2023-11-04T01:11:10.943 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:11:10.943 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923 --owner scheduled_pdonnell@teuthology --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --verbose -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/orig.config.yaml 2023-11-04T01:11:10.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:11:11.072 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7445923' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231103.180916 sha1: 702f9e6492477037e018f68dfdf636a30c24f329 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7192 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231103.180916 suite_path: /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 702f9e6492477037e018f68dfdf636a30c24f329 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObjzkOIRGUA/IGRZGae37U/XDfCXtLtiK/EkhveSRNXY05XcUpf0WEB+mPgaqfQVuR3/mzKeWsP7F092gmawQc= smithi091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGp5T0z04DJrPMtyLJse+C9AA/f1IUwrnreXuSXlkCBjRW4LDq6ssOWsdbrX8AQSoEspz75IP7kWmHJtBc1K1Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-03_18:12:33 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T01:11:11.073 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa; will attempt to use it 2023-11-04T01:11:11.073 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks 2023-11-04T01:11:11.073 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T01:11:11.075 INFO:teuthology.task.internal:Checking packages... 2023-11-04T01:11:11.096 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-04T01:11:11.096 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T01:11:11.096 INFO:teuthology.packaging:ref: None 2023-11-04T01:11:11.096 INFO:teuthology.packaging:tag: None 2023-11-04T01:11:11.096 INFO:teuthology.packaging:branch: main 2023-11-04T01:11:11.096 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:11:11.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-11-04T01:11:11.477 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7052-g7188d8cd-1jammy 2023-11-04T01:11:11.477 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T01:11:11.487 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T01:11:11.487 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T01:11:11.499 INFO:teuthology.task.internal:Saving configuration 2023-11-04T01:11:11.513 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T01:11:11.521 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:11:11.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:37.139718', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMdf9JklOLHS75MpBPEpD1C6Nfb+2eoRkYJye8bnr9ra'} 2023-11-04T01:11:11.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:37.138360', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII2DrXb/o4p2gba/zLl9vlMNo8Qmk8/QbSzX4+5UclER'} 2023-11-04T01:11:11.570 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T01:11:11.578 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-04T01:11:11.578 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-04T01:11:11.578 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T01:11:11.650 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f89aa6de040>, signals=[15]) 2023-11-04T01:11:11.651 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T01:11:11.656 INFO:teuthology.task.internal:Opening connections... 2023-11-04T01:11:11.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:11:11.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:11:11.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:11:11.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:11:11.807 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T01:11:11.814 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-11-04T01:11:11.819 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-11-04T01:11:11.820 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-11-04T01:11:11.867 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T01:11:11.867 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2023-11-04T01:11:11.867 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04" 2023-11-04T01:11:11.867 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T01:11:11.867 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T01:11:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy 2023-11-04T01:11:11.869 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-11-04T01:11:11.890 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2023-11-04T01:11:11.895 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2023-11-04T01:11:11.895 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu" 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="22.04" 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=jammy 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T01:11:11.940 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T01:11:11.941 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T01:11:11.941 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=jammy 2023-11-04T01:11:11.941 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-11-04T01:11:11.965 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T01:11:11.974 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T01:11:11.980 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T01:11:11.980 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:11:11.982 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:11:11.991 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T01:11:11.998 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T01:11:11.998 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:11:12.029 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:11:12.037 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T01:11:12.091 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T01:11:12.104 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T01:11:12.104 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T01:11:12.105 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:11:12.105 DEBUG:teuthology.orchestra.run.smithi091:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:11:12.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:11:12.110 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-11-04T01:11:12.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:11:12.111 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-11-04T01:11:12.156 INFO:teuthology.orchestra.run.smithi091.stdout:5.15.0-56-generic 2023-11-04T01:11:12.156 INFO:teuthology.task.kernel:Running kernel on smithi091: 5.15.0-56-generic 2023-11-04T01:11:12.156 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2023-11-04T01:11:12.160 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-56-generic 2023-11-04T01:11:12.160 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.15.0-56-generic 2023-11-04T01:11:12.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2023-11-04T01:11:12.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-11-04T01:11:12.291 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-11-04T01:11:12.417 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:11:12.417 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:11:12.420 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-04T01:11:12.420 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-04T01:11:12.430 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-04T01:11:12.479 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-04T01:11:12.492 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-04T01:11:12.532 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-04T01:11:12.638 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,149 kB] 2023-11-04T01:11:12.666 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [940 kB] 2023-11-04T01:11:12.719 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [524 kB] 2023-11-04T01:11:12.724 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [245 kB] 2023-11-04T01:11:12.727 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-04T01:11:12.727 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,105 kB] 2023-11-04T01:11:12.742 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.9 kB] 2023-11-04T01:11:12.742 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [179 kB] 2023-11-04T01:11:12.744 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:11:12.744 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [999 kB] 2023-11-04T01:11:12.748 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [524 kB] 2023-11-04T01:11:12.752 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [661 kB] 2023-11-04T01:11:12.758 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [219 kB] 2023-11-04T01:11:12.760 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-04T01:11:12.766 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [360 kB] 2023-11-04T01:11:12.771 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [186 kB] 2023-11-04T01:11:12.773 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-04T01:11:12.774 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-04T01:11:12.774 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,085 kB] 2023-11-04T01:11:12.775 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-04T01:11:12.775 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-04T01:11:12.775 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-04T01:11:12.776 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-04T01:11:12.777 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-04T01:11:12.778 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-04T01:11:12.778 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-04T01:11:12.779 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-04T01:11:12.794 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-04T01:11:12.794 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-04T01:11:12.795 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-04T01:11:12.795 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-04T01:11:12.825 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [176 kB] 2023-11-04T01:11:12.826 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:11:12.826 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [797 kB] 2023-11-04T01:11:12.826 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,149 kB] 2023-11-04T01:11:12.829 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [563 kB] 2023-11-04T01:11:12.834 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [146 kB] 2023-11-04T01:11:12.835 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-04T01:11:12.835 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-04T01:11:12.836 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-04T01:11:12.836 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-04T01:11:12.839 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [245 kB] 2023-11-04T01:11:12.842 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-04T01:11:12.842 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.9 kB] 2023-11-04T01:11:12.843 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,105 kB] 2023-11-04T01:11:12.843 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-04T01:11:12.857 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [179 kB] 2023-11-04T01:11:12.859 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:11:12.859 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [661 kB] 2023-11-04T01:11:12.865 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [999 kB] 2023-11-04T01:11:12.874 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [219 kB] 2023-11-04T01:11:12.876 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-04T01:11:12.876 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-04T01:11:12.877 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-04T01:11:12.877 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-04T01:11:12.877 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-04T01:11:12.893 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-04T01:11:12.893 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-04T01:11:12.894 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-04T01:11:12.894 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-04T01:11:12.910 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-04T01:11:12.910 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-04T01:11:12.910 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-04T01:11:12.910 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-04T01:11:12.955 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [360 kB] 2023-11-04T01:11:13.218 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [940 kB] 2023-11-04T01:11:13.366 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [186 kB] 2023-11-04T01:11:13.385 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-04T01:11:13.386 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,085 kB] 2023-11-04T01:11:13.454 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-04T01:11:13.456 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [176 kB] 2023-11-04T01:11:13.466 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:11:13.466 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [563 kB] 2023-11-04T01:11:13.488 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [797 kB] 2023-11-04T01:11:13.677 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [146 kB] 2023-11-04T01:11:14.066 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-04T01:11:14.072 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-04T01:11:14.087 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-04T01:11:14.088 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-04T01:11:14.091 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-04T01:11:18.422 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 10.1 MB in 2s (6,436 kB/s) 2023-11-04T01:11:18.423 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 10.1 MB in 2s (5,808 kB/s) 2023-11-04T01:11:19.730 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:11:19.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:11:19.802 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:11:19.866 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:11:19.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:11:19.939 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:11:19.971 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-11-04T01:11:19.972 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-11-04T01:11:20.121 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:11:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:11:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:11:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:11:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-04T01:11:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: python2.7-minimal 2023-11-04T01:11:20.122 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:11:20.123 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-11-04T01:11:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:11:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-generic linux-image-5.15.0-88-generic 2023-11-04T01:11:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-5.15.0-88-generic linux-modules-extra-5.15.0-88-generic 2023-11-04T01:11:20.124 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-11-04T01:11:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-04T01:11:20.124 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2023-11-04T01:11:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: thermald 2023-11-04T01:11:20.125 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-04T01:11:20.126 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-04T01:11:20.169 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-11-04T01:11:20.170 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:11:20.170 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.15.0-88-generic linux-modules-5.15.0-88-generic 2023-11-04T01:11:20.170 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-extra-5.15.0-88-generic 2023-11-04T01:11:20.170 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-11-04T01:11:20.171 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-04T01:11:20.225 INFO:teuthology.orchestra.run.smithi040.stdout:3 upgraded, 5 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:11:20.225 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 113 MB of archives. 2023-11-04T01:11:20.225 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-04T01:11:20.225 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-88-generic amd64 5.15.0-88.98 [22.4 MB] 2023-11-04T01:11:20.283 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:11:20.283 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:11:20.283 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:11:20.283 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:11:20.284 INFO:teuthology.orchestra.run.smithi091.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-04T01:11:20.284 INFO:teuthology.orchestra.run.smithi091.stdout: python2.7-minimal 2023-11-04T01:11:20.284 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:11:20.285 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-11-04T01:11:20.285 INFO:teuthology.orchestra.run.smithi091.stdout: linux-generic linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:11:20.285 INFO:teuthology.orchestra.run.smithi091.stdout: linux-headers-generic linux-image-5.15.0-88-generic 2023-11-04T01:11:20.285 INFO:teuthology.orchestra.run.smithi091.stdout: linux-modules-5.15.0-88-generic linux-modules-extra-5.15.0-88-generic 2023-11-04T01:11:20.286 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-11-04T01:11:20.286 INFO:teuthology.orchestra.run.smithi091.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-04T01:11:20.286 INFO:teuthology.orchestra.run.smithi091.stdout:Recommended packages: 2023-11-04T01:11:20.286 INFO:teuthology.orchestra.run.smithi091.stdout: thermald 2023-11-04T01:11:20.330 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-11-04T01:11:20.330 INFO:teuthology.orchestra.run.smithi091.stdout: linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:11:20.330 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.15.0-88-generic linux-modules-5.15.0-88-generic 2023-11-04T01:11:20.331 INFO:teuthology.orchestra.run.smithi091.stdout: linux-modules-extra-5.15.0-88-generic 2023-11-04T01:11:20.331 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2023-11-04T01:11:20.332 INFO:teuthology.orchestra.run.smithi091.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-04T01:11:20.510 INFO:teuthology.orchestra.run.smithi091.stdout:3 upgraded, 5 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:11:20.510 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 113 MB of archives. 2023-11-04T01:11:20.511 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-04T01:11:20.511 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-88-generic amd64 5.15.0-88.98 [22.4 MB] 2023-11-04T01:11:20.846 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-88-generic amd64 5.15.0-88.98 [11.5 MB] 2023-11-04T01:11:21.058 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-88-generic amd64 5.15.0-88.98 [64.0 MB] 2023-11-04T01:11:21.920 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-88-generic amd64 5.15.0-88.98 [11.5 MB] 2023-11-04T01:11:22.270 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-88-generic amd64 5.15.0-88.98 [64.0 MB] 2023-11-04T01:11:22.275 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.88.85 [1,698 B] 2023-11-04T01:11:22.275 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.88.85 [2,488 B] 2023-11-04T01:11:22.276 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88 all 5.15.0-88.98 [12.3 MB] 2023-11-04T01:11:22.559 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88-generic amd64 5.15.0-88.98 [2,878 kB] 2023-11-04T01:11:22.640 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.88.85 [2,340 B] 2023-11-04T01:11:23.057 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 113 MB in 2s (45.9 MB/s) 2023-11-04T01:11:23.214 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-5.15.0-88-generic. 2023-11-04T01:11:24.448 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.88.85 [1,698 B] 2023-11-04T01:11:24.448 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.88.85 [2,488 B] 2023-11-04T01:11:24.448 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88 all 5.15.0-88.98 [12.3 MB] 2023-11-04T01:11:25.210 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-04T01:11:25.214 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../0-linux-modules-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:25.319 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:25.371 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88-generic amd64 5.15.0-88.98 [2,878 kB] 2023-11-04T01:11:25.498 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.88.85 [2,340 B] 2023-11-04T01:11:25.897 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 113 MB in 5s (21.9 MB/s) 2023-11-04T01:11:26.083 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-modules-5.15.0-88-generic. 2023-11-04T01:11:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-image-5.15.0-88-generic. 2023-11-04T01:11:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../1-linux-image-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:28.156 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-04T01:11:28.160 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../0-linux-modules-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:28.271 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-88-generic. 2023-11-04T01:11:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:30.905 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-image-5.15.0-88-generic. 2023-11-04T01:11:30.926 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../1-linux-image-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:31.024 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:31.533 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-88-generic. 2023-11-04T01:11:31.554 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:31.591 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:34.885 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../3-linux-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:11:35.011 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:11:35.303 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:11:35.398 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:11:35.693 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-88. 2023-11-04T01:11:35.715 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../5-linux-headers-5.15.0-88_5.15.0-88.98_all.deb ... 2023-11-04T01:11:35.759 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:11:38.059 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../3-linux-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:11:38.177 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:11:38.535 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:11:38.656 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-image-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:11:38.984 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-headers-5.15.0-88. 2023-11-04T01:11:39.006 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../5-linux-headers-5.15.0-88_5.15.0-88.98_all.deb ... 2023-11-04T01:11:39.050 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:11:41.381 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-88-generic. 2023-11-04T01:11:41.418 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../6-linux-headers-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:11:41.456 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:11:44.145 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:22:49.643 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:22:49.643 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-generic (5.15.0.88.85) ... 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:49.644 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-generic (5.15.0.88.85) ... 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-generic (5.15.0.88.85) ... 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub' 2023-11-04T01:22:49.645 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Generating grub configuration file ... 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:22:49.646 INFO:teuthology.orchestra.run.smithi040.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:22:49.647 INFO:teuthology.orchestra.run.smithi040.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:22:49.647 INFO:teuthology.orchestra.run.smithi040.stdout:done 2023-11-04T01:22:49.648 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2023-11-04T01:22:49.649 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-headers-5.15.0-88-generic. 2023-11-04T01:22:49.649 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../6-linux-headers-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:22:49.649 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.649 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:22:49.649 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-generic (5.15.0.88.85) ... 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.650 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-image-generic (5.15.0.88.85) ... 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-generic (5.15.0.88.85) ... 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:Sourcing file `/etc/default/grub' 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:22:49.651 INFO:teuthology.orchestra.run.smithi091.stdout:Generating grub configuration file ... 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:22:49.652 INFO:teuthology.orchestra.run.smithi091.stdout:done 2023-11-04T01:22:49.653 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2023-11-04T01:22:49.684 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2023-11-04T01:22:49.684 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2023-11-04T01:22:49.684 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2023-11-04T01:22:49.684 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2023-11-04T01:22:49.684 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 20 2023-11-04T01:22:49.684 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 5.15.0.88.85 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2023-11-04T01:22:49.685 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.88.85 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:22:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2023-11-04T01:22:49.687 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2023-11-04T01:22:49.687 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:22:49.687 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2023-11-04T01:22:49.687 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-88-generic 2023-11-04T01:22:49.687 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:22:49.687 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:22:49.687 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T01:22:49.688 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi091.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:22:49.688 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2023-11-04T01:22:49.688 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-88-generic 2023-11-04T01:22:49.688 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:22:49.688 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:22:49.689 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T01:22:49.689 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:22:49.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2023-11-04T01:22:49.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-11-04T01:22:49.922 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-11-04T01:22:49.994 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:22:50.003 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:22:50.020 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:22:50.049 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:22:50.049 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:22:50.053 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:22:50.073 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:22:50.113 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:22:51.286 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:22:51.304 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:22:51.354 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:22:51.365 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:22:51.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:22:51.434 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:22:51.547 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-04T01:22:51.547 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-04T01:22:51.622 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-11-04T01:22:51.622 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-11-04T01:22:51.690 INFO:teuthology.orchestra.run.smithi091.stdout:linux-image-generic is already the newest version (5.15.0.88.85). 2023-11-04T01:22:51.690 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:22:51.690 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:22:51.690 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:22:51.690 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:22:51.691 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:22:51.691 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:22:51.691 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:22:51.726 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 0 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:22:51.728 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2023-11-04T01:22:51.739 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2023-11-04T01:22:51.739 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2023-11-04T01:22:51.739 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2023-11-04T01:22:51.739 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2023-11-04T01:22:51.739 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 20 2023-11-04T01:22:51.739 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 5.15.0.88.85 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:22:51.740 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2023-11-04T01:22:51.740 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-04T01:22:51.786 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.hMlzOC4ipT 2023-11-04T01:22:51.786 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hMlzOC4ipT 2023-11-04T01:22:51.793 INFO:teuthology.orchestra.run.smithi040.stdout:linux-image-generic is already the newest version (5.15.0.88.85). 2023-11-04T01:22:51.793 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:22:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:22:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:22:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:22:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:22:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:22:51.794 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:22:51.833 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 0 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:22:51.836 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2023-11-04T01:22:51.842 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.hMlzOC4ipT 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:22:51.852 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.88.85 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:22:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2023-11-04T01:22:51.853 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-11-04T01:22:51.899 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.SHqfeC7ANx 2023-11-04T01:22:51.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SHqfeC7ANx 2023-11-04T01:22:51.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.SHqfeC7ANx 2023-11-04T01:22:51.960 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.hMlzOC4ipT is 10KB 2023-11-04T01:22:51.975 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.hMlzOC4ipT 2023-11-04T01:22:51.980 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-04T01:22:52.033 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:22:52.033 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-04T01:22:52.034 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-04T01:22:52.076 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.SHqfeC7ANx is 10KB 2023-11-04T01:22:52.089 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.SHqfeC7ANx 2023-11-04T01:22:52.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-04T01:22:52.132 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-88-generic 2023-11-04T01:22:52.133 DEBUG:teuthology.orchestra.run.smithi091:> sudo update-grub 2023-11-04T01:22:52.147 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:22:52.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-04T01:22:52.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-04T01:22:52.229 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-88-generic 2023-11-04T01:22:52.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo update-grub 2023-11-04T01:22:53.440 INFO:teuthology.orchestra.run.smithi091.stderr:Sourcing file `/etc/default/grub' 2023-11-04T01:22:53.441 INFO:teuthology.orchestra.run.smithi091.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:22:53.455 INFO:teuthology.orchestra.run.smithi091.stderr:Generating grub configuration file ... 2023-11-04T01:22:53.459 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub' 2023-11-04T01:22:53.460 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:22:53.465 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2023-11-04T01:22:53.639 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:22:53.646 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:22:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:22:53.948 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:22:53.953 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:22:53.994 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:22:54.000 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:22:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:22:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:22:54.064 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:22:54.069 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:22:54.145 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:22:54.145 INFO:teuthology.orchestra.run.smithi091.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:22:54.145 INFO:teuthology.orchestra.run.smithi091.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:22:54.165 INFO:teuthology.orchestra.run.smithi091.stderr:done 2023-11-04T01:22:54.173 DEBUG:teuthology.orchestra.run.smithi091:> sudo shutdown -r now 2023-11-04T01:22:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:22:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:22:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:22:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:done 2023-11-04T01:22:54.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2023-11-04T01:23:24.206 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T01:23:24.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-04T01:23:24.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:23:24.252 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T01:23:24.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-04T01:23:24.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:24.267 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T01:24:24.267 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T01:24:33.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-04T01:24:33.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:33.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-04T01:24:33.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:34.299 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-11-04T01:24:36.318 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-11-04T01:24:46.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-04T01:24:46.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:46.614 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-11-04T01:24:47.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-04T01:24:47.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-88-generic"... 2023-11-04T01:24:47.210 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-11-04T01:24:47.256 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-88-generic 2023-11-04T01:24:47.256 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-88-generic vs 5.15.0-88-generic 2023-11-04T01:24:47.256 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:24:47.257 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-04T01:24:48.258 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T01:24:48.258 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:24:48.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-04T01:24:48.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:48.322 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2023-11-04T01:24:48.346 DEBUG:teuthology.parallel:result is None 2023-11-04T01:24:48.571 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-11-04T01:24:49.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-04T01:24:49.184 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-88-generic"... 2023-11-04T01:24:49.185 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-11-04T01:24:49.231 INFO:teuthology.orchestra.run.smithi091.stdout:5.15.0-88-generic 2023-11-04T01:24:49.232 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-88-generic vs 5.15.0-88-generic 2023-11-04T01:24:49.232 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:24:49.232 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-04T01:24:50.233 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T01:24:50.233 DEBUG:teuthology.orchestra.run.smithi091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:24:50.559 INFO:teuthology.orchestra.run.smithi091.stdout:ttyS1 2023-11-04T01:24:50.589 DEBUG:teuthology.parallel:result is None 2023-11-04T01:24:50.589 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T01:24:50.602 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T01:24:50.603 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:50.605 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:24:50.610 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T01:24:50.663 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T01:24:50.677 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T01:24:50.677 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:50.679 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:24:50.709 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T01:24:50.721 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T01:24:50.722 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:50.733 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:24:50.754 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:50.762 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:50.763 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:50.770 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:24:50.772 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T01:24:50.785 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T01:24:50.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:50.809 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:24:50.828 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T01:24:50.845 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T01:24:50.845 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:50.865 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:24:50.879 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:50.916 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:50.968 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:24:50.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:51.029 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:24:51.035 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:24:51.083 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:24:51.083 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:24:51.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-11-04T01:24:51.151 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2023-11-04T01:24:51.238 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T01:24:51.246 INFO:teuthology.task.internal:Starting timer... 2023-11-04T01:24:51.246 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T01:24:51.259 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T01:24:51.270 DEBUG:teuthology.task.selinux:Excluding smithi040: OS 'ubuntu' does not support SELinux 2023-11-04T01:24:51.271 DEBUG:teuthology.task.selinux:Excluding smithi091: OS 'ubuntu' does not support SELinux 2023-11-04T01:24:51.271 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T01:24:51.271 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-04T01:24:51.271 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T01:24:51.271 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T01:24:51.282 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-04T01:24:51.282 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T01:24:51.301 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T01:24:51.302 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi091.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T01:35:58.084 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi091.front.sepia.ceph.com')] 2023-11-04T01:35:58.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-04T01:35:58.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:35:58.171 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-11-04T01:35:58.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-11-04T01:35:58.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-04T01:35:58.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:35:58.379 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-11-04T01:35:58.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-11-04T01:35:58.479 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T01:35:58.492 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T01:35:58.493 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:35:58.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:35:58.500 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:35:58.500 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-04T01:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Command line: ntpd -gq 2023-11-04T01:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: ---------------------------------------------------- 2023-11-04T01:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: ntp-4 is maintained by Network Time Foundation, 2023-11-04T01:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-04T01:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: corporation. Support and training for ntp-4 are 2023-11-04T01:35:58.530 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: available at https://www.nwtime.org/support 2023-11-04T01:35:58.530 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: ---------------------------------------------------- 2023-11-04T01:35:58.530 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: proto: precision = 0.047 usec (-24) 2023-11-04T01:35:58.530 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: basedate set to 2022-02-04 2023-11-04T01:35:58.530 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: gps base set to 2022-02-06 (week 2196) 2023-11-04T01:35:58.531 INFO:teuthology.orchestra.run.smithi040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:35:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:35:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:35:58.531 INFO:teuthology.orchestra.run.smithi040.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:35:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listen and drop on 0 v6wildcard [::]:123 2023-11-04T01:35:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-04T01:35:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listen normally on 2 lo 127.0.0.1:123 2023-11-04T01:35:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listen normally on 3 ens1f0 172.21.15.40:123 2023-11-04T01:35:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listen normally on 4 lo [::1]:123 2023-11-04T01:35:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12cc%4]:123 2023-11-04T01:35:58.533 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:35:58 ntpd[27933]: Listening on routing socket on fd #22 for interface updates 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Command line: ntpd -gq 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: ---------------------------------------------------- 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: ntp-4 is maintained by Network Time Foundation, 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: corporation. Support and training for ntp-4 are 2023-11-04T01:35:58.545 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: available at https://www.nwtime.org/support 2023-11-04T01:35:58.546 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: ---------------------------------------------------- 2023-11-04T01:35:58.546 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: proto: precision = 0.044 usec (-24) 2023-11-04T01:35:58.546 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: basedate set to 2022-02-04 2023-11-04T01:35:58.546 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: gps base set to 2022-02-06 (week 2196) 2023-11-04T01:35:58.547 INFO:teuthology.orchestra.run.smithi091.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:35:58.547 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:35:58.548 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:35:58.548 INFO:teuthology.orchestra.run.smithi091.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:35:58.549 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listen and drop on 0 v6wildcard [::]:123 2023-11-04T01:35:58.549 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-04T01:35:58.549 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listen normally on 2 lo 127.0.0.1:123 2023-11-04T01:35:58.549 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listen normally on 3 enp3s0f1 172.21.15.91:123 2023-11-04T01:35:58.549 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listen normally on 4 lo [::1]:123 2023-11-04T01:35:58.549 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d5%5]:123 2023-11-04T01:35:58.550 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:35:58 ntpd[27999]: Listening on routing socket on fd #22 for interface updates 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:35:59.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:35:59.531 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:35:59 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:35:59.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:35:59 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:35:59.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:35:59 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:35:59.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:35:59 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:35:59.550 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:35:59 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:35:59.550 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:35:59 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:35:59.550 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:35:59 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:00.529 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:00 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:00.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:00 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:00.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:00 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:00.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:00 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:00.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:00 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:00.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:00 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:01.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:01 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:01.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:01 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:01.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:01 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:01.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:01 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:01.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:01 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:01.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:01 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:01.548 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:01 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:01.548 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:01 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:01.548 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:01 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:01.548 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:01 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:01.548 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:01 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:01.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:01 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:02.529 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:02 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:02.529 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:02 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:02.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:02 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:02.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:02 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:02.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:02 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:02.530 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:02 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:02.546 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:02.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:02.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:02.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:02.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:02 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:03.532 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.532 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:03.533 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:03 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:03.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:03 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:04.531 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:04 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:04.531 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:04 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:04.531 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:04 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:04.531 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:04 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:04.532 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:04 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:04.532 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:04 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:04.547 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:04.548 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:04 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:05.539 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:05.539 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:05.539 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:05.539 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:05.540 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:05.540 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:05.540 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:05.540 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:05.540 INFO:teuthology.orchestra.run.smithi040.stdout: 4 Nov 01:36:05 ntpd[27933]: ntpd: time slew -0.000031 s 2023-11-04T01:36:05.540 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd: time slew -0.000031s 2023-11-04T01:36:05.541 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-04T01:36:05.541 INFO:teuthology.orchestra.run.smithi040.stderr: 4 Nov 01:36:05 ntpd[27933]: can't open /var/log/ntpstats/loopstats.20231104: Permission denied 2023-11-04T01:36:05.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:05.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:05.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:36:05.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:36:05.549 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:36:05.550 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:36:05.550 INFO:teuthology.orchestra.run.smithi091.stdout: 4 Nov 01:36:05 ntpd[27999]: ntpd: time slew -0.003158 s 2023-11-04T01:36:05.550 INFO:teuthology.orchestra.run.smithi091.stdout:ntpd: time slew -0.003158s 2023-11-04T01:36:05.551 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-04T01:36:05.551 INFO:teuthology.orchestra.run.smithi091.stderr: 4 Nov 01:36:05 ntpd[27999]: can't open /var/log/ntpstats/loopstats.20231104: Permission denied 2023-11-04T01:36:05.602 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T01:36:05.602 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2023-11-04T01:36:05.602 INFO:teuthology.orchestra.run.smithi040.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.602 INFO:teuthology.orchestra.run.smithi040.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.602 INFO:teuthology.orchestra.run.smithi040.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.602 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.630 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T01:36:05.630 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2023-11-04T01:36:05.630 INFO:teuthology.orchestra.run.smithi091.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.631 INFO:teuthology.orchestra.run.smithi091.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.631 INFO:teuthology.orchestra.run.smithi091.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.631 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:36:05.631 INFO:teuthology.run_tasks:Running task install... 2023-11-04T01:36:05.641 DEBUG:teuthology.task.install:project ceph 2023-11-04T01:36:05.641 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-04T01:36:05.641 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-04T01:36:05.641 INFO:teuthology.task.install:Using flavor: default 2023-11-04T01:36:05.647 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T01:36:05.647 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-04T01:36:05.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-key list | grep Ceph 2023-11-04T01:36:05.649 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-key list | grep Ceph 2023-11-04T01:36:05.717 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-04T01:36:05.727 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-04T01:36:05.745 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-04T01:36:05.745 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph.com (release key) 2023-11-04T01:36:05.746 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-04T01:36:05.746 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-04T01:36:05.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:36:05.754 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-04T01:36:05.754 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph.com (release key) 2023-11-04T01:36:05.755 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-04T01:36:05.755 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-04T01:36:05.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:36:05.968 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default/ 2023-11-04T01:36:05.969 INFO:teuthology.task.install.deb:Package version is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:36:05.975 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default/ 2023-11-04T01:36:05.976 INFO:teuthology.task.install.deb:Package version is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:36:06.080 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:36:06.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-04T01:36:06.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-11-04T01:36:06.105 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:36:06.106 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-04T01:36:06.161 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-11-04T01:36:06.325 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:36:06.326 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-04T01:36:06.337 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-04T01:36:06.380 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy InRelease 2023-11-04T01:36:06.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy InRelease 2023-11-04T01:36:06.401 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-04T01:36:06.404 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:36:06.404 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:36:06.412 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:36:06.422 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-04T01:36:06.427 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-04T01:36:06.442 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-04T01:36:06.464 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-04T01:36:06.471 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-11-04T01:36:06.477 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:36:06.500 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-04T01:36:06.542 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-11-04T01:36:06.563 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,105 kB] 2023-11-04T01:36:06.563 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:36:06.639 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-11-04T01:36:06.640 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-04T01:36:06.801 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 27.8 kB in 1s (54.5 kB/s) 2023-11-04T01:36:06.850 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 1,437 kB in 0s (2,914 kB/s) 2023-11-04T01:36:07.703 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:36:07.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7035-g7532011a-1jammy cephadm=18.0.0-7035-g7532011a-1jammy ceph-mds=18.0.0-7035-g7532011a-1jammy ceph-mgr=18.0.0-7035-g7532011a-1jammy ceph-common=18.0.0-7035-g7532011a-1jammy ceph-fuse=18.0.0-7035-g7532011a-1jammy ceph-test=18.0.0-7035-g7532011a-1jammy ceph-volume=18.0.0-7035-g7532011a-1jammy radosgw=18.0.0-7035-g7532011a-1jammy python3-rados=18.0.0-7035-g7532011a-1jammy python3-rgw=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy python3-rbd=18.0.0-7035-g7532011a-1jammy libcephfs2=18.0.0-7035-g7532011a-1jammy libcephfs-dev=18.0.0-7035-g7532011a-1jammy librados2=18.0.0-7035-g7532011a-1jammy librbd1=18.0.0-7035-g7532011a-1jammy rbd-fuse=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy cephfs-shell=18.0.0-7035-g7532011a-1jammy cephfs-top=18.0.0-7035-g7532011a-1jammy cephfs-mirror=18.0.0-7035-g7532011a-1jammy 2023-11-04T01:36:07.753 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:36:07.768 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7035-g7532011a-1jammy cephadm=18.0.0-7035-g7532011a-1jammy ceph-mds=18.0.0-7035-g7532011a-1jammy ceph-mgr=18.0.0-7035-g7532011a-1jammy ceph-common=18.0.0-7035-g7532011a-1jammy ceph-fuse=18.0.0-7035-g7532011a-1jammy ceph-test=18.0.0-7035-g7532011a-1jammy ceph-volume=18.0.0-7035-g7532011a-1jammy radosgw=18.0.0-7035-g7532011a-1jammy python3-rados=18.0.0-7035-g7532011a-1jammy python3-rgw=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy python3-rbd=18.0.0-7035-g7532011a-1jammy libcephfs2=18.0.0-7035-g7532011a-1jammy libcephfs-dev=18.0.0-7035-g7532011a-1jammy librados2=18.0.0-7035-g7532011a-1jammy librbd1=18.0.0-7035-g7532011a-1jammy rbd-fuse=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy cephfs-shell=18.0.0-7035-g7532011a-1jammy cephfs-top=18.0.0-7035-g7532011a-1jammy cephfs-mirror=18.0.0-7035-g7532011a-1jammy 2023-11-04T01:36:07.783 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:36:07.828 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:36:07.974 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-11-04T01:36:07.975 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-11-04T01:36:08.013 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-04T01:36:08.014 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-04T01:36:08.147 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:36:08.148 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:36:08.148 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:36:08.148 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:36:08.148 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:36:08.148 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:36:08.149 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:36:08.149 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-11-04T01:36:08.149 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-04T01:36:08.149 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-04T01:36:08.150 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-04T01:36:08.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-04T01:36:08.152 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-04T01:36:08.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-04T01:36:08.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-04T01:36:08.154 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-04T01:36:08.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-04T01:36:08.155 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-04T01:36:08.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:36:08.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:36:08.156 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:36:08.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:36:08.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:36:08.157 INFO:teuthology.orchestra.run.smithi040.stdout: socat xmlstarlet 2023-11-04T01:36:08.157 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-watchdog 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2023-11-04T01:36:08.158 INFO:teuthology.orchestra.run.smithi040.stdout: btrfs-tools 2023-11-04T01:36:08.185 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:36:08.185 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:36:08.186 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:36:08.186 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:36:08.186 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:36:08.186 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:36:08.187 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:36:08.187 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-11-04T01:36:08.187 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-04T01:36:08.187 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-04T01:36:08.188 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:36:08.189 INFO:teuthology.orchestra.run.smithi091.stdout: socat xmlstarlet 2023-11-04T01:36:08.190 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-11-04T01:36:08.192 INFO:teuthology.orchestra.run.smithi091.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-04T01:36:08.192 INFO:teuthology.orchestra.run.smithi091.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-04T01:36:08.192 INFO:teuthology.orchestra.run.smithi091.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-04T01:36:08.192 INFO:teuthology.orchestra.run.smithi091.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-04T01:36:08.192 INFO:teuthology.orchestra.run.smithi091.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-04T01:36:08.193 INFO:teuthology.orchestra.run.smithi091.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-04T01:36:08.195 INFO:teuthology.orchestra.run.smithi091.stdout: python3-watchdog 2023-11-04T01:36:08.195 INFO:teuthology.orchestra.run.smithi091.stdout:Recommended packages: 2023-11-04T01:36:08.195 INFO:teuthology.orchestra.run.smithi091.stdout: btrfs-tools 2023-11-04T01:36:08.259 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-11-04T01:36:08.260 INFO:teuthology.orchestra.run.smithi040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-04T01:36:08.260 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-04T01:36:08.260 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-04T01:36:08.260 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-04T01:36:08.261 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:36:08.261 INFO:teuthology.orchestra.run.smithi040.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-04T01:36:08.261 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-04T01:36:08.261 INFO:teuthology.orchestra.run.smithi040.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-04T01:36:08.261 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-04T01:36:08.261 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:36:08.262 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:36:08.263 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:36:08.263 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:36:08.263 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:36:08.263 INFO:teuthology.orchestra.run.smithi040.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-04T01:36:08.290 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-11-04T01:36:08.290 INFO:teuthology.orchestra.run.smithi091.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-04T01:36:08.290 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-04T01:36:08.290 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-04T01:36:08.290 INFO:teuthology.orchestra.run.smithi091.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-04T01:36:08.291 INFO:teuthology.orchestra.run.smithi091.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:36:08.291 INFO:teuthology.orchestra.run.smithi091.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-04T01:36:08.291 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-04T01:36:08.291 INFO:teuthology.orchestra.run.smithi091.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-04T01:36:08.291 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-04T01:36:08.292 INFO:teuthology.orchestra.run.smithi091.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:36:08.293 INFO:teuthology.orchestra.run.smithi091.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:36:08.293 INFO:teuthology.orchestra.run.smithi091.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:36:08.293 INFO:teuthology.orchestra.run.smithi091.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:36:08.293 INFO:teuthology.orchestra.run.smithi091.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:36:08.293 INFO:teuthology.orchestra.run.smithi091.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-04T01:36:08.324 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 114 newly installed, 0 to remove and 258 not upgraded. 2023-11-04T01:36:08.324 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 185 MB of archives. 2023-11-04T01:36:08.324 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-04T01:36:08.324 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-04T01:36:08.346 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-04T01:36:08.355 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-04T01:36:08.402 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-04T01:36:08.424 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-04T01:36:08.427 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-04T01:36:08.440 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-04T01:36:08.477 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 114 newly installed, 0 to remove and 258 not upgraded. 2023-11-04T01:36:08.477 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 185 MB of archives. 2023-11-04T01:36:08.477 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-04T01:36:08.477 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-04T01:36:08.492 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-04T01:36:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-04T01:36:08.510 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-04T01:36:08.511 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-04T01:36:08.512 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-04T01:36:08.521 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-04T01:36:08.521 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-04T01:36:08.521 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-04T01:36:08.526 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-04T01:36:08.526 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-04T01:36:08.535 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-04T01:36:08.535 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-04T01:36:08.536 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-04T01:36:08.555 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-04T01:36:08.555 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-04T01:36:08.559 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-04T01:36:08.559 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-04T01:36:08.559 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-04T01:36:08.560 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-04T01:36:08.561 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-04T01:36:08.562 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-04T01:36:08.574 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-04T01:36:08.575 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-04T01:36:08.576 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-04T01:36:08.594 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-04T01:36:08.595 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-04T01:36:08.602 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7035-g7532011a-1jammy [3,467 kB] 2023-11-04T01:36:08.602 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-04T01:36:08.602 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-04T01:36:08.602 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-04T01:36:08.602 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-04T01:36:08.604 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-04T01:36:08.604 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-04T01:36:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-04T01:36:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-11-04T01:36:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-04T01:36:08.633 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-04T01:36:08.638 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-04T01:36:08.639 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-04T01:36:08.644 INFO:teuthology.orchestra.run.smithi040.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-04T01:36:08.717 INFO:teuthology.orchestra.run.smithi040.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-04T01:36:08.717 INFO:teuthology.orchestra.run.smithi040.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-04T01:36:08.719 INFO:teuthology.orchestra.run.smithi040.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-04T01:36:08.719 INFO:teuthology.orchestra.run.smithi040.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-04T01:36:08.719 INFO:teuthology.orchestra.run.smithi040.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-04T01:36:08.720 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7035-g7532011a-1jammy [3,467 kB] 2023-11-04T01:36:08.720 INFO:teuthology.orchestra.run.smithi040.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-04T01:36:08.738 INFO:teuthology.orchestra.run.smithi040.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-04T01:36:08.740 INFO:teuthology.orchestra.run.smithi040.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-04T01:36:08.741 INFO:teuthology.orchestra.run.smithi040.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-04T01:36:08.756 INFO:teuthology.orchestra.run.smithi040.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-04T01:36:08.760 INFO:teuthology.orchestra.run.smithi040.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-04T01:36:08.760 INFO:teuthology.orchestra.run.smithi040.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-04T01:36:08.761 INFO:teuthology.orchestra.run.smithi040.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-04T01:36:08.761 INFO:teuthology.orchestra.run.smithi040.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-04T01:36:08.762 INFO:teuthology.orchestra.run.smithi040.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-04T01:36:08.762 INFO:teuthology.orchestra.run.smithi040.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-04T01:36:08.780 INFO:teuthology.orchestra.run.smithi040.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-04T01:36:08.783 INFO:teuthology.orchestra.run.smithi040.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-04T01:36:08.785 INFO:teuthology.orchestra.run.smithi040.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-04T01:36:08.787 INFO:teuthology.orchestra.run.smithi040.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-04T01:36:08.799 INFO:teuthology.orchestra.run.smithi040.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-04T01:36:08.804 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-04T01:36:08.805 INFO:teuthology.orchestra.run.smithi040.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-04T01:36:08.806 INFO:teuthology.orchestra.run.smithi040.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-04T01:36:08.806 INFO:teuthology.orchestra.run.smithi040.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-04T01:36:08.813 INFO:teuthology.orchestra.run.smithi040.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-04T01:36:08.819 INFO:teuthology.orchestra.run.smithi040.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-04T01:36:08.819 INFO:teuthology.orchestra.run.smithi040.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-04T01:36:08.820 INFO:teuthology.orchestra.run.smithi040.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-04T01:36:08.820 INFO:teuthology.orchestra.run.smithi040.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-04T01:36:08.825 INFO:teuthology.orchestra.run.smithi040.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-04T01:36:08.841 INFO:teuthology.orchestra.run.smithi040.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-04T01:36:08.847 INFO:teuthology.orchestra.run.smithi040.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-04T01:36:08.848 INFO:teuthology.orchestra.run.smithi040.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-04T01:36:08.848 INFO:teuthology.orchestra.run.smithi040.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-04T01:36:08.848 INFO:teuthology.orchestra.run.smithi040.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-04T01:36:08.848 INFO:teuthology.orchestra.run.smithi040.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-04T01:36:08.902 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-04T01:36:08.916 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-04T01:36:08.968 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-04T01:36:09.142 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-04T01:36:09.150 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-04T01:36:09.178 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-04T01:36:09.186 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-04T01:36:09.351 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-04T01:36:09.918 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-04T01:36:09.921 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-04T01:36:09.921 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-04T01:36:09.930 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-04T01:36:09.930 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-04T01:36:09.930 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-04T01:36:09.930 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-04T01:36:09.932 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-04T01:36:09.934 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-04T01:36:09.998 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-04T01:36:10.182 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-04T01:36:10.383 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-04T01:36:10.412 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-04T01:36:10.439 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-04T01:36:10.540 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-04T01:36:10.554 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-04T01:36:10.562 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-04T01:36:10.613 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-04T01:36:10.641 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-04T01:36:10.650 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-04T01:36:10.765 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-04T01:36:10.929 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-04T01:36:11.113 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-04T01:36:11.162 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-04T01:36:11.272 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7035-g7532011a-1jammy [3,110 kB] 2023-11-04T01:36:11.296 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-04T01:36:11.387 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-04T01:36:11.406 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-11-04T01:36:11.434 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-04T01:36:11.440 INFO:teuthology.orchestra.run.smithi040.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7035-g7532011a-1jammy [3,110 kB] 2023-11-04T01:36:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-04T01:36:11.485 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-04T01:36:11.493 INFO:teuthology.orchestra.run.smithi091.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-04T01:36:11.522 INFO:teuthology.orchestra.run.smithi091.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-04T01:36:11.913 INFO:teuthology.orchestra.run.smithi091.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-04T01:36:12.068 INFO:teuthology.orchestra.run.smithi091.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7035-g7532011a-1jammy [688 kB] 2023-11-04T01:36:12.207 INFO:teuthology.orchestra.run.smithi091.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7035-g7532011a-1jammy [356 kB] 2023-11-04T01:36:12.229 INFO:teuthology.orchestra.run.smithi091.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-04T01:36:12.279 INFO:teuthology.orchestra.run.smithi091.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7035-g7532011a-1jammy [32.8 kB] 2023-11-04T01:36:12.285 INFO:teuthology.orchestra.run.smithi091.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7035-g7532011a-1jammy [180 kB] 2023-11-04T01:36:12.316 INFO:teuthology.orchestra.run.smithi091.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-04T01:36:12.321 INFO:teuthology.orchestra.run.smithi091.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7035-g7532011a-1jammy [62.4 kB] 2023-11-04T01:36:12.332 INFO:teuthology.orchestra.run.smithi091.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7035-g7532011a-1jammy [330 kB] 2023-11-04T01:36:12.340 INFO:teuthology.orchestra.run.smithi091.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-04T01:36:12.352 INFO:teuthology.orchestra.run.smithi091.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-04T01:36:12.396 INFO:teuthology.orchestra.run.smithi091.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7035-g7532011a-1jammy [6,245 kB] 2023-11-04T01:36:12.401 INFO:teuthology.orchestra.run.smithi091.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-04T01:36:12.652 INFO:teuthology.orchestra.run.smithi091.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-04T01:36:12.661 INFO:teuthology.orchestra.run.smithi091.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-04T01:36:12.662 INFO:teuthology.orchestra.run.smithi091.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-04T01:36:12.727 INFO:teuthology.orchestra.run.smithi091.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-04T01:36:12.728 INFO:teuthology.orchestra.run.smithi091.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-04T01:36:12.893 INFO:teuthology.orchestra.run.smithi091.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-04T01:36:13.089 INFO:teuthology.orchestra.run.smithi091.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-04T01:36:13.138 INFO:teuthology.orchestra.run.smithi091.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-04T01:36:13.202 INFO:teuthology.orchestra.run.smithi091.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-04T01:36:13.235 INFO:teuthology.orchestra.run.smithi091.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-04T01:36:13.270 INFO:teuthology.orchestra.run.smithi091.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-04T01:36:13.420 INFO:teuthology.orchestra.run.smithi091.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-04T01:36:13.455 INFO:teuthology.orchestra.run.smithi091.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-04T01:36:13.479 INFO:teuthology.orchestra.run.smithi091.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-04T01:36:13.489 INFO:teuthology.orchestra.run.smithi091.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-04T01:36:13.516 INFO:teuthology.orchestra.run.smithi091.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7035-g7532011a-1jammy [112 kB] 2023-11-04T01:36:13.527 INFO:teuthology.orchestra.run.smithi091.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-04T01:36:13.542 INFO:teuthology.orchestra.run.smithi091.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7035-g7532011a-1jammy [439 kB] 2023-11-04T01:36:13.619 INFO:teuthology.orchestra.run.smithi091.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7035-g7532011a-1jammy [22.6 MB] 2023-11-04T01:36:13.713 INFO:teuthology.orchestra.run.smithi091.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-04T01:36:13.846 INFO:teuthology.orchestra.run.smithi040.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7035-g7532011a-1jammy [688 kB] 2023-11-04T01:36:13.892 INFO:teuthology.orchestra.run.smithi091.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-04T01:36:14.234 INFO:teuthology.orchestra.run.smithi091.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-04T01:36:14.295 INFO:teuthology.orchestra.run.smithi091.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-04T01:36:14.296 INFO:teuthology.orchestra.run.smithi091.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-04T01:36:14.304 INFO:teuthology.orchestra.run.smithi091.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-04T01:36:14.306 INFO:teuthology.orchestra.run.smithi091.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-04T01:36:14.325 INFO:teuthology.orchestra.run.smithi091.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-04T01:36:14.334 INFO:teuthology.orchestra.run.smithi091.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-04T01:36:14.394 INFO:teuthology.orchestra.run.smithi091.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-04T01:36:14.394 INFO:teuthology.orchestra.run.smithi091.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-04T01:36:14.559 INFO:teuthology.orchestra.run.smithi091.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-04T01:36:14.668 INFO:teuthology.orchestra.run.smithi040.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7035-g7532011a-1jammy [356 kB] 2023-11-04T01:36:14.993 INFO:teuthology.orchestra.run.smithi091.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-04T01:36:15.008 INFO:teuthology.orchestra.run.smithi091.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-04T01:36:15.040 INFO:teuthology.orchestra.run.smithi040.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7035-g7532011a-1jammy [32.8 kB] 2023-11-04T01:36:15.113 INFO:teuthology.orchestra.run.smithi040.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7035-g7532011a-1jammy [180 kB] 2023-11-04T01:36:15.311 INFO:teuthology.orchestra.run.smithi040.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7035-g7532011a-1jammy [62.4 kB] 2023-11-04T01:36:15.368 INFO:teuthology.orchestra.run.smithi040.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7035-g7532011a-1jammy [330 kB] 2023-11-04T01:36:15.704 INFO:teuthology.orchestra.run.smithi040.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7035-g7532011a-1jammy [6,245 kB] 2023-11-04T01:36:17.233 INFO:teuthology.orchestra.run.smithi091.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7035-g7532011a-1jammy [6,900 kB] 2023-11-04T01:36:18.069 INFO:teuthology.orchestra.run.smithi091.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7035-g7532011a-1jammy [238 kB] 2023-11-04T01:36:18.115 INFO:teuthology.orchestra.run.smithi091.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7035-g7532011a-1jammy [124 kB] 2023-11-04T01:36:18.133 INFO:teuthology.orchestra.run.smithi091.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7035-g7532011a-1jammy [1,495 kB] 2023-11-04T01:36:18.313 INFO:teuthology.orchestra.run.smithi091.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7035-g7532011a-1jammy [9,947 kB] 2023-11-04T01:36:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7035-g7532011a-1jammy [112 kB] 2023-11-04T01:36:18.517 INFO:teuthology.orchestra.run.smithi040.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7035-g7532011a-1jammy [439 kB] 2023-11-04T01:36:18.649 INFO:teuthology.orchestra.run.smithi040.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7035-g7532011a-1jammy [22.6 MB] 2023-11-04T01:36:19.787 INFO:teuthology.orchestra.run.smithi091.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7035-g7532011a-1jammy [31.8 MB] 2023-11-04T01:36:24.299 INFO:teuthology.orchestra.run.smithi091.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7035-g7532011a-1jammy [14.0 kB] 2023-11-04T01:36:24.299 INFO:teuthology.orchestra.run.smithi091.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7035-g7532011a-1jammy [838 kB] 2023-11-04T01:36:24.316 INFO:teuthology.orchestra.run.smithi091.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7035-g7532011a-1jammy [2,144 kB] 2023-11-04T01:36:24.582 INFO:teuthology.orchestra.run.smithi091.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7035-g7532011a-1jammy [284 kB] 2023-11-04T01:36:24.644 INFO:teuthology.orchestra.run.smithi091.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7035-g7532011a-1jammy [138 kB] 2023-11-04T01:36:24.650 INFO:teuthology.orchestra.run.smithi091.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7035-g7532011a-1jammy [1,900 kB] 2023-11-04T01:36:24.928 INFO:teuthology.orchestra.run.smithi091.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7035-g7532011a-1jammy [8,625 kB] 2023-11-04T01:36:25.094 INFO:teuthology.orchestra.run.smithi040.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7035-g7532011a-1jammy [6,900 kB] 2023-11-04T01:36:26.233 INFO:teuthology.orchestra.run.smithi091.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7035-g7532011a-1jammy [14.2 kB] 2023-11-04T01:36:26.234 INFO:teuthology.orchestra.run.smithi091.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7035-g7532011a-1jammy [48.7 MB] 2023-11-04T01:36:26.563 INFO:teuthology.orchestra.run.smithi040.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7035-g7532011a-1jammy [238 kB] 2023-11-04T01:36:26.624 INFO:teuthology.orchestra.run.smithi040.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7035-g7532011a-1jammy [124 kB] 2023-11-04T01:36:26.637 INFO:teuthology.orchestra.run.smithi040.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7035-g7532011a-1jammy [1,495 kB] 2023-11-04T01:36:26.935 INFO:teuthology.orchestra.run.smithi040.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7035-g7532011a-1jammy [9,947 kB] 2023-11-04T01:36:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7035-g7532011a-1jammy [31.8 MB] 2023-11-04T01:36:32.165 INFO:teuthology.orchestra.run.smithi091.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7035-g7532011a-1jammy [120 kB] 2023-11-04T01:36:32.167 INFO:teuthology.orchestra.run.smithi091.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7035-g7532011a-1jammy [225 kB] 2023-11-04T01:36:32.172 INFO:teuthology.orchestra.run.smithi091.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7035-g7532011a-1jammy [34.0 kB] 2023-11-04T01:36:32.173 INFO:teuthology.orchestra.run.smithi091.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7035-g7532011a-1jammy [23.4 kB] 2023-11-04T01:36:32.174 INFO:teuthology.orchestra.run.smithi091.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7035-g7532011a-1jammy [38.3 kB] 2023-11-04T01:36:32.175 INFO:teuthology.orchestra.run.smithi091.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7035-g7532011a-1jammy [12.3 MB] 2023-11-04T01:36:33.272 INFO:teuthology.orchestra.run.smithi091.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7035-g7532011a-1jammy [90.8 kB] 2023-11-04T01:36:33.815 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 185 MB in 25s (7,419 kB/s) 2023-11-04T01:36:33.957 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-04T01:36:34.053 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165985 files and directories currently installed.) 2023-11-04T01:36:34.059 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-04T01:36:34.105 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-04T01:36:34.374 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-04T01:36:34.389 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-04T01:36:34.425 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:36:34.719 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cmd2. 2023-11-04T01:36:34.745 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-04T01:36:34.785 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-04T01:36:35.096 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-04T01:36:35.123 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-04T01:36:35.205 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:36:35.309 INFO:teuthology.orchestra.run.smithi040.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7035-g7532011a-1jammy [14.0 kB] 2023-11-04T01:36:35.310 INFO:teuthology.orchestra.run.smithi040.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7035-g7532011a-1jammy [838 kB] 2023-11-04T01:36:35.326 INFO:teuthology.orchestra.run.smithi040.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7035-g7532011a-1jammy [2,144 kB] 2023-11-04T01:36:35.550 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-04T01:36:35.576 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-04T01:36:35.578 INFO:teuthology.orchestra.run.smithi040.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7035-g7532011a-1jammy [284 kB] 2023-11-04T01:36:35.614 INFO:teuthology.orchestra.run.smithi040.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7035-g7532011a-1jammy [138 kB] 2023-11-04T01:36:35.616 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:36:35.620 INFO:teuthology.orchestra.run.smithi040.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7035-g7532011a-1jammy [1,900 kB] 2023-11-04T01:36:35.852 INFO:teuthology.orchestra.run.smithi040.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7035-g7532011a-1jammy [8,625 kB] 2023-11-04T01:36:35.919 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-04T01:36:35.947 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-04T01:36:35.978 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:36:36.465 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-04T01:36:36.492 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:36:36.540 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:36:36.800 INFO:teuthology.orchestra.run.smithi040.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7035-g7532011a-1jammy [14.2 kB] 2023-11-04T01:36:36.801 INFO:teuthology.orchestra.run.smithi040.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7035-g7532011a-1jammy [48.7 MB] 2023-11-04T01:36:37.109 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-04T01:36:37.136 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:36:37.176 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:36:37.479 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-04T01:36:37.506 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:36:37.545 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:36:37.890 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-04T01:36:37.917 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-04T01:36:37.957 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:36:38.268 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librados2. 2023-11-04T01:36:38.296 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../010-librados2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:38.335 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:38.729 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librbd1. 2023-11-04T01:36:38.755 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../011-librbd1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:38.787 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:39.210 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs2. 2023-11-04T01:36:39.234 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:39.273 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:39.559 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rados. 2023-11-04T01:36:39.576 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:39.617 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:39.945 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-04T01:36:39.972 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:36:40.012 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:40.113 INFO:teuthology.orchestra.run.smithi040.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7035-g7532011a-1jammy [120 kB] 2023-11-04T01:36:40.116 INFO:teuthology.orchestra.run.smithi040.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7035-g7532011a-1jammy [225 kB] 2023-11-04T01:36:40.120 INFO:teuthology.orchestra.run.smithi040.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7035-g7532011a-1jammy [34.0 kB] 2023-11-04T01:36:40.121 INFO:teuthology.orchestra.run.smithi040.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7035-g7532011a-1jammy [23.4 kB] 2023-11-04T01:36:40.122 INFO:teuthology.orchestra.run.smithi040.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7035-g7532011a-1jammy [38.3 kB] 2023-11-04T01:36:40.123 INFO:teuthology.orchestra.run.smithi040.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7035-g7532011a-1jammy [12.3 MB] 2023-11-04T01:36:40.247 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cephfs. 2023-11-04T01:36:40.263 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:40.298 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:40.549 INFO:teuthology.orchestra.run.smithi040.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7035-g7532011a-1jammy [90.8 kB] 2023-11-04T01:36:40.617 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-04T01:36:40.644 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:36:40.683 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:41.020 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-prettytable. 2023-11-04T01:36:41.046 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-04T01:36:41.087 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-04T01:36:41.142 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 185 MB in 32s (5,739 kB/s) 2023-11-04T01:36:41.281 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-04T01:36:41.347 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rbd. 2023-11-04T01:36:41.362 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:41.381 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165985 files and directories currently installed.) 2023-11-04T01:36:41.386 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-04T01:36:41.405 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:41.804 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-04T01:36:42.332 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-04T01:36:42.358 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-04T01:36:42.390 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:36:42.620 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-04T01:36:42.643 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-04T01:36:42.660 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cmd2. 2023-11-04T01:36:42.686 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-04T01:36:42.692 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:36:42.743 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-04T01:36:42.995 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librgw2. 2023-11-04T01:36:43.022 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../020-librgw2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:43.061 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:43.088 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-04T01:36:43.114 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-04T01:36:43.198 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:36:43.517 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-04T01:36:43.543 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-04T01:36:43.555 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rgw. 2023-11-04T01:36:43.571 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:43.575 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:36:43.613 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:43.903 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-04T01:36:43.930 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-04T01:36:43.933 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-04T01:36:43.959 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-04T01:36:43.969 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:36:43.999 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:36:44.311 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libradosstriper1. 2023-11-04T01:36:44.337 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:44.377 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-04T01:36:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:36:44.481 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:36:44.764 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-common. 2023-11-04T01:36:44.790 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:44.822 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:44.851 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-04T01:36:44.878 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:36:44.910 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:36:45.246 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-04T01:36:45.273 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:36:45.313 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:36:45.658 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-04T01:36:45.685 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-04T01:36:45.724 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:36:46.003 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-base. 2023-11-04T01:36:46.029 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:46.079 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:46.219 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librados2. 2023-11-04T01:36:46.246 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../010-librados2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:46.278 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:46.724 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librbd1. 2023-11-04T01:36:46.749 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../011-librbd1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:46.788 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:46.815 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-04T01:36:46.843 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-04T01:36:46.881 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:36:47.143 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cheroot. 2023-11-04T01:36:47.169 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-04T01:36:47.201 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:36:47.233 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs2. 2023-11-04T01:36:47.259 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:47.299 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:47.554 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rados. 2023-11-04T01:36:47.579 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:47.618 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:47.737 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-04T01:36:47.763 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-04T01:36:47.804 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:36:47.896 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-04T01:36:47.923 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:36:47.963 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:48.106 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-04T01:36:48.133 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-04T01:36:48.173 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:36:48.226 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cephfs. 2023-11-04T01:36:48.240 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:48.274 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:48.485 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-04T01:36:48.511 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-04T01:36:48.551 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:36:48.593 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-04T01:36:48.620 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:36:48.660 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:48.837 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempora. 2023-11-04T01:36:48.852 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-04T01:36:48.887 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-04T01:36:48.980 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-prettytable. 2023-11-04T01:36:49.007 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-04T01:36:49.046 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-04T01:36:49.181 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-portend. 2023-11-04T01:36:49.208 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-04T01:36:49.248 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-04T01:36:49.299 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rbd. 2023-11-04T01:36:49.316 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:49.357 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:49.551 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-04T01:36:49.578 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-04T01:36:49.617 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-04T01:36:49.669 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-04T01:36:49.696 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-04T01:36:49.727 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:36:49.895 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-04T01:36:49.922 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-04T01:36:49.970 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:36:50.080 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librgw2. 2023-11-04T01:36:50.107 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../020-librgw2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:50.146 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:50.315 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-natsort. 2023-11-04T01:36:50.342 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-04T01:36:50.381 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-04T01:36:50.662 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-logutils. 2023-11-04T01:36:50.665 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rgw. 2023-11-04T01:36:50.677 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-04T01:36:50.694 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:50.720 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-04T01:36:50.732 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:50.998 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-04T01:36:51.025 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-04T01:36:51.064 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:36:51.077 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-04T01:36:51.104 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-04T01:36:51.143 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:36:51.367 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-mako. 2023-11-04T01:36:51.394 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-04T01:36:51.433 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:36:51.513 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libradosstriper1. 2023-11-04T01:36:51.529 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:51.563 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:51.762 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-04T01:36:51.789 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-04T01:36:51.828 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:36:52.000 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-common. 2023-11-04T01:36:52.026 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:52.066 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:52.106 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-04T01:36:52.129 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-04T01:36:52.164 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:36:52.425 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webob. 2023-11-04T01:36:52.452 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-04T01:36:52.492 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:36:52.953 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-waitress. 2023-11-04T01:36:52.980 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-04T01:36:53.023 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:36:53.331 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempita. 2023-11-04T01:36:53.358 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-04T01:36:53.364 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-base. 2023-11-04T01:36:53.391 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:53.398 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:36:53.440 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:53.701 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-paste. 2023-11-04T01:36:53.727 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-04T01:36:53.767 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:36:54.095 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-04T01:36:54.122 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-04T01:36:54.127 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-04T01:36:54.154 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-04T01:36:54.161 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:36:54.193 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:36:54.464 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-04T01:36:54.491 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-04T01:36:54.496 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cheroot. 2023-11-04T01:36:54.523 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-04T01:36:54.531 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:36:54.563 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:36:54.792 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webtest. 2023-11-04T01:36:54.819 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-04T01:36:54.850 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-04T01:36:54.882 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-04T01:36:54.910 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-04T01:36:54.949 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:36:55.153 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pecan. 2023-11-04T01:36:55.180 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-04T01:36:55.202 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-04T01:36:55.221 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:36:55.229 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-04T01:36:55.260 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:36:55.538 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-04T01:36:55.565 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-04T01:36:55.600 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-certifi. 2023-11-04T01:36:55.604 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:36:55.627 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-04T01:36:55.666 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-04T01:36:55.891 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempora. 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-04T01:36:55.957 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-04T01:36:55.986 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-idna. 2023-11-04T01:36:56.013 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-04T01:36:56.053 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-04T01:36:56.236 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-portend. 2023-11-04T01:36:56.262 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-04T01:36:56.302 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-04T01:36:56.364 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-urllib3. 2023-11-04T01:36:56.391 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-11-04T01:36:56.430 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:36:56.730 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-04T01:36:56.733 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-requests. 2023-11-04T01:36:56.757 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-04T01:36:56.760 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-04T01:36:56.797 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-04T01:36:56.799 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:36:57.083 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-04T01:36:57.086 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-04T01:36:57.102 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-04T01:36:57.110 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-04T01:36:57.136 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:36:57.149 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:36:57.453 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-natsort. 2023-11-04T01:36:57.456 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-04T01:36:57.472 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:36:57.481 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-04T01:36:57.505 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:57.520 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-04T01:36:57.806 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-logutils. 2023-11-04T01:36:57.833 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-04T01:36:57.873 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-04T01:36:57.886 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-04T01:36:57.912 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:57.960 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:58.176 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-04T01:36:58.203 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-04T01:36:58.242 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:36:58.271 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-openssl. 2023-11-04T01:36:58.298 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-04T01:36:58.338 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-04T01:36:58.545 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-mako. 2023-11-04T01:36:58.572 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-04T01:36:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:36:58.633 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr. 2023-11-04T01:36:58.659 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:58.691 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:58.924 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-04T01:36:58.951 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-04T01:36:58.982 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:36:59.102 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mon. 2023-11-04T01:36:59.129 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:36:59.177 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:36:59.269 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-04T01:36:59.297 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-04T01:36:59.335 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:36:59.623 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webob. 2023-11-04T01:36:59.648 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-04T01:36:59.687 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:37:00.016 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-waitress. 2023-11-04T01:37:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-04T01:37:00.077 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:37:00.140 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-osd. 2023-11-04T01:37:00.166 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:00.205 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:00.360 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempita. 2023-11-04T01:37:00.376 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-04T01:37:00.410 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:37:00.688 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-paste. 2023-11-04T01:37:00.715 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-04T01:37:00.754 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:37:01.067 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-04T01:37:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-04T01:37:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:37:01.461 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-04T01:37:01.488 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-04T01:37:01.527 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:37:01.847 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webtest. 2023-11-04T01:37:01.874 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-04T01:37:01.913 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-04T01:37:02.067 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph. 2023-11-04T01:37:02.082 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../060-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:02.117 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:02.183 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pecan. 2023-11-04T01:37:02.210 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-04T01:37:02.241 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:37:02.428 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-fuse. 2023-11-04T01:37:02.455 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:02.538 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-certifi. 2023-11-04T01:37:02.565 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-04T01:37:02.586 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:02.607 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-04T01:37:02.916 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-idna. 2023-11-04T01:37:02.943 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-04T01:37:02.983 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-04T01:37:02.998 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mds. 2023-11-04T01:37:03.024 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:03.147 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-urllib3. 2023-11-04T01:37:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-11-04T01:37:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:37:03.517 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephadm. 2023-11-04T01:37:03.544 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../063-cephadm_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:03.575 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:03.689 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests. 2023-11-04T01:37:03.716 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-04T01:37:03.755 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:37:03.878 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-04T01:37:03.905 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-04T01:37:03.945 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-04T01:37:04.042 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-04T01:37:04.068 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-04T01:37:04.108 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:37:04.256 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-04T01:37:04.283 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:37:04.314 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:04.386 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-04T01:37:04.402 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:04.444 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:04.833 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-04T01:37:04.861 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:04.899 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-openssl. 2023-11-04T01:37:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-04T01:37:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-04T01:37:05.353 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-babel. 2023-11-04T01:37:05.381 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:37:05.419 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:05.605 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr. 2023-11-04T01:37:05.632 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:05.663 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:05.739 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jinja2. 2023-11-04T01:37:05.766 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-04T01:37:05.805 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-04T01:37:06.033 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mon. 2023-11-04T01:37:06.060 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:06.100 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:06.159 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-04T01:37:06.185 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:06.234 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:06.571 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-04T01:37:06.597 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-04T01:37:06.637 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:37:06.948 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-04T01:37:06.975 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-04T01:37:07.023 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-04T01:37:07.153 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-osd. 2023-11-04T01:37:07.181 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:07.212 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:07.393 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-routes. 2023-11-04T01:37:07.419 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-04T01:37:07.468 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:37:07.888 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-04T01:37:07.915 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:07.962 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:08.399 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-04T01:37:08.415 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-04T01:37:08.457 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:37:08.986 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-joblib. 2023-11-04T01:37:09.013 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-04T01:37:09.052 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:37:09.323 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph. 2023-11-04T01:37:09.340 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../060-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:09.381 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:09.449 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-04T01:37:09.475 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-04T01:37:09.514 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:37:09.701 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-fuse. 2023-11-04T01:37:09.728 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:09.817 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn. 2023-11-04T01:37:09.844 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-04T01:37:09.883 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:37:10.105 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mds. 2023-11-04T01:37:10.132 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:10.162 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:10.483 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephadm. 2023-11-04T01:37:10.510 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../063-cephadm_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:10.540 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:10.601 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-04T01:37:10.628 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:10.667 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:10.827 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-04T01:37:10.854 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-04T01:37:10.894 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-04T01:37:11.205 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-04T01:37:11.221 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:37:11.263 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:11.637 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cachetools. 2023-11-04T01:37:11.664 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-04T01:37:11.703 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-04T01:37:11.998 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-04T01:37:12.025 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-04T01:37:12.064 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:37:12.384 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-04T01:37:12.393 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-babel. 2023-11-04T01:37:12.399 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-04T01:37:12.421 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:37:12.433 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:37:12.460 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:12.712 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rsa. 2023-11-04T01:37:12.728 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-04T01:37:12.761 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-04T01:37:12.780 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jinja2. 2023-11-04T01:37:12.807 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-04T01:37:12.888 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-04T01:37:13.040 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-google-auth. 2023-11-04T01:37:13.070 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-04T01:37:13.098 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-04T01:37:13.216 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-04T01:37:13.233 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:13.266 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:13.562 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-04T01:37:13.589 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-04T01:37:13.628 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:37:13.745 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-04T01:37:13.772 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-04T01:37:13.811 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:37:13.873 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-04T01:37:13.900 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-04T01:37:13.931 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-04T01:37:14.123 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-websocket. 2023-11-04T01:37:14.150 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-04T01:37:14.189 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-04T01:37:14.234 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-routes. 2023-11-04T01:37:14.261 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-04T01:37:14.300 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:37:14.501 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-04T01:37:14.528 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-04T01:37:14.567 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:37:14.629 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-04T01:37:14.657 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:14.696 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:15.085 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-04T01:37:15.099 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-04T01:37:15.132 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:37:15.240 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-04T01:37:15.267 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:15.306 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:15.622 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-joblib. 2023-11-04T01:37:15.642 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-04T01:37:15.647 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-04T01:37:15.669 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-04T01:37:15.686 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:37:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:37:16.049 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-04T01:37:16.062 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-04T01:37:16.076 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-04T01:37:16.089 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:37:16.114 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:37:16.128 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:37:16.381 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package jq. 2023-11-04T01:37:16.384 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn. 2023-11-04T01:37:16.397 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:37:16.412 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-04T01:37:16.431 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-04T01:37:16.442 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:37:16.658 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package socat. 2023-11-04T01:37:16.686 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-04T01:37:16.725 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:37:17.053 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package xmlstarlet. 2023-11-04T01:37:17.081 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-04T01:37:17.120 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:37:17.162 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-04T01:37:17.188 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:17.217 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:17.482 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-test. 2023-11-04T01:37:17.498 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:17.540 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:18.140 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cachetools. 2023-11-04T01:37:18.167 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-04T01:37:18.206 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-04T01:37:18.425 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-04T01:37:18.454 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-04T01:37:18.483 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:37:18.770 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-04T01:37:18.798 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-04T01:37:18.836 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:37:19.131 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rsa. 2023-11-04T01:37:19.152 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-04T01:37:19.190 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-04T01:37:19.510 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-google-auth. 2023-11-04T01:37:19.537 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-04T01:37:19.576 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-04T01:37:19.853 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-volume. 2023-11-04T01:37:19.880 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:19.919 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:19.973 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-04T01:37:20.001 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-04T01:37:20.039 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:37:20.348 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-04T01:37:20.351 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-websocket. 2023-11-04T01:37:20.375 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:20.378 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-04T01:37:20.415 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:20.417 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-04T01:37:20.734 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-colorama. 2023-11-04T01:37:20.745 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-04T01:37:20.762 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-04T01:37:20.773 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-04T01:37:20.801 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-04T01:37:20.812 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:37:21.062 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-shell. 2023-11-04T01:37:21.086 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:21.128 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:21.448 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-top. 2023-11-04T01:37:21.475 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-04T01:37:21.504 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:21.523 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:21.542 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:21.779 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-04T01:37:21.806 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-04T01:37:21.826 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-04T01:37:21.837 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:37:21.853 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:21.892 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:22.182 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-04T01:37:22.210 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:37:22.248 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:37:22.271 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package nvme-cli. 2023-11-04T01:37:22.298 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-04T01:37:22.337 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:37:22.693 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-04T01:37:22.701 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package jq. 2023-11-04T01:37:22.707 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-04T01:37:22.717 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:37:22.750 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:37:22.750 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-04T01:37:23.011 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package socat. 2023-11-04T01:37:23.028 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-04T01:37:23.061 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:37:23.170 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-04T01:37:23.197 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-04T01:37:23.236 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-04T01:37:23.373 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package xmlstarlet. 2023-11-04T01:37:23.390 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-04T01:37:23.431 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:37:23.539 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastescript. 2023-11-04T01:37:23.566 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-04T01:37:23.605 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-04T01:37:23.752 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-test. 2023-11-04T01:37:23.769 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:23.802 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:23.925 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pluggy. 2023-11-04T01:37:23.953 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-04T01:37:23.992 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:37:24.303 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-psutil. 2023-11-04T01:37:24.331 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-04T01:37:24.370 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-04T01:37:24.723 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-py. 2023-11-04T01:37:24.750 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-04T01:37:24.789 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-04T01:37:25.067 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pygments. 2023-11-04T01:37:25.095 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-04T01:37:25.134 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:37:25.630 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-04T01:37:25.658 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-04T01:37:25.696 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:37:26.007 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-toml. 2023-11-04T01:37:26.035 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-04T01:37:26.056 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-volume. 2023-11-04T01:37:26.072 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:26.073 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-04T01:37:26.114 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:26.376 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pytest. 2023-11-04T01:37:26.404 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-04T01:37:26.442 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:37:26.468 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-04T01:37:26.496 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:26.535 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:26.796 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplejson. 2023-11-04T01:37:26.813 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-colorama. 2023-11-04T01:37:26.824 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-04T01:37:26.841 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-04T01:37:26.863 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:37:26.880 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-04T01:37:27.132 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-04T01:37:27.141 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-shell. 2023-11-04T01:37:27.147 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-04T01:37:27.169 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:27.190 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:37:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-top. 2023-11-04T01:37:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:37:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-04T01:37:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:27.886 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package radosgw. 2023-11-04T01:37:27.913 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../112-radosgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:27.952 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package nvme-cli. 2023-11-04T01:37:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-04T01:37:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:37:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-04T01:37:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-04T01:37:28.688 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-fuse. 2023-11-04T01:37:28.704 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:37:28.704 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:28.746 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-04T01:37:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-04T01:37:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-04T01:37:29.309 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-04T01:37:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastescript. 2023-11-04T01:37:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-04T01:37:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-04T01:37:29.553 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:37:29.704 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:37:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pluggy. 2023-11-04T01:37:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-04T01:37:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:37:29.938 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-04T01:37:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-psutil. 2023-11-04T01:37:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-04T01:37:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-04T01:37:30.299 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-04T01:37:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-py. 2023-11-04T01:37:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-04T01:37:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-04T01:37:30.798 INFO:teuthology.orchestra.run.smithi091.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-04T01:37:30.915 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pygments. 2023-11-04T01:37:31.066 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-04T01:37:31.071 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:37:31.382 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user cephadm....done 2023-11-04T01:37:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-04T01:37:31.537 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:37:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-04T01:37:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:37:31.813 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:37:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-toml. 2023-11-04T01:37:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-04T01:37:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-04T01:37:32.064 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:37:32.190 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:37:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pytest. 2023-11-04T01:37:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-04T01:37:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:37:32.433 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-04T01:37:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplejson. 2023-11-04T01:37:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-04T01:37:32.676 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:37:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:37:32.785 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-04T01:37:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-04T01:37:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-04T01:37:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:37:33.095 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:37:33.439 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-04T01:37:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package radosgw. 2023-11-04T01:37:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../112-radosgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:33.732 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-04T01:37:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:33.983 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-04T01:37:34.243 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:37:34.494 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:37:34.610 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package rbd-fuse. 2023-11-04T01:37:34.626 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:37:34.668 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:34.762 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:37:34.964 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-04T01:37:35.113 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:35.315 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:37:35.372 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:37:35.441 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:37:35.481 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-04T01:37:35.707 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-04T01:37:35.749 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:37:35.992 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:37:36.076 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-04T01:37:36.117 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-04T01:37:36.477 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:36.553 INFO:teuthology.orchestra.run.smithi040.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-04T01:37:36.611 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-04T01:37:36.826 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:36.879 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:37:37.130 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:37:37.387 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user cephadm....done 2023-11-04T01:37:37.440 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:37:37.524 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:37:37.801 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:37:38.043 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:37:38.100 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:37:38.169 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:37:38.351 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:37:38.429 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-04T01:37:38.478 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:37:38.603 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:37:38.688 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:37:38.815 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-04T01:37:38.887 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-04T01:37:39.133 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:37:39.263 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-04T01:37:39.502 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-04T01:37:39.514 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:37:39.769 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-04T01:37:39.907 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:37:40.029 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-04T01:37:40.192 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-04T01:37:40.314 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:37:40.510 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:37:40.573 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:37:40.832 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:37:40.861 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:37:41.092 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:41.112 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:37:41.213 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:41.359 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:37:41.460 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-04T01:37:41.498 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-idna (3.3-1) ... 2023-11-04T01:37:41.719 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:37:41.807 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:37:41.979 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:37:42.105 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-04T01:37:42.473 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:42.599 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-04T01:37:42.875 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:37:43.129 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:37:43.264 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-04T01:37:43.377 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:37:43.531 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:37:43.632 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:37:43.669 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:37:43.733 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:37:44.052 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:37:44.303 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-04T01:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:37:44.614 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:37:44.662 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:37:44.740 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:37:44.788 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:37:44.866 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:37:45.106 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:37:45.175 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-04T01:37:45.349 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-04T01:37:45.568 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-04T01:37:45.600 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-04T01:37:45.794 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:37:45.834 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:37:46.094 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-04T01:37:46.162 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:37:46.361 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:37:46.462 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-04T01:37:46.463 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-04T01:37:46.730 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:37:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:37:46.856 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:37:47.124 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:37:47.149 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:37:47.375 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:37:47.433 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:37:47.510 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:47.692 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:47.786 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-idna (3.3-1) ... 2023-11-04T01:37:48.094 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-04T01:37:48.112 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:37:48.321 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:37:48.430 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:37:48.823 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:37:49.091 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-04T01:37:49.325 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:37:49.384 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:37:49.451 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-04T01:37:49.493 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-04T01:37:49.753 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:37:49.769 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:37:49.879 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:37:50.005 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:37:50.087 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:37:50.346 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-04T01:37:50.365 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:37:50.472 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-04T01:37:50.633 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-04T01:37:50.732 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-04T01:37:50.875 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:37:50.976 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:37:50.991 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:37:51.250 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:37:51.294 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:37:51.554 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-04T01:37:51.635 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-04T01:37:51.830 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-04T01:37:51.920 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:37:52.098 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:37:52.238 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:37:52.348 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:52.366 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-04T01:37:52.449 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:52.558 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:52.642 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:37:52.751 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-04T01:37:52.770 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:52.896 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:53.019 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:37:53.022 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-04T01:37:53.145 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:37:53.290 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:53.424 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:53.445 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:37:53.550 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:53.747 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:37:53.771 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:37:53.772 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:37:54.006 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:37:54.294 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:54.408 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-04T01:37:54.453 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:54.604 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:54.659 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:37:54.730 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:37:54.760 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:37:55.136 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:37:55.396 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-04T01:37:55.647 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:37:55.773 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-04T01:37:55.951 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:56.077 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:56.099 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:37:56.203 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:56.329 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:56.392 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:37:56.455 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:56.556 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:56.651 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-04T01:37:56.777 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-04T01:37:57.045 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-04T01:37:57.058 INFO:teuthology.orchestra.run.smithi091.stdout:Adding group ceph....done 2023-11-04T01:37:57.330 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:37:57.409 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user ceph....done 2023-11-04T01:37:57.570 INFO:teuthology.orchestra.run.smithi091.stdout:Setting system user ceph properties....done 2023-11-04T01:37:57.588 INFO:teuthology.orchestra.run.smithi091.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-04T01:37:57.598 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:37:57.723 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-04T01:37:58.007 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-04T01:37:58.073 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-04T01:37:58.292 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:37:58.616 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:37:58.787 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:37:58.814 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:37:58.929 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.056 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.267 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.367 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.368 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.469 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-04T01:37:59.493 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.737 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.863 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:37:59.982 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:37:59.982 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:37:59.989 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:00.210 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:38:00.211 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:38:00.511 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:00.799 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:00.868 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-04T01:38:00.917 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:01.018 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:38:01.394 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:01.635 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:01.635 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:02.124 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.310 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:02.310 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:02.348 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.474 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.592 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.693 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.827 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.834 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:02.946 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:03.147 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:03.147 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:03.496 INFO:teuthology.orchestra.run.smithi040.stdout:Adding group ceph....done 2023-11-04T01:38:03.702 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:03.814 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:03.889 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user ceph....done 2023-11-04T01:38:03.963 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:04.058 INFO:teuthology.orchestra.run.smithi040.stdout:Setting system user ceph properties....done 2023-11-04T01:38:04.078 INFO:teuthology.orchestra.run.smithi040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-04T01:38:04.174 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:04.175 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:04.217 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-04T01:38:04.543 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-04T01:38:04.714 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:04.864 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:05.104 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:38:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:38:05.512 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:05.653 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:05.856 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:05.982 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:06.022 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:38:06.464 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:38:06.465 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:38:06.756 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:38:06.984 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:07.223 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:38:07.227 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-04T01:38:07.285 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-11-04T01:38:07.330 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-04T01:38:07.473 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-11-04T01:38:07.474 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-11-04T01:38:07.633 INFO:teuthology.orchestra.run.smithi091.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:38:07.634 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:38:07.635 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:38:07.635 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:38:07.636 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-11-04T01:38:07.636 INFO:teuthology.orchestra.run.smithi091.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-04T01:38:07.636 INFO:teuthology.orchestra.run.smithi091.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-04T01:38:07.636 INFO:teuthology.orchestra.run.smithi091.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-04T01:38:07.636 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-04T01:38:07.636 INFO:teuthology.orchestra.run.smithi091.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:38:07.637 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-11-04T01:38:07.637 INFO:teuthology.orchestra.run.smithi091.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-04T01:38:07.637 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-04T01:38:07.637 INFO:teuthology.orchestra.run.smithi091.stdout: libengine-pkcs11-openssl 2023-11-04T01:38:07.674 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-11-04T01:38:07.675 INFO:teuthology.orchestra.run.smithi091.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-04T01:38:07.675 INFO:teuthology.orchestra.run.smithi091.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-04T01:38:07.675 INFO:teuthology.orchestra.run.smithi091.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-04T01:38:07.676 INFO:teuthology.orchestra.run.smithi091.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-04T01:38:07.676 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-04T01:38:07.676 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-04T01:38:07.676 INFO:teuthology.orchestra.run.smithi091.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:38:07.676 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2023-11-04T01:38:07.678 INFO:teuthology.orchestra.run.smithi091.stdout: libssl3 2023-11-04T01:38:07.754 INFO:teuthology.orchestra.run.smithi091.stdout:1 upgraded, 39 newly installed, 0 to remove and 257 not upgraded. 2023-11-04T01:38:07.754 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 54.6 MB of archives. 2023-11-04T01:38:07.754 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-04T01:38:07.754 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-04T01:38:07.836 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:07.853 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-04T01:38:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-04T01:38:07.928 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-04T01:38:07.929 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-04T01:38:07.933 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-04T01:38:07.934 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-04T01:38:07.934 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-04T01:38:07.935 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-04T01:38:07.937 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-04T01:38:07.937 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-04T01:38:07.938 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-04T01:38:07.952 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-04T01:38:08.073 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:08.073 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:08.263 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-04T01:38:08.265 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-04T01:38:08.265 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-04T01:38:08.268 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-04T01:38:08.268 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-04T01:38:08.274 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-04T01:38:08.274 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-04T01:38:08.280 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-04T01:38:08.281 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-04T01:38:08.301 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-04T01:38:08.302 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-04T01:38:08.311 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-04T01:38:08.332 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-04T01:38:08.334 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-04T01:38:08.334 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-04T01:38:08.334 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-04T01:38:08.335 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-04T01:38:08.345 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-04T01:38:08.347 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-04T01:38:08.543 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-04T01:38:08.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-04T01:38:08.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-04T01:38:08.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-04T01:38:08.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-04T01:38:08.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-04T01:38:08.555 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-04T01:38:08.556 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-04T01:38:08.605 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:08.836 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:08.836 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:08.951 INFO:teuthology.orchestra.run.smithi091.stdout:Preconfiguring packages ... 2023-11-04T01:38:09.107 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 54.6 MB in 1s (62.6 MB/s) 2023-11-04T01:38:09.213 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package flex. 2023-11-04T01:38:09.306 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172900 files and directories currently installed.) 2023-11-04T01:38:09.313 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-04T01:38:09.382 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:09.419 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-04T01:38:09.656 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:09.656 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:09.994 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:38:10.166 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-04T01:38:10.200 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:10.318 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:10.486 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:10.707 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:10.707 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:10.830 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:38:11.220 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:11.372 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:11.388 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package bison. 2023-11-04T01:38:11.492 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172973 files and directories currently installed.) 2023-11-04T01:38:11.499 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-04T01:38:11.499 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:11.549 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:38:11.649 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:11.985 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:38:11.990 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-04T01:38:12.018 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-04T01:38:12.057 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:38:12.377 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package dump. 2023-11-04T01:38:12.404 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-04T01:38:12.443 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking dump (0.4b47-3) ... 2023-11-04T01:38:12.755 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package indent. 2023-11-04T01:38:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:12.830 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:38:13.021 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:38:13.124 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-04T01:38:13.151 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-04T01:38:13.199 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:38:13.481 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:38:13.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-04T01:38:13.536 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-04T01:38:13.549 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-11-04T01:38:13.564 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-04T01:38:13.603 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:38:13.742 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-11-04T01:38:13.742 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-11-04T01:38:13.864 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-04T01:38:13.891 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:38:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:38:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:38:13.916 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:38:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:38:13.917 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:38:13.917 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-11-04T01:38:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-04T01:38:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-04T01:38:13.917 INFO:teuthology.orchestra.run.smithi040.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-04T01:38:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-04T01:38:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:38:13.918 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-11-04T01:38:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-04T01:38:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-04T01:38:13.919 INFO:teuthology.orchestra.run.smithi040.stdout: libengine-pkcs11-openssl 2023-11-04T01:38:13.930 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:38:13.958 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-11-04T01:38:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-04T01:38:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-04T01:38:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-04T01:38:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-04T01:38:13.959 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-04T01:38:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-04T01:38:13.960 INFO:teuthology.orchestra.run.smithi040.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:38:13.962 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-11-04T01:38:13.962 INFO:teuthology.orchestra.run.smithi040.stdout: libssl3 2023-11-04T01:38:14.032 INFO:teuthology.orchestra.run.smithi040.stdout:1 upgraded, 39 newly installed, 0 to remove and 257 not upgraded. 2023-11-04T01:38:14.032 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 54.6 MB of archives. 2023-11-04T01:38:14.032 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-04T01:38:14.032 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-04T01:38:14.132 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-04T01:38:14.202 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-04T01:38:14.220 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-04T01:38:14.220 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-04T01:38:14.224 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-04T01:38:14.226 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-04T01:38:14.226 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-04T01:38:14.228 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-04T01:38:14.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-04T01:38:14.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-04T01:38:14.231 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-04T01:38:14.244 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-04T01:38:14.325 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-04T01:38:14.352 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-04T01:38:14.408 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:14.547 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-04T01:38:14.547 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-04T01:38:14.547 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-04T01:38:14.548 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-04T01:38:14.548 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-04T01:38:14.552 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-04T01:38:14.553 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-04T01:38:14.561 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-04T01:38:14.561 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-04T01:38:14.582 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-04T01:38:14.582 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-04T01:38:14.592 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-04T01:38:14.611 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-04T01:38:14.614 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-04T01:38:14.615 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-04T01:38:14.615 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-04T01:38:14.615 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-04T01:38:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-04T01:38:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-04T01:38:14.703 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-04T01:38:14.730 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-04T01:38:14.769 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:14.833 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-04T01:38:14.833 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-04T01:38:14.833 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-04T01:38:14.833 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-04T01:38:14.834 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-04T01:38:14.834 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-04T01:38:14.844 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-04T01:38:14.845 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-04T01:38:15.022 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjson-perl. 2023-11-04T01:38:15.049 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-04T01:38:15.088 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-04T01:38:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:Preconfiguring packages ... 2023-11-04T01:38:15.400 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-04T01:38:15.422 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 54.6 MB in 1s (62.3 MB/s) 2023-11-04T01:38:15.427 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-04T01:38:15.466 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:38:15.534 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package flex. 2023-11-04T01:38:15.598 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172900 files and directories currently installed.) 2023-11-04T01:38:15.604 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-04T01:38:15.642 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-04T01:38:16.149 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:38:16.297 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-04T01:38:16.690 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:38:17.061 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-04T01:38:17.088 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:38:17.127 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:17.240 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package bison. 2023-11-04T01:38:17.345 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172973 files and directories currently installed.) 2023-11-04T01:38:17.351 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-04T01:38:17.388 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-04T01:38:17.400 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:38:17.404 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:38:17.446 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:17.765 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-04T01:38:17.794 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:38:17.794 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-04T01:38:17.821 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-04T01:38:17.832 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:17.859 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:38:18.143 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-04T01:38:18.171 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-04T01:38:18.196 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package dump. 2023-11-04T01:38:18.201 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:38:18.224 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-04T01:38:18.262 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking dump (0.4b47-3) ... 2023-11-04T01:38:18.504 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-04T01:38:18.532 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:38:18.549 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package indent. 2023-11-04T01:38:18.566 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:18.570 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:38:18.607 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:38:18.843 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-04T01:38:18.860 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-04T01:38:18.957 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-04T01:38:18.984 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:19.023 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:19.033 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:38:19.335 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-04T01:38:19.362 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:19.391 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-04T01:38:19.401 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:19.419 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-04T01:38:19.458 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:38:19.679 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-04T01:38:19.701 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-04T01:38:19.706 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:19.730 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-04T01:38:19.745 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:19.760 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:38:19.989 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-04T01:38:20.005 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:38:20.047 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:38:20.088 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-04T01:38:20.117 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-04T01:38:20.155 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:20.415 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-04T01:38:20.443 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-04T01:38:20.482 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:20.520 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-04T01:38:20.547 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-04T01:38:20.586 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:38:20.735 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjson-perl. 2023-11-04T01:38:20.763 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-04T01:38:20.801 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-04T01:38:20.931 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package modemmanager. 2023-11-04T01:38:20.958 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:38:20.997 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:21.071 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-04T01:38:21.099 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-04T01:38:21.129 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:38:21.578 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package network-manager. 2023-11-04T01:38:21.606 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:38:21.645 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:38:22.243 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ppp. 2023-11-04T01:38:22.271 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-04T01:38:22.585 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:38:22.882 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-04T01:38:22.910 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:38:22.923 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package pptp-linux. 2023-11-04T01:38:22.950 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-04T01:38:22.957 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:22.989 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-04T01:38:23.201 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-04T01:38:23.218 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:38:23.233 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-04T01:38:23.249 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-04T01:38:23.259 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:23.283 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-04T01:38:23.553 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-04T01:38:23.581 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-04T01:38:23.589 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-04T01:38:23.616 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:38:23.619 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client-common (238) ... 2023-11-04T01:38:23.654 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:23.923 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-04T01:38:23.951 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:23.956 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-04T01:38:23.973 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-04T01:38:23.989 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:24.065 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:38:24.394 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-04T01:38:24.422 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:38:24.460 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:38:24.594 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-common. 2023-11-04T01:38:24.622 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-04T01:38:24.680 INFO:teuthology.orchestra.run.smithi091.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-04T01:38:24.709 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-common (238) ... 2023-11-04T01:38:24.821 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-04T01:38:24.850 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:24.888 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:25.152 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-14. 2023-11-04T01:38:25.179 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:25.191 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-04T01:38:25.219 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:25.221 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:25.257 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:25.543 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-04T01:38:25.560 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:25.593 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:25.779 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-04T01:38:25.797 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:38:25.845 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:38:26.383 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-04T01:38:26.411 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-04T01:38:26.449 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:38:26.562 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql. 2023-11-04T01:38:26.579 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-04T01:38:26.613 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql (14+238) ... 2023-11-04T01:38:26.760 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package modemmanager. 2023-11-04T01:38:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:38:26.819 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:26.831 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client. 2023-11-04T01:38:26.859 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-04T01:38:26.898 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client (14+238) ... 2023-11-04T01:38:27.175 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-04T01:38:27.191 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-04T01:38:27.233 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-04T01:38:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager. 2023-11-04T01:38:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:38:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:38:27.560 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package tcl8.6. 2023-11-04T01:38:27.588 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-04T01:38:27.637 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:38:27.896 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package tcl. 2023-11-04T01:38:27.913 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-04T01:38:27.951 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-04T01:38:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ppp. 2023-11-04T01:38:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-04T01:38:28.291 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package wpasupplicant. 2023-11-04T01:38:28.319 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-04T01:38:28.357 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:38:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:38:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package pptp-linux. 2023-11-04T01:38:28.698 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-04T01:38:28.711 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-04T01:38:28.728 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-04T01:38:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-04T01:38:28.778 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-04T01:38:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-04T01:38:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-04T01:38:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-04T01:38:29.114 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-04T01:38:29.142 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-04T01:38:29.181 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:38:29.442 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client-common (238) ... 2023-11-04T01:38:29.653 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-04T01:38:29.754 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:38:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-04T01:38:29.855 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-04T01:38:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-common (238) ... 2023-11-04T01:38:29.973 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:38:30.099 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:38:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-04T01:38:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:30.225 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:30.702 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-04T01:38:30.772 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:38:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-common. 2023-11-04T01:38:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-04T01:38:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-04T01:38:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-common (238) ... 2023-11-04T01:38:31.170 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:38:31.170 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:38:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-14. 2023-11-04T01:38:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:38:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:31.725 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:38:31.851 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:38:31.968 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-04T01:38:32.095 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:38:32.220 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:32.346 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:38:32.472 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:38:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql. 2023-11-04T01:38:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-04T01:38:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql (14+238) ... 2023-11-04T01:38:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client. 2023-11-04T01:38:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-04T01:38:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client (14+238) ... 2023-11-04T01:38:33.078 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:38:33.204 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up dump (0.4b47-3) ... 2023-11-04T01:38:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-04T01:38:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-04T01:38:33.297 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-04T01:38:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-04T01:38:33.355 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:33.481 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:38:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl8.6. 2023-11-04T01:38:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-04T01:38:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:38:33.739 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-04T01:38:33.866 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-04T01:38:33.979 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl. 2023-11-04T01:38:33.993 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:38:34.007 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-04T01:38:34.051 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-04T01:38:34.082 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-04T01:38:34.152 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:38:34.278 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:38:34.357 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package wpasupplicant. 2023-11-04T01:38:34.385 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-04T01:38:34.415 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:38:34.454 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:38:34.580 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:34.706 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-04T01:38:34.874 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client (14+238) ... 2023-11-04T01:38:34.979 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-04T01:38:34.983 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:38:35.008 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-04T01:38:35.055 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-04T01:38:35.391 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-04T01:38:35.420 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-04T01:38:35.458 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:38:35.514 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi091.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi091.stdout:which means they are currently configured by ifupdown: 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi091.stdout:- enp3s0f1 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi091.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi091.stdout:remove their configuration from /etc/network/interfaces. 2023-11-04T01:38:35.515 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:35.639 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-04T01:38:35.736 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-common (238) ... 2023-11-04T01:38:35.955 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-04T01:38:36.014 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-04T01:38:36.081 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:38:36.199 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:36.308 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:38:36.393 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-04T01:38:36.409 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:38:36.536 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:36.978 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:37.098 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-04T01:38:37.129 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:37.191 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:38:37.247 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-04T01:38:37.373 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-common (238) ... 2023-11-04T01:38:37.570 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:38:37.570 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:38:38.094 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:38:38.220 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:38:38.346 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-04T01:38:38.472 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:38:38.598 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:38.724 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:38:38.833 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:38:38.989 INFO:teuthology.orchestra.run.smithi091.stdout:Adding user postgres to group ssl-cert 2023-11-04T01:38:39.228 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:39.228 INFO:teuthology.orchestra.run.smithi091.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-04T01:38:39.402 INFO:teuthology.orchestra.run.smithi091.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-04T01:38:39.402 INFO:teuthology.orchestra.run.smithi091.stdout:Removing obsolete dictionary files: 2023-11-04T01:38:39.438 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:38:39.564 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up dump (0.4b47-3) ... 2023-11-04T01:38:39.658 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-04T01:38:39.725 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:39.834 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:38:39.935 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-04T01:38:40.003 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-04T01:38:40.044 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-04T01:38:40.178 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:38:40.270 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-04T01:38:40.338 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:38:40.464 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:38:40.482 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:40.641 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:38:40.775 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:40.799 INFO:teuthology.orchestra.run.smithi091.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-04T01:38:40.824 INFO:teuthology.orchestra.run.smithi091.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-04T01:38:40.871 INFO:teuthology.orchestra.run.smithi091.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-04T01:38:40.871 INFO:teuthology.orchestra.run.smithi091.stdout:This user must also own the server process. 2023-11-04T01:38:40.871 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:40.871 INFO:teuthology.orchestra.run.smithi091.stdout:The database cluster will be initialized with locale "en_US". 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout:The default text search configuration will be set to "english". 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout:Data page checksums are disabled. 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout:creating subdirectories ... ok 2023-11-04T01:38:40.872 INFO:teuthology.orchestra.run.smithi091.stdout:selecting dynamic shared memory implementation ... posix 2023-11-04T01:38:40.884 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-04T01:38:40.886 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default max_connections ... 100 2023-11-04T01:38:40.907 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default shared_buffers ... 128MB 2023-11-04T01:38:40.917 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default time zone ... Etc/UTC 2023-11-04T01:38:40.918 INFO:teuthology.orchestra.run.smithi091.stdout:creating configuration files ... ok 2023-11-04T01:38:41.019 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client (14+238) ... 2023-11-04T01:38:41.032 INFO:teuthology.orchestra.run.smithi091.stdout:running bootstrap script ... ok 2023-11-04T01:38:41.145 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:38:41.636 INFO:teuthology.orchestra.run.smithi091.stdout:performing post-bootstrap initialization ... ok 2023-11-04T01:38:41.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:41.650 INFO:teuthology.orchestra.run.smithi040.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-04T01:38:41.650 INFO:teuthology.orchestra.run.smithi040.stdout:which means they are currently configured by ifupdown: 2023-11-04T01:38:41.650 INFO:teuthology.orchestra.run.smithi040.stdout:- ens1f0 2023-11-04T01:38:41.651 INFO:teuthology.orchestra.run.smithi040.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-04T01:38:41.651 INFO:teuthology.orchestra.run.smithi040.stdout:remove their configuration from /etc/network/interfaces. 2023-11-04T01:38:41.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:41.792 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-04T01:38:42.164 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-04T01:38:42.277 INFO:teuthology.orchestra.run.smithi091.stdout:syncing data to disk ... ok 2023-11-04T01:38:42.519 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-04T01:38:42.672 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-04T01:38:43.072 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:38:43.217 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:38:43.342 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-04T01:38:43.459 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-common (238) ... 2023-11-04T01:38:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:Adding user postgres to group ssl-cert 2023-11-04T01:38:44.571 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:44.571 INFO:teuthology.orchestra.run.smithi040.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-04T01:38:44.760 INFO:teuthology.orchestra.run.smithi040.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-04T01:38:44.760 INFO:teuthology.orchestra.run.smithi040.stdout:Removing obsolete dictionary files: 2023-11-04T01:38:45.388 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-04T01:38:45.455 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:45.564 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-04T01:38:45.673 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql (14+238) ... 2023-11-04T01:38:45.799 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:45.836 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:38:45.925 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:46.161 INFO:teuthology.orchestra.run.smithi040.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-04T01:38:46.178 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:38:46.178 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:38:46.179 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:This user must also own the server process. 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:The database cluster will be initialized with locale "en_US". 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:The default text search configuration will be set to "english". 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:Data page checksums are disabled. 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-04T01:38:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:creating subdirectories ... ok 2023-11-04T01:38:46.222 INFO:teuthology.orchestra.run.smithi040.stdout:selecting dynamic shared memory implementation ... posix 2023-11-04T01:38:46.234 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default max_connections ... 100 2023-11-04T01:38:46.252 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default shared_buffers ... 128MB 2023-11-04T01:38:46.262 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default time zone ... Etc/UTC 2023-11-04T01:38:46.263 INFO:teuthology.orchestra.run.smithi040.stdout:creating configuration files ... ok 2023-11-04T01:38:46.375 INFO:teuthology.orchestra.run.smithi040.stdout:running bootstrap script ... ok 2023-11-04T01:38:46.778 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-04T01:38:47.037 INFO:teuthology.orchestra.run.smithi040.stdout:performing post-bootstrap initialization ... ok 2023-11-04T01:38:47.072 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:38:47.223 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:38:47.655 INFO:teuthology.orchestra.run.smithi040.stdout:syncing data to disk ... ok 2023-11-04T01:38:48.109 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-04T01:38:48.467 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-04T01:38:48.567 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-04T01:38:49.179 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:38:49.182 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:50.926 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:51.052 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-04T01:38:51.178 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql (14+238) ... 2023-11-04T01:38:51.304 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:38:51.413 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:38:51.658 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:38:51.658 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:38:52.291 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-04T01:38:52.585 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:38:52.753 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:38:54.122 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-04T01:38:54.222 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-04T01:38:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:38:54.874 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:54.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:38:55.015 DEBUG:teuthology.orchestra.run.smithi040:> dpkg-query -W -f '${Version}' ceph 2023-11-04T01:38:55.035 INFO:teuthology.orchestra.run.smithi040.stdout:18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:55.035 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:55.035 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035-g7532011a-1jammy is installed. 2023-11-04T01:38:55.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:38:55.248 DEBUG:teuthology.orchestra.run.smithi091:> dpkg-query -W -f '${Version}' ceph 2023-11-04T01:38:55.268 INFO:teuthology.orchestra.run.smithi091.stdout:18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:55.268 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:55.268 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035-g7532011a-1jammy is installed. 2023-11-04T01:38:55.268 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T01:38:55.269 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:55.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:38:55.283 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:55.283 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:38:55.325 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T01:38:55.325 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:55.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:38:55.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:38:55.396 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:55.396 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:38:55.409 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:38:55.463 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T01:38:55.463 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:55.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:38:55.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:38:55.538 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:55.538 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:38:55.551 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:38:55.607 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T01:38:55.607 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:55.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:38:55.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:38:55.680 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:55.680 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:38:55.693 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:38:55.748 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T01:38:55.814 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T01:38:55.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-11-04T01:38:55.816 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /var/log/ceph 2023-11-04T01:38:55.829 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T01:38:55.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:38:55.870 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:38:55.883 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T01:38:55.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:38:55.927 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:38:55.952 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T01:38:55.952 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T01:38:55.952 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T01:38:55.952 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:55.953 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:38:55.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:56.065 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:56.065 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:38:56.070 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:56.149 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T01:38:56.149 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T01:38:56.150 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7445923', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231103.180916', 'sha1': '702f9e6492477037e018f68dfdf636a30c24f329'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7192, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231103.180916', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '702f9e6492477037e018f68dfdf636a30c24f329', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObjzkOIRGUA/IGRZGae37U/XDfCXtLtiK/EkhveSRNXY05XcUpf0WEB+mPgaqfQVuR3/mzKeWsP7F092gmawQc=', 'smithi091.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGp5T0z04DJrPMtyLJse+C9AA/f1IUwrnreXuSXlkCBjRW4LDq6ssOWsdbrX8AQSoEspz75IP7kWmHJtBc1K1Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-03_18:12:33', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T01:38:56.150 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:38:56.152 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:38:56.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:38:56.201 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:38:56.248 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:56.248 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:38:56.260 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:38:56.260 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-11-04T01:38:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-11-04 01:32:07.250945208 +0000 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-11-04 01:32:06.214948234 +0000 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-11-04 01:32:06.214948234 +0000 2023-11-04T01:38:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-11-04T01:38:56.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-11-04T01:38:56.363 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000407959 s, 1.3 MB/s 2023-11-04T01:38:56.364 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:38:56.414 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-11-04 01:32:08.562941376 +0000 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-11-04 01:32:07.494944495 +0000 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-11-04 01:32:07.494944495 +0000 2023-11-04T01:38:56.461 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-11-04T01:38:56.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:38:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-11-04T01:38:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-11-04T01:38:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000346666 s, 1.5 MB/s 2023-11-04T01:38:56.517 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:38:56.566 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-11-04T01:38:56.612 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-11-04 01:32:08.798940686 +0000 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-11-04 01:32:08.794940698 +0000 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-11-04 01:32:08.794940698 +0000 2023-11-04T01:38:56.613 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-11-04T01:38:56.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:38:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-11-04T01:38:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-11-04T01:38:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000390708 s, 1.3 MB/s 2023-11-04T01:38:56.668 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:38:56.718 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-11-04T01:38:56.768 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-11-04 01:32:10.190935620 +0000 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-11-04 01:32:10.186935632 +0000 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-11-04 01:32:10.186935632 +0000 2023-11-04T01:38:56.769 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-11-04T01:38:56.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:38:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-11-04T01:38:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-11-04T01:38:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000410543 s, 1.2 MB/s 2023-11-04T01:38:56.825 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:38:56.874 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:38:56.874 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:56.874 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:38:56.880 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:38:56.880 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:38:56.928 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 884 Links: 1 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-04 01:32:05.939246338 +0000 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-04 01:32:04.915264702 +0000 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-04 01:32:04.915264702 +0000 2023-11-04T01:38:56.929 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-04T01:38:56.929 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:38:56.982 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-04T01:38:56.982 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-04T01:38:56.983 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000385304 s, 1.3 MB/s 2023-11-04T01:38:56.984 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:38:57.033 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 2023-11-04T01:38:57.080 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:38:57.080 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:57.080 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-11-04T01:38:57.080 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:57.080 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-04 01:32:07.323221836 +0000 2023-11-04T01:38:57.081 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-04 01:32:06.291240025 +0000 2023-11-04T01:38:57.081 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-04 01:32:06.291240025 +0000 2023-11-04T01:38:57.081 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-04T01:38:57.081 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:38:57.134 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-04T01:38:57.134 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-04T01:38:57.134 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000411157 s, 1.2 MB/s 2023-11-04T01:38:57.135 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:38:57.185 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-04 01:32:07.783214047 +0000 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-04 01:32:07.779214115 +0000 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-04 01:32:07.779214115 +0000 2023-11-04T01:38:57.232 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-04T01:38:57.233 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-04T01:38:57.286 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.0003926 s, 1.3 MB/s 2023-11-04T01:38:57.287 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:38:57.337 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-11-04 01:32:10.031175008 +0000 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-11-04 01:32:09.159189748 +0000 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-11-04 01:32:09.159189748 +0000 2023-11-04T01:38:57.384 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-11-04T01:38:57.385 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:38:57.438 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-11-04T01:38:57.439 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-11-04T01:38:57.439 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000419074 s, 1.2 MB/s 2023-11-04T01:38:57.440 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:38:57.489 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:38:57.489 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:38:57.489 INFO:tasks.ceph:Generating config... 2023-11-04T01:38:57.490 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-04T01:38:57.491 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T01:38:57.491 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T01:38:57.491 INFO:tasks.ceph:[client] pid file = 2023-11-04T01:38:57.491 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-04T01:38:57.491 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-04T01:38:57.491 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T01:38:57.491 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-04T01:38:57.491 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T01:38:57.491 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-04T01:38:57.491 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-04T01:38:57.491 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T01:38:57.492 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-04T01:38:57.492 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-04T01:38:57.492 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T01:38:57.493 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T01:38:57.494 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T01:38:57.494 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T01:38:57.494 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-04T01:38:57.494 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T01:38:57.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T01:38:57.529 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T01:38:57.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T01:38:57.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:38:57.679 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.91'), ('mon.c', '[v2:172.21.15.91:3301,v1:172.21.15.91:6790]')] 2023-11-04T01:38:57.680 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.91,[v2:172.21.15.91:3301,v1:172.21.15.91:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-04T01:38:57.680 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:57.680 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:38:57.724 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.91 --addv c '[v2:172.21.15.91:3301,v1:172.21.15.91:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:38:57.809 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:fsid f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-11-04T01:38:57.810093+0000 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-11-04T01:38:57.810093+0000 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.b 2023-11-04T01:38:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] mon.c 2023-11-04T01:38:57.811 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T01:38:57.812 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:38:57.861 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d... 2023-11-04T01:38:57.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:38:57.905 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:38:57.934 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-11-04T01:38:57.934 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-11-04T01:38:57.935 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-11-04T01:38:57.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-11-04T01:38:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-11-04T01:38:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.91,[v2:172.21.15.91:3301,v1:172.21.15.91:6790]" 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.939 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-11-04T01:38:57.940 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:38:57.941 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-11-04T01:38:57.942 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:38:57.943 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-11-04T01:38:57.944 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:38:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-11-04T01:38:57.946 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-11-04T01:38:57.947 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-11-04T01:38:57.948 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-11-04T01:38:57.949 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-11-04T01:38:57.949 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-11-04T01:38:57.950 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2023-11-04T01:38:57.950 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2023-11-04T01:38:57.950 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2023-11-04T01:38:57.951 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:38:57.952 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.953 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "172.21.15.40,172.21.15.91,[v2:172.21.15.91:3301,v1:172.21.15.91:6790]" 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2023-11-04T01:38:57.954 INFO:teuthology.orchestra.run.smithi091.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug trim objects = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.955 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: bdev async discard = True 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: bdev enable discard = True 2023-11-04T01:38:57.956 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore allocator = bitmap 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 1/20 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 1/20 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 20 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 4/10 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2023-11-04T01:38:57.957 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2023-11-04T01:38:57.958 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:38:57.959 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: # 1m isn't quite enough 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: mon op complaint time = 120 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2023-11-04T01:38:57.960 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: client mount timeout = 600 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: debug client = 20 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = "" 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-04T01:38:57.961 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout:[mds] 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds = 20 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds balancer = 20 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug frag = True 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug scatterstat = True 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: mds op complaint time = 180 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: mds verify scatter = True 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-04T01:38:57.962 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-04T01:38:57.963 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T01:38:57.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T01:38:58.041 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T01:38:58.042 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:58.042 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T01:38:58.047 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:58.088 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T01:38:58.096 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:38:58.096 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:58.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:38:58.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:38:58.163 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:38:58.163 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:38:58.208 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:38:58.209 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:58.209 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:38:58.209 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:38:58.231 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:38:58.232 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:38:58.280 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T01:38:58.280 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T01:38:58.281 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:38:58.324 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:38:58.327 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:38:58.368 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:38:58.381 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T01:38:58.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:38:58.423 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:38:58.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T01:38:58.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:38:58.566 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:38:58.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-04T01:38:58.624 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:38:58.668 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:38:58.671 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T01:38:58.731 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:38:58.816 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:38:58.819 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-04T01:38:58.879 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T01:38:58.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T01:38:58.918 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T01:38:58.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-04T01:38:59.005 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-04T01:38:59.018 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-04T01:38:59.054 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-04T01:38:59.065 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-04T01:38:59.140 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-04T01:38:59.151 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T01:38:59.151 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:38:59.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T01:38:59.166 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:38:59.166 INFO:tasks.ceph:role: osd.0 2023-11-04T01:38:59.166 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:38:59.166 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:38:59.231 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:38:59.231 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:38:59.231 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:38:59.231 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:38:59.231 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:38:59.232 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:38:59.232 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:38:59.232 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:38:59.232 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:38:59.232 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:38:59.681 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-11-04T01:38:59.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-11-04T01:38:59.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T01:38:59.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T01:38:59.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:38:59.786 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:38:59.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T01:38:59.842 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:38:59.842 INFO:tasks.ceph:role: osd.1 2023-11-04T01:38:59.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:38:59.843 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:38:59.904 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:38:59.904 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:38:59.905 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:00.363 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-11-04T01:39:00.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-11-04T01:39:00.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:00.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:00.536 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:00.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:00.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:00.592 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:00.592 INFO:tasks.ceph:role: osd.2 2023-11-04T01:39:00.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:39:00.592 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:39:00.657 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:00.658 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-11-04T01:39:01.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-11-04T01:39:01.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:01.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:01.273 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:01.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:01.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:01.329 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:01.329 INFO:tasks.ceph:role: osd.3 2023-11-04T01:39:01.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:39:01.329 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:01.392 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:39:01.393 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:01.393 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:01.820 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-11-04T01:39:01.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-11-04T01:39:01.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:01.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:01.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:01.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:02.034+0000 7fb5c05ea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T01:39:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:02.038+0000 7fb5c05ea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T01:39:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:02.038+0000 7fb5c05ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:39:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:02.038+0000 7fb5c05ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:39:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:02.038+0000 7fb5c05ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:39:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:02.042+0000 7fb5c05ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T01:39:05.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T01:39:05.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:05.166+0000 7fab87555640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T01:39:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:05.170+0000 7fab87555640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T01:39:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:05.170+0000 7fab87555640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:39:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:05.170+0000 7fab87555640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:39:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:05.170+0000 7fab87555640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:39:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:05.170+0000 7fab87555640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T01:39:08.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:08.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:08.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:08.326+0000 7fa5a80c1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T01:39:08.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:08.326+0000 7fa5a80c1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T01:39:08.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:08.326+0000 7fa5a80c1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:39:08.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:08.326+0000 7fa5a80c1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:39:08.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:08.326+0000 7fa5a80c1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:39:08.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:08.330+0000 7fa5a80c1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T01:39:11.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:11.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:11.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:11.502+0000 7f2070fa2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T01:39:11.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:11.502+0000 7f2070fa2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T01:39:11.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:11.502+0000 7f2070fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:39:11.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:11.502+0000 7f2070fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:39:11.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:11.502+0000 7f2070fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:39:11.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:11.502+0000 7f2070fa2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T01:39:14.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:14.573 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:14.588 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:14.588 INFO:tasks.ceph:role: osd.4 2023-11-04T01:39:14.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:39:14.588 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:39:14.651 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:14.652 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:15.121 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-04T01:39:15.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-04T01:39:15.123 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:15.269 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:15.281 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:15.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:15.282 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:15.333 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:15.333 INFO:tasks.ceph:role: osd.5 2023-11-04T01:39:15.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:39:15.333 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:39:15.394 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:15.394 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:15.394 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:15.394 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:39:15.394 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:15.394 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:15.395 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:15.395 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:39:15.395 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:15.395 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:15.827 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-04T01:39:15.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-04T01:39:15.829 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:15.892 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:15.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:15.944 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:15.945 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:15.996 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:15.997 INFO:tasks.ceph:role: osd.6 2023-11-04T01:39:15.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:39:15.997 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:16.058 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:16.059 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:39:16.059 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:16.059 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:16.512 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-04T01:39:16.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-04T01:39:16.514 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:16.599 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:16.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:16.653 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:16.654 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:16.706 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:16.707 INFO:tasks.ceph:role: osd.7 2023-11-04T01:39:16.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:39:16.707 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:16.772 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:39:16.773 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:16.773 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:17.239 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-11-04T01:39:17.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-11-04T01:39:17.242 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:17.401 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:17.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:39:17.413 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:39:17.414 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:17.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:17.522+0000 7f1848075640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-04T01:39:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:17.526+0000 7f1848075640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-04T01:39:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:17.526+0000 7f1848075640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:39:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:17.526+0000 7f1848075640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:39:17.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:17.526+0000 7f1848075640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:39:17.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:17.530+0000 7f1848075640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-04T01:39:20.556 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:20.569 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:20.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:20.646+0000 7fb7d897a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-04T01:39:20.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:20.646+0000 7fb7d897a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-04T01:39:20.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:20.646+0000 7fb7d897a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:39:20.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:20.646+0000 7fb7d897a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:39:20.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:20.646+0000 7fb7d897a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:39:20.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:20.646+0000 7fb7d897a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-04T01:39:23.642 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:23.699 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:23.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:23.782+0000 7f1192bab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:23.782+0000 7f1192bab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:23.782+0000 7f1192bab640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:23.782+0000 7f1192bab640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:23.782+0000 7f1192bab640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:39:23.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:23.782+0000 7f1192bab640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-04T01:39:26.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:26.155 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:26.852 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:26.865 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:26.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:26.942+0000 7fc5c530b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-04T01:39:26.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:26.942+0000 7fc5c530b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-04T01:39:26.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:26.942+0000 7fc5c530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:39:26.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:26.942+0000 7fc5c530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:39:26.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:26.942+0000 7fc5c530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:39:26.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:26.946+0000 7fc5c530b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-04T01:39:29.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:30.011 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T01:39:30.011 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T01:39:30.026 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T01:39:30.080 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-04T01:39:30.136 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T01:39:30.192 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T01:39:30.248 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T01:39:30.304 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T01:39:30.361 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.361 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T01:39:30.375 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.376 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T01:39:30.431 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.431 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-04T01:39:30.491 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.491 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-04T01:39:30.547 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.547 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-04T01:39:30.603 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.603 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-04T01:39:30.659 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.659 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-04T01:39:30.714 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.714 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T01:39:30.720 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:30.720 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-04T01:39:30.769 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.769 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-04T01:39:30.775 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:30.775 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-04T01:39:30.824 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T01:39:30.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:39:30.826 DEBUG:teuthology.orchestra.run.smithi091:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:39:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ== 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg== 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw== 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg== 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg== 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-11-04T01:39:30.870 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w== 2023-11-04T01:39:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-11-04T01:39:30.871 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g== 2023-11-04T01:39:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-11-04T01:39:30.871 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA== 2023-11-04T01:39:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg== 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ== 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-11-04T01:39:30.873 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw== 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.y] 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ== 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg== 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw== 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.0] 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg== 2023-11-04T01:39:30.878 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.1] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg== 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.2] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w== 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.3] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g== 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.x] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ== 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ== 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ== 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.4] 2023-11-04T01:39:30.879 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.5] 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.6] 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.7] 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[client.2] 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[client.1] 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ== 2023-11-04T01:39:30.880 INFO:teuthology.orchestra.run.smithi091.stdout:[client.3] 2023-11-04T01:39:30.881 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw== 2023-11-04T01:39:30.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:30.918 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:30.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:30.969 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.061 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.111 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.198 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.286 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.360 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.438 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:31.449 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:31.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.534 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.610 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:31.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.655 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.751 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.833 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.917 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:31.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.001 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.051 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.132 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.223 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:32.297 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T01:39:32.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T01:39:32.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:32.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T01:39:32.426 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T01:39:32.439 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:32.538 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T01:39:32.548 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T01:39:32.600 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:32.695 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T01:39:32.706 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:32.708 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:32.750 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T01:39:32.751 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T01:39:32.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T01:39:32.753 INFO:tasks.ceph.mon.a:Started 2023-11-04T01:39:32.754 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T01:39:32.754 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T01:39:32.796 INFO:tasks.ceph.mon.b:Started 2023-11-04T01:39:32.796 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T01:39:32.796 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T01:39:32.798 INFO:tasks.ceph.mon.c:Started 2023-11-04T01:39:32.798 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T01:39:32.798 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T01:39:32.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T01:39:32.801 INFO:tasks.ceph.mgr.y:Started 2023-11-04T01:39:32.801 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T01:39:32.801 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T01:39:32.803 INFO:tasks.ceph.mgr.x:Started 2023-11-04T01:39:32.803 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T01:39:32.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T01:39:32.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.914+0000 7f4a882da640 1 Processor -- start 2023-11-04T01:39:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a882da640 1 -- start start 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a882da640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a882da640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a800b5e00 con 0x7f4a800d1940 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a882da640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a800d0190 con 0x7f4a8015d0b0 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a882da640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a800d1520 con 0x7f4a800cf810 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a86877640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4a800d1940 0x7f4a800d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36396/0 (socket says 172.21.15.40:36396) 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a86877640 1 -- 172.21.15.40:0/350911753 learned_addr learned my addr 172.21.15.40:0/350911753 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a85875640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 msgr2=0x7f4a800cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:39:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a85875640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 msgr2=0x7f4a800cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:32.918+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.122+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.122+0000 7f4a85875640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 msgr2=0x7f4a800cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:39:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.122+0000 7f4a85875640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 msgr2=0x7f4a800cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.122+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.122+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:39:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439357139 0 0) 0x7f4a800b5e00 con 0x7f4a800d1940 2023-11-04T01:39:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c003530 con 0x7f4a800d1940 2023-11-04T01:39:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053489960 0 0) 0x7f4a800d0190 con 0x7f4a8015d0b0 2023-11-04T01:39:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a800b5e00 con 0x7f4a8015d0b0 2023-11-04T01:39:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.1 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1958079049 0 0) 0x7f4a800b5e00 con 0x7f4a8015d0b0 2023-11-04T01:39:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 msgr2=0x7f4a800cfc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a800cfc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 >> v1:172.21.15.40:6789/0 conn(0x7f4a800d1940 legacy=0x7f4a800d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8015d490 con 0x7f4a8015d0b0 2023-11-04T01:39:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.1 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f4a7c001680 con 0x7f4a8015d0b0 2023-11-04T01:39:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 >> v1:172.21.15.91:6789/0 conn(0x7f4a8015d0b0 legacy=0x7f4a80160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6c003b10 0x7f4a6c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a6c004d10 0x7f4a6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a800d1520 con 0x7f4a6c003b10 2023-11-04T01:39:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00bb20 con 0x7f4a6c004d10 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.178+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00bce0 con 0x7f4a800cf810 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86076640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6c003b10 0x7f4a6c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86877640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a6c004d10 0x7f4a6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a85875640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86076640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 msgr2=0x7f4a6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86076640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a800cf810 0x7f4a6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86076640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a6c004d10 msgr2=0x7f4a6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:33.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86076640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a6c004d10 0x7f4a6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.182+0000 7f4a86076640 1 -- 172.21.15.40:0/350911753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a800b5e00 con 0x7f4a6c003b10 2023-11-04T01:39:33.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.190+0000 7f4a86076640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6c003b10 0x7f4a6c003f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c007ea0 tx=0x7f4a7c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51ed4e6a1df4bb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.190+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0a57e0 con 0x7f4a6c003b10 2023-11-04T01:39:33.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.190+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c0a5960 con 0x7f4a6c003b10 2023-11-04T01:39:33.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.190+0000 7f4a85074640 1 -- 172.21.15.40:0/350911753 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0a5d10 con 0x7f4a6c003b10 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 -- 172.21.15.40:0/350911753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6c003b10 msgr2=0x7f4a6c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 --2- 172.21.15.40:0/350911753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a6c003b10 0x7f4a6c003f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c007ea0 tx=0x7f4a7c01ca00 comp rx=0 tx=0).stop 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a86877640 1 -- 172.21.15.40:0/350911753 reap_dead start 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 -- 172.21.15.40:0/350911753 shutdown_connections 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 -- 172.21.15.40:0/350911753 >> 172.21.15.40:0/350911753 conn(0x7f4a8006a890 msgr2=0x7f4a8006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 -- 172.21.15.40:0/350911753 shutdown_connections 2023-11-04T01:39:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 -- 172.21.15.40:0/350911753 wait complete. 2023-11-04T01:39:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 Processor -- start 2023-11-04T01:39:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.194+0000 7f4a882da640 1 -- start start 2023-11-04T01:39:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a6c003b10 0x7f4a800ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 0x7f4a800b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a80154ab0 0x7f4a80154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80156230 con 0x7f4a800b4e90 2023-11-04T01:39:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80155470 con 0x7f4a80154ab0 2023-11-04T01:39:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a800caae0 con 0x7f4a6c003b10 2023-11-04T01:39:33.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 0x7f4a800b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 0x7f4a800b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36214/0 (socket says 172.21.15.40:36214) 2023-11-04T01:39:33.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a86877640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a80154ab0 0x7f4a80154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 -- 172.21.15.40:0/831379010 learned_addr learned my addr 172.21.15.40:0/831379010 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:33.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a86076640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a6c003b10 0x7f4a800ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 -- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a6c003b10 msgr2=0x7f4a800ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a6c003b10 0x7f4a800ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 -- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a80154ab0 msgr2=0x7f4a80154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a80154ab0 0x7f4a80154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 -- 172.21.15.40:0/831379010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a800cadc0 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a86877640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a80154ab0 0x7f4a80154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a85875640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 0x7f4a800b5310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a70013980 tx=0x7f4a70013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70011a50 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7000c050 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70011df0 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a800cb0a0 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80155920 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4a70005ca0 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4a70006870 con 0x7f4a800b4e90 2023-11-04T01:39:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.198+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a800cb550 con 0x7f4a800b4e90 2023-11-04T01:39:33.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.206+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4a7003db40 con 0x7f4a800b4e90 2023-11-04T01:39:33.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.286+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4a800744a0 con 0x7f4a800b4e90 2023-11-04T01:39:33.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a76ffd640 1 -- 172.21.15.40:0/831379010 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4a7002c020 con 0x7f4a800b4e90 2023-11-04T01:39:33.295 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-11-04T01:39:33.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 msgr2=0x7f4a800b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 0x7f4a800b5310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a70013980 tx=0x7f4a70013e40 comp rx=0 tx=0).stop 2023-11-04T01:39:33.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 shutdown_connections 2023-11-04T01:39:33.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4a80154ab0 0x7f4a80154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a800b4e90 0x7f4a800b5310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 --2- 172.21.15.40:0/831379010 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4a6c003b10 0x7f4a800ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 >> 172.21.15.40:0/831379010 conn(0x7f4a8006a890 msgr2=0x7f4a80160910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 shutdown_connections 2023-11-04T01:39:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:33.294+0000 7f4a882da640 1 -- 172.21.15.40:0/831379010 wait complete. 2023-11-04T01:39:33.315 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T01:39:33.315 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T01:39:33.316 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:33.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T01:39:33.328 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:33.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T01:39:33.384 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:33.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T01:39:33.423 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:33.421+0000 7fa4ca66f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:39:33.440 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:39:33.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T01:39:33.501 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:33.501 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-04T01:39:33.515 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:33.515 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-04T01:39:33.571 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:33.571 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-04T01:39:33.626 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:39:33.626 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-04T01:39:33.678 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new f79021a9-1c37-4e56-b6b9-55cf9d93f960 0 2023-11-04T01:39:33.735 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:33.730+0000 7f4972d33180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:39:33.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.837+0000 7f306ee82640 1 Processor -- start 2023-11-04T01:39:33.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.837+0000 7f306ee82640 1 -- start start 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.837+0000 7f306ee82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3068160790 0x7f3068065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.837+0000 7f306ee82640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680ca010 con 0x7f30680ceb70 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306ee82640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680c9a30 con 0x7f306806b280 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306ee82640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3068160b70 con 0x7f3068160790 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3068160790 0x7f3068065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3068160790 0x7f3068065dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60892/0 (socket says 172.21.15.91:60892) 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 -- 172.21.15.91:0/3685449058 learned_addr learned my addr 172.21.15.91:0/3685449058 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 -- 172.21.15.91:0/3685449058 >> v1:172.21.15.91:6789/0 conn(0x7f306806b280 legacy=0x7f3068160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 -- 172.21.15.91:0/3685449058 >> v1:172.21.15.40:6789/0 conn(0x7f30680ceb70 legacy=0x7f306806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f30677fe640 1 -- 172.21.15.91:0/3685449058 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964843190 0 0) 0x7f30680c9a30 con 0x7f306806b280 2023-11-04T01:39:33.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 -- 172.21.15.91:0/3685449058 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680cb590 con 0x7f3068160790 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306cc1e640 1 --2- 172.21.15.91:0/3685449058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f3068065dc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3060009e50 tx=0x7f306001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c871636bf6caaf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f30677fe640 1 -- 172.21.15.91:0/3685449058 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600a55d0 con 0x7f3068160790 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f30677fe640 1 -- 172.21.15.91:0/3685449058 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30600a5730 con 0x7f3068160790 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f30677fe640 1 -- 172.21.15.91:0/3685449058 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600a5ac0 con 0x7f3068160790 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306ee82640 1 -- 172.21.15.91:0/3685449058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 msgr2=0x7f3068065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.841+0000 7f306ee82640 1 --2- 172.21.15.91:0/3685449058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f3068065dc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3060009e50 tx=0x7f306001ca10 comp rx=0 tx=0).stop 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/3685449058 shutdown_connections 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 --2- 172.21.15.91:0/3685449058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f3068065dc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/3685449058 >> 172.21.15.91:0/3685449058 conn(0x7f30680b0e30 msgr2=0x7f30680b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/3685449058 shutdown_connections 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/3685449058 wait complete. 2023-11-04T01:39:33.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 Processor -- start 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- start start 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 0x7f30680c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30680ceb70 0x7f30680b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f30680ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c6e70 con 0x7f30680ceb70 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c8a70 con 0x7f3068160790 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30680c87a0 con 0x7f306806b280 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306cc1e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 0x7f30680c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f30680ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306cc1e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 0x7f30680c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50342/0 (socket says 172.21.15.91:50342) 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306cc1e640 1 -- 172.21.15.91:0/1892041350 learned_addr learned my addr 172.21.15.91:0/1892041350 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f30680ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60898/0 (socket says 172.21.15.91:60898) 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f3067fff640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30680ceb70 0x7f30680b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 -- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 msgr2=0x7f30680c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 0x7f30680c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 -- 172.21.15.91:0/1892041350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30680ceb70 msgr2=0x7f30680b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30680ceb70 0x7f30680b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 -- 172.21.15.91:0/1892041350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3060009b30 con 0x7f3068160790 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306cc1e640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 0x7f30680c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306d41f640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f30680ad910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f305800c3e0 tx=0x7f305800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580054e0 con 0x7f3068160790 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058003600 con 0x7f3068160790 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680c6540 con 0x7f3068160790 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580039f0 con 0x7f3068160790 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680c6b00 con 0x7f3068160790 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f305801c440 con 0x7f3068160790 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3058012780 con 0x7f3068160790 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.845+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30680c72e0 con 0x7f3068160790 2023-11-04T01:39:33.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.861+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f30680c72e0 con 0x7f3068160790 2023-11-04T01:39:33.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.929+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f79021a9-1c37-4e56-b6b9-55cf9d93f960", "id": 0} v 0) v1 -- 0x7f3068066030 con 0x7f3068160790 2023-11-04T01:39:33.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f30657fa640 1 -- 172.21.15.91:0/1892041350 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f79021a9-1c37-4e56-b6b9-55cf9d93f960", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3058017070 con 0x7f3068160790 2023-11-04T01:39:33.936 INFO:teuthology.orchestra.run.smithi091.stdout:0 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 msgr2=0x7f30680ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f30680ad910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f305800c3e0 tx=0x7f305800c8a0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 shutdown_connections 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3068160790 0x7f30680ad910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30680ceb70 0x7f30680b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 --2- 172.21.15.91:0/1892041350 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f306806b280 0x7f30680c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 >> 172.21.15.91:0/1892041350 conn(0x7f30680b0e30 msgr2=0x7f3068157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 shutdown_connections 2023-11-04T01:39:33.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:33.937+0000 7f306ee82640 1 -- 172.21.15.91:0/1892041350 wait complete. 2023-11-04T01:39:33.950 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:33.949+0000 7fa4ca66f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:39:33.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 0ef244d7-56b1-4291-a58a-b5ec353cb581 1 2023-11-04T01:39:34.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8007ca3640 1 Processor -- start 2023-11-04T01:39:34.069 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8007ca3640 1 -- start start 2023-11-04T01:39:34.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8007ca3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80000ce9e0 0x7f80000c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8007ca3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80000ca530 con 0x7f8000159420 2023-11-04T01:39:34.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8007ca3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80000cd3b0 con 0x7f80000ca0e0 2023-11-04T01:39:34.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8007ca3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000cdff0 con 0x7f80000ce9e0 2023-11-04T01:39:34.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f800523e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80000ce9e0 0x7f80000c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8006240640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f80000ca0e0 0x7f8000159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45016/0 (socket says 172.21.15.91:45016) 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8006240640 1 -- 172.21.15.91:0/1755054595 learned_addr learned my addr 172.21.15.91:0/1755054595 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8004a3d640 1 -- 172.21.15.91:0/1755054595 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710727627 0 0) 0x7f80000cd3b0 con 0x7f80000ca0e0 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f8004a3d640 1 -- 172.21.15.91:0/1755054595 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fec003450 con 0x7f80000ca0e0 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f800523e640 1 -- 172.21.15.91:0/1755054595 >> v1:172.21.15.91:6789/0 conn(0x7f80000ca0e0 legacy=0x7f8000159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f800523e640 1 -- 172.21.15.91:0/1755054595 >> v1:172.21.15.40:6789/0 conn(0x7f8000159420 legacy=0x7f800015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.069+0000 7f800523e640 1 -- 172.21.15.91:0/1755054595 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000cd650 con 0x7f80000ce9e0 2023-11-04T01:39:34.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f800523e640 1 --2- 172.21.15.91:0/1755054595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80000ce9e0 0x7f80000c9ba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0097c0 tx=0x7f7ffc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa2a73560972541 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8004a3d640 1 -- 172.21.15.91:0/1755054595 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0ab600 con 0x7f80000ce9e0 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8004a3d640 1 -- 172.21.15.91:0/1755054595 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0a7050 con 0x7f80000ce9e0 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8004a3d640 1 -- 172.21.15.91:0/1755054595 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0ab980 con 0x7f80000ce9e0 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- 172.21.15.91:0/1755054595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80000ce9e0 msgr2=0x7f80000c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 --2- 172.21.15.91:0/1755054595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80000ce9e0 0x7f80000c9ba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc0097c0 tx=0x7f7ffc01c3f0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- 172.21.15.91:0/1755054595 shutdown_connections 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 --2- 172.21.15.91:0/1755054595 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80000ce9e0 0x7f80000c9ba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- 172.21.15.91:0/1755054595 >> 172.21.15.91:0/1755054595 conn(0x7f80000b0e30 msgr2=0x7f80000b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- 172.21.15.91:0/1755054595 shutdown_connections 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- 172.21.15.91:0/1755054595 wait complete. 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 Processor -- start 2023-11-04T01:39:34.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- start start 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 0x7f8000148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80000ce9e0 0x7f800015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8000159420 0x7f8000156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800015c210 con 0x7f80000ce9e0 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80001487c0 con 0x7f8000159420 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800015cbe0 con 0x7f80000ca0e0 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8005a3f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 0x7f8000148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8000159420 0x7f8000156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8005a3f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 0x7f8000148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50354/0 (socket says 172.21.15.91:50354) 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8005a3f640 1 -- 172.21.15.91:0/3382238827 learned_addr learned my addr 172.21.15.91:0/3382238827 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f800523e640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80000ce9e0 0x7f800015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 -- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 msgr2=0x7f8000148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 0x7f8000148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 -- 172.21.15.91:0/3382238827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80000ce9e0 msgr2=0x7f800015c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80000ce9e0 0x7f800015c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 -- 172.21.15.91:0/3382238827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009420 con 0x7f8000159420 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8005a3f640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 0x7f8000148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f800523e640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80000ce9e0 0x7f800015c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8006240640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8000159420 0x7f8000156d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800ca80 tx=0x7f7ff800cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800ac30 con 0x7f8000159420 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800ad90 con 0x7f8000159420 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.073+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80001563a0 con 0x7f8000159420 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.077+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8012600 con 0x7f8000159420 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.077+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000156960 con 0x7f8000159420 2023-11-04T01:39:34.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.077+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ff8012a60 con 0x7f8000159420 2023-11-04T01:39:34.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.077+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7ff8007070 con 0x7f8000159420 2023-11-04T01:39:34.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.077+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000156b50 con 0x7f8000159420 2023-11-04T01:39:34.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.077+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8000156b50 con 0x7f8000159420 2023-11-04T01:39:34.129 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:34.129+0000 7fa4ca66f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:39:34.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.145+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0ef244d7-56b1-4291-a58a-b5ec353cb581", "id": 1} v 0) v1 -- 0x7f800015c3c0 con 0x7f8000159420 2023-11-04T01:39:34.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f7ff27fc640 1 -- 172.21.15.91:0/3382238827 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ef244d7-56b1-4291-a58a-b5ec353cb581", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f800015c3c0 con 0x7f8000159420 2023-11-04T01:39:34.156 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-04T01:39:34.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8000159420 msgr2=0x7f8000156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8000159420 0x7f8000156d10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800ca80 tx=0x7f7ff800cf40 comp rx=0 tx=0).stop 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 shutdown_connections 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8000159420 0x7f8000156d10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80000ce9e0 0x7f800015c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 --2- 172.21.15.91:0/3382238827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80000ca0e0 0x7f8000148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 >> 172.21.15.91:0/3382238827 conn(0x7f80000b0e30 msgr2=0x7f800006c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 shutdown_connections 2023-11-04T01:39:34.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.157+0000 7f8007ca3640 1 -- 172.21.15.91:0/3382238827 wait complete. 2023-11-04T01:39:34.173 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 1dc3282c-ecbd-47ec-8c89-ee2dc120078b 2 2023-11-04T01:39:34.261 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:34.257+0000 7f4972d33180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:39:34.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 Processor -- start 2023-11-04T01:39:34.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 -- start start 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a1015af50 0x7f2a100cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a100b32f0 0x7f2a100ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100cd830 con 0x7f2a100cf4c0 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a100b3780 con 0x7f2a100b32f0 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.289+0000 7f2a15660640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100cdad0 con 0x7f2a1015af50 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0f7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2a100cf4c0 0x7f2a1015e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45018/0 (socket says 172.21.15.91:45018) 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0effd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a1015af50 0x7f2a100cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0f7fe640 1 -- 172.21.15.91:0/2297523560 learned_addr learned my addr 172.21.15.91:0/2297523560 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0e7fc640 1 --2- 172.21.15.91:0/2297523560 >> v2:172.21.15.40:3300/0 conn(0x7f2a100b32f0 0x7f2a100ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0effd640 1 -- 172.21.15.91:0/2297523560 >> v2:172.21.15.40:3300/0 conn(0x7f2a100b32f0 msgr2=0x7f2a100ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0effd640 1 --2- 172.21.15.91:0/2297523560 >> v2:172.21.15.40:3300/0 conn(0x7f2a100b32f0 0x7f2a100ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0effd640 1 -- 172.21.15.91:0/2297523560 >> v1:172.21.15.91:6789/0 conn(0x7f2a100cf4c0 legacy=0x7f2a1015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0dffb640 1 -- 172.21.15.91:0/2297523560 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537477732 0 0) 0x7f2a100cd830 con 0x7f2a100cf4c0 2023-11-04T01:39:34.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0effd640 1 -- 172.21.15.91:0/2297523560 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100cddb0 con 0x7f2a1015af50 2023-11-04T01:39:34.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0effd640 1 --2- 172.21.15.91:0/2297523560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a1015af50 0x7f2a100cb330 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29f80097a0 tx=0x7f29f801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f619a610c368827d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0dffb640 1 -- 172.21.15.91:0/2297523560 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80ab5f0 con 0x7f2a1015af50 2023-11-04T01:39:34.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0dffb640 1 -- 172.21.15.91:0/2297523560 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f80ab750 con 0x7f2a1015af50 2023-11-04T01:39:34.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a0dffb640 1 -- 172.21.15.91:0/2297523560 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80abae0 con 0x7f2a1015af50 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 -- 172.21.15.91:0/2297523560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a1015af50 msgr2=0x7f2a100cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 --2- 172.21.15.91:0/2297523560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a1015af50 0x7f2a100cb330 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f29f80097a0 tx=0x7f29f801c3d0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 -- 172.21.15.91:0/2297523560 shutdown_connections 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 --2- 172.21.15.91:0/2297523560 >> v2:172.21.15.40:3300/0 conn(0x7f2a100b32f0 0x7f2a100ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 --2- 172.21.15.91:0/2297523560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a1015af50 0x7f2a100cb330 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 -- 172.21.15.91:0/2297523560 >> 172.21.15.91:0/2297523560 conn(0x7f2a10065dc0 msgr2=0x7f2a100661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 -- 172.21.15.91:0/2297523560 shutdown_connections 2023-11-04T01:39:34.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.293+0000 7f2a15660640 1 -- 172.21.15.91:0/2297523560 wait complete. 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 Processor -- start 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- start start 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 0x7f2a10150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a1015af50 0x7f2a10155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a101596d0 0x7f2a10159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10151f80 con 0x7f2a101596d0 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10155980 con 0x7f2a1015af50 2023-11-04T01:39:34.298 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10151370 con 0x7f2a100cf4c0 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 0x7f2a10150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a1015af50 0x7f2a10155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 0x7f2a10150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50372/0 (socket says 172.21.15.91:50372) 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 -- 172.21.15.91:0/756495149 learned_addr learned my addr 172.21.15.91:0/756495149 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0f7fe640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a101596d0 0x7f2a10159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 -- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a1015af50 msgr2=0x7f2a10155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a1015af50 0x7f2a10155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 -- 172.21.15.91:0/756495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a101596d0 msgr2=0x7f2a10159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a101596d0 0x7f2a10159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 -- 172.21.15.91:0/756495149 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80093b0 con 0x7f2a100cf4c0 2023-11-04T01:39:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0e7fc640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a1015af50 0x7f2a10155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a0effd640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 0x7f2a10150ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29f801c8b0 tx=0x7f29f8019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8004230 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8004390 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a10151650 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8005be0 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a10151c10 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29f80bc070 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f29f80a8050 con 0x7f2a100cf4c0 2023-11-04T01:39:34.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.297+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10066a90 con 0x7f2a100cf4c0 2023-11-04T01:39:34.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.301+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f29f80c3020 con 0x7f2a100cf4c0 2023-11-04T01:39:34.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.369+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1dc3282c-ecbd-47ec-8c89-ee2dc120078b", "id": 2} v 0) v1 -- 0x7f2a100cd400 con 0x7f2a100cf4c0 2023-11-04T01:39:34.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a077fe640 1 -- 172.21.15.91:0/756495149 <== mon.2 v2:172.21.15.91:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1dc3282c-ecbd-47ec-8c89-ee2dc120078b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29f80abd50 con 0x7f2a100cf4c0 2023-11-04T01:39:34.377 INFO:teuthology.orchestra.run.smithi091.stdout:2 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 msgr2=0x7f2a10150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 0x7f2a10150ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29f801c8b0 tx=0x7f29f8019170 comp rx=0 tx=0).stop 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 shutdown_connections 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a101596d0 0x7f2a10159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a1015af50 0x7f2a10155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 --2- 172.21.15.91:0/756495149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a100cf4c0 0x7f2a10150ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 >> 172.21.15.91:0/756495149 conn(0x7f2a10065dc0 msgr2=0x7f2a1006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 shutdown_connections 2023-11-04T01:39:34.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.377+0000 7f2a15660640 1 -- 172.21.15.91:0/756495149 wait complete. 2023-11-04T01:39:34.393 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new a6b52471-c1d1-49b7-bc2c-c4d4868c7198 3 2023-11-04T01:39:34.456 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:34.449+0000 7f4972d33180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:39:34.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 Processor -- start 2023-11-04T01:39:34.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 -- start start 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 0x7fa21c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa21c0cf4c0 0x7fa21c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c0cd830 con 0x7fa21c0b32f0 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c0b3780 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa224157640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0cdad0 con 0x7fa21c15af50 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 0x7fa21c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 0x7fa21c0cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50386/0 (socket says 172.21.15.91:50386) 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 -- 172.21.15.91:0/1594739879 learned_addr learned my addr 172.21.15.91:0/1594739879 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa2226f4640 1 --2- 172.21.15.91:0/1594739879 >> v2:172.21.15.40:3300/0 conn(0x7fa21c0cf4c0 0x7fa21c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 -- 172.21.15.91:0/1594739879 >> v2:172.21.15.40:3300/0 conn(0x7fa21c0cf4c0 msgr2=0x7fa21c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 --2- 172.21.15.91:0/1594739879 >> v2:172.21.15.40:3300/0 conn(0x7fa21c0cf4c0 0x7fa21c0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 -- 172.21.15.91:0/1594739879 >> v1:172.21.15.40:6789/0 conn(0x7fa21c0b32f0 legacy=0x7fa21c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.505+0000 7fa221ef3640 1 -- 172.21.15.91:0/1594739879 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0cddb0 con 0x7fa21c15af50 2023-11-04T01:39:34.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa221ef3640 1 --2- 172.21.15.91:0/1594739879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 0x7fa21c0cb330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa218006fd0 tx=0x7fa21801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbcbf13025635df0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa220ef1640 1 -- 172.21.15.91:0/1594739879 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180a7070 con 0x7fa21c15af50 2023-11-04T01:39:34.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa220ef1640 1 -- 172.21.15.91:0/1594739879 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2180ab430 con 0x7fa21c15af50 2023-11-04T01:39:34.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa220ef1640 1 -- 172.21.15.91:0/1594739879 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180ab7c0 con 0x7fa21c15af50 2023-11-04T01:39:34.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 -- 172.21.15.91:0/1594739879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 msgr2=0x7fa21c0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 --2- 172.21.15.91:0/1594739879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 0x7fa21c0cb330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa218006fd0 tx=0x7fa21801c450 comp rx=0 tx=0).stop 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 -- 172.21.15.91:0/1594739879 shutdown_connections 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 --2- 172.21.15.91:0/1594739879 >> v2:172.21.15.40:3300/0 conn(0x7fa21c0cf4c0 0x7fa21c0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 --2- 172.21.15.91:0/1594739879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c15af50 0x7fa21c0cb330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 -- 172.21.15.91:0/1594739879 >> 172.21.15.91:0/1594739879 conn(0x7fa21c065dc0 msgr2=0x7fa21c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 -- 172.21.15.91:0/1594739879 shutdown_connections 2023-11-04T01:39:34.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.509+0000 7fa224157640 1 -- 172.21.15.91:0/1594739879 wait complete. 2023-11-04T01:39:34.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 Processor -- start 2023-11-04T01:39:34.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- start start 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 0x7fa21c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa21c15af50 0x7fa21c150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa21c151cd0 0x7fa21c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c151840 con 0x7fa21c15af50 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c150c30 con 0x7fa21c151cd0 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c150f10 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 0x7fa21c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 0x7fa21c15dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50398/0 (socket says 172.21.15.91:50398) 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 -- 172.21.15.91:0/1765762711 learned_addr learned my addr 172.21.15.91:0/1765762711 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2226f4640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa21c151cd0 0x7fa21c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2216f2640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa21c15af50 0x7fa21c150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 -- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa21c151cd0 msgr2=0x7fa21c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa21c151cd0 0x7fa21c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 -- 172.21.15.91:0/1765762711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa21c15af50 msgr2=0x7fa21c150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa21c15af50 0x7fa21c150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 -- 172.21.15.91:0/1765762711 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009480 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2216f2640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa21c15af50 0x7fa21c150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa221ef3640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 0x7fa21c15dcb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2180ad040 tx=0x7fa2180191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218005ba0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218005d00 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c1511f0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218003a00 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c15e1f0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2180ab5a0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa218006300 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.513+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c0675f0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.517+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa2180c3060 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.581+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a6b52471-c1d1-49b7-bc2c-c4d4868c7198", "id": 3} v 0) v1 -- 0x7fa21c0c43c0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.589+0000 7fa2127fc640 1 -- 172.21.15.91:0/1765762711 <== mon.2 v2:172.21.15.91:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6b52471-c1d1-49b7-bc2c-c4d4868c7198", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2180ce0b0 con 0x7fa21c0cf4c0 2023-11-04T01:39:34.591 INFO:teuthology.orchestra.run.smithi091.stdout:3 2023-11-04T01:39:34.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 msgr2=0x7fa21c15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 0x7fa21c15dcb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa2180ad040 tx=0x7fa2180191f0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 shutdown_connections 2023-11-04T01:39:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa21c151cd0 0x7fa21c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa21c15af50 0x7fa21c150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 --2- 172.21.15.91:0/1765762711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa21c0cf4c0 0x7fa21c15dcb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 >> 172.21.15.91:0/1765762711 conn(0x7fa21c065dc0 msgr2=0x7fa21c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 shutdown_connections 2023-11-04T01:39:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.593+0000 7fa224157640 1 -- 172.21.15.91:0/1765762711 wait complete. 2023-11-04T01:39:34.609 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 1ea8df65-fb5d-455f-8eda-35a437eef186 4 2023-11-04T01:39:34.712 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:34.713+0000 7fa4ca66f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:34.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 Processor -- start 2023-11-04T01:39:34.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 -- start start 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed8160790 0x7efed8065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efed80ceb70 0x7efed806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efed806b0b0 0x7efed80ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed8160b70 con 0x7efed806b0b0 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80ca010 con 0x7efed80ceb70 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedf5a0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80c9a30 con 0x7efed8160790 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedcb3b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efed80ceb70 0x7efed806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedd33c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed8160790 0x7efed8065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedcb3b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efed80ceb70 0x7efed806ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60942/0 (socket says 172.21.15.91:60942) 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.721+0000 7efedcb3b640 1 -- 172.21.15.91:0/1373246792 learned_addr learned my addr 172.21.15.91:0/1373246792 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efeddb3d640 1 --2- 172.21.15.91:0/1373246792 >> v2:172.21.15.40:3300/0 conn(0x7efed806b0b0 0x7efed80ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedcb3b640 1 -- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed8160790 msgr2=0x7efed8065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedcb3b640 1 --2- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed8160790 0x7efed8065dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedcb3b640 1 -- 172.21.15.91:0/1373246792 >> v2:172.21.15.40:3300/0 conn(0x7efed806b0b0 msgr2=0x7efed80ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedcb3b640 1 --2- 172.21.15.91:0/1373246792 >> v2:172.21.15.40:3300/0 conn(0x7efed806b0b0 0x7efed80ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedcb3b640 1 -- 172.21.15.91:0/1373246792 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80cb590 con 0x7efed80ceb70 2023-11-04T01:39:34.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedd33c640 1 --2- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed8160790 0x7efed8065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:34.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedcb3b640 1 --2- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed80ceb70 0x7efed806ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efed8073db0 tx=0x7efec801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b49ee3700452d4d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efecffff640 1 -- 172.21.15.91:0/1373246792 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80ab600 con 0x7efed80ceb70 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efecffff640 1 -- 172.21.15.91:0/1373246792 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80a7050 con 0x7efed80ceb70 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efecffff640 1 -- 172.21.15.91:0/1373246792 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80ab980 con 0x7efed80ceb70 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 -- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed80ceb70 msgr2=0x7efed806ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 --2- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed80ceb70 0x7efed806ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efed8073db0 tx=0x7efec801c500 comp rx=0 tx=0).stop 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 -- 172.21.15.91:0/1373246792 shutdown_connections 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 --2- 172.21.15.91:0/1373246792 >> v2:172.21.15.40:3300/0 conn(0x7efed806b0b0 0x7efed80ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 --2- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed80ceb70 0x7efed806ab70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 --2- 172.21.15.91:0/1373246792 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed8160790 0x7efed8065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 -- 172.21.15.91:0/1373246792 >> 172.21.15.91:0/1373246792 conn(0x7efed80b0e30 msgr2=0x7efed80b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 -- 172.21.15.91:0/1373246792 shutdown_connections 2023-11-04T01:39:34.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.725+0000 7efedf5a0640 1 -- 172.21.15.91:0/1373246792 wait complete. 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 Processor -- start 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- start start 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 0x7efed81537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed80ceb70 0x7efed81596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 0x7efed8159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80b4a90 con 0x7efed80ceb70 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81594f0 con 0x7efed8160790 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed8156f30 con 0x7efed806b0b0 2023-11-04T01:39:34.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 0x7efed8159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedd33c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 0x7efed81537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 0x7efed8159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60958/0 (socket says 172.21.15.91:60958) 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedd33c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 0x7efed81537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50412/0 (socket says 172.21.15.91:50412) 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 -- 172.21.15.91:0/357346776 learned_addr learned my addr 172.21.15.91:0/357346776 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedcb3b640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed80ceb70 0x7efed81596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 -- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 msgr2=0x7efed81537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 0x7efed81537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 -- 172.21.15.91:0/357346776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed80ceb70 msgr2=0x7efed81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed80ceb70 0x7efed81596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 -- 172.21.15.91:0/357346776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4009420 con 0x7efed8160790 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedd33c640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 0x7efed81537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efeddb3d640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 0x7efed8159c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efed0007e60 tx=0x7efed000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0014620 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000ee90 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec80094d0 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00149e0 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80b2ee0 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efed001e460 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7efed001d8d0 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.729+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed81570f0 con 0x7efed8160790 2023-11-04T01:39:34.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.733+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7efed001d3c0 con 0x7efed8160790 2023-11-04T01:39:34.768 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:34.769+0000 7fa4ca66f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:39:34.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.797+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ea8df65-fb5d-455f-8eda-35a437eef186", "id": 4} v 0) v1 -- 0x7efed80675f0 con 0x7efed8160790 2023-11-04T01:39:34.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efecdffb640 1 -- 172.21.15.91:0/357346776 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ea8df65-fb5d-455f-8eda-35a437eef186", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efed001d560 con 0x7efed8160790 2023-11-04T01:39:34.803 INFO:teuthology.orchestra.run.smithi091.stdout:4 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 msgr2=0x7efed8159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 0x7efed8159c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efed0007e60 tx=0x7efed000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 shutdown_connections 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efed8160790 0x7efed8159c00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed80ceb70 0x7efed81596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 --2- 172.21.15.91:0/357346776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efed806b0b0 0x7efed81537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 >> 172.21.15.91:0/357346776 conn(0x7efed80b0e30 msgr2=0x7efed8155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 shutdown_connections 2023-11-04T01:39:34.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.805+0000 7efedf5a0640 1 -- 172.21.15.91:0/357346776 wait complete. 2023-11-04T01:39:34.819 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new 7f6b1537-bfc8-4462-9f5d-78d30ad492e0 5 2023-11-04T01:39:34.822 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:34.821+0000 7fa4ca66f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:39:34.902 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:34.901+0000 7fa4ca66f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:39:34.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 Processor -- start 2023-11-04T01:39:34.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 -- start start 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f754c15af50 0x7f754c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0cf4c0 0x7f754c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0cd830 con 0x7f754c0b32f0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c0b3780 con 0x7f754c15af50 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f7551bf9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0cdad0 con 0x7f754c0cf4c0 2023-11-04T01:39:34.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0cf4c0 0x7f754c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754affd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f754c0b32f0 0x7f754c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45030/0 (socket says 172.21.15.91:45030) 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754affd640 1 -- 172.21.15.91:0/1436945216 learned_addr learned my addr 172.21.15.91:0/1436945216 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754b7fe640 1 --2- 172.21.15.91:0/1436945216 >> v2:172.21.15.40:3300/0 conn(0x7f754c15af50 0x7f754c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754a7fc640 1 -- 172.21.15.91:0/1436945216 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487692344 0 0) 0x7f754c0cd830 con 0x7f754c0b32f0 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754a7fc640 1 -- 172.21.15.91:0/1436945216 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7534003530 con 0x7f754c0b32f0 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754bfff640 1 -- 172.21.15.91:0/1436945216 >> v2:172.21.15.40:3300/0 conn(0x7f754c15af50 msgr2=0x7f754c0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754bfff640 1 --2- 172.21.15.91:0/1436945216 >> v2:172.21.15.40:3300/0 conn(0x7f754c15af50 0x7f754c0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754bfff640 1 -- 172.21.15.91:0/1436945216 >> v1:172.21.15.91:6789/0 conn(0x7f754c0b32f0 legacy=0x7f754c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754bfff640 1 -- 172.21.15.91:0/1436945216 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0cddb0 con 0x7f754c0cf4c0 2023-11-04T01:39:34.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.925+0000 7f754b7fe640 1 --2- 172.21.15.91:0/1436945216 >> v2:172.21.15.40:3300/0 conn(0x7f754c15af50 0x7f754c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f754bfff640 1 --2- 172.21.15.91:0/1436945216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0cf4c0 0x7f754c0d0610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7544009d90 tx=0x7f754401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b7bc17605c71504 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f754a7fc640 1 -- 172.21.15.91:0/1436945216 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440a59a0 con 0x7f754c0cf4c0 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f754a7fc640 1 -- 172.21.15.91:0/1436945216 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440a5b00 con 0x7f754c0cf4c0 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f754a7fc640 1 -- 172.21.15.91:0/1436945216 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440a5e90 con 0x7f754c0cf4c0 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 -- 172.21.15.91:0/1436945216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0cf4c0 msgr2=0x7f754c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 --2- 172.21.15.91:0/1436945216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0cf4c0 0x7f754c0d0610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7544009d90 tx=0x7f754401c8c0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 -- 172.21.15.91:0/1436945216 shutdown_connections 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 --2- 172.21.15.91:0/1436945216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0cf4c0 0x7f754c0d0610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 --2- 172.21.15.91:0/1436945216 >> v2:172.21.15.40:3300/0 conn(0x7f754c15af50 0x7f754c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 -- 172.21.15.91:0/1436945216 >> 172.21.15.91:0/1436945216 conn(0x7f754c065dc0 msgr2=0x7f754c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 -- 172.21.15.91:0/1436945216 shutdown_connections 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.929+0000 7f7551bf9640 1 -- 172.21.15.91:0/1436945216 wait complete. 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 Processor -- start 2023-11-04T01:39:34.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- start start 2023-11-04T01:39:34.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f754c0cf4c0 0x7f754c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 0x7f754c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0b0b80 0x7f754c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c1522e0 con 0x7f754c0cf4c0 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0b1020 con 0x7f754c15af50 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0b1300 con 0x7f754c0b0b80 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 0x7f754c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0b0b80 0x7f754c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 0x7f754c0b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60964/0 (socket says 172.21.15.91:60964) 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 -- 172.21.15.91:0/716866785 learned_addr learned my addr 172.21.15.91:0/716866785 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754b7fe640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f754c0cf4c0 0x7f754c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 -- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0b0b80 msgr2=0x7f754c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0b0b80 0x7f754c153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 -- 172.21.15.91:0/716866785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f754c0cf4c0 msgr2=0x7f754c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:34.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f754c0cf4c0 0x7f754c151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 -- 172.21.15.91:0/716866785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009a70 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f754affd640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 0x7f754c0b0640 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f754000c4d0 tx=0x7f754000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540005cf0 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540005e50 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c0b15e0 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540007270 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c0b1ba0 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f754001c440 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7540012980 con 0x7f754c15af50 2023-11-04T01:39:34.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.933+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c0b1d90 con 0x7f754c15af50 2023-11-04T01:39:34.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.937+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7540021060 con 0x7f754c15af50 2023-11-04T01:39:34.957 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:34.957+0000 7fa4ca66f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:39:34.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:34.997+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f6b1537-bfc8-4462-9f5d-78d30ad492e0", "id": 5} v 0) v1 -- 0x7f754c0675f0 con 0x7f754c15af50 2023-11-04T01:39:35.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7533fff640 1 -- 172.21.15.91:0/716866785 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f6b1537-bfc8-4462-9f5d-78d30ad492e0", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7540017070 con 0x7f754c15af50 2023-11-04T01:39:35.005 INFO:teuthology.orchestra.run.smithi091.stdout:5 2023-11-04T01:39:35.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 msgr2=0x7f754c0b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 0x7f754c0b0640 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f754000c4d0 tx=0x7f754000c990 comp rx=0 tx=0).stop 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 shutdown_connections 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f754c0b0b80 0x7f754c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f754c15af50 0x7f754c0b0640 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 --2- 172.21.15.91:0/716866785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f754c0cf4c0 0x7f754c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 >> 172.21.15.91:0/716866785 conn(0x7f754c065dc0 msgr2=0x7f754c0b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 shutdown_connections 2023-11-04T01:39:35.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.005+0000 7f7551bf9640 1 -- 172.21.15.91:0/716866785 wait complete. 2023-11-04T01:39:35.020 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new c3b9bb64-dca0-4141-9c80-024ad4f169ee 6 2023-11-04T01:39:35.035 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:35.037+0000 7fa4ca66f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:39:35.055 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.049+0000 7f4972d33180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:35.089 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:35.089+0000 7fa4ca66f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:39:35.120 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.113+0000 7f4972d33180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:39:35.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c1d672640 1 Processor -- start 2023-11-04T01:39:35.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c1d672640 1 -- start start 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c1d672640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c180b32f0 0x7f9c180cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c1d672640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c180cd830 con 0x7f9c180cf4c0 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c1d672640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c180cdad0 con 0x7f9c1815af50 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c1d672640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180b3780 con 0x7f9c180b32f0 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9c1815af50 0x7f9c180ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:45040/0 (socket says 172.21.15.91:45040) 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 -- 172.21.15.91:0/736423512 learned_addr learned my addr 172.21.15.91:0/736423512 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c167fc640 1 --2- 172.21.15.91:0/736423512 >> v2:172.21.15.40:3300/0 conn(0x7f9c180b32f0 0x7f9c180cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803451996 0 0) 0x7f9c180cdad0 con 0x7f9c1815af50 2023-11-04T01:39:35.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c00003530 con 0x7f9c1815af50 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 <== mon.1 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3855210028 0 0) 0x7f9c00003530 con 0x7f9c1815af50 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 >> v2:172.21.15.40:3300/0 conn(0x7f9c180b32f0 msgr2=0x7f9c180cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 --2- 172.21.15.91:0/736423512 >> v2:172.21.15.40:3300/0 conn(0x7f9c180b32f0 0x7f9c180cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 >> v1:172.21.15.40:6789/0 conn(0x7f9c180cf4c0 legacy=0x7f9c180d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180cddb0 con 0x7f9c1815af50 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 <== mon.1 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9c08001800 con 0x7f9c1815af50 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 >> v1:172.21.15.91:6789/0 conn(0x7f9c1815af50 legacy=0x7f9c180ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c00003980 0x7f9c00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c000047d0 0x7f9c00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00005190 0x7f9c0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180b3780 con 0x7f9c00005190 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0000c130 con 0x7f9c00003980 2023-11-04T01:39:35.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0000c2f0 con 0x7f9c000047d0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c00003980 0x7f9c00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c167fc640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c000047d0 0x7f9c00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c177fe640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00005190 0x7f9c0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 -- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c000047d0 msgr2=0x7f9c00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c000047d0 0x7f9c00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 -- 172.21.15.91:0/736423512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00005190 msgr2=0x7f9c0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00005190 0x7f9c0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c16ffd640 1 -- 172.21.15.91:0/736423512 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00003530 con 0x7f9c00003980 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c177fe640 1 -- 172.21.15.91:0/736423512 reap_dead start 2023-11-04T01:39:35.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.145+0000 7f9c167fc640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c000047d0 0x7f9c00004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c16ffd640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c00003980 0x7f9c00003da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c240 tx=0x7f9c0801f390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18bc8b8e21ea9db8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08007270 con 0x7f9c00003980 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c080ab070 con 0x7f9c00003980 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c15ffb640 1 -- 172.21.15.91:0/736423512 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08007670 con 0x7f9c00003980 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c00003980 msgr2=0x7f9c00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c00003980 0x7f9c00003da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c240 tx=0x7f9c0801f390 comp rx=0 tx=0).stop 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- 172.21.15.91:0/736423512 shutdown_connections 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 --2- 172.21.15.91:0/736423512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c00003980 0x7f9c00003da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- 172.21.15.91:0/736423512 >> 172.21.15.91:0/736423512 conn(0x7f9c18065dc0 msgr2=0x7f9c180661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- 172.21.15.91:0/736423512 shutdown_connections 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- 172.21.15.91:0/736423512 wait complete. 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 Processor -- start 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- start start 2023-11-04T01:39:35.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00003980 0x7f9c18157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c1814f9a0 0x7f9c1814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c18157020 0x7f9c181574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181f0c50 con 0x7f9c00003980 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181529e0 con 0x7f9c18157020 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.149+0000 7f9c1d672640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18152cc0 con 0x7f9c1814f9a0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c18157020 0x7f9c181574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c1814f9a0 0x7f9c1814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c18157020 0x7f9c181574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:60994/0 (socket says 172.21.15.91:60994) 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c177fe640 1 -- 172.21.15.91:0/2562308431 learned_addr learned my addr 172.21.15.91:0/2562308431 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c16ffd640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00003980 0x7f9c18157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 -- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c18157020 msgr2=0x7f9c181574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c18157020 0x7f9c181574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 -- 172.21.15.91:0/2562308431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00003980 msgr2=0x7f9c18157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00003980 0x7f9c18157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 -- 172.21.15.91:0/2562308431 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18156540 con 0x7f9c1814f9a0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c167fc640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c1814f9a0 0x7f9c1814fe00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c180698b0 tx=0x7f9c0c011e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00faf0 con 0x7f9c1814f9a0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00fc50 con 0x7f9c1814f9a0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c18156820 con 0x7f9c1814f9a0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c004020 con 0x7f9c1814f9a0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c18158530 con 0x7f9c1814f9a0 2023-11-04T01:39:35.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9c0c003620 con 0x7f9c1814f9a0 2023-11-04T01:39:35.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c180675f0 con 0x7f9c1814f9a0 2023-11-04T01:39:35.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9c0c014a30 con 0x7f9c1814f9a0 2023-11-04T01:39:35.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.153+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9c0c03cb40 con 0x7f9c1814f9a0 2023-11-04T01:39:35.175 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.169+0000 7f4972d33180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:39:35.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.217+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c3b9bb64-dca0-4141-9c80-024ad4f169ee", "id": 6} v 0) v1 -- 0x7f9c180b06e0 con 0x7f9c1814f9a0 2023-11-04T01:39:35.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9bff7fe640 1 -- 172.21.15.91:0/2562308431 <== mon.2 v2:172.21.15.91:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3b9bb64-dca0-4141-9c80-024ad4f169ee", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c0c02b0b0 con 0x7f9c1814f9a0 2023-11-04T01:39:35.228 INFO:teuthology.orchestra.run.smithi091.stdout:6 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c1814f9a0 msgr2=0x7f9c1814fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c1814f9a0 0x7f9c1814fe00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c180698b0 tx=0x7f9c0c011e30 comp rx=0 tx=0).stop 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 shutdown_connections 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c18157020 0x7f9c181574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c1814f9a0 0x7f9c1814fe00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 --2- 172.21.15.91:0/2562308431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c00003980 0x7f9c18157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 >> 172.21.15.91:0/2562308431 conn(0x7f9c18065dc0 msgr2=0x7f9c180b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 shutdown_connections 2023-11-04T01:39:35.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.229+0000 7f9c1d672640 1 -- 172.21.15.91:0/2562308431 wait complete. 2023-11-04T01:39:35.236 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:35.237+0000 7fa4ca66f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:39:35.244 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd new ab1edd79-8d9f-45a8-abfd-2263a72bf439 7 2023-11-04T01:39:35.256 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.249+0000 7f4972d33180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:39:35.299 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:35.297+0000 7fa4ca66f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:39:35.310 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.305+0000 7f4972d33180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:39:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 Processor -- start 2023-11-04T01:39:35.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 -- start start 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 0x7fb7640cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 0x7fb7640ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7640cf4c0 0x7fb7640cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640b3780 con 0x7fb7640cf4c0 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640cd830 con 0x7fb76415af50 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb768fd0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640cdad0 con 0x7fb7640b32f0 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb761d9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 0x7fb7640ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.357+0000 7fb76259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 0x7fb7640cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 0x7fb7640ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50462/0 (socket says 172.21.15.91:50462) 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb76259c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 0x7fb7640cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:32768/0 (socket says 172.21.15.91:32768) 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 -- 172.21.15.91:0/368617491 learned_addr learned my addr 172.21.15.91:0/368617491 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb762d9d640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.40:3300/0 conn(0x7fb7640cf4c0 0x7fb7640cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 -- 172.21.15.91:0/368617491 >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 msgr2=0x7fb7640cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 0x7fb7640cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 -- 172.21.15.91:0/368617491 >> v2:172.21.15.40:3300/0 conn(0x7fb7640cf4c0 msgr2=0x7fb7640cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.40:3300/0 conn(0x7fb7640cf4c0 0x7fb7640cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 -- 172.21.15.91:0/368617491 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640cddb0 con 0x7fb7640b32f0 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb76259c640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 0x7fb7640cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:35.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb762d9d640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.40:3300/0 conn(0x7fb7640cf4c0 0x7fb7640cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:35.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb761d9b640 1 --2- 172.21.15.91:0/368617491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 0x7fb7640ce8b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7640681a0 tx=0x7fb75801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302e1c0905ad6a52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb76159a640 1 -- 172.21.15.91:0/368617491 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580ab650 con 0x7fb7640b32f0 2023-11-04T01:39:35.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb76159a640 1 -- 172.21.15.91:0/368617491 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580ab7b0 con 0x7fb7640b32f0 2023-11-04T01:39:35.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb76159a640 1 -- 172.21.15.91:0/368617491 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580abb40 con 0x7fb7640b32f0 2023-11-04T01:39:35.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 -- 172.21.15.91:0/368617491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 msgr2=0x7fb7640ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 --2- 172.21.15.91:0/368617491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 0x7fb7640ce8b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7640681a0 tx=0x7fb75801c470 comp rx=0 tx=0).stop 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 -- 172.21.15.91:0/368617491 shutdown_connections 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.40:3300/0 conn(0x7fb7640cf4c0 0x7fb7640cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 --2- 172.21.15.91:0/368617491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7640b32f0 0x7fb7640ce8b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 --2- 172.21.15.91:0/368617491 >> v2:172.21.15.91:3300/0 conn(0x7fb76415af50 0x7fb7640cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 -- 172.21.15.91:0/368617491 >> 172.21.15.91:0/368617491 conn(0x7fb764065dc0 msgr2=0x7fb7640661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 -- 172.21.15.91:0/368617491 shutdown_connections 2023-11-04T01:39:35.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.361+0000 7fb768fd0640 1 -- 172.21.15.91:0/368617491 wait complete. 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 Processor -- start 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- start start 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 0x7fb7641545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb76415af50 0x7fb764163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb764164480 0x7fb76406c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764157f70 con 0x7fb764164480 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764164910 con 0x7fb7640cf4c0 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415cca0 con 0x7fb76415af50 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 0x7fb7641545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb761d9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb76415af50 0x7fb764163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 0x7fb7641545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:32770/0 (socket says 172.21.15.91:32770) 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb761d9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb76415af50 0x7fb764163f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.91:50472/0 (socket says 172.21.15.91:50472) 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 -- 172.21.15.91:0/2787808381 learned_addr learned my addr 172.21.15.91:0/2787808381 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb762d9d640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb764164480 0x7fb76406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 -- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb76415af50 msgr2=0x7fb764163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb76415af50 0x7fb764163f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 -- 172.21.15.91:0/2787808381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb764164480 msgr2=0x7fb76406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb764164480 0x7fb76406c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 -- 172.21.15.91:0/2787808381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540093b0 con 0x7fb7640cf4c0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb762d9d640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb764164480 0x7fb76406c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb76259c640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 0x7fb7641545a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb75400e960 tx=0x7fb75400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400ca00 con 0x7fb7640cf4c0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400cb60 con 0x7fb7640cf4c0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7580094d0 con 0x7fb7640cf4c0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540059a0 con 0x7fb7640cf4c0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb764158430 con 0x7fb7640cf4c0 2023-11-04T01:39:35.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76406d2f0 con 0x7fb7640cf4c0 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb754006030 con 0x7fb7640cf4c0 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.365+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb754013ad0 con 0x7fb7640cf4c0 2023-11-04T01:39:35.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.369+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb75403ab40 con 0x7fb7640cf4c0 2023-11-04T01:39:35.391 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.385+0000 7f4972d33180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:39:35.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.437+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab1edd79-8d9f-45a8-abfd-2263a72bf439", "id": 7} v 0) v1 -- 0x7fb7640675f0 con 0x7fb7640cf4c0 2023-11-04T01:39:35.444 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.441+0000 7f4972d33180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:39:35.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb752ffd640 1 -- 172.21.15.91:0/2787808381 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab1edd79-8d9f-45a8-abfd-2263a72bf439", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb754029020 con 0x7fb7640cf4c0 2023-11-04T01:39:35.448 INFO:teuthology.orchestra.run.smithi091.stdout:7 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 msgr2=0x7fb7641545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 0x7fb7641545a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb75400e960 tx=0x7fb75400ee20 comp rx=0 tx=0).stop 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 shutdown_connections 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb764164480 0x7fb76406c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb76415af50 0x7fb764163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 --2- 172.21.15.91:0/2787808381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7640cf4c0 0x7fb7641545a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 >> 172.21.15.91:0/2787808381 conn(0x7fb764065dc0 msgr2=0x7fb7640661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 shutdown_connections 2023-11-04T01:39:35.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:39:35.449+0000 7fb768fd0640 1 -- 172.21.15.91:0/2787808381 wait complete. 2023-11-04T01:39:35.463 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T01:39:35.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T01:39:35.466 INFO:tasks.ceph.osd.0:Started 2023-11-04T01:39:35.467 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T01:39:35.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T01:39:35.469 INFO:tasks.ceph.osd.1:Started 2023-11-04T01:39:35.469 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T01:39:35.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T01:39:35.471 INFO:tasks.ceph.osd.2:Started 2023-11-04T01:39:35.472 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T01:39:35.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T01:39:35.474 INFO:tasks.ceph.osd.3:Started 2023-11-04T01:39:35.474 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-04T01:39:35.474 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-04T01:39:35.476 INFO:tasks.ceph.osd.4:Started 2023-11-04T01:39:35.476 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-04T01:39:35.476 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-04T01:39:35.478 INFO:tasks.ceph.osd.5:Started 2023-11-04T01:39:35.478 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-04T01:39:35.478 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-04T01:39:35.480 INFO:tasks.ceph.osd.6:Started 2023-11-04T01:39:35.480 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-04T01:39:35.480 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-04T01:39:35.482 INFO:tasks.ceph.osd.7:Started 2023-11-04T01:39:35.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 Processor -- start 2023-11-04T01:39:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 -- start start 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d015af80 0x7fc5d00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5d00b1e10 0x7fc5d015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d015b360 con 0x7fc5d006ace0 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d0071880 con 0x7fc5d00b1e10 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5d5020640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0071b60 con 0x7fc5d015af80 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5d00b1e10 0x7fc5d015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5d00b1e10 0x7fc5d015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36266/0 (socket says 172.21.15.40:36266) 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 -- 172.21.15.40:0/1463171589 learned_addr learned my addr 172.21.15.40:0/1463171589 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5ced9d640 1 --2- 172.21.15.40:0/1463171589 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d015af80 0x7fc5d00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 -- 172.21.15.40:0/1463171589 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d015af80 msgr2=0x7fc5d00ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 --2- 172.21.15.40:0/1463171589 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d015af80 0x7fc5d00ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 -- 172.21.15.40:0/1463171589 >> v1:172.21.15.91:6789/0 conn(0x7fc5d006ace0 legacy=0x7fc5d00b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.605+0000 7fc5cf59e640 1 -- 172.21.15.40:0/1463171589 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d006a200 con 0x7fc5d00b1e10 2023-11-04T01:39:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5cf59e640 1 --2- 172.21.15.40:0/1463171589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d015eb00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009e50 tx=0x7fc5c801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc21284cf9386f22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5ce59c640 1 -- 172.21.15.40:0/1463171589 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80a5730 con 0x7fc5d00b1e10 2023-11-04T01:39:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5ce59c640 1 -- 172.21.15.40:0/1463171589 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c80a5890 con 0x7fc5d00b1e10 2023-11-04T01:39:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5ce59c640 1 -- 172.21.15.40:0/1463171589 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80a5c20 con 0x7fc5d00b1e10 2023-11-04T01:39:35.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- 172.21.15.40:0/1463171589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 msgr2=0x7fc5d015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 --2- 172.21.15.40:0/1463171589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d015eb00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009e50 tx=0x7fc5c801c980 comp rx=0 tx=0).stop 2023-11-04T01:39:35.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- 172.21.15.40:0/1463171589 shutdown_connections 2023-11-04T01:39:35.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 --2- 172.21.15.40:0/1463171589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d015eb00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 --2- 172.21.15.40:0/1463171589 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d015af80 0x7fc5d00ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- 172.21.15.40:0/1463171589 >> 172.21.15.40:0/1463171589 conn(0x7fc5d006e760 msgr2=0x7fc5d006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- 172.21.15.40:0/1463171589 shutdown_connections 2023-11-04T01:39:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- 172.21.15.40:0/1463171589 wait complete. 2023-11-04T01:39:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 Processor -- start 2023-11-04T01:39:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- start start 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d006ace0 0x7fc5d0151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d0165540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5d015af80 0x7fc5d0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0164310 con 0x7fc5d00b1e10 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01645f0 con 0x7fc5d015af80 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5d5020640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01648d0 con 0x7fc5d006ace0 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5c659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d0165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5c659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d0165540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36280/0 (socket says 172.21.15.40:36280) 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5c659c640 1 -- 172.21.15.40:0/3204164783 learned_addr learned my addr 172.21.15.40:0/3204164783 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.609+0000 7fc5cf59e640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5d015af80 0x7fc5d0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5ced9d640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d006ace0 0x7fc5d0151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c659c640 1 -- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d006ace0 msgr2=0x7fc5d0151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c659c640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d006ace0 0x7fc5d0151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c659c640 1 -- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5d015af80 msgr2=0x7fc5d0156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c659c640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5d015af80 0x7fc5d0156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c659c640 1 -- 172.21.15.40:0/3204164783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009b30 con 0x7fc5d00b1e10 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5cf59e640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5d015af80 0x7fc5d0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c659c640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d0165540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c4d0 tx=0x7fc5b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80052d0 con 0x7fc5d00b1e10 2023-11-04T01:39:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b8005430 con 0x7fc5d00b1e10 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8012830 con 0x7fc5d00b1e10 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d0164bb0 con 0x7fc5d00b1e10 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d0165a80 con 0x7fc5d00b1e10 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5b8012c90 con 0x7fc5d00b1e10 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc5b801bad0 con 0x7fc5d00b1e10 2023-11-04T01:39:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d00cd7d0 con 0x7fc5d00b1e10 2023-11-04T01:39:35.621 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.613+0000 7f4972d33180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:39:35.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.613+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc5d00cd7d0 con 0x7fc5d00b1e10 2023-11-04T01:39:35.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5d00675f0 con 0x7fc5d00b1e10 2023-11-04T01:39:35.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5c7fff640 1 -- 172.21.15.40:0/3204164783 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc5b802a090 con 0x7fc5d00b1e10 2023-11-04T01:39:35.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:35.679 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:35.437613+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:35.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 msgr2=0x7fc5d0165540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:35.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d0165540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c4d0 tx=0x7fc5b800c990 comp rx=0 tx=0).stop 2023-11-04T01:39:35.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 shutdown_connections 2023-11-04T01:39:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc5d015af80 0x7fc5d0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d00b1e10 0x7fc5d0165540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 --2- 172.21.15.40:0/3204164783 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc5d006ace0 0x7fc5d0151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.673+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 >> 172.21.15.40:0/3204164783 conn(0x7fc5d006e760 msgr2=0x7fc5d015beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.677+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 shutdown_connections 2023-11-04T01:39:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:35.677+0000 7fc5d5020640 1 -- 172.21.15.40:0/3204164783 wait complete. 2023-11-04T01:39:35.683 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:35.677+0000 7f4972d33180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:39:35.695 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T01:39:35.696 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T01:39:35.905 INFO:tasks.ceph.mgr.x.smithi091.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-04T01:39:35.905 INFO:tasks.ceph.mgr.x.smithi091.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-04T01:39:35.906 INFO:tasks.ceph.mgr.x.smithi091.stderr: from numpy import show_config as show_numpy_config 2023-11-04T01:39:35.953 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:35.953+0000 7fa4ca66f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:39:36.076 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:36.077+0000 7fa4ca66f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:36.097 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:39:36.097+0000 7f509c5d2640 -1 Falling back to public interface 2023-11-04T01:39:36.108 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:39:36.109+0000 7fe37b288640 -1 Falling back to public interface 2023-11-04T01:39:36.109 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:39:36.109+0000 7f10eca87640 -1 Falling back to public interface 2023-11-04T01:39:36.112 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:39:36.113+0000 7ff1b26f8640 -1 Falling back to public interface 2023-11-04T01:39:36.118 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:39:36.113+0000 7f3580679640 -1 Falling back to public interface 2023-11-04T01:39:36.118 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:39:36.113+0000 7f10ff2d5640 -1 Falling back to public interface 2023-11-04T01:39:36.118 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:39:36.113+0000 7f10fe296640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-04T01:39:36.123 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:39:36.113+0000 7fd3059d7640 -1 Falling back to public interface 2023-11-04T01:39:36.124 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:39:36.113+0000 7fdd8d91e640 -1 Falling back to public interface 2023-11-04T01:39:36.245 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:36.245+0000 7fa4ca66f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:36.301 INFO:tasks.ceph.mgr.y.smithi040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-04T01:39:36.301 INFO:tasks.ceph.mgr.y.smithi040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-04T01:39:36.301 INFO:tasks.ceph.mgr.y.smithi040.stderr: from numpy import show_config as show_numpy_config 2023-11-04T01:39:36.307 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:36.305+0000 7fa4ca66f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:39:36.369 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:36.365+0000 7f4972d33180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:39:36.430 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:36.429+0000 7fa4ca66f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:36.500 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:36.531 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:36.525+0000 7f4972d33180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:36.616 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.609+0000 7f00e6889640 1 Processor -- start 2023-11-04T01:39:36.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00e6889640 1 -- start start 2023-11-04T01:39:36.618 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00e6889640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f00e015d540 0x7f00e00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.618 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00e6889640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e00722e0 0x7f00e006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.618 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00e6889640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00b4270 con 0x7f00e006a370 2023-11-04T01:39:36.618 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00e6889640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e006cb40 con 0x7f00e00722e0 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00e6889640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e006ce20 con 0x7f00e015d540 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e00722e0 0x7f00e006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e00722e0 0x7f00e006d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36284/0 (socket says 172.21.15.40:36284) 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 -- 172.21.15.40:0/295204744 learned_addr learned my addr 172.21.15.40:0/295204744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00dffff640 1 --2- 172.21.15.40:0/295204744 >> v2:172.21.15.91:3300/0 conn(0x7f00e015d540 0x7f00e00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 -- 172.21.15.40:0/295204744 >> v2:172.21.15.91:3300/0 conn(0x7f00e015d540 msgr2=0x7f00e00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 --2- 172.21.15.40:0/295204744 >> v2:172.21.15.91:3300/0 conn(0x7f00e015d540 0x7f00e00b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 -- 172.21.15.40:0/295204744 >> v1:172.21.15.91:6789/0 conn(0x7f00e006a370 legacy=0x7f00e00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.613+0000 7f00df7fe640 1 -- 172.21.15.40:0/295204744 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e006d100 con 0x7f00e00722e0 2023-11-04T01:39:36.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00df7fe640 1 --2- 172.21.15.40:0/295204744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e00722e0 0x7f00e006d620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00e00712b0 tx=0x7f00d401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772d818dbc74df8a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00deffd640 1 -- 172.21.15.40:0/295204744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40a5790 con 0x7f00e00722e0 2023-11-04T01:39:36.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00deffd640 1 -- 172.21.15.40:0/295204744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d40a58f0 con 0x7f00e00722e0 2023-11-04T01:39:36.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00deffd640 1 -- 172.21.15.40:0/295204744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40a5c80 con 0x7f00e00722e0 2023-11-04T01:39:36.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- 172.21.15.40:0/295204744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e00722e0 msgr2=0x7f00e006d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 --2- 172.21.15.40:0/295204744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e00722e0 0x7f00e006d620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00e00712b0 tx=0x7f00d401c8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- 172.21.15.40:0/295204744 shutdown_connections 2023-11-04T01:39:36.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 --2- 172.21.15.40:0/295204744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e00722e0 0x7f00e006d620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 --2- 172.21.15.40:0/295204744 >> v2:172.21.15.91:3300/0 conn(0x7f00e015d540 0x7f00e00b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- 172.21.15.40:0/295204744 >> 172.21.15.40:0/295204744 conn(0x7f00e00716a0 msgr2=0x7f00e0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- 172.21.15.40:0/295204744 shutdown_connections 2023-11-04T01:39:36.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- 172.21.15.40:0/295204744 wait complete. 2023-11-04T01:39:36.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 Processor -- start 2023-11-04T01:39:36.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- start start 2023-11-04T01:39:36.625 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e006a370 0x7f00e00c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.625 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e00722e0 0x7f00e0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.625 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 0x7f00e00af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01566e0 con 0x7f00e015d540 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01569c0 con 0x7f00e00722e0 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e6889640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0156ca0 con 0x7f00e006a370 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e4e26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 0x7f00e00af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e4e26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 0x7f00e00af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36286/0 (socket says 172.21.15.40:36286) 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00e4e26640 1 -- 172.21.15.40:0/2035850963 learned_addr learned my addr 172.21.15.40:0/2035850963 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00dffff640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e006a370 0x7f00e00c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.617+0000 7f00df7fe640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e00722e0 0x7f00e0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e4e26640 1 -- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e006a370 msgr2=0x7f00e00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e4e26640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e006a370 0x7f00e00c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e4e26640 1 -- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e00722e0 msgr2=0x7f00e0155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.626 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e4e26640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e00722e0 0x7f00e0155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e4e26640 1 -- 172.21.15.40:0/2035850963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009b30 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00df7fe640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e00722e0 0x7f00e0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e4e26640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 0x7f00e00af610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c340 tx=0x7f00d800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8005220 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8005380 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007270 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e0156f80 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e00c7440 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00d80067e0 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f00d8006a90 con 0x7f00e015d540 2023-11-04T01:39:36.627 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00675f0 con 0x7f00e015d540 2023-11-04T01:39:36.628 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.621+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f00d8006d70 con 0x7f00e015d540 2023-11-04T01:39:36.684 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.677+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00e0157430 con 0x7f00e015d540 2023-11-04T01:39:36.685 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00dcff9640 1 -- 172.21.15.40:0/2035850963 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f00d8011590 con 0x7f00e015d540 2023-11-04T01:39:36.685 INFO:teuthology.misc.health.smithi040.stdout: 2023-11-04T01:39:36.685 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:35.437613+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:36.686 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 msgr2=0x7f00e00af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:36.686 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 0x7f00e00af610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c340 tx=0x7f00d800c800 comp rx=0 tx=0).stop 2023-11-04T01:39:36.686 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 shutdown_connections 2023-11-04T01:39:36.686 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e015d540 0x7f00e00af610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.687 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e00722e0 0x7f00e0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.687 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 --2- 172.21.15.40:0/2035850963 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e006a370 0x7f00e00c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:36.687 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 >> 172.21.15.40:0/2035850963 conn(0x7f00e00716a0 msgr2=0x7f00e00ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:36.687 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 shutdown_connections 2023-11-04T01:39:36.687 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:36.681+0000 7f00e6889640 1 -- 172.21.15.40:0/2035850963 wait complete. 2023-11-04T01:39:36.691 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:36.685+0000 7f4972d33180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:36.700 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:39:36.758 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:36.753+0000 7f4972d33180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:39:36.887 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:36.881+0000 7f4972d33180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:37.041 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:37.041+0000 7fa4ca66f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:39:37.116 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:37.117+0000 7fa4ca66f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:39:37.287 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:37.285+0000 7fa4ca66f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:39:37.360 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:37.361+0000 7fa4ca66f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:39:37.517 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:37.513+0000 7f4972d33180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:39:37.595 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:37.589+0000 7f4972d33180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:39:37.648 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:37.649+0000 7fa4ca66f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:39:37.707 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:37.705+0000 7fa4ca66f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:39:37.775 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:37.769+0000 7f4972d33180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:39:37.853 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:37.849+0000 7f4972d33180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:39:38.158 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:38.153+0000 7f4972d33180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:39:38.220 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-11-04T01:39:38.213+0000 7f4972d33180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:39:38.753 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:38.752+0000 7fa471df9640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T01:39:38.758 INFO:tasks.ceph.mgr.x.smithi091.stderr:2023-11-04T01:39:38.756+0000 7fa471df9640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T01:39:39.954 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:39:39.952+0000 7f509c5d2640 -1 osd.4 0 log_to_monitors true 2023-11-04T01:39:39.997 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:39:39.993+0000 7fd3059d7640 -1 osd.2 0 log_to_monitors true 2023-11-04T01:39:40.029 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:39:40.028+0000 7f10eca87640 -1 osd.7 0 log_to_monitors true 2023-11-04T01:39:40.066 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:39:40.064+0000 7fe37b288640 -1 osd.5 0 log_to_monitors true 2023-11-04T01:39:40.069 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:39:40.068+0000 7ff1b26f8640 -1 osd.6 0 log_to_monitors true 2023-11-04T01:39:40.088 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:39:40.081+0000 7fdd8d91e640 -1 osd.3 0 log_to_monitors true 2023-11-04T01:39:40.103 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:39:40.097+0000 7f3580679640 -1 osd.0 0 log_to_monitors true 2023-11-04T01:39:40.106 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:39:40.101+0000 7f10ff2d5640 -1 osd.1 0 log_to_monitors true 2023-11-04T01:39:43.409 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:39:43.408+0000 7f10e820e640 -1 osd.7 0 waiting for initial osdmap 2023-11-04T01:39:43.442 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:39:43.440+0000 7f10e085b640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.484 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:39:43.477+0000 7f10faa5c640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T01:39:43.503 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:39:43.497+0000 7f357be00640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T01:39:43.506 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:43.511 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:39:43.505+0000 7fd302994640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T01:39:43.511 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:39:43.508+0000 7ff1af6b5640 -1 osd.6 0 waiting for initial osdmap 2023-11-04T01:39:43.517 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:39:43.513+0000 7f10f30a9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.526 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:39:43.521+0000 7fdd8a8db640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T01:39:43.537 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:39:43.533+0000 7f357444d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.540 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:39:43.540+0000 7ff1a64cc640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.545 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:39:43.541+0000 7fd2f97ab640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.557 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:39:43.553+0000 7fdd816f2640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.578 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:39:43.576+0000 7fe376a0f640 -1 osd.5 0 waiting for initial osdmap 2023-11-04T01:39:43.605 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:39:43.604+0000 7fe36f05c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.612 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.605+0000 7f09c6527640 1 Processor -- start 2023-11-04T01:39:43.612 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.605+0000 7f09c6527640 1 -- start start 2023-11-04T01:39:43.613 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f09c00cdea0 0x7f09c00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.613 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09c00ca400 0x7f09c00b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.613 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c00ccee0 con 0x7f09c015a1f0 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c015a5d0 con 0x7f09c00ca400 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00ca900 con 0x7f09c00cdea0 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09c00ca400 0x7f09c00b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09c00ca400 0x7f09c00b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33432/0 (socket says 172.21.15.40:33432) 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 -- 172.21.15.40:0/4131428181 learned_addr learned my addr 172.21.15.40:0/4131428181 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09bf7fe640 1 --2- 172.21.15.40:0/4131428181 >> v2:172.21.15.91:3300/0 conn(0x7f09c00cdea0 0x7f09c00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 -- 172.21.15.40:0/4131428181 >> v2:172.21.15.91:3300/0 conn(0x7f09c00cdea0 msgr2=0x7f09c00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 --2- 172.21.15.40:0/4131428181 >> v2:172.21.15.91:3300/0 conn(0x7f09c00cdea0 0x7f09c00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.614 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 -- 172.21.15.40:0/4131428181 >> v1:172.21.15.91:6789/0 conn(0x7f09c015a1f0 legacy=0x7f09c00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.615 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 -- 172.21.15.40:0/4131428181 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00cabe0 con 0x7f09c00ca400 2023-11-04T01:39:43.615 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c4ac4640 1 --2- 172.21.15.40:0/4131428181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00ca400 0x7f09c00b0b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f09c015dc30 tx=0x7f09b801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1b8a6c57cf4d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.615 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09beffd640 1 -- 172.21.15.40:0/4131428181 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80a5780 con 0x7f09c00ca400 2023-11-04T01:39:43.615 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09beffd640 1 -- 172.21.15.40:0/4131428181 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80a58e0 con 0x7f09c00ca400 2023-11-04T01:39:43.616 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09beffd640 1 -- 172.21.15.40:0/4131428181 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80a5c70 con 0x7f09c00ca400 2023-11-04T01:39:43.616 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- 172.21.15.40:0/4131428181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00ca400 msgr2=0x7f09c00b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 --2- 172.21.15.40:0/4131428181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00ca400 0x7f09c00b0b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f09c015dc30 tx=0x7f09b801c9d0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- 172.21.15.40:0/4131428181 shutdown_connections 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 --2- 172.21.15.40:0/4131428181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00ca400 0x7f09c00b0b70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 --2- 172.21.15.40:0/4131428181 >> v2:172.21.15.91:3300/0 conn(0x7f09c00cdea0 0x7f09c00b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- 172.21.15.40:0/4131428181 >> 172.21.15.40:0/4131428181 conn(0x7f09c00cebb0 msgr2=0x7f09c00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- 172.21.15.40:0/4131428181 shutdown_connections 2023-11-04T01:39:43.617 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.609+0000 7f09c6527640 1 -- 172.21.15.40:0/4131428181 wait complete. 2023-11-04T01:39:43.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 Processor -- start 2023-11-04T01:39:43.619 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- start start 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f09c00ca400 0x7f09c0152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 0x7f09c0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09c015a1f0 0x7f09c0153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00b2c30 con 0x7f09c00cdea0 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c27f0 con 0x7f09c015a1f0 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00c2a90 con 0x7f09c00ca400 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 0x7f09c0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.620 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 0x7f09c0152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33434/0 (socket says 172.21.15.40:33434) 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 -- 172.21.15.40:0/2783172170 learned_addr learned my addr 172.21.15.40:0/2783172170 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c4ac4640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09c015a1f0 0x7f09c0153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bffff640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f09c00ca400 0x7f09c0152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 -- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f09c00ca400 msgr2=0x7f09c0152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f09c00ca400 0x7f09c0152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 -- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09c015a1f0 msgr2=0x7f09c0153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09c015a1f0 0x7f09c0153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 -- 172.21.15.40:0/2783172170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009b30 con 0x7f09c00cdea0 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bf7fe640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 0x7f09c0152c30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f09a800d7d0 tx=0x7f09a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800b6c0 con 0x7f09c00cdea0 2023-11-04T01:39:43.621 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800b820 con 0x7f09c00cdea0 2023-11-04T01:39:43.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800bbd0 con 0x7f09c00cdea0 2023-11-04T01:39:43.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c00c2d70 con 0x7f09c00cdea0 2023-11-04T01:39:43.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c00c3330 con 0x7f09c00cdea0 2023-11-04T01:39:43.622 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00744a0 con 0x7f09c00cdea0 2023-11-04T01:39:43.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.613+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f09a800bd30 con 0x7f09c00cdea0 2023-11-04T01:39:43.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.617+0000 7f09bcff9640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f09a0066410 0x7f09a00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.617+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f09a8083320 con 0x7f09c00cdea0 2023-11-04T01:39:43.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.617+0000 7f09bffff640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f09a0066410 0x7f09a00688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.623 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.617+0000 7f09bffff640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f09a0066410 0x7f09a00688d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f09c01f94c0 tx=0x7f09b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.634 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.629+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09a8051750 con 0x7f09c00cdea0 2023-11-04T01:39:43.638 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:39:43.636+0000 7f5097d59640 -1 osd.4 0 waiting for initial osdmap 2023-11-04T01:39:43.669 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:39:43.668+0000 7f50903a6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:43.788 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.781+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09c006cfb0 con 0x7f09c00cdea0 2023-11-04T01:39:43.790 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09bcff9640 1 -- 172.21.15.40:0/2783172170 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f09a8054d70 con 0x7f09c00cdea0 2023-11-04T01:39:43.790 INFO:teuthology.misc.health.smithi040.stdout: 2023-11-04T01:39:43.790 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":12,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:41.200257+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:43.792 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f09a0066410 msgr2=0x7f09a00688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.792 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f09a0066410 0x7f09a00688d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f09c01f94c0 tx=0x7f09b0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:43.792 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 msgr2=0x7f09c0152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.792 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 0x7f09c0152c30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f09a800d7d0 tx=0x7f09a800dc90 comp rx=0 tx=0).stop 2023-11-04T01:39:43.792 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 shutdown_connections 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f09a0066410 0x7f09a00688d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f09c015a1f0 0x7f09c0153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09c00cdea0 0x7f09c0152c30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 --2- 172.21.15.40:0/2783172170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f09c00ca400 0x7f09c0152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 >> 172.21.15.40:0/2783172170 conn(0x7f09c00cebb0 msgr2=0x7f09c00c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 shutdown_connections 2023-11-04T01:39:43.793 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:43.785+0000 7f09c6527640 1 -- 172.21.15.40:0/2783172170 wait complete. 2023-11-04T01:39:43.806 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:39:50.612 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:50.735 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 Processor -- start 2023-11-04T01:39:50.735 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 -- start start 2023-11-04T01:39:50.736 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc600ceaa0 0x7fdc600ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.736 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdc600caf10 0x7fdc600b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.736 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc60070d90 con 0x7fdc60159e70 2023-11-04T01:39:50.736 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6006dd90 con 0x7fdc600ceaa0 2023-11-04T01:39:50.736 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc686ab640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600cef00 con 0x7fdc600caf10 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc600ceaa0 0x7fdc600ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc600ceaa0 0x7fdc600ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46170/0 (socket says 172.21.15.40:46170) 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 -- 172.21.15.40:0/976557549 learned_addr learned my addr 172.21.15.40:0/976557549 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc66c48640 1 --2- 172.21.15.40:0/976557549 >> v2:172.21.15.91:3300/0 conn(0x7fdc600caf10 0x7fdc600b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 -- 172.21.15.40:0/976557549 >> v2:172.21.15.91:3300/0 conn(0x7fdc600caf10 msgr2=0x7fdc600b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 --2- 172.21.15.40:0/976557549 >> v2:172.21.15.91:3300/0 conn(0x7fdc600caf10 0x7fdc600b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 -- 172.21.15.40:0/976557549 >> v1:172.21.15.91:6789/0 conn(0x7fdc60159e70 legacy=0x7fdc6006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:50.737 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.729+0000 7fdc65c46640 1 -- 172.21.15.40:0/976557549 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6006d4f0 con 0x7fdc600ceaa0 2023-11-04T01:39:50.738 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc65c46640 1 --2- 172.21.15.40:0/976557549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc600ca9d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc600cc0c0 tx=0x7fdc5c01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421140e2ed31f356 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.739 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc65445640 1 -- 172.21.15.40:0/976557549 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0a7b40 con 0x7fdc600ceaa0 2023-11-04T01:39:50.739 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc65445640 1 -- 172.21.15.40:0/976557549 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0a7ca0 con 0x7fdc600ceaa0 2023-11-04T01:39:50.739 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc65445640 1 -- 172.21.15.40:0/976557549 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0af660 con 0x7fdc600ceaa0 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 -- 172.21.15.40:0/976557549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 msgr2=0x7fdc600ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 --2- 172.21.15.40:0/976557549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc600ca9d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc600cc0c0 tx=0x7fdc5c01eb60 comp rx=0 tx=0).stop 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 -- 172.21.15.40:0/976557549 shutdown_connections 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 --2- 172.21.15.40:0/976557549 >> v2:172.21.15.91:3300/0 conn(0x7fdc600caf10 0x7fdc600b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 --2- 172.21.15.40:0/976557549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc600ca9d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 -- 172.21.15.40:0/976557549 >> 172.21.15.40:0/976557549 conn(0x7fdc6006e760 msgr2=0x7fdc6006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 -- 172.21.15.40:0/976557549 shutdown_connections 2023-11-04T01:39:50.740 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.733+0000 7fdc686ab640 1 -- 172.21.15.40:0/976557549 wait complete. 2023-11-04T01:39:50.741 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 Processor -- start 2023-11-04T01:39:50.741 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- start start 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdc600caf10 0x7fdc601fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc601526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc60159e70 0x7fdc600c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60152510 con 0x7fdc600ceaa0 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60151d00 con 0x7fdc60159e70 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601fa540 con 0x7fdc600caf10 2023-11-04T01:39:50.743 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc601526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc601526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46172/0 (socket says 172.21.15.40:46172) 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 -- 172.21.15.40:0/4172402472 learned_addr learned my addr 172.21.15.40:0/4172402472 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc66c48640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc60159e70 0x7fdc600c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc66447640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdc600caf10 0x7fdc601fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 -- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdc600caf10 msgr2=0x7fdc601fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdc600caf10 0x7fdc601fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 -- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc60159e70 msgr2=0x7fdc600c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc60159e70 0x7fdc600c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 -- 172.21.15.40:0/4172402472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c00b770 con 0x7fdc600ceaa0 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc66447640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdc600caf10 0x7fdc601fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc65c46640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc601526c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00b2c0 tx=0x7fdc5c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.744 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0a7b40 con 0x7fdc600ceaa0 2023-11-04T01:39:50.745 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0ba480 con 0x7fdc600ceaa0 2023-11-04T01:39:50.745 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc60151f50 con 0x7fdc600ceaa0 2023-11-04T01:39:50.745 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0ba830 con 0x7fdc600ceaa0 2023-11-04T01:39:50.745 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc601f9800 con 0x7fdc600ceaa0 2023-11-04T01:39:50.746 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc601f9660 con 0x7fdc600ceaa0 2023-11-04T01:39:50.746 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc5c0ba990 con 0x7fdc600ceaa0 2023-11-04T01:39:50.746 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc56ffd640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdc440664a0 0x7fdc44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:50.746 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.737+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc5c11f1a0 con 0x7fdc600ceaa0 2023-11-04T01:39:50.746 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.741+0000 7fdc66447640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdc440664a0 0x7fdc44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:50.746 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.741+0000 7fdc66447640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdc440664a0 0x7fdc44068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc500098b0 tx=0x7fdc50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:50.749 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.745+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc601f9660 con 0x7fdc600ceaa0 2023-11-04T01:39:50.907 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.901+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc601f9660 con 0x7fdc600ceaa0 2023-11-04T01:39:50.909 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc56ffd640 1 -- 172.21.15.40:0/4172402472 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fdc601f9660 con 0x7fdc600ceaa0 2023-11-04T01:39:50.909 INFO:teuthology.misc.health.smithi040.stdout: 2023-11-04T01:39:50.909 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":16,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:47.865911+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdc440664a0 msgr2=0x7fdc44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdc440664a0 0x7fdc44068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc500098b0 tx=0x7fdc50008040 comp rx=0 tx=0).stop 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 msgr2=0x7fdc601526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc601526c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00b2c0 tx=0x7fdc5c01d3a0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 shutdown_connections 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdc440664a0 0x7fdc44068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdc60159e70 0x7fdc600c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.912 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc600ceaa0 0x7fdc601526c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.913 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 --2- 172.21.15.40:0/4172402472 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdc600caf10 0x7fdc601fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:50.913 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 >> 172.21.15.40:0/4172402472 conn(0x7fdc6006e760 msgr2=0x7fdc600cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:50.913 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 shutdown_connections 2023-11-04T01:39:50.913 INFO:teuthology.misc.health.smithi040.stderr:2023-11-04T01:39:50.905+0000 7fdc686ab640 1 -- 172.21.15.40:0/4172402472 wait complete. 2023-11-04T01:39:50.927 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-04T01:39:50.928 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T01:39:50.928 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:39:50.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:39:50.930 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:39:50.931 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:50.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:50.933 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:50.933 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:39:50.933 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:39:50.936 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:39:50.936 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:39:50.936 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:39:50.938 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:39:50.939 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T01:39:50.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:51.008 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:39:51.010 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:39:51.022 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:39:51.023 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:39:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 Processor -- start 2023-11-04T01:39:51.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 -- start start 2023-11-04T01:39:51.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 0x7f163c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f163c0cd6d0 0x7f163c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163c0d0a60 con 0x7f163c0cb400 2023-11-04T01:39:51.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c15b390 con 0x7f163c0cd6d0 2023-11-04T01:39:51.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f164405b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0cf8a0 con 0x7f163c15afb0 2023-11-04T01:39:51.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f163c0cb400 0x7f163c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33200/0 (socket says 172.21.15.40:33200) 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 -- 172.21.15.40:0/1244766152 learned_addr learned my addr 172.21.15.40:0/1244766152 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387770566 0 0) 0x7f163c0d0a60 con 0x7f163c0cb400 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1641df7640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 0x7f163c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1628003530 con 0x7f163c0cb400 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16425f8640 1 --2- 172.21.15.40:0/1244766152 >> v2:172.21.15.91:3300/0 conn(0x7f163c0cd6d0 0x7f163c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1764783776 0 0) 0x7f1628003530 con 0x7f163c0cb400 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 msgr2=0x7f163c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 0x7f163c0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 >> v2:172.21.15.91:3300/0 conn(0x7f163c0cd6d0 msgr2=0x7f163c0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 --2- 172.21.15.40:0/1244766152 >> v2:172.21.15.91:3300/0 conn(0x7f163c0cd6d0 0x7f163c0cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0d04a0 con 0x7f163c0cb400 2023-11-04T01:39:51.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f162c001680 con 0x7f163c0cb400 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 >> v1:172.21.15.40:6789/0 conn(0x7f163c0cb400 legacy=0x7f163c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 0x7f1628003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1628003f00 0x7f16280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1628004d10 0x7f1628005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c15b390 con 0x7f1628003f00 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0cf8a0 con 0x7f1628004d10 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162800b9e0 con 0x7f163c15afb0 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1628003f00 0x7f16280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f1641df7640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 0x7f1628003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16425f8640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1628004d10 0x7f1628005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 -- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 msgr2=0x7f1628003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c15afb0 0x7f1628003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 -- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1628004d10 msgr2=0x7f1628005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1628004d10 0x7f1628005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.049+0000 7f16415f6640 1 -- 172.21.15.40:0/1244766152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628003530 con 0x7f1628003f00 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1628003f00 0x7f16280047d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f162c00c210 tx=0x7f162c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915a8d88da9c653e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0058e0 con 0x7f1628003f00 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c005a40 con 0x7f1628003f00 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f1640df5640 1 -- 172.21.15.40:0/1244766152 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c005df0 con 0x7f1628003f00 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- 172.21.15.40:0/1244766152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1628003f00 msgr2=0x7f16280047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 --2- 172.21.15.40:0/1244766152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1628003f00 0x7f16280047d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f162c00c210 tx=0x7f162c01cba0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16425f8640 1 -- 172.21.15.40:0/1244766152 reap_dead start 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- 172.21.15.40:0/1244766152 shutdown_connections 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- 172.21.15.40:0/1244766152 >> 172.21.15.40:0/1244766152 conn(0x7f163c065dc0 msgr2=0x7f163c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- 172.21.15.40:0/1244766152 shutdown_connections 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- 172.21.15.40:0/1244766152 wait complete. 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 Processor -- start 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- start start 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c0b1fb0 0x7f163c1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 0x7f163c1f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f163c1f5330 0x7f163c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c8600 con 0x7f163c0c7df0 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c88e0 con 0x7f163c1f5330 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f164405b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c8bc0 con 0x7f163c0b1fb0 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 0x7f163c1f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 0x7f163c1f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46208/0 (socket says 172.21.15.40:46208) 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 -- 172.21.15.40:0/1682292489 learned_addr learned my addr 172.21.15.40:0/1682292489 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16425f8640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f163c1f5330 0x7f163c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f1641df7640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c0b1fb0 0x7f163c1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 -- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c0b1fb0 msgr2=0x7f163c1f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c0b1fb0 0x7f163c1f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 -- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f163c1f5330 msgr2=0x7f163c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f163c1f5330 0x7f163c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.053+0000 7f16415f6640 1 -- 172.21.15.40:0/1682292489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0c8ea0 con 0x7f163c0c7df0 2023-11-04T01:39:51.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16415f6640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 0x7f163c1f4df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f162c01c9d0 tx=0x7f1628005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c006e40 con 0x7f163c0c7df0 2023-11-04T01:39:51.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c0048b0 con 0x7f163c0c7df0 2023-11-04T01:39:51.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c0c9180 con 0x7f163c0c7df0 2023-11-04T01:39:51.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c004c60 con 0x7f163c0c7df0 2023-11-04T01:39:51.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c0c8270 con 0x7f163c0c7df0 2023-11-04T01:39:51.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c0675f0 con 0x7f163c0c7df0 2023-11-04T01:39:51.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f162c006fa0 con 0x7f163c0c7df0 2023-11-04T01:39:51.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16327fc640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16200664a0 0x7f1620068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f162c11c920 con 0x7f163c0c7df0 2023-11-04T01:39:51.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f1641df7640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16200664a0 0x7f1620068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.057+0000 7f1641df7640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16200664a0 0x7f1620068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1638009b00 tx=0x7f1638009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.061+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f162c0ea100 con 0x7f163c0c7df0 2023-11-04T01:39:51.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.213+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f163c066b00 con 0x7f163c0c7df0 2023-11-04T01:39:51.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.213+0000 7f16327fc640 1 -- 172.21.15.40:0/1682292489 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f162c0ed720 con 0x7f163c0c7df0 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:47.865911+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16200664a0 msgr2=0x7f1620068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16200664a0 0x7f1620068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1638009b00 tx=0x7f1638009190 comp rx=0 tx=0).stop 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 msgr2=0x7f163c1f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 0x7f163c1f4df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f162c01c9d0 tx=0x7f1628005800 comp rx=0 tx=0).stop 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 shutdown_connections 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16200664a0 0x7f1620068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f163c1f5330 0x7f163c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f163c0c7df0 0x7f163c1f4df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 --2- 172.21.15.40:0/1682292489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f163c0b1fb0 0x7f163c1f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 >> 172.21.15.40:0/1682292489 conn(0x7f163c065dc0 msgr2=0x7f163c0ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 shutdown_connections 2023-11-04T01:39:51.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.217+0000 7f164405b640 1 -- 172.21.15.40:0/1682292489 wait complete. 2023-11-04T01:39:51.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:51.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.345+0000 7fa517b2a640 1 Processor -- start 2023-11-04T01:39:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.345+0000 7fa517b2a640 1 -- start start 2023-11-04T01:39:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa517b2a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 0x7fa5100cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa517b2a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51006c0c0 con 0x7fa51015e490 2023-11-04T01:39:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa517b2a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51006c3a0 con 0x7fa51006d160 2023-11-04T01:39:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa517b2a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51006c680 con 0x7fa51015af70 2023-11-04T01:39:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa51015e490 0x7fa5100701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33214/0 (socket says 172.21.15.40:33214) 2023-11-04T01:39:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 -- 172.21.15.40:0/3676973809 learned_addr learned my addr 172.21.15.40:0/3676973809 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5158c6640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 0x7fa5100cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346584091 0 0) 0x7fa51006c0c0 con 0x7fa51015e490 2023-11-04T01:39:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4fc003530 con 0x7fa51015e490 2023-11-04T01:39:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639264701 0 0) 0x7fa4fc003530 con 0x7fa51015e490 2023-11-04T01:39:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 msgr2=0x7fa5100cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 0x7fa5100cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 >> v1:172.21.15.91:6789/0 conn(0x7fa51006d160 legacy=0x7fa51015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51006c960 con 0x7fa51015e490 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fa508001a00 con 0x7fa51015e490 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 >> v1:172.21.15.40:6789/0 conn(0x7fa51015e490 legacy=0x7fa5100701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 0x7fa4fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4fc003f30 0x7fa4fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4fc004d10 0x7fa4fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51006c680 con 0x7fa4fc004d10 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc00ba70 con 0x7fa4fc003f30 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc00de40 con 0x7fa51015af70 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4fc004d10 0x7fa4fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5158c6640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 0x7fa4fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5150c5640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4fc003f30 0x7fa4fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 -- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 msgr2=0x7fa4fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa51015af70 0x7fa4fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 -- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4fc003f30 msgr2=0x7fa4fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4fc003f30 0x7fa4fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5160c7640 1 -- 172.21.15.40:0/3676973809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc003530 con 0x7fa4fc004d10 2023-11-04T01:39:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.349+0000 7fa5150c5640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4fc003f30 0x7fa4fc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4fc004d10 0x7fa4fc005190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa50800a830 tx=0x7fa50801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93472e7e7f608eae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5080072d0 con 0x7fa4fc004d10 2023-11-04T01:39:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080a8070 con 0x7fa4fc004d10 2023-11-04T01:39:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5148c4640 1 -- 172.21.15.40:0/3676973809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5080076f0 con 0x7fa4fc004d10 2023-11-04T01:39:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- 172.21.15.40:0/3676973809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4fc004d10 msgr2=0x7fa4fc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 --2- 172.21.15.40:0/3676973809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4fc004d10 0x7fa4fc005190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa50800a830 tx=0x7fa50801d340 comp rx=0 tx=0).stop 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 -- 172.21.15.40:0/3676973809 reap_dead start 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- 172.21.15.40:0/3676973809 shutdown_connections 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- 172.21.15.40:0/3676973809 >> 172.21.15.40:0/3676973809 conn(0x7fa5100cb510 msgr2=0x7fa5100cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- 172.21.15.40:0/3676973809 shutdown_connections 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- 172.21.15.40:0/3676973809 wait complete. 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 Processor -- start 2023-11-04T01:39:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- start start 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4fc004d10 0x7fa5100cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5100c5b60 0x7fa5100cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 0x7fa5100c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100c25c0 con 0x7fa5100c73d0 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100c6090 con 0x7fa5100c5b60 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa517b2a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100c6370 con 0x7fa4fc004d10 2023-11-04T01:39:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 0x7fa5100c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5158c6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4fc004d10 0x7fa5100cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 0x7fa5100c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46238/0 (socket says 172.21.15.40:46238) 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 -- 172.21.15.40:0/1256019601 learned_addr learned my addr 172.21.15.40:0/1256019601 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5150c5640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5100c5b60 0x7fa5100cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 -- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4fc004d10 msgr2=0x7fa5100cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4fc004d10 0x7fa5100cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 -- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5100c5b60 msgr2=0x7fa5100cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5100c5b60 0x7fa5100cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 -- 172.21.15.40:0/1256019601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100c6650 con 0x7fa5100c73d0 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.353+0000 7fa5160c7640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 0x7fa5100c2a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa50801d170 tx=0x7fa4fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508001210 con 0x7fa5100c73d0 2023-11-04T01:39:51.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa508001800 con 0x7fa5100c73d0 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100c6930 con 0x7fa5100c73d0 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508004d70 con 0x7fa5100c73d0 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5100c2f50 con 0x7fa5100c73d0 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5100c6ac0 con 0x7fa5100c73d0 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5080aa030 con 0x7fa5100c73d0 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5027fc640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4f40664a0 0x7fa4f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa50811c790 con 0x7fa5100c73d0 2023-11-04T01:39:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5158c6640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4f40664a0 0x7fa4f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.357+0000 7fa5158c6640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4f40664a0 0x7fa4f4068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa504009be0 tx=0x7fa504009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.361+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5080e9ff0 con 0x7fa5100c73d0 2023-11-04T01:39:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.513+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5100744a0 con 0x7fa5100c73d0 2023-11-04T01:39:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa5027fc640 1 -- 172.21.15.40:0/1256019601 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5080ed610 con 0x7fa5100c73d0 2023-11-04T01:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4f40664a0 msgr2=0x7fa4f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4f40664a0 0x7fa4f4068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa504009be0 tx=0x7fa504009190 comp rx=0 tx=0).stop 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 msgr2=0x7fa5100c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 0x7fa5100c2a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa50801d170 tx=0x7fa4fc005800 comp rx=0 tx=0).stop 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 shutdown_connections 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4f40664a0 0x7fa4f4068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5100c73d0 0x7fa5100c2a10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5100c5b60 0x7fa5100cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 --2- 172.21.15.40:0/1256019601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4fc004d10 0x7fa5100cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 >> 172.21.15.40:0/1256019601 conn(0x7fa5100cb510 msgr2=0x7fa51015c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 shutdown_connections 2023-11-04T01:39:51.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.517+0000 7fa517b2a640 1 -- 172.21.15.40:0/1256019601 wait complete. 2023-11-04T01:39:51.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:51.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.657+0000 7f7e3651c640 1 Processor -- start 2023-11-04T01:39:51.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.657+0000 7f7e3651c640 1 -- start start 2023-11-04T01:39:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e3651c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7e300cdf00 0x7f7e300d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e3651c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e300cfe80 0x7f7e3015b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e3651c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3015fa20 con 0x7f7e3015b050 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e3651c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e300d0ca0 con 0x7f7e300cfe80 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e3651c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3006daf0 con 0x7f7e300cdf00 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e300cfe80 0x7f7e3015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e300cfe80 0x7f7e3015b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46240/0 (socket says 172.21.15.40:46240) 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 -- 172.21.15.40:0/2305448949 learned_addr learned my addr 172.21.15.40:0/2305448949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e2f7fe640 1 --2- 172.21.15.40:0/2305448949 >> v2:172.21.15.91:3300/0 conn(0x7f7e300cdf00 0x7f7e300d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 -- 172.21.15.40:0/2305448949 >> v2:172.21.15.91:3300/0 conn(0x7f7e300cdf00 msgr2=0x7f7e300d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 --2- 172.21.15.40:0/2305448949 >> v2:172.21.15.91:3300/0 conn(0x7f7e300cdf00 0x7f7e300d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 -- 172.21.15.40:0/2305448949 >> v1:172.21.15.91:6789/0 conn(0x7f7e3015b050 legacy=0x7f7e300cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 -- 172.21.15.40:0/2305448949 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3015ec60 con 0x7f7e300cfe80 2023-11-04T01:39:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e34ab9640 1 --2- 172.21.15.40:0/2305448949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e3015b430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e300b39d0 tx=0x7f7e2801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefdf5f10a462b5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e2effd640 1 -- 172.21.15.40:0/2305448949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280a5790 con 0x7f7e300cfe80 2023-11-04T01:39:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e2effd640 1 -- 172.21.15.40:0/2305448949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e280a58f0 con 0x7f7e300cfe80 2023-11-04T01:39:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.661+0000 7f7e2effd640 1 -- 172.21.15.40:0/2305448949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280a5c80 con 0x7f7e300cfe80 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/2305448949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 msgr2=0x7f7e3015b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 --2- 172.21.15.40:0/2305448949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e3015b430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e300b39d0 tx=0x7f7e2801c8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/2305448949 shutdown_connections 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 --2- 172.21.15.40:0/2305448949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e3015b430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 --2- 172.21.15.40:0/2305448949 >> v2:172.21.15.91:3300/0 conn(0x7f7e300cdf00 0x7f7e300d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/2305448949 >> 172.21.15.40:0/2305448949 conn(0x7f7e300b28f0 msgr2=0x7f7e300b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/2305448949 shutdown_connections 2023-11-04T01:39:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/2305448949 wait complete. 2023-11-04T01:39:51.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 Processor -- start 2023-11-04T01:39:51.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- start start 2023-11-04T01:39:51.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7e300cdf00 0x7f7e3014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e300ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e3015b050 0x7f7e301597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3015a260 con 0x7f7e300cfe80 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3014ee00 con 0x7f7e3015b050 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300c8dc0 con 0x7f7e300cdf00 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e300ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e300ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46248/0 (socket says 172.21.15.40:46248) 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 -- 172.21.15.40:0/1340262751 learned_addr learned my addr 172.21.15.40:0/1340262751 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e34ab9640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e3015b050 0x7f7e301597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2ffff640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7e300cdf00 0x7f7e3014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 -- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7e300cdf00 msgr2=0x7f7e3014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7e300cdf00 0x7f7e3014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 -- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e3015b050 msgr2=0x7f7e301597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e3015b050 0x7f7e301597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 -- 172.21.15.40:0/1340262751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009b30 con 0x7f7e300cfe80 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2f7fe640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e300ca830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400d830 tx=0x7f7e2400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400b6c0 con 0x7f7e300cfe80 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2400b820 con 0x7f7e300cfe80 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e30158760 con 0x7f7e300cfe80 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400bb90 con 0x7f7e300cfe80 2023-11-04T01:39:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.665+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e30158d20 con 0x7f7e300cfe80 2023-11-04T01:39:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.669+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e300c72b0 con 0x7f7e300cfe80 2023-11-04T01:39:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.669+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e2400bcf0 con 0x7f7e300cfe80 2023-11-04T01:39:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.669+0000 7f7e2cff9640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7e1c0664a0 0x7f7e1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.669+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e24084010 con 0x7f7e300cfe80 2023-11-04T01:39:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.669+0000 7f7e2ffff640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7e1c0664a0 0x7f7e1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.669+0000 7f7e2ffff640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7e1c0664a0 0x7f7e1c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000b810 tx=0x7f7e20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.673+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e24051870 con 0x7f7e300cfe80 2023-11-04T01:39:51.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.861+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e300cd270 con 0x7f7e300cfe80 2023-11-04T01:39:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e2cff9640 1 -- 172.21.15.40:0/1340262751 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f7e24054e90 con 0x7f7e300cfe80 2023-11-04T01:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-04T01:39:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2023-11-04T01:39:51.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7e1c0664a0 msgr2=0x7f7e1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7e1c0664a0 0x7f7e1c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000b810 tx=0x7f7e20008040 comp rx=0 tx=0).stop 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 msgr2=0x7f7e300ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e300ca830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400d830 tx=0x7f7e2400dcf0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 shutdown_connections 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7e1c0664a0 0x7f7e1c068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7e3015b050 0x7f7e301597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e300cfe80 0x7f7e300ca830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 --2- 172.21.15.40:0/1340262751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7e300cdf00 0x7f7e3014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 >> 172.21.15.40:0/1340262751 conn(0x7f7e300b28f0 msgr2=0x7f7e300cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 shutdown_connections 2023-11-04T01:39:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:51.865+0000 7f7e3651c640 1 -- 172.21.15.40:0/1340262751 wait complete. 2023-11-04T01:39:53.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.013+0000 7f93f222b640 1 Processor -- start 2023-11-04T01:39:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.013+0000 7f93f222b640 1 -- start start 2023-11-04T01:39:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93f222b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93ec0b4990 0x7f93ec0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93f222b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f93ec0b74f0 0x7f93ec0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93f222b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ec0b6070 con 0x7f93ec0d0690 2023-11-04T01:39:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93f222b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0b8ed0 con 0x7f93ec0b4990 2023-11-04T01:39:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93f222b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0b52b0 con 0x7f93ec0b74f0 2023-11-04T01:39:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93ec0b4990 0x7f93ec0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93ec0b4990 0x7f93ec0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46254/0 (socket says 172.21.15.40:46254) 2023-11-04T01:39:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 -- 172.21.15.40:0/2116080662 learned_addr learned my addr 172.21.15.40:0/2116080662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93ebfff640 1 --2- 172.21.15.40:0/2116080662 >> v2:172.21.15.91:3300/0 conn(0x7f93ec0b74f0 0x7f93ec0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 -- 172.21.15.40:0/2116080662 >> v2:172.21.15.91:3300/0 conn(0x7f93ec0b74f0 msgr2=0x7f93ec0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 --2- 172.21.15.40:0/2116080662 >> v2:172.21.15.91:3300/0 conn(0x7f93ec0b74f0 0x7f93ec0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 -- 172.21.15.40:0/2116080662 >> v1:172.21.15.91:6789/0 conn(0x7f93ec0d0690 legacy=0x7f93ec0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 -- 172.21.15.40:0/2116080662 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0d1ce0 con 0x7f93ec0b4990 2023-11-04T01:39:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93ebfff640 1 --2- 172.21.15.40:0/2116080662 >> v2:172.21.15.91:3300/0 conn(0x7f93ec0b74f0 0x7f93ec0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.017+0000 7f93eb7fe640 1 --2- 172.21.15.40:0/2116080662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b4990 0x7f93ec0b4d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93ec08c3b0 tx=0x7f93dc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f4b1d905bf33f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93ea7fc640 1 -- 172.21.15.40:0/2116080662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc0a89f0 con 0x7f93ec0b4990 2023-11-04T01:39:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93ea7fc640 1 -- 172.21.15.40:0/2116080662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc0a8b50 con 0x7f93ec0b4990 2023-11-04T01:39:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93ea7fc640 1 -- 172.21.15.40:0/2116080662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc0b0440 con 0x7f93ec0b4990 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/2116080662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b4990 msgr2=0x7f93ec0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 --2- 172.21.15.40:0/2116080662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b4990 0x7f93ec0b4d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93ec08c3b0 tx=0x7f93dc01ecf0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/2116080662 shutdown_connections 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 --2- 172.21.15.40:0/2116080662 >> v2:172.21.15.91:3300/0 conn(0x7f93ec0b74f0 0x7f93ec0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 --2- 172.21.15.40:0/2116080662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b4990 0x7f93ec0b4d70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/2116080662 >> 172.21.15.40:0/2116080662 conn(0x7f93ec0cf990 msgr2=0x7f93ec0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/2116080662 shutdown_connections 2023-11-04T01:39:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/2116080662 wait complete. 2023-11-04T01:39:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 Processor -- start 2023-11-04T01:39:54.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- start start 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93ec0b4990 0x7f93ec1e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 0x7f93ec0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93ec0d0690 0x7f93ec0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec148a20 con 0x7f93ec0b74f0 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec148740 con 0x7f93ec0d0690 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1f6020 con 0x7f93ec0b4990 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 0x7f93ec0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 0x7f93ec0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46262/0 (socket says 172.21.15.40:46262) 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 -- 172.21.15.40:0/1814915717 learned_addr learned my addr 172.21.15.40:0/1814915717 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eb7fe640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93ec0b4990 0x7f93ec1e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93ebfff640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93ec0d0690 0x7f93ec0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 -- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93ec0b4990 msgr2=0x7f93ec1e8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93ec0b4990 0x7f93ec1e8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 -- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93ec0d0690 msgr2=0x7f93ec0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93ec0d0690 0x7f93ec0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 -- 172.21.15.40:0/1814915717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0094d0 con 0x7f93ec0b74f0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eb7fe640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93ec0b4990 0x7f93ec1e8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93eaffd640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 0x7f93ec0b39b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93e000c390 tx=0x7f93e000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00052d0 con 0x7f93ec0b74f0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0005430 con 0x7f93ec0b74f0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec1f6300 con 0x7f93ec0b74f0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0003820 con 0x7f93ec0b74f0 2023-11-04T01:39:54.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.021+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec1e9460 con 0x7f93ec0b74f0 2023-11-04T01:39:54.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.025+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec1f5e80 con 0x7f93ec0b74f0 2023-11-04T01:39:54.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.025+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93e0003980 con 0x7f93ec0b74f0 2023-11-04T01:39:54.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.025+0000 7f93d3fff640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93d80664a0 0x7f93d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.025+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93e0083070 con 0x7f93ec0b74f0 2023-11-04T01:39:54.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.025+0000 7f93eb7fe640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93d80664a0 0x7f93d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.025+0000 7f93eb7fe640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93d80664a0 0x7f93d8068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0b2000 tx=0x7f93dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.029+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93ec1f5e80 con 0x7f93ec0b74f0 2023-11-04T01:39:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.221+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ec1f5e80 con 0x7f93ec0b74f0 2023-11-04T01:39:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.221+0000 7f93d3fff640 1 -- 172.21.15.40:0/1814915717 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f93e0017e80 con 0x7f93ec0b74f0 2023-11-04T01:39:54.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:54.229 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-04T01:39:54.229 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93d80664a0 msgr2=0x7f93d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93d80664a0 0x7f93d8068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0b2000 tx=0x7f93dc008040 comp rx=0 tx=0).stop 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 msgr2=0x7f93ec0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 0x7f93ec0b39b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93e000c390 tx=0x7f93e000c850 comp rx=0 tx=0).stop 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 shutdown_connections 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93d80664a0 0x7f93d8068960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93ec0d0690 0x7f93ec0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93ec0b74f0 0x7f93ec0b39b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 --2- 172.21.15.40:0/1814915717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93ec0b4990 0x7f93ec1e8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 >> 172.21.15.40:0/1814915717 conn(0x7f93ec0cf990 msgr2=0x7f93ec0ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 shutdown_connections 2023-11-04T01:39:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.225+0000 7f93f222b640 1 -- 172.21.15.40:0/1814915717 wait complete. 2023-11-04T01:39:54.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 Processor -- start 2023-11-04T01:39:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- start start 2023-11-04T01:39:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69c00d0ae0 0x7f69c00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c00b6070 con 0x7f69c00d0690 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c00b8ed0 con 0x7f69c00b4990 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c00d1ce0 con 0x7f69c00d0ae0 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69bffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69c00d0ae0 0x7f69c00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69b7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f69c00d0690 0x7f69c00b64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33220/0 (socket says 172.21.15.40:33220) 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69bffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69c00d0ae0 0x7f69c00b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46268/0 (socket says 172.21.15.40:46268) 2023-11-04T01:39:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69b7fff640 1 -- 172.21.15.40:0/2531469565 learned_addr learned my addr 172.21.15.40:0/2531469565 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69bffff640 1 -- 172.21.15.40:0/2531469565 >> v1:172.21.15.91:6789/0 conn(0x7f69c00b4990 legacy=0x7f69c00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69bffff640 1 -- 172.21.15.40:0/2531469565 >> v1:172.21.15.40:6789/0 conn(0x7f69c00d0690 legacy=0x7f69c00b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69beffd640 1 -- 172.21.15.40:0/2531469565 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038375479 0 0) 0x7f69c00b6070 con 0x7f69c00d0690 2023-11-04T01:39:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69bffff640 1 -- 172.21.15.40:0/2531469565 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c00d1fc0 con 0x7f69c00d0ae0 2023-11-04T01:39:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69bffff640 1 --2- 172.21.15.40:0/2531469565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0ae0 0x7f69c00b6bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009d90 tx=0x7f69b801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a748519e5cb765d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69beffd640 1 -- 172.21.15.40:0/2531469565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b80af600 con 0x7f69c00d0ae0 2023-11-04T01:39:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69beffd640 1 -- 172.21.15.40:0/2531469565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b80ab050 con 0x7f69c00d0ae0 2023-11-04T01:39:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69beffd640 1 -- 172.21.15.40:0/2531469565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b80af980 con 0x7f69c00d0ae0 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- 172.21.15.40:0/2531469565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0ae0 msgr2=0x7f69c00b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/2531469565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0ae0 0x7f69c00b6bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009d90 tx=0x7f69b801f130 comp rx=0 tx=0).stop 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- 172.21.15.40:0/2531469565 shutdown_connections 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/2531469565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0ae0 0x7f69c00b6bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- 172.21.15.40:0/2531469565 >> 172.21.15.40:0/2531469565 conn(0x7f69c00cf990 msgr2=0x7f69c00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- 172.21.15.40:0/2531469565 shutdown_connections 2023-11-04T01:39:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- 172.21.15.40:0/2531469565 wait complete. 2023-11-04T01:39:54.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 Processor -- start 2023-11-04T01:39:54.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.373+0000 7f69c5b1e640 1 -- start start 2023-11-04T01:39:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c00b4990 0x7f69c0159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 0x7f69c01e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c00d0ae0 0x7f69c01e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0159680 con 0x7f69c00d0690 2023-11-04T01:39:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c01f2f70 con 0x7f69c00b4990 2023-11-04T01:39:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c015ff20 con 0x7f69c00d0ae0 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 0x7f69c01e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 0x7f69c01e8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46282/0 (socket says 172.21.15.40:46282) 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 -- 172.21.15.40:0/3672779222 learned_addr learned my addr 172.21.15.40:0/3672779222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bffff640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c00d0ae0 0x7f69c01e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bf7fe640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c00b4990 0x7f69c0159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 -- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c00d0ae0 msgr2=0x7f69c01e8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c00d0ae0 0x7f69c01e8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 -- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c00b4990 msgr2=0x7f69c0159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c00b4990 0x7f69c0159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 -- 172.21.15.40:0/3672779222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8009a70 con 0x7f69c00d0690 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bf7fe640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c00b4990 0x7f69c0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69b7fff640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 0x7f69c01e8940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c4b0 tx=0x7f69a800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a80074e0 con 0x7f69c00d0690 2023-11-04T01:39:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8007640 con 0x7f69c00d0690 2023-11-04T01:39:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c01f2660 con 0x7f69c00d0690 2023-11-04T01:39:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8004a30 con 0x7f69c00d0690 2023-11-04T01:39:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c01f2920 con 0x7f69c00d0690 2023-11-04T01:39:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c01f3120 con 0x7f69c00d0690 2023-11-04T01:39:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69a8004b90 con 0x7f69c00d0690 2023-11-04T01:39:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bcff9640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69a00664a0 0x7f69a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69a8082ea0 con 0x7f69c00d0690 2023-11-04T01:39:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.377+0000 7f69bf7fe640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69a00664a0 0x7f69a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.381+0000 7f69bf7fe640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69a00664a0 0x7f69a0068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f69b0000f70 tx=0x7f69b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.381+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69a80507b0 con 0x7f69c00d0690 2023-11-04T01:39:54.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.537+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69c00744a0 con 0x7f69c00d0690 2023-11-04T01:39:54.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.537+0000 7f69bcff9640 1 -- 172.21.15.40:0/3672779222 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f69a8018020 con 0x7f69c00d0690 2023-11-04T01:39:54.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:54.545 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:47.865911+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:54.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69a00664a0 msgr2=0x7f69a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69a00664a0 0x7f69a0068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f69b0000f70 tx=0x7f69b0009040 comp rx=0 tx=0).stop 2023-11-04T01:39:54.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 msgr2=0x7f69c01e8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 0x7f69c01e8940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69a800c4b0 tx=0x7f69a800c970 comp rx=0 tx=0).stop 2023-11-04T01:39:54.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 shutdown_connections 2023-11-04T01:39:54.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69a00664a0 0x7f69a0068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c00d0ae0 0x7f69c01e8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c00d0690 0x7f69c01e8940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 --2- 172.21.15.40:0/3672779222 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c00b4990 0x7f69c0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 >> 172.21.15.40:0/3672779222 conn(0x7f69c00cf990 msgr2=0x7f69c00b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 shutdown_connections 2023-11-04T01:39:54.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.541+0000 7f69c5b1e640 1 -- 172.21.15.40:0/3672779222 wait complete. 2023-11-04T01:39:54.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:54.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:54.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.693+0000 7f212ba5a640 1 Processor -- start 2023-11-04T01:39:54.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.693+0000 7f212ba5a640 1 -- start start 2023-11-04T01:39:54.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f212ba5a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2124146510 0x7f21240cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f212ba5a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2124161760 con 0x7f212406a870 2023-11-04T01:39:54.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f212ba5a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2124161a40 con 0x7f21241438e0 2023-11-04T01:39:54.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f212ba5a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240d0790 con 0x7f2124146510 2023-11-04T01:39:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2128ff5640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f212406a870 0x7f212406cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33232/0 (socket says 172.21.15.40:33232) 2023-11-04T01:39:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2128ff5640 1 -- 172.21.15.40:0/2732292623 learned_addr learned my addr 172.21.15.40:0/2732292623 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 --2- 172.21.15.40:0/2732292623 >> v2:172.21.15.91:3300/0 conn(0x7f2124146510 0x7f21240cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977104725 0 0) 0x7f2124161760 con 0x7f212406a870 2023-11-04T01:39:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2110003530 con 0x7f212406a870 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1925130915 0 0) 0x7f2110003530 con 0x7f212406a870 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 >> v2:172.21.15.91:3300/0 conn(0x7f2124146510 msgr2=0x7f21240cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 --2- 172.21.15.40:0/2732292623 >> v2:172.21.15.91:3300/0 conn(0x7f2124146510 0x7f21240cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 >> v1:172.21.15.91:6789/0 conn(0x7f21241438e0 legacy=0x7f212406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240d0a00 con 0x7f212406a870 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f2114001680 con 0x7f212406a870 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 >> v1:172.21.15.40:6789/0 conn(0x7f212406a870 legacy=0x7f212406cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110003980 0x7f2110003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21100047d0 0x7f2110004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2110005190 0x7f211000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240d0790 con 0x7f2110005190 2023-11-04T01:39:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211000c130 con 0x7f21100047d0 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211000c2f0 con 0x7f2110003980 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2110005190 0x7f211000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2128ff5640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21100047d0 0x7f2110004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f21297f6640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110003980 0x7f2110003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 -- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110003980 msgr2=0x7f2110003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110003980 0x7f2110003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 -- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21100047d0 msgr2=0x7f2110004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21100047d0 0x7f2110004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2129ff7640 1 -- 172.21.15.40:0/2732292623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110003530 con 0x7f2110005190 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f21297f6640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110003980 0x7f2110003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.697+0000 7f2128ff5640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f21100047d0 0x7f2110004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f2129ff7640 1 -- 172.21.15.40:0/2732292623 reap_dead start 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f2129ff7640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2110005190 0x7f211000b990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f211c009f90 tx=0x7f211c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74befc25fa3e14fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0a5b60 con 0x7f2110005190 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c00f040 con 0x7f2110005190 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f211bfff640 1 -- 172.21.15.40:0/2732292623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0ad440 con 0x7f2110005190 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- 172.21.15.40:0/2732292623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2110005190 msgr2=0x7f211000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2110005190 0x7f211000b990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f211c009f90 tx=0x7f211c01cc60 comp rx=0 tx=0).stop 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- 172.21.15.40:0/2732292623 shutdown_connections 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 --2- 172.21.15.40:0/2732292623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2110005190 0x7f211000b990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- 172.21.15.40:0/2732292623 >> 172.21.15.40:0/2732292623 conn(0x7f21240cfc70 msgr2=0x7f21240d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- 172.21.15.40:0/2732292623 shutdown_connections 2023-11-04T01:39:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- 172.21.15.40:0/2732292623 wait complete. 2023-11-04T01:39:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 Processor -- start 2023-11-04T01:39:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- start start 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110005190 0x7f212413cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 0x7f212415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f212413acc0 0x7f212415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124139930 con 0x7f212413a840 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240b3ac0 con 0x7f212413acc0 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f212ba5a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21240b3da0 con 0x7f2110005190 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f2128ff5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 0x7f212415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f2128ff5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 0x7f212415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46298/0 (socket says 172.21.15.40:46298) 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f2128ff5640 1 -- 172.21.15.40:0/3052366504 learned_addr learned my addr 172.21.15.40:0/3052366504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f21297f6640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110005190 0x7f212413cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.701+0000 7f2129ff7640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f212413acc0 0x7f212415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2128ff5640 1 -- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110005190 msgr2=0x7f212413cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2128ff5640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110005190 0x7f212413cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2128ff5640 1 -- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f212413acc0 msgr2=0x7f212415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2128ff5640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f212413acc0 0x7f212415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2128ff5640 1 -- 172.21.15.40:0/3052366504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240b4080 con 0x7f212413a840 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2129ff7640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f212413acc0 0x7f212415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2128ff5640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 0x7f212415b500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2114011790 tx=0x7f2114011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400fb60 con 0x7f212413a840 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400fcc0 con 0x7f212413a840 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21240b4360 con 0x7f212413a840 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114015610 con 0x7f212413a840 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2124138e60 con 0x7f212413a840 2023-11-04T01:39:54.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21240b45a0 con 0x7f212413a840 2023-11-04T01:39:54.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2114015770 con 0x7f212413a840 2023-11-04T01:39:54.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2119ffb640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21080664a0 0x7f2108068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:54.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2114086c30 con 0x7f212413a840 2023-11-04T01:39:54.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f21297f6640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21080664a0 0x7f2108068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:54.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.705+0000 7f21297f6640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21080664a0 0x7f2108068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2120001660 tx=0x7f2120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:54.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.709+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f21240b45a0 con 0x7f212413a840 2023-11-04T01:39:54.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.865+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21240b45a0 con 0x7f212413a840 2023-11-04T01:39:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f2119ffb640 1 -- 172.21.15.40:0/3052366504 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21240b45a0 con 0x7f212413a840 2023-11-04T01:39:54.869 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:39:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21080664a0 msgr2=0x7f2108068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21080664a0 0x7f2108068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2120001660 tx=0x7f2120009040 comp rx=0 tx=0).stop 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 msgr2=0x7f212415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 0x7f212415b500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2114011790 tx=0x7f2114011c50 comp rx=0 tx=0).stop 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 shutdown_connections 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21080664a0 0x7f2108068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f212413acc0 0x7f212415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212413a840 0x7f212415b500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 --2- 172.21.15.40:0/3052366504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2110005190 0x7f212413cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 >> 172.21.15.40:0/3052366504 conn(0x7f21240cfc70 msgr2=0x7f21240d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 shutdown_connections 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:54.869+0000 7f212ba5a640 1 -- 172.21.15.40:0/3052366504 wait complete. 2023-11-04T01:39:54.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:39:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 Processor -- start 2023-11-04T01:39:55.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 -- start start 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f68cc159fc0 0x7f68cc0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc0b0d40 0x7f68cc15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc06cfd0 con 0x7f68cc0ca990 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0ca030 con 0x7f68cc159fc0 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68d20b3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc15e830 con 0x7f68cc0b0d40 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f68cc159fc0 0x7f68cc0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cbfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc0b0d40 0x7f68cc15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f68cc159fc0 0x7f68cc0ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:38126/0 (socket says 172.21.15.40:38126) 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68caffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f68cc0ca990 0x7f68cc0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:53412/0 (socket says 172.21.15.40:53412) 2023-11-04T01:39:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 -- 172.21.15.40:0/4174707654 learned_addr learned my addr 172.21.15.40:0/4174707654 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cbfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc0b0d40 0x7f68cc15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:47678/0 (socket says 172.21.15.40:47678) 2023-11-04T01:39:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 -- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc0b0d40 msgr2=0x7f68cc15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc0b0d40 0x7f68cc15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 -- 172.21.15.40:0/4174707654 >> v1:172.21.15.91:6789/0 conn(0x7f68cc0ca990 legacy=0x7f68cc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.009+0000 7f68cb7fe640 1 -- 172.21.15.40:0/4174707654 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc15eb10 con 0x7f68cc159fc0 2023-11-04T01:39:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc159fc0 0x7f68cc0ca450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009870 tx=0x7f68bc01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809b7d91be361005 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68ca7fc640 1 -- 172.21.15.40:0/4174707654 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0ab620 con 0x7f68cc159fc0 2023-11-04T01:39:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68ca7fc640 1 -- 172.21.15.40:0/4174707654 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc0ab780 con 0x7f68cc159fc0 2023-11-04T01:39:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68ca7fc640 1 -- 172.21.15.40:0/4174707654 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0abb10 con 0x7f68cc159fc0 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc159fc0 msgr2=0x7f68cc0ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 --2- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc159fc0 0x7f68cc0ca450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009870 tx=0x7f68bc01c510 comp rx=0 tx=0).stop 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- 172.21.15.40:0/4174707654 shutdown_connections 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 --2- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc0b0d40 0x7f68cc15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 --2- 172.21.15.40:0/4174707654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc159fc0 0x7f68cc0ca450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- 172.21.15.40:0/4174707654 >> 172.21.15.40:0/4174707654 conn(0x7f68cc0cebb0 msgr2=0x7f68cc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- 172.21.15.40:0/4174707654 shutdown_connections 2023-11-04T01:39:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- 172.21.15.40:0/4174707654 wait complete. 2023-11-04T01:39:55.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 Processor -- start 2023-11-04T01:39:55.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- start start 2023-11-04T01:39:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc0b0d40 0x7f68cc14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 0x7f68cc0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc159fc0 0x7f68cc0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc14bf70 con 0x7f68cc0ca990 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0c6960 con 0x7f68cc0b0d40 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68d20b3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0c6c40 con 0x7f68cc159fc0 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.013+0000 7f68caffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 0x7f68cc0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 0x7f68cc0b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46308/0 (socket says 172.21.15.40:46308) 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 -- 172.21.15.40:0/1463518793 learned_addr learned my addr 172.21.15.40:0/1463518793 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc0b0d40 0x7f68cc14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68cbfff640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc159fc0 0x7f68cc0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 -- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc159fc0 msgr2=0x7f68cc0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc159fc0 0x7f68cc0b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 -- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc0b0d40 msgr2=0x7f68cc14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc0b0d40 0x7f68cc14ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 -- 172.21.15.40:0/1463518793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0094d0 con 0x7f68cc0ca990 2023-11-04T01:39:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc0b0d40 0x7f68cc14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68caffd640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 0x7f68cc0b3730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c490 tx=0x7f68c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0007480 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00075e0 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc0c6f20 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0004a10 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc0c74e0 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0c7700 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68c0004b70 con 0x7f68cc0ca990 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68b3fff640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68c0082bf0 con 0x7f68cc0ca990 2023-11-04T01:39:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.017+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68b80664a0 0x7f68b8068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0af000 tx=0x7f68bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.021+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68c0050500 con 0x7f68cc0ca990 2023-11-04T01:39:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.177+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68cc0744a0 con 0x7f68cc0ca990 2023-11-04T01:39:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.177+0000 7f68b3fff640 1 -- 172.21.15.40:0/1463518793 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f68c0018020 con 0x7f68cc0ca990 2023-11-04T01:39:55.181 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:55.181 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-11-04T01:39:55.181 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:39:55.181 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-11-04T01:39:55.181 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-11-04T01:39:55.182 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:39:55.182 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-11-04T01:39:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68b80664a0 msgr2=0x7f68b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68b80664a0 0x7f68b8068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0af000 tx=0x7f68bc0a7000 comp rx=0 tx=0).stop 2023-11-04T01:39:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 msgr2=0x7f68cc0b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 0x7f68cc0b3730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c490 tx=0x7f68c000c950 comp rx=0 tx=0).stop 2023-11-04T01:39:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 shutdown_connections 2023-11-04T01:39:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68cc159fc0 0x7f68cc0b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc0ca990 0x7f68cc0b3730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 --2- 172.21.15.40:0/1463518793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68cc0b0d40 0x7f68cc14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 >> 172.21.15.40:0/1463518793 conn(0x7f68cc0cebb0 msgr2=0x7f68cc15a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 shutdown_connections 2023-11-04T01:39:55.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.181+0000 7f68d20b3640 1 -- 172.21.15.40:0/1463518793 wait complete. 2023-11-04T01:39:55.199 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:39:55.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:39:55.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.313+0000 7f12b1b72640 1 Processor -- start 2023-11-04T01:39:55.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.313+0000 7f12b1b72640 1 -- start start 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12b1b72640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f12ac159e00 0x7f12ac0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12b1b72640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac15d9d0 con 0x7f12ac070180 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12b1b72640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac15dcb0 con 0x7f12ac0cb830 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12b1b72640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac15e650 con 0x7f12ac159e00 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12a3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f12ac070180 0x7f12ac0cb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33248/0 (socket says 172.21.15.40:33248) 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12a3fff640 1 -- 172.21.15.40:0/104718011 learned_addr learned my addr 172.21.15.40:0/104718011 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/104718011 >> v2:172.21.15.91:3300/0 conn(0x7f12ac159e00 0x7f12ac0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005318706 0 0) 0x7f12ac15d9d0 con 0x7f12ac070180 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1298003530 con 0x7f12ac070180 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2995548734 0 0) 0x7f1298003530 con 0x7f12ac070180 2023-11-04T01:39:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 >> v2:172.21.15.91:3300/0 conn(0x7f12ac159e00 msgr2=0x7f12ac0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 --2- 172.21.15.40:0/104718011 >> v2:172.21.15.91:3300/0 conn(0x7f12ac159e00 0x7f12ac0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 >> v1:172.21.15.91:6789/0 conn(0x7f12ac0cb830 legacy=0x7f12ac0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac15df90 con 0x7f12ac070180 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1294001680 con 0x7f12ac070180 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 >> v1:172.21.15.40:6789/0 conn(0x7f12ac070180 legacy=0x7f12ac0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298003980 0x7f1298003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12980047d0 0x7f1298004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298005190 0x7f129800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac15e650 con 0x7f1298003980 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129800c130 con 0x7f12980047d0 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129800c2f0 con 0x7f1298005190 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298003980 0x7f1298003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12a3fff640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12980047d0 0x7f1298004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12abfff640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298005190 0x7f129800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 -- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298005190 msgr2=0x7f129800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298005190 0x7f129800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 -- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12980047d0 msgr2=0x7f1298004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12980047d0 0x7f1298004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12abfff640 1 -- 172.21.15.40:0/104718011 reap_dead start 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12ab7fe640 1 -- 172.21.15.40:0/104718011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298003530 con 0x7f1298003980 2023-11-04T01:39:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.317+0000 7f12a3fff640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12980047d0 0x7f1298004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298003980 0x7f1298003da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f129c009ae0 tx=0x7f129c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e095a81500490d93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0b0400 con 0x7f1298003980 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c0b0560 con 0x7f1298003980 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12aaffd640 1 -- 172.21.15.40:0/104718011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0b0910 con 0x7f1298003980 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- 172.21.15.40:0/104718011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298003980 msgr2=0x7f1298003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298003980 0x7f1298003da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f129c009ae0 tx=0x7f129c01ca70 comp rx=0 tx=0).stop 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- 172.21.15.40:0/104718011 shutdown_connections 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 --2- 172.21.15.40:0/104718011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298003980 0x7f1298003da0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- 172.21.15.40:0/104718011 >> 172.21.15.40:0/104718011 conn(0x7f12ac0b0630 msgr2=0x7f12ac0b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:55.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- 172.21.15.40:0/104718011 shutdown_connections 2023-11-04T01:39:55.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- 172.21.15.40:0/104718011 wait complete. 2023-11-04T01:39:55.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 Processor -- start 2023-11-04T01:39:55.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- start start 2023-11-04T01:39:55.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298003980 0x7f12ac1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12ac0b2830 0x7f12ac0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 0x7f12ac0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c6300 con 0x7f12ac0c7850 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac152df0 con 0x7f12ac0b2830 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12b1b72640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c6550 con 0x7f1298003980 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12abfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 0x7f12ac0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12abfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 0x7f12ac0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46336/0 (socket says 172.21.15.40:46336) 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12abfff640 1 -- 172.21.15.40:0/3523655888 learned_addr learned my addr 172.21.15.40:0/3523655888 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298003980 0x7f12ac1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.321+0000 7f12a3fff640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12ac0b2830 0x7f12ac0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12abfff640 1 -- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298003980 msgr2=0x7f12ac1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12abfff640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298003980 0x7f12ac1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12abfff640 1 -- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12ac0b2830 msgr2=0x7f12ac0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12abfff640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12ac0b2830 0x7f12ac0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12abfff640 1 -- 172.21.15.40:0/3523655888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0c6830 con 0x7f12ac0c7850 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12abfff640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 0x7f12ac0ac8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0c5ae0 tx=0x7f12a400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003b80 con 0x7f12ac0c7850 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4003ce0 con 0x7f12ac0c7850 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40052b0 con 0x7f12ac0c7850 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac0c6b10 con 0x7f12ac0c7850 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac1531b0 con 0x7f12ac0c7850 2023-11-04T01:39:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac0744a0 con 0x7f12ac0c7850 2023-11-04T01:39:55.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12a4005410 con 0x7f12ac0c7850 2023-11-04T01:39:55.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12a8ff9640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f128c0664d0 0x7f128c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:55.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f12a4083450 con 0x7f12ac0c7850 2023-11-04T01:39:55.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f128c0664d0 0x7f128c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:55.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.325+0000 7f12ab7fe640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f128c0664d0 0x7f128c068990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f129c0af000 tx=0x7f129c0b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:55.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.329+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12a4050c30 con 0x7f12ac0c7850 2023-11-04T01:39:55.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:55.485+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f12ac0c6fc0 con 0x7f12ac0c7850 2023-11-04T01:39:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.049+0000 7f12a8ff9640 1 -- 172.21.15.40:0/3523655888 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f12a4018020 con 0x7f12ac0c7850 2023-11-04T01:39:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f128c0664d0 msgr2=0x7f128c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f128c0664d0 0x7f128c068990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f129c0af000 tx=0x7f129c0b2040 comp rx=0 tx=0).stop 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 msgr2=0x7f12ac0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 0x7f12ac0ac8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0c5ae0 tx=0x7f12a400dc00 comp rx=0 tx=0).stop 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 shutdown_connections 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f128c0664d0 0x7f128c068990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12ac0c7850 0x7f12ac0ac8c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12ac0b2830 0x7f12ac0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 --2- 172.21.15.40:0/3523655888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1298003980 0x7f12ac1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 >> 172.21.15.40:0/3523655888 conn(0x7f12ac0b0630 msgr2=0x7f12ac0c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 shutdown_connections 2023-11-04T01:39:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.053+0000 7f12b1b72640 1 -- 172.21.15.40:0/3523655888 wait complete. 2023-11-04T01:39:56.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:39:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 Processor -- start 2023-11-04T01:39:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 -- start start 2023-11-04T01:39:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4040ccbf0 0x7fb40415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb4040cf030 0x7fb4040b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040cfd50 con 0x7fb404158be0 2023-11-04T01:39:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040b65f0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb40b1d8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cfb40 con 0x7fb4040cf030 2023-11-04T01:39:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb408f74640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb404158be0 0x7fb4040ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33262/0 (socket says 172.21.15.40:33262) 2023-11-04T01:39:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb408f74640 1 -- 172.21.15.40:0/1251040308 learned_addr learned my addr 172.21.15.40:0/1251040308 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb403fff640 1 --2- 172.21.15.40:0/1251040308 >> v2:172.21.15.40:3300/0 conn(0x7fb4040ccbf0 0x7fb40415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb409775640 1 --2- 172.21.15.40:0/1251040308 >> v2:172.21.15.91:3300/0 conn(0x7fb4040cf030 0x7fb4040b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb4037fe640 1 -- 172.21.15.40:0/1251040308 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992471375 0 0) 0x7fb4040cfd50 con 0x7fb404158be0 2023-11-04T01:39:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb4037fe640 1 -- 172.21.15.40:0/1251040308 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f0003530 con 0x7fb404158be0 2023-11-04T01:39:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb403fff640 1 -- 172.21.15.40:0/1251040308 >> v2:172.21.15.91:3300/0 conn(0x7fb4040cf030 msgr2=0x7fb4040b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb403fff640 1 --2- 172.21.15.40:0/1251040308 >> v2:172.21.15.91:3300/0 conn(0x7fb4040cf030 0x7fb4040b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb403fff640 1 -- 172.21.15.40:0/1251040308 >> v1:172.21.15.40:6789/0 conn(0x7fb404158be0 legacy=0x7fb4040ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.217+0000 7fb403fff640 1 -- 172.21.15.40:0/1251040308 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040d0030 con 0x7fb4040ccbf0 2023-11-04T01:39:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb403fff640 1 --2- 172.21.15.40:0/1251040308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb40415beb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4040b6ea0 tx=0x7fb3ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ab3e4e0c655c4f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb4037fe640 1 -- 172.21.15.40:0/1251040308 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0a7070 con 0x7fb4040ccbf0 2023-11-04T01:39:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb4037fe640 1 -- 172.21.15.40:0/1251040308 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec0ab430 con 0x7fb4040ccbf0 2023-11-04T01:39:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb4037fe640 1 -- 172.21.15.40:0/1251040308 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0ab7c0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 -- 172.21.15.40:0/1251040308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 msgr2=0x7fb40415beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/1251040308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb40415beb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb4040b6ea0 tx=0x7fb3ec01c430 comp rx=0 tx=0).stop 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 -- 172.21.15.40:0/1251040308 shutdown_connections 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/1251040308 >> v2:172.21.15.91:3300/0 conn(0x7fb4040cf030 0x7fb4040b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/1251040308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb40415beb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 -- 172.21.15.40:0/1251040308 >> 172.21.15.40:0/1251040308 conn(0x7fb40406f750 msgr2=0x7fb40406fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 -- 172.21.15.40:0/1251040308 shutdown_connections 2023-11-04T01:39:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 -- 172.21.15.40:0/1251040308 wait complete. 2023-11-04T01:39:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 Processor -- start 2023-11-04T01:39:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.221+0000 7fb40b1d8640 1 -- start start 2023-11-04T01:39:56.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb4040c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4040cf030 0x7fb40415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb404158be0 0x7fb40415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040cb530 con 0x7fb4040ccbf0 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040caf70 con 0x7fb4040cf030 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040cb250 con 0x7fb404158be0 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb4040c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb4040c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46350/0 (socket says 172.21.15.40:46350) 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 -- 172.21.15.40:0/3112262978 learned_addr learned my addr 172.21.15.40:0/3112262978 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb409775640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb404158be0 0x7fb40415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb403fff640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4040cf030 0x7fb40415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 -- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb404158be0 msgr2=0x7fb40415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb404158be0 0x7fb40415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 -- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4040cf030 msgr2=0x7fb40415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4040cf030 0x7fb40415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 -- 172.21.15.40:0/3112262978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec009420 con 0x7fb4040ccbf0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb408f74640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb4040c8550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c420 tx=0x7fb3f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4005cf0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4005e50 con 0x7fb4040ccbf0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4041566a0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40072d0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040c8a90 con 0x7fb4040ccbf0 2023-11-04T01:39:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4040675f0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.230 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3f4007430 con 0x7fb4040ccbf0 2023-11-04T01:39:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb4017fa640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb3e40664a0 0x7fb3e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb3f4083120 con 0x7fb4040ccbf0 2023-11-04T01:39:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.225+0000 7fb403fff640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb3e40664a0 0x7fb3e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.229+0000 7fb403fff640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb3e40664a0 0x7fb3e4068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0af000 tx=0x7fb3ec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.233+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb3f40508c0 con 0x7fb4040ccbf0 2023-11-04T01:39:56.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:56.381+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4040cb670 con 0x7fb4040ccbf0 2023-11-04T01:39:57.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.057+0000 7fb4017fa640 1 -- 172.21.15.40:0/3112262978 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3f4053ee0 con 0x7fb4040ccbf0 2023-11-04T01:39:57.058 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-11-04T01:39:57.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb3e40664a0 msgr2=0x7fb3e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb3e40664a0 0x7fb3e4068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0af000 tx=0x7fb3ec0a7000 comp rx=0 tx=0).stop 2023-11-04T01:39:57.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 msgr2=0x7fb4040c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb4040c8550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c420 tx=0x7fb3f400c8e0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 shutdown_connections 2023-11-04T01:39:57.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb3e40664a0 0x7fb3e4068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb404158be0 0x7fb40415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4040cf030 0x7fb40415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 --2- 172.21.15.40:0/3112262978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4040ccbf0 0x7fb4040c8550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 >> 172.21.15.40:0/3112262978 conn(0x7fb40406f750 msgr2=0x7fb40415d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:57.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 shutdown_connections 2023-11-04T01:39:57.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.061+0000 7fb40b1d8640 1 -- 172.21.15.40:0/3112262978 wait complete. 2023-11-04T01:39:57.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:39:57.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904f834640 1 Processor -- start 2023-11-04T01:39:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904f834640 1 -- start start 2023-11-04T01:39:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904f834640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 0x7f904815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904f834640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90480cb130 con 0x7f904815c160 2023-11-04T01:39:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904f834640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904815b680 con 0x7f90480b0c20 2023-11-04T01:39:57.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904f834640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904815bd40 con 0x7f904815acb0 2023-11-04T01:39:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904cdcf640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f904815c160 0x7f90480b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48830/0 (socket says 172.21.15.40:48830) 2023-11-04T01:39:57.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904cdcf640 1 -- 172.21.15.40:0/1424441079 learned_addr learned my addr 172.21.15.40:0/1424441079 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904d5d0640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 0x7f904815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222804447 0 0) 0x7f90480cb130 con 0x7f904815c160 2023-11-04T01:39:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9034003530 con 0x7f904815c160 2023-11-04T01:39:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1135201856 0 0) 0x7f9034003530 con 0x7f904815c160 2023-11-04T01:39:57.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 msgr2=0x7f904815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 0x7f904815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 >> v1:172.21.15.91:6789/0 conn(0x7f90480b0c20 legacy=0x7f90480ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904815b960 con 0x7f904815c160 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f903c001680 con 0x7f904815c160 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 >> v1:172.21.15.40:6789/0 conn(0x7f904815c160 legacy=0x7f90480b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 0x7f90340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9034003f30 0x7f90340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9034004d10 0x7f9034005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904815bd40 con 0x7f9034004d10 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903400ba70 con 0x7f9034003f30 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903400bc30 con 0x7f904815acb0 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9034004d10 0x7f9034005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904cdcf640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9034003f30 0x7f90340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904ddd1640 1 -- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 msgr2=0x7f90340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f904815acb0 0x7f90340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904ddd1640 1 -- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9034003f30 msgr2=0x7f90340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9034003f30 0x7f90340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904ddd1640 1 -- 172.21.15.40:0/1424441079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034003530 con 0x7f9034004d10 2023-11-04T01:39:57.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.233+0000 7f904cdcf640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9034003f30 0x7f90340047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9034004d10 0x7f9034005190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9040001e70 tx=0x7f904001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb806d41cb0bdd22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040003b80 con 0x7f9034004d10 2023-11-04T01:39:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040003ce0 con 0x7f9034004d10 2023-11-04T01:39:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f903bfff640 1 -- 172.21.15.40:0/1424441079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400052c0 con 0x7f9034004d10 2023-11-04T01:39:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- 172.21.15.40:0/1424441079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9034004d10 msgr2=0x7f9034005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 --2- 172.21.15.40:0/1424441079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9034004d10 0x7f9034005190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9040001e70 tx=0x7f904001c760 comp rx=0 tx=0).stop 2023-11-04T01:39:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904ddd1640 1 -- 172.21.15.40:0/1424441079 reap_dead start 2023-11-04T01:39:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- 172.21.15.40:0/1424441079 shutdown_connections 2023-11-04T01:39:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- 172.21.15.40:0/1424441079 >> 172.21.15.40:0/1424441079 conn(0x7f90480cb510 msgr2=0x7f90480cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- 172.21.15.40:0/1424441079 shutdown_connections 2023-11-04T01:39:57.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- 172.21.15.40:0/1424441079 wait complete. 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 Processor -- start 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- start start 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9034004d10 0x7f9048149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480af430 0x7f904815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 0x7f904815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c7cd0 con 0x7f90480af8b0 2023-11-04T01:39:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c7fb0 con 0x7f90480af430 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904f834640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c8290 con 0x7f9034004d10 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904ddd1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 0x7f904815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904ddd1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 0x7f904815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60016/0 (socket says 172.21.15.40:60016) 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904ddd1640 1 -- 172.21.15.40:0/1687640468 learned_addr learned my addr 172.21.15.40:0/1687640468 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904cdcf640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480af430 0x7f904815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.237+0000 7f904d5d0640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9034004d10 0x7f9048149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904ddd1640 1 -- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9034004d10 msgr2=0x7f9048149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9034004d10 0x7f9048149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904ddd1640 1 -- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480af430 msgr2=0x7f904815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480af430 0x7f904815eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904ddd1640 1 -- 172.21.15.40:0/1687640468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480c8570 con 0x7f90480af8b0 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904d5d0640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9034004d10 0x7f9048149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904ddd1640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 0x7f904815f0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f904001cc40 tx=0x7f9034005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040006d60 con 0x7f90480af8b0 2023-11-04T01:39:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040005820 con 0x7f90480af8b0 2023-11-04T01:39:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90480c79d0 con 0x7f90480af8b0 2023-11-04T01:39:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040007230 con 0x7f90480af8b0 2023-11-04T01:39:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904814f570 con 0x7f90480af8b0 2023-11-04T01:39:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90480744a0 con 0x7f90480af8b0 2023-11-04T01:39:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9040007390 con 0x7f90480af8b0 2023-11-04T01:39:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f9039ffb640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f902c0664d0 0x7f902c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f904011db40 con 0x7f90480af8b0 2023-11-04T01:39:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904d5d0640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f902c0664d0 0x7f902c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.241+0000 7f904d5d0640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f902c0664d0 0x7f902c068990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90440047c0 tx=0x7f9044008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.245+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90400eb0b0 con 0x7f90480af8b0 2023-11-04T01:39:57.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:57.437+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f90480ae740 con 0x7f90480af8b0 2023-11-04T01:39:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.096+0000 7f9039ffb640 1 -- 172.21.15.40:0/1687640468 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f90400ee6d0 con 0x7f90480af8b0 2023-11-04T01:39:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f902c0664d0 msgr2=0x7f902c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f902c0664d0 0x7f902c068990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f90440047c0 tx=0x7f9044008040 comp rx=0 tx=0).stop 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 msgr2=0x7f904815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 0x7f904815f0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f904001cc40 tx=0x7f9034005800 comp rx=0 tx=0).stop 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 shutdown_connections 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f902c0664d0 0x7f902c068990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480af8b0 0x7f904815f0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480af430 0x7f904815eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 --2- 172.21.15.40:0/1687640468 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9034004d10 0x7f9048149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 >> 172.21.15.40:0/1687640468 conn(0x7f90480cb510 msgr2=0x7f90480ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 shutdown_connections 2023-11-04T01:39:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.100+0000 7f904f834640 1 -- 172.21.15.40:0/1687640468 wait complete. 2023-11-04T01:39:58.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.244+0000 7ffb6c290640 1 Processor -- start 2023-11-04T01:39:58.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.244+0000 7ffb6c290640 1 -- start start 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb640b0d40 0x7ffb640704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb640ccee0 con 0x7ffb640cdea0 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6415a5d0 con 0x7ffb6415a1f0 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb640ca900 con 0x7ffb640b0d40 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6a82d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb640b0d40 0x7ffb640704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6982b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffb640cdea0 0x7ffb640b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48836/0 (socket says 172.21.15.40:48836) 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6982b640 1 -- 172.21.15.40:0/3329297138 learned_addr learned my addr 172.21.15.40:0/3329297138 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6a82d640 1 -- 172.21.15.40:0/3329297138 >> v1:172.21.15.91:6789/0 conn(0x7ffb6415a1f0 legacy=0x7ffb640cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6a82d640 1 -- 172.21.15.40:0/3329297138 >> v1:172.21.15.40:6789/0 conn(0x7ffb640cdea0 legacy=0x7ffb640b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6a82d640 1 -- 172.21.15.40:0/3329297138 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640cabe0 con 0x7ffb640b0d40 2023-11-04T01:39:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6902a640 1 -- 172.21.15.40:0/3329297138 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531459861 0 0) 0x7ffb640ccee0 con 0x7ffb640cdea0 2023-11-04T01:39:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6a82d640 1 --2- 172.21.15.40:0/3329297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb640704e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009d90 tx=0x7ffb5c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2162a8d92321d63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6902a640 1 -- 172.21.15.40:0/3329297138 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0a58c0 con 0x7ffb640b0d40 2023-11-04T01:39:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6902a640 1 -- 172.21.15.40:0/3329297138 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0a5a20 con 0x7ffb640b0d40 2023-11-04T01:39:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6902a640 1 -- 172.21.15.40:0/3329297138 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0a5db0 con 0x7ffb640b0d40 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- 172.21.15.40:0/3329297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 msgr2=0x7ffb640704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 --2- 172.21.15.40:0/3329297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb640704e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009d90 tx=0x7ffb5c01c910 comp rx=0 tx=0).stop 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- 172.21.15.40:0/3329297138 shutdown_connections 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 --2- 172.21.15.40:0/3329297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb640704e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- 172.21.15.40:0/3329297138 >> 172.21.15.40:0/3329297138 conn(0x7ffb640cebb0 msgr2=0x7ffb640cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- 172.21.15.40:0/3329297138 shutdown_connections 2023-11-04T01:39:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.248+0000 7ffb6c290640 1 -- 172.21.15.40:0/3329297138 wait complete. 2023-11-04T01:39:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 Processor -- start 2023-11-04T01:39:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- start start 2023-11-04T01:39:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb64165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb640cdea0 0x7ffb640c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb6415a1f0 0x7ffb641f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640c6130 con 0x7ffb640b0d40 2023-11-04T01:39:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64162f30 con 0x7ffb640cdea0 2023-11-04T01:39:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64163180 con 0x7ffb6415a1f0 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb64165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb64165920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60036/0 (socket says 172.21.15.40:60036) 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 -- 172.21.15.40:0/708311969 learned_addr learned my addr 172.21.15.40:0/708311969 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6982b640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb640cdea0 0x7ffb640c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a82d640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb6415a1f0 0x7ffb641f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 -- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb6415a1f0 msgr2=0x7ffb641f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb6415a1f0 0x7ffb641f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 -- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb640cdea0 msgr2=0x7ffb640c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb640cdea0 0x7ffb640c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 -- 172.21.15.40:0/708311969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c009a70 con 0x7ffb640b0d40 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6a02c640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb64165920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000b440 tx=0x7ffb6000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60011830 con 0x7ffb640b0d40 2023-11-04T01:39:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60011990 con 0x7ffb640b0d40 2023-11-04T01:39:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb64163460 con 0x7ffb640b0d40 2023-11-04T01:39:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60011d40 con 0x7ffb640b0d40 2023-11-04T01:39:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb641f99a0 con 0x7ffb640b0d40 2023-11-04T01:39:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.252+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb641638c0 con 0x7ffb640b0d40 2023-11-04T01:39:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.256+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb60004020 con 0x7ffb640b0d40 2023-11-04T01:39:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.256+0000 7ffb5affd640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb480664a0 0x7ffb48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.256+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb60083bd0 con 0x7ffb640b0d40 2023-11-04T01:39:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.256+0000 7ffb6982b640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb480664a0 0x7ffb48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.256+0000 7ffb6982b640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb480664a0 0x7ffb48068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb640b31b0 tx=0x7ffb54007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.260+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb641638c0 con 0x7ffb640b0d40 2023-11-04T01:39:58.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.416+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb641638c0 con 0x7ffb640b0d40 2023-11-04T01:39:58.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.416+0000 7ffb5affd640 1 -- 172.21.15.40:0/708311969 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16458 (secure 0 0 0) 0x7ffb641638c0 con 0x7ffb640b0d40 2023-11-04T01:39:58.421 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:58.421 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:57.439661+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:58.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb480664a0 msgr2=0x7ffb48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb480664a0 0x7ffb48068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb640b31b0 tx=0x7ffb54007b80 comp rx=0 tx=0).stop 2023-11-04T01:39:58.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 msgr2=0x7ffb64165920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb64165920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000b440 tx=0x7ffb6000b900 comp rx=0 tx=0).stop 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 shutdown_connections 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb480664a0 0x7ffb48068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb6415a1f0 0x7ffb641f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb640cdea0 0x7ffb640c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 --2- 172.21.15.40:0/708311969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb640b0d40 0x7ffb64165920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 >> 172.21.15.40:0/708311969 conn(0x7ffb640cebb0 msgr2=0x7ffb640b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 shutdown_connections 2023-11-04T01:39:58.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.420+0000 7ffb6c290640 1 -- 172.21.15.40:0/708311969 wait complete. 2023-11-04T01:39:58.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:58.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.560+0000 7fbc24583640 1 Processor -- start 2023-11-04T01:39:58.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc24583640 1 -- start start 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc24583640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc1c0cdea0 0x7fbc1c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc24583640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c0ccee0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc24583640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c15a5d0 con 0x7fbc1c0ca400 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc24583640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c0ca900 con 0x7fbc1c0cdea0 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc2231f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc1c15a1f0 0x7fbc1c0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48838/0 (socket says 172.21.15.40:48838) 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc2231f640 1 -- 172.21.15.40:0/1436948560 learned_addr learned my addr 172.21.15.40:0/1436948560 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc21b1e640 1 --2- 172.21.15.40:0/1436948560 >> v2:172.21.15.40:3300/0 conn(0x7fbc1c0cdea0 0x7fbc1c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc21b1e640 1 -- 172.21.15.40:0/1436948560 >> v1:172.21.15.91:6789/0 conn(0x7fbc1c0ca400 legacy=0x7fbc1c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc21b1e640 1 -- 172.21.15.40:0/1436948560 >> v1:172.21.15.40:6789/0 conn(0x7fbc1c15a1f0 legacy=0x7fbc1c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc21b1e640 1 -- 172.21.15.40:0/1436948560 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c0cabe0 con 0x7fbc1c0cdea0 2023-11-04T01:39:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.564+0000 7fbc21b1e640 1 --2- 172.21.15.40:0/1436948560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c0cdea0 0x7fbc1c0b0630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0097c0 tx=0x7fbc0c01e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4bae24c7ff5f80 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc2131d640 1 -- 172.21.15.40:0/1436948560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0ad650 con 0x7fbc1c0cdea0 2023-11-04T01:39:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc2131d640 1 -- 172.21.15.40:0/1436948560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0ad7b0 con 0x7fbc1c0cdea0 2023-11-04T01:39:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc2131d640 1 -- 172.21.15.40:0/1436948560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0adb40 con 0x7fbc1c0cdea0 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/1436948560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c0cdea0 msgr2=0x7fbc1c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 --2- 172.21.15.40:0/1436948560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c0cdea0 0x7fbc1c0b0630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0097c0 tx=0x7fbc0c01e650 comp rx=0 tx=0).stop 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/1436948560 shutdown_connections 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 --2- 172.21.15.40:0/1436948560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c0cdea0 0x7fbc1c0b0630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/1436948560 >> 172.21.15.40:0/1436948560 conn(0x7fbc1c0cebb0 msgr2=0x7fbc1c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/1436948560 shutdown_connections 2023-11-04T01:39:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/1436948560 wait complete. 2023-11-04T01:39:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 Processor -- start 2023-11-04T01:39:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- start start 2023-11-04T01:39:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc1c0ca400 0x7fbc1c0c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc1c0cdea0 0x7fbc1c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 0x7fbc1c1590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c157d60 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c158040 con 0x7fbc1c0ca400 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c158320 con 0x7fbc1c0cdea0 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 0x7fbc1c1590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 0x7fbc1c1590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60044/0 (socket says 172.21.15.40:60044) 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 -- 172.21.15.40:0/3937668646 learned_addr learned my addr 172.21.15.40:0/3937668646 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc21b1e640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc1c0cdea0 0x7fbc1c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 -- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc1c0cdea0 msgr2=0x7fbc1c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc2231f640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc1c0ca400 0x7fbc1c0c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc1c0cdea0 0x7fbc1c155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 -- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc1c0ca400 msgr2=0x7fbc1c0c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc1c0ca400 0x7fbc1c0c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 -- 172.21.15.40:0/3937668646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c009420 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc22b20640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 0x7fbc1c1590e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c780 tx=0x7fbc1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14004b70 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1400ce90 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c158600 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1400a850 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.568+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c158bc0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.572+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c158db0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.572+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc1400a9b0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.572+0000 7fbc12ffd640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc000664d0 0x7fbc00068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.572+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc140840a0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.572+0000 7fbc2231f640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc000664d0 0x7fbc00068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.572+0000 7fbc2231f640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc000664d0 0x7fbc00068990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005890 tx=0x7fbc18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.576+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc14051480 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.736+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc1c0744a0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.736+0000 7fbc12ffd640 1 -- 172.21.15.40:0/3937668646 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16458 (secure 0 0 0) 0x7fbc14054aa0 con 0x7fbc1c15a1f0 2023-11-04T01:39:58.740 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:39:58.740 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:57.439661+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc000664d0 msgr2=0x7fbc00068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc000664d0 0x7fbc00068990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbc18005890 tx=0x7fbc18009040 comp rx=0 tx=0).stop 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 msgr2=0x7fbc1c1590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 0x7fbc1c1590e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c780 tx=0x7fbc1400cc40 comp rx=0 tx=0).stop 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 shutdown_connections 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc000664d0 0x7fbc00068990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc1c15a1f0 0x7fbc1c1590e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc1c0cdea0 0x7fbc1c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 --2- 172.21.15.40:0/3937668646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc1c0ca400 0x7fbc1c0c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 >> 172.21.15.40:0/3937668646 conn(0x7fbc1c0cebb0 msgr2=0x7fbc1c15c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 shutdown_connections 2023-11-04T01:39:58.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.740+0000 7fbc24583640 1 -- 172.21.15.40:0/3937668646 wait complete. 2023-11-04T01:39:58.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:39:58.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb83658640 1 Processor -- start 2023-11-04T01:39:58.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb83658640 1 -- start start 2023-11-04T01:39:58.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb83658640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb7c0b32f0 0x7feb7c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb83658640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0cd830 con 0x7feb7c15af50 2023-11-04T01:39:58.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb83658640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0cdad0 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb83658640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c0b3780 con 0x7feb7c0b32f0 2023-11-04T01:39:58.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb80bf3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb7c0b32f0 0x7feb7c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.876+0000 7feb813f4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feb7c15af50 0x7feb7c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48840/0 (socket says 172.21.15.40:48840) 2023-11-04T01:39:58.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb813f4640 1 -- 172.21.15.40:0/3411143777 learned_addr learned my addr 172.21.15.40:0/3411143777 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:39:58.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb80bf3640 1 -- 172.21.15.40:0/3411143777 >> v1:172.21.15.91:6789/0 conn(0x7feb7c0cf4c0 legacy=0x7feb7c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb80bf3640 1 -- 172.21.15.40:0/3411143777 >> v1:172.21.15.40:6789/0 conn(0x7feb7c15af50 legacy=0x7feb7c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb80bf3640 1 -- 172.21.15.40:0/3411143777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0cddb0 con 0x7feb7c0b32f0 2023-11-04T01:39:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb80bf3640 1 --2- 172.21.15.40:0/3411143777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0b32f0 0x7feb7c0cb330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0097c0 tx=0x7feb6c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3472c487e68991 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb73fff640 1 -- 172.21.15.40:0/3411143777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0ab610 con 0x7feb7c0b32f0 2023-11-04T01:39:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb73fff640 1 -- 172.21.15.40:0/3411143777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c0ab770 con 0x7feb7c0b32f0 2023-11-04T01:39:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb73fff640 1 -- 172.21.15.40:0/3411143777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0abb00 con 0x7feb7c0b32f0 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 -- 172.21.15.40:0/3411143777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0b32f0 msgr2=0x7feb7c0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 --2- 172.21.15.40:0/3411143777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0b32f0 0x7feb7c0cb330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0097c0 tx=0x7feb6c01c3f0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 -- 172.21.15.40:0/3411143777 shutdown_connections 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 --2- 172.21.15.40:0/3411143777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0b32f0 0x7feb7c0cb330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 -- 172.21.15.40:0/3411143777 >> 172.21.15.40:0/3411143777 conn(0x7feb7c065dc0 msgr2=0x7feb7c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 -- 172.21.15.40:0/3411143777 shutdown_connections 2023-11-04T01:39:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.880+0000 7feb83658640 1 -- 172.21.15.40:0/3411143777 wait complete. 2023-11-04T01:39:58.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 Processor -- start 2023-11-04T01:39:58.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 -- start start 2023-11-04T01:39:58.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 0x7feb7c0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb7c15af50 0x7feb7c156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb7c0c83f0 0x7feb7c1f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1f6be0 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0ca450 con 0x7feb7c0c83f0 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0ca730 con 0x7feb7c15af50 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 0x7feb7c0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 0x7feb7c0c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60060/0 (socket says 172.21.15.40:60060) 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 -- 172.21.15.40:0/1302242058 learned_addr learned my addr 172.21.15.40:0/1302242058 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb80bf3640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb7c15af50 0x7feb7c156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb81bf5640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb7c0c83f0 0x7feb7c1f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 -- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb7c15af50 msgr2=0x7feb7c156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb7c15af50 0x7feb7c156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 -- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb7c0c83f0 msgr2=0x7feb7c1f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb7c0c83f0 0x7feb7c1f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 -- 172.21.15.40:0/1302242058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c009420 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb81bf5640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb7c0c83f0 0x7feb7c1f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb813f4640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 0x7feb7c0c9de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb78007fd0 tx=0x7feb7800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780074e0 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb78007640 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c0caa10 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780059b0 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.884+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c14a6e0 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.888+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c0cac50 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.888+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb78005b10 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.888+0000 7feb71ffb640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb600664d0 0x7feb60068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.888+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb78083230 con 0x7feb7c0cf4c0 2023-11-04T01:39:58.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.888+0000 7feb80bf3640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb600664d0 0x7feb60068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.888+0000 7feb80bf3640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb600664d0 0x7feb60068990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0af000 tx=0x7feb6c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:58.892+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb780507f0 con 0x7feb7c0cf4c0 2023-11-04T01:39:59.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.084+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feb7c1f7070 con 0x7feb7c0cf4c0 2023-11-04T01:39:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.100+0000 7feb71ffb640 1 -- 172.21.15.40:0/1302242058 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7feb7c1f7070 con 0x7feb7c0cf4c0 2023-11-04T01:39:59.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb600664d0 msgr2=0x7feb60068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb600664d0 0x7feb60068990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0af000 tx=0x7feb6c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 msgr2=0x7feb7c0c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 0x7feb7c0c9de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb78007fd0 tx=0x7feb7800c890 comp rx=0 tx=0).stop 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 shutdown_connections 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb600664d0 0x7feb60068990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb7c0c83f0 0x7feb7c1f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb7c15af50 0x7feb7c156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 --2- 172.21.15.40:0/1302242058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb7c0cf4c0 0x7feb7c0c9de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 >> 172.21.15.40:0/1302242058 conn(0x7feb7c065dc0 msgr2=0x7feb7c166340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 shutdown_connections 2023-11-04T01:39:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.104+0000 7feb83658640 1 -- 172.21.15.40:0/1302242058 wait complete. 2023-11-04T01:39:59.124 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:39:59.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:39:59.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 Processor -- start 2023-11-04T01:39:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 -- start start 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fa015d0b0 0x7f6fa0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa00cff20 0x7f6fa00d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa00b5e00 con 0x7f6fa01610f0 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00d1520 con 0x7f6fa015d0b0 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa6999640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa015d490 con 0x7f6fa00cff20 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fa015d0b0 0x7f6fa0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fa015d0b0 0x7f6fa0160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60068/0 (socket says 172.21.15.40:60068) 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 -- 172.21.15.40:0/2010365492 learned_addr learned my addr 172.21.15.40:0/2010365492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6fa4f36640 1 --2- 172.21.15.40:0/2010365492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa00cff20 0x7f6fa00d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 -- 172.21.15.40:0/2010365492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa00cff20 msgr2=0x7f6fa00d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 --2- 172.21.15.40:0/2010365492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa00cff20 0x7f6fa00d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 -- 172.21.15.40:0/2010365492 >> v1:172.21.15.40:6789/0 conn(0x7f6fa01610f0 legacy=0x7f6fa00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.248+0000 7f6f9ffff640 1 -- 172.21.15.40:0/2010365492 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00b8930 con 0x7f6fa015d0b0 2023-11-04T01:39:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9ffff640 1 --2- 172.21.15.40:0/2010365492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa0160bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009e50 tx=0x7f6f9801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b72be0e26ab0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9effd640 1 -- 172.21.15.40:0/2010365492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980a57f0 con 0x7f6fa015d0b0 2023-11-04T01:39:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9effd640 1 -- 172.21.15.40:0/2010365492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f980a5950 con 0x7f6fa015d0b0 2023-11-04T01:39:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9effd640 1 -- 172.21.15.40:0/2010365492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980a5ce0 con 0x7f6fa015d0b0 2023-11-04T01:39:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- 172.21.15.40:0/2010365492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 msgr2=0x7f6fa0160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 --2- 172.21.15.40:0/2010365492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa0160bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009e50 tx=0x7f6f9801ca10 comp rx=0 tx=0).stop 2023-11-04T01:39:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- 172.21.15.40:0/2010365492 shutdown_connections 2023-11-04T01:39:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 --2- 172.21.15.40:0/2010365492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa00cff20 0x7f6fa00d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 --2- 172.21.15.40:0/2010365492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa0160bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- 172.21.15.40:0/2010365492 >> 172.21.15.40:0/2010365492 conn(0x7f6fa006a890 msgr2=0x7f6fa006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- 172.21.15.40:0/2010365492 shutdown_connections 2023-11-04T01:39:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- 172.21.15.40:0/2010365492 wait complete. 2023-11-04T01:39:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 Processor -- start 2023-11-04T01:39:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- start start 2023-11-04T01:39:59.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6fa00cff20 0x7f6fa0156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa01583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa01610f0 0x7f6fa0157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0158930 con 0x7f6fa015d0b0 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01575d0 con 0x7f6fa00cff20 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa6999640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0157870 con 0x7f6fa01610f0 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa01583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa01583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60072/0 (socket says 172.21.15.40:60072) 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 -- 172.21.15.40:0/1672470061 learned_addr learned my addr 172.21.15.40:0/1672470061 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6fa4f36640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa01610f0 0x7f6fa0157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9ffff640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6fa00cff20 0x7f6fa0156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 -- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa01610f0 msgr2=0x7f6fa0157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa01610f0 0x7f6fa0157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 -- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6fa00cff20 msgr2=0x7f6fa0156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6fa00cff20 0x7f6fa0156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 -- 172.21.15.40:0/1672470061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009b30 con 0x7f6fa015d0b0 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.252+0000 7f6f9f7fe640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa01583f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c3c0 tx=0x7f6f8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880052d0 con 0x7f6fa015d0b0 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88005430 con 0x7f6fa015d0b0 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa0157b50 con 0x7f6fa015d0b0 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88003840 con 0x7f6fa015d0b0 2023-11-04T01:39:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa0158110 con 0x7f6fa015d0b0 2023-11-04T01:39:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa00744a0 con 0x7f6fa015d0b0 2023-11-04T01:39:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f880039a0 con 0x7f6fa015d0b0 2023-11-04T01:39:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9cff9640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f800664a0 0x7f6f80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f88083260 con 0x7f6fa015d0b0 2023-11-04T01:39:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9ffff640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f800664a0 0x7f6f80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.256+0000 7f6f9ffff640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f800664a0 0x7f6f80068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f980ae000 tx=0x7f6f980a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.260+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6f88050820 con 0x7f6fa015d0b0 2023-11-04T01:39:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:39:59.452+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6fa00d0a10 con 0x7f6fa015d0b0 2023-11-04T01:40:00.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.120+0000 7f6f9cff9640 1 -- 172.21.15.40:0/1672470061 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f88053e40 con 0x7f6fa015d0b0 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f800664a0 msgr2=0x7f6f80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f800664a0 0x7f6f80068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f980ae000 tx=0x7f6f980a7070 comp rx=0 tx=0).stop 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 msgr2=0x7f6fa01583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa01583f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c3c0 tx=0x7f6f8800c880 comp rx=0 tx=0).stop 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 shutdown_connections 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f800664a0 0x7f6f80068960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6fa01610f0 0x7f6fa0157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fa015d0b0 0x7f6fa01583f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 --2- 172.21.15.40:0/1672470061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6fa00cff20 0x7f6fa0156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 >> 172.21.15.40:0/1672470061 conn(0x7f6fa006a890 msgr2=0x7f6fa00cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 shutdown_connections 2023-11-04T01:40:00.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.124+0000 7f6fa6999640 1 -- 172.21.15.40:0/1672470061 wait complete. 2023-11-04T01:40:00.148 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:40:00.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 Processor -- start 2023-11-04T01:40:00.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 -- start start 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b7815afb0 0x7f2b780b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b780cb400 0x7f2b780cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b780cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7815b390 con 0x7f2b780cb400 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b780ce040 con 0x7f2b7815afb0 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b805a7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780d0a60 con 0x7f2b780cd6d0 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b780cb400 0x7f2b780cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b780cb400 0x7f2b780cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60074/0 (socket says 172.21.15.40:60074) 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 -- 172.21.15.40:0/565983729 learned_addr learned my addr 172.21.15.40:0/565983729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7eb44640 1 --2- 172.21.15.40:0/565983729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b780cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7e343640 1 --2- 172.21.15.40:0/565983729 >> v2:172.21.15.91:3300/0 conn(0x7f2b7815afb0 0x7f2b780b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 -- 172.21.15.40:0/565983729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 msgr2=0x7f2b780cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 --2- 172.21.15.40:0/565983729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b780cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 -- 172.21.15.40:0/565983729 >> v2:172.21.15.91:3300/0 conn(0x7f2b7815afb0 msgr2=0x7f2b780b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 --2- 172.21.15.40:0/565983729 >> v2:172.21.15.91:3300/0 conn(0x7f2b7815afb0 0x7f2b780b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7db42640 1 -- 172.21.15.40:0/565983729 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780d04a0 con 0x7f2b780cb400 2023-11-04T01:40:00.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.272+0000 7f2b7e343640 1 --2- 172.21.15.40:0/565983729 >> v2:172.21.15.91:3300/0 conn(0x7f2b7815afb0 0x7f2b780b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b7db42640 1 --2- 172.21.15.40:0/565983729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b780cf190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b78066da0 tx=0x7f2b6801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92b3ccea6a04bf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b7d341640 1 -- 172.21.15.40:0/565983729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680ab600 con 0x7f2b780cb400 2023-11-04T01:40:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b7d341640 1 -- 172.21.15.40:0/565983729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b680ab760 con 0x7f2b780cb400 2023-11-04T01:40:00.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b7d341640 1 -- 172.21.15.40:0/565983729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680abaf0 con 0x7f2b780cb400 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- 172.21.15.40:0/565983729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 msgr2=0x7f2b780cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- 172.21.15.40:0/565983729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b780cf190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b78066da0 tx=0x7f2b6801c440 comp rx=0 tx=0).stop 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- 172.21.15.40:0/565983729 shutdown_connections 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- 172.21.15.40:0/565983729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b780cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- 172.21.15.40:0/565983729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b780cf190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- 172.21.15.40:0/565983729 >> v2:172.21.15.91:3300/0 conn(0x7f2b7815afb0 0x7f2b780b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- 172.21.15.40:0/565983729 >> 172.21.15.40:0/565983729 conn(0x7f2b78065dc0 msgr2=0x7f2b780661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- 172.21.15.40:0/565983729 shutdown_connections 2023-11-04T01:40:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- 172.21.15.40:0/565983729 wait complete. 2023-11-04T01:40:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 Processor -- start 2023-11-04T01:40:00.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- start start 2023-11-04T01:40:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b78156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b78153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b7815afb0 0x7f2b78154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780b23e0 con 0x7f2b780cb400 2023-11-04T01:40:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780cb0e0 con 0x7f2b7815afb0 2023-11-04T01:40:00.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.276+0000 7f2b805a7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b780b1ab0 con 0x7f2b780cd6d0 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b78156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b78156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60082/0 (socket says 172.21.15.40:60082) 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 -- 172.21.15.40:0/2427010351 learned_addr learned my addr 172.21.15.40:0/2427010351 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7db42640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b78153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7eb44640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b7815afb0 0x7f2b78154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 -- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 msgr2=0x7f2b78153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b78153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 -- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b7815afb0 msgr2=0x7f2b78154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b7815afb0 0x7f2b78154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 -- 172.21.15.40:0/2427010351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b680094d0 con 0x7f2b780cb400 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7db42640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b78153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:00.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7e343640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b78156e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c7f0 tx=0x7f2b7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74007820 con 0x7f2b780cb400 2023-11-04T01:40:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74007980 con 0x7f2b780cb400 2023-11-04T01:40:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b780b1d90 con 0x7f2b780cb400 2023-11-04T01:40:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74007d30 con 0x7f2b780cb400 2023-11-04T01:40:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b780cad90 con 0x7f2b780cb400 2023-11-04T01:40:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b780675f0 con 0x7f2b780cb400 2023-11-04T01:40:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b740113f0 con 0x7f2b780cb400 2023-11-04T01:40:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b6effd640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b5c0664a0 0x7f2b5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b740841a0 con 0x7f2b780cb400 2023-11-04T01:40:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.280+0000 7f2b7db42640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b5c0664a0 0x7f2b5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.284+0000 7f2b7db42640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b5c0664a0 0x7f2b5c068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b680af000 tx=0x7f2b680a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.284+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b74051620 con 0x7f2b780cb400 2023-11-04T01:40:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.476+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b7815a7c0 con 0x7f2b780cb400 2023-11-04T01:40:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b6effd640 1 -- 172.21.15.40:0/2427010351 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f2b7405b030 con 0x7f2b780cb400 2023-11-04T01:40:00.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:00.482 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:00.482 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b5c0664a0 msgr2=0x7f2b5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b5c0664a0 0x7f2b5c068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b680af000 tx=0x7f2b680a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 msgr2=0x7f2b78156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b78156e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c7f0 tx=0x7f2b7400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 shutdown_connections 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b5c0664a0 0x7f2b5c068960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b7815afb0 0x7f2b78154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b780cd6d0 0x7f2b78153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 --2- 172.21.15.40:0/2427010351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b780cb400 0x7f2b78156e30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 >> 172.21.15.40:0/2427010351 conn(0x7f2b78065dc0 msgr2=0x7f2b780661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 shutdown_connections 2023-11-04T01:40:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.480+0000 7f2b805a7640 1 -- 172.21.15.40:0/2427010351 wait complete. 2023-11-04T01:40:00.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:00.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 Processor -- start 2023-11-04T01:40:00.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 -- start start 2023-11-04T01:40:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd9d815b090 0x7fd9d815f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9d815b470 0x7fd9d806a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80cbe40 con 0x7fd9d8065fd0 2023-11-04T01:40:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d815fca0 con 0x7fd9d815b470 2023-11-04T01:40:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9def5d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80cc120 con 0x7fd9d815b090 2023-11-04T01:40:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9d7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9d815b470 0x7fd9d806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9dd4fa640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9d8065fd0 0x7fd9d80cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48852/0 (socket says 172.21.15.40:48852) 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9dd4fa640 1 -- 172.21.15.40:0/3582264416 learned_addr learned my addr 172.21.15.40:0/3582264416 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9dccf9640 1 --2- 172.21.15.40:0/3582264416 >> v2:172.21.15.91:3300/0 conn(0x7fd9d815b090 0x7fd9d815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9d7fff640 1 -- 172.21.15.40:0/3582264416 >> v2:172.21.15.91:3300/0 conn(0x7fd9d815b090 msgr2=0x7fd9d815f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9d7fff640 1 --2- 172.21.15.40:0/3582264416 >> v2:172.21.15.91:3300/0 conn(0x7fd9d815b090 0x7fd9d815f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9d7fff640 1 -- 172.21.15.40:0/3582264416 >> v1:172.21.15.40:6789/0 conn(0x7fd9d8065fd0 legacy=0x7fd9d80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9d7fff640 1 -- 172.21.15.40:0/3582264416 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80cc400 con 0x7fd9d815b470 2023-11-04T01:40:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.624+0000 7fd9dccf9640 1 --2- 172.21.15.40:0/3582264416 >> v2:172.21.15.91:3300/0 conn(0x7fd9d815b090 0x7fd9d815f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9d7fff640 1 --2- 172.21.15.40:0/3582264416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d806a160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8072760 tx=0x7fd9cc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3440d8b1c9a2725a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9d77fe640 1 -- 172.21.15.40:0/3582264416 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ab600 con 0x7fd9d815b470 2023-11-04T01:40:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9d77fe640 1 -- 172.21.15.40:0/3582264416 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a7050 con 0x7fd9d815b470 2023-11-04T01:40:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9d77fe640 1 -- 172.21.15.40:0/3582264416 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ab980 con 0x7fd9d815b470 2023-11-04T01:40:00.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 -- 172.21.15.40:0/3582264416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 msgr2=0x7fd9d806a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 --2- 172.21.15.40:0/3582264416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d806a160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8072760 tx=0x7fd9cc01c3a0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 -- 172.21.15.40:0/3582264416 shutdown_connections 2023-11-04T01:40:00.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 --2- 172.21.15.40:0/3582264416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d806a160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 --2- 172.21.15.40:0/3582264416 >> v2:172.21.15.91:3300/0 conn(0x7fd9d815b090 0x7fd9d815f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 -- 172.21.15.40:0/3582264416 >> 172.21.15.40:0/3582264416 conn(0x7fd9d80716a0 msgr2=0x7fd9d8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 -- 172.21.15.40:0/3582264416 shutdown_connections 2023-11-04T01:40:00.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 -- 172.21.15.40:0/3582264416 wait complete. 2023-11-04T01:40:00.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 Processor -- start 2023-11-04T01:40:00.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 -- start start 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9d8065fd0 0x7fd9d809cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.628+0000 7fd9def5d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9d815b090 0x7fd9d80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80b1960 con 0x7fd9d815b470 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80b0670 con 0x7fd9d8065fd0 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80b08c0 con 0x7fd9d815b090 2023-11-04T01:40:00.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d80ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60102/0 (socket says 172.21.15.40:60102) 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 -- 172.21.15.40:0/2574899203 learned_addr learned my addr 172.21.15.40:0/2574899203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dccf9640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9d8065fd0 0x7fd9d809cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d7fff640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9d815b090 0x7fd9d80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 -- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9d815b090 msgr2=0x7fd9d80b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9d815b090 0x7fd9d80b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 -- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9d8065fd0 msgr2=0x7fd9d809cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9d8065fd0 0x7fd9d809cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 -- 172.21.15.40:0/2574899203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009420 con 0x7fd9d815b470 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dd4fa640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d80ca490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000c3c0 tx=0x7fd9d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0005cf0 con 0x7fd9d815b470 2023-11-04T01:40:00.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d0005e50 con 0x7fd9d815b470 2023-11-04T01:40:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d80b0ba0 con 0x7fd9d815b470 2023-11-04T01:40:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00072f0 con 0x7fd9d815b470 2023-11-04T01:40:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d80b1160 con 0x7fd9d815b470 2023-11-04T01:40:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d80675f0 con 0x7fd9d815b470 2023-11-04T01:40:00.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9d0007450 con 0x7fd9d815b470 2023-11-04T01:40:00.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d57fa640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9c40664a0 0x7fd9c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9d0083330 con 0x7fd9d815b470 2023-11-04T01:40:00.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.632+0000 7fd9dccf9640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9c40664a0 0x7fd9c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.636+0000 7fd9dccf9640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9c40664a0 0x7fd9c4068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9d81f74f0 tx=0x7fd9c8003a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.636+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9d0050840 con 0x7fd9d815b470 2023-11-04T01:40:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.792+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d8072400 con 0x7fd9d815b470 2023-11-04T01:40:00.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.796+0000 7fd9d57fa640 1 -- 172.21.15.40:0/2574899203 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fd9d0053e60 con 0x7fd9d815b470 2023-11-04T01:40:00.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:00.799 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9c40664a0 msgr2=0x7fd9c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9c40664a0 0x7fd9c4068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9d81f74f0 tx=0x7fd9c8003a20 comp rx=0 tx=0).stop 2023-11-04T01:40:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 msgr2=0x7fd9d80ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d80ca490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000c3c0 tx=0x7fd9d000c880 comp rx=0 tx=0).stop 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 shutdown_connections 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9c40664a0 0x7fd9c4068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9d815b470 0x7fd9d80ca490 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9d815b090 0x7fd9d80b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 --2- 172.21.15.40:0/2574899203 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9d8065fd0 0x7fd9d809cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 >> 172.21.15.40:0/2574899203 conn(0x7fd9d80716a0 msgr2=0x7fd9d806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 shutdown_connections 2023-11-04T01:40:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.800+0000 7fd9def5d640 1 -- 172.21.15.40:0/2574899203 wait complete. 2023-11-04T01:40:00.818 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:40:00.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05f19d640 1 Processor -- start 2023-11-04T01:40:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05f19d640 1 -- start start 2023-11-04T01:40:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05f19d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 0x7ff05806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05f19d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05806c740 con 0x7ff0580b0d40 2023-11-04T01:40:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05f19d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05815b670 con 0x7ff0580c2670 2023-11-04T01:40:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05f19d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05806bb30 con 0x7ff05815b290 2023-11-04T01:40:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05d73a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff0580b0d40 0x7ff05815eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48854/0 (socket says 172.21.15.40:48854) 2023-11-04T01:40:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05d73a640 1 -- 172.21.15.40:0/3908377347 learned_addr learned my addr 172.21.15.40:0/3908377347 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05cf39640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 0x7ff05806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286404013 0 0) 0x7ff05806c740 con 0x7ff0580b0d40 2023-11-04T01:40:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff044003530 con 0x7ff0580b0d40 2023-11-04T01:40:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738549013 0 0) 0x7ff05815b670 con 0x7ff0580c2670 2023-11-04T01:40:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff05806c740 con 0x7ff0580c2670 2023-11-04T01:40:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2370623467 0 0) 0x7ff044003530 con 0x7ff0580b0d40 2023-11-04T01:40:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 msgr2=0x7ff05806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 0x7ff05806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 >> v1:172.21.15.91:6789/0 conn(0x7ff0580c2670 legacy=0x7ff0580b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05806be10 con 0x7ff0580b0d40 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff050001600 con 0x7ff0580b0d40 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 >> v1:172.21.15.40:6789/0 conn(0x7ff0580b0d40 legacy=0x7ff05815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 0x7ff044003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff044004d10 0x7ff044005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05806bb30 con 0x7ff0440040f0 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04400bb50 con 0x7ff044004d10 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04400bd10 con 0x7ff05815b290 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff057fff640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05cf39640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 0x7ff044003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff05d73a640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff044004d10 0x7ff044005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff057fff640 1 -- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 msgr2=0x7ff044003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff057fff640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff05815b290 0x7ff044003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff057fff640 1 -- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff044004d10 msgr2=0x7ff044005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff057fff640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff044004d10 0x7ff044005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.932+0000 7ff057fff640 1 -- 172.21.15.40:0/3908377347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044003530 con 0x7ff0440040f0 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff057fff640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0440047d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff0580c2a90 tx=0x7ff04001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5955111dda5aaee7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400052d0 con 0x7ff0440040f0 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0400a7050 con 0x7ff0440040f0 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff0577fe640 1 -- 172.21.15.40:0/3908377347 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040003600 con 0x7ff0440040f0 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 -- 172.21.15.40:0/3908377347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 msgr2=0x7ff0440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 --2- 172.21.15.40:0/3908377347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0440047d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff0580c2a90 tx=0x7ff04001c510 comp rx=0 tx=0).stop 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05d73a640 1 -- 172.21.15.40:0/3908377347 reap_dead start 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 -- 172.21.15.40:0/3908377347 shutdown_connections 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 -- 172.21.15.40:0/3908377347 >> 172.21.15.40:0/3908377347 conn(0x7ff0580cebb0 msgr2=0x7ff0580cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 -- 172.21.15.40:0/3908377347 shutdown_connections 2023-11-04T01:40:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 -- 172.21.15.40:0/3908377347 wait complete. 2023-11-04T01:40:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 Processor -- start 2023-11-04T01:40:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.936+0000 7ff05f19d640 1 -- start start 2023-11-04T01:40:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0581f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0580ce080 0x7ff0581f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff0581f5c10 0x7ff0580cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581547c0 con 0x7ff0440040f0 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580c4800 con 0x7ff0580ce080 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580cd510 con 0x7ff0581f5c10 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0581f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0581f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60106/0 (socket says 172.21.15.40:60106) 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 -- 172.21.15.40:0/2160523706 learned_addr learned my addr 172.21.15.40:0/2160523706 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05d73a640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff0581f5c10 0x7ff0580cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff057fff640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0580ce080 0x7ff0581f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 -- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff0581f5c10 msgr2=0x7ff0580cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff0581f5c10 0x7ff0580cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 -- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0580ce080 msgr2=0x7ff0581f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0580ce080 0x7ff0581f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 -- 172.21.15.40:0/2160523706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff058153f20 con 0x7ff0440040f0 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05d73a640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff0581f5c10 0x7ff0580cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff057fff640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0580ce080 0x7ff0581f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05cf39640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0581f6a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff048007f30 tx=0x7ff048011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800e030 con 0x7ff0440040f0 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048016470 con 0x7ff0440040f0 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058154200 con 0x7ff0440040f0 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048016820 con 0x7ff0440040f0 2023-11-04T01:40:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0580c4a30 con 0x7ff0440040f0 2023-11-04T01:40:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0580744a0 con 0x7ff0440040f0 2023-11-04T01:40:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff048016980 con 0x7ff0440040f0 2023-11-04T01:40:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff0557fa640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0380664a0 0x7ff038068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff04800f070 con 0x7ff0440040f0 2023-11-04T01:40:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.940+0000 7ff057fff640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0380664a0 0x7ff038068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.944+0000 7ff057fff640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0380664a0 0x7ff038068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0400ac000 tx=0x7ff0400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:00.944+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0480521f0 con 0x7ff0440040f0 2023-11-04T01:40:01.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.100+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0580718f0 con 0x7ff0380664a0 2023-11-04T01:40:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.120+0000 7ff0557fa640 1 -- 172.21.15.40:0/2160523706 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249724 (secure 0 0 0) 0x7ff040005310 con 0x7ff0380664a0 2023-11-04T01:40:01.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:01.126 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0380664a0 msgr2=0x7ff038068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0380664a0 0x7ff038068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff0400ac000 tx=0x7ff0400a6000 comp rx=0 tx=0).stop 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 msgr2=0x7ff0581f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0581f6a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff048007f30 tx=0x7ff048011660 comp rx=0 tx=0).stop 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 shutdown_connections 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0380664a0 0x7ff038068960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff0581f5c10 0x7ff0580cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff0580ce080 0x7ff0581f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 --2- 172.21.15.40:0/2160523706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0440040f0 0x7ff0581f6a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 >> 172.21.15.40:0/2160523706 conn(0x7ff0580cebb0 msgr2=0x7ff0580b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 shutdown_connections 2023-11-04T01:40:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.124+0000 7ff05f19d640 1 -- 172.21.15.40:0/2160523706 wait complete. 2023-11-04T01:40:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-04T01:39:59.747859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219124,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001238"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T01:39:49.965304+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:49.965304+0000","last_peered":"2023-11-04T01:39:49.965304+0000","last_clean":"2023-11-04T01:39:49.965304+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:49.965304+0000","last_undegraded":"2023-11-04T01:39:49.965304+0000","last_fullsized":"2023-11-04T01:39:49.965304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:01.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.304+0000 7f0e5aed7640 1 Processor -- start 2023-11-04T01:40:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.304+0000 7f0e5aed7640 1 -- start start 2023-11-04T01:40:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e5aed7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e540715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e5aed7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e5406f8f0 0x7f0e540b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e5aed7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e540c2670 con 0x7f0e540b0b70 2023-11-04T01:40:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e5aed7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e54070140 con 0x7f0e5406f8f0 2023-11-04T01:40:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e5aed7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5415fc90 con 0x7f0e5415afd0 2023-11-04T01:40:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e5406f8f0 0x7f0e540b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e5406f8f0 0x7f0e540b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60110/0 (socket says 172.21.15.40:60110) 2023-11-04T01:40:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 -- 172.21.15.40:0/321786444 learned_addr learned my addr 172.21.15.40:0/321786444 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e58c73640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e540715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 -- 172.21.15.40:0/321786444 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 msgr2=0x7f0e540715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e540715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 -- 172.21.15.40:0/321786444 >> v1:172.21.15.91:6789/0 conn(0x7f0e540b0b70 legacy=0x7f0e540c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e53fff640 1 -- 172.21.15.40:0/321786444 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5406bc30 con 0x7f0e5406f8f0 2023-11-04T01:40:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.308+0000 7f0e58c73640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e540715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e53fff640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406f8f0 0x7f0e540b0630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009870 tx=0x7f0e4801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55af1fc761e3a4a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e537fe640 1 -- 172.21.15.40:0/321786444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480ab600 con 0x7f0e5406f8f0 2023-11-04T01:40:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e537fe640 1 -- 172.21.15.40:0/321786444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e480a7050 con 0x7f0e5406f8f0 2023-11-04T01:40:01.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e537fe640 1 -- 172.21.15.40:0/321786444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480ab980 con 0x7f0e5406f8f0 2023-11-04T01:40:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 -- 172.21.15.40:0/321786444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406f8f0 msgr2=0x7f0e540b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406f8f0 0x7f0e540b0630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e48009870 tx=0x7f0e4801c540 comp rx=0 tx=0).stop 2023-11-04T01:40:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 -- 172.21.15.40:0/321786444 shutdown_connections 2023-11-04T01:40:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406f8f0 0x7f0e540b0630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/321786444 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e540715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 -- 172.21.15.40:0/321786444 >> 172.21.15.40:0/321786444 conn(0x7f0e540cebb0 msgr2=0x7f0e540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 -- 172.21.15.40:0/321786444 shutdown_connections 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 -- 172.21.15.40:0/321786444 wait complete. 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 Processor -- start 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.312+0000 7f0e5aed7640 1 -- start start 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e5406f8f0 0x7f0e540ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 0x7f0e540cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e54148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540cdab0 con 0x7f0e540b0b70 2023-11-04T01:40:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541597e0 con 0x7f0e5406f8f0 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54159220 con 0x7f0e5415afd0 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 0x7f0e540cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 0x7f0e540cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60126/0 (socket says 172.21.15.40:60126) 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 -- 172.21.15.40:0/1028415579 learned_addr learned my addr 172.21.15.40:0/1028415579 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e58c73640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e5406f8f0 0x7f0e540ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e59474640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e54148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 -- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 msgr2=0x7f0e54148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e54148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 -- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e5406f8f0 msgr2=0x7f0e540ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e5406f8f0 0x7f0e540ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 -- 172.21.15.40:0/1028415579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480094d0 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e58c73640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e5406f8f0 0x7f0e540ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e53fff640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 0x7f0e540cccd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e480ae040 tx=0x7f0e4801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480b6620 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e480abe90 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480b69e0 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e54159500 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e540ce670 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e540cdc60 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e480b2040 con 0x7f0e540b0b70 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e517fa640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e400664d0 0x7f0e40068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e4811e3a0 con 0x7f0e540b0b70 2023-11-04T01:40:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.316+0000 7f0e58c73640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e400664d0 0x7f0e40068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.320+0000 7f0e58c73640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e400664d0 0x7f0e40068990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009b40 tx=0x7f0e44003a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.320+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e480eb990 con 0x7f0e540b0b70 2023-11-04T01:40:01.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.476+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e5406c4d0 con 0x7f0e400664d0 2023-11-04T01:40:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.492+0000 7f0e517fa640 1 -- 172.21.15.40:0/1028415579 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249724 (secure 0 0 0) 0x7f0e440047e0 con 0x7f0e400664d0 2023-11-04T01:40:01.498 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:01.500 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e400664d0 msgr2=0x7f0e40068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e400664d0 0x7f0e40068990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009b40 tx=0x7f0e44003a40 comp rx=0 tx=0).stop 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 msgr2=0x7f0e540cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 0x7f0e540cccd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e480ae040 tx=0x7f0e4801ad80 comp rx=0 tx=0).stop 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 shutdown_connections 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e400664d0 0x7f0e40068990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e5415afd0 0x7f0e54148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e540b0b70 0x7f0e540cccd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 --2- 172.21.15.40:0/1028415579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e5406f8f0 0x7f0e540ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 >> 172.21.15.40:0/1028415579 conn(0x7f0e540cebb0 msgr2=0x7f0e54153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 shutdown_connections 2023-11-04T01:40:01.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.496+0000 7f0e5aed7640 1 -- 172.21.15.40:0/1028415579 wait complete. 2023-11-04T01:40:01.519 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-04T01:39:59.747859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219124,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001238"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T01:39:49.965304+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:49.965304+0000","last_peered":"2023-11-04T01:39:49.965304+0000","last_clean":"2023-11-04T01:39:49.965304+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:49.965304+0000","last_undegraded":"2023-11-04T01:39:49.965304+0000","last_fullsized":"2023-11-04T01:39:49.965304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:57.051939+0000","last_change":"2023-11-04T01:39:57.051939+0000","last_active":"2023-11-04T01:39:57.051939+0000","last_peered":"2023-11-04T01:39:57.051939+0000","last_clean":"2023-11-04T01:39:57.051939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:57.051939+0000","last_undegraded":"2023-11-04T01:39:57.051939+0000","last_fullsized":"2023-11-04T01:39:57.051939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:39:56.042003+0000","last_change":"2023-11-04T01:39:56.042003+0000","last_active":"2023-11-04T01:39:56.042003+0000","last_peered":"2023-11-04T01:39:56.042003+0000","last_clean":"2023-11-04T01:39:56.042003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:39:56.042003+0000","last_undegraded":"2023-11-04T01:39:56.042003+0000","last_fullsized":"2023-11-04T01:39:56.042003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:01.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:01.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.688+0000 7f065a94a640 1 Processor -- start 2023-11-04T01:40:01.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.688+0000 7f065a94a640 1 -- start start 2023-11-04T01:40:01.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f065a94a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f06540b27d0 0x7f06540d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f065a94a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06540cfe40 0x7f065406f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f065a94a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540d02f0 con 0x7f065415b150 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f065a94a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065415f980 con 0x7f06540cfe40 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f065a94a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065415f4f0 con 0x7f06540b27d0 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06540cfe40 0x7f065406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06540cfe40 0x7f065406f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60128/0 (socket says 172.21.15.40:60128) 2023-11-04T01:40:01.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 -- 172.21.15.40:0/2969069822 learned_addr learned my addr 172.21.15.40:0/2969069822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:01.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0653fff640 1 --2- 172.21.15.40:0/2969069822 >> v2:172.21.15.91:3300/0 conn(0x7f06540b27d0 0x7f06540d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 -- 172.21.15.40:0/2969069822 >> v2:172.21.15.91:3300/0 conn(0x7f06540b27d0 msgr2=0x7f06540d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 --2- 172.21.15.40:0/2969069822 >> v2:172.21.15.91:3300/0 conn(0x7f06540b27d0 0x7f06540d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 -- 172.21.15.40:0/2969069822 >> v1:172.21.15.91:6789/0 conn(0x7f065415b150 legacy=0x7f06540b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 -- 172.21.15.40:0/2969069822 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540d0af0 con 0x7f06540cfe40 2023-11-04T01:40:01.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0653fff640 1 --2- 172.21.15.40:0/2969069822 >> v2:172.21.15.91:3300/0 conn(0x7f06540b27d0 0x7f06540d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:01.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0658ee7640 1 --2- 172.21.15.40:0/2969069822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540cfe40 0x7f065406f480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0654066f40 tx=0x7f064c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d84de38862192f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0652ffd640 1 -- 172.21.15.40:0/2969069822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0a56b0 con 0x7f06540cfe40 2023-11-04T01:40:01.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0652ffd640 1 -- 172.21.15.40:0/2969069822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c0a5810 con 0x7f06540cfe40 2023-11-04T01:40:01.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.692+0000 7f0652ffd640 1 -- 172.21.15.40:0/2969069822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0a5ba0 con 0x7f06540cfe40 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/2969069822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540cfe40 msgr2=0x7f065406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 --2- 172.21.15.40:0/2969069822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540cfe40 0x7f065406f480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0654066f40 tx=0x7f064c01c900 comp rx=0 tx=0).stop 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/2969069822 shutdown_connections 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 --2- 172.21.15.40:0/2969069822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540cfe40 0x7f065406f480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 --2- 172.21.15.40:0/2969069822 >> v2:172.21.15.91:3300/0 conn(0x7f06540b27d0 0x7f06540d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/2969069822 >> 172.21.15.40:0/2969069822 conn(0x7f06540cd7d0 msgr2=0x7f06540cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/2969069822 shutdown_connections 2023-11-04T01:40:01.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/2969069822 wait complete. 2023-11-04T01:40:01.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 Processor -- start 2023-11-04T01:40:01.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- start start 2023-11-04T01:40:01.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 0x7f065414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f06540cfe40 0x7f065415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f065415b150 0x7f06540b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065415e360 con 0x7f06540b27d0 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065415d2c0 con 0x7f065415b150 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065415d5a0 con 0x7f06540cfe40 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 0x7f065414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 0x7f065414db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60136/0 (socket says 172.21.15.40:60136) 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 -- 172.21.15.40:0/4066014291 learned_addr learned my addr 172.21.15.40:0/4066014291 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0658ee7640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f065415b150 0x7f06540b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f06537fe640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f06540cfe40 0x7f065415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 -- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f06540cfe40 msgr2=0x7f065415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f06540cfe40 0x7f065415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 -- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f065415b150 msgr2=0x7f06540b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f065415b150 0x7f06540b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 -- 172.21.15.40:0/4066014291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009b30 con 0x7f06540b27d0 2023-11-04T01:40:01.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0658ee7640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f065415b150 0x7f06540b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:01.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0653fff640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 0x7f065414db30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f064400c7f0 tx=0x7f064400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644007820 con 0x7f06540b27d0 2023-11-04T01:40:01.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644007980 con 0x7f06540b27d0 2023-11-04T01:40:01.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065415d880 con 0x7f06540b27d0 2023-11-04T01:40:01.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644007d30 con 0x7f06540b27d0 2023-11-04T01:40:01.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.696+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065415de40 con 0x7f06540b27d0 2023-11-04T01:40:01.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.700+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06540744a0 con 0x7f06540b27d0 2023-11-04T01:40:01.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.700+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06440113f0 con 0x7f06540b27d0 2023-11-04T01:40:01.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.700+0000 7f0650ff9640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06400664a0 0x7f0640068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.700+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0644084160 con 0x7f06540b27d0 2023-11-04T01:40:01.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.700+0000 7f06537fe640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06400664a0 0x7f0640068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.700+0000 7f06537fe640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06400664a0 0x7f0640068960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06541f8d90 tx=0x7f0648009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.704+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0644051670 con 0x7f06540b27d0 2023-11-04T01:40:01.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.856+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f065415d710 con 0x7f06400664a0 2023-11-04T01:40:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.876+0000 7f0650ff9640 1 -- 172.21.15.40:0/4066014291 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264643 (secure 0 0 0) 0x7f065415d710 con 0x7f06400664a0 2023-11-04T01:40:01.883 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:01.884 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:01.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06400664a0 msgr2=0x7f0640068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06400664a0 0x7f0640068960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06541f8d90 tx=0x7f0648009040 comp rx=0 tx=0).stop 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 msgr2=0x7f065414db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 0x7f065414db30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f064400c7f0 tx=0x7f064400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 shutdown_connections 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06400664a0 0x7f0640068960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f065415b150 0x7f06540b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f06540cfe40 0x7f065415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 --2- 172.21.15.40:0/4066014291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06540b27d0 0x7f065414db30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 >> 172.21.15.40:0/4066014291 conn(0x7f06540cd7d0 msgr2=0x7f06540cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 shutdown_connections 2023-11-04T01:40:01.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:01.880+0000 7f065a94a640 1 -- 172.21.15.40:0/4066014291 wait complete. 2023-11-04T01:40:01.902 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-04T01:40:01.748491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.692660"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242480+0000","last_change":"2023-11-04T01:39:57.925789+0000","last_active":"2023-11-04T01:39:59.242480+0000","last_peered":"2023-11-04T01:39:59.242480+0000","last_clean":"2023-11-04T01:39:59.242480+0000","last_became_active":"2023-11-04T01:39:57.925151+0000","last_became_peered":"2023-11-04T01:39:57.925151+0000","last_unstale":"2023-11-04T01:39:59.242480+0000","last_undegraded":"2023-11-04T01:39:59.242480+0000","last_fullsized":"2023-11-04T01:39:59.242480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868458+0000","last_change":"2023-11-04T01:39:57.908425+0000","last_active":"2023-11-04T01:39:58.868458+0000","last_peered":"2023-11-04T01:39:58.868458+0000","last_clean":"2023-11-04T01:39:58.868458+0000","last_became_active":"2023-11-04T01:39:57.907722+0000","last_became_peered":"2023-11-04T01:39:57.907722+0000","last_unstale":"2023-11-04T01:39:58.868458+0000","last_undegraded":"2023-11-04T01:39:58.868458+0000","last_fullsized":"2023-11-04T01:39:58.868458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867715+0000","last_change":"2023-11-04T01:39:57.900305+0000","last_active":"2023-11-04T01:39:59.867715+0000","last_peered":"2023-11-04T01:39:59.867715+0000","last_clean":"2023-11-04T01:39:59.867715+0000","last_became_active":"2023-11-04T01:39:57.897404+0000","last_became_peered":"2023-11-04T01:39:57.897404+0000","last_unstale":"2023-11-04T01:39:59.867715+0000","last_undegraded":"2023-11-04T01:39:59.867715+0000","last_fullsized":"2023-11-04T01:39:59.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873355+0000","last_change":"2023-11-04T01:39:57.903325+0000","last_active":"2023-11-04T01:39:58.873355+0000","last_peered":"2023-11-04T01:39:58.873355+0000","last_clean":"2023-11-04T01:39:58.873355+0000","last_became_active":"2023-11-04T01:39:57.902596+0000","last_became_peered":"2023-11-04T01:39:57.902596+0000","last_unstale":"2023-11-04T01:39:58.873355+0000","last_undegraded":"2023-11-04T01:39:58.873355+0000","last_fullsized":"2023-11-04T01:39:58.873355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241536+0000","last_change":"2023-11-04T01:39:57.926330+0000","last_active":"2023-11-04T01:39:59.241536+0000","last_peered":"2023-11-04T01:39:59.241536+0000","last_clean":"2023-11-04T01:39:59.241536+0000","last_became_active":"2023-11-04T01:39:57.924224+0000","last_became_peered":"2023-11-04T01:39:57.924224+0000","last_unstale":"2023-11-04T01:39:59.241536+0000","last_undegraded":"2023-11-04T01:39:59.241536+0000","last_fullsized":"2023-11-04T01:39:59.241536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871995+0000","last_change":"2023-11-04T01:39:57.892846+0000","last_active":"2023-11-04T01:39:58.871995+0000","last_peered":"2023-11-04T01:39:58.871995+0000","last_clean":"2023-11-04T01:39:58.871995+0000","last_became_active":"2023-11-04T01:39:57.892070+0000","last_became_peered":"2023-11-04T01:39:57.892070+0000","last_unstale":"2023-11-04T01:39:58.871995+0000","last_undegraded":"2023-11-04T01:39:58.871995+0000","last_fullsized":"2023-11-04T01:39:58.871995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241310+0000","last_change":"2023-11-04T01:39:57.925014+0000","last_active":"2023-11-04T01:39:59.241310+0000","last_peered":"2023-11-04T01:39:59.241310+0000","last_clean":"2023-11-04T01:39:59.241310+0000","last_became_active":"2023-11-04T01:39:57.924087+0000","last_became_peered":"2023-11-04T01:39:57.924087+0000","last_unstale":"2023-11-04T01:39:59.241310+0000","last_undegraded":"2023-11-04T01:39:59.241310+0000","last_fullsized":"2023-11-04T01:39:59.241310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867175+0000","last_change":"2023-11-04T01:39:57.899378+0000","last_active":"2023-11-04T01:39:59.867175+0000","last_peered":"2023-11-04T01:39:59.867175+0000","last_clean":"2023-11-04T01:39:59.867175+0000","last_became_active":"2023-11-04T01:39:57.898302+0000","last_became_peered":"2023-11-04T01:39:57.898302+0000","last_unstale":"2023-11-04T01:39:59.867175+0000","last_undegraded":"2023-11-04T01:39:59.867175+0000","last_fullsized":"2023-11-04T01:39:59.867175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242662+0000","last_change":"2023-11-04T01:39:57.926979+0000","last_active":"2023-11-04T01:39:59.242662+0000","last_peered":"2023-11-04T01:39:59.242662+0000","last_clean":"2023-11-04T01:39:59.242662+0000","last_became_active":"2023-11-04T01:39:57.926296+0000","last_became_peered":"2023-11-04T01:39:57.926296+0000","last_unstale":"2023-11-04T01:39:59.242662+0000","last_undegraded":"2023-11-04T01:39:59.242662+0000","last_fullsized":"2023-11-04T01:39:59.242662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:16.450490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.904461+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.903712+0000","last_became_peered":"2023-11-04T01:39:57.903712+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867074+0000","last_change":"2023-11-04T01:39:57.916530+0000","last_active":"2023-11-04T01:39:59.867074+0000","last_peered":"2023-11-04T01:39:59.867074+0000","last_clean":"2023-11-04T01:39:59.867074+0000","last_became_active":"2023-11-04T01:39:57.915736+0000","last_became_peered":"2023-11-04T01:39:57.915736+0000","last_unstale":"2023-11-04T01:39:59.867074+0000","last_undegraded":"2023-11-04T01:39:59.867074+0000","last_fullsized":"2023-11-04T01:39:59.867074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872434+0000","last_change":"2023-11-04T01:39:57.910499+0000","last_active":"2023-11-04T01:39:58.872434+0000","last_peered":"2023-11-04T01:39:58.872434+0000","last_clean":"2023-11-04T01:39:58.872434+0000","last_became_active":"2023-11-04T01:39:57.908955+0000","last_became_peered":"2023-11-04T01:39:57.908955+0000","last_unstale":"2023-11-04T01:39:58.872434+0000","last_undegraded":"2023-11-04T01:39:58.872434+0000","last_fullsized":"2023-11-04T01:39:58.872434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:13.526783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868977+0000","last_change":"2023-11-04T01:39:57.910910+0000","last_active":"2023-11-04T01:39:59.868977+0000","last_peered":"2023-11-04T01:39:59.868977+0000","last_clean":"2023-11-04T01:39:59.868977+0000","last_became_active":"2023-11-04T01:39:57.910137+0000","last_became_peered":"2023-11-04T01:39:57.910137+0000","last_unstale":"2023-11-04T01:39:59.868977+0000","last_undegraded":"2023-11-04T01:39:59.868977+0000","last_fullsized":"2023-11-04T01:39:59.868977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865890+0000","last_change":"2023-11-04T01:39:57.899243+0000","last_active":"2023-11-04T01:39:59.865890+0000","last_peered":"2023-11-04T01:39:59.865890+0000","last_clean":"2023-11-04T01:39:59.865890+0000","last_became_active":"2023-11-04T01:39:57.898485+0000","last_became_peered":"2023-11-04T01:39:57.898485+0000","last_unstale":"2023-11-04T01:39:59.865890+0000","last_undegraded":"2023-11-04T01:39:59.865890+0000","last_fullsized":"2023-11-04T01:39:59.865890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:10.549998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868723+0000","last_change":"2023-11-04T01:39:57.908194+0000","last_active":"2023-11-04T01:39:58.868723+0000","last_peered":"2023-11-04T01:39:58.868723+0000","last_clean":"2023-11-04T01:39:58.868723+0000","last_became_active":"2023-11-04T01:39:57.907392+0000","last_became_peered":"2023-11-04T01:39:57.907392+0000","last_unstale":"2023-11-04T01:39:58.868723+0000","last_undegraded":"2023-11-04T01:39:58.868723+0000","last_fullsized":"2023-11-04T01:39:58.868723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871444+0000","last_change":"2023-11-04T01:39:57.880160+0000","last_active":"2023-11-04T01:39:58.871444+0000","last_peered":"2023-11-04T01:39:58.871444+0000","last_clean":"2023-11-04T01:39:58.871444+0000","last_became_active":"2023-11-04T01:39:57.879279+0000","last_became_peered":"2023-11-04T01:39:57.879279+0000","last_unstale":"2023-11-04T01:39:58.871444+0000","last_undegraded":"2023-11-04T01:39:58.871444+0000","last_fullsized":"2023-11-04T01:39:58.871444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874863+0000","last_change":"2023-11-04T01:39:57.921634+0000","last_active":"2023-11-04T01:39:58.874863+0000","last_peered":"2023-11-04T01:39:58.874863+0000","last_clean":"2023-11-04T01:39:58.874863+0000","last_became_active":"2023-11-04T01:39:57.921093+0000","last_became_peered":"2023-11-04T01:39:57.921093+0000","last_unstale":"2023-11-04T01:39:58.874863+0000","last_undegraded":"2023-11-04T01:39:58.874863+0000","last_fullsized":"2023-11-04T01:39:58.874863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866725+0000","last_change":"2023-11-04T01:39:57.905623+0000","last_active":"2023-11-04T01:39:59.866725+0000","last_peered":"2023-11-04T01:39:59.866725+0000","last_clean":"2023-11-04T01:39:59.866725+0000","last_became_active":"2023-11-04T01:39:57.903240+0000","last_became_peered":"2023-11-04T01:39:57.903240+0000","last_unstale":"2023-11-04T01:39:59.866725+0000","last_undegraded":"2023-11-04T01:39:59.866725+0000","last_fullsized":"2023-11-04T01:39:59.866725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242457+0000","last_change":"2023-11-04T01:39:57.926788+0000","last_active":"2023-11-04T01:39:59.242457+0000","last_peered":"2023-11-04T01:39:59.242457+0000","last_clean":"2023-11-04T01:39:59.242457+0000","last_became_active":"2023-11-04T01:39:57.926166+0000","last_became_peered":"2023-11-04T01:39:57.926166+0000","last_unstale":"2023-11-04T01:39:59.242457+0000","last_undegraded":"2023-11-04T01:39:59.242457+0000","last_fullsized":"2023-11-04T01:39:59.242457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867431+0000","last_change":"2023-11-04T01:39:57.911323+0000","last_active":"2023-11-04T01:39:59.867431+0000","last_peered":"2023-11-04T01:39:59.867431+0000","last_clean":"2023-11-04T01:39:59.867431+0000","last_became_active":"2023-11-04T01:39:57.910177+0000","last_became_peered":"2023-11-04T01:39:57.910177+0000","last_unstale":"2023-11-04T01:39:59.867431+0000","last_undegraded":"2023-11-04T01:39:59.867431+0000","last_fullsized":"2023-11-04T01:39:59.867431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866844+0000","last_change":"2023-11-04T01:39:57.905163+0000","last_active":"2023-11-04T01:39:59.866844+0000","last_peered":"2023-11-04T01:39:59.866844+0000","last_clean":"2023-11-04T01:39:59.866844+0000","last_became_active":"2023-11-04T01:39:57.903224+0000","last_became_peered":"2023-11-04T01:39:57.903224+0000","last_unstale":"2023-11-04T01:39:59.866844+0000","last_undegraded":"2023-11-04T01:39:59.866844+0000","last_fullsized":"2023-11-04T01:39:59.866844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:37.716898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872301+0000","last_change":"2023-11-04T01:39:57.921678+0000","last_active":"2023-11-04T01:39:58.872301+0000","last_peered":"2023-11-04T01:39:58.872301+0000","last_clean":"2023-11-04T01:39:58.872301+0000","last_became_active":"2023-11-04T01:39:57.921140+0000","last_became_peered":"2023-11-04T01:39:57.921140+0000","last_unstale":"2023-11-04T01:39:58.872301+0000","last_undegraded":"2023-11-04T01:39:58.872301+0000","last_fullsized":"2023-11-04T01:39:58.872301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867110+0000","last_change":"2023-11-04T01:39:57.896458+0000","last_active":"2023-11-04T01:39:59.867110+0000","last_peered":"2023-11-04T01:39:59.867110+0000","last_clean":"2023-11-04T01:39:59.867110+0000","last_became_active":"2023-11-04T01:39:57.895714+0000","last_became_peered":"2023-11-04T01:39:57.895714+0000","last_unstale":"2023-11-04T01:39:59.867110+0000","last_undegraded":"2023-11-04T01:39:59.867110+0000","last_fullsized":"2023-11-04T01:39:59.867110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871593+0000","last_change":"2023-11-04T01:39:57.915051+0000","last_active":"2023-11-04T01:39:58.871593+0000","last_peered":"2023-11-04T01:39:58.871593+0000","last_clean":"2023-11-04T01:39:58.871593+0000","last_became_active":"2023-11-04T01:39:57.914155+0000","last_became_peered":"2023-11-04T01:39:57.914155+0000","last_unstale":"2023-11-04T01:39:58.871593+0000","last_undegraded":"2023-11-04T01:39:58.871593+0000","last_fullsized":"2023-11-04T01:39:58.871593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869418+0000","last_change":"2023-11-04T01:39:57.896281+0000","last_active":"2023-11-04T01:39:59.869418+0000","last_peered":"2023-11-04T01:39:59.869418+0000","last_clean":"2023-11-04T01:39:59.869418+0000","last_became_active":"2023-11-04T01:39:57.895403+0000","last_became_peered":"2023-11-04T01:39:57.895403+0000","last_unstale":"2023-11-04T01:39:59.869418+0000","last_undegraded":"2023-11-04T01:39:59.869418+0000","last_fullsized":"2023-11-04T01:39:59.869418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867543+0000","last_change":"2023-11-04T01:39:57.921624+0000","last_active":"2023-11-04T01:39:59.867543+0000","last_peered":"2023-11-04T01:39:59.867543+0000","last_clean":"2023-11-04T01:39:59.867543+0000","last_became_active":"2023-11-04T01:39:57.920996+0000","last_became_peered":"2023-11-04T01:39:57.920996+0000","last_unstale":"2023-11-04T01:39:59.867543+0000","last_undegraded":"2023-11-04T01:39:59.867543+0000","last_fullsized":"2023-11-04T01:39:59.867543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868934+0000","last_change":"2023-11-04T01:39:57.893478+0000","last_active":"2023-11-04T01:39:58.868934+0000","last_peered":"2023-11-04T01:39:58.868934+0000","last_clean":"2023-11-04T01:39:58.868934+0000","last_became_active":"2023-11-04T01:39:57.892683+0000","last_became_peered":"2023-11-04T01:39:57.892683+0000","last_unstale":"2023-11-04T01:39:58.868934+0000","last_undegraded":"2023-11-04T01:39:58.868934+0000","last_fullsized":"2023-11-04T01:39:58.868934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869388+0000","last_change":"2023-11-04T01:39:57.905914+0000","last_active":"2023-11-04T01:39:59.869388+0000","last_peered":"2023-11-04T01:39:59.869388+0000","last_clean":"2023-11-04T01:39:59.869388+0000","last_became_active":"2023-11-04T01:39:57.905063+0000","last_became_peered":"2023-11-04T01:39:57.905063+0000","last_unstale":"2023-11-04T01:39:59.869388+0000","last_undegraded":"2023-11-04T01:39:59.869388+0000","last_fullsized":"2023-11-04T01:39:59.869388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867127+0000","last_change":"2023-11-04T01:39:57.904020+0000","last_active":"2023-11-04T01:39:59.867127+0000","last_peered":"2023-11-04T01:39:59.867127+0000","last_clean":"2023-11-04T01:39:59.867127+0000","last_became_active":"2023-11-04T01:39:57.900757+0000","last_became_peered":"2023-11-04T01:39:57.900757+0000","last_unstale":"2023-11-04T01:39:59.867127+0000","last_undegraded":"2023-11-04T01:39:59.867127+0000","last_fullsized":"2023-11-04T01:39:59.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872605+0000","last_change":"2023-11-04T01:39:57.899405+0000","last_active":"2023-11-04T01:39:58.872605+0000","last_peered":"2023-11-04T01:39:58.872605+0000","last_clean":"2023-11-04T01:39:58.872605+0000","last_became_active":"2023-11-04T01:39:57.898321+0000","last_became_peered":"2023-11-04T01:39:57.898321+0000","last_unstale":"2023-11-04T01:39:58.872605+0000","last_undegraded":"2023-11-04T01:39:58.872605+0000","last_fullsized":"2023-11-04T01:39:58.872605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865624+0000","last_change":"2023-11-04T01:39:57.889138+0000","last_active":"2023-11-04T01:39:59.865624+0000","last_peered":"2023-11-04T01:39:59.865624+0000","last_clean":"2023-11-04T01:39:59.865624+0000","last_became_active":"2023-11-04T01:39:57.888387+0000","last_became_peered":"2023-11-04T01:39:57.888387+0000","last_unstale":"2023-11-04T01:39:59.865624+0000","last_undegraded":"2023-11-04T01:39:59.865624+0000","last_fullsized":"2023-11-04T01:39:59.865624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866818+0000","last_change":"2023-11-04T01:39:57.906169+0000","last_active":"2023-11-04T01:39:59.866818+0000","last_peered":"2023-11-04T01:39:59.866818+0000","last_clean":"2023-11-04T01:39:59.866818+0000","last_became_active":"2023-11-04T01:39:57.905475+0000","last_became_peered":"2023-11-04T01:39:57.905475+0000","last_unstale":"2023-11-04T01:39:59.866818+0000","last_undegraded":"2023-11-04T01:39:59.866818+0000","last_fullsized":"2023-11-04T01:39:59.866818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872249+0000","last_change":"2023-11-04T01:39:57.913166+0000","last_active":"2023-11-04T01:39:58.872249+0000","last_peered":"2023-11-04T01:39:58.872249+0000","last_clean":"2023-11-04T01:39:58.872249+0000","last_became_active":"2023-11-04T01:39:57.912369+0000","last_became_peered":"2023-11-04T01:39:57.912369+0000","last_unstale":"2023-11-04T01:39:58.872249+0000","last_undegraded":"2023-11-04T01:39:58.872249+0000","last_fullsized":"2023-11-04T01:39:58.872249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:37.941972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869281+0000","last_change":"2023-11-04T01:39:57.109460+0000","last_active":"2023-11-04T01:39:59.869281+0000","last_peered":"2023-11-04T01:39:59.869281+0000","last_clean":"2023-11-04T01:39:59.869281+0000","last_became_active":"2023-11-04T01:39:57.109057+0000","last_became_peered":"2023-11-04T01:39:57.109057+0000","last_unstale":"2023-11-04T01:39:59.869281+0000","last_undegraded":"2023-11-04T01:39:59.869281+0000","last_fullsized":"2023-11-04T01:39:59.869281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867312+0000","last_change":"2023-11-04T01:39:57.899906+0000","last_active":"2023-11-04T01:39:59.867312+0000","last_peered":"2023-11-04T01:39:59.867312+0000","last_clean":"2023-11-04T01:39:59.867312+0000","last_became_active":"2023-11-04T01:39:57.890228+0000","last_became_peered":"2023-11-04T01:39:57.890228+0000","last_unstale":"2023-11-04T01:39:59.867312+0000","last_undegraded":"2023-11-04T01:39:59.867312+0000","last_fullsized":"2023-11-04T01:39:59.867312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866758+0000","last_change":"2023-11-04T01:39:57.107398+0000","last_active":"2023-11-04T01:39:59.866758+0000","last_peered":"2023-11-04T01:39:59.866758+0000","last_clean":"2023-11-04T01:39:59.866758+0000","last_became_active":"2023-11-04T01:39:57.105860+0000","last_became_peered":"2023-11-04T01:39:57.105860+0000","last_unstale":"2023-11-04T01:39:59.866758+0000","last_undegraded":"2023-11-04T01:39:59.866758+0000","last_fullsized":"2023-11-04T01:39:59.866758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868547+0000","last_change":"2023-11-04T01:39:57.104185+0000","last_active":"2023-11-04T01:39:59.868547+0000","last_peered":"2023-11-04T01:39:59.868547+0000","last_clean":"2023-11-04T01:39:59.868547+0000","last_became_active":"2023-11-04T01:39:57.103699+0000","last_became_peered":"2023-11-04T01:39:57.103699+0000","last_unstale":"2023-11-04T01:39:59.868547+0000","last_undegraded":"2023-11-04T01:39:59.868547+0000","last_fullsized":"2023-11-04T01:39:59.868547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867352+0000","last_change":"2023-11-04T01:39:57.901259+0000","last_active":"2023-11-04T01:39:59.867352+0000","last_peered":"2023-11-04T01:39:59.867352+0000","last_clean":"2023-11-04T01:39:59.867352+0000","last_became_active":"2023-11-04T01:39:57.899400+0000","last_became_peered":"2023-11-04T01:39:57.899400+0000","last_unstale":"2023-11-04T01:39:59.867352+0000","last_undegraded":"2023-11-04T01:39:59.867352+0000","last_fullsized":"2023-11-04T01:39:59.867352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871665+0000","last_change":"2023-11-04T01:39:57.103508+0000","last_active":"2023-11-04T01:39:58.871665+0000","last_peered":"2023-11-04T01:39:58.871665+0000","last_clean":"2023-11-04T01:39:58.871665+0000","last_became_active":"2023-11-04T01:39:57.102807+0000","last_became_peered":"2023-11-04T01:39:57.102807+0000","last_unstale":"2023-11-04T01:39:58.871665+0000","last_undegraded":"2023-11-04T01:39:58.871665+0000","last_fullsized":"2023-11-04T01:39:58.871665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868552+0000","last_change":"2023-11-04T01:39:57.914207+0000","last_active":"2023-11-04T01:39:58.868552+0000","last_peered":"2023-11-04T01:39:58.868552+0000","last_clean":"2023-11-04T01:39:58.868552+0000","last_became_active":"2023-11-04T01:39:57.913328+0000","last_became_peered":"2023-11-04T01:39:57.913328+0000","last_unstale":"2023-11-04T01:39:58.868552+0000","last_undegraded":"2023-11-04T01:39:58.868552+0000","last_fullsized":"2023-11-04T01:39:58.868552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867354+0000","last_change":"2023-11-04T01:39:57.116533+0000","last_active":"2023-11-04T01:39:59.867354+0000","last_peered":"2023-11-04T01:39:59.867354+0000","last_clean":"2023-11-04T01:39:59.867354+0000","last_became_active":"2023-11-04T01:39:57.115805+0000","last_became_peered":"2023-11-04T01:39:57.115805+0000","last_unstale":"2023-11-04T01:39:59.867354+0000","last_undegraded":"2023-11-04T01:39:59.867354+0000","last_fullsized":"2023-11-04T01:39:59.867354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874659+0000","last_change":"2023-11-04T01:39:57.900836+0000","last_active":"2023-11-04T01:39:58.874659+0000","last_peered":"2023-11-04T01:39:58.874659+0000","last_clean":"2023-11-04T01:39:58.874659+0000","last_became_active":"2023-11-04T01:39:57.900068+0000","last_became_peered":"2023-11-04T01:39:57.900068+0000","last_unstale":"2023-11-04T01:39:58.874659+0000","last_undegraded":"2023-11-04T01:39:58.874659+0000","last_fullsized":"2023-11-04T01:39:58.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874438+0000","last_change":"2023-11-04T01:39:57.112275+0000","last_active":"2023-11-04T01:39:58.874438+0000","last_peered":"2023-11-04T01:39:58.874438+0000","last_clean":"2023-11-04T01:39:58.874438+0000","last_became_active":"2023-11-04T01:39:57.111384+0000","last_became_peered":"2023-11-04T01:39:57.111384+0000","last_unstale":"2023-11-04T01:39:58.874438+0000","last_undegraded":"2023-11-04T01:39:58.874438+0000","last_fullsized":"2023-11-04T01:39:58.874438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.460433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868016+0000","last_change":"2023-11-04T01:39:57.889775+0000","last_active":"2023-11-04T01:39:59.868016+0000","last_peered":"2023-11-04T01:39:59.868016+0000","last_clean":"2023-11-04T01:39:59.868016+0000","last_became_active":"2023-11-04T01:39:57.888973+0000","last_became_peered":"2023-11-04T01:39:57.888973+0000","last_unstale":"2023-11-04T01:39:59.868016+0000","last_undegraded":"2023-11-04T01:39:59.868016+0000","last_fullsized":"2023-11-04T01:39:59.868016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869054+0000","last_change":"2023-11-04T01:39:57.104163+0000","last_active":"2023-11-04T01:39:58.869054+0000","last_peered":"2023-11-04T01:39:58.869054+0000","last_clean":"2023-11-04T01:39:58.869054+0000","last_became_active":"2023-11-04T01:39:57.103774+0000","last_became_peered":"2023-11-04T01:39:57.103774+0000","last_unstale":"2023-11-04T01:39:58.869054+0000","last_undegraded":"2023-11-04T01:39:58.869054+0000","last_fullsized":"2023-11-04T01:39:58.869054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872752+0000","last_change":"2023-11-04T01:39:57.908429+0000","last_active":"2023-11-04T01:39:58.872752+0000","last_peered":"2023-11-04T01:39:58.872752+0000","last_clean":"2023-11-04T01:39:58.872752+0000","last_became_active":"2023-11-04T01:39:57.904836+0000","last_became_peered":"2023-11-04T01:39:57.904836+0000","last_unstale":"2023-11-04T01:39:58.872752+0000","last_undegraded":"2023-11-04T01:39:58.872752+0000","last_fullsized":"2023-11-04T01:39:58.872752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867284+0000","last_change":"2023-11-04T01:39:57.104076+0000","last_active":"2023-11-04T01:39:59.867284+0000","last_peered":"2023-11-04T01:39:59.867284+0000","last_clean":"2023-11-04T01:39:59.867284+0000","last_became_active":"2023-11-04T01:39:57.103284+0000","last_became_peered":"2023-11-04T01:39:57.103284+0000","last_unstale":"2023-11-04T01:39:59.867284+0000","last_undegraded":"2023-11-04T01:39:59.867284+0000","last_fullsized":"2023-11-04T01:39:59.867284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242226+0000","last_change":"2023-11-04T01:39:57.925026+0000","last_active":"2023-11-04T01:39:59.242226+0000","last_peered":"2023-11-04T01:39:59.242226+0000","last_clean":"2023-11-04T01:39:59.242226+0000","last_became_active":"2023-11-04T01:39:57.924278+0000","last_became_peered":"2023-11-04T01:39:57.924278+0000","last_unstale":"2023-11-04T01:39:59.242226+0000","last_undegraded":"2023-11-04T01:39:59.242226+0000","last_fullsized":"2023-11-04T01:39:59.242226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867432+0000","last_change":"2023-11-04T01:39:57.089537+0000","last_active":"2023-11-04T01:39:59.867432+0000","last_peered":"2023-11-04T01:39:59.867432+0000","last_clean":"2023-11-04T01:39:59.867432+0000","last_became_active":"2023-11-04T01:39:57.088369+0000","last_became_peered":"2023-11-04T01:39:57.088369+0000","last_unstale":"2023-11-04T01:39:59.867432+0000","last_undegraded":"2023-11-04T01:39:59.867432+0000","last_fullsized":"2023-11-04T01:39:59.867432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866389+0000","last_change":"2023-11-04T01:39:57.921257+0000","last_active":"2023-11-04T01:39:59.866389+0000","last_peered":"2023-11-04T01:39:59.866389+0000","last_clean":"2023-11-04T01:39:59.866389+0000","last_became_active":"2023-11-04T01:39:57.920025+0000","last_became_peered":"2023-11-04T01:39:57.920025+0000","last_unstale":"2023-11-04T01:39:59.866389+0000","last_undegraded":"2023-11-04T01:39:59.866389+0000","last_fullsized":"2023-11-04T01:39:59.866389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:17.627984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872817+0000","last_change":"2023-11-04T01:39:57.114536+0000","last_active":"2023-11-04T01:39:58.872817+0000","last_peered":"2023-11-04T01:39:58.872817+0000","last_clean":"2023-11-04T01:39:58.872817+0000","last_became_active":"2023-11-04T01:39:57.114040+0000","last_became_peered":"2023-11-04T01:39:57.114040+0000","last_unstale":"2023-11-04T01:39:58.872817+0000","last_undegraded":"2023-11-04T01:39:58.872817+0000","last_fullsized":"2023-11-04T01:39:58.872817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241638+0000","last_change":"2023-11-04T01:39:57.927347+0000","last_active":"2023-11-04T01:39:59.241638+0000","last_peered":"2023-11-04T01:39:59.241638+0000","last_clean":"2023-11-04T01:39:59.241638+0000","last_became_active":"2023-11-04T01:39:57.925411+0000","last_became_peered":"2023-11-04T01:39:57.925411+0000","last_unstale":"2023-11-04T01:39:59.241638+0000","last_undegraded":"2023-11-04T01:39:59.241638+0000","last_fullsized":"2023-11-04T01:39:59.241638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866704+0000","last_change":"2023-11-04T01:39:57.104862+0000","last_active":"2023-11-04T01:39:59.866704+0000","last_peered":"2023-11-04T01:39:59.866704+0000","last_clean":"2023-11-04T01:39:59.866704+0000","last_became_active":"2023-11-04T01:39:57.103985+0000","last_became_peered":"2023-11-04T01:39:57.103985+0000","last_unstale":"2023-11-04T01:39:59.866704+0000","last_undegraded":"2023-11-04T01:39:59.866704+0000","last_fullsized":"2023-11-04T01:39:59.866704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:42.123401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866814+0000","last_change":"2023-11-04T01:39:57.903968+0000","last_active":"2023-11-04T01:39:59.866814+0000","last_peered":"2023-11-04T01:39:59.866814+0000","last_clean":"2023-11-04T01:39:59.866814+0000","last_became_active":"2023-11-04T01:39:57.903269+0000","last_became_peered":"2023-11-04T01:39:57.903269+0000","last_unstale":"2023-11-04T01:39:59.866814+0000","last_undegraded":"2023-11-04T01:39:59.866814+0000","last_fullsized":"2023-11-04T01:39:59.866814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865260+0000","last_change":"2023-11-04T01:39:57.083110+0000","last_active":"2023-11-04T01:39:59.865260+0000","last_peered":"2023-11-04T01:39:59.865260+0000","last_clean":"2023-11-04T01:39:59.865260+0000","last_became_active":"2023-11-04T01:39:57.082483+0000","last_became_peered":"2023-11-04T01:39:57.082483+0000","last_unstale":"2023-11-04T01:39:59.865260+0000","last_undegraded":"2023-11-04T01:39:59.865260+0000","last_fullsized":"2023-11-04T01:39:59.865260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:49.424318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241483+0000","last_change":"2023-11-04T01:39:57.925941+0000","last_active":"2023-11-04T01:39:59.241483+0000","last_peered":"2023-11-04T01:39:59.241483+0000","last_clean":"2023-11-04T01:39:59.241483+0000","last_became_active":"2023-11-04T01:39:57.925338+0000","last_became_peered":"2023-11-04T01:39:57.925338+0000","last_unstale":"2023-11-04T01:39:59.241483+0000","last_undegraded":"2023-11-04T01:39:59.241483+0000","last_fullsized":"2023-11-04T01:39:59.241483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873396+0000","last_change":"2023-11-04T01:39:57.089157+0000","last_active":"2023-11-04T01:39:58.873396+0000","last_peered":"2023-11-04T01:39:58.873396+0000","last_clean":"2023-11-04T01:39:58.873396+0000","last_became_active":"2023-11-04T01:39:57.088373+0000","last_became_peered":"2023-11-04T01:39:57.088373+0000","last_unstale":"2023-11-04T01:39:58.873396+0000","last_undegraded":"2023-11-04T01:39:58.873396+0000","last_fullsized":"2023-11-04T01:39:58.873396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.666272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242512+0000","last_change":"2023-11-04T01:39:57.926318+0000","last_active":"2023-11-04T01:39:59.242512+0000","last_peered":"2023-11-04T01:39:59.242512+0000","last_clean":"2023-11-04T01:39:59.242512+0000","last_became_active":"2023-11-04T01:39:57.924998+0000","last_became_peered":"2023-11-04T01:39:57.924998+0000","last_unstale":"2023-11-04T01:39:59.242512+0000","last_undegraded":"2023-11-04T01:39:59.242512+0000","last_fullsized":"2023-11-04T01:39:59.242512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:37.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866744+0000","last_change":"2023-11-04T01:39:57.085866+0000","last_active":"2023-11-04T01:39:59.866744+0000","last_peered":"2023-11-04T01:39:59.866744+0000","last_clean":"2023-11-04T01:39:59.866744+0000","last_became_active":"2023-11-04T01:39:57.085501+0000","last_became_peered":"2023-11-04T01:39:57.085501+0000","last_unstale":"2023-11-04T01:39:59.866744+0000","last_undegraded":"2023-11-04T01:39:59.866744+0000","last_fullsized":"2023-11-04T01:39:59.866744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242796+0000","last_change":"2023-11-04T01:39:57.927164+0000","last_active":"2023-11-04T01:39:59.242796+0000","last_peered":"2023-11-04T01:39:59.242796+0000","last_clean":"2023-11-04T01:39:59.242796+0000","last_became_active":"2023-11-04T01:39:57.926817+0000","last_became_peered":"2023-11-04T01:39:57.926817+0000","last_unstale":"2023-11-04T01:39:59.242796+0000","last_undegraded":"2023-11-04T01:39:59.242796+0000","last_fullsized":"2023-11-04T01:39:59.242796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:14.194200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869221+0000","last_change":"2023-11-04T01:39:57.088611+0000","last_active":"2023-11-04T01:39:58.869221+0000","last_peered":"2023-11-04T01:39:58.869221+0000","last_clean":"2023-11-04T01:39:58.869221+0000","last_became_active":"2023-11-04T01:39:57.088214+0000","last_became_peered":"2023-11-04T01:39:57.088214+0000","last_unstale":"2023-11-04T01:39:58.869221+0000","last_undegraded":"2023-11-04T01:39:58.869221+0000","last_fullsized":"2023-11-04T01:39:58.869221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873978+0000","last_change":"2023-11-04T01:39:57.916146+0000","last_active":"2023-11-04T01:39:58.873978+0000","last_peered":"2023-11-04T01:39:58.873978+0000","last_clean":"2023-11-04T01:39:58.873978+0000","last_became_active":"2023-11-04T01:39:57.914346+0000","last_became_peered":"2023-11-04T01:39:57.914346+0000","last_unstale":"2023-11-04T01:39:58.873978+0000","last_undegraded":"2023-11-04T01:39:58.873978+0000","last_fullsized":"2023-11-04T01:39:58.873978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866304+0000","last_change":"2023-11-04T01:39:57.091428+0000","last_active":"2023-11-04T01:39:59.866304+0000","last_peered":"2023-11-04T01:39:59.866304+0000","last_clean":"2023-11-04T01:39:59.866304+0000","last_became_active":"2023-11-04T01:39:57.090767+0000","last_became_peered":"2023-11-04T01:39:57.090767+0000","last_unstale":"2023-11-04T01:39:59.866304+0000","last_undegraded":"2023-11-04T01:39:59.866304+0000","last_fullsized":"2023-11-04T01:39:59.866304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242170+0000","last_change":"2023-11-04T01:39:57.925040+0000","last_active":"2023-11-04T01:39:59.242170+0000","last_peered":"2023-11-04T01:39:59.242170+0000","last_clean":"2023-11-04T01:39:59.242170+0000","last_became_active":"2023-11-04T01:39:57.924201+0000","last_became_peered":"2023-11-04T01:39:57.924201+0000","last_unstale":"2023-11-04T01:39:59.242170+0000","last_undegraded":"2023-11-04T01:39:59.242170+0000","last_fullsized":"2023-11-04T01:39:59.242170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:39:57.898357+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:57.898357+0000","last_peered":"2023-11-04T01:39:57.898357+0000","last_clean":"2023-11-04T01:39:57.898357+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:57.898357+0000","last_undegraded":"2023-11-04T01:39:57.898357+0000","last_fullsized":"2023-11-04T01:39:57.898357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871472+0000","last_change":"2023-11-04T01:39:57.093034+0000","last_active":"2023-11-04T01:39:58.871472+0000","last_peered":"2023-11-04T01:39:58.871472+0000","last_clean":"2023-11-04T01:39:58.871472+0000","last_became_active":"2023-11-04T01:39:57.092158+0000","last_became_peered":"2023-11-04T01:39:57.092158+0000","last_unstale":"2023-11-04T01:39:58.871472+0000","last_undegraded":"2023-11-04T01:39:58.871472+0000","last_fullsized":"2023-11-04T01:39:58.871472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869011+0000","last_change":"2023-11-04T01:39:57.899138+0000","last_active":"2023-11-04T01:39:59.869011+0000","last_peered":"2023-11-04T01:39:59.869011+0000","last_clean":"2023-11-04T01:39:59.869011+0000","last_became_active":"2023-11-04T01:39:57.898313+0000","last_became_peered":"2023-11-04T01:39:57.898313+0000","last_unstale":"2023-11-04T01:39:59.869011+0000","last_undegraded":"2023-11-04T01:39:59.869011+0000","last_fullsized":"2023-11-04T01:39:59.869011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241057+0000","last_change":"2023-11-04T01:39:57.119969+0000","last_active":"2023-11-04T01:39:59.241057+0000","last_peered":"2023-11-04T01:39:59.241057+0000","last_clean":"2023-11-04T01:39:59.241057+0000","last_became_active":"2023-11-04T01:39:57.118250+0000","last_became_peered":"2023-11-04T01:39:57.118250+0000","last_unstale":"2023-11-04T01:39:59.241057+0000","last_undegraded":"2023-11-04T01:39:59.241057+0000","last_fullsized":"2023-11-04T01:39:59.241057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865841+0000","last_change":"2023-11-04T01:39:57.888041+0000","last_active":"2023-11-04T01:39:59.865841+0000","last_peered":"2023-11-04T01:39:59.865841+0000","last_clean":"2023-11-04T01:39:59.865841+0000","last_became_active":"2023-11-04T01:39:57.887240+0000","last_became_peered":"2023-11-04T01:39:57.887240+0000","last_unstale":"2023-11-04T01:39:59.865841+0000","last_undegraded":"2023-11-04T01:39:59.865841+0000","last_fullsized":"2023-11-04T01:39:59.865841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:00.328908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865848+0000","last_change":"2023-11-04T01:39:57.086891+0000","last_active":"2023-11-04T01:39:59.865848+0000","last_peered":"2023-11-04T01:39:59.865848+0000","last_clean":"2023-11-04T01:39:59.865848+0000","last_became_active":"2023-11-04T01:39:57.086482+0000","last_became_peered":"2023-11-04T01:39:57.086482+0000","last_unstale":"2023-11-04T01:39:59.865848+0000","last_undegraded":"2023-11-04T01:39:59.865848+0000","last_fullsized":"2023-11-04T01:39:59.865848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868387+0000","last_change":"2023-11-04T01:39:57.908737+0000","last_active":"2023-11-04T01:39:58.868387+0000","last_peered":"2023-11-04T01:39:58.868387+0000","last_clean":"2023-11-04T01:39:58.868387+0000","last_became_active":"2023-11-04T01:39:57.907965+0000","last_became_peered":"2023-11-04T01:39:57.907965+0000","last_unstale":"2023-11-04T01:39:58.868387+0000","last_undegraded":"2023-11-04T01:39:58.868387+0000","last_fullsized":"2023-11-04T01:39:58.868387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873025+0000","last_change":"2023-11-04T01:39:57.101402+0000","last_active":"2023-11-04T01:39:58.873025+0000","last_peered":"2023-11-04T01:39:58.873025+0000","last_clean":"2023-11-04T01:39:58.873025+0000","last_became_active":"2023-11-04T01:39:57.100736+0000","last_became_peered":"2023-11-04T01:39:57.100736+0000","last_unstale":"2023-11-04T01:39:58.873025+0000","last_undegraded":"2023-11-04T01:39:58.873025+0000","last_fullsized":"2023-11-04T01:39:58.873025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872956+0000","last_change":"2023-11-04T01:39:57.912134+0000","last_active":"2023-11-04T01:39:58.872956+0000","last_peered":"2023-11-04T01:39:58.872956+0000","last_clean":"2023-11-04T01:39:58.872956+0000","last_became_active":"2023-11-04T01:39:57.909396+0000","last_became_peered":"2023-11-04T01:39:57.909396+0000","last_unstale":"2023-11-04T01:39:58.872956+0000","last_undegraded":"2023-11-04T01:39:58.872956+0000","last_fullsized":"2023-11-04T01:39:58.872956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868443+0000","last_change":"2023-11-04T01:39:57.086794+0000","last_active":"2023-11-04T01:39:58.868443+0000","last_peered":"2023-11-04T01:39:58.868443+0000","last_clean":"2023-11-04T01:39:58.868443+0000","last_became_active":"2023-11-04T01:39:57.086448+0000","last_became_peered":"2023-11-04T01:39:57.086448+0000","last_unstale":"2023-11-04T01:39:58.868443+0000","last_undegraded":"2023-11-04T01:39:58.868443+0000","last_fullsized":"2023-11-04T01:39:58.868443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872724+0000","last_change":"2023-11-04T01:39:57.889388+0000","last_active":"2023-11-04T01:39:58.872724+0000","last_peered":"2023-11-04T01:39:58.872724+0000","last_clean":"2023-11-04T01:39:58.872724+0000","last_became_active":"2023-11-04T01:39:57.888326+0000","last_became_peered":"2023-11-04T01:39:57.888326+0000","last_unstale":"2023-11-04T01:39:58.872724+0000","last_undegraded":"2023-11-04T01:39:58.872724+0000","last_fullsized":"2023-11-04T01:39:58.872724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242500+0000","last_change":"2023-11-04T01:39:57.119606+0000","last_active":"2023-11-04T01:39:59.242500+0000","last_peered":"2023-11-04T01:39:59.242500+0000","last_clean":"2023-11-04T01:39:59.242500+0000","last_became_active":"2023-11-04T01:39:57.118501+0000","last_became_peered":"2023-11-04T01:39:57.118501+0000","last_unstale":"2023-11-04T01:39:59.242500+0000","last_undegraded":"2023-11-04T01:39:59.242500+0000","last_fullsized":"2023-11-04T01:39:59.242500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868674+0000","last_change":"2023-11-04T01:39:57.896425+0000","last_active":"2023-11-04T01:39:58.868674+0000","last_peered":"2023-11-04T01:39:58.868674+0000","last_clean":"2023-11-04T01:39:58.868674+0000","last_became_active":"2023-11-04T01:39:57.895472+0000","last_became_peered":"2023-11-04T01:39:57.895472+0000","last_unstale":"2023-11-04T01:39:58.868674+0000","last_undegraded":"2023-11-04T01:39:58.868674+0000","last_fullsized":"2023-11-04T01:39:58.868674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868581+0000","last_change":"2023-11-04T01:39:57.102873+0000","last_active":"2023-11-04T01:39:58.868581+0000","last_peered":"2023-11-04T01:39:58.868581+0000","last_clean":"2023-11-04T01:39:58.868581+0000","last_became_active":"2023-11-04T01:39:57.102500+0000","last_became_peered":"2023-11-04T01:39:57.102500+0000","last_unstale":"2023-11-04T01:39:58.868581+0000","last_undegraded":"2023-11-04T01:39:58.868581+0000","last_fullsized":"2023-11-04T01:39:58.868581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869619+0000","last_change":"2023-11-04T01:39:57.920760+0000","last_active":"2023-11-04T01:39:59.869619+0000","last_peered":"2023-11-04T01:39:59.869619+0000","last_clean":"2023-11-04T01:39:59.869619+0000","last_became_active":"2023-11-04T01:39:57.920036+0000","last_became_peered":"2023-11-04T01:39:57.920036+0000","last_unstale":"2023-11-04T01:39:59.869619+0000","last_undegraded":"2023-11-04T01:39:59.869619+0000","last_fullsized":"2023-11-04T01:39:59.869619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867441+0000","last_change":"2023-11-04T01:39:57.119006+0000","last_active":"2023-11-04T01:39:59.867441+0000","last_peered":"2023-11-04T01:39:59.867441+0000","last_clean":"2023-11-04T01:39:59.867441+0000","last_became_active":"2023-11-04T01:39:57.118360+0000","last_became_peered":"2023-11-04T01:39:57.118360+0000","last_unstale":"2023-11-04T01:39:59.867441+0000","last_undegraded":"2023-11-04T01:39:59.867441+0000","last_fullsized":"2023-11-04T01:39:59.867441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867208+0000","last_change":"2023-11-04T01:39:57.899526+0000","last_active":"2023-11-04T01:39:59.867208+0000","last_peered":"2023-11-04T01:39:59.867208+0000","last_clean":"2023-11-04T01:39:59.867208+0000","last_became_active":"2023-11-04T01:39:57.898663+0000","last_became_peered":"2023-11-04T01:39:57.898663+0000","last_unstale":"2023-11-04T01:39:59.867208+0000","last_undegraded":"2023-11-04T01:39:59.867208+0000","last_fullsized":"2023-11-04T01:39:59.867208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.240990+0000","last_change":"2023-11-04T01:39:57.118965+0000","last_active":"2023-11-04T01:39:59.240990+0000","last_peered":"2023-11-04T01:39:59.240990+0000","last_clean":"2023-11-04T01:39:59.240990+0000","last_became_active":"2023-11-04T01:39:57.117428+0000","last_became_peered":"2023-11-04T01:39:57.117428+0000","last_unstale":"2023-11-04T01:39:59.240990+0000","last_undegraded":"2023-11-04T01:39:59.240990+0000","last_fullsized":"2023-11-04T01:39:59.240990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872736+0000","last_change":"2023-11-04T01:39:57.897837+0000","last_active":"2023-11-04T01:39:58.872736+0000","last_peered":"2023-11-04T01:39:58.872736+0000","last_clean":"2023-11-04T01:39:58.872736+0000","last_became_active":"2023-11-04T01:39:57.897180+0000","last_became_peered":"2023-11-04T01:39:57.897180+0000","last_unstale":"2023-11-04T01:39:58.872736+0000","last_undegraded":"2023-11-04T01:39:58.872736+0000","last_fullsized":"2023-11-04T01:39:58.872736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.657024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868796+0000","last_change":"2023-11-04T01:39:57.109529+0000","last_active":"2023-11-04T01:39:58.868796+0000","last_peered":"2023-11-04T01:39:58.868796+0000","last_clean":"2023-11-04T01:39:58.868796+0000","last_became_active":"2023-11-04T01:39:57.109076+0000","last_became_peered":"2023-11-04T01:39:57.109076+0000","last_unstale":"2023-11-04T01:39:58.868796+0000","last_undegraded":"2023-11-04T01:39:58.868796+0000","last_fullsized":"2023-11-04T01:39:58.868796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.909590+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.908648+0000","last_became_peered":"2023-11-04T01:39:57.908648+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868661+0000","last_change":"2023-11-04T01:39:57.090615+0000","last_active":"2023-11-04T01:39:58.868661+0000","last_peered":"2023-11-04T01:39:58.868661+0000","last_clean":"2023-11-04T01:39:58.868661+0000","last_became_active":"2023-11-04T01:39:57.090254+0000","last_became_peered":"2023-11-04T01:39:57.090254+0000","last_unstale":"2023-11-04T01:39:58.868661+0000","last_undegraded":"2023-11-04T01:39:58.868661+0000","last_fullsized":"2023-11-04T01:39:58.868661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869182+0000","last_change":"2023-11-04T01:39:57.919597+0000","last_active":"2023-11-04T01:39:59.869182+0000","last_peered":"2023-11-04T01:39:59.869182+0000","last_clean":"2023-11-04T01:39:59.869182+0000","last_became_active":"2023-11-04T01:39:57.918813+0000","last_became_peered":"2023-11-04T01:39:57.918813+0000","last_unstale":"2023-11-04T01:39:59.869182+0000","last_undegraded":"2023-11-04T01:39:59.869182+0000","last_fullsized":"2023-11-04T01:39:59.869182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241973+0000","last_change":"2023-11-04T01:39:57.122022+0000","last_active":"2023-11-04T01:39:59.241973+0000","last_peered":"2023-11-04T01:39:59.241973+0000","last_clean":"2023-11-04T01:39:59.241973+0000","last_became_active":"2023-11-04T01:39:57.121383+0000","last_became_peered":"2023-11-04T01:39:57.121383+0000","last_unstale":"2023-11-04T01:39:59.241973+0000","last_undegraded":"2023-11-04T01:39:59.241973+0000","last_fullsized":"2023-11-04T01:39:59.241973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867389+0000","last_change":"2023-11-04T01:39:57.904433+0000","last_active":"2023-11-04T01:39:59.867389+0000","last_peered":"2023-11-04T01:39:59.867389+0000","last_clean":"2023-11-04T01:39:59.867389+0000","last_became_active":"2023-11-04T01:39:57.903609+0000","last_became_peered":"2023-11-04T01:39:57.903609+0000","last_unstale":"2023-11-04T01:39:59.867389+0000","last_undegraded":"2023-11-04T01:39:59.867389+0000","last_fullsized":"2023-11-04T01:39:59.867389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872398+0000","last_change":"2023-11-04T01:39:57.887415+0000","last_active":"2023-11-04T01:39:58.872398+0000","last_peered":"2023-11-04T01:39:58.872398+0000","last_clean":"2023-11-04T01:39:58.872398+0000","last_became_active":"2023-11-04T01:39:57.886545+0000","last_became_peered":"2023-11-04T01:39:57.886545+0000","last_unstale":"2023-11-04T01:39:58.872398+0000","last_undegraded":"2023-11-04T01:39:58.872398+0000","last_fullsized":"2023-11-04T01:39:58.872398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241975+0000","last_change":"2023-11-04T01:39:57.117914+0000","last_active":"2023-11-04T01:39:59.241975+0000","last_peered":"2023-11-04T01:39:59.241975+0000","last_clean":"2023-11-04T01:39:59.241975+0000","last_became_active":"2023-11-04T01:39:57.117315+0000","last_became_peered":"2023-11-04T01:39:57.117315+0000","last_unstale":"2023-11-04T01:39:59.241975+0000","last_undegraded":"2023-11-04T01:39:59.241975+0000","last_fullsized":"2023-11-04T01:39:59.241975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873666+0000","last_change":"2023-11-04T01:39:57.890838+0000","last_active":"2023-11-04T01:39:58.873666+0000","last_peered":"2023-11-04T01:39:58.873666+0000","last_clean":"2023-11-04T01:39:58.873666+0000","last_became_active":"2023-11-04T01:39:57.890240+0000","last_became_peered":"2023-11-04T01:39:57.890240+0000","last_unstale":"2023-11-04T01:39:58.873666+0000","last_undegraded":"2023-11-04T01:39:58.873666+0000","last_fullsized":"2023-11-04T01:39:58.873666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242364+0000","last_change":"2023-11-04T01:39:57.119136+0000","last_active":"2023-11-04T01:39:59.242364+0000","last_peered":"2023-11-04T01:39:59.242364+0000","last_clean":"2023-11-04T01:39:59.242364+0000","last_became_active":"2023-11-04T01:39:57.117698+0000","last_became_peered":"2023-11-04T01:39:57.117698+0000","last_unstale":"2023-11-04T01:39:59.242364+0000","last_undegraded":"2023-11-04T01:39:59.242364+0000","last_fullsized":"2023-11-04T01:39:59.242364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867841+0000","last_change":"2023-11-04T01:39:57.891105+0000","last_active":"2023-11-04T01:39:59.867841+0000","last_peered":"2023-11-04T01:39:59.867841+0000","last_clean":"2023-11-04T01:39:59.867841+0000","last_became_active":"2023-11-04T01:39:57.890260+0000","last_became_peered":"2023-11-04T01:39:57.890260+0000","last_unstale":"2023-11-04T01:39:59.867841+0000","last_undegraded":"2023-11-04T01:39:59.867841+0000","last_fullsized":"2023-11-04T01:39:59.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869471+0000","last_change":"2023-11-04T01:39:57.086637+0000","last_active":"2023-11-04T01:39:59.869471+0000","last_peered":"2023-11-04T01:39:59.869471+0000","last_clean":"2023-11-04T01:39:59.869471+0000","last_became_active":"2023-11-04T01:39:57.086227+0000","last_became_peered":"2023-11-04T01:39:57.086227+0000","last_unstale":"2023-11-04T01:39:59.869471+0000","last_undegraded":"2023-11-04T01:39:59.869471+0000","last_fullsized":"2023-11-04T01:39:59.869471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:34.010007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869390+0000","last_change":"2023-11-04T01:39:57.910463+0000","last_active":"2023-11-04T01:39:59.869390+0000","last_peered":"2023-11-04T01:39:59.869390+0000","last_clean":"2023-11-04T01:39:59.869390+0000","last_became_active":"2023-11-04T01:39:57.909626+0000","last_became_peered":"2023-11-04T01:39:57.909626+0000","last_unstale":"2023-11-04T01:39:59.869390+0000","last_undegraded":"2023-11-04T01:39:59.869390+0000","last_fullsized":"2023-11-04T01:39:59.869390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868143+0000","last_change":"2023-11-04T01:39:57.110005+0000","last_active":"2023-11-04T01:39:59.868143+0000","last_peered":"2023-11-04T01:39:59.868143+0000","last_clean":"2023-11-04T01:39:59.868143+0000","last_became_active":"2023-11-04T01:39:57.109526+0000","last_became_peered":"2023-11-04T01:39:57.109526+0000","last_unstale":"2023-11-04T01:39:59.868143+0000","last_undegraded":"2023-11-04T01:39:59.868143+0000","last_fullsized":"2023-11-04T01:39:59.868143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:01.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:40:02.046 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:40:02.044+0000 7f373a33d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.060+0000 7f2ee093d640 1 Processor -- start 2023-11-04T01:40:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.060+0000 7f2ee093d640 1 -- start start 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2edc06baa0 0x7f2edc0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2edc0cb9e0 0x7f2edc0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc071450 con 0x7f2edc144500 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc0cbe30 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc0ce8a0 con 0x7f2edc06baa0 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2edc0cb9e0 0x7f2edc0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2edc0cb9e0 0x7f2edc0ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60152/0 (socket says 172.21.15.40:60152) 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 -- 172.21.15.40:0/3111139013 learned_addr learned my addr 172.21.15.40:0/3111139013 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ed9d9b640 1 --2- 172.21.15.40:0/3111139013 >> v2:172.21.15.91:3300/0 conn(0x7f2edc06baa0 0x7f2edc0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 -- 172.21.15.40:0/3111139013 >> v2:172.21.15.91:3300/0 conn(0x7f2edc06baa0 msgr2=0x7f2edc0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 --2- 172.21.15.40:0/3111139013 >> v2:172.21.15.91:3300/0 conn(0x7f2edc06baa0 0x7f2edc0cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 -- 172.21.15.40:0/3111139013 >> v1:172.21.15.91:6789/0 conn(0x7f2edc144500 legacy=0x7f2edc15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 -- 172.21.15.40:0/3111139013 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc071cd0 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2edad9d640 1 --2- 172.21.15.40:0/3111139013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc0ccd00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2edc06dee0 tx=0x7f2ed401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c53136972f460c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ed959a640 1 -- 172.21.15.40:0/3111139013 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40ac600 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ed959a640 1 -- 172.21.15.40:0/3111139013 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed40a8050 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ed959a640 1 -- 172.21.15.40:0/3111139013 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40ac980 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 -- 172.21.15.40:0/3111139013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 msgr2=0x7f2edc0ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.064+0000 7f2ee093d640 1 --2- 172.21.15.40:0/3111139013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc0ccd00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2edc06dee0 tx=0x7f2ed401c490 comp rx=0 tx=0).stop 2023-11-04T01:40:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- 172.21.15.40:0/3111139013 shutdown_connections 2023-11-04T01:40:02.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 --2- 172.21.15.40:0/3111139013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc0ccd00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 --2- 172.21.15.40:0/3111139013 >> v2:172.21.15.91:3300/0 conn(0x7f2edc06baa0 0x7f2edc0cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- 172.21.15.40:0/3111139013 >> 172.21.15.40:0/3111139013 conn(0x7f2edc0b07d0 msgr2=0x7f2edc0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- 172.21.15.40:0/3111139013 shutdown_connections 2023-11-04T01:40:02.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- 172.21.15.40:0/3111139013 wait complete. 2023-11-04T01:40:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 Processor -- start 2023-11-04T01:40:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- start start 2023-11-04T01:40:02.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2edc06baa0 0x7f2edc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2edc144500 0x7f2edc13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0b3b50 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc13e880 con 0x7f2edc144500 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0b3d80 con 0x7f2edc06baa0 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60166/0 (socket says 172.21.15.40:60166) 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 -- 172.21.15.40:0/2146934168 learned_addr learned my addr 172.21.15.40:0/2146934168 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2eda59c640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2edc06baa0 0x7f2edc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2edad9d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2edc144500 0x7f2edc13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 -- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2edc06baa0 msgr2=0x7f2edc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2edc06baa0 0x7f2edc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 -- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2edc144500 msgr2=0x7f2edc13d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2edc144500 0x7f2edc13d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 -- 172.21.15.40:0/2146934168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40094d0 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ed9d9b640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc15a860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000d5f0 tx=0x7f2ed000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00125f0 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed0012750 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc0b4060 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0012ae0 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.068+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc0b4620 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.072+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc074510 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.072+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ed0012c40 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.072+0000 7f2ecaffd640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ebc0664a0 0x7f2ebc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.072+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed0084420 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.072+0000 7f2eda59c640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ebc0664a0 0x7f2ebc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.072+0000 7f2eda59c640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ebc0664a0 0x7f2ebc068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc005530 tx=0x7f2ecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.076+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ed0051800 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.284+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2edc06c5a0 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.284+0000 7f2ecaffd640 1 -- 172.21.15.40:0/2146934168 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7f2ed0054e20 con 0x7f2edc0cb9e0 2023-11-04T01:40:02.289 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:02.289 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061984,"num_in_osds":8,"osd_in_since":1699061975,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":224276480,"bytes_avail":772869836800,"bytes_total":773094113280,"write_bytes_sec":2518,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4260}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-04T01:39:33.150717+0000","services":{}},"progress_events":{}} 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ebc0664a0 msgr2=0x7f2ebc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ebc0664a0 0x7f2ebc068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc005530 tx=0x7f2ecc009040 comp rx=0 tx=0).stop 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 msgr2=0x7f2edc15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc15a860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000d5f0 tx=0x7f2ed000dab0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 shutdown_connections 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ebc0664a0 0x7f2ebc068960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2edc144500 0x7f2edc13d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2edc0cb9e0 0x7f2edc15a860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 --2- 172.21.15.40:0/2146934168 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2edc06baa0 0x7f2edc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 >> 172.21.15.40:0/2146934168 conn(0x7f2edc0b07d0 msgr2=0x7f2edc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 shutdown_connections 2023-11-04T01:40:02.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.288+0000 7f2ee093d640 1 -- 172.21.15.40:0/2146934168 wait complete. 2023-11-04T01:40:02.307 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:40:02.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.412+0000 7f7632947640 1 Processor -- start 2023-11-04T01:40:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.412+0000 7f7632947640 1 -- start start 2023-11-04T01:40:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7632947640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0b4990 0x7f762c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7632947640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f762c0d0690 0x7f762c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7632947640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c0b6070 con 0x7f762c0d0ae0 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7632947640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c0b8ed0 con 0x7f762c0d0690 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7632947640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0b52b0 con 0x7f762c0b4990 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f762c0d0690 0x7f762c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7630ee4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f762c0d0ae0 0x7f762c0cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48858/0 (socket says 172.21.15.40:48858) 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f762c0d0690 0x7f762c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60176/0 (socket says 172.21.15.40:60176) 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f7630ee4640 1 -- 172.21.15.40:0/3435655382 learned_addr learned my addr 172.21.15.40:0/3435655382 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762bfff640 1 --2- 172.21.15.40:0/3435655382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0b4990 0x7f762c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 -- 172.21.15.40:0/3435655382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0b4990 msgr2=0x7f762c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 --2- 172.21.15.40:0/3435655382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0b4990 0x7f762c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 -- 172.21.15.40:0/3435655382 >> v1:172.21.15.40:6789/0 conn(0x7f762c0d0ae0 legacy=0x7f762c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762affd640 1 -- 172.21.15.40:0/3435655382 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431350964 0 0) 0x7f762c0b6070 con 0x7f762c0d0ae0 2023-11-04T01:40:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 -- 172.21.15.40:0/3435655382 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0d1ce0 con 0x7f762c0d0690 2023-11-04T01:40:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762b7fe640 1 --2- 172.21.15.40:0/3435655382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0d0690 0x7f762c0cd770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76140097c0 tx=0x7f761401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bdf72f7268126b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762affd640 1 -- 172.21.15.40:0/3435655382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76140a8970 con 0x7f762c0d0690 2023-11-04T01:40:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762affd640 1 -- 172.21.15.40:0/3435655382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76140a8ad0 con 0x7f762c0d0690 2023-11-04T01:40:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.416+0000 7f762affd640 1 -- 172.21.15.40:0/3435655382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76140a8e60 con 0x7f762c0d0690 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3435655382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0d0690 msgr2=0x7f762c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 --2- 172.21.15.40:0/3435655382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0d0690 0x7f762c0cd770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76140097c0 tx=0x7f761401ec70 comp rx=0 tx=0).stop 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3435655382 shutdown_connections 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 --2- 172.21.15.40:0/3435655382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0d0690 0x7f762c0cd770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 --2- 172.21.15.40:0/3435655382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0b4990 0x7f762c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3435655382 >> 172.21.15.40:0/3435655382 conn(0x7f762c0cf990 msgr2=0x7f762c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3435655382 shutdown_connections 2023-11-04T01:40:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3435655382 wait complete. 2023-11-04T01:40:02.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 Processor -- start 2023-11-04T01:40:02.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- start start 2023-11-04T01:40:02.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 0x7f762c1e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f762c0d0690 0x7f762c158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0d0ae0 0x7f762c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c1e6970 con 0x7f762c0b4990 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0c9fe0 con 0x7f762c0d0690 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ca2a0 con 0x7f762c0d0ae0 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 0x7f762c1e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 0x7f762c1e6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60188/0 (socket says 172.21.15.40:60188) 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 -- 172.21.15.40:0/3865354814 learned_addr learned my addr 172.21.15.40:0/3865354814 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762b7fe640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f762c0d0690 0x7f762c158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7630ee4640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0d0ae0 0x7f762c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 -- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0d0ae0 msgr2=0x7f762c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0d0ae0 0x7f762c0cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 -- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f762c0d0690 msgr2=0x7f762c158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f762c0d0690 0x7f762c158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 -- 172.21.15.40:0/3865354814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614009420 con 0x7f762c0b4990 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762b7fe640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f762c0d0690 0x7f762c158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f762bfff640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 0x7f762c1e6430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f761c007e40 tx=0x7f761c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c014620 con 0x7f762c0b4990 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c00ee90 con 0x7f762c0b4990 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c0149c0 con 0x7f762c0b4990 2023-11-04T01:40:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0ca580 con 0x7f762c0b4990 2023-11-04T01:40:02.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.420+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0cab40 con 0x7f762c0b4990 2023-11-04T01:40:02.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.424+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c0744a0 con 0x7f762c0b4990 2023-11-04T01:40:02.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.424+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f761c014b20 con 0x7f762c0b4990 2023-11-04T01:40:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.424+0000 7f7628ff9640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f760c0664a0 0x7f760c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.424+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f761c084790 con 0x7f762c0b4990 2023-11-04T01:40:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.424+0000 7f762b7fe640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f760c0664a0 0x7f760c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.424+0000 7f762b7fe640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f760c0664a0 0x7f760c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76140b2000 tx=0x7f76140aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.428+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f761c051c00 con 0x7f762c0b4990 2023-11-04T01:40:02.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.576+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f762c0d22a0 con 0x7f760c0664a0 2023-11-04T01:40:02.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.596+0000 7f7628ff9640 1 -- 172.21.15.40:0/3865354814 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264643 (secure 0 0 0) 0x7f76140bb420 con 0x7f760c0664a0 2023-11-04T01:40:02.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f760c0664a0 msgr2=0x7f760c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f760c0664a0 0x7f760c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76140b2000 tx=0x7f76140aa070 comp rx=0 tx=0).stop 2023-11-04T01:40:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 msgr2=0x7f762c1e6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 0x7f762c1e6430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f761c007e40 tx=0x7f761c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 shutdown_connections 2023-11-04T01:40:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f760c0664a0 0x7f760c068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f762c0d0ae0 0x7f762c0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f762c0d0690 0x7f762c158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 --2- 172.21.15.40:0/3865354814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f762c0b4990 0x7f762c1e6430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 >> 172.21.15.40:0/3865354814 conn(0x7f762c0cf990 msgr2=0x7f762c0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 shutdown_connections 2023-11-04T01:40:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:02.604+0000 7f7632947640 1 -- 172.21.15.40:0/3865354814 wait complete. 2023-11-04T01:40:02.622 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-04T01:40:01.748491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.692660"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242480+0000","last_change":"2023-11-04T01:39:57.925789+0000","last_active":"2023-11-04T01:39:59.242480+0000","last_peered":"2023-11-04T01:39:59.242480+0000","last_clean":"2023-11-04T01:39:59.242480+0000","last_became_active":"2023-11-04T01:39:57.925151+0000","last_became_peered":"2023-11-04T01:39:57.925151+0000","last_unstale":"2023-11-04T01:39:59.242480+0000","last_undegraded":"2023-11-04T01:39:59.242480+0000","last_fullsized":"2023-11-04T01:39:59.242480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868458+0000","last_change":"2023-11-04T01:39:57.908425+0000","last_active":"2023-11-04T01:39:58.868458+0000","last_peered":"2023-11-04T01:39:58.868458+0000","last_clean":"2023-11-04T01:39:58.868458+0000","last_became_active":"2023-11-04T01:39:57.907722+0000","last_became_peered":"2023-11-04T01:39:57.907722+0000","last_unstale":"2023-11-04T01:39:58.868458+0000","last_undegraded":"2023-11-04T01:39:58.868458+0000","last_fullsized":"2023-11-04T01:39:58.868458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867715+0000","last_change":"2023-11-04T01:39:57.900305+0000","last_active":"2023-11-04T01:39:59.867715+0000","last_peered":"2023-11-04T01:39:59.867715+0000","last_clean":"2023-11-04T01:39:59.867715+0000","last_became_active":"2023-11-04T01:39:57.897404+0000","last_became_peered":"2023-11-04T01:39:57.897404+0000","last_unstale":"2023-11-04T01:39:59.867715+0000","last_undegraded":"2023-11-04T01:39:59.867715+0000","last_fullsized":"2023-11-04T01:39:59.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873355+0000","last_change":"2023-11-04T01:39:57.903325+0000","last_active":"2023-11-04T01:39:58.873355+0000","last_peered":"2023-11-04T01:39:58.873355+0000","last_clean":"2023-11-04T01:39:58.873355+0000","last_became_active":"2023-11-04T01:39:57.902596+0000","last_became_peered":"2023-11-04T01:39:57.902596+0000","last_unstale":"2023-11-04T01:39:58.873355+0000","last_undegraded":"2023-11-04T01:39:58.873355+0000","last_fullsized":"2023-11-04T01:39:58.873355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241536+0000","last_change":"2023-11-04T01:39:57.926330+0000","last_active":"2023-11-04T01:39:59.241536+0000","last_peered":"2023-11-04T01:39:59.241536+0000","last_clean":"2023-11-04T01:39:59.241536+0000","last_became_active":"2023-11-04T01:39:57.924224+0000","last_became_peered":"2023-11-04T01:39:57.924224+0000","last_unstale":"2023-11-04T01:39:59.241536+0000","last_undegraded":"2023-11-04T01:39:59.241536+0000","last_fullsized":"2023-11-04T01:39:59.241536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871995+0000","last_change":"2023-11-04T01:39:57.892846+0000","last_active":"2023-11-04T01:39:58.871995+0000","last_peered":"2023-11-04T01:39:58.871995+0000","last_clean":"2023-11-04T01:39:58.871995+0000","last_became_active":"2023-11-04T01:39:57.892070+0000","last_became_peered":"2023-11-04T01:39:57.892070+0000","last_unstale":"2023-11-04T01:39:58.871995+0000","last_undegraded":"2023-11-04T01:39:58.871995+0000","last_fullsized":"2023-11-04T01:39:58.871995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241310+0000","last_change":"2023-11-04T01:39:57.925014+0000","last_active":"2023-11-04T01:39:59.241310+0000","last_peered":"2023-11-04T01:39:59.241310+0000","last_clean":"2023-11-04T01:39:59.241310+0000","last_became_active":"2023-11-04T01:39:57.924087+0000","last_became_peered":"2023-11-04T01:39:57.924087+0000","last_unstale":"2023-11-04T01:39:59.241310+0000","last_undegraded":"2023-11-04T01:39:59.241310+0000","last_fullsized":"2023-11-04T01:39:59.241310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867175+0000","last_change":"2023-11-04T01:39:57.899378+0000","last_active":"2023-11-04T01:39:59.867175+0000","last_peered":"2023-11-04T01:39:59.867175+0000","last_clean":"2023-11-04T01:39:59.867175+0000","last_became_active":"2023-11-04T01:39:57.898302+0000","last_became_peered":"2023-11-04T01:39:57.898302+0000","last_unstale":"2023-11-04T01:39:59.867175+0000","last_undegraded":"2023-11-04T01:39:59.867175+0000","last_fullsized":"2023-11-04T01:39:59.867175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242662+0000","last_change":"2023-11-04T01:39:57.926979+0000","last_active":"2023-11-04T01:39:59.242662+0000","last_peered":"2023-11-04T01:39:59.242662+0000","last_clean":"2023-11-04T01:39:59.242662+0000","last_became_active":"2023-11-04T01:39:57.926296+0000","last_became_peered":"2023-11-04T01:39:57.926296+0000","last_unstale":"2023-11-04T01:39:59.242662+0000","last_undegraded":"2023-11-04T01:39:59.242662+0000","last_fullsized":"2023-11-04T01:39:59.242662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:16.450490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.904461+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.903712+0000","last_became_peered":"2023-11-04T01:39:57.903712+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867074+0000","last_change":"2023-11-04T01:39:57.916530+0000","last_active":"2023-11-04T01:39:59.867074+0000","last_peered":"2023-11-04T01:39:59.867074+0000","last_clean":"2023-11-04T01:39:59.867074+0000","last_became_active":"2023-11-04T01:39:57.915736+0000","last_became_peered":"2023-11-04T01:39:57.915736+0000","last_unstale":"2023-11-04T01:39:59.867074+0000","last_undegraded":"2023-11-04T01:39:59.867074+0000","last_fullsized":"2023-11-04T01:39:59.867074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872434+0000","last_change":"2023-11-04T01:39:57.910499+0000","last_active":"2023-11-04T01:39:58.872434+0000","last_peered":"2023-11-04T01:39:58.872434+0000","last_clean":"2023-11-04T01:39:58.872434+0000","last_became_active":"2023-11-04T01:39:57.908955+0000","last_became_peered":"2023-11-04T01:39:57.908955+0000","last_unstale":"2023-11-04T01:39:58.872434+0000","last_undegraded":"2023-11-04T01:39:58.872434+0000","last_fullsized":"2023-11-04T01:39:58.872434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:13.526783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868977+0000","last_change":"2023-11-04T01:39:57.910910+0000","last_active":"2023-11-04T01:39:59.868977+0000","last_peered":"2023-11-04T01:39:59.868977+0000","last_clean":"2023-11-04T01:39:59.868977+0000","last_became_active":"2023-11-04T01:39:57.910137+0000","last_became_peered":"2023-11-04T01:39:57.910137+0000","last_unstale":"2023-11-04T01:39:59.868977+0000","last_undegraded":"2023-11-04T01:39:59.868977+0000","last_fullsized":"2023-11-04T01:39:59.868977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865890+0000","last_change":"2023-11-04T01:39:57.899243+0000","last_active":"2023-11-04T01:39:59.865890+0000","last_peered":"2023-11-04T01:39:59.865890+0000","last_clean":"2023-11-04T01:39:59.865890+0000","last_became_active":"2023-11-04T01:39:57.898485+0000","last_became_peered":"2023-11-04T01:39:57.898485+0000","last_unstale":"2023-11-04T01:39:59.865890+0000","last_undegraded":"2023-11-04T01:39:59.865890+0000","last_fullsized":"2023-11-04T01:39:59.865890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:10.549998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868723+0000","last_change":"2023-11-04T01:39:57.908194+0000","last_active":"2023-11-04T01:39:58.868723+0000","last_peered":"2023-11-04T01:39:58.868723+0000","last_clean":"2023-11-04T01:39:58.868723+0000","last_became_active":"2023-11-04T01:39:57.907392+0000","last_became_peered":"2023-11-04T01:39:57.907392+0000","last_unstale":"2023-11-04T01:39:58.868723+0000","last_undegraded":"2023-11-04T01:39:58.868723+0000","last_fullsized":"2023-11-04T01:39:58.868723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871444+0000","last_change":"2023-11-04T01:39:57.880160+0000","last_active":"2023-11-04T01:39:58.871444+0000","last_peered":"2023-11-04T01:39:58.871444+0000","last_clean":"2023-11-04T01:39:58.871444+0000","last_became_active":"2023-11-04T01:39:57.879279+0000","last_became_peered":"2023-11-04T01:39:57.879279+0000","last_unstale":"2023-11-04T01:39:58.871444+0000","last_undegraded":"2023-11-04T01:39:58.871444+0000","last_fullsized":"2023-11-04T01:39:58.871444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874863+0000","last_change":"2023-11-04T01:39:57.921634+0000","last_active":"2023-11-04T01:39:58.874863+0000","last_peered":"2023-11-04T01:39:58.874863+0000","last_clean":"2023-11-04T01:39:58.874863+0000","last_became_active":"2023-11-04T01:39:57.921093+0000","last_became_peered":"2023-11-04T01:39:57.921093+0000","last_unstale":"2023-11-04T01:39:58.874863+0000","last_undegraded":"2023-11-04T01:39:58.874863+0000","last_fullsized":"2023-11-04T01:39:58.874863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866725+0000","last_change":"2023-11-04T01:39:57.905623+0000","last_active":"2023-11-04T01:39:59.866725+0000","last_peered":"2023-11-04T01:39:59.866725+0000","last_clean":"2023-11-04T01:39:59.866725+0000","last_became_active":"2023-11-04T01:39:57.903240+0000","last_became_peered":"2023-11-04T01:39:57.903240+0000","last_unstale":"2023-11-04T01:39:59.866725+0000","last_undegraded":"2023-11-04T01:39:59.866725+0000","last_fullsized":"2023-11-04T01:39:59.866725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242457+0000","last_change":"2023-11-04T01:39:57.926788+0000","last_active":"2023-11-04T01:39:59.242457+0000","last_peered":"2023-11-04T01:39:59.242457+0000","last_clean":"2023-11-04T01:39:59.242457+0000","last_became_active":"2023-11-04T01:39:57.926166+0000","last_became_peered":"2023-11-04T01:39:57.926166+0000","last_unstale":"2023-11-04T01:39:59.242457+0000","last_undegraded":"2023-11-04T01:39:59.242457+0000","last_fullsized":"2023-11-04T01:39:59.242457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867431+0000","last_change":"2023-11-04T01:39:57.911323+0000","last_active":"2023-11-04T01:39:59.867431+0000","last_peered":"2023-11-04T01:39:59.867431+0000","last_clean":"2023-11-04T01:39:59.867431+0000","last_became_active":"2023-11-04T01:39:57.910177+0000","last_became_peered":"2023-11-04T01:39:57.910177+0000","last_unstale":"2023-11-04T01:39:59.867431+0000","last_undegraded":"2023-11-04T01:39:59.867431+0000","last_fullsized":"2023-11-04T01:39:59.867431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866844+0000","last_change":"2023-11-04T01:39:57.905163+0000","last_active":"2023-11-04T01:39:59.866844+0000","last_peered":"2023-11-04T01:39:59.866844+0000","last_clean":"2023-11-04T01:39:59.866844+0000","last_became_active":"2023-11-04T01:39:57.903224+0000","last_became_peered":"2023-11-04T01:39:57.903224+0000","last_unstale":"2023-11-04T01:39:59.866844+0000","last_undegraded":"2023-11-04T01:39:59.866844+0000","last_fullsized":"2023-11-04T01:39:59.866844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:37.716898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872301+0000","last_change":"2023-11-04T01:39:57.921678+0000","last_active":"2023-11-04T01:39:58.872301+0000","last_peered":"2023-11-04T01:39:58.872301+0000","last_clean":"2023-11-04T01:39:58.872301+0000","last_became_active":"2023-11-04T01:39:57.921140+0000","last_became_peered":"2023-11-04T01:39:57.921140+0000","last_unstale":"2023-11-04T01:39:58.872301+0000","last_undegraded":"2023-11-04T01:39:58.872301+0000","last_fullsized":"2023-11-04T01:39:58.872301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867110+0000","last_change":"2023-11-04T01:39:57.896458+0000","last_active":"2023-11-04T01:39:59.867110+0000","last_peered":"2023-11-04T01:39:59.867110+0000","last_clean":"2023-11-04T01:39:59.867110+0000","last_became_active":"2023-11-04T01:39:57.895714+0000","last_became_peered":"2023-11-04T01:39:57.895714+0000","last_unstale":"2023-11-04T01:39:59.867110+0000","last_undegraded":"2023-11-04T01:39:59.867110+0000","last_fullsized":"2023-11-04T01:39:59.867110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871593+0000","last_change":"2023-11-04T01:39:57.915051+0000","last_active":"2023-11-04T01:39:58.871593+0000","last_peered":"2023-11-04T01:39:58.871593+0000","last_clean":"2023-11-04T01:39:58.871593+0000","last_became_active":"2023-11-04T01:39:57.914155+0000","last_became_peered":"2023-11-04T01:39:57.914155+0000","last_unstale":"2023-11-04T01:39:58.871593+0000","last_undegraded":"2023-11-04T01:39:58.871593+0000","last_fullsized":"2023-11-04T01:39:58.871593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869418+0000","last_change":"2023-11-04T01:39:57.896281+0000","last_active":"2023-11-04T01:39:59.869418+0000","last_peered":"2023-11-04T01:39:59.869418+0000","last_clean":"2023-11-04T01:39:59.869418+0000","last_became_active":"2023-11-04T01:39:57.895403+0000","last_became_peered":"2023-11-04T01:39:57.895403+0000","last_unstale":"2023-11-04T01:39:59.869418+0000","last_undegraded":"2023-11-04T01:39:59.869418+0000","last_fullsized":"2023-11-04T01:39:59.869418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867543+0000","last_change":"2023-11-04T01:39:57.921624+0000","last_active":"2023-11-04T01:39:59.867543+0000","last_peered":"2023-11-04T01:39:59.867543+0000","last_clean":"2023-11-04T01:39:59.867543+0000","last_became_active":"2023-11-04T01:39:57.920996+0000","last_became_peered":"2023-11-04T01:39:57.920996+0000","last_unstale":"2023-11-04T01:39:59.867543+0000","last_undegraded":"2023-11-04T01:39:59.867543+0000","last_fullsized":"2023-11-04T01:39:59.867543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868934+0000","last_change":"2023-11-04T01:39:57.893478+0000","last_active":"2023-11-04T01:39:58.868934+0000","last_peered":"2023-11-04T01:39:58.868934+0000","last_clean":"2023-11-04T01:39:58.868934+0000","last_became_active":"2023-11-04T01:39:57.892683+0000","last_became_peered":"2023-11-04T01:39:57.892683+0000","last_unstale":"2023-11-04T01:39:58.868934+0000","last_undegraded":"2023-11-04T01:39:58.868934+0000","last_fullsized":"2023-11-04T01:39:58.868934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869388+0000","last_change":"2023-11-04T01:39:57.905914+0000","last_active":"2023-11-04T01:39:59.869388+0000","last_peered":"2023-11-04T01:39:59.869388+0000","last_clean":"2023-11-04T01:39:59.869388+0000","last_became_active":"2023-11-04T01:39:57.905063+0000","last_became_peered":"2023-11-04T01:39:57.905063+0000","last_unstale":"2023-11-04T01:39:59.869388+0000","last_undegraded":"2023-11-04T01:39:59.869388+0000","last_fullsized":"2023-11-04T01:39:59.869388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867127+0000","last_change":"2023-11-04T01:39:57.904020+0000","last_active":"2023-11-04T01:39:59.867127+0000","last_peered":"2023-11-04T01:39:59.867127+0000","last_clean":"2023-11-04T01:39:59.867127+0000","last_became_active":"2023-11-04T01:39:57.900757+0000","last_became_peered":"2023-11-04T01:39:57.900757+0000","last_unstale":"2023-11-04T01:39:59.867127+0000","last_undegraded":"2023-11-04T01:39:59.867127+0000","last_fullsized":"2023-11-04T01:39:59.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872605+0000","last_change":"2023-11-04T01:39:57.899405+0000","last_active":"2023-11-04T01:39:58.872605+0000","last_peered":"2023-11-04T01:39:58.872605+0000","last_clean":"2023-11-04T01:39:58.872605+0000","last_became_active":"2023-11-04T01:39:57.898321+0000","last_became_peered":"2023-11-04T01:39:57.898321+0000","last_unstale":"2023-11-04T01:39:58.872605+0000","last_undegraded":"2023-11-04T01:39:58.872605+0000","last_fullsized":"2023-11-04T01:39:58.872605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865624+0000","last_change":"2023-11-04T01:39:57.889138+0000","last_active":"2023-11-04T01:39:59.865624+0000","last_peered":"2023-11-04T01:39:59.865624+0000","last_clean":"2023-11-04T01:39:59.865624+0000","last_became_active":"2023-11-04T01:39:57.888387+0000","last_became_peered":"2023-11-04T01:39:57.888387+0000","last_unstale":"2023-11-04T01:39:59.865624+0000","last_undegraded":"2023-11-04T01:39:59.865624+0000","last_fullsized":"2023-11-04T01:39:59.865624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866818+0000","last_change":"2023-11-04T01:39:57.906169+0000","last_active":"2023-11-04T01:39:59.866818+0000","last_peered":"2023-11-04T01:39:59.866818+0000","last_clean":"2023-11-04T01:39:59.866818+0000","last_became_active":"2023-11-04T01:39:57.905475+0000","last_became_peered":"2023-11-04T01:39:57.905475+0000","last_unstale":"2023-11-04T01:39:59.866818+0000","last_undegraded":"2023-11-04T01:39:59.866818+0000","last_fullsized":"2023-11-04T01:39:59.866818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872249+0000","last_change":"2023-11-04T01:39:57.913166+0000","last_active":"2023-11-04T01:39:58.872249+0000","last_peered":"2023-11-04T01:39:58.872249+0000","last_clean":"2023-11-04T01:39:58.872249+0000","last_became_active":"2023-11-04T01:39:57.912369+0000","last_became_peered":"2023-11-04T01:39:57.912369+0000","last_unstale":"2023-11-04T01:39:58.872249+0000","last_undegraded":"2023-11-04T01:39:58.872249+0000","last_fullsized":"2023-11-04T01:39:58.872249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:37.941972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869281+0000","last_change":"2023-11-04T01:39:57.109460+0000","last_active":"2023-11-04T01:39:59.869281+0000","last_peered":"2023-11-04T01:39:59.869281+0000","last_clean":"2023-11-04T01:39:59.869281+0000","last_became_active":"2023-11-04T01:39:57.109057+0000","last_became_peered":"2023-11-04T01:39:57.109057+0000","last_unstale":"2023-11-04T01:39:59.869281+0000","last_undegraded":"2023-11-04T01:39:59.869281+0000","last_fullsized":"2023-11-04T01:39:59.869281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867312+0000","last_change":"2023-11-04T01:39:57.899906+0000","last_active":"2023-11-04T01:39:59.867312+0000","last_peered":"2023-11-04T01:39:59.867312+0000","last_clean":"2023-11-04T01:39:59.867312+0000","last_became_active":"2023-11-04T01:39:57.890228+0000","last_became_peered":"2023-11-04T01:39:57.890228+0000","last_unstale":"2023-11-04T01:39:59.867312+0000","last_undegraded":"2023-11-04T01:39:59.867312+0000","last_fullsized":"2023-11-04T01:39:59.867312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866758+0000","last_change":"2023-11-04T01:39:57.107398+0000","last_active":"2023-11-04T01:39:59.866758+0000","last_peered":"2023-11-04T01:39:59.866758+0000","last_clean":"2023-11-04T01:39:59.866758+0000","last_became_active":"2023-11-04T01:39:57.105860+0000","last_became_peered":"2023-11-04T01:39:57.105860+0000","last_unstale":"2023-11-04T01:39:59.866758+0000","last_undegraded":"2023-11-04T01:39:59.866758+0000","last_fullsized":"2023-11-04T01:39:59.866758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868547+0000","last_change":"2023-11-04T01:39:57.104185+0000","last_active":"2023-11-04T01:39:59.868547+0000","last_peered":"2023-11-04T01:39:59.868547+0000","last_clean":"2023-11-04T01:39:59.868547+0000","last_became_active":"2023-11-04T01:39:57.103699+0000","last_became_peered":"2023-11-04T01:39:57.103699+0000","last_unstale":"2023-11-04T01:39:59.868547+0000","last_undegraded":"2023-11-04T01:39:59.868547+0000","last_fullsized":"2023-11-04T01:39:59.868547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867352+0000","last_change":"2023-11-04T01:39:57.901259+0000","last_active":"2023-11-04T01:39:59.867352+0000","last_peered":"2023-11-04T01:39:59.867352+0000","last_clean":"2023-11-04T01:39:59.867352+0000","last_became_active":"2023-11-04T01:39:57.899400+0000","last_became_peered":"2023-11-04T01:39:57.899400+0000","last_unstale":"2023-11-04T01:39:59.867352+0000","last_undegraded":"2023-11-04T01:39:59.867352+0000","last_fullsized":"2023-11-04T01:39:59.867352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871665+0000","last_change":"2023-11-04T01:39:57.103508+0000","last_active":"2023-11-04T01:39:58.871665+0000","last_peered":"2023-11-04T01:39:58.871665+0000","last_clean":"2023-11-04T01:39:58.871665+0000","last_became_active":"2023-11-04T01:39:57.102807+0000","last_became_peered":"2023-11-04T01:39:57.102807+0000","last_unstale":"2023-11-04T01:39:58.871665+0000","last_undegraded":"2023-11-04T01:39:58.871665+0000","last_fullsized":"2023-11-04T01:39:58.871665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868552+0000","last_change":"2023-11-04T01:39:57.914207+0000","last_active":"2023-11-04T01:39:58.868552+0000","last_peered":"2023-11-04T01:39:58.868552+0000","last_clean":"2023-11-04T01:39:58.868552+0000","last_became_active":"2023-11-04T01:39:57.913328+0000","last_became_peered":"2023-11-04T01:39:57.913328+0000","last_unstale":"2023-11-04T01:39:58.868552+0000","last_undegraded":"2023-11-04T01:39:58.868552+0000","last_fullsized":"2023-11-04T01:39:58.868552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867354+0000","last_change":"2023-11-04T01:39:57.116533+0000","last_active":"2023-11-04T01:39:59.867354+0000","last_peered":"2023-11-04T01:39:59.867354+0000","last_clean":"2023-11-04T01:39:59.867354+0000","last_became_active":"2023-11-04T01:39:57.115805+0000","last_became_peered":"2023-11-04T01:39:57.115805+0000","last_unstale":"2023-11-04T01:39:59.867354+0000","last_undegraded":"2023-11-04T01:39:59.867354+0000","last_fullsized":"2023-11-04T01:39:59.867354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874659+0000","last_change":"2023-11-04T01:39:57.900836+0000","last_active":"2023-11-04T01:39:58.874659+0000","last_peered":"2023-11-04T01:39:58.874659+0000","last_clean":"2023-11-04T01:39:58.874659+0000","last_became_active":"2023-11-04T01:39:57.900068+0000","last_became_peered":"2023-11-04T01:39:57.900068+0000","last_unstale":"2023-11-04T01:39:58.874659+0000","last_undegraded":"2023-11-04T01:39:58.874659+0000","last_fullsized":"2023-11-04T01:39:58.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874438+0000","last_change":"2023-11-04T01:39:57.112275+0000","last_active":"2023-11-04T01:39:58.874438+0000","last_peered":"2023-11-04T01:39:58.874438+0000","last_clean":"2023-11-04T01:39:58.874438+0000","last_became_active":"2023-11-04T01:39:57.111384+0000","last_became_peered":"2023-11-04T01:39:57.111384+0000","last_unstale":"2023-11-04T01:39:58.874438+0000","last_undegraded":"2023-11-04T01:39:58.874438+0000","last_fullsized":"2023-11-04T01:39:58.874438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.460433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868016+0000","last_change":"2023-11-04T01:39:57.889775+0000","last_active":"2023-11-04T01:39:59.868016+0000","last_peered":"2023-11-04T01:39:59.868016+0000","last_clean":"2023-11-04T01:39:59.868016+0000","last_became_active":"2023-11-04T01:39:57.888973+0000","last_became_peered":"2023-11-04T01:39:57.888973+0000","last_unstale":"2023-11-04T01:39:59.868016+0000","last_undegraded":"2023-11-04T01:39:59.868016+0000","last_fullsized":"2023-11-04T01:39:59.868016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869054+0000","last_change":"2023-11-04T01:39:57.104163+0000","last_active":"2023-11-04T01:39:58.869054+0000","last_peered":"2023-11-04T01:39:58.869054+0000","last_clean":"2023-11-04T01:39:58.869054+0000","last_became_active":"2023-11-04T01:39:57.103774+0000","last_became_peered":"2023-11-04T01:39:57.103774+0000","last_unstale":"2023-11-04T01:39:58.869054+0000","last_undegraded":"2023-11-04T01:39:58.869054+0000","last_fullsized":"2023-11-04T01:39:58.869054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872752+0000","last_change":"2023-11-04T01:39:57.908429+0000","last_active":"2023-11-04T01:39:58.872752+0000","last_peered":"2023-11-04T01:39:58.872752+0000","last_clean":"2023-11-04T01:39:58.872752+0000","last_became_active":"2023-11-04T01:39:57.904836+0000","last_became_peered":"2023-11-04T01:39:57.904836+0000","last_unstale":"2023-11-04T01:39:58.872752+0000","last_undegraded":"2023-11-04T01:39:58.872752+0000","last_fullsized":"2023-11-04T01:39:58.872752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867284+0000","last_change":"2023-11-04T01:39:57.104076+0000","last_active":"2023-11-04T01:39:59.867284+0000","last_peered":"2023-11-04T01:39:59.867284+0000","last_clean":"2023-11-04T01:39:59.867284+0000","last_became_active":"2023-11-04T01:39:57.103284+0000","last_became_peered":"2023-11-04T01:39:57.103284+0000","last_unstale":"2023-11-04T01:39:59.867284+0000","last_undegraded":"2023-11-04T01:39:59.867284+0000","last_fullsized":"2023-11-04T01:39:59.867284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242226+0000","last_change":"2023-11-04T01:39:57.925026+0000","last_active":"2023-11-04T01:39:59.242226+0000","last_peered":"2023-11-04T01:39:59.242226+0000","last_clean":"2023-11-04T01:39:59.242226+0000","last_became_active":"2023-11-04T01:39:57.924278+0000","last_became_peered":"2023-11-04T01:39:57.924278+0000","last_unstale":"2023-11-04T01:39:59.242226+0000","last_undegraded":"2023-11-04T01:39:59.242226+0000","last_fullsized":"2023-11-04T01:39:59.242226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867432+0000","last_change":"2023-11-04T01:39:57.089537+0000","last_active":"2023-11-04T01:39:59.867432+0000","last_peered":"2023-11-04T01:39:59.867432+0000","last_clean":"2023-11-04T01:39:59.867432+0000","last_became_active":"2023-11-04T01:39:57.088369+0000","last_became_peered":"2023-11-04T01:39:57.088369+0000","last_unstale":"2023-11-04T01:39:59.867432+0000","last_undegraded":"2023-11-04T01:39:59.867432+0000","last_fullsized":"2023-11-04T01:39:59.867432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866389+0000","last_change":"2023-11-04T01:39:57.921257+0000","last_active":"2023-11-04T01:39:59.866389+0000","last_peered":"2023-11-04T01:39:59.866389+0000","last_clean":"2023-11-04T01:39:59.866389+0000","last_became_active":"2023-11-04T01:39:57.920025+0000","last_became_peered":"2023-11-04T01:39:57.920025+0000","last_unstale":"2023-11-04T01:39:59.866389+0000","last_undegraded":"2023-11-04T01:39:59.866389+0000","last_fullsized":"2023-11-04T01:39:59.866389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:17.627984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872817+0000","last_change":"2023-11-04T01:39:57.114536+0000","last_active":"2023-11-04T01:39:58.872817+0000","last_peered":"2023-11-04T01:39:58.872817+0000","last_clean":"2023-11-04T01:39:58.872817+0000","last_became_active":"2023-11-04T01:39:57.114040+0000","last_became_peered":"2023-11-04T01:39:57.114040+0000","last_unstale":"2023-11-04T01:39:58.872817+0000","last_undegraded":"2023-11-04T01:39:58.872817+0000","last_fullsized":"2023-11-04T01:39:58.872817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241638+0000","last_change":"2023-11-04T01:39:57.927347+0000","last_active":"2023-11-04T01:39:59.241638+0000","last_peered":"2023-11-04T01:39:59.241638+0000","last_clean":"2023-11-04T01:39:59.241638+0000","last_became_active":"2023-11-04T01:39:57.925411+0000","last_became_peered":"2023-11-04T01:39:57.925411+0000","last_unstale":"2023-11-04T01:39:59.241638+0000","last_undegraded":"2023-11-04T01:39:59.241638+0000","last_fullsized":"2023-11-04T01:39:59.241638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866704+0000","last_change":"2023-11-04T01:39:57.104862+0000","last_active":"2023-11-04T01:39:59.866704+0000","last_peered":"2023-11-04T01:39:59.866704+0000","last_clean":"2023-11-04T01:39:59.866704+0000","last_became_active":"2023-11-04T01:39:57.103985+0000","last_became_peered":"2023-11-04T01:39:57.103985+0000","last_unstale":"2023-11-04T01:39:59.866704+0000","last_undegraded":"2023-11-04T01:39:59.866704+0000","last_fullsized":"2023-11-04T01:39:59.866704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:42.123401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866814+0000","last_change":"2023-11-04T01:39:57.903968+0000","last_active":"2023-11-04T01:39:59.866814+0000","last_peered":"2023-11-04T01:39:59.866814+0000","last_clean":"2023-11-04T01:39:59.866814+0000","last_became_active":"2023-11-04T01:39:57.903269+0000","last_became_peered":"2023-11-04T01:39:57.903269+0000","last_unstale":"2023-11-04T01:39:59.866814+0000","last_undegraded":"2023-11-04T01:39:59.866814+0000","last_fullsized":"2023-11-04T01:39:59.866814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865260+0000","last_change":"2023-11-04T01:39:57.083110+0000","last_active":"2023-11-04T01:39:59.865260+0000","last_peered":"2023-11-04T01:39:59.865260+0000","last_clean":"2023-11-04T01:39:59.865260+0000","last_became_active":"2023-11-04T01:39:57.082483+0000","last_became_peered":"2023-11-04T01:39:57.082483+0000","last_unstale":"2023-11-04T01:39:59.865260+0000","last_undegraded":"2023-11-04T01:39:59.865260+0000","last_fullsized":"2023-11-04T01:39:59.865260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:49.424318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241483+0000","last_change":"2023-11-04T01:39:57.925941+0000","last_active":"2023-11-04T01:39:59.241483+0000","last_peered":"2023-11-04T01:39:59.241483+0000","last_clean":"2023-11-04T01:39:59.241483+0000","last_became_active":"2023-11-04T01:39:57.925338+0000","last_became_peered":"2023-11-04T01:39:57.925338+0000","last_unstale":"2023-11-04T01:39:59.241483+0000","last_undegraded":"2023-11-04T01:39:59.241483+0000","last_fullsized":"2023-11-04T01:39:59.241483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873396+0000","last_change":"2023-11-04T01:39:57.089157+0000","last_active":"2023-11-04T01:39:58.873396+0000","last_peered":"2023-11-04T01:39:58.873396+0000","last_clean":"2023-11-04T01:39:58.873396+0000","last_became_active":"2023-11-04T01:39:57.088373+0000","last_became_peered":"2023-11-04T01:39:57.088373+0000","last_unstale":"2023-11-04T01:39:58.873396+0000","last_undegraded":"2023-11-04T01:39:58.873396+0000","last_fullsized":"2023-11-04T01:39:58.873396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.666272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242512+0000","last_change":"2023-11-04T01:39:57.926318+0000","last_active":"2023-11-04T01:39:59.242512+0000","last_peered":"2023-11-04T01:39:59.242512+0000","last_clean":"2023-11-04T01:39:59.242512+0000","last_became_active":"2023-11-04T01:39:57.924998+0000","last_became_peered":"2023-11-04T01:39:57.924998+0000","last_unstale":"2023-11-04T01:39:59.242512+0000","last_undegraded":"2023-11-04T01:39:59.242512+0000","last_fullsized":"2023-11-04T01:39:59.242512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:37.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866744+0000","last_change":"2023-11-04T01:39:57.085866+0000","last_active":"2023-11-04T01:39:59.866744+0000","last_peered":"2023-11-04T01:39:59.866744+0000","last_clean":"2023-11-04T01:39:59.866744+0000","last_became_active":"2023-11-04T01:39:57.085501+0000","last_became_peered":"2023-11-04T01:39:57.085501+0000","last_unstale":"2023-11-04T01:39:59.866744+0000","last_undegraded":"2023-11-04T01:39:59.866744+0000","last_fullsized":"2023-11-04T01:39:59.866744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242796+0000","last_change":"2023-11-04T01:39:57.927164+0000","last_active":"2023-11-04T01:39:59.242796+0000","last_peered":"2023-11-04T01:39:59.242796+0000","last_clean":"2023-11-04T01:39:59.242796+0000","last_became_active":"2023-11-04T01:39:57.926817+0000","last_became_peered":"2023-11-04T01:39:57.926817+0000","last_unstale":"2023-11-04T01:39:59.242796+0000","last_undegraded":"2023-11-04T01:39:59.242796+0000","last_fullsized":"2023-11-04T01:39:59.242796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:14.194200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869221+0000","last_change":"2023-11-04T01:39:57.088611+0000","last_active":"2023-11-04T01:39:58.869221+0000","last_peered":"2023-11-04T01:39:58.869221+0000","last_clean":"2023-11-04T01:39:58.869221+0000","last_became_active":"2023-11-04T01:39:57.088214+0000","last_became_peered":"2023-11-04T01:39:57.088214+0000","last_unstale":"2023-11-04T01:39:58.869221+0000","last_undegraded":"2023-11-04T01:39:58.869221+0000","last_fullsized":"2023-11-04T01:39:58.869221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873978+0000","last_change":"2023-11-04T01:39:57.916146+0000","last_active":"2023-11-04T01:39:58.873978+0000","last_peered":"2023-11-04T01:39:58.873978+0000","last_clean":"2023-11-04T01:39:58.873978+0000","last_became_active":"2023-11-04T01:39:57.914346+0000","last_became_peered":"2023-11-04T01:39:57.914346+0000","last_unstale":"2023-11-04T01:39:58.873978+0000","last_undegraded":"2023-11-04T01:39:58.873978+0000","last_fullsized":"2023-11-04T01:39:58.873978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866304+0000","last_change":"2023-11-04T01:39:57.091428+0000","last_active":"2023-11-04T01:39:59.866304+0000","last_peered":"2023-11-04T01:39:59.866304+0000","last_clean":"2023-11-04T01:39:59.866304+0000","last_became_active":"2023-11-04T01:39:57.090767+0000","last_became_peered":"2023-11-04T01:39:57.090767+0000","last_unstale":"2023-11-04T01:39:59.866304+0000","last_undegraded":"2023-11-04T01:39:59.866304+0000","last_fullsized":"2023-11-04T01:39:59.866304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242170+0000","last_change":"2023-11-04T01:39:57.925040+0000","last_active":"2023-11-04T01:39:59.242170+0000","last_peered":"2023-11-04T01:39:59.242170+0000","last_clean":"2023-11-04T01:39:59.242170+0000","last_became_active":"2023-11-04T01:39:57.924201+0000","last_became_peered":"2023-11-04T01:39:57.924201+0000","last_unstale":"2023-11-04T01:39:59.242170+0000","last_undegraded":"2023-11-04T01:39:59.242170+0000","last_fullsized":"2023-11-04T01:39:59.242170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:39:57.898357+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:57.898357+0000","last_peered":"2023-11-04T01:39:57.898357+0000","last_clean":"2023-11-04T01:39:57.898357+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:57.898357+0000","last_undegraded":"2023-11-04T01:39:57.898357+0000","last_fullsized":"2023-11-04T01:39:57.898357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871472+0000","last_change":"2023-11-04T01:39:57.093034+0000","last_active":"2023-11-04T01:39:58.871472+0000","last_peered":"2023-11-04T01:39:58.871472+0000","last_clean":"2023-11-04T01:39:58.871472+0000","last_became_active":"2023-11-04T01:39:57.092158+0000","last_became_peered":"2023-11-04T01:39:57.092158+0000","last_unstale":"2023-11-04T01:39:58.871472+0000","last_undegraded":"2023-11-04T01:39:58.871472+0000","last_fullsized":"2023-11-04T01:39:58.871472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869011+0000","last_change":"2023-11-04T01:39:57.899138+0000","last_active":"2023-11-04T01:39:59.869011+0000","last_peered":"2023-11-04T01:39:59.869011+0000","last_clean":"2023-11-04T01:39:59.869011+0000","last_became_active":"2023-11-04T01:39:57.898313+0000","last_became_peered":"2023-11-04T01:39:57.898313+0000","last_unstale":"2023-11-04T01:39:59.869011+0000","last_undegraded":"2023-11-04T01:39:59.869011+0000","last_fullsized":"2023-11-04T01:39:59.869011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241057+0000","last_change":"2023-11-04T01:39:57.119969+0000","last_active":"2023-11-04T01:39:59.241057+0000","last_peered":"2023-11-04T01:39:59.241057+0000","last_clean":"2023-11-04T01:39:59.241057+0000","last_became_active":"2023-11-04T01:39:57.118250+0000","last_became_peered":"2023-11-04T01:39:57.118250+0000","last_unstale":"2023-11-04T01:39:59.241057+0000","last_undegraded":"2023-11-04T01:39:59.241057+0000","last_fullsized":"2023-11-04T01:39:59.241057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865841+0000","last_change":"2023-11-04T01:39:57.888041+0000","last_active":"2023-11-04T01:39:59.865841+0000","last_peered":"2023-11-04T01:39:59.865841+0000","last_clean":"2023-11-04T01:39:59.865841+0000","last_became_active":"2023-11-04T01:39:57.887240+0000","last_became_peered":"2023-11-04T01:39:57.887240+0000","last_unstale":"2023-11-04T01:39:59.865841+0000","last_undegraded":"2023-11-04T01:39:59.865841+0000","last_fullsized":"2023-11-04T01:39:59.865841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:00.328908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865848+0000","last_change":"2023-11-04T01:39:57.086891+0000","last_active":"2023-11-04T01:39:59.865848+0000","last_peered":"2023-11-04T01:39:59.865848+0000","last_clean":"2023-11-04T01:39:59.865848+0000","last_became_active":"2023-11-04T01:39:57.086482+0000","last_became_peered":"2023-11-04T01:39:57.086482+0000","last_unstale":"2023-11-04T01:39:59.865848+0000","last_undegraded":"2023-11-04T01:39:59.865848+0000","last_fullsized":"2023-11-04T01:39:59.865848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868387+0000","last_change":"2023-11-04T01:39:57.908737+0000","last_active":"2023-11-04T01:39:58.868387+0000","last_peered":"2023-11-04T01:39:58.868387+0000","last_clean":"2023-11-04T01:39:58.868387+0000","last_became_active":"2023-11-04T01:39:57.907965+0000","last_became_peered":"2023-11-04T01:39:57.907965+0000","last_unstale":"2023-11-04T01:39:58.868387+0000","last_undegraded":"2023-11-04T01:39:58.868387+0000","last_fullsized":"2023-11-04T01:39:58.868387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873025+0000","last_change":"2023-11-04T01:39:57.101402+0000","last_active":"2023-11-04T01:39:58.873025+0000","last_peered":"2023-11-04T01:39:58.873025+0000","last_clean":"2023-11-04T01:39:58.873025+0000","last_became_active":"2023-11-04T01:39:57.100736+0000","last_became_peered":"2023-11-04T01:39:57.100736+0000","last_unstale":"2023-11-04T01:39:58.873025+0000","last_undegraded":"2023-11-04T01:39:58.873025+0000","last_fullsized":"2023-11-04T01:39:58.873025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872956+0000","last_change":"2023-11-04T01:39:57.912134+0000","last_active":"2023-11-04T01:39:58.872956+0000","last_peered":"2023-11-04T01:39:58.872956+0000","last_clean":"2023-11-04T01:39:58.872956+0000","last_became_active":"2023-11-04T01:39:57.909396+0000","last_became_peered":"2023-11-04T01:39:57.909396+0000","last_unstale":"2023-11-04T01:39:58.872956+0000","last_undegraded":"2023-11-04T01:39:58.872956+0000","last_fullsized":"2023-11-04T01:39:58.872956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868443+0000","last_change":"2023-11-04T01:39:57.086794+0000","last_active":"2023-11-04T01:39:58.868443+0000","last_peered":"2023-11-04T01:39:58.868443+0000","last_clean":"2023-11-04T01:39:58.868443+0000","last_became_active":"2023-11-04T01:39:57.086448+0000","last_became_peered":"2023-11-04T01:39:57.086448+0000","last_unstale":"2023-11-04T01:39:58.868443+0000","last_undegraded":"2023-11-04T01:39:58.868443+0000","last_fullsized":"2023-11-04T01:39:58.868443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872724+0000","last_change":"2023-11-04T01:39:57.889388+0000","last_active":"2023-11-04T01:39:58.872724+0000","last_peered":"2023-11-04T01:39:58.872724+0000","last_clean":"2023-11-04T01:39:58.872724+0000","last_became_active":"2023-11-04T01:39:57.888326+0000","last_became_peered":"2023-11-04T01:39:57.888326+0000","last_unstale":"2023-11-04T01:39:58.872724+0000","last_undegraded":"2023-11-04T01:39:58.872724+0000","last_fullsized":"2023-11-04T01:39:58.872724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242500+0000","last_change":"2023-11-04T01:39:57.119606+0000","last_active":"2023-11-04T01:39:59.242500+0000","last_peered":"2023-11-04T01:39:59.242500+0000","last_clean":"2023-11-04T01:39:59.242500+0000","last_became_active":"2023-11-04T01:39:57.118501+0000","last_became_peered":"2023-11-04T01:39:57.118501+0000","last_unstale":"2023-11-04T01:39:59.242500+0000","last_undegraded":"2023-11-04T01:39:59.242500+0000","last_fullsized":"2023-11-04T01:39:59.242500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868674+0000","last_change":"2023-11-04T01:39:57.896425+0000","last_active":"2023-11-04T01:39:58.868674+0000","last_peered":"2023-11-04T01:39:58.868674+0000","last_clean":"2023-11-04T01:39:58.868674+0000","last_became_active":"2023-11-04T01:39:57.895472+0000","last_became_peered":"2023-11-04T01:39:57.895472+0000","last_unstale":"2023-11-04T01:39:58.868674+0000","last_undegraded":"2023-11-04T01:39:58.868674+0000","last_fullsized":"2023-11-04T01:39:58.868674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868581+0000","last_change":"2023-11-04T01:39:57.102873+0000","last_active":"2023-11-04T01:39:58.868581+0000","last_peered":"2023-11-04T01:39:58.868581+0000","last_clean":"2023-11-04T01:39:58.868581+0000","last_became_active":"2023-11-04T01:39:57.102500+0000","last_became_peered":"2023-11-04T01:39:57.102500+0000","last_unstale":"2023-11-04T01:39:58.868581+0000","last_undegraded":"2023-11-04T01:39:58.868581+0000","last_fullsized":"2023-11-04T01:39:58.868581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869619+0000","last_change":"2023-11-04T01:39:57.920760+0000","last_active":"2023-11-04T01:39:59.869619+0000","last_peered":"2023-11-04T01:39:59.869619+0000","last_clean":"2023-11-04T01:39:59.869619+0000","last_became_active":"2023-11-04T01:39:57.920036+0000","last_became_peered":"2023-11-04T01:39:57.920036+0000","last_unstale":"2023-11-04T01:39:59.869619+0000","last_undegraded":"2023-11-04T01:39:59.869619+0000","last_fullsized":"2023-11-04T01:39:59.869619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867441+0000","last_change":"2023-11-04T01:39:57.119006+0000","last_active":"2023-11-04T01:39:59.867441+0000","last_peered":"2023-11-04T01:39:59.867441+0000","last_clean":"2023-11-04T01:39:59.867441+0000","last_became_active":"2023-11-04T01:39:57.118360+0000","last_became_peered":"2023-11-04T01:39:57.118360+0000","last_unstale":"2023-11-04T01:39:59.867441+0000","last_undegraded":"2023-11-04T01:39:59.867441+0000","last_fullsized":"2023-11-04T01:39:59.867441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867208+0000","last_change":"2023-11-04T01:39:57.899526+0000","last_active":"2023-11-04T01:39:59.867208+0000","last_peered":"2023-11-04T01:39:59.867208+0000","last_clean":"2023-11-04T01:39:59.867208+0000","last_became_active":"2023-11-04T01:39:57.898663+0000","last_became_peered":"2023-11-04T01:39:57.898663+0000","last_unstale":"2023-11-04T01:39:59.867208+0000","last_undegraded":"2023-11-04T01:39:59.867208+0000","last_fullsized":"2023-11-04T01:39:59.867208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.240990+0000","last_change":"2023-11-04T01:39:57.118965+0000","last_active":"2023-11-04T01:39:59.240990+0000","last_peered":"2023-11-04T01:39:59.240990+0000","last_clean":"2023-11-04T01:39:59.240990+0000","last_became_active":"2023-11-04T01:39:57.117428+0000","last_became_peered":"2023-11-04T01:39:57.117428+0000","last_unstale":"2023-11-04T01:39:59.240990+0000","last_undegraded":"2023-11-04T01:39:59.240990+0000","last_fullsized":"2023-11-04T01:39:59.240990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872736+0000","last_change":"2023-11-04T01:39:57.897837+0000","last_active":"2023-11-04T01:39:58.872736+0000","last_peered":"2023-11-04T01:39:58.872736+0000","last_clean":"2023-11-04T01:39:58.872736+0000","last_became_active":"2023-11-04T01:39:57.897180+0000","last_became_peered":"2023-11-04T01:39:57.897180+0000","last_unstale":"2023-11-04T01:39:58.872736+0000","last_undegraded":"2023-11-04T01:39:58.872736+0000","last_fullsized":"2023-11-04T01:39:58.872736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.657024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868796+0000","last_change":"2023-11-04T01:39:57.109529+0000","last_active":"2023-11-04T01:39:58.868796+0000","last_peered":"2023-11-04T01:39:58.868796+0000","last_clean":"2023-11-04T01:39:58.868796+0000","last_became_active":"2023-11-04T01:39:57.109076+0000","last_became_peered":"2023-11-04T01:39:57.109076+0000","last_unstale":"2023-11-04T01:39:58.868796+0000","last_undegraded":"2023-11-04T01:39:58.868796+0000","last_fullsized":"2023-11-04T01:39:58.868796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.909590+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.908648+0000","last_became_peered":"2023-11-04T01:39:57.908648+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868661+0000","last_change":"2023-11-04T01:39:57.090615+0000","last_active":"2023-11-04T01:39:58.868661+0000","last_peered":"2023-11-04T01:39:58.868661+0000","last_clean":"2023-11-04T01:39:58.868661+0000","last_became_active":"2023-11-04T01:39:57.090254+0000","last_became_peered":"2023-11-04T01:39:57.090254+0000","last_unstale":"2023-11-04T01:39:58.868661+0000","last_undegraded":"2023-11-04T01:39:58.868661+0000","last_fullsized":"2023-11-04T01:39:58.868661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869182+0000","last_change":"2023-11-04T01:39:57.919597+0000","last_active":"2023-11-04T01:39:59.869182+0000","last_peered":"2023-11-04T01:39:59.869182+0000","last_clean":"2023-11-04T01:39:59.869182+0000","last_became_active":"2023-11-04T01:39:57.918813+0000","last_became_peered":"2023-11-04T01:39:57.918813+0000","last_unstale":"2023-11-04T01:39:59.869182+0000","last_undegraded":"2023-11-04T01:39:59.869182+0000","last_fullsized":"2023-11-04T01:39:59.869182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241973+0000","last_change":"2023-11-04T01:39:57.122022+0000","last_active":"2023-11-04T01:39:59.241973+0000","last_peered":"2023-11-04T01:39:59.241973+0000","last_clean":"2023-11-04T01:39:59.241973+0000","last_became_active":"2023-11-04T01:39:57.121383+0000","last_became_peered":"2023-11-04T01:39:57.121383+0000","last_unstale":"2023-11-04T01:39:59.241973+0000","last_undegraded":"2023-11-04T01:39:59.241973+0000","last_fullsized":"2023-11-04T01:39:59.241973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867389+0000","last_change":"2023-11-04T01:39:57.904433+0000","last_active":"2023-11-04T01:39:59.867389+0000","last_peered":"2023-11-04T01:39:59.867389+0000","last_clean":"2023-11-04T01:39:59.867389+0000","last_became_active":"2023-11-04T01:39:57.903609+0000","last_became_peered":"2023-11-04T01:39:57.903609+0000","last_unstale":"2023-11-04T01:39:59.867389+0000","last_undegraded":"2023-11-04T01:39:59.867389+0000","last_fullsized":"2023-11-04T01:39:59.867389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872398+0000","last_change":"2023-11-04T01:39:57.887415+0000","last_active":"2023-11-04T01:39:58.872398+0000","last_peered":"2023-11-04T01:39:58.872398+0000","last_clean":"2023-11-04T01:39:58.872398+0000","last_became_active":"2023-11-04T01:39:57.886545+0000","last_became_peered":"2023-11-04T01:39:57.886545+0000","last_unstale":"2023-11-04T01:39:58.872398+0000","last_undegraded":"2023-11-04T01:39:58.872398+0000","last_fullsized":"2023-11-04T01:39:58.872398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241975+0000","last_change":"2023-11-04T01:39:57.117914+0000","last_active":"2023-11-04T01:39:59.241975+0000","last_peered":"2023-11-04T01:39:59.241975+0000","last_clean":"2023-11-04T01:39:59.241975+0000","last_became_active":"2023-11-04T01:39:57.117315+0000","last_became_peered":"2023-11-04T01:39:57.117315+0000","last_unstale":"2023-11-04T01:39:59.241975+0000","last_undegraded":"2023-11-04T01:39:59.241975+0000","last_fullsized":"2023-11-04T01:39:59.241975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873666+0000","last_change":"2023-11-04T01:39:57.890838+0000","last_active":"2023-11-04T01:39:58.873666+0000","last_peered":"2023-11-04T01:39:58.873666+0000","last_clean":"2023-11-04T01:39:58.873666+0000","last_became_active":"2023-11-04T01:39:57.890240+0000","last_became_peered":"2023-11-04T01:39:57.890240+0000","last_unstale":"2023-11-04T01:39:58.873666+0000","last_undegraded":"2023-11-04T01:39:58.873666+0000","last_fullsized":"2023-11-04T01:39:58.873666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242364+0000","last_change":"2023-11-04T01:39:57.119136+0000","last_active":"2023-11-04T01:39:59.242364+0000","last_peered":"2023-11-04T01:39:59.242364+0000","last_clean":"2023-11-04T01:39:59.242364+0000","last_became_active":"2023-11-04T01:39:57.117698+0000","last_became_peered":"2023-11-04T01:39:57.117698+0000","last_unstale":"2023-11-04T01:39:59.242364+0000","last_undegraded":"2023-11-04T01:39:59.242364+0000","last_fullsized":"2023-11-04T01:39:59.242364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867841+0000","last_change":"2023-11-04T01:39:57.891105+0000","last_active":"2023-11-04T01:39:59.867841+0000","last_peered":"2023-11-04T01:39:59.867841+0000","last_clean":"2023-11-04T01:39:59.867841+0000","last_became_active":"2023-11-04T01:39:57.890260+0000","last_became_peered":"2023-11-04T01:39:57.890260+0000","last_unstale":"2023-11-04T01:39:59.867841+0000","last_undegraded":"2023-11-04T01:39:59.867841+0000","last_fullsized":"2023-11-04T01:39:59.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869471+0000","last_change":"2023-11-04T01:39:57.086637+0000","last_active":"2023-11-04T01:39:59.869471+0000","last_peered":"2023-11-04T01:39:59.869471+0000","last_clean":"2023-11-04T01:39:59.869471+0000","last_became_active":"2023-11-04T01:39:57.086227+0000","last_became_peered":"2023-11-04T01:39:57.086227+0000","last_unstale":"2023-11-04T01:39:59.869471+0000","last_undegraded":"2023-11-04T01:39:59.869471+0000","last_fullsized":"2023-11-04T01:39:59.869471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:34.010007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869390+0000","last_change":"2023-11-04T01:39:57.910463+0000","last_active":"2023-11-04T01:39:59.869390+0000","last_peered":"2023-11-04T01:39:59.869390+0000","last_clean":"2023-11-04T01:39:59.869390+0000","last_became_active":"2023-11-04T01:39:57.909626+0000","last_became_peered":"2023-11-04T01:39:57.909626+0000","last_unstale":"2023-11-04T01:39:59.869390+0000","last_undegraded":"2023-11-04T01:39:59.869390+0000","last_fullsized":"2023-11-04T01:39:59.869390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868143+0000","last_change":"2023-11-04T01:39:57.110005+0000","last_active":"2023-11-04T01:39:59.868143+0000","last_peered":"2023-11-04T01:39:59.868143+0000","last_clean":"2023-11-04T01:39:59.868143+0000","last_became_active":"2023-11-04T01:39:57.109526+0000","last_became_peered":"2023-11-04T01:39:57.109526+0000","last_unstale":"2023-11-04T01:39:59.868143+0000","last_undegraded":"2023-11-04T01:39:59.868143+0000","last_fullsized":"2023-11-04T01:39:59.868143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:05.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 Processor -- start 2023-11-04T01:40:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 -- start start 2023-11-04T01:40:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0690 0x7fe7940b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7940d0ae0 0x7fe7940b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940b6070 con 0x7fe7940b4990 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940b8ed0 con 0x7fe7940d0ae0 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79c54c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940d1ce0 con 0x7fe7940d0690 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79a2e8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7940b4990 0x7fe7940b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48868/0 (socket says 172.21.15.40:48868) 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79a2e8640 1 -- 172.21.15.40:0/845965579 learned_addr learned my addr 172.21.15.40:0/845965579 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.760+0000 7fe79aae9640 1 --2- 172.21.15.40:0/845965579 >> v2:172.21.15.40:3300/0 conn(0x7fe7940d0ae0 0x7fe7940b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe799ae7640 1 --2- 172.21.15.40:0/845965579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0690 0x7fe7940b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe7992e6640 1 -- 172.21.15.40:0/845965579 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882172942 0 0) 0x7fe7940b6070 con 0x7fe7940b4990 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe7992e6640 1 -- 172.21.15.40:0/845965579 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe780003530 con 0x7fe7940b4990 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79aae9640 1 -- 172.21.15.40:0/845965579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0690 msgr2=0x7fe7940b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:05.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79aae9640 1 --2- 172.21.15.40:0/845965579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0690 0x7fe7940b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79aae9640 1 -- 172.21.15.40:0/845965579 >> v1:172.21.15.40:6789/0 conn(0x7fe7940b4990 legacy=0x7fe7940b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79aae9640 1 -- 172.21.15.40:0/845965579 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940d1fc0 con 0x7fe7940d0ae0 2023-11-04T01:40:05.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79aae9640 1 --2- 172.21.15.40:0/845965579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940d0ae0 0x7fe7940b6a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009d90 tx=0x7fe78c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd2acc5c34fb2dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:05.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe7992e6640 1 -- 172.21.15.40:0/845965579 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0af600 con 0x7fe7940d0ae0 2023-11-04T01:40:05.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe7992e6640 1 -- 172.21.15.40:0/845965579 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0ab050 con 0x7fe7940d0ae0 2023-11-04T01:40:05.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe7992e6640 1 -- 172.21.15.40:0/845965579 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0af980 con 0x7fe7940d0ae0 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 -- 172.21.15.40:0/845965579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940d0ae0 msgr2=0x7fe7940b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 --2- 172.21.15.40:0/845965579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940d0ae0 0x7fe7940b6a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009d90 tx=0x7fe78c01f130 comp rx=0 tx=0).stop 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 -- 172.21.15.40:0/845965579 shutdown_connections 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 --2- 172.21.15.40:0/845965579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940d0ae0 0x7fe7940b6a20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 --2- 172.21.15.40:0/845965579 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0690 0x7fe7940b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 -- 172.21.15.40:0/845965579 >> 172.21.15.40:0/845965579 conn(0x7fe7940cf990 msgr2=0x7fe7940cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 -- 172.21.15.40:0/845965579 shutdown_connections 2023-11-04T01:40:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.764+0000 7fe79c54c640 1 -- 172.21.15.40:0/845965579 wait complete. 2023-11-04T01:40:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 Processor -- start 2023-11-04T01:40:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- start start 2023-11-04T01:40:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 0x7fe794160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7940d0690 0x7fe79415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0ae0 0x7fe79415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79414c990 con 0x7fe7940b4990 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941605d0 con 0x7fe7940d0690 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415fc00 con 0x7fe7940d0ae0 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 0x7fe794160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 0x7fe794160090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60208/0 (socket says 172.21.15.40:60208) 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 -- 172.21.15.40:0/2856474549 learned_addr learned my addr 172.21.15.40:0/2856474549 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79aae9640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0ae0 0x7fe79415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe799ae7640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7940d0690 0x7fe79415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 -- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0ae0 msgr2=0x7fe79415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0ae0 0x7fe79415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 -- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7940d0690 msgr2=0x7fe79415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7940d0690 0x7fe79415b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 -- 172.21.15.40:0/2856474549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009a70 con 0x7fe7940b4990 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79a2e8640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 0x7fe794160090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c450 tx=0x7fe79000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790005cf0 con 0x7fe7940b4990 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe790005e50 con 0x7fe7940b4990 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7941f6b80 con 0x7fe7940b4990 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790007270 con 0x7fe7940b4990 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79415f5b0 con 0x7fe7940b4990 2023-11-04T01:40:05.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79415f410 con 0x7fe7940b4990 2023-11-04T01:40:05.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.768+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7900073d0 con 0x7fe7940b4990 2023-11-04T01:40:05.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.772+0000 7fe78affd640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe7780664a0 0x7fe778068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.772+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe790083250 con 0x7fe7940b4990 2023-11-04T01:40:05.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.772+0000 7fe799ae7640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe7780664a0 0x7fe778068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.772+0000 7fe799ae7640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe7780664a0 0x7fe778068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe7941f5bf0 tx=0x7fe784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:05.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.776+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe79415f410 con 0x7fe7940b4990 2023-11-04T01:40:05.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.932+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7940d2580 con 0x7fe7780664a0 2023-11-04T01:40:05.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.952+0000 7fe78affd640 1 -- 172.21.15.40:0/2856474549 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264615 (secure 0 0 0) 0x7fe7840118b0 con 0x7fe7780664a0 2023-11-04T01:40:05.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe7780664a0 msgr2=0x7fe778068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe7780664a0 0x7fe778068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe7941f5bf0 tx=0x7fe784008040 comp rx=0 tx=0).stop 2023-11-04T01:40:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 msgr2=0x7fe794160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 0x7fe794160090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe79000c450 tx=0x7fe79000c910 comp rx=0 tx=0).stop 2023-11-04T01:40:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 shutdown_connections 2023-11-04T01:40:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe7780664a0 0x7fe778068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe7940d0ae0 0x7fe79415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe7940d0690 0x7fe79415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 --2- 172.21.15.40:0/2856474549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7940b4990 0x7fe794160090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 >> 172.21.15.40:0/2856474549 conn(0x7fe7940cf990 msgr2=0x7fe79415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 shutdown_connections 2023-11-04T01:40:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:05.956+0000 7fe79c54c640 1 -- 172.21.15.40:0/2856474549 wait complete. 2023-11-04T01:40:05.976 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-04T01:40:05.749970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002756"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242480+0000","last_change":"2023-11-04T01:39:57.925789+0000","last_active":"2023-11-04T01:39:59.242480+0000","last_peered":"2023-11-04T01:39:59.242480+0000","last_clean":"2023-11-04T01:39:59.242480+0000","last_became_active":"2023-11-04T01:39:57.925151+0000","last_became_peered":"2023-11-04T01:39:57.925151+0000","last_unstale":"2023-11-04T01:39:59.242480+0000","last_undegraded":"2023-11-04T01:39:59.242480+0000","last_fullsized":"2023-11-04T01:39:59.242480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868458+0000","last_change":"2023-11-04T01:39:57.908425+0000","last_active":"2023-11-04T01:39:58.868458+0000","last_peered":"2023-11-04T01:39:58.868458+0000","last_clean":"2023-11-04T01:39:58.868458+0000","last_became_active":"2023-11-04T01:39:57.907722+0000","last_became_peered":"2023-11-04T01:39:57.907722+0000","last_unstale":"2023-11-04T01:39:58.868458+0000","last_undegraded":"2023-11-04T01:39:58.868458+0000","last_fullsized":"2023-11-04T01:39:58.868458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867715+0000","last_change":"2023-11-04T01:39:57.900305+0000","last_active":"2023-11-04T01:39:59.867715+0000","last_peered":"2023-11-04T01:39:59.867715+0000","last_clean":"2023-11-04T01:39:59.867715+0000","last_became_active":"2023-11-04T01:39:57.897404+0000","last_became_peered":"2023-11-04T01:39:57.897404+0000","last_unstale":"2023-11-04T01:39:59.867715+0000","last_undegraded":"2023-11-04T01:39:59.867715+0000","last_fullsized":"2023-11-04T01:39:59.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873355+0000","last_change":"2023-11-04T01:39:57.903325+0000","last_active":"2023-11-04T01:39:58.873355+0000","last_peered":"2023-11-04T01:39:58.873355+0000","last_clean":"2023-11-04T01:39:58.873355+0000","last_became_active":"2023-11-04T01:39:57.902596+0000","last_became_peered":"2023-11-04T01:39:57.902596+0000","last_unstale":"2023-11-04T01:39:58.873355+0000","last_undegraded":"2023-11-04T01:39:58.873355+0000","last_fullsized":"2023-11-04T01:39:58.873355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241536+0000","last_change":"2023-11-04T01:39:57.926330+0000","last_active":"2023-11-04T01:39:59.241536+0000","last_peered":"2023-11-04T01:39:59.241536+0000","last_clean":"2023-11-04T01:39:59.241536+0000","last_became_active":"2023-11-04T01:39:57.924224+0000","last_became_peered":"2023-11-04T01:39:57.924224+0000","last_unstale":"2023-11-04T01:39:59.241536+0000","last_undegraded":"2023-11-04T01:39:59.241536+0000","last_fullsized":"2023-11-04T01:39:59.241536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871995+0000","last_change":"2023-11-04T01:39:57.892846+0000","last_active":"2023-11-04T01:39:58.871995+0000","last_peered":"2023-11-04T01:39:58.871995+0000","last_clean":"2023-11-04T01:39:58.871995+0000","last_became_active":"2023-11-04T01:39:57.892070+0000","last_became_peered":"2023-11-04T01:39:57.892070+0000","last_unstale":"2023-11-04T01:39:58.871995+0000","last_undegraded":"2023-11-04T01:39:58.871995+0000","last_fullsized":"2023-11-04T01:39:58.871995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241310+0000","last_change":"2023-11-04T01:39:57.925014+0000","last_active":"2023-11-04T01:39:59.241310+0000","last_peered":"2023-11-04T01:39:59.241310+0000","last_clean":"2023-11-04T01:39:59.241310+0000","last_became_active":"2023-11-04T01:39:57.924087+0000","last_became_peered":"2023-11-04T01:39:57.924087+0000","last_unstale":"2023-11-04T01:39:59.241310+0000","last_undegraded":"2023-11-04T01:39:59.241310+0000","last_fullsized":"2023-11-04T01:39:59.241310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867175+0000","last_change":"2023-11-04T01:39:57.899378+0000","last_active":"2023-11-04T01:39:59.867175+0000","last_peered":"2023-11-04T01:39:59.867175+0000","last_clean":"2023-11-04T01:39:59.867175+0000","last_became_active":"2023-11-04T01:39:57.898302+0000","last_became_peered":"2023-11-04T01:39:57.898302+0000","last_unstale":"2023-11-04T01:39:59.867175+0000","last_undegraded":"2023-11-04T01:39:59.867175+0000","last_fullsized":"2023-11-04T01:39:59.867175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242662+0000","last_change":"2023-11-04T01:39:57.926979+0000","last_active":"2023-11-04T01:39:59.242662+0000","last_peered":"2023-11-04T01:39:59.242662+0000","last_clean":"2023-11-04T01:39:59.242662+0000","last_became_active":"2023-11-04T01:39:57.926296+0000","last_became_peered":"2023-11-04T01:39:57.926296+0000","last_unstale":"2023-11-04T01:39:59.242662+0000","last_undegraded":"2023-11-04T01:39:59.242662+0000","last_fullsized":"2023-11-04T01:39:59.242662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:16.450490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.904461+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.903712+0000","last_became_peered":"2023-11-04T01:39:57.903712+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867074+0000","last_change":"2023-11-04T01:39:57.916530+0000","last_active":"2023-11-04T01:39:59.867074+0000","last_peered":"2023-11-04T01:39:59.867074+0000","last_clean":"2023-11-04T01:39:59.867074+0000","last_became_active":"2023-11-04T01:39:57.915736+0000","last_became_peered":"2023-11-04T01:39:57.915736+0000","last_unstale":"2023-11-04T01:39:59.867074+0000","last_undegraded":"2023-11-04T01:39:59.867074+0000","last_fullsized":"2023-11-04T01:39:59.867074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872434+0000","last_change":"2023-11-04T01:39:57.910499+0000","last_active":"2023-11-04T01:39:58.872434+0000","last_peered":"2023-11-04T01:39:58.872434+0000","last_clean":"2023-11-04T01:39:58.872434+0000","last_became_active":"2023-11-04T01:39:57.908955+0000","last_became_peered":"2023-11-04T01:39:57.908955+0000","last_unstale":"2023-11-04T01:39:58.872434+0000","last_undegraded":"2023-11-04T01:39:58.872434+0000","last_fullsized":"2023-11-04T01:39:58.872434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:13.526783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868977+0000","last_change":"2023-11-04T01:39:57.910910+0000","last_active":"2023-11-04T01:39:59.868977+0000","last_peered":"2023-11-04T01:39:59.868977+0000","last_clean":"2023-11-04T01:39:59.868977+0000","last_became_active":"2023-11-04T01:39:57.910137+0000","last_became_peered":"2023-11-04T01:39:57.910137+0000","last_unstale":"2023-11-04T01:39:59.868977+0000","last_undegraded":"2023-11-04T01:39:59.868977+0000","last_fullsized":"2023-11-04T01:39:59.868977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865890+0000","last_change":"2023-11-04T01:39:57.899243+0000","last_active":"2023-11-04T01:39:59.865890+0000","last_peered":"2023-11-04T01:39:59.865890+0000","last_clean":"2023-11-04T01:39:59.865890+0000","last_became_active":"2023-11-04T01:39:57.898485+0000","last_became_peered":"2023-11-04T01:39:57.898485+0000","last_unstale":"2023-11-04T01:39:59.865890+0000","last_undegraded":"2023-11-04T01:39:59.865890+0000","last_fullsized":"2023-11-04T01:39:59.865890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:10.549998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868723+0000","last_change":"2023-11-04T01:39:57.908194+0000","last_active":"2023-11-04T01:39:58.868723+0000","last_peered":"2023-11-04T01:39:58.868723+0000","last_clean":"2023-11-04T01:39:58.868723+0000","last_became_active":"2023-11-04T01:39:57.907392+0000","last_became_peered":"2023-11-04T01:39:57.907392+0000","last_unstale":"2023-11-04T01:39:58.868723+0000","last_undegraded":"2023-11-04T01:39:58.868723+0000","last_fullsized":"2023-11-04T01:39:58.868723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871444+0000","last_change":"2023-11-04T01:39:57.880160+0000","last_active":"2023-11-04T01:39:58.871444+0000","last_peered":"2023-11-04T01:39:58.871444+0000","last_clean":"2023-11-04T01:39:58.871444+0000","last_became_active":"2023-11-04T01:39:57.879279+0000","last_became_peered":"2023-11-04T01:39:57.879279+0000","last_unstale":"2023-11-04T01:39:58.871444+0000","last_undegraded":"2023-11-04T01:39:58.871444+0000","last_fullsized":"2023-11-04T01:39:58.871444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874863+0000","last_change":"2023-11-04T01:39:57.921634+0000","last_active":"2023-11-04T01:39:58.874863+0000","last_peered":"2023-11-04T01:39:58.874863+0000","last_clean":"2023-11-04T01:39:58.874863+0000","last_became_active":"2023-11-04T01:39:57.921093+0000","last_became_peered":"2023-11-04T01:39:57.921093+0000","last_unstale":"2023-11-04T01:39:58.874863+0000","last_undegraded":"2023-11-04T01:39:58.874863+0000","last_fullsized":"2023-11-04T01:39:58.874863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866725+0000","last_change":"2023-11-04T01:39:57.905623+0000","last_active":"2023-11-04T01:39:59.866725+0000","last_peered":"2023-11-04T01:39:59.866725+0000","last_clean":"2023-11-04T01:39:59.866725+0000","last_became_active":"2023-11-04T01:39:57.903240+0000","last_became_peered":"2023-11-04T01:39:57.903240+0000","last_unstale":"2023-11-04T01:39:59.866725+0000","last_undegraded":"2023-11-04T01:39:59.866725+0000","last_fullsized":"2023-11-04T01:39:59.866725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242457+0000","last_change":"2023-11-04T01:39:57.926788+0000","last_active":"2023-11-04T01:39:59.242457+0000","last_peered":"2023-11-04T01:39:59.242457+0000","last_clean":"2023-11-04T01:39:59.242457+0000","last_became_active":"2023-11-04T01:39:57.926166+0000","last_became_peered":"2023-11-04T01:39:57.926166+0000","last_unstale":"2023-11-04T01:39:59.242457+0000","last_undegraded":"2023-11-04T01:39:59.242457+0000","last_fullsized":"2023-11-04T01:39:59.242457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867431+0000","last_change":"2023-11-04T01:39:57.911323+0000","last_active":"2023-11-04T01:39:59.867431+0000","last_peered":"2023-11-04T01:39:59.867431+0000","last_clean":"2023-11-04T01:39:59.867431+0000","last_became_active":"2023-11-04T01:39:57.910177+0000","last_became_peered":"2023-11-04T01:39:57.910177+0000","last_unstale":"2023-11-04T01:39:59.867431+0000","last_undegraded":"2023-11-04T01:39:59.867431+0000","last_fullsized":"2023-11-04T01:39:59.867431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866844+0000","last_change":"2023-11-04T01:39:57.905163+0000","last_active":"2023-11-04T01:39:59.866844+0000","last_peered":"2023-11-04T01:39:59.866844+0000","last_clean":"2023-11-04T01:39:59.866844+0000","last_became_active":"2023-11-04T01:39:57.903224+0000","last_became_peered":"2023-11-04T01:39:57.903224+0000","last_unstale":"2023-11-04T01:39:59.866844+0000","last_undegraded":"2023-11-04T01:39:59.866844+0000","last_fullsized":"2023-11-04T01:39:59.866844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:37.716898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872301+0000","last_change":"2023-11-04T01:39:57.921678+0000","last_active":"2023-11-04T01:39:58.872301+0000","last_peered":"2023-11-04T01:39:58.872301+0000","last_clean":"2023-11-04T01:39:58.872301+0000","last_became_active":"2023-11-04T01:39:57.921140+0000","last_became_peered":"2023-11-04T01:39:57.921140+0000","last_unstale":"2023-11-04T01:39:58.872301+0000","last_undegraded":"2023-11-04T01:39:58.872301+0000","last_fullsized":"2023-11-04T01:39:58.872301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867110+0000","last_change":"2023-11-04T01:39:57.896458+0000","last_active":"2023-11-04T01:39:59.867110+0000","last_peered":"2023-11-04T01:39:59.867110+0000","last_clean":"2023-11-04T01:39:59.867110+0000","last_became_active":"2023-11-04T01:39:57.895714+0000","last_became_peered":"2023-11-04T01:39:57.895714+0000","last_unstale":"2023-11-04T01:39:59.867110+0000","last_undegraded":"2023-11-04T01:39:59.867110+0000","last_fullsized":"2023-11-04T01:39:59.867110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871593+0000","last_change":"2023-11-04T01:39:57.915051+0000","last_active":"2023-11-04T01:39:58.871593+0000","last_peered":"2023-11-04T01:39:58.871593+0000","last_clean":"2023-11-04T01:39:58.871593+0000","last_became_active":"2023-11-04T01:39:57.914155+0000","last_became_peered":"2023-11-04T01:39:57.914155+0000","last_unstale":"2023-11-04T01:39:58.871593+0000","last_undegraded":"2023-11-04T01:39:58.871593+0000","last_fullsized":"2023-11-04T01:39:58.871593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869418+0000","last_change":"2023-11-04T01:39:57.896281+0000","last_active":"2023-11-04T01:39:59.869418+0000","last_peered":"2023-11-04T01:39:59.869418+0000","last_clean":"2023-11-04T01:39:59.869418+0000","last_became_active":"2023-11-04T01:39:57.895403+0000","last_became_peered":"2023-11-04T01:39:57.895403+0000","last_unstale":"2023-11-04T01:39:59.869418+0000","last_undegraded":"2023-11-04T01:39:59.869418+0000","last_fullsized":"2023-11-04T01:39:59.869418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867543+0000","last_change":"2023-11-04T01:39:57.921624+0000","last_active":"2023-11-04T01:39:59.867543+0000","last_peered":"2023-11-04T01:39:59.867543+0000","last_clean":"2023-11-04T01:39:59.867543+0000","last_became_active":"2023-11-04T01:39:57.920996+0000","last_became_peered":"2023-11-04T01:39:57.920996+0000","last_unstale":"2023-11-04T01:39:59.867543+0000","last_undegraded":"2023-11-04T01:39:59.867543+0000","last_fullsized":"2023-11-04T01:39:59.867543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868934+0000","last_change":"2023-11-04T01:39:57.893478+0000","last_active":"2023-11-04T01:39:58.868934+0000","last_peered":"2023-11-04T01:39:58.868934+0000","last_clean":"2023-11-04T01:39:58.868934+0000","last_became_active":"2023-11-04T01:39:57.892683+0000","last_became_peered":"2023-11-04T01:39:57.892683+0000","last_unstale":"2023-11-04T01:39:58.868934+0000","last_undegraded":"2023-11-04T01:39:58.868934+0000","last_fullsized":"2023-11-04T01:39:58.868934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869388+0000","last_change":"2023-11-04T01:39:57.905914+0000","last_active":"2023-11-04T01:39:59.869388+0000","last_peered":"2023-11-04T01:39:59.869388+0000","last_clean":"2023-11-04T01:39:59.869388+0000","last_became_active":"2023-11-04T01:39:57.905063+0000","last_became_peered":"2023-11-04T01:39:57.905063+0000","last_unstale":"2023-11-04T01:39:59.869388+0000","last_undegraded":"2023-11-04T01:39:59.869388+0000","last_fullsized":"2023-11-04T01:39:59.869388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867127+0000","last_change":"2023-11-04T01:39:57.904020+0000","last_active":"2023-11-04T01:39:59.867127+0000","last_peered":"2023-11-04T01:39:59.867127+0000","last_clean":"2023-11-04T01:39:59.867127+0000","last_became_active":"2023-11-04T01:39:57.900757+0000","last_became_peered":"2023-11-04T01:39:57.900757+0000","last_unstale":"2023-11-04T01:39:59.867127+0000","last_undegraded":"2023-11-04T01:39:59.867127+0000","last_fullsized":"2023-11-04T01:39:59.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872605+0000","last_change":"2023-11-04T01:39:57.899405+0000","last_active":"2023-11-04T01:39:58.872605+0000","last_peered":"2023-11-04T01:39:58.872605+0000","last_clean":"2023-11-04T01:39:58.872605+0000","last_became_active":"2023-11-04T01:39:57.898321+0000","last_became_peered":"2023-11-04T01:39:57.898321+0000","last_unstale":"2023-11-04T01:39:58.872605+0000","last_undegraded":"2023-11-04T01:39:58.872605+0000","last_fullsized":"2023-11-04T01:39:58.872605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865624+0000","last_change":"2023-11-04T01:39:57.889138+0000","last_active":"2023-11-04T01:39:59.865624+0000","last_peered":"2023-11-04T01:39:59.865624+0000","last_clean":"2023-11-04T01:39:59.865624+0000","last_became_active":"2023-11-04T01:39:57.888387+0000","last_became_peered":"2023-11-04T01:39:57.888387+0000","last_unstale":"2023-11-04T01:39:59.865624+0000","last_undegraded":"2023-11-04T01:39:59.865624+0000","last_fullsized":"2023-11-04T01:39:59.865624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866818+0000","last_change":"2023-11-04T01:39:57.906169+0000","last_active":"2023-11-04T01:39:59.866818+0000","last_peered":"2023-11-04T01:39:59.866818+0000","last_clean":"2023-11-04T01:39:59.866818+0000","last_became_active":"2023-11-04T01:39:57.905475+0000","last_became_peered":"2023-11-04T01:39:57.905475+0000","last_unstale":"2023-11-04T01:39:59.866818+0000","last_undegraded":"2023-11-04T01:39:59.866818+0000","last_fullsized":"2023-11-04T01:39:59.866818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872249+0000","last_change":"2023-11-04T01:39:57.913166+0000","last_active":"2023-11-04T01:39:58.872249+0000","last_peered":"2023-11-04T01:39:58.872249+0000","last_clean":"2023-11-04T01:39:58.872249+0000","last_became_active":"2023-11-04T01:39:57.912369+0000","last_became_peered":"2023-11-04T01:39:57.912369+0000","last_unstale":"2023-11-04T01:39:58.872249+0000","last_undegraded":"2023-11-04T01:39:58.872249+0000","last_fullsized":"2023-11-04T01:39:58.872249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:37.941972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869281+0000","last_change":"2023-11-04T01:39:57.109460+0000","last_active":"2023-11-04T01:39:59.869281+0000","last_peered":"2023-11-04T01:39:59.869281+0000","last_clean":"2023-11-04T01:39:59.869281+0000","last_became_active":"2023-11-04T01:39:57.109057+0000","last_became_peered":"2023-11-04T01:39:57.109057+0000","last_unstale":"2023-11-04T01:39:59.869281+0000","last_undegraded":"2023-11-04T01:39:59.869281+0000","last_fullsized":"2023-11-04T01:39:59.869281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867312+0000","last_change":"2023-11-04T01:39:57.899906+0000","last_active":"2023-11-04T01:39:59.867312+0000","last_peered":"2023-11-04T01:39:59.867312+0000","last_clean":"2023-11-04T01:39:59.867312+0000","last_became_active":"2023-11-04T01:39:57.890228+0000","last_became_peered":"2023-11-04T01:39:57.890228+0000","last_unstale":"2023-11-04T01:39:59.867312+0000","last_undegraded":"2023-11-04T01:39:59.867312+0000","last_fullsized":"2023-11-04T01:39:59.867312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866758+0000","last_change":"2023-11-04T01:39:57.107398+0000","last_active":"2023-11-04T01:39:59.866758+0000","last_peered":"2023-11-04T01:39:59.866758+0000","last_clean":"2023-11-04T01:39:59.866758+0000","last_became_active":"2023-11-04T01:39:57.105860+0000","last_became_peered":"2023-11-04T01:39:57.105860+0000","last_unstale":"2023-11-04T01:39:59.866758+0000","last_undegraded":"2023-11-04T01:39:59.866758+0000","last_fullsized":"2023-11-04T01:39:59.866758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868547+0000","last_change":"2023-11-04T01:39:57.104185+0000","last_active":"2023-11-04T01:39:59.868547+0000","last_peered":"2023-11-04T01:39:59.868547+0000","last_clean":"2023-11-04T01:39:59.868547+0000","last_became_active":"2023-11-04T01:39:57.103699+0000","last_became_peered":"2023-11-04T01:39:57.103699+0000","last_unstale":"2023-11-04T01:39:59.868547+0000","last_undegraded":"2023-11-04T01:39:59.868547+0000","last_fullsized":"2023-11-04T01:39:59.868547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867352+0000","last_change":"2023-11-04T01:39:57.901259+0000","last_active":"2023-11-04T01:39:59.867352+0000","last_peered":"2023-11-04T01:39:59.867352+0000","last_clean":"2023-11-04T01:39:59.867352+0000","last_became_active":"2023-11-04T01:39:57.899400+0000","last_became_peered":"2023-11-04T01:39:57.899400+0000","last_unstale":"2023-11-04T01:39:59.867352+0000","last_undegraded":"2023-11-04T01:39:59.867352+0000","last_fullsized":"2023-11-04T01:39:59.867352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871665+0000","last_change":"2023-11-04T01:39:57.103508+0000","last_active":"2023-11-04T01:39:58.871665+0000","last_peered":"2023-11-04T01:39:58.871665+0000","last_clean":"2023-11-04T01:39:58.871665+0000","last_became_active":"2023-11-04T01:39:57.102807+0000","last_became_peered":"2023-11-04T01:39:57.102807+0000","last_unstale":"2023-11-04T01:39:58.871665+0000","last_undegraded":"2023-11-04T01:39:58.871665+0000","last_fullsized":"2023-11-04T01:39:58.871665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868552+0000","last_change":"2023-11-04T01:39:57.914207+0000","last_active":"2023-11-04T01:39:58.868552+0000","last_peered":"2023-11-04T01:39:58.868552+0000","last_clean":"2023-11-04T01:39:58.868552+0000","last_became_active":"2023-11-04T01:39:57.913328+0000","last_became_peered":"2023-11-04T01:39:57.913328+0000","last_unstale":"2023-11-04T01:39:58.868552+0000","last_undegraded":"2023-11-04T01:39:58.868552+0000","last_fullsized":"2023-11-04T01:39:58.868552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867354+0000","last_change":"2023-11-04T01:39:57.116533+0000","last_active":"2023-11-04T01:39:59.867354+0000","last_peered":"2023-11-04T01:39:59.867354+0000","last_clean":"2023-11-04T01:39:59.867354+0000","last_became_active":"2023-11-04T01:39:57.115805+0000","last_became_peered":"2023-11-04T01:39:57.115805+0000","last_unstale":"2023-11-04T01:39:59.867354+0000","last_undegraded":"2023-11-04T01:39:59.867354+0000","last_fullsized":"2023-11-04T01:39:59.867354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874659+0000","last_change":"2023-11-04T01:39:57.900836+0000","last_active":"2023-11-04T01:39:58.874659+0000","last_peered":"2023-11-04T01:39:58.874659+0000","last_clean":"2023-11-04T01:39:58.874659+0000","last_became_active":"2023-11-04T01:39:57.900068+0000","last_became_peered":"2023-11-04T01:39:57.900068+0000","last_unstale":"2023-11-04T01:39:58.874659+0000","last_undegraded":"2023-11-04T01:39:58.874659+0000","last_fullsized":"2023-11-04T01:39:58.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874438+0000","last_change":"2023-11-04T01:39:57.112275+0000","last_active":"2023-11-04T01:39:58.874438+0000","last_peered":"2023-11-04T01:39:58.874438+0000","last_clean":"2023-11-04T01:39:58.874438+0000","last_became_active":"2023-11-04T01:39:57.111384+0000","last_became_peered":"2023-11-04T01:39:57.111384+0000","last_unstale":"2023-11-04T01:39:58.874438+0000","last_undegraded":"2023-11-04T01:39:58.874438+0000","last_fullsized":"2023-11-04T01:39:58.874438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.460433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868016+0000","last_change":"2023-11-04T01:39:57.889775+0000","last_active":"2023-11-04T01:39:59.868016+0000","last_peered":"2023-11-04T01:39:59.868016+0000","last_clean":"2023-11-04T01:39:59.868016+0000","last_became_active":"2023-11-04T01:39:57.888973+0000","last_became_peered":"2023-11-04T01:39:57.888973+0000","last_unstale":"2023-11-04T01:39:59.868016+0000","last_undegraded":"2023-11-04T01:39:59.868016+0000","last_fullsized":"2023-11-04T01:39:59.868016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869054+0000","last_change":"2023-11-04T01:39:57.104163+0000","last_active":"2023-11-04T01:39:58.869054+0000","last_peered":"2023-11-04T01:39:58.869054+0000","last_clean":"2023-11-04T01:39:58.869054+0000","last_became_active":"2023-11-04T01:39:57.103774+0000","last_became_peered":"2023-11-04T01:39:57.103774+0000","last_unstale":"2023-11-04T01:39:58.869054+0000","last_undegraded":"2023-11-04T01:39:58.869054+0000","last_fullsized":"2023-11-04T01:39:58.869054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872752+0000","last_change":"2023-11-04T01:39:57.908429+0000","last_active":"2023-11-04T01:39:58.872752+0000","last_peered":"2023-11-04T01:39:58.872752+0000","last_clean":"2023-11-04T01:39:58.872752+0000","last_became_active":"2023-11-04T01:39:57.904836+0000","last_became_peered":"2023-11-04T01:39:57.904836+0000","last_unstale":"2023-11-04T01:39:58.872752+0000","last_undegraded":"2023-11-04T01:39:58.872752+0000","last_fullsized":"2023-11-04T01:39:58.872752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867284+0000","last_change":"2023-11-04T01:39:57.104076+0000","last_active":"2023-11-04T01:39:59.867284+0000","last_peered":"2023-11-04T01:39:59.867284+0000","last_clean":"2023-11-04T01:39:59.867284+0000","last_became_active":"2023-11-04T01:39:57.103284+0000","last_became_peered":"2023-11-04T01:39:57.103284+0000","last_unstale":"2023-11-04T01:39:59.867284+0000","last_undegraded":"2023-11-04T01:39:59.867284+0000","last_fullsized":"2023-11-04T01:39:59.867284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242226+0000","last_change":"2023-11-04T01:39:57.925026+0000","last_active":"2023-11-04T01:39:59.242226+0000","last_peered":"2023-11-04T01:39:59.242226+0000","last_clean":"2023-11-04T01:39:59.242226+0000","last_became_active":"2023-11-04T01:39:57.924278+0000","last_became_peered":"2023-11-04T01:39:57.924278+0000","last_unstale":"2023-11-04T01:39:59.242226+0000","last_undegraded":"2023-11-04T01:39:59.242226+0000","last_fullsized":"2023-11-04T01:39:59.242226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867432+0000","last_change":"2023-11-04T01:39:57.089537+0000","last_active":"2023-11-04T01:39:59.867432+0000","last_peered":"2023-11-04T01:39:59.867432+0000","last_clean":"2023-11-04T01:39:59.867432+0000","last_became_active":"2023-11-04T01:39:57.088369+0000","last_became_peered":"2023-11-04T01:39:57.088369+0000","last_unstale":"2023-11-04T01:39:59.867432+0000","last_undegraded":"2023-11-04T01:39:59.867432+0000","last_fullsized":"2023-11-04T01:39:59.867432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866389+0000","last_change":"2023-11-04T01:39:57.921257+0000","last_active":"2023-11-04T01:39:59.866389+0000","last_peered":"2023-11-04T01:39:59.866389+0000","last_clean":"2023-11-04T01:39:59.866389+0000","last_became_active":"2023-11-04T01:39:57.920025+0000","last_became_peered":"2023-11-04T01:39:57.920025+0000","last_unstale":"2023-11-04T01:39:59.866389+0000","last_undegraded":"2023-11-04T01:39:59.866389+0000","last_fullsized":"2023-11-04T01:39:59.866389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:17.627984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872817+0000","last_change":"2023-11-04T01:39:57.114536+0000","last_active":"2023-11-04T01:39:58.872817+0000","last_peered":"2023-11-04T01:39:58.872817+0000","last_clean":"2023-11-04T01:39:58.872817+0000","last_became_active":"2023-11-04T01:39:57.114040+0000","last_became_peered":"2023-11-04T01:39:57.114040+0000","last_unstale":"2023-11-04T01:39:58.872817+0000","last_undegraded":"2023-11-04T01:39:58.872817+0000","last_fullsized":"2023-11-04T01:39:58.872817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241638+0000","last_change":"2023-11-04T01:39:57.927347+0000","last_active":"2023-11-04T01:39:59.241638+0000","last_peered":"2023-11-04T01:39:59.241638+0000","last_clean":"2023-11-04T01:39:59.241638+0000","last_became_active":"2023-11-04T01:39:57.925411+0000","last_became_peered":"2023-11-04T01:39:57.925411+0000","last_unstale":"2023-11-04T01:39:59.241638+0000","last_undegraded":"2023-11-04T01:39:59.241638+0000","last_fullsized":"2023-11-04T01:39:59.241638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866704+0000","last_change":"2023-11-04T01:39:57.104862+0000","last_active":"2023-11-04T01:39:59.866704+0000","last_peered":"2023-11-04T01:39:59.866704+0000","last_clean":"2023-11-04T01:39:59.866704+0000","last_became_active":"2023-11-04T01:39:57.103985+0000","last_became_peered":"2023-11-04T01:39:57.103985+0000","last_unstale":"2023-11-04T01:39:59.866704+0000","last_undegraded":"2023-11-04T01:39:59.866704+0000","last_fullsized":"2023-11-04T01:39:59.866704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:42.123401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866814+0000","last_change":"2023-11-04T01:39:57.903968+0000","last_active":"2023-11-04T01:39:59.866814+0000","last_peered":"2023-11-04T01:39:59.866814+0000","last_clean":"2023-11-04T01:39:59.866814+0000","last_became_active":"2023-11-04T01:39:57.903269+0000","last_became_peered":"2023-11-04T01:39:57.903269+0000","last_unstale":"2023-11-04T01:39:59.866814+0000","last_undegraded":"2023-11-04T01:39:59.866814+0000","last_fullsized":"2023-11-04T01:39:59.866814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865260+0000","last_change":"2023-11-04T01:39:57.083110+0000","last_active":"2023-11-04T01:39:59.865260+0000","last_peered":"2023-11-04T01:39:59.865260+0000","last_clean":"2023-11-04T01:39:59.865260+0000","last_became_active":"2023-11-04T01:39:57.082483+0000","last_became_peered":"2023-11-04T01:39:57.082483+0000","last_unstale":"2023-11-04T01:39:59.865260+0000","last_undegraded":"2023-11-04T01:39:59.865260+0000","last_fullsized":"2023-11-04T01:39:59.865260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:49.424318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241483+0000","last_change":"2023-11-04T01:39:57.925941+0000","last_active":"2023-11-04T01:39:59.241483+0000","last_peered":"2023-11-04T01:39:59.241483+0000","last_clean":"2023-11-04T01:39:59.241483+0000","last_became_active":"2023-11-04T01:39:57.925338+0000","last_became_peered":"2023-11-04T01:39:57.925338+0000","last_unstale":"2023-11-04T01:39:59.241483+0000","last_undegraded":"2023-11-04T01:39:59.241483+0000","last_fullsized":"2023-11-04T01:39:59.241483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873396+0000","last_change":"2023-11-04T01:39:57.089157+0000","last_active":"2023-11-04T01:39:58.873396+0000","last_peered":"2023-11-04T01:39:58.873396+0000","last_clean":"2023-11-04T01:39:58.873396+0000","last_became_active":"2023-11-04T01:39:57.088373+0000","last_became_peered":"2023-11-04T01:39:57.088373+0000","last_unstale":"2023-11-04T01:39:58.873396+0000","last_undegraded":"2023-11-04T01:39:58.873396+0000","last_fullsized":"2023-11-04T01:39:58.873396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.666272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242512+0000","last_change":"2023-11-04T01:39:57.926318+0000","last_active":"2023-11-04T01:39:59.242512+0000","last_peered":"2023-11-04T01:39:59.242512+0000","last_clean":"2023-11-04T01:39:59.242512+0000","last_became_active":"2023-11-04T01:39:57.924998+0000","last_became_peered":"2023-11-04T01:39:57.924998+0000","last_unstale":"2023-11-04T01:39:59.242512+0000","last_undegraded":"2023-11-04T01:39:59.242512+0000","last_fullsized":"2023-11-04T01:39:59.242512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:37.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866744+0000","last_change":"2023-11-04T01:39:57.085866+0000","last_active":"2023-11-04T01:39:59.866744+0000","last_peered":"2023-11-04T01:39:59.866744+0000","last_clean":"2023-11-04T01:39:59.866744+0000","last_became_active":"2023-11-04T01:39:57.085501+0000","last_became_peered":"2023-11-04T01:39:57.085501+0000","last_unstale":"2023-11-04T01:39:59.866744+0000","last_undegraded":"2023-11-04T01:39:59.866744+0000","last_fullsized":"2023-11-04T01:39:59.866744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242796+0000","last_change":"2023-11-04T01:39:57.927164+0000","last_active":"2023-11-04T01:39:59.242796+0000","last_peered":"2023-11-04T01:39:59.242796+0000","last_clean":"2023-11-04T01:39:59.242796+0000","last_became_active":"2023-11-04T01:39:57.926817+0000","last_became_peered":"2023-11-04T01:39:57.926817+0000","last_unstale":"2023-11-04T01:39:59.242796+0000","last_undegraded":"2023-11-04T01:39:59.242796+0000","last_fullsized":"2023-11-04T01:39:59.242796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:14.194200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869221+0000","last_change":"2023-11-04T01:39:57.088611+0000","last_active":"2023-11-04T01:39:58.869221+0000","last_peered":"2023-11-04T01:39:58.869221+0000","last_clean":"2023-11-04T01:39:58.869221+0000","last_became_active":"2023-11-04T01:39:57.088214+0000","last_became_peered":"2023-11-04T01:39:57.088214+0000","last_unstale":"2023-11-04T01:39:58.869221+0000","last_undegraded":"2023-11-04T01:39:58.869221+0000","last_fullsized":"2023-11-04T01:39:58.869221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873978+0000","last_change":"2023-11-04T01:39:57.916146+0000","last_active":"2023-11-04T01:39:58.873978+0000","last_peered":"2023-11-04T01:39:58.873978+0000","last_clean":"2023-11-04T01:39:58.873978+0000","last_became_active":"2023-11-04T01:39:57.914346+0000","last_became_peered":"2023-11-04T01:39:57.914346+0000","last_unstale":"2023-11-04T01:39:58.873978+0000","last_undegraded":"2023-11-04T01:39:58.873978+0000","last_fullsized":"2023-11-04T01:39:58.873978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866304+0000","last_change":"2023-11-04T01:39:57.091428+0000","last_active":"2023-11-04T01:39:59.866304+0000","last_peered":"2023-11-04T01:39:59.866304+0000","last_clean":"2023-11-04T01:39:59.866304+0000","last_became_active":"2023-11-04T01:39:57.090767+0000","last_became_peered":"2023-11-04T01:39:57.090767+0000","last_unstale":"2023-11-04T01:39:59.866304+0000","last_undegraded":"2023-11-04T01:39:59.866304+0000","last_fullsized":"2023-11-04T01:39:59.866304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242170+0000","last_change":"2023-11-04T01:39:57.925040+0000","last_active":"2023-11-04T01:39:59.242170+0000","last_peered":"2023-11-04T01:39:59.242170+0000","last_clean":"2023-11-04T01:39:59.242170+0000","last_became_active":"2023-11-04T01:39:57.924201+0000","last_became_peered":"2023-11-04T01:39:57.924201+0000","last_unstale":"2023-11-04T01:39:59.242170+0000","last_undegraded":"2023-11-04T01:39:59.242170+0000","last_fullsized":"2023-11-04T01:39:59.242170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:39:57.898357+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:57.898357+0000","last_peered":"2023-11-04T01:39:57.898357+0000","last_clean":"2023-11-04T01:39:57.898357+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:57.898357+0000","last_undegraded":"2023-11-04T01:39:57.898357+0000","last_fullsized":"2023-11-04T01:39:57.898357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871472+0000","last_change":"2023-11-04T01:39:57.093034+0000","last_active":"2023-11-04T01:39:58.871472+0000","last_peered":"2023-11-04T01:39:58.871472+0000","last_clean":"2023-11-04T01:39:58.871472+0000","last_became_active":"2023-11-04T01:39:57.092158+0000","last_became_peered":"2023-11-04T01:39:57.092158+0000","last_unstale":"2023-11-04T01:39:58.871472+0000","last_undegraded":"2023-11-04T01:39:58.871472+0000","last_fullsized":"2023-11-04T01:39:58.871472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869011+0000","last_change":"2023-11-04T01:39:57.899138+0000","last_active":"2023-11-04T01:39:59.869011+0000","last_peered":"2023-11-04T01:39:59.869011+0000","last_clean":"2023-11-04T01:39:59.869011+0000","last_became_active":"2023-11-04T01:39:57.898313+0000","last_became_peered":"2023-11-04T01:39:57.898313+0000","last_unstale":"2023-11-04T01:39:59.869011+0000","last_undegraded":"2023-11-04T01:39:59.869011+0000","last_fullsized":"2023-11-04T01:39:59.869011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241057+0000","last_change":"2023-11-04T01:39:57.119969+0000","last_active":"2023-11-04T01:39:59.241057+0000","last_peered":"2023-11-04T01:39:59.241057+0000","last_clean":"2023-11-04T01:39:59.241057+0000","last_became_active":"2023-11-04T01:39:57.118250+0000","last_became_peered":"2023-11-04T01:39:57.118250+0000","last_unstale":"2023-11-04T01:39:59.241057+0000","last_undegraded":"2023-11-04T01:39:59.241057+0000","last_fullsized":"2023-11-04T01:39:59.241057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865841+0000","last_change":"2023-11-04T01:39:57.888041+0000","last_active":"2023-11-04T01:39:59.865841+0000","last_peered":"2023-11-04T01:39:59.865841+0000","last_clean":"2023-11-04T01:39:59.865841+0000","last_became_active":"2023-11-04T01:39:57.887240+0000","last_became_peered":"2023-11-04T01:39:57.887240+0000","last_unstale":"2023-11-04T01:39:59.865841+0000","last_undegraded":"2023-11-04T01:39:59.865841+0000","last_fullsized":"2023-11-04T01:39:59.865841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:00.328908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865848+0000","last_change":"2023-11-04T01:39:57.086891+0000","last_active":"2023-11-04T01:39:59.865848+0000","last_peered":"2023-11-04T01:39:59.865848+0000","last_clean":"2023-11-04T01:39:59.865848+0000","last_became_active":"2023-11-04T01:39:57.086482+0000","last_became_peered":"2023-11-04T01:39:57.086482+0000","last_unstale":"2023-11-04T01:39:59.865848+0000","last_undegraded":"2023-11-04T01:39:59.865848+0000","last_fullsized":"2023-11-04T01:39:59.865848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868387+0000","last_change":"2023-11-04T01:39:57.908737+0000","last_active":"2023-11-04T01:39:58.868387+0000","last_peered":"2023-11-04T01:39:58.868387+0000","last_clean":"2023-11-04T01:39:58.868387+0000","last_became_active":"2023-11-04T01:39:57.907965+0000","last_became_peered":"2023-11-04T01:39:57.907965+0000","last_unstale":"2023-11-04T01:39:58.868387+0000","last_undegraded":"2023-11-04T01:39:58.868387+0000","last_fullsized":"2023-11-04T01:39:58.868387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873025+0000","last_change":"2023-11-04T01:39:57.101402+0000","last_active":"2023-11-04T01:39:58.873025+0000","last_peered":"2023-11-04T01:39:58.873025+0000","last_clean":"2023-11-04T01:39:58.873025+0000","last_became_active":"2023-11-04T01:39:57.100736+0000","last_became_peered":"2023-11-04T01:39:57.100736+0000","last_unstale":"2023-11-04T01:39:58.873025+0000","last_undegraded":"2023-11-04T01:39:58.873025+0000","last_fullsized":"2023-11-04T01:39:58.873025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872956+0000","last_change":"2023-11-04T01:39:57.912134+0000","last_active":"2023-11-04T01:39:58.872956+0000","last_peered":"2023-11-04T01:39:58.872956+0000","last_clean":"2023-11-04T01:39:58.872956+0000","last_became_active":"2023-11-04T01:39:57.909396+0000","last_became_peered":"2023-11-04T01:39:57.909396+0000","last_unstale":"2023-11-04T01:39:58.872956+0000","last_undegraded":"2023-11-04T01:39:58.872956+0000","last_fullsized":"2023-11-04T01:39:58.872956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868443+0000","last_change":"2023-11-04T01:39:57.086794+0000","last_active":"2023-11-04T01:39:58.868443+0000","last_peered":"2023-11-04T01:39:58.868443+0000","last_clean":"2023-11-04T01:39:58.868443+0000","last_became_active":"2023-11-04T01:39:57.086448+0000","last_became_peered":"2023-11-04T01:39:57.086448+0000","last_unstale":"2023-11-04T01:39:58.868443+0000","last_undegraded":"2023-11-04T01:39:58.868443+0000","last_fullsized":"2023-11-04T01:39:58.868443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872724+0000","last_change":"2023-11-04T01:39:57.889388+0000","last_active":"2023-11-04T01:39:58.872724+0000","last_peered":"2023-11-04T01:39:58.872724+0000","last_clean":"2023-11-04T01:39:58.872724+0000","last_became_active":"2023-11-04T01:39:57.888326+0000","last_became_peered":"2023-11-04T01:39:57.888326+0000","last_unstale":"2023-11-04T01:39:58.872724+0000","last_undegraded":"2023-11-04T01:39:58.872724+0000","last_fullsized":"2023-11-04T01:39:58.872724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242500+0000","last_change":"2023-11-04T01:39:57.119606+0000","last_active":"2023-11-04T01:39:59.242500+0000","last_peered":"2023-11-04T01:39:59.242500+0000","last_clean":"2023-11-04T01:39:59.242500+0000","last_became_active":"2023-11-04T01:39:57.118501+0000","last_became_peered":"2023-11-04T01:39:57.118501+0000","last_unstale":"2023-11-04T01:39:59.242500+0000","last_undegraded":"2023-11-04T01:39:59.242500+0000","last_fullsized":"2023-11-04T01:39:59.242500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868674+0000","last_change":"2023-11-04T01:39:57.896425+0000","last_active":"2023-11-04T01:39:58.868674+0000","last_peered":"2023-11-04T01:39:58.868674+0000","last_clean":"2023-11-04T01:39:58.868674+0000","last_became_active":"2023-11-04T01:39:57.895472+0000","last_became_peered":"2023-11-04T01:39:57.895472+0000","last_unstale":"2023-11-04T01:39:58.868674+0000","last_undegraded":"2023-11-04T01:39:58.868674+0000","last_fullsized":"2023-11-04T01:39:58.868674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:40:00.228392+0000","last_change":"2023-11-04T01:39:57.102873+0000","last_active":"2023-11-04T01:40:00.228392+0000","last_peered":"2023-11-04T01:40:00.228392+0000","last_clean":"2023-11-04T01:40:00.228392+0000","last_became_active":"2023-11-04T01:39:57.102500+0000","last_became_peered":"2023-11-04T01:39:57.102500+0000","last_unstale":"2023-11-04T01:40:00.228392+0000","last_undegraded":"2023-11-04T01:40:00.228392+0000","last_fullsized":"2023-11-04T01:40:00.228392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869619+0000","last_change":"2023-11-04T01:39:57.920760+0000","last_active":"2023-11-04T01:39:59.869619+0000","last_peered":"2023-11-04T01:39:59.869619+0000","last_clean":"2023-11-04T01:39:59.869619+0000","last_became_active":"2023-11-04T01:39:57.920036+0000","last_became_peered":"2023-11-04T01:39:57.920036+0000","last_unstale":"2023-11-04T01:39:59.869619+0000","last_undegraded":"2023-11-04T01:39:59.869619+0000","last_fullsized":"2023-11-04T01:39:59.869619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867441+0000","last_change":"2023-11-04T01:39:57.119006+0000","last_active":"2023-11-04T01:39:59.867441+0000","last_peered":"2023-11-04T01:39:59.867441+0000","last_clean":"2023-11-04T01:39:59.867441+0000","last_became_active":"2023-11-04T01:39:57.118360+0000","last_became_peered":"2023-11-04T01:39:57.118360+0000","last_unstale":"2023-11-04T01:39:59.867441+0000","last_undegraded":"2023-11-04T01:39:59.867441+0000","last_fullsized":"2023-11-04T01:39:59.867441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867208+0000","last_change":"2023-11-04T01:39:57.899526+0000","last_active":"2023-11-04T01:39:59.867208+0000","last_peered":"2023-11-04T01:39:59.867208+0000","last_clean":"2023-11-04T01:39:59.867208+0000","last_became_active":"2023-11-04T01:39:57.898663+0000","last_became_peered":"2023-11-04T01:39:57.898663+0000","last_unstale":"2023-11-04T01:39:59.867208+0000","last_undegraded":"2023-11-04T01:39:59.867208+0000","last_fullsized":"2023-11-04T01:39:59.867208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.240990+0000","last_change":"2023-11-04T01:39:57.118965+0000","last_active":"2023-11-04T01:39:59.240990+0000","last_peered":"2023-11-04T01:39:59.240990+0000","last_clean":"2023-11-04T01:39:59.240990+0000","last_became_active":"2023-11-04T01:39:57.117428+0000","last_became_peered":"2023-11-04T01:39:57.117428+0000","last_unstale":"2023-11-04T01:39:59.240990+0000","last_undegraded":"2023-11-04T01:39:59.240990+0000","last_fullsized":"2023-11-04T01:39:59.240990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872736+0000","last_change":"2023-11-04T01:39:57.897837+0000","last_active":"2023-11-04T01:39:58.872736+0000","last_peered":"2023-11-04T01:39:58.872736+0000","last_clean":"2023-11-04T01:39:58.872736+0000","last_became_active":"2023-11-04T01:39:57.897180+0000","last_became_peered":"2023-11-04T01:39:57.897180+0000","last_unstale":"2023-11-04T01:39:58.872736+0000","last_undegraded":"2023-11-04T01:39:58.872736+0000","last_fullsized":"2023-11-04T01:39:58.872736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.657024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868796+0000","last_change":"2023-11-04T01:39:57.109529+0000","last_active":"2023-11-04T01:39:58.868796+0000","last_peered":"2023-11-04T01:39:58.868796+0000","last_clean":"2023-11-04T01:39:58.868796+0000","last_became_active":"2023-11-04T01:39:57.109076+0000","last_became_peered":"2023-11-04T01:39:57.109076+0000","last_unstale":"2023-11-04T01:39:58.868796+0000","last_undegraded":"2023-11-04T01:39:58.868796+0000","last_fullsized":"2023-11-04T01:39:58.868796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.909590+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.908648+0000","last_became_peered":"2023-11-04T01:39:57.908648+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868661+0000","last_change":"2023-11-04T01:39:57.090615+0000","last_active":"2023-11-04T01:39:58.868661+0000","last_peered":"2023-11-04T01:39:58.868661+0000","last_clean":"2023-11-04T01:39:58.868661+0000","last_became_active":"2023-11-04T01:39:57.090254+0000","last_became_peered":"2023-11-04T01:39:57.090254+0000","last_unstale":"2023-11-04T01:39:58.868661+0000","last_undegraded":"2023-11-04T01:39:58.868661+0000","last_fullsized":"2023-11-04T01:39:58.868661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869182+0000","last_change":"2023-11-04T01:39:57.919597+0000","last_active":"2023-11-04T01:39:59.869182+0000","last_peered":"2023-11-04T01:39:59.869182+0000","last_clean":"2023-11-04T01:39:59.869182+0000","last_became_active":"2023-11-04T01:39:57.918813+0000","last_became_peered":"2023-11-04T01:39:57.918813+0000","last_unstale":"2023-11-04T01:39:59.869182+0000","last_undegraded":"2023-11-04T01:39:59.869182+0000","last_fullsized":"2023-11-04T01:39:59.869182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241973+0000","last_change":"2023-11-04T01:39:57.122022+0000","last_active":"2023-11-04T01:39:59.241973+0000","last_peered":"2023-11-04T01:39:59.241973+0000","last_clean":"2023-11-04T01:39:59.241973+0000","last_became_active":"2023-11-04T01:39:57.121383+0000","last_became_peered":"2023-11-04T01:39:57.121383+0000","last_unstale":"2023-11-04T01:39:59.241973+0000","last_undegraded":"2023-11-04T01:39:59.241973+0000","last_fullsized":"2023-11-04T01:39:59.241973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867389+0000","last_change":"2023-11-04T01:39:57.904433+0000","last_active":"2023-11-04T01:39:59.867389+0000","last_peered":"2023-11-04T01:39:59.867389+0000","last_clean":"2023-11-04T01:39:59.867389+0000","last_became_active":"2023-11-04T01:39:57.903609+0000","last_became_peered":"2023-11-04T01:39:57.903609+0000","last_unstale":"2023-11-04T01:39:59.867389+0000","last_undegraded":"2023-11-04T01:39:59.867389+0000","last_fullsized":"2023-11-04T01:39:59.867389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872398+0000","last_change":"2023-11-04T01:39:57.887415+0000","last_active":"2023-11-04T01:39:58.872398+0000","last_peered":"2023-11-04T01:39:58.872398+0000","last_clean":"2023-11-04T01:39:58.872398+0000","last_became_active":"2023-11-04T01:39:57.886545+0000","last_became_peered":"2023-11-04T01:39:57.886545+0000","last_unstale":"2023-11-04T01:39:58.872398+0000","last_undegraded":"2023-11-04T01:39:58.872398+0000","last_fullsized":"2023-11-04T01:39:58.872398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241975+0000","last_change":"2023-11-04T01:39:57.117914+0000","last_active":"2023-11-04T01:39:59.241975+0000","last_peered":"2023-11-04T01:39:59.241975+0000","last_clean":"2023-11-04T01:39:59.241975+0000","last_became_active":"2023-11-04T01:39:57.117315+0000","last_became_peered":"2023-11-04T01:39:57.117315+0000","last_unstale":"2023-11-04T01:39:59.241975+0000","last_undegraded":"2023-11-04T01:39:59.241975+0000","last_fullsized":"2023-11-04T01:39:59.241975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873666+0000","last_change":"2023-11-04T01:39:57.890838+0000","last_active":"2023-11-04T01:39:58.873666+0000","last_peered":"2023-11-04T01:39:58.873666+0000","last_clean":"2023-11-04T01:39:58.873666+0000","last_became_active":"2023-11-04T01:39:57.890240+0000","last_became_peered":"2023-11-04T01:39:57.890240+0000","last_unstale":"2023-11-04T01:39:58.873666+0000","last_undegraded":"2023-11-04T01:39:58.873666+0000","last_fullsized":"2023-11-04T01:39:58.873666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242364+0000","last_change":"2023-11-04T01:39:57.119136+0000","last_active":"2023-11-04T01:39:59.242364+0000","last_peered":"2023-11-04T01:39:59.242364+0000","last_clean":"2023-11-04T01:39:59.242364+0000","last_became_active":"2023-11-04T01:39:57.117698+0000","last_became_peered":"2023-11-04T01:39:57.117698+0000","last_unstale":"2023-11-04T01:39:59.242364+0000","last_undegraded":"2023-11-04T01:39:59.242364+0000","last_fullsized":"2023-11-04T01:39:59.242364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867841+0000","last_change":"2023-11-04T01:39:57.891105+0000","last_active":"2023-11-04T01:39:59.867841+0000","last_peered":"2023-11-04T01:39:59.867841+0000","last_clean":"2023-11-04T01:39:59.867841+0000","last_became_active":"2023-11-04T01:39:57.890260+0000","last_became_peered":"2023-11-04T01:39:57.890260+0000","last_unstale":"2023-11-04T01:39:59.867841+0000","last_undegraded":"2023-11-04T01:39:59.867841+0000","last_fullsized":"2023-11-04T01:39:59.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869471+0000","last_change":"2023-11-04T01:39:57.086637+0000","last_active":"2023-11-04T01:39:59.869471+0000","last_peered":"2023-11-04T01:39:59.869471+0000","last_clean":"2023-11-04T01:39:59.869471+0000","last_became_active":"2023-11-04T01:39:57.086227+0000","last_became_peered":"2023-11-04T01:39:57.086227+0000","last_unstale":"2023-11-04T01:39:59.869471+0000","last_undegraded":"2023-11-04T01:39:59.869471+0000","last_fullsized":"2023-11-04T01:39:59.869471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:34.010007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869390+0000","last_change":"2023-11-04T01:39:57.910463+0000","last_active":"2023-11-04T01:39:59.869390+0000","last_peered":"2023-11-04T01:39:59.869390+0000","last_clean":"2023-11-04T01:39:59.869390+0000","last_became_active":"2023-11-04T01:39:57.909626+0000","last_became_peered":"2023-11-04T01:39:57.909626+0000","last_unstale":"2023-11-04T01:39:59.869390+0000","last_undegraded":"2023-11-04T01:39:59.869390+0000","last_fullsized":"2023-11-04T01:39:59.869390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868143+0000","last_change":"2023-11-04T01:39:57.110005+0000","last_active":"2023-11-04T01:39:59.868143+0000","last_peered":"2023-11-04T01:39:59.868143+0000","last_clean":"2023-11-04T01:39:59.868143+0000","last_became_active":"2023-11-04T01:39:57.109526+0000","last_became_peered":"2023-11-04T01:39:57.109526+0000","last_unstale":"2023-11-04T01:39:59.868143+0000","last_undegraded":"2023-11-04T01:39:59.868143+0000","last_fullsized":"2023-11-04T01:39:59.868143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:05.980 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:40:05.980 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T01:40:05.980 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T01:40:05.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T01:40:05.981 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T01:40:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10f1af640 1 Processor -- start 2023-11-04T01:40:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10f1af640 1 -- start start 2023-11-04T01:40:06.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10f1af640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa1080ceaa0 0x7fa1080ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10f1af640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa108070d90 con 0x7fa1080caf10 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10f1af640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080cef00 con 0x7fa108159e70 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10f1af640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10806dd90 con 0x7fa1080ceaa0 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10d74c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa1080caf10 0x7fa1080b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48882/0 (socket says 172.21.15.40:48882) 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10d74c640 1 -- 172.21.15.40:0/268800855 learned_addr learned my addr 172.21.15.40:0/268800855 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415462053 0 0) 0x7fa108070d90 con 0x7fa1080caf10 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f4003530 con 0x7fa1080caf10 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 --2- 172.21.15.40:0/268800855 >> v2:172.21.15.91:3300/0 conn(0x7fa1080ceaa0 0x7fa1080ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1281192410 0 0) 0x7fa0f4003530 con 0x7fa1080caf10 2023-11-04T01:40:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 >> v2:172.21.15.91:3300/0 conn(0x7fa1080ceaa0 msgr2=0x7fa1080ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 --2- 172.21.15.40:0/268800855 >> v2:172.21.15.91:3300/0 conn(0x7fa1080ceaa0 0x7fa1080ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 >> v1:172.21.15.91:6789/0 conn(0x7fa108159e70 legacy=0x7fa10806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10806d4f0 con 0x7fa1080caf10 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fa0f8001680 con 0x7fa1080caf10 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 >> v1:172.21.15.40:6789/0 conn(0x7fa1080caf10 legacy=0x7fa1080b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0f4003980 0x7fa0f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f40047d0 0x7fa0f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f4005190 0x7fa0f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10806dd90 con 0x7fa0f40047d0 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f400c030 con 0x7fa0f4003980 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f400c1f0 con 0x7fa0f4005190 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f40047d0 0x7fa0f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10d74c640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f4005190 0x7fa0f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10cf4b640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0f4003980 0x7fa0f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 -- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f4005190 msgr2=0x7fa0f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f4005190 0x7fa0f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 -- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0f4003980 msgr2=0x7fa0f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0f4003980 0x7fa0f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa107fff640 1 -- 172.21.15.40:0/268800855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4003530 con 0x7fa0f40047d0 2023-11-04T01:40:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.140+0000 7fa10d74c640 1 -- 172.21.15.40:0/268800855 reap_dead start 2023-11-04T01:40:06.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa107fff640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f40047d0 0x7fa0f4004c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009fc0 tx=0x7fa0f001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f02b24dd82189 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00a5b60 con 0x7fa0f40047d0 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000f040 con 0x7fa0f40047d0 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa1077fe640 1 -- 172.21.15.40:0/268800855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00ad440 con 0x7fa0f40047d0 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- 172.21.15.40:0/268800855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f40047d0 msgr2=0x7fa0f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f40047d0 0x7fa0f4004c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009fc0 tx=0x7fa0f001cc60 comp rx=0 tx=0).stop 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- 172.21.15.40:0/268800855 shutdown_connections 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 --2- 172.21.15.40:0/268800855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0f40047d0 0x7fa0f4004c50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- 172.21.15.40:0/268800855 >> 172.21.15.40:0/268800855 conn(0x7fa10806e760 msgr2=0x7fa10806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- 172.21.15.40:0/268800855 shutdown_connections 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- 172.21.15.40:0/268800855 wait complete. 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 Processor -- start 2023-11-04T01:40:06.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- start start 2023-11-04T01:40:06.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f40047d0 0x7fa10814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 0x7fa10814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10814fc60 0x7fa10814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10814d2e0 con 0x7fa10814c230 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10814bf20 con 0x7fa10814fc60 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10f1af640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10814c6d0 con 0x7fa0f40047d0 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa107fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 0x7fa10814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa107fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 0x7fa10814f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60212/0 (socket says 172.21.15.40:60212) 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa107fff640 1 -- 172.21.15.40:0/2298024188 learned_addr learned my addr 172.21.15.40:0/2298024188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10cf4b640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f40047d0 0x7fa10814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.144+0000 7fa10d74c640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10814fc60 0x7fa10814d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa107fff640 1 -- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f40047d0 msgr2=0x7fa10814b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa107fff640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f40047d0 0x7fa10814b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa107fff640 1 -- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10814fc60 msgr2=0x7fa10814d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa107fff640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10814fc60 0x7fa10814d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa107fff640 1 -- 172.21.15.40:0/2298024188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10814c9b0 con 0x7fa10814c230 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa107fff640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 0x7fa10814f720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00b0040 tx=0x7fa0f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0003ba0 con 0x7fa10814c230 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0003d00 con 0x7fa10814c230 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10814cc90 con 0x7fa10814c230 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00adba0 con 0x7fa10814c230 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1081584f0 con 0x7fa10814c230 2023-11-04T01:40:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1080675f0 con 0x7fa10814c230 2023-11-04T01:40:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0f00b4040 con 0x7fa10814c230 2023-11-04T01:40:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa1057fa640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664d0 0x7fa0e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0f011e830 con 0x7fa10814c230 2023-11-04T01:40:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa10cf4b640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664d0 0x7fa0e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.148+0000 7fa10cf4b640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664d0 0x7fa0e8068990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa100000c10 tx=0x7fa100009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.152+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0f00ebdf0 con 0x7fa10814c230 2023-11-04T01:40:06.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.348+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa1080cd9e0 con 0x7fa10814c230 2023-11-04T01:40:06.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa1057fa640 1 -- 172.21.15.40:0/2298024188 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164431 (secure 0 0 0) 0x7fa0f00b2090 con 0x7fa10814c230 2023-11-04T01:40:06.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664d0 msgr2=0x7fa0e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664d0 0x7fa0e8068990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa100000c10 tx=0x7fa100009040 comp rx=0 tx=0).stop 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 msgr2=0x7fa10814f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 0x7fa10814f720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00b0040 tx=0x7fa0f0009750 comp rx=0 tx=0).stop 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 shutdown_connections 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664d0 0x7fa0e8068990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10814fc60 0x7fa10814d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10814c230 0x7fa10814f720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 --2- 172.21.15.40:0/2298024188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0f40047d0 0x7fa10814b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 >> 172.21.15.40:0/2298024188 conn(0x7fa10806e760 msgr2=0x7fa10806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 shutdown_connections 2023-11-04T01:40:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.352+0000 7fa10f1af640 1 -- 172.21.15.40:0/2298024188 wait complete. 2023-11-04T01:40:06.373 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":3202656120},{"type":"v1","addr":"172.21.15.91:6833","nonce":3202656120}]},"active_addr":"172.21.15.91:6833/3202656120","active_change":"2023-11-04T01:39:37.730625+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2264770264}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":1536154829}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":253513987}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2356543102}]}]} 2023-11-04T01:40:06.376 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T01:40:06.376 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T01:40:06.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:06.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 Processor -- start 2023-11-04T01:40:06.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 -- start start 2023-11-04T01:40:06.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d8c15d170 0x7f4d8c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4d8c06a160 0x7f4d8c06a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0c4fb0 con 0x7f4d8c070bf0 2023-11-04T01:40:06.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c06aad0 con 0x7f4d8c06a160 2023-11-04T01:40:06.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d91a1b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0711b0 con 0x7f4d8c15d170 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8a7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4d8c070bf0 0x7f4d8c0ca390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48898/0 (socket says 172.21.15.40:48898) 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8a7fc640 1 -- 172.21.15.40:0/3768673234 learned_addr learned my addr 172.21.15.40:0/3768673234 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8b7fe640 1 --2- 172.21.15.40:0/3768673234 >> v2:172.21.15.40:3300/0 conn(0x7f4d8c06a160 0x7f4d8c06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8affd640 1 --2- 172.21.15.40:0/3768673234 >> v2:172.21.15.91:3300/0 conn(0x7f4d8c15d170 0x7f4d8c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d89ffb640 1 -- 172.21.15.40:0/3768673234 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472281619 0 0) 0x7f4d8c0c4fb0 con 0x7f4d8c070bf0 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d89ffb640 1 -- 172.21.15.40:0/3768673234 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d74003530 con 0x7f4d8c070bf0 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8b7fe640 1 -- 172.21.15.40:0/3768673234 >> v2:172.21.15.91:3300/0 conn(0x7f4d8c15d170 msgr2=0x7f4d8c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8b7fe640 1 --2- 172.21.15.40:0/3768673234 >> v2:172.21.15.91:3300/0 conn(0x7f4d8c15d170 0x7f4d8c0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8b7fe640 1 -- 172.21.15.40:0/3768673234 >> v1:172.21.15.40:6789/0 conn(0x7f4d8c070bf0 legacy=0x7f4d8c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.492+0000 7f4d8b7fe640 1 -- 172.21.15.40:0/3768673234 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c071490 con 0x7f4d8c06a160 2023-11-04T01:40:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d8b7fe640 1 --2- 172.21.15.40:0/3768673234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c06a590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0cfb60 tx=0x7f4d8401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27610c9b8b81e324 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d89ffb640 1 -- 172.21.15.40:0/3768673234 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840a58b0 con 0x7f4d8c06a160 2023-11-04T01:40:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d89ffb640 1 -- 172.21.15.40:0/3768673234 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d840a5a10 con 0x7f4d8c06a160 2023-11-04T01:40:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d89ffb640 1 -- 172.21.15.40:0/3768673234 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840a5da0 con 0x7f4d8c06a160 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- 172.21.15.40:0/3768673234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 msgr2=0x7f4d8c06a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/3768673234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c06a590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0cfb60 tx=0x7f4d8401c8e0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- 172.21.15.40:0/3768673234 shutdown_connections 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/3768673234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c06a590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/3768673234 >> v2:172.21.15.91:3300/0 conn(0x7f4d8c15d170 0x7f4d8c0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- 172.21.15.40:0/3768673234 >> 172.21.15.40:0/3768673234 conn(0x7f4d8c0cfc00 msgr2=0x7f4d8c0d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- 172.21.15.40:0/3768673234 shutdown_connections 2023-11-04T01:40:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- 172.21.15.40:0/3768673234 wait complete. 2023-11-04T01:40:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 Processor -- start 2023-11-04T01:40:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- start start 2023-11-04T01:40:06.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d8c070bf0 0x7f4d8c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d8c15d170 0x7f4d8c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0b0fe0 con 0x7f4d8c06a160 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c151fe0 con 0x7f4d8c15d170 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d91a1b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c9b30 con 0x7f4d8c070bf0 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d8affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c0c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60230/0 (socket says 172.21.15.40:60230) 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.496+0000 7f4d8affd640 1 -- 172.21.15.40:0/4107511961 learned_addr learned my addr 172.21.15.40:0/4107511961 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8a7fc640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d8c070bf0 0x7f4d8c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8b7fe640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d8c15d170 0x7f4d8c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8affd640 1 -- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d8c070bf0 msgr2=0x7f4d8c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8affd640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d8c070bf0 0x7f4d8c15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8affd640 1 -- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d8c15d170 msgr2=0x7f4d8c0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8affd640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d8c15d170 0x7f4d8c0afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8affd640 1 -- 172.21.15.40:0/4107511961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009a70 con 0x7f4d8c06a160 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8a7fc640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d8c070bf0 0x7f4d8c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8affd640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c0c9550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00e990 tx=0x7f4d7c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c009690 con 0x7f4d8c06a160 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c00c9e0 con 0x7f4d8c06a160 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c0b0a20 con 0x7f4d8c06a160 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00cd50 con 0x7f4d8c06a160 2023-11-04T01:40:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c1538f0 con 0x7f4d8c06a160 2023-11-04T01:40:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c151db0 con 0x7f4d8c06a160 2023-11-04T01:40:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d7c013470 con 0x7f4d8c06a160 2023-11-04T01:40:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d73fff640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4d780664d0 0x7f4d78068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d7c084120 con 0x7f4d8c06a160 2023-11-04T01:40:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8a7fc640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4d780664d0 0x7f4d78068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.500+0000 7f4d8a7fc640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4d780664d0 0x7f4d78068990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c15bfe0 tx=0x7f4d80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.504+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d8c151db0 con 0x7f4d8c06a160 2023-11-04T01:40:06.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.664+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d8c151db0 con 0x7f4d8c06a160 2023-11-04T01:40:06.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.664+0000 7f4d73fff640 1 -- 172.21.15.40:0/4107511961 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4d7c051500 con 0x7f4d8c06a160 2023-11-04T01:40:06.669 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:06.669 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:06.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4d780664d0 msgr2=0x7f4d78068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4d780664d0 0x7f4d78068990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c15bfe0 tx=0x7f4d80009040 comp rx=0 tx=0).stop 2023-11-04T01:40:06.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 msgr2=0x7f4d8c0c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c0c9550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00e990 tx=0x7f4d7c00ee50 comp rx=0 tx=0).stop 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 shutdown_connections 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4d780664d0 0x7f4d78068990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d8c15d170 0x7f4d8c0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d8c070bf0 0x7f4d8c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 --2- 172.21.15.40:0/4107511961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d8c06a160 0x7f4d8c0c9550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 >> 172.21.15.40:0/4107511961 conn(0x7f4d8c0cfc00 msgr2=0x7f4d8c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 shutdown_connections 2023-11-04T01:40:06.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.668+0000 7f4d91a1b640 1 -- 172.21.15.40:0/4107511961 wait complete. 2023-11-04T01:40:06.688 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T01:40:06.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:06.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.808+0000 7f1ae7c8b640 1 Processor -- start 2023-11-04T01:40:06.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.808+0000 7f1ae7c8b640 1 -- start start 2023-11-04T01:40:06.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ae00b0890 0x7f1ae00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00b0c70 0x7f1ae00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00ce320 con 0x7f1ae00c9960 2023-11-04T01:40:06.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae006d2f0 con 0x7f1ae00b0890 2023-11-04T01:40:06.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00ce110 con 0x7f1ae00b0c70 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5a27640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ae00b0890 0x7f1ae00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5226640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1ae00c9960 0x7f1ae00704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48906/0 (socket says 172.21.15.40:48906) 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5226640 1 -- 172.21.15.40:0/2799574966 learned_addr learned my addr 172.21.15.40:0/2799574966 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae6228640 1 --2- 172.21.15.40:0/2799574966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00b0c70 0x7f1ae00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5a27640 1 -- 172.21.15.40:0/2799574966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00b0c70 msgr2=0x7f1ae00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5a27640 1 --2- 172.21.15.40:0/2799574966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00b0c70 0x7f1ae00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5a27640 1 -- 172.21.15.40:0/2799574966 >> v1:172.21.15.40:6789/0 conn(0x7f1ae00c9960 legacy=0x7f1ae00704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5a27640 1 -- 172.21.15.40:0/2799574966 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00ce600 con 0x7f1ae00b0890 2023-11-04T01:40:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae4a25640 1 -- 172.21.15.40:0/2799574966 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205482349 0 0) 0x7f1ae00ce320 con 0x7f1ae00c9960 2023-11-04T01:40:06.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae5a27640 1 --2- 172.21.15.40:0/2799574966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0890 0x7f1ae00cdbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00bfa0 tx=0x7f1adc01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2db6326773ea53 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae4a25640 1 -- 172.21.15.40:0/2799574966 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc00b2d0 con 0x7f1ae00b0890 2023-11-04T01:40:06.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae4a25640 1 -- 172.21.15.40:0/2799574966 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc0a79f0 con 0x7f1ae00b0890 2023-11-04T01:40:06.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae4a25640 1 -- 172.21.15.40:0/2799574966 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0a7d80 con 0x7f1ae00b0890 2023-11-04T01:40:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/2799574966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0890 msgr2=0x7f1ae00cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/2799574966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0890 0x7f1ae00cdbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00bfa0 tx=0x7f1adc01eb20 comp rx=0 tx=0).stop 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/2799574966 shutdown_connections 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/2799574966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00b0c70 0x7f1ae00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/2799574966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0890 0x7f1ae00cdbd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.812+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/2799574966 >> 172.21.15.40:0/2799574966 conn(0x7f1ae00cebb0 msgr2=0x7f1ae00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/2799574966 shutdown_connections 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/2799574966 wait complete. 2023-11-04T01:40:06.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 Processor -- start 2023-11-04T01:40:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- start start 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ae00b0890 0x7f1ae00b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 0x7f1ae00c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00c9960 0x7f1ae014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00b4640 con 0x7f1ae00b0c70 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00b4430 con 0x7f1ae00b0890 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00c28c0 con 0x7f1ae00c9960 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 0x7f1ae00c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 0x7f1ae00c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60242/0 (socket says 172.21.15.40:60242) 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 -- 172.21.15.40:0/1369076603 learned_addr learned my addr 172.21.15.40:0/1369076603 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae6228640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00c9960 0x7f1ae014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5a27640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ae00b0890 0x7f1ae00b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 -- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00c9960 msgr2=0x7f1ae014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00c9960 0x7f1ae014c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 -- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ae00b0890 msgr2=0x7f1ae00b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ae00b0890 0x7f1ae00b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 -- 172.21.15.40:0/1369076603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc00bc80 con 0x7f1ae00b0c70 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae5226640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 0x7f1ae00c2380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40011f0 tx=0x7f1ad400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40074e0 con 0x7f1ae00b0c70 2023-11-04T01:40:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4007640 con 0x7f1ae00b0c70 2023-11-04T01:40:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4004a10 con 0x7f1ae00b0c70 2023-11-04T01:40:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00b1860 con 0x7f1ae00b0c70 2023-11-04T01:40:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.816+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae0153e10 con 0x7f1ae00b0c70 2023-11-04T01:40:06.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.820+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae00b19f0 con 0x7f1ae00b0c70 2023-11-04T01:40:06.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.820+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ad4004b70 con 0x7f1ae00b0c70 2023-11-04T01:40:06.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.820+0000 7f1ad27fc640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1ac40664a0 0x7f1ac4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.820+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ad4083020 con 0x7f1ae00b0c70 2023-11-04T01:40:06.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.820+0000 7f1ae5a27640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1ac40664a0 0x7f1ac4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.820+0000 7f1ae5a27640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1ac40664a0 0x7f1ac4068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0b0000 tx=0x7f1adc0a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.824+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1ad40505e0 con 0x7f1ae00b0c70 2023-11-04T01:40:06.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.972+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ae00744a0 con 0x7f1ae00b0c70 2023-11-04T01:40:06.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ad27fc640 1 -- 172.21.15.40:0/1369076603 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f1ad4018020 con 0x7f1ae00b0c70 2023-11-04T01:40:06.979 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:06.979 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1ac40664a0 msgr2=0x7f1ac4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1ac40664a0 0x7f1ac4068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0b0000 tx=0x7f1adc0a9070 comp rx=0 tx=0).stop 2023-11-04T01:40:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 msgr2=0x7f1ae00c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 0x7f1ae00c2380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40011f0 tx=0x7f1ad400c9b0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 shutdown_connections 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1ac40664a0 0x7f1ac4068960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1ae00c9960 0x7f1ae014c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ae00b0c70 0x7f1ae00c2380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 --2- 172.21.15.40:0/1369076603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1ae00b0890 0x7f1ae00b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 >> 172.21.15.40:0/1369076603 conn(0x7f1ae00cebb0 msgr2=0x7f1ae015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.976+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 shutdown_connections 2023-11-04T01:40:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:06.980+0000 7f1ae7c8b640 1 -- 172.21.15.40:0/1369076603 wait complete. 2023-11-04T01:40:06.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T01:40:06.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T01:40:06.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T01:40:06.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T01:40:06.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-04T01:40:06.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-04T01:40:06.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-04T01:40:07.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-04T01:40:07.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 Processor -- start 2023-11-04T01:40:07.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 -- start start 2023-11-04T01:40:07.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6a8c0e78e0 0x7f6a8c04f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 0x7f6a8c038210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0549f0 con 0x7f6a8c054480 2023-11-04T01:40:07.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0077b0 con 0x7f6a8c0e78e0 2023-11-04T01:40:07.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a997e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0069f0 con 0x7f6a8c037d60 2023-11-04T01:40:07.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a98fe5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 0x7f6a8c038210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a937fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6a8c054480 0x7f6a8c04f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:36000/0 (socket says 172.21.15.40:36000) 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a98fe5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 0x7f6a8c038210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:46876/0 (socket says 172.21.15.40:46876) 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a937fe640 1 -- 172.21.15.40:0/1792704719 learned_addr learned my addr 172.21.15.40:0/1792704719 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a98fe5640 1 -- 172.21.15.40:0/1792704719 >> v2:172.21.15.91:3300/0 conn(0x7f6a8c0e78e0 msgr2=0x7f6a8c04f210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a98fe5640 1 --2- 172.21.15.40:0/1792704719 >> v2:172.21.15.91:3300/0 conn(0x7f6a8c0e78e0 0x7f6a8c04f210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a98fe5640 1 -- 172.21.15.40:0/1792704719 >> v1:172.21.15.91:6789/0 conn(0x7f6a8c054480 legacy=0x7f6a8c04f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f6a98fe5640 1 -- 172.21.15.40:0/1792704719 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c006cd0 con 0x7f6a8c037d60 2023-11-04T01:40:07.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f39b9f3b640 1 Processor -- start 2023-11-04T01:40:07.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.176+0000 7f39b9f3b640 1 -- start start 2023-11-04T01:40:07.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 Processor -- start 2023-11-04T01:40:07.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 -- start start 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 Processor -- start 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 -- start start 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b9f3b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b406b4b0 0x7f39b406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b9f3b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39b40b0480 0x7f39b40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b9f3b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b406c250 con 0x7f39b40cbfa0 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b9f3b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b406c530 con 0x7f39b40b0480 2023-11-04T01:40:07.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b9f3b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b0e50 con 0x7f39b406b4b0 2023-11-04T01:40:07.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f39b40cbfa0 0x7f39b4158dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48908/0 (socket says 172.21.15.40:48908) 2023-11-04T01:40:07.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b37fe640 1 -- 172.21.15.40:0/1831978697 learned_addr learned my addr 172.21.15.40:0/1831978697 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e5c0d01b0 0x7f6e5c06b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0c4240 0x7f6e5c0ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c0b04a0 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0d0590 con 0x7f6e5c0d01b0 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61f12640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b06f0 con 0x7f6e5c0c4240 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c047e30 0x7f2b2c037d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b2c0382a0 0x7f2b2c04f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c006df0 con 0x7f2b2c0e77c0 2023-11-04T01:40:07.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c054a50 con 0x7f2b2c0382a0 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3b089640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c054490 con 0x7f2b2c047e30 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e5c0d01b0 0x7f6e5c06b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e5c0d01b0 0x7f6e5c06b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60248/0 (socket says 172.21.15.40:60248) 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 -- 172.21.15.40:0/4058173358 learned_addr learned my addr 172.21.15.40:0/4058173358 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3a087640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b2c0e77c0 0x7f2b2c007280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48926/0 (socket says 172.21.15.40:48926) 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3a087640 1 -- 172.21.15.40:0/810376219 learned_addr learned my addr 172.21.15.40:0/810376219 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b3a888640 1 --2- 172.21.15.40:0/810376219 >> v2:172.21.15.91:3300/0 conn(0x7f2b2c0382a0 0x7f2b2c04f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b3fff640 1 --2- 172.21.15.40:0/1831978697 >> v2:172.21.15.91:3300/0 conn(0x7f39b40b0480 0x7f39b40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39886640 1 --2- 172.21.15.40:0/810376219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c047e30 0x7f2b2c037d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39abfff640 1 --2- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b406b4b0 0x7f39b406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e61711640 1 --2- 172.21.15.40:0/4058173358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0c4240 0x7f6e5c0ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6a98fe5640 1 --2- 172.21.15.40:0/1792704719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 0x7f6a8c038210 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a9404fde0 tx=0x7f6a94096d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81d549372c209f9e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39085640 1 -- 172.21.15.40:0/810376219 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668695673 0 0) 0x7f2b2c006df0 con 0x7f2b2c0e77c0 2023-11-04T01:40:07.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39085640 1 -- 172.21.15.40:0/810376219 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b20003530 con 0x7f2b2c0e77c0 2023-11-04T01:40:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 Processor -- start 2023-11-04T01:40:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e5b7fe640 1 -- 172.21.15.40:0/4058173358 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488254026 0 0) 0x7f6e5c0b04a0 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e5b7fe640 1 -- 172.21.15.40:0/4058173358 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e44003530 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b3fff640 1 -- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b406b4b0 msgr2=0x7f39b406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b3fff640 1 --2- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b406b4b0 0x7f39b406b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b3fff640 1 -- 172.21.15.40:0/1831978697 >> v1:172.21.15.40:6789/0 conn(0x7f39b40cbfa0 legacy=0x7f39b4158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 -- start start 2023-11-04T01:40:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39886640 1 -- 172.21.15.40:0/810376219 >> v2:172.21.15.91:3300/0 conn(0x7f2b2c0382a0 msgr2=0x7f2b2c04f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39886640 1 --2- 172.21.15.40:0/810376219 >> v2:172.21.15.91:3300/0 conn(0x7f2b2c0382a0 0x7f2b2c04f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f39b3fff640 1 -- 172.21.15.40:0/1831978697 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b406f9f0 con 0x7f39b40b0480 2023-11-04T01:40:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39886640 1 -- 172.21.15.40:0/810376219 >> v1:172.21.15.40:6789/0 conn(0x7f2b2c0e77c0 legacy=0x7f2b2c007280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f2b39886640 1 -- 172.21.15.40:0/810376219 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c054770 con 0x7f2b2c047e30 2023-11-04T01:40:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f0b0359e640 1 Processor -- start 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f0b0359e640 1 -- start start 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6a92ffd640 1 -- 172.21.15.40:0/1792704719 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9411fd00 con 0x7f6a8c037d60 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6a92ffd640 1 -- 172.21.15.40:0/1792704719 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9411fe60 con 0x7f6a8c037d60 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6a92ffd640 1 -- 172.21.15.40:0/1792704719 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94127660 con 0x7f6a8c037d60 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 -- 172.21.15.40:0/1792704719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 msgr2=0x7f6a8c038210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 --2- 172.21.15.40:0/1792704719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 0x7f6a8c038210 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a9404fde0 tx=0x7f6a94096d50 comp rx=0 tx=0).stop 2023-11-04T01:40:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424015d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42400671a0 0x7f42400ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f42400cf0e0 0x7f42400cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424015d960 con 0x7f42400671a0 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42400cfa90 con 0x7f42400cf0e0 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f4244a83640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424015fdb0 con 0x7f42400cb160 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42400671a0 0x7f42400ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42400671a0 0x7f42400ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60258/0 (socket says 172.21.15.40:60258) 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 -- 172.21.15.40:0/2180303710 learned_addr learned my addr 172.21.15.40:0/2180303710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3a888640 1 --2- 172.21.15.40:0/810376219 >> v2:172.21.15.91:3300/0 conn(0x7f2b2c0382a0 0x7f2b2c04f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b0359e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0afc0df370 0x7f0afc0070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b0359e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0afc04f5a0 0x7f0afc038000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b0359e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc005dc0 con 0x7f0afc04fa60 2023-11-04T01:40:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b0359e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc006c20 con 0x7f0afc0df370 2023-11-04T01:40:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b0359e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc054370 con 0x7f0afc04f5a0 2023-11-04T01:40:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 -- 172.21.15.40:0/1792704719 shutdown_connections 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 --2- 172.21.15.40:0/1792704719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c037d60 0x7f6a8c038210 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 --2- 172.21.15.40:0/1792704719 >> v2:172.21.15.91:3300/0 conn(0x7f6a8c0e78e0 0x7f6a8c04f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 -- 172.21.15.40:0/1792704719 >> 172.21.15.40:0/1792704719 conn(0x7f6a8c054bc0 msgr2=0x7f6a8c054fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 -- 172.21.15.40:0/1792704719 shutdown_connections 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 -- 172.21.15.40:0/1792704719 wait complete. 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 -- 172.21.15.40:0/4058173358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0c4240 msgr2=0x7f6e5c0ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 --2- 172.21.15.40:0/4058173358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0c4240 0x7f6e5c0ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 -- 172.21.15.40:0/4058173358 >> v1:172.21.15.40:6789/0 conn(0x7f6e5c0d16f0 legacy=0x7f6e5c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.180+0000 7f6e60f10640 1 -- 172.21.15.40:0/4058173358 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0b09d0 con 0x7f6e5c0d01b0 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423ffff640 1 --2- 172.21.15.40:0/2180303710 >> v2:172.21.15.91:3300/0 conn(0x7f42400cf0e0 0x7f42400cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 -- 172.21.15.40:0/2180303710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 msgr2=0x7f424015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 --2- 172.21.15.40:0/2180303710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 -- 172.21.15.40:0/2180303710 >> v2:172.21.15.91:3300/0 conn(0x7f42400cf0e0 msgr2=0x7f42400cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 --2- 172.21.15.40:0/2180303710 >> v2:172.21.15.91:3300/0 conn(0x7f42400cf0e0 0x7f42400cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 -- 172.21.15.40:0/2180303710 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400cb8e0 con 0x7f42400671a0 2023-11-04T01:40:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0afc0df370 0x7f0afc0070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0afc0df370 0x7f0afc0070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60260/0 (socket says 172.21.15.40:60260) 2023-11-04T01:40:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 -- 172.21.15.40:0/573989320 learned_addr learned my addr 172.21.15.40:0/573989320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b02d9d640 1 --2- 172.21.15.40:0/573989320 >> v2:172.21.15.91:3300/0 conn(0x7f0afc04f5a0 0x7f0afc038000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa04da0b640 1 Processor -- start 2023-11-04T01:40:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa04da0b640 1 -- start start 2023-11-04T01:40:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 -- 172.21.15.40:0/573989320 >> v2:172.21.15.91:3300/0 conn(0x7f0afc04f5a0 msgr2=0x7f0afc038000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6e60f10640 1 --2- 172.21.15.40:0/4058173358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0d01b0 0x7f6e5c06b270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009870 tx=0x7f6e5001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dc9c3577b52f06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b3fff640 1 --2- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b40b0910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009d90 tx=0x7f39ac01c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28e5295e1669bc6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b39886640 1 --2- 172.21.15.40:0/810376219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c047e30 0x7f2b2c037d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b240097c0 tx=0x7f2b2401ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f7758bdcb269d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b39085640 1 -- 172.21.15.40:0/810376219 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240a87b0 con 0x7f2b2c047e30 2023-11-04T01:40:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b2ffd640 1 -- 172.21.15.40:0/1831978697 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0a66d0 con 0x7f39b40b0480 2023-11-04T01:40:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b39085640 1 -- 172.21.15.40:0/810376219 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b240a8910 con 0x7f2b2c047e30 2023-11-04T01:40:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b39085640 1 -- 172.21.15.40:0/810376219 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240a8c80 con 0x7f2b2c047e30 2023-11-04T01:40:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b2ffd640 1 -- 172.21.15.40:0/1831978697 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac0a6830 con 0x7f39b40b0480 2023-11-04T01:40:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b2ffd640 1 -- 172.21.15.40:0/1831978697 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0a66d0 con 0x7f39b40b0480 2023-11-04T01:40:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa04da0b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa048159a50 0x7fa0480cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 Processor -- start 2023-11-04T01:40:07.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa04da0b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce720 0x7fa04806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f6a997e6640 1 -- start start 2023-11-04T01:40:07.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa046ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa048159a50 0x7fa0480cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa046ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa048159a50 0x7fa0480cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52472/0 (socket says 172.21.15.40:52472) 2023-11-04T01:40:07.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa046ffd640 1 -- 172.21.15.40:0/701675054 learned_addr learned my addr 172.21.15.40:0/701675054 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 -- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 msgr2=0x7f39b40b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423effd640 1 --2- 172.21.15.40:0/2180303710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400671a0 0x7f42400ce0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42400c27d0 tx=0x7f423001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3222bb8f44055cb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 --2- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b40b0910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009d90 tx=0x7f39ac01c7d0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 -- 172.21.15.40:0/810376219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c047e30 msgr2=0x7f2b2c037d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 --2- 172.21.15.40:0/810376219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c047e30 0x7f2b2c037d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b240097c0 tx=0x7f2b2401ebf0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 -- 172.21.15.40:0/810376219 shutdown_connections 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 --2- 172.21.15.40:0/810376219 >> v2:172.21.15.91:3300/0 conn(0x7f2b2c0382a0 0x7f2b2c04f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 --2- 172.21.15.40:0/810376219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c047e30 0x7f2b2c037d60 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b240097c0 tx=0x7f2b2401ebf0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 -- 172.21.15.40:0/1831978697 shutdown_connections 2023-11-04T01:40:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 --2- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b40b0910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 --2- 172.21.15.40:0/1831978697 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b406b4b0 0x7f39b406b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 -- 172.21.15.40:0/1831978697 >> 172.21.15.40:0/1831978697 conn(0x7f39b40cb480 msgr2=0x7f39b40cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 -- 172.21.15.40:0/810376219 >> 172.21.15.40:0/810376219 conn(0x7f2b2c054bc0 msgr2=0x7f2b2c054fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 -- 172.21.15.40:0/1831978697 shutdown_connections 2023-11-04T01:40:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 -- 172.21.15.40:0/810376219 shutdown_connections 2023-11-04T01:40:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa0467fc640 1 --2- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce720 0x7fa04806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f2b3b089640 1 -- 172.21.15.40:0/810376219 wait complete. 2023-11-04T01:40:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423e7fc640 1 -- 172.21.15.40:0/2180303710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300ad640 con 0x7f42400671a0 2023-11-04T01:40:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423e7fc640 1 -- 172.21.15.40:0/2180303710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300ad7a0 con 0x7f42400671a0 2023-11-04T01:40:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f423e7fc640 1 -- 172.21.15.40:0/2180303710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300adb30 con 0x7f42400671a0 2023-11-04T01:40:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f39b9f3b640 1 -- 172.21.15.40:0/1831978697 wait complete. 2023-11-04T01:40:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa048159e30 con 0x7fa0480ce070 2023-11-04T01:40:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa048070b80 con 0x7fa048159a50 2023-11-04T01:40:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e5b7fe640 1 -- 172.21.15.40:0/4058173358 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500ac630 con 0x7f6e5c0d01b0 2023-11-04T01:40:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480ccfd0 con 0x7fa0480ce720 2023-11-04T01:40:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e5b7fe640 1 -- 172.21.15.40:0/4058173358 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500ac790 con 0x7f6e5c0d01b0 2023-11-04T01:40:07.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e5b7fe640 1 -- 172.21.15.40:0/4058173358 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500acb20 con 0x7f6e5c0d01b0 2023-11-04T01:40:07.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 --2- 172.21.15.40:0/573989320 >> v2:172.21.15.91:3300/0 conn(0x7f0afc04f5a0 0x7f0afc038000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 -- 172.21.15.40:0/573989320 >> v1:172.21.15.40:6789/0 conn(0x7f0afc04fa60 legacy=0x7f0afc04fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.184+0000 7f0b01d9b640 1 -- 172.21.15.40:0/573989320 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc006010 con 0x7f0afc0df370 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c037d60 0x7f6a8c0d3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a8c054480 0x7f6a8c04bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c0e78e0 0x7f6a8c0d4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0d4270 con 0x7f6a8c037d60 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0e9d20 con 0x7f6a8c054480 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0ea000 con 0x7f6a8c0e78e0 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c037d60 0x7f6a8c0d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c037d60 0x7f6a8c0d3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60276/0 (socket says 172.21.15.40:60276) 2023-11-04T01:40:07.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 -- 172.21.15.40:0/3197373300 learned_addr learned my addr 172.21.15.40:0/3197373300 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 -- 172.21.15.40:0/2180303710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400671a0 msgr2=0x7f42400ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 --2- 172.21.15.40:0/2180303710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400671a0 0x7f42400ce0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42400c27d0 tx=0x7f423001c4e0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 -- 172.21.15.40:0/2180303710 shutdown_connections 2023-11-04T01:40:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 --2- 172.21.15.40:0/2180303710 >> v2:172.21.15.91:3300/0 conn(0x7f42400cf0e0 0x7f42400cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 --2- 172.21.15.40:0/2180303710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400671a0 0x7f42400ce0d0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f42400c27d0 tx=0x7f423001c4e0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 --2- 172.21.15.40:0/2180303710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 -- 172.21.15.40:0/2180303710 >> 172.21.15.40:0/2180303710 conn(0x7f424006a330 msgr2=0x7f424006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a937fe640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a8c054480 0x7f6a8c04bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b02d9d640 1 --2- 172.21.15.40:0/573989320 >> v2:172.21.15.91:3300/0 conn(0x7f0afc04f5a0 0x7f0afc038000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 -- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c0e78e0 msgr2=0x7f6a8c0d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a8c0e78e0 0x7f6a8c0d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 -- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a8c054480 msgr2=0x7f6a8c04bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a8c054480 0x7f6a8c04bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 -- 172.21.15.40:0/3197373300 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9404f430 con 0x7f6a8c037d60 2023-11-04T01:40:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a937fe640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a8c054480 0x7f6a8c04bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b01d9b640 1 --2- 172.21.15.40:0/573989320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc0070b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0afc053120 tx=0x7f0af401e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2de1ffa9ec233e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a93fff640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c037d60 0x7f6a8c0d3350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000b3e0 tx=0x7f6a8000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 Processor -- start 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 -- start start 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c0382a0 0x7f2b2c0d5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b2c0e77c0 0x7f2b2c0ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c048450 0x7f2b2c049c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0497d0 con 0x7f2b2c0382a0 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c04a1a0 con 0x7f2b2c0e77c0 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3b089640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c048bc0 con 0x7f2b2c048450 2023-11-04T01:40:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3a888640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c048450 0x7f2b2c049c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3a888640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c048450 0x7f2b2c049c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:46934/0 (socket says 172.21.15.40:46934) 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b3a888640 1 -- 172.21.15.40:0/2649605313 learned_addr learned my addr 172.21.15.40:0/2649605313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0159a640 1 -- 172.21.15.40:0/573989320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40a7a90 con 0x7f0afc0df370 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0159a640 1 -- 172.21.15.40:0/573989320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af40ab070 con 0x7f0afc0df370 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0159a640 1 -- 172.21.15.40:0/573989320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40a7e10 con 0x7f0afc0df370 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 -- 172.21.15.40:0/573989320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 msgr2=0x7f0afc0070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 --2- 172.21.15.40:0/573989320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc0070b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0afc053120 tx=0x7f0af401e9c0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 -- 172.21.15.40:0/573989320 shutdown_connections 2023-11-04T01:40:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 --2- 172.21.15.40:0/573989320 >> v2:172.21.15.91:3300/0 conn(0x7f0afc04f5a0 0x7f0afc038000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 --2- 172.21.15.40:0/573989320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc0070b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 -- 172.21.15.40:0/573989320 >> 172.21.15.40:0/573989320 conn(0x7f0afc009fa0 msgr2=0x7f0afc00a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 -- 172.21.15.40:0/573989320 shutdown_connections 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f0b0359e640 1 -- 172.21.15.40:0/573989320 wait complete. 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80011830 con 0x7f6a8c037d60 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0d3c20 con 0x7f6a8c037d60 2023-11-04T01:40:07.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c0d3890 con 0x7f6a8c037d60 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a800119b0 con 0x7f6a8c037d60 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80011d60 con 0x7f6a8c037d60 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a8c052cb0 con 0x7f6a8c037d60 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 -- 172.21.15.40:0/4058173358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0d01b0 msgr2=0x7f6e5c06b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 --2- 172.21.15.40:0/4058173358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0d01b0 0x7f6e5c06b270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009870 tx=0x7f6e5001c500 comp rx=0 tx=0).stop 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 -- 172.21.15.40:0/4058173358 shutdown_connections 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 --2- 172.21.15.40:0/4058173358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0c4240 0x7f6e5c0ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 --2- 172.21.15.40:0/4058173358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0d01b0 0x7f6e5c06b270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 -- 172.21.15.40:0/4058173358 >> 172.21.15.40:0/4058173358 conn(0x7f6e5c0d0b60 msgr2=0x7f6e5c0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 -- 172.21.15.40:0/4058173358 shutdown_connections 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 -- 172.21.15.40:0/4058173358 wait complete. 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa046ffd640 1 -- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce720 msgr2=0x7fa04806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa046ffd640 1 --2- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce720 0x7fa04806ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa046ffd640 1 -- 172.21.15.40:0/701675054 >> v1:172.21.15.40:6789/0 conn(0x7fa0480ce070 legacy=0x7fa04815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa046ffd640 1 -- 172.21.15.40:0/701675054 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480cd2b0 con 0x7fa048159a50 2023-11-04T01:40:07.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 Processor -- start 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 -- start start 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39b406b4b0 0x7f39b414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b40cbfa0 0x7f39b4150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c30e0 con 0x7f39b406b4b0 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c2510 con 0x7f39b40b0480 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b9f3b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c27b0 con 0x7f39b40cbfa0 2023-11-04T01:40:07.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 -- 172.21.15.40:0/2180303710 shutdown_connections 2023-11-04T01:40:07.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 Processor -- start 2023-11-04T01:40:07.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39abfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f2b39886640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b2c0e77c0 0x7f2b2c0ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39b3fff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b40cbfa0 0x7f39b4150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7fa046ffd640 1 --2- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480cc6f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa03800a920 tx=0x7fa03801ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3dbb9b34d8e029a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f4244a83640 1 -- 172.21.15.40:0/2180303710 wait complete. 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39abfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b41507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52488/0 (socket says 172.21.15.40:52488) 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f39abfff640 1 -- 172.21.15.40:0/3963217227 learned_addr learned my addr 172.21.15.40:0/3963217227 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39b406b4b0 0x7f39b414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3a888640 1 -- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b2c0e77c0 msgr2=0x7f2b2c0ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3a888640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b2c0e77c0 0x7f2b2c0ea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3a888640 1 -- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c0382a0 msgr2=0x7f2b2c0d5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3a888640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c0382a0 0x7f2b2c0d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3a888640 1 -- 172.21.15.40:0/2649605313 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3404f430 con 0x7f2b2c048450 2023-11-04T01:40:07.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7fa9d5640 1 Processor -- start 2023-11-04T01:40:07.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 -- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b40cbfa0 msgr2=0x7f39b4150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39b40cbfa0 0x7f39b4150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 -- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 msgr2=0x7f39b41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39b40b0480 0x7f39b41507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 -- 172.21.15.40:0/3963217227 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009a70 con 0x7f39b406b4b0 2023-11-04T01:40:07.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7fa9d5640 1 -- start start 2023-11-04T01:40:07.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.188+0000 7f6e61f12640 1 -- start start 2023-11-04T01:40:07.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61f12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0c4240 0x7f6e5c201700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61f12640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0d01b0 0x7f6e5c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61f12640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e5c0d16f0 0x7f6e5c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f39b37fe640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39b406b4b0 0x7f39b414ef00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c530 tx=0x7f39a400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61f12640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0caa50 con 0x7f6e5c0c4240 2023-11-04T01:40:07.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 Processor -- start 2023-11-04T01:40:07.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0d01b0 0x7f6e5c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0d01b0 0x7f6e5c0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:46966/0 (socket says 172.21.15.40:46966) 2023-11-04T01:40:07.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e5bfff640 1 -- 172.21.15.40:0/38286554 learned_addr learned my addr 172.21.15.40:0/38286554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa045ffb640 1 -- 172.21.15.40:0/701675054 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380a8d40 con 0x7fa048159a50 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa045ffb640 1 -- 172.21.15.40:0/701675054 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038004030 con 0x7fa048159a50 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa045ffb640 1 -- 172.21.15.40:0/701675054 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380a8ea0 con 0x7fa048159a50 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 msgr2=0x7fa0480cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 --2- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480cc6f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa03800a920 tx=0x7fa03801ef90 comp rx=0 tx=0).stop 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 shutdown_connections 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 --2- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce720 0x7fa04806ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 --2- 172.21.15.40:0/701675054 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480cc6f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 >> 172.21.15.40:0/701675054 conn(0x7fa0480cebb0 msgr2=0x7fa0480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61711640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e5c0d16f0 0x7f6e5c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 shutdown_connections 2023-11-04T01:40:07.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0cd280 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0c9f70 con 0x7f6e5c0d01b0 2023-11-04T01:40:07.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 Processor -- start 2023-11-04T01:40:07.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 -- start start 2023-11-04T01:40:07.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 -- 172.21.15.40:0/701675054 wait complete. 2023-11-04T01:40:07.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 -- start start 2023-11-04T01:40:07.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7fa9d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f40c9880 0x7ff7f413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7fa9d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f413f240 con 0x7ff7f4159640 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3a888640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c048450 0x7f2b2c049c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b34063da0 tx=0x7f2b34067570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34072660 con 0x7f2b2c048450 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340727c0 con 0x7f2b2c048450 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34082610 con 0x7f2b2c048450 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b24009420 con 0x7f2b2c048450 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0afc04f5a0 0x7f0afc047410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc04fa60 0x7f0afc188910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc18c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0259c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0afc04f5a0 0x7f0afc047410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc046ff0 con 0x7f0afc0df370 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc046a00 con 0x7f0afc04fa60 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0259c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0afc04f5a0 0x7f0afc047410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:46984/0 (socket says 172.21.15.40:46984) 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0259c640 1 -- 172.21.15.40:0/1162811067 learned_addr learned my addr 172.21.15.40:0/1162811067 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b01d9b640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc04fa60 0x7f0afc188910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b0359e640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc18d210 con 0x7f0afc04f5a0 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f0b02d9d640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc18c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e60f10640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0c4240 0x7f6e5c201700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 Processor -- start 2023-11-04T01:40:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7ebfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7f4159640 0x7ff7f40c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48952/0 (socket says 172.21.15.40:48952) 2023-11-04T01:40:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7ebfff640 1 -- 172.21.15.40:0/2961073860 learned_addr learned my addr 172.21.15.40:0/2961073860 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7f8f72640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f40c9880 0x7ff7f413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400cf0e0 0x7f424015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4240151700 0x7f42400af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42400c2fd0 con 0x7f42400cf0e0 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4240151ca0 con 0x7f4240151700 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f4244a83640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4240151f80 con 0x7f42400cb160 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a8001a400 con 0x7f6a8c037d60 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a90ff9640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a780664a0 0x7f6a78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a80084600 con 0x7f6a8c037d60 2023-11-04T01:40:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a90ff9640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] conn(0x7f6a7806e640 0x7f6a78070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 --> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a78071110 con 0x7f6a7806e640 2023-11-04T01:40:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a800849b0 con 0x7f6a8c037d60 2023-11-04T01:40:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a937fe640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a780664a0 0x7f6a78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c049180 con 0x7f2b2c048450 2023-11-04T01:40:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b2c0e7ba0 con 0x7f2b2c048450 2023-11-04T01:40:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6a98fe5640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] conn(0x7f6a7806e640 0x7f6a78070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61711640 1 -- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0d01b0 msgr2=0x7f6e5c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61711640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6e5c0d01b0 0x7f6e5c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61711640 1 -- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0c4240 msgr2=0x7f6e5c201700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61711640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e5c0c4240 0x7f6e5c201700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f6e61711640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500094d0 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f413ec10 con 0x7ff7f4159260 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f415da60 con 0x7ff7f40c9880 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f423ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4240151700 0x7f42400af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f423f7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f423f7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424014e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:46996/0 (socket says 172.21.15.40:46996) 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7f423f7fe640 1 -- 172.21.15.40:0/1597608349 learned_addr learned my addr 172.21.15.40:0/1597608349 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40074e0 con 0x7f39b406b4b0 2023-11-04T01:40:07.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423effd640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400cf0e0 0x7f424015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366743127 0 0) 0x7ff7f413f240 con 0x7ff7f4159640 2023-11-04T01:40:07.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e0003530 con 0x7ff7f4159640 2023-11-04T01:40:07.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a4007640 con 0x7f39b406b4b0 2023-11-04T01:40:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4004a30 con 0x7f39b406b4b0 2023-11-04T01:40:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b02d9d640 1 -- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0afc04f5a0 msgr2=0x7f0afc047410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b02d9d640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0afc04f5a0 0x7f0afc047410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b02d9d640 1 -- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc04fa60 msgr2=0x7f0afc188910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b02d9d640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc04fa60 0x7f0afc188910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b02d9d640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4008550 con 0x7f0afc0df370 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b0259c640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0afc04f5a0 0x7f0afc047410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b01d9b640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0afc04fa60 0x7f0afc188910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.192+0000 7fa04da0b640 1 -- start start 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa04da0b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce070 0x7fa0480b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa04da0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0480ce720 0x7fa0480c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa04da0b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa04da0b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c4f10 con 0x7fa0480ce720 2023-11-04T01:40:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa04da0b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480b0d10 con 0x7fa048159a50 2023-11-04T01:40:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa04da0b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480b2950 con 0x7fa0480ce070 2023-11-04T01:40:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1269508094 0 0) 0x7ff7e0003530 con 0x7ff7f4159640 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f40c9880 msgr2=0x7ff7f413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f40c9880 0x7ff7f413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 >> v1:172.21.15.91:6789/0 conn(0x7ff7f4159260 legacy=0x7ff7f415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f415dd40 con 0x7ff7f4159640 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff7dc001680 con 0x7ff7f4159640 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 >> v1:172.21.15.40:6789/0 conn(0x7ff7f4159640 legacy=0x7ff7f40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e0003770 0x7ff7e0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e61711640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e5c0d16f0 0x7f6e5c0c7c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e7a0 tx=0x7f6e4c00ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7e00040d0 0x7ff7e000b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7e000b560 0x7ff7e000d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f415da60 con 0x7ff7e0003770 2023-11-04T01:40:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e000e1a0 con 0x7ff7e00040d0 2023-11-04T01:40:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e000e360 con 0x7ff7e000b560 2023-11-04T01:40:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b02d9d640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc18c750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0af800d5d0 tx=0x7f0af800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6a98fe5640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] conn(0x7f6a7806e640 0x7f6a78070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== osd.2 v2:172.21.15.40:6816/788033951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f6a78071110 con 0x7f6a7806e640 2023-11-04T01:40:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00eeb0 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00c940 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0ca250 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c201c40 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00ccf0 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e5c0cf480 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0480ce720 0x7fa0480c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0477fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0480ce720 0x7fa0480c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60330/0 (socket says 172.21.15.40:60330) 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0477fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52536/0 (socket says 172.21.15.40:52536) 2023-11-04T01:40:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 -- 172.21.15.40:0/3121237441 learned_addr learned my addr 172.21.15.40:0/3121237441 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 -- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce070 msgr2=0x7fa0480b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0480ce070 0x7fa0480b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 -- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 msgr2=0x7fa0480b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa048159a50 0x7fa0480b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 -- 172.21.15.40:0/3121237441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03800a580 con 0x7fa0480ce720 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7fa0467fc640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0480ce720 0x7fa0480c49d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00b240 tx=0x7fa03c00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b9f3b640 1 -- 172.21.15.40:0/3963217227 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40c2a90 con 0x7f39b406b4b0 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b9f3b640 1 -- 172.21.15.40:0/3963217227 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b414f440 con 0x7f39b406b4b0 2023-11-04T01:40:07.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b9f3b640 1 -- 172.21.15.40:0/3963217227 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39b40ae0b0 con 0x7f39b406b4b0 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f3fff640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e0003770 0x7ff7e0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7e00040d0 0x7ff7e000b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423f7fe640 1 -- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4240151700 msgr2=0x7f42400af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423f7fe640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4240151700 0x7f42400af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423f7fe640 1 -- 172.21.15.40:0/1597608349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400cf0e0 msgr2=0x7f424015bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423f7fe640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42400cf0e0 0x7f424015bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423f7fe640 1 -- 172.21.15.40:0/1597608349 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300094d0 con 0x7f42400cb160 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f423f7fe640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424014e6a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f423800ba50 tx=0x7f423800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800cbe0 con 0x7f42400cb160 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800cd60 con 0x7f42400cb160 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238014680 con 0x7f42400cb160 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42400c2980 con 0x7f42400cb160 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424014ebe0 con 0x7f42400cb160 2023-11-04T01:40:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b34071040 con 0x7f2b2c048450 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42400cc180 con 0x7f42400cb160 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8014620 con 0x7f0afc0df370 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af80147a0 con 0x7f0afc0df370 2023-11-04T01:40:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8014b50 con 0x7f0afc0df370 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f39a4004b90 con 0x7f39b406b4b0 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7f8f72640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7e000b560 0x7ff7e000d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f6a937fe640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a780664a0 0x7f6a78068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0deb80 tx=0x7f6a88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b2affd640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b180664f0 0x7f2b180689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b340ede40 con 0x7f2b2c048450 2023-11-04T01:40:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7ebfff640 1 -- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7e000b560 msgr2=0x7ff7e000d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7e000b560 0x7ff7e000d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7ebfff640 1 -- 172.21.15.40:0/2961073860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e0003770 msgr2=0x7ff7e0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e0003770 0x7ff7e0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7ff7ebfff640 1 -- 172.21.15.40:0/2961073860 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f415dd40 con 0x7ff7e00040d0 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f39b0ff9640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39a4083050 con 0x7f39b406b4b0 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39b0ff9640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] conn(0x7f399406e640 0x7f3994070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 --> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3994071110 con 0x7f399406e640 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39a40503b0 con 0x7f39b406b4b0 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39abfff640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39b3fff640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] conn(0x7f399406e640 0x7f3994070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b0359e640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc007770 con 0x7f0afc0df370 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f0b0359e640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc046c10 con 0x7f0afc0df370 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f0b0359e640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ae8000fd0 con 0x7f0afc0df370 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39abfff640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39b40b2a50 tx=0x7f399c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b2affd640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] conn(0x7f2b1806e710 0x7f2b18070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 --> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b180711e0 con 0x7f2b1806e710 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b340ee1b0 con 0x7f2b2c048450 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4238007370 con 0x7f42400cb160 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.196+0000 7f2b3a087640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b180664f0 0x7f2b180689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f2b39886640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] conn(0x7f2b1806e710 0x7f2b18070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f2b39886640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] conn(0x7f2b1806e710 0x7f2b18070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6e4c013470 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e597fa640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e480664a0 0x7f6e48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e4c084400 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e597fa640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] conn(0x7f6e4806e640 0x7f6e48070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e48071110 con 0x7f6e4806e640 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e4c0847b0 con 0x7f6e5c0d16f0 2023-11-04T01:40:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e5bfff640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] conn(0x7f6e4806e640 0x7f6e48070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7e00040d0 0x7ff7e000b020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c1b0 tx=0x7ff7dc01cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b93d87340d124 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f2b3a087640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b180664f0 0x7f2b180689b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b30007fd0 tx=0x7f2b30007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f4227fff640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f422c066570 0x7f422c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4238084520 con 0x7f42400cb160 2023-11-04T01:40:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f4227fff640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] conn(0x7f422c06e790 0x7f422c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 --> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f422c071260 con 0x7f422c06e790 2023-11-04T01:40:07.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42380848d0 con 0x7f42400cb160 2023-11-04T01:40:07.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f39b3fff640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] conn(0x7f399406e640 0x7f3994070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f423effd640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f422c066570 0x7f422c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e60f10640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e480664a0 0x7f6e48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f6e5bfff640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] conn(0x7f6e4806e640 0x7f6e48070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== osd.0 v2:172.21.15.40:6800/3235912228 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f2b180711e0 con 0x7f2b1806e710 2023-11-04T01:40:07.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0a5b10 con 0x7ff7e00040d0 2023-11-04T01:40:07.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc0a5c90 con 0x7ff7e00040d0 2023-11-04T01:40:07.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7f37fe640 1 -- 172.21.15.40:0/2961073860 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc005b20 con 0x7ff7e00040d0 2023-11-04T01:40:07.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7e00040d0 msgr2=0x7ff7e000b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7fa9d5640 1 --2- 172.21.15.40:0/2961073860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7e00040d0 0x7ff7e000b020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c1b0 tx=0x7ff7dc01cc30 comp rx=0 tx=0).stop 2023-11-04T01:40:07.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c010440 con 0x7fa0480ce720 2023-11-04T01:40:07.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c0105a0 con 0x7fa0480ce720 2023-11-04T01:40:07.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c010910 con 0x7fa0480ce720 2023-11-04T01:40:07.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7fa04da0b640 1 -- 172.21.15.40:0/3121237441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0480b2c30 con 0x7fa0480ce720 2023-11-04T01:40:07.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7fa04da0b640 1 -- 172.21.15.40:0/3121237441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0480c6f90 con 0x7fa0480ce720 2023-11-04T01:40:07.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7fa04da0b640 1 -- 172.21.15.40:0/3121237441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa028000fd0 con 0x7fa0480ce720 2023-11-04T01:40:07.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7ff7f8f72640 1 -- 172.21.15.40:0/2961073860 reap_dead start 2023-11-04T01:40:07.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== osd.3 v2:172.21.15.40:6817/4092378766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f6e48071110 con 0x7f6e4806e640 2023-11-04T01:40:07.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 shutdown_connections 2023-11-04T01:40:07.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 >> 172.21.15.40:0/2961073860 conn(0x7ff7f40cebb0 msgr2=0x7ff7f40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 shutdown_connections 2023-11-04T01:40:07.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.200+0000 7f423ffff640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] conn(0x7f422c06e790 0x7f422c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f423effd640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f422c066570 0x7f422c068a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42300af000 tx=0x7f42300a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/2961073860 wait complete. 2023-11-04T01:40:07.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f6e60f10640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e480664a0 0x7f6e48068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e500ae000 tx=0x7f6e500a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0af8014cb0 con 0x7f0afc0df370 2023-11-04T01:40:07.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f423ffff640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] conn(0x7f422c06e790 0x7f422c070bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0ae40664f0 0x7f0ae40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0af8084860 con 0x7f0afc0df370 2023-11-04T01:40:07.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] conn(0x7f0ae406e710 0x7f0ae4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ae40711e0 con 0x7f0ae406e710 2023-11-04T01:40:07.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0af8084d00 con 0x7f0afc0df370 2023-11-04T01:40:07.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0b0259c640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0ae40664f0 0x7f0ae40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0b01d9b640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] conn(0x7f0ae406e710 0x7f0ae4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa03c010a70 con 0x7fa0480ce720 2023-11-04T01:40:07.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== osd.5 v2:172.21.15.91:6808/2194189179 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f3994071110 con 0x7f399406e640 2023-11-04T01:40:07.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 Processor -- start 2023-11-04T01:40:07.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- start start 2023-11-04T01:40:07.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa02ffff640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa034066570 0x7fa034068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0b01d9b640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] conn(0x7f0ae406e710 0x7f0ae4070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0b0259c640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0ae40664f0 0x7f0ae40689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b04079c20 tx=0x7f0b04061de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== osd.1 v2:172.21.15.40:6802/865841018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f0ae40711e0 con 0x7f0ae406e710 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa03c014030 con 0x7fa0480ce720 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa02ffff640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] conn(0x7fa03406e790 0x7fa034070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 --> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa034071260 con 0x7fa03406e790 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa03c084da0 con 0x7fa0480ce720 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa046ffd640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa034066570 0x7fa034068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa0477fe640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] conn(0x7fa03406e790 0x7fa034070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa046ffd640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa034066570 0x7fa034068a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0380b1000 tx=0x7fa038004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7fa0477fe640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] conn(0x7fa03406e790 0x7fa034070bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== osd.4 v2:172.21.15.91:6800/3214346669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fa034071260 con 0x7fa03406e790 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f41fa700 0x7ff7f40c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f4141100 0x7ff7f41621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7f41fbe80 0x7ff7f41626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c3400 con 0x7ff7f4141100 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c2780 con 0x7ff7f41fbe80 2023-11-04T01:40:07.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7fa9d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c2a60 con 0x7ff7f41fa700 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f41fa700 0x7ff7f40c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f41fa700 0x7ff7f40c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:47016/0 (socket says 172.21.15.40:47016) 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 -- 172.21.15.40:0/214864017 learned_addr learned my addr 172.21.15.40:0/214864017 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f8f72640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7f41fbe80 0x7ff7f41626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f4141100 0x7ff7f41621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 -- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7f41fbe80 msgr2=0x7ff7f41626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7f41fbe80 0x7ff7f41626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 -- 172.21.15.40:0/214864017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f4141100 msgr2=0x7ff7f41621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f4141100 0x7ff7f41621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7ff7f3fff640 1 -- 172.21.15.40:0/214864017 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f415d830 con 0x7ff7f41fa700 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7f3fff640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f41fa700 0x7ff7f40c3990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400f7f0 tx=0x7ff7e400fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40050d0 con 0x7ff7f41fa700 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f40c2d40 con 0x7ff7f41fa700 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f40c3ed0 con 0x7ff7f41fa700 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4005230 con 0x7ff7f41fa700 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400d730 con 0x7ff7f41fa700 2023-11-04T01:40:07.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.208+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7f415d6b0 con 0x7ff7f41fa700 2023-11-04T01:40:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.204+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== osd.7 v2:172.21.15.91:6810/2470646827 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f422c071260 con 0x7f422c06e790 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7e400d890 con 0x7ff7f41fa700 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f17fa640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7d40664a0 0x7ff7d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7e40846e0 con 0x7ff7f41fa700 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7d40664a0 0x7ff7d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f17fa640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] conn(0x7ff7d406e6c0 0x7ff7d4070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 --> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7d4071190 con 0x7ff7d406e6c0 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e4084a90 con 0x7ff7f41fa700 2023-11-04T01:40:07.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f8f72640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] conn(0x7ff7d406e6c0 0x7ff7d4070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7ebfff640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7d40664a0 0x7ff7d4068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0ab000 tx=0x7ff7dc006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.216+0000 7ff7f8f72640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] conn(0x7ff7d406e6c0 0x7ff7d4070ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.220+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== osd.6 v2:172.21.15.91:6824/3197908777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7ff7d4071190 con 0x7ff7d406e6c0 2023-11-04T01:40:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0b0359e640 1 -- 172.21.15.40:0/1162811067 --> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ae8002cc0 con 0x7f0ae406e710 2023-11-04T01:40:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39b9f3b640 1 -- 172.21.15.40:0/3963217227 --> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39b40c3220 con 0x7f399406e640 2023-11-04T01:40:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af2ffd640 1 -- 172.21.15.40:0/1162811067 <== osd.1 v2:172.21.15.40:6802/865841018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ae8002cc0 con 0x7f0ae406e710 2023-11-04T01:40:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 --> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42400c3110 con 0x7f422c06e790 2023-11-04T01:40:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 --> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b2c006a80 con 0x7f2b1806e710 2023-11-04T01:40:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39b0ff9640 1 -- 172.21.15.40:0/3963217227 <== osd.5 v2:172.21.15.91:6808/2194189179 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f39ac009450 con 0x7f399406e640 2023-11-04T01:40:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] conn(0x7f0ae406e710 msgr2=0x7f0ae4070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:6802/865841018,v1:172.21.15.40:6804/865841018] conn(0x7f0ae406e710 0x7f0ae4070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0ae40664f0 msgr2=0x7f0ae40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0ae40664f0 0x7f0ae40689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b04079c20 tx=0x7f0b04061de0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b2affd640 1 -- 172.21.15.40:0/2649605313 <== osd.0 v2:172.21.15.40:6800/3235912228 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b240a85b0 con 0x7f2b1806e710 2023-11-04T01:40:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 msgr2=0x7f0afc18c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 --2- 172.21.15.40:0/1162811067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0afc0df370 0x7f0afc18c750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0af800d5d0 tx=0x7f0af800d9d0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] conn(0x7f399406e640 msgr2=0x7f3994070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6808/2194189179,v1:172.21.15.91:6809/2194189179] conn(0x7f399406e640 0x7f3994070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0b02d9d640 1 -- 172.21.15.40:0/1162811067 reap_dead start 2023-11-04T01:40:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 shutdown_connections 2023-11-04T01:40:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 >> 172.21.15.40:0/1162811067 conn(0x7f0afc009fa0 msgr2=0x7f0afc0de5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 msgr2=0x7f3994068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39b40b2a50 tx=0x7f399c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4227fff640 1 -- 172.21.15.40:0/1597608349 <== osd.7 v2:172.21.15.91:6810/2470646827 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4234009ba0 con 0x7f422c06e790 2023-11-04T01:40:07.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39b406b4b0 msgr2=0x7f39b414ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 --> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e5c0ca0e0 con 0x7f6e4806e640 2023-11-04T01:40:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 --2- 172.21.15.40:0/3963217227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39b406b4b0 0x7f39b414ef00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c530 tx=0x7f39a400c9f0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39b3fff640 1 -- 172.21.15.40:0/3963217227 reap_dead start 2023-11-04T01:40:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 shutdown_connections 2023-11-04T01:40:07.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f0af0ff9640 1 -- 172.21.15.40:0/1162811067 wait complete. 2023-11-04T01:40:07.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 shutdown_connections 2023-11-04T01:40:07.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 >> 172.21.15.40:0/3963217227 conn(0x7f39b40cb480 msgr2=0x7f39b4151b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 shutdown_connections 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f39a9ffb640 1 -- 172.21.15.40:0/3963217227 wait complete. 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] conn(0x7f422c06e790 msgr2=0x7f422c070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6810/2470646827,v1:172.21.15.91:6812/2470646827] conn(0x7f422c06e790 0x7f422c070bb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f422c066570 msgr2=0x7f422c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f422c066570 0x7f422c068a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42300af000 tx=0x7f42300a7070 comp rx=0 tx=0).stop 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 msgr2=0x7f424014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 --2- 172.21.15.40:0/1597608349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42400cb160 0x7f424014e6a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f423800ba50 tx=0x7f423800bf10 comp rx=0 tx=0).stop 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f423ffff640 1 -- 172.21.15.40:0/1597608349 reap_dead start 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 shutdown_connections 2023-11-04T01:40:07.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 >> 172.21.15.40:0/1597608349 conn(0x7f424006a330 msgr2=0x7f424015dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f6e597fa640 1 -- 172.21.15.40:0/38286554 <== osd.3 v2:172.21.15.40:6817/4092378766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e5c0ca0e0 con 0x7f6e4806e640 2023-11-04T01:40:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 shutdown_connections 2023-11-04T01:40:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f4244a83640 1 -- 172.21.15.40:0/1597608349 wait complete. 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] conn(0x7f2b1806e710 msgr2=0x7f2b18070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.40:6800/3235912228,v1:172.21.15.40:6801/3235912228] conn(0x7f2b1806e710 0x7f2b18070b30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b180664f0 msgr2=0x7f2b180689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b180664f0 0x7f2b180689b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b30007fd0 tx=0x7f2b30007940 comp rx=0 tx=0).stop 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c048450 msgr2=0x7f2b2c049c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 --2- 172.21.15.40:0/2649605313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b2c048450 0x7f2b2c049c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b34063da0 tx=0x7f2b34067570 comp rx=0 tx=0).stop 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3a888640 1 -- 172.21.15.40:0/2649605313 reap_dead start 2023-11-04T01:40:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 shutdown_connections 2023-11-04T01:40:07.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 >> 172.21.15.40:0/2649605313 conn(0x7f2b2c054bc0 msgr2=0x7f2b2c04dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7fa04da0b640 1 -- 172.21.15.40:0/3121237441 --> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa028002cf0 con 0x7fa03406e790 2023-11-04T01:40:07.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 shutdown_connections 2023-11-04T01:40:07.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f2b3b089640 1 -- 172.21.15.40:0/2649605313 wait complete. 2023-11-04T01:40:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] conn(0x7f6e4806e640 msgr2=0x7f6e48070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.40:6817/4092378766,v1:172.21.15.40:6818/4092378766] conn(0x7f6e4806e640 0x7f6e48070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02ffff640 1 -- 172.21.15.40:0/3121237441 <== osd.4 v2:172.21.15.91:6800/3214346669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa028002cf0 con 0x7fa03406e790 2023-11-04T01:40:07.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] conn(0x7fa03406e790 msgr2=0x7fa034070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6800/3214346669,v1:172.21.15.91:6801/3214346669] conn(0x7fa03406e790 0x7fa034070bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.232+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 --> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a8c0481d0 con 0x7f6a7806e640 2023-11-04T01:40:07.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a90ff9640 1 -- 172.21.15.40:0/3197373300 <== osd.2 v2:172.21.15.40:6816/788033951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a9411fb00 con 0x7f6a7806e640 2023-11-04T01:40:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] conn(0x7f6a7806e640 msgr2=0x7f6a78070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:6816/788033951,v1:172.21.15.40:6819/788033951] conn(0x7f6a7806e640 0x7f6a78070a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a780664a0 msgr2=0x7f6a78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a780664a0 0x7f6a78068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0deb80 tx=0x7f6a88009040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa034066570 msgr2=0x7fa034068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa034066570 0x7fa034068a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0380b1000 tx=0x7fa038004740 comp rx=0 tx=0).stop 2023-11-04T01:40:07.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c037d60 msgr2=0x7f6a8c0d3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 --2- 172.21.15.40:0/3197373300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c037d60 0x7f6a8c0d3350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000b3e0 tx=0x7f6a8000b8a0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a98fe5640 1 -- 172.21.15.40:0/3197373300 reap_dead start 2023-11-04T01:40:07.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0480ce720 msgr2=0x7fa0480c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 --2- 172.21.15.40:0/3121237441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0480ce720 0x7fa0480c49d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00b240 tx=0x7fa03c00d720 comp rx=0 tx=0).stop 2023-11-04T01:40:07.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa0477fe640 1 -- 172.21.15.40:0/3121237441 reap_dead start 2023-11-04T01:40:07.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e480664a0 msgr2=0x7f6e48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e480664a0 0x7f6e48068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e500ae000 tx=0x7f6e500a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:07.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 shutdown_connections 2023-11-04T01:40:07.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 >> 172.21.15.40:0/3197373300 conn(0x7f6a8c054bc0 msgr2=0x7f6a8c0e62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e5c0d16f0 msgr2=0x7f6e5c0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 shutdown_connections 2023-11-04T01:40:07.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 --2- 172.21.15.40:0/38286554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6e5c0d16f0 0x7f6e5c0c7c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e7a0 tx=0x7f6e4c00ec60 comp rx=0 tx=0).stop 2023-11-04T01:40:07.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 shutdown_connections 2023-11-04T01:40:07.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 >> 172.21.15.40:0/3121237441 conn(0x7fa0480cebb0 msgr2=0x7fa04806c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61711640 1 -- 172.21.15.40:0/38286554 reap_dead start 2023-11-04T01:40:07.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6a997e6640 1 -- 172.21.15.40:0/3197373300 wait complete. 2023-11-04T01:40:07.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 shutdown_connections 2023-11-04T01:40:07.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7fa02dffb640 1 -- 172.21.15.40:0/3121237441 wait complete. 2023-11-04T01:40:07.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 shutdown_connections 2023-11-04T01:40:07.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 >> 172.21.15.40:0/38286554 conn(0x7f6e5c0d0b60 msgr2=0x7f6e5c06f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 shutdown_connections 2023-11-04T01:40:07.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.236+0000 7f6e61f12640 1 -- 172.21.15.40:0/38286554 wait complete. 2023-11-04T01:40:07.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.248+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 --> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7f413fac0 con 0x7ff7d406e6c0 2023-11-04T01:40:07.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.248+0000 7ff7f17fa640 1 -- 172.21.15.40:0/214864017 <== osd.6 v2:172.21.15.91:6824/3197908777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7ec00f040 con 0x7ff7d406e6c0 2023-11-04T01:40:07.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] conn(0x7ff7d406e6c0 msgr2=0x7ff7d4070ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6824/3197908777,v1:172.21.15.91:6825/3197908777] conn(0x7ff7d406e6c0 0x7ff7d4070ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7d40664a0 msgr2=0x7ff7d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7d40664a0 0x7ff7d4068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0ab000 tx=0x7ff7dc006040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f41fa700 msgr2=0x7ff7f40c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 --2- 172.21.15.40:0/214864017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7f41fa700 0x7ff7f40c3990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400f7f0 tx=0x7ff7e400fcb0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7f8f72640 1 -- 172.21.15.40:0/214864017 reap_dead start 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 shutdown_connections 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 >> 172.21.15.40:0/214864017 conn(0x7ff7f40cebb0 msgr2=0x7ff7f41583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 shutdown_connections 2023-11-04T01:40:07.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.252+0000 7ff7fa9d5640 1 -- 172.21.15.40:0/214864017 wait complete. 2023-11-04T01:40:07.294 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-11-04T01:40:07.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:40:07.295 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-11-04T01:40:07.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:40:07.296 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-11-04T01:40:07.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:40:07.297 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:07.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:40:07.298 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-11-04T01:40:07.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:40:07.299 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:07.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:40:07.300 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-11-04T01:40:07.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:40:07.301 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:07.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:40:07.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8404bd9640 1 Processor -- start 2023-11-04T01:40:07.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8404bd9640 1 -- start start 2023-11-04T01:40:07.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 Processor -- start 2023-11-04T01:40:07.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 -- start start 2023-11-04T01:40:07.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f0dd322d640 1 Processor -- start 2023-11-04T01:40:07.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 Processor -- start 2023-11-04T01:40:07.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 -- start start 2023-11-04T01:40:07.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f0f683fa640 1 Processor -- start 2023-11-04T01:40:07.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f0f683fa640 1 -- start start 2023-11-04T01:40:07.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8404bd9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f840015ac90 0x7f840015e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f523ebf9640 1 Processor -- start 2023-11-04T01:40:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f523ebf9640 1 -- start start 2023-11-04T01:40:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8404bd9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84000ca270 0x7f84000ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8f100ccbe0 0x7f8f100ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f100ccfc0 0x7f8f10161180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f101616c0 0x7f8f100cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100ace00 con 0x7f8f100ccfc0 2023-11-04T01:40:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100ad030 con 0x7f8f100ccbe0 2023-11-04T01:40:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f8f15356640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100ad310 con 0x7f8f101616c0 2023-11-04T01:40:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f100ccfc0 0x7f8f10161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f100ccfc0 0x7f8f10161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56588/0 (socket says 172.21.15.40:56588) 2023-11-04T01:40:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 -- 172.21.15.40:0/704001520 learned_addr learned my addr 172.21.15.40:0/704001520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83f7fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f840006d370 0x7f840006be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48268/0 (socket says 172.21.15.40:48268) 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa7200ccbe0 0x7fa7200ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa72006d310 0x7fa7200cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7200ace00 con 0x7fa7200ccfc0 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa720161890 con 0x7fa72006d310 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7fa724dba640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7200ad030 con 0x7fa7200ccbe0 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f683fa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f6006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f683fa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6006a160 con 0x7f0f600ae880 2023-11-04T01:40:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f683fa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600cc7d0 con 0x7f0f600c23f0 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f683fa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6006dbb0 con 0x7f0f60065dc0 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f0dd322d640 1 -- start start 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd322d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0dc40df270 0x7f0dc4053ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd322d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc404ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd322d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc4005dc0 con 0x7f0dc4053070 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd322d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc4050450 con 0x7f0dc40df270 2023-11-04T01:40:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd322d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4006060 con 0x7f0dc404fa60 2023-11-04T01:40:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f14b55640 1 --2- 172.21.15.40:0/704001520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f101616c0 0x7f8f100cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dcbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0dc4053070 0x7f0dc4007100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41100/0 (socket says 172.21.15.40:41100) 2023-11-04T01:40:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dcbfff640 1 -- 172.21.15.40:0/454251446 learned_addr learned my addr 172.21.15.40:0/454251446 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f4c378f2640 1 Processor -- start 2023-11-04T01:40:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.512+0000 7f4c378f2640 1 -- start start 2023-11-04T01:40:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd0fc9640 1 --2- 172.21.15.40:0/454251446 >> v2:172.21.15.40:3300/0 conn(0x7f0dc40df270 0x7f0dc4053ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c378f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c280df370 0x7f4c280070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa72006d310 0x7fa7200cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa7200ccbe0 0x7fa7200ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa72006d310 0x7fa7200cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56576/0 (socket says 172.21.15.40:56576) 2023-11-04T01:40:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71ffff640 1 -- 172.21.15.40:0/3649859020 learned_addr learned my addr 172.21.15.40:0/3649859020 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fe59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f840015ac90 0x7f840015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fe59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f840015ac90 0x7f840015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52462/0 (socket says 172.21.15.40:52462) 2023-11-04T01:40:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523ebf9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5238071030 0x7f52380ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8404bd9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840015ee40 con 0x7f840006d370 2023-11-04T01:40:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f66997640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0f600c23f0 0x7f0f600cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48280/0 (socket says 172.21.15.40:48280) 2023-11-04T01:40:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f66997640 1 -- 172.21.15.40:0/728251341 learned_addr learned my addr 172.21.15.40:0/728251341 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8404bd9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000cac00 con 0x7f84000ca270 2023-11-04T01:40:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 Processor -- start 2023-11-04T01:40:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8404bd9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840006fc30 con 0x7f840015ac90 2023-11-04T01:40:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd17ca640 1 --2- 172.21.15.40:0/454251446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc404ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 -- start start 2023-11-04T01:40:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523ebf9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380ca8a0 con 0x7f52380cb940 2023-11-04T01:40:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523ebf9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380cab80 con 0x7f5238159ac0 2023-11-04T01:40:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523ebf9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380cae60 con 0x7f5238071030 2023-11-04T01:40:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65995640 1 --2- 172.21.15.40:0/728251341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f6006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71f7fe640 1 -- 172.21.15.40:0/3649859020 >> v2:172.21.15.40:3300/0 conn(0x7fa72006d310 msgr2=0x7fa7200cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71f7fe640 1 --2- 172.21.15.40:0/3649859020 >> v2:172.21.15.40:3300/0 conn(0x7fa72006d310 0x7fa7200cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71f7fe640 1 -- 172.21.15.40:0/3649859020 >> v1:172.21.15.91:6789/0 conn(0x7fa7200ccfc0 legacy=0x7fa720161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7fa71f7fe640 1 -- 172.21.15.40:0/3649859020 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200ad310 con 0x7fa7200ccbe0 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c378f2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4c28050170 0x7f4c28038000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c378f2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c28005dc0 con 0x7f4c2800c090 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c378f2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c28006c20 con 0x7f4c28050170 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c378f2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28054370 con 0x7f4c280df370 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c3568e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c280df370 0x7f4c280070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c3568e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c280df370 0x7f4c280070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:41874/0 (socket says 172.21.15.40:41874) 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c3568e640 1 -- 172.21.15.40:0/4273327907 learned_addr learned my addr 172.21.15.40:0/4273327907 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/4273327907 >> v2:172.21.15.91:3300/0 conn(0x7f4c28050170 0x7f4c28038000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd17ca640 1 -- 172.21.15.40:0/454251446 >> v2:172.21.15.40:3300/0 conn(0x7f0dc40df270 msgr2=0x7f0dc4053ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd17ca640 1 --2- 172.21.15.40:0/454251446 >> v2:172.21.15.40:3300/0 conn(0x7f0dc40df270 0x7f0dc4053ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd17ca640 1 -- 172.21.15.40:0/454251446 >> v1:172.21.15.40:6789/0 conn(0x7f0dc4053070 legacy=0x7f0dc4007100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0dd17ca640 1 -- 172.21.15.40:0/454251446 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc4006340 con 0x7f0dc404fa60 2023-11-04T01:40:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84000ca270 0x7f84000ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83f7fff640 1 -- 172.21.15.40:0/1363601750 learned_addr learned my addr 172.21.15.40:0/1363601750 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fe59c640 1 -- 172.21.15.40:0/1363601750 >> v2:172.21.15.40:3300/0 conn(0x7f84000ca270 msgr2=0x7f84000ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fe59c640 1 --2- 172.21.15.40:0/1363601750 >> v2:172.21.15.40:3300/0 conn(0x7f84000ca270 0x7f84000ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fe59c640 1 -- 172.21.15.40:0/1363601750 >> v1:172.21.15.91:6789/0 conn(0x7f840006d370 legacy=0x7f840006be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f83fe59c640 1 -- 172.21.15.40:0/1363601750 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840006b690 con 0x7f840015ac90 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c35e8f640 1 -- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c280df370 msgr2=0x7f4c280070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c280df370 0x7f4c280070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c35e8f640 1 -- 172.21.15.40:0/4273327907 >> v1:172.21.15.91:6789/0 conn(0x7f4c2800c090 legacy=0x7f4c2804fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f4c35e8f640 1 -- 172.21.15.40:0/4273327907 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28006010 con 0x7f4c28050170 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523dbf7640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5238159ac0 0x7f5238070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48298/0 (socket says 172.21.15.40:48298) 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523dbf7640 1 -- 172.21.15.40:0/1772217646 learned_addr learned my addr 172.21.15.40:0/1772217646 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 -- 172.21.15.40:0/704001520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f101616c0 msgr2=0x7f8f100cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 --2- 172.21.15.40:0/704001520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f101616c0 0x7f8f100cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 -- 172.21.15.40:0/704001520 >> v2:172.21.15.91:3300/0 conn(0x7f8f100ccbe0 msgr2=0x7f8f100ac8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 --2- 172.21.15.40:0/704001520 >> v2:172.21.15.91:3300/0 conn(0x7f8f100ccbe0 0x7f8f100ac8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 -- 172.21.15.40:0/704001520 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100ad5f0 con 0x7f8f100ccfc0 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760573038 0 0) 0x7f52380cab80 con 0x7f5238159ac0 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5228003530 con 0x7f5238159ac0 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff544143580 0x7ff5440c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff544160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544161600 con 0x7ff544160a90 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff544161410 con 0x7ff544143580 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff54923c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5441618e0 con 0x7ff5440ceda0 2023-11-04T01:40:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff544143580 0x7ff5440c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654183931 0 0) 0x7f0f6006a160 con 0x7f0f600ae880 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c003530 con 0x7f0f600ae880 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438869764 0 0) 0x7f0f600cc7d0 con 0x7f0f600c23f0 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6006a160 con 0x7f0f600c23f0 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65995640 1 -- 172.21.15.40:0/728251341 >> v1:172.21.15.91:6789/0 conn(0x7f0f600c23f0 legacy=0x7f0f600cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65995640 1 -- 172.21.15.40:0/728251341 >> v1:172.21.15.40:6789/0 conn(0x7f0f600ae880 legacy=0x7f0f600b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f0f65995640 1 -- 172.21.15.40:0/728251341 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600cf350 con 0x7f0f60065dc0 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff548a3b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff544160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff544143580 0x7ff5440c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56630/0 (socket says 172.21.15.40:56630) 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 -- 172.21.15.40:0/2313432218 learned_addr learned my addr 172.21.15.40:0/2313432218 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 -- 172.21.15.40:0/2313432218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 msgr2=0x7ff544160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 --2- 172.21.15.40:0/2313432218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff544160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 -- 172.21.15.40:0/2313432218 >> v1:172.21.15.91:6789/0 conn(0x7ff544160a90 legacy=0x7ff5440ce690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7ff543fff640 1 -- 172.21.15.40:0/2313432218 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440c8e20 con 0x7ff544143580 2023-11-04T01:40:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.516+0000 7f8f0f7fe640 1 --2- 172.21.15.40:0/704001520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100ccfc0 0x7f8f10161180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f100cb340 tx=0x7f8f0401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0b708b15e659a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523d3f6640 1 --2- 172.21.15.40:0/1772217646 >> v2:172.21.15.40:3300/0 conn(0x7f5238071030 0x7f52380ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 <== mon.1 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1013911785 0 0) 0x7f5228003530 con 0x7f5238159ac0 2023-11-04T01:40:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f0effd640 1 -- 172.21.15.40:0/704001520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040aa430 con 0x7f8f100ccfc0 2023-11-04T01:40:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f0effd640 1 -- 172.21.15.40:0/704001520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040aa590 con 0x7f8f100ccfc0 2023-11-04T01:40:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f0effd640 1 -- 172.21.15.40:0/704001520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040aa960 con 0x7f8f100ccfc0 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 >> v2:172.21.15.40:3300/0 conn(0x7f5238071030 msgr2=0x7f52380ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 --2- 172.21.15.40:0/1772217646 >> v2:172.21.15.40:3300/0 conn(0x7f5238071030 0x7f52380ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 >> v1:172.21.15.40:6789/0 conn(0x7f52380cb940 legacy=0x7f523806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380cb140 con 0x7f5238159ac0 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523d3f6640 1 --2- 172.21.15.40:0/1772217646 >> v2:172.21.15.40:3300/0 conn(0x7f5238071030 0x7f52380ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 <== mon.1 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f5224001680 con 0x7f5238159ac0 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 >> v1:172.21.15.91:6789/0 conn(0x7f5238159ac0 legacy=0x7f5238070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280039d0 0x7f5228003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280047d0 0x7f5228004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5228005190 0x7f5228014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380cae60 con 0x7f52280039d0 2023-11-04T01:40:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228014ad0 con 0x7f52280047d0 2023-11-04T01:40:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228014c10 con 0x7f5228005190 2023-11-04T01:40:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa71f7fe640 1 --2- 172.21.15.40:0/3649859020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7200ccbe0 0x7fa7200ac8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7200cb340 tx=0x7fa71401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ce51f06f9527b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523e3f8640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5228005190 0x7f5228014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd17ca640 1 --2- 172.21.15.40:0/454251446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc404ff10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0db80097c0 tx=0x7f0db801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d33d7adf87217f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523dbf7640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280039d0 0x7f5228003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523d3f6640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280047d0 0x7f5228004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c28038000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000b70 tx=0x7f4c30096cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ba767386841459 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 -- 172.21.15.40:0/704001520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100ccfc0 msgr2=0x7f8f10161180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 --2- 172.21.15.40:0/704001520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100ccfc0 0x7f8f10161180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f100cb340 tx=0x7f8f0401c510 comp rx=0 tx=0).stop 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523dbf7640 1 -- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5228005190 msgr2=0x7f5228014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523dbf7640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5228005190 0x7f5228014590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523dbf7640 1 -- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280047d0 msgr2=0x7f5228004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523dbf7640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280047d0 0x7f5228004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523dbf7640 1 -- 172.21.15.40:0/1772217646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228003530 con 0x7f52280039d0 2023-11-04T01:40:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dcb7fe640 1 -- 172.21.15.40:0/454251446 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80ab600 con 0x7f0dc404fa60 2023-11-04T01:40:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dcb7fe640 1 -- 172.21.15.40:0/454251446 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db80a7050 con 0x7f0dc404fa60 2023-11-04T01:40:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dcb7fe640 1 -- 172.21.15.40:0/454251446 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80ab980 con 0x7f0dc404fa60 2023-11-04T01:40:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa71e7fc640 1 -- 172.21.15.40:0/3649859020 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140ab600 con 0x7fa7200ccbe0 2023-11-04T01:40:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa71e7fc640 1 -- 172.21.15.40:0/3649859020 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7140a7050 con 0x7fa7200ccbe0 2023-11-04T01:40:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa71e7fc640 1 -- 172.21.15.40:0/3649859020 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7140ab980 con 0x7fa7200ccbe0 2023-11-04T01:40:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 -- 172.21.15.40:0/704001520 shutdown_connections 2023-11-04T01:40:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 --2- 172.21.15.40:0/704001520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f101616c0 0x7f8f100cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 --2- 172.21.15.40:0/704001520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100ccfc0 0x7f8f10161180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 --2- 172.21.15.40:0/704001520 >> v2:172.21.15.91:3300/0 conn(0x7f8f100ccbe0 0x7f8f100ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 -- 172.21.15.40:0/704001520 >> 172.21.15.40:0/704001520 conn(0x7f8f100b0550 msgr2=0x7f8f100b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 -- 172.21.15.40:0/704001520 shutdown_connections 2023-11-04T01:40:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 -- 172.21.15.40:0/3649859020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7200ccbe0 msgr2=0x7fa7200ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f83fe59c640 1 --2- 172.21.15.40:0/1363601750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840015ac90 0x7f840015e900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8400071dc0 tx=0x7f83e80206b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b2424b7376d49 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f83fdd9b640 1 -- 172.21.15.40:0/1363601750 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e800d0d0 con 0x7f840015ac90 2023-11-04T01:40:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f83fdd9b640 1 -- 172.21.15.40:0/1363601750 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e800d230 con 0x7f840015ac90 2023-11-04T01:40:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f83fdd9b640 1 -- 172.21.15.40:0/1363601750 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e80a97a0 con 0x7f840015ac90 2023-11-04T01:40:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f523e3f8640 1 -- 172.21.15.40:0/1772217646 reap_dead start 2023-11-04T01:40:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 --2- 172.21.15.40:0/3649859020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7200ccbe0 0x7fa7200ac8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7200cb340 tx=0x7fa71401c450 comp rx=0 tx=0).stop 2023-11-04T01:40:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 -- 172.21.15.40:0/3649859020 shutdown_connections 2023-11-04T01:40:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 --2- 172.21.15.40:0/3649859020 >> v2:172.21.15.40:3300/0 conn(0x7fa72006d310 0x7fa7200cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 --2- 172.21.15.40:0/3649859020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7200ccbe0 0x7fa7200ac8c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 -- 172.21.15.40:0/3649859020 >> 172.21.15.40:0/3649859020 conn(0x7fa7200b0550 msgr2=0x7fa7200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0f65995640 1 --2- 172.21.15.40:0/728251341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f6006d350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0097f0 tx=0x7f0f5c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da63ea804207167 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd322d640 1 -- 172.21.15.40:0/454251446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 msgr2=0x7f0dc404ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd322d640 1 --2- 172.21.15.40:0/454251446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc404ff10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0db80097c0 tx=0x7f0db801c380 comp rx=0 tx=0).stop 2023-11-04T01:40:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 -- 172.21.15.40:0/3649859020 shutdown_connections 2023-11-04T01:40:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7ff543fff640 1 --2- 172.21.15.40:0/2313432218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440c9900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff534009870 tx=0x7ff53401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7e8deed33a2b45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0ab600 con 0x7f0f60065dc0 2023-11-04T01:40:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7ff5437fe640 1 -- 172.21.15.40:0/2313432218 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340aa5f0 con 0x7ff544143580 2023-11-04T01:40:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7ff5437fe640 1 -- 172.21.15.40:0/2313432218 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340aa750 con 0x7ff544143580 2023-11-04T01:40:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7ff5437fe640 1 -- 172.21.15.40:0/2313432218 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340aaae0 con 0x7ff544143580 2023-11-04T01:40:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd322d640 1 -- 172.21.15.40:0/454251446 shutdown_connections 2023-11-04T01:40:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd322d640 1 --2- 172.21.15.40:0/454251446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc404ff10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd322d640 1 --2- 172.21.15.40:0/454251446 >> v2:172.21.15.40:3300/0 conn(0x7f0dc40df270 0x7f0dc4053ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0dd322d640 1 -- 172.21.15.40:0/454251446 >> 172.21.15.40:0/454251446 conn(0x7f0dc4009fa0 msgr2=0x7f0dc400a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 -- 172.21.15.40:0/704001520 wait complete. 2023-11-04T01:40:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 Processor -- start 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7ff54923c640 1 -- 172.21.15.40:0/2313432218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 msgr2=0x7ff5440c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7ff54923c640 1 --2- 172.21.15.40:0/2313432218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440c9900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff534009870 tx=0x7ff53401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a7050 con 0x7f0f60065dc0 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0f65194640 1 -- 172.21.15.40:0/728251341 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0ab960 con 0x7f0f60065dc0 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0f683fa640 1 -- 172.21.15.40:0/728251341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 msgr2=0x7f0f6006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f0f683fa640 1 --2- 172.21.15.40:0/728251341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f6006d350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0097f0 tx=0x7f0f5c01c4e0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f4c27fff640 1 -- 172.21.15.40:0/4273327907 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3011fc50 con 0x7f4c28050170 2023-11-04T01:40:07.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8404bd9640 1 -- 172.21.15.40:0/1363601750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840015ac90 msgr2=0x7f840015e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8404bd9640 1 --2- 172.21.15.40:0/1363601750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840015ac90 0x7f840015e900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8400071dc0 tx=0x7f83e80206b0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f4c27fff640 1 -- 172.21.15.40:0/4273327907 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3011fdb0 con 0x7f4c28050170 2023-11-04T01:40:07.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- 172.21.15.40:0/2313432218 shutdown_connections 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 --2- 172.21.15.40:0/2313432218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff544160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 --2- 172.21.15.40:0/2313432218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440c9900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- 172.21.15.40:0/2313432218 >> 172.21.15.40:0/2313432218 conn(0x7ff5440cc4b0 msgr2=0x7ff5440cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- 172.21.15.40:0/728251341 shutdown_connections 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 --2- 172.21.15.40:0/728251341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f6006d350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- 172.21.15.40:0/728251341 >> 172.21.15.40:0/728251341 conn(0x7f0f600716a0 msgr2=0x7f0f60071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- 172.21.15.40:0/2313432218 shutdown_connections 2023-11-04T01:40:07.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- 172.21.15.40:0/728251341 shutdown_connections 2023-11-04T01:40:07.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7f8f15356640 1 -- start start 2023-11-04T01:40:07.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f15356640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f100ccbe0 0x7f8f10157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f15356640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f100ccfc0 0x7f8f100c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- 172.21.15.40:0/2313432218 wait complete. 2023-11-04T01:40:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 Processor -- start 2023-11-04T01:40:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f15356640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 0x7f8f100c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.520+0000 7fa724dba640 1 -- 172.21.15.40:0/3649859020 wait complete. 2023-11-04T01:40:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 Processor -- start 2023-11-04T01:40:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 -- start start 2023-11-04T01:40:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72006d310 0x7fa72006be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f100ccbe0 0x7f8f10157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f100ccbe0 0x7f8f10157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52490/0 (socket says 172.21.15.40:52490) 2023-11-04T01:40:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 0x7fa7201490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7200ccfc0 0x7fa720149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 0x7f8f100c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 0x7f8f100c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56662/0 (socket says 172.21.15.40:56662) 2023-11-04T01:40:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72014a040 con 0x7fa7200ccbe0 2023-11-04T01:40:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa720145ad0 con 0x7fa72006d310 2023-11-04T01:40:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720149b40 con 0x7fa7200ccfc0 2023-11-04T01:40:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 0x7fa7201490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f4c378f2640 1 -- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 msgr2=0x7f4c28038000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f4c378f2640 1 --2- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c28038000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000b70 tx=0x7f4c30096cc0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 0x7fa7201490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56678/0 (socket says 172.21.15.40:56678) 2023-11-04T01:40:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 -- 172.21.15.40:0/3760516464 learned_addr learned my addr 172.21.15.40:0/3760516464 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- 172.21.15.40:0/728251341 wait complete. 2023-11-04T01:40:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f100ccfc0 0x7f8f100c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f100ccfc0 0x7f8f100c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:41898/0 (socket says 172.21.15.40:41898) 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 Processor -- start 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523dbf7640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280039d0 0x7f5228003dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f522400c1c0 tx=0x7f522401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7012c6bc046418 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224005ae0 con 0x7f52280039d0 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224005c40 con 0x7f52280039d0 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523cbf5640 1 -- 172.21.15.40:0/1772217646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224007070 con 0x7f52280039d0 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 -- 172.21.15.40:0/1772217646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280039d0 msgr2=0x7f5228003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280039d0 0x7f5228003dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f522400c1c0 tx=0x7f522401cbf0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 -- 172.21.15.40:0/1772217646 shutdown_connections 2023-11-04T01:40:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 --2- 172.21.15.40:0/1772217646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52280039d0 0x7f5228003dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 -- 172.21.15.40:0/1772217646 >> 172.21.15.40:0/1772217646 conn(0x7f52380cc4b0 msgr2=0x7f52380cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 -- 172.21.15.40:0/1772217646 shutdown_connections 2023-11-04T01:40:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71ffff640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7200ccfc0 0x7fa720149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 -- 172.21.15.40:0/1772217646 wait complete. 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f0ffff640 1 -- 172.21.15.40:0/120593821 learned_addr learned my addr 172.21.15.40:0/120593821 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- start start 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff54415fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff544160a90 0x7ff5440b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54415e010 con 0x7ff544143580 2023-11-04T01:40:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440b0fc0 con 0x7ff544160a90 2023-11-04T01:40:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff54923c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54415d3b0 con 0x7ff5440ceda0 2023-11-04T01:40:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8404bd9640 1 -- 172.21.15.40:0/1363601750 shutdown_connections 2023-11-04T01:40:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8404bd9640 1 --2- 172.21.15.40:0/1363601750 >> v2:172.21.15.40:3300/0 conn(0x7f84000ca270 0x7f84000ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8404bd9640 1 --2- 172.21.15.40:0/1363601750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840015ac90 0x7f840015e900 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8404bd9640 1 -- 172.21.15.40:0/1363601750 >> 172.21.15.40:0/1363601750 conn(0x7f84000b0550 msgr2=0x7f84000b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 -- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7200ccfc0 msgr2=0x7fa720149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7200ccfc0 0x7fa720149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 -- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72006d310 msgr2=0x7fa72006be00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:40:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72006d310 0x7fa72006be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 -- 172.21.15.40:0/3760516464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714009420 con 0x7fa7200ccbe0 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56694/0 (socket says 172.21.15.40:56694) 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 -- 172.21.15.40:0/4036809354 learned_addr learned my addr 172.21.15.40:0/4036809354 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff548a3b640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff544160a90 0x7ff5440b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff543fff640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff54415fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10157870 con 0x7f8f100b1f40 2023-11-04T01:40:07.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 -- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 msgr2=0x7ff54415fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff54415fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 -- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff544160a90 msgr2=0x7ff5440b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff544160a90 0x7ff5440b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 -- 172.21.15.40:0/4036809354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340094d0 con 0x7ff544143580 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff548a3b640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff544160a90 0x7ff5440b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa71effd640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 0x7fa7201490c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c760 tx=0x7fa71800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff53b7fe640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440b0540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00b410 tx=0x7ff52c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718006d60 con 0x7fa7200ccbe0 2023-11-04T01:40:07.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800ce70 con 0x7fa7200ccbe0 2023-11-04T01:40:07.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa724dba640 1 -- 172.21.15.40:0/3760516464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa720149d60 con 0x7fa7200ccbe0 2023-11-04T01:40:07.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718003ba0 con 0x7fa7200ccbe0 2023-11-04T01:40:07.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100c41f0 con 0x7f8f100ccbe0 2023-11-04T01:40:07.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100c4470 con 0x7f8f100ccfc0 2023-11-04T01:40:07.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 Processor -- start 2023-11-04T01:40:07.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f523ebf9640 1 -- start start 2023-11-04T01:40:07.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- start start 2023-11-04T01:40:07.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f600b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f600ae880 0x7f0f601609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 0x7f0f60204130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600b1520 con 0x7f0f600ae880 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600afa30 con 0x7f0f600c23f0 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f0f683fa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600c93b0 con 0x7f0f60065dc0 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 -- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f100ccfc0 msgr2=0x7f8f100c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f100ccfc0 0x7f8f100c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 -- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f100ccbe0 msgr2=0x7f8f10157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f100ccbe0 0x7f8f10157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7f8f14b55640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040094d0 con 0x7f8f100b1f40 2023-11-04T01:40:07.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c004020 con 0x7ff544143580 2023-11-04T01:40:07.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c004180 con 0x7ff544143580 2023-11-04T01:40:07.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.524+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c011630 con 0x7ff544143580 2023-11-04T01:40:07.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7ff54923c640 1 -- 172.21.15.40:0/4036809354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54415d670 con 0x7ff544143580 2023-11-04T01:40:07.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 0x7f0f60204130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 0x7f0f60204130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52514/0 (socket says 172.21.15.40:52514) 2023-11-04T01:40:07.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 -- 172.21.15.40:0/1238658911 learned_addr learned my addr 172.21.15.40:0/1238658911 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66196640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f600b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8404bd9640 1 -- 172.21.15.40:0/1363601750 shutdown_connections 2023-11-04T01:40:07.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 -- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 msgr2=0x7f0f600b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f600b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 -- 172.21.15.40:0/1238658911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f600ae880 msgr2=0x7f0f601609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f600ae880 0x7f0f601609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 -- 172.21.15.40:0/1238658911 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c009420 con 0x7f0f600c23f0 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280039d0 0x7f5238202120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 0x7f5238141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523814b970 0x7f523814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238148190 con 0x7f523814b970 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238141740 con 0x7f52280039d0 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523814c330 con 0x7f5238140da0 2023-11-04T01:40:07.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 -- 172.21.15.40:0/4273327907 shutdown_connections 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 --2- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c28038000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 --2- 172.21.15.40:0/4273327907 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c280df370 0x7f4c280070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 -- 172.21.15.40:0/4273327907 >> 172.21.15.40:0/4273327907 conn(0x7f4c28009fa0 msgr2=0x7f4c2800a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 -- 172.21.15.40:0/4273327907 shutdown_connections 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 0x7f5238141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523e3f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523814b970 0x7f523814bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f66997640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 0x7f0f60204130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800cb70 tx=0x7f0f5800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7ff54923c640 1 -- 172.21.15.40:0/4036809354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54415dc30 con 0x7ff544143580 2023-11-04T01:40:07.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 -- 172.21.15.40:0/4273327907 wait complete. 2023-11-04T01:40:07.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523e3f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523814b970 0x7f523814bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56712/0 (socket says 172.21.15.40:56712) 2023-11-04T01:40:07.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 0x7f5238141200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:41944/0 (socket says 172.21.15.40:41944) 2023-11-04T01:40:07.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523e3f8640 1 -- 172.21.15.40:0/4068069961 learned_addr learned my addr 172.21.15.40:0/4068069961 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523dbf7640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280039d0 0x7f5238202120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7ff54923c640 1 -- 172.21.15.40:0/4036809354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54415e150 con 0x7ff544143580 2023-11-04T01:40:07.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800ad40 con 0x7f0f600c23f0 2023-11-04T01:40:07.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58012400 con 0x7f0f600c23f0 2023-11-04T01:40:07.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800aea0 con 0x7f0f600c23f0 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 -- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280039d0 msgr2=0x7f5238202120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280039d0 0x7f5238202120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 -- 172.21.15.40:0/4068069961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523814b970 msgr2=0x7f523814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523814b970 0x7f523814bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 -- 172.21.15.40:0/4068069961 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523814ad90 con 0x7f5238140da0 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523d3f6640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 0x7f5238141200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f522c00efc0 tx=0x7f522c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00a840 con 0x7f5238140da0 2023-11-04T01:40:07.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f683fa640 1 -- 172.21.15.40:0/1238658911 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f600b1240 con 0x7f0f600c23f0 2023-11-04T01:40:07.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f683fa640 1 -- 172.21.15.40:0/1238658911 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f600affb0 con 0x7f0f600c23f0 2023-11-04T01:40:07.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8f14b55640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 0x7f8f100c9700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f100c8f60 tx=0x7f8f0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08018070 con 0x7f8f100b1f40 2023-11-04T01:40:07.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f683fa640 1 -- 172.21.15.40:0/1238658911 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f600af870 con 0x7f0f600c23f0 2023-11-04T01:40:07.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0800edd0 con 0x7f8f100b1f40 2023-11-04T01:40:07.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08007ea0 con 0x7f8f100b1f40 2023-11-04T01:40:07.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f100c4750 con 0x7f8f100b1f40 2023-11-04T01:40:07.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff52c011790 con 0x7ff544143580 2023-11-04T01:40:07.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7ff5417fa640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5240664a0 0x7ff524068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52c083bb0 con 0x7ff544143580 2023-11-04T01:40:07.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f4c378f2640 1 Processor -- start 2023-11-04T01:40:07.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f100c4d10 con 0x7f8f100b1f40 2023-11-04T01:40:07.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0dd322d640 1 -- 172.21.15.40:0/454251446 shutdown_connections 2023-11-04T01:40:07.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa718003d00 con 0x7fa7200ccbe0 2023-11-04T01:40:07.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef0005260 con 0x7f8f100b1f40 2023-11-04T01:40:07.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5238147510 con 0x7f5238140da0 2023-11-04T01:40:07.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238147ad0 con 0x7f5238140da0 2023-11-04T01:40:07.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7fa724dba640 1 -- 172.21.15.40:0/3760516464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa720145fc0 con 0x7fa7200ccbe0 2023-11-04T01:40:07.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00a9a0 con 0x7f5238140da0 2023-11-04T01:40:07.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0dd322d640 1 -- 172.21.15.40:0/454251446 wait complete. 2023-11-04T01:40:07.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7fa707fff640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa70c0664a0 0x7fa70c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7fa71f7fe640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa70c0664a0 0x7fa70c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7ff543fff640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5240664a0 0x7ff524068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00ad30 con 0x7f5238140da0 2023-11-04T01:40:07.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 Processor -- start 2023-11-04T01:40:07.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220005260 con 0x7f5238140da0 2023-11-04T01:40:07.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 -- start start 2023-11-04T01:40:07.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f8404bd9640 1 -- 172.21.15.40:0/1363601750 wait complete. 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 -- start start 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c2800c090 0x7f4c280d81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c280ea920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c280df370 0x7f4c2818d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280d9340 con 0x7f4c280df370 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2818d6a0 con 0x7f4c28050170 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c378f2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280d87c0 con 0x7f4c2800c090 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c34e8d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c280ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c34e8d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c280ea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52522/0 (socket says 172.21.15.40:52522) 2023-11-04T01:40:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c34e8d640 1 -- 172.21.15.40:0/1604054378 learned_addr learned my addr 172.21.15.40:0/1604054378 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c280df370 0x7f4c2818d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.528+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f58007070 con 0x7f0f600c23f0 2023-11-04T01:40:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0f56ffd640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f440664d0 0x7f0f44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f580842a0 con 0x7f0f600c23f0 2023-11-04T01:40:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7fa724dba640 1 -- 172.21.15.40:0/3760516464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7200744a0 con 0x7fa7200ccbe0 2023-11-04T01:40:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0f66196640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f440664d0 0x7f0f44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7fa71f7fe640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa70c0664a0 0x7fa70c068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7200675c0 tx=0x7fa7140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 -- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c2800c090 msgr2=0x7f4c280d81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c2800c090 0x7f4c280d81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 -- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 msgr2=0x7f4c280ea920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c280ea920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 -- 172.21.15.40:0/1604054378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28007770 con 0x7f4c280df370 2023-11-04T01:40:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c34e8d640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c280ea920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f4c35e8f640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c280df370 0x7f4c2818d160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c3004f2f0 tx=0x7f4c30093b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0f66196640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f440664d0 0x7f0f44068990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f500011f0 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc40d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dc4053070 0x7f0dc40ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dc40df270 0x7f0dc40d8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc404db90 con 0x7f0dc40df270 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40d26f0 con 0x7f0dc4053070 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd322d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40d29d0 con 0x7f0dc404fa60 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd0fc9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc40d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dc4053070 0x7f0dc40ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd0fc9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc40d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:41958/0 (socket says 172.21.15.40:41958) 2023-11-04T01:40:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd0fc9640 1 -- 172.21.15.40:0/3653254294 learned_addr learned my addr 172.21.15.40:0/3653254294 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f8404bd9640 1 Processor -- start 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dd17ca640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dc40df270 0x7f0dc40d8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 -- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 msgr2=0x7f0dc40d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc40d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 -- 172.21.15.40:0/3653254294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dc40df270 msgr2=0x7f0dc40d8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dc40df270 0x7f0dc40d8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 -- 172.21.15.40:0/3653254294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009420 con 0x7f0dc4053070 2023-11-04T01:40:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f522c0213f0 con 0x7f5238140da0 2023-11-04T01:40:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f52367fc640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f521c0664d0 0x7f521c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f522c0850b0 con 0x7f5238140da0 2023-11-04T01:40:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f523dbf7640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f521c0664d0 0x7f521c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f0dcbfff640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dc4053070 0x7f0dc40ca7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000c650 tx=0x7f0dc000ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.532+0000 7f8404bd9640 1 -- start start 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840006d370 0x7f8400155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84000ca270 0x7f84000a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 0x7f84000a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c6660 con 0x7f840015ac90 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c6940 con 0x7f840006d370 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c6c20 con 0x7f84000ca270 2023-11-04T01:40:07.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 0x7f84000a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 0x7f84000a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56728/0 (socket says 172.21.15.40:56728) 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 -- 172.21.15.40:0/3933313788 learned_addr learned my addr 172.21.15.40:0/3933313788 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fe59c640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840006d370 0x7f8400155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83f7fff640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84000ca270 0x7f84000a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 -- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84000ca270 msgr2=0x7f84000a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84000ca270 0x7f84000a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 -- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840006d370 msgr2=0x7f8400155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840006d370 0x7f8400155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 -- 172.21.15.40:0/3933313788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e800d8c0 con 0x7f840015ac90 2023-11-04T01:40:07.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f523dbf7640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f521c0664d0 0x7f521c068990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52240ab000 tx=0x7f52240b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83fed9d640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 0x7f84000a95e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83f800efc0 tx=0x7f83f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7ff543fff640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5240664a0 0x7ff524068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ae000 tx=0x7ff534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff54415e150 con 0x7ff544143580 2023-11-04T01:40:07.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8009ba0 con 0x7f840015ac90 2023-11-04T01:40:07.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84000c6f00 con 0x7f840015ac90 2023-11-04T01:40:07.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa718054ac0 con 0x7fa7200ccbe0 2023-11-04T01:40:07.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8400155fd0 con 0x7f840015ac90 2023-11-04T01:40:07.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84000744a0 con 0x7f840015ac90 2023-11-04T01:40:07.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f08014420 con 0x7f8f100b1f40 2023-11-04T01:40:07.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8f0cff9640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ef8066630 0x7f8ef8068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f08084f20 con 0x7f8f100b1f40 2023-11-04T01:40:07.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30131410 con 0x7f4c280df370 2023-11-04T01:40:07.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280d8aa0 con 0x7f4c280df370 2023-11-04T01:40:07.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.536+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c280d9060 con 0x7f4c280df370 2023-11-04T01:40:07.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f8f0ffff640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ef8066630 0x7f8ef8068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c28042840 con 0x7f4c280df370 2023-11-04T01:40:07.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f8f0ffff640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ef8066630 0x7f8ef8068af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009a50 tx=0x7f8f00009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c30127440 con 0x7f4c280df370 2023-11-04T01:40:07.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30127660 con 0x7f4c280df370 2023-11-04T01:40:07.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800f040 con 0x7f840015ac90 2023-11-04T01:40:07.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8014680 con 0x7f840015ac90 2023-11-04T01:40:07.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.540+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa718016030 con 0x7fa7200ccbe0 2023-11-04T01:40:07.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.544+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000e840 con 0x7f0dc4053070 2023-11-04T01:40:07.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.544+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000e9e0 con 0x7f0dc4053070 2023-11-04T01:40:07.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.544+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000edd0 con 0x7f0dc4053070 2023-11-04T01:40:07.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.544+0000 7f0dd322d640 1 -- 172.21.15.40:0/3653254294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc40d2cb0 con 0x7f0dc4053070 2023-11-04T01:40:07.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.544+0000 7f0dd322d640 1 -- 172.21.15.40:0/3653254294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc40d3270 con 0x7f0dc4053070 2023-11-04T01:40:07.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.544+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f080522f0 con 0x7f8f100b1f40 2023-11-04T01:40:07.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f58055240 con 0x7f0f600c23f0 2023-11-04T01:40:07.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c3012e050 con 0x7f4c280df370 2023-11-04T01:40:07.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f4c25ffb640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c140664a0 0x7f4c14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c301989c0 con 0x7f4c280df370 2023-11-04T01:40:07.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f522c052750 con 0x7f5238140da0 2023-11-04T01:40:07.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f0dd322d640 1 -- 172.21.15.40:0/3653254294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac005260 con 0x7f0dc4053070 2023-11-04T01:40:07.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83f80147e0 con 0x7f840015ac90 2023-11-04T01:40:07.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f83f6ffd640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e00664a0 0x7f83e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83f8085320 con 0x7f840015ac90 2023-11-04T01:40:07.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f83fe59c640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e00664a0 0x7f83e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f4c3568e640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c140664a0 0x7f4c14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0dc0022480 con 0x7f0dc4053070 2023-11-04T01:40:07.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f83fe59c640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e00664a0 0x7f83e0068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83e80b2000 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f4c3568e640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c140664a0 0x7f4c14068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c20011fd0 tx=0x7f4c20013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f0dc97fa640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0db00664f0 0x7f0db00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:07.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.548+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc00841f0 con 0x7f0dc4053070 2023-11-04T01:40:07.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.552+0000 7f0dd0fc9640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0db00664f0 0x7f0db00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:07.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.552+0000 7f0dd0fc9640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0db00664f0 0x7f0db00689b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc072e50 tx=0x7f0dcc08d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:07.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.552+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4c30165e30 con 0x7f4c280df370 2023-11-04T01:40:07.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.560+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f83f8052880 con 0x7f840015ac90 2023-11-04T01:40:07.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.560+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0dc0051700 con 0x7f0dc4053070 2023-11-04T01:40:07.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.852+0000 7f0f683fa640 1 -- 172.21.15.40:0/1238658911 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0f600b01a0 con 0x7f0f600c23f0 2023-11-04T01:40:07.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.852+0000 7f0f56ffd640 1 -- 172.21.15.40:0/1238658911 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f58054dd0 con 0x7f0f600c23f0 2023-11-04T01:40:07.857 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:07.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7fa724dba640 1 -- 172.21.15.40:0/3760516464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7200adf90 con 0x7fa7200ccbe0 2023-11-04T01:40:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7fa707fff640 1 -- 172.21.15.40:0/3760516464 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa718016020 con 0x7fa7200ccbe0 2023-11-04T01:40:07.858 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-11-04T01:40:07.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 -- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f440664d0 msgr2=0x7f0f44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f440664d0 0x7f0f44068990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f500011f0 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 -- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 msgr2=0x7f0f60204130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 0x7f0f60204130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800cb70 tx=0x7f0f5800a430 comp rx=0 tx=0).stop 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 -- 172.21.15.40:0/1238658911 shutdown_connections 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f440664d0 0x7f0f44068990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f600c23f0 0x7f0f60204130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f600ae880 0x7f0f601609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 --2- 172.21.15.40:0/1238658911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f60065dc0 0x7f0f600b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 -- 172.21.15.40:0/1238658911 >> 172.21.15.40:0/1238658911 conn(0x7f0f600716a0 msgr2=0x7f0f600cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7fa705ffb640 1 -- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa70c0664a0 msgr2=0x7fa70c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7fa705ffb640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa70c0664a0 0x7fa70c068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7200675c0 tx=0x7fa7140a6000 comp rx=0 tx=0).stop 2023-11-04T01:40:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7fa705ffb640 1 -- 172.21.15.40:0/3760516464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 msgr2=0x7fa7201490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7fa705ffb640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 0x7fa7201490c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c760 tx=0x7fa71800cc20 comp rx=0 tx=0).stop 2023-11-04T01:40:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.856+0000 7f0f54ff9640 1 -- 172.21.15.40:0/1238658911 shutdown_connections 2023-11-04T01:40:07.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7f0f54ff9640 1 -- 172.21.15.40:0/1238658911 wait complete. 2023-11-04T01:40:07.865 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-11-04T01:40:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 -- 172.21.15.40:0/3760516464 shutdown_connections 2023-11-04T01:40:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa70c0664a0 0x7fa70c068960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7200ccfc0 0x7fa720149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7200ccbe0 0x7fa7201490c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 --2- 172.21.15.40:0/3760516464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72006d310 0x7fa72006be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 -- 172.21.15.40:0/3760516464 >> 172.21.15.40:0/3760516464 conn(0x7fa7200b0550 msgr2=0x7fa7200ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 -- 172.21.15.40:0/3760516464 shutdown_connections 2023-11-04T01:40:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7fa705ffb640 1 -- 172.21.15.40:0/3760516464 wait complete. 2023-11-04T01:40:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7ff54923c640 1 -- 172.21.15.40:0/4036809354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff54415e150 con 0x7ff544143580 2023-11-04T01:40:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.860+0000 7ff5417fa640 1 -- 172.21.15.40:0/4036809354 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff54415e150 con 0x7ff544143580 2023-11-04T01:40:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52200057e0 con 0x7f5238140da0 2023-11-04T01:40:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 -- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5240664a0 msgr2=0x7ff524068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5240664a0 0x7ff524068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ae000 tx=0x7ff534008040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 -- 172.21.15.40:0/4036809354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 msgr2=0x7ff5440b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440b0540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00b410 tx=0x7ff52c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 -- 172.21.15.40:0/4036809354 shutdown_connections 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5240664a0 0x7ff524068960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff544160a90 0x7ff5440b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff544143580 0x7ff5440b0540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 --2- 172.21.15.40:0/4036809354 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5440ceda0 0x7ff54415fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 -- 172.21.15.40:0/4036809354 >> 172.21.15.40:0/4036809354 conn(0x7ff5440cc4b0 msgr2=0x7ff54413f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 -- 172.21.15.40:0/4036809354 shutdown_connections 2023-11-04T01:40:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7ff53a7fc640 1 -- 172.21.15.40:0/4036809354 wait complete. 2023-11-04T01:40:07.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4c28042840 con 0x7f4c280df370 2023-11-04T01:40:07.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7f52367fc640 1 -- 172.21.15.40:0/4068069961 <== mon.2 v2:172.21.15.91:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f522c055d70 con 0x7f5238140da0 2023-11-04T01:40:07.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7f4c25ffb640 1 -- 172.21.15.40:0/1604054378 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c28042840 con 0x7f4c280df370 2023-11-04T01:40:07.872 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-11-04T01:40:07.873 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-11-04T01:40:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.868+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8ef00057e0 con 0x7f8f100b1f40 2023-11-04T01:40:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f8f0cff9640 1 -- 172.21.15.40:0/120593821 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f08055910 con 0x7f8f100b1f40 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f521c0664d0 msgr2=0x7f521c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f521c0664d0 0x7f521c068990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52240ab000 tx=0x7f52240b1040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 msgr2=0x7f5238141200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 0x7f5238141200 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f522c00efc0 tx=0x7f522c00c7b0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 shutdown_connections 2023-11-04T01:40:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f521c0664d0 0x7f521c068990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523814b970 0x7f523814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5238140da0 0x7f5238141200 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 --2- 172.21.15.40:0/4068069961 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52280039d0 0x7f5238202120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 >> 172.21.15.40:0/4068069961 conn(0x7f52380cc4b0 msgr2=0x7f52380cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 shutdown_connections 2023-11-04T01:40:07.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f523ebf9640 1 -- 172.21.15.40:0/4068069961 wait complete. 2023-11-04T01:40:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c140664a0 msgr2=0x7f4c14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f4c378f2640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c140664a0 0x7f4c14068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c20011fd0 tx=0x7f4c20013040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c280df370 msgr2=0x7f4c2818d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f4c378f2640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c280df370 0x7f4c2818d160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c3004f2f0 tx=0x7f4c30093b00 comp rx=0 tx=0).stop 2023-11-04T01:40:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.872+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 shutdown_connections 2023-11-04T01:40:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c140664a0 0x7f4c14068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ef8066630 msgr2=0x7f8ef8068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ef8066630 0x7f8ef8068af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009a50 tx=0x7f8f00009190 comp rx=0 tx=0).stop 2023-11-04T01:40:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 msgr2=0x7f8f100c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 0x7f8f100c9700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f100c8f60 tx=0x7f8f0800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c280df370 0x7f4c2818d160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c28050170 0x7f4c280ea920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 --2- 172.21.15.40:0/1604054378 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c2800c090 0x7f4c280d81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 shutdown_connections 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ef8066630 0x7f8ef8068af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f100b1f40 0x7f8f100c9700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f100ccfc0 0x7f8f100c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 --2- 172.21.15.40:0/120593821 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f100ccbe0 0x7f8f10157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 >> 172.21.15.40:0/1604054378 conn(0x7f4c28009fa0 msgr2=0x7f4c28049e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 >> 172.21.15.40:0/120593821 conn(0x7f8f100b0550 msgr2=0x7f8f100ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 shutdown_connections 2023-11-04T01:40:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f8f15356640 1 -- 172.21.15.40:0/120593821 wait complete. 2023-11-04T01:40:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 shutdown_connections 2023-11-04T01:40:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.876+0000 7f4c378f2640 1 -- 172.21.15.40:0/1604054378 wait complete. 2023-11-04T01:40:07.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.880+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f84000c73b0 con 0x7f840015ac90 2023-11-04T01:40:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.880+0000 7f83f6ffd640 1 -- 172.21.15.40:0/3933313788 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83f8055ea0 con 0x7f840015ac90 2023-11-04T01:40:07.885 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.880+0000 7f0dd322d640 1 -- 172.21.15.40:0/3653254294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0dac0057e0 con 0x7f0dc4053070 2023-11-04T01:40:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.880+0000 7f0dc97fa640 1 -- 172.21.15.40:0/3653254294 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0dc001d090 con 0x7f0dc4053070 2023-11-04T01:40:07.888 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-11-04T01:40:07.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 -- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0db00664f0 msgr2=0x7f0db00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0db00664f0 0x7f0db00689b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc072e50 tx=0x7f0dcc08d040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 -- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dc4053070 msgr2=0x7f0dc40ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dc4053070 0x7f0dc40ca7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000c650 tx=0x7f0dc000ca50 comp rx=0 tx=0).stop 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 -- 172.21.15.40:0/3653254294 shutdown_connections 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0db00664f0 0x7f0db00689b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dc40df270 0x7f0dc40d8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dc4053070 0x7f0dc40ca7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 --2- 172.21.15.40:0/3653254294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dc404fa60 0x7f0dc40d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.884+0000 7f0db6ffd640 1 -- 172.21.15.40:0/3653254294 >> 172.21.15.40:0/3653254294 conn(0x7f0dc4009fa0 msgr2=0x7f0dc40dd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.888+0000 7f0db6ffd640 1 -- 172.21.15.40:0/3653254294 shutdown_connections 2023-11-04T01:40:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.888+0000 7f0db6ffd640 1 -- 172.21.15.40:0/3653254294 wait complete. 2023-11-04T01:40:07.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e00664a0 msgr2=0x7f83e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e00664a0 0x7f83e0068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83e80b2000 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 msgr2=0x7f84000a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 0x7f84000a95e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83f800efc0 tx=0x7f83f800c490 comp rx=0 tx=0).stop 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 shutdown_connections 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e00664a0 0x7f83e0068960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f840015ac90 0x7f84000a95e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84000ca270 0x7f84000a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 --2- 172.21.15.40:0/3933313788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f840006d370 0x7f8400155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 >> 172.21.15.40:0/3933313788 conn(0x7f84000b0550 msgr2=0x7f8400159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 shutdown_connections 2023-11-04T01:40:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:07.896+0000 7f8404bd9640 1 -- 172.21.15.40:0/3933313788 wait complete. 2023-11-04T01:40:07.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-04T01:40:07.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-11-04T01:40:07.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-11-04T01:40:07.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-11-04T01:40:07.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-11-04T01:40:07.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-11-04T01:40:07.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-11-04T01:40:08.893 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:40:08.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:40:08.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:40:08.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:40:08.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:40:08.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:40:08.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:40:08.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:40:09.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.072+0000 7fc86e5ac640 1 Processor -- start 2023-11-04T01:40:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.072+0000 7fc86e5ac640 1 -- start start 2023-11-04T01:40:09.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc86e5ac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc868158fc0 0x7fc8680cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc86e5ac640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8680ce230 con 0x7fc86806d000 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc86e5ac640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86815ceb0 con 0x7fc8680cb830 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc86e5ac640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86815da50 con 0x7fc868158fc0 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc867fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc868158fc0 0x7fc8680cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc867fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc868158fc0 0x7fc8680cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56738/0 (socket says 172.21.15.40:56738) 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc867fff640 1 -- 172.21.15.40:0/2176729245 learned_addr learned my addr 172.21.15.40:0/2176729245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc867fff640 1 -- 172.21.15.40:0/2176729245 >> v1:172.21.15.91:6789/0 conn(0x7fc8680cb830 legacy=0x7fc8680cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc867fff640 1 -- 172.21.15.40:0/2176729245 >> v1:172.21.15.40:6789/0 conn(0x7fc86806d000 legacy=0x7fc86815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.076+0000 7fc867fff640 1 -- 172.21.15.40:0/2176729245 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8681593a0 con 0x7fc868158fc0 2023-11-04T01:40:09.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc867fff640 1 --2- 172.21.15.40:0/2176729245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc8680cada0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc86000ca00 tx=0x7fc86001dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fcfca4dc69dd43 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc866ffd640 1 -- 172.21.15.40:0/2176729245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600a6d30 con 0x7fc868158fc0 2023-11-04T01:40:09.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc866ffd640 1 -- 172.21.15.40:0/2176729245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8600a6e90 con 0x7fc868158fc0 2023-11-04T01:40:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 -- 172.21.15.40:0/2176729245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 msgr2=0x7fc8680cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 --2- 172.21.15.40:0/2176729245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc8680cada0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc86000ca00 tx=0x7fc86001dd80 comp rx=0 tx=0).stop 2023-11-04T01:40:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 -- 172.21.15.40:0/2176729245 shutdown_connections 2023-11-04T01:40:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 --2- 172.21.15.40:0/2176729245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc8680cada0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 -- 172.21.15.40:0/2176729245 >> 172.21.15.40:0/2176729245 conn(0x7fc8680b0550 msgr2=0x7fc8680b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 -- 172.21.15.40:0/2176729245 shutdown_connections 2023-11-04T01:40:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.080+0000 7fc86e5ac640 1 -- 172.21.15.40:0/2176729245 wait complete. 2023-11-04T01:40:09.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 Processor -- start 2023-11-04T01:40:09.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 -- start start 2023-11-04T01:40:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc86806d000 0x7fc868149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8680cb830 0x7fc86815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc86806b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86814a260 con 0x7fc868158fc0 2023-11-04T01:40:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868159640 con 0x7fc8680cb830 2023-11-04T01:40:09.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86e5ac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc868159920 con 0x7fc86806d000 2023-11-04T01:40:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc86806b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc86806b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56754/0 (socket says 172.21.15.40:56754) 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 -- 172.21.15.40:0/831918820 learned_addr learned my addr 172.21.15.40:0/831918820 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc8677fe640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8680cb830 0x7fc86815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc867fff640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc86806d000 0x7fc868149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 -- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc86806d000 msgr2=0x7fc868149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc86806d000 0x7fc868149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 -- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8680cb830 msgr2=0x7fc86815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8680cb830 0x7fc86815a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 -- 172.21.15.40:0/831918820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86000c660 con 0x7fc868158fc0 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.084+0000 7fc86cb49640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc86806b690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00c410 tx=0x7fc85c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003600 con 0x7fc868158fc0 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc86e5ac640 1 -- 172.21.15.40:0/831918820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc868159c00 con 0x7fc868158fc0 2023-11-04T01:40:09.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc86e5ac640 1 -- 172.21.15.40:0/831918820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86815a1c0 con 0x7fc868158fc0 2023-11-04T01:40:09.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c003760 con 0x7fc868158fc0 2023-11-04T01:40:09.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003b10 con 0x7fc868158fc0 2023-11-04T01:40:09.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc86e5ac640 1 -- 172.21.15.40:0/831918820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc844005260 con 0x7fc868158fc0 2023-11-04T01:40:09.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc85c003d30 con 0x7fc868158fc0 2023-11-04T01:40:09.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.088+0000 7fc864ff9640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc84c066470 0x7fc84c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.096+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc85c054290 con 0x7fc868158fc0 2023-11-04T01:40:09.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.096+0000 7fc867fff640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc84c066470 0x7fc84c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.096+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc85c088060 con 0x7fc868158fc0 2023-11-04T01:40:09.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.100+0000 7fc867fff640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc84c066470 0x7fc84c068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8600af000 tx=0x7fc8600a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 Processor -- start 2023-11-04T01:40:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 -- start start 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f90100df510 0x7f90100541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9010007350 0x7f901004fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9010007350 0x7f901004fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9010007350 0x7f901004fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56760/0 (socket says 172.21.15.40:56760) 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 -- 172.21.15.40:0/1717250814 learned_addr learned my addr 172.21.15.40:0/1717250814 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9010006ec0 con 0x7f9010050160 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100505f0 con 0x7f9010007350 2023-11-04T01:40:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100062b0 con 0x7f90100df510 2023-11-04T01:40:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 Processor -- start 2023-11-04T01:40:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 -- start start 2023-11-04T01:40:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f901cf1b640 1 --2- 172.21.15.40:0/1717250814 >> v2:172.21.15.91:3300/0 conn(0x7f90100df510 0x7f90100541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 -- 172.21.15.40:0/1717250814 >> v2:172.21.15.91:3300/0 conn(0x7f90100df510 msgr2=0x7f90100541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 --2- 172.21.15.40:0/1717250814 >> v2:172.21.15.91:3300/0 conn(0x7f90100df510 0x7f90100541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f6a326be640 1 Processor -- start 2023-11-04T01:40:09.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f6a326be640 1 -- start start 2023-11-04T01:40:09.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f4002dcb640 1 Processor -- start 2023-11-04T01:40:09.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f4002dcb640 1 -- start start 2023-11-04T01:40:09.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f5deccca640 1 Processor -- start 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f5deccca640 1 -- start start 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5deccca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5de00e77c0 0x7f5de0007280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5deccca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de0047e30 0x7f5de0037d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5deccca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5de00382a0 0x7f5de0052790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5deccca640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de0054a50 con 0x7f5de00e77c0 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5deccca640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de0006df0 con 0x7f5de00382a0 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5deccca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de0054490 con 0x7f5de0047e30 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6528159a50 0x7f6528070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f65280cba80 0x7f65280c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65280706a0 con 0x7f6528071070 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652815da30 con 0x7f6528159a50 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f652759e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652815ad70 con 0x7f65280cba80 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f6525d9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6528071070 0x7f65280cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48328/0 (socket says 172.21.15.40:48328) 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f6525d9b640 1 -- 172.21.15.40:0/946147537 learned_addr learned my addr 172.21.15.40:0/946147537 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f6526d9d640 1 --2- 172.21.15.40:0/946147537 >> v2:172.21.15.91:3300/0 conn(0x7f65280cba80 0x7f65280c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6526d9d640 1 -- 172.21.15.40:0/946147537 >> v2:172.21.15.40:3300/0 conn(0x7f6528159a50 msgr2=0x7f6528070b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6526d9d640 1 --2- 172.21.15.40:0/946147537 >> v2:172.21.15.40:3300/0 conn(0x7f6528159a50 0x7f6528070b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6526d9d640 1 -- 172.21.15.40:0/946147537 >> v1:172.21.15.91:6789/0 conn(0x7f6528071070 legacy=0x7f65280cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6526d9d640 1 -- 172.21.15.40:0/946147537 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652815b050 con 0x7f65280cba80 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 -- 172.21.15.40:0/1717250814 >> v1:172.21.15.91:6789/0 conn(0x7f9010050160 legacy=0x7f9010038180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.124+0000 7f9017fff640 1 -- 172.21.15.40:0/1717250814 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010006590 con 0x7f9010007350 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a326be640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0c9880 0x7f6a2c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a326be640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c0ce880 con 0x7f6a2c0cafe0 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a326be640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c06cb20 con 0x7f6a2c169fa0 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a326be640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0cb3c0 con 0x7f6a2c0c9880 2023-11-04T01:40:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a2b7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f6a2c169fa0 0x7f6a2c0c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48330/0 (socket says 172.21.15.40:48330) 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a2b7fe640 1 -- 172.21.15.40:0/2415725780 learned_addr learned my addr 172.21.15.40:0/2415725780 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a30c5b640 1 --2- 172.21.15.40:0/2415725780 >> v2:172.21.15.40:3300/0 conn(0x7f6a2c0c9880 0x7f6a2c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4002dcb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ff40df770 0x7f3ff4055d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4002dcb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3ff4036620 0x7f3ff403a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4002dcb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff403aa20 con 0x7f3ff403a5d0 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4002dcb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40538e0 con 0x7f3ff40df770 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4002dcb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff4036b00 con 0x7f3ff4036620 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ff40df770 0x7f3ff4055d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ff40df770 0x7f3ff4055d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56774/0 (socket says 172.21.15.40:56774) 2023-11-04T01:40:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 -- 172.21.15.40:0/3761944250 learned_addr learned my addr 172.21.15.40:0/3761944250 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f9017fff640 1 --2- 172.21.15.40:0/1717250814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010007350 0x7f901004fc20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f901000d360 tx=0x7f900c01e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a2ae408c3207ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f40015c8640 1 --2- 172.21.15.40:0/3761944250 >> v2:172.21.15.91:3300/0 conn(0x7f3ff4036620 0x7f3ff403a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a30c5b640 1 -- 172.21.15.40:0/2415725780 >> v1:172.21.15.91:6789/0 conn(0x7f6a2c169fa0 legacy=0x7f6a2c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a30c5b640 1 -- 172.21.15.40:0/2415725780 >> v1:172.21.15.40:6789/0 conn(0x7f6a2c0cafe0 legacy=0x7f6a2c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6a30c5b640 1 -- 172.21.15.40:0/2415725780 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c16a430 con 0x7f6a2c0c9880 2023-11-04T01:40:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f90177fe640 1 -- 172.21.15.40:0/1717250814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0ad670 con 0x7f9010007350 2023-11-04T01:40:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f90177fe640 1 -- 172.21.15.40:0/1717250814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0ad7d0 con 0x7f9010007350 2023-11-04T01:40:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f90177fe640 1 -- 172.21.15.40:0/1717250814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0adb60 con 0x7f9010007350 2023-11-04T01:40:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 -- 172.21.15.40:0/3761944250 >> v2:172.21.15.91:3300/0 conn(0x7f3ff4036620 msgr2=0x7f3ff403a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 --2- 172.21.15.40:0/3761944250 >> v2:172.21.15.91:3300/0 conn(0x7f3ff4036620 0x7f3ff403a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 -- 172.21.15.40:0/3761944250 >> v1:172.21.15.91:6789/0 conn(0x7f3ff403a5d0 legacy=0x7f3ff40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f4001dc9640 1 -- 172.21.15.40:0/3761944250 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4052fb0 con 0x7f3ff40df770 2023-11-04T01:40:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5de00e77c0 0x7f5de0007280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010007350 msgr2=0x7f901004fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 --2- 172.21.15.40:0/1717250814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010007350 0x7f901004fc20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f901000d360 tx=0x7f900c01e650 comp rx=0 tx=0).stop 2023-11-04T01:40:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 shutdown_connections 2023-11-04T01:40:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 --2- 172.21.15.40:0/1717250814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010007350 0x7f901004fc20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 --2- 172.21.15.40:0/1717250814 >> v2:172.21.15.91:3300/0 conn(0x7f90100df510 0x7f90100541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 >> 172.21.15.40:0/1717250814 conn(0x7f9010054bc0 msgr2=0x7f9010054fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5de00e77c0 0x7f5de0007280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56790/0 (socket says 172.21.15.40:56790) 2023-11-04T01:40:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 shutdown_connections 2023-11-04T01:40:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f901df1d640 1 -- 172.21.15.40:0/1717250814 wait complete. 2023-11-04T01:40:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5de00382a0 0x7f5de0052790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5de00382a0 0x7f5de0052790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52588/0 (socket says 172.21.15.40:52588) 2023-11-04T01:40:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de7fff640 1 -- 172.21.15.40:0/2764871295 learned_addr learned my addr 172.21.15.40:0/2764871295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f29433ba640 1 Processor -- start 2023-11-04T01:40:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f6526d9d640 1 --2- 172.21.15.40:0/946147537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65280cba80 0x7f65280c8fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f652806f8a0 tx=0x7f651801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2a51a0b8036538 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 -- 172.21.15.40:0/2764871295 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de0047e30 msgr2=0x7f5de0037d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 --2- 172.21.15.40:0/2764871295 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de0047e30 0x7f5de0037d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 -- 172.21.15.40:0/2764871295 >> v2:172.21.15.91:3300/0 conn(0x7f5de00382a0 msgr2=0x7f5de0052790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 --2- 172.21.15.40:0/2764871295 >> v2:172.21.15.91:3300/0 conn(0x7f5de00382a0 0x7f5de0052790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f5de77fe640 1 -- 172.21.15.40:0/2764871295 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de0054770 con 0x7f5de00e77c0 2023-11-04T01:40:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.128+0000 7f29433ba640 1 -- start start 2023-11-04T01:40:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a30c5b640 1 --2- 172.21.15.40:0/2415725780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0c9880 0x7f6a2c0cc900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009740 tx=0x7f6a1c01c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1801b3bdcfb5d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 Processor -- start 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f29433ba640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f29340556e0 0x7f2934054210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f29433ba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2934007380 0x7f29340df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f29433ba640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2934006ef0 con 0x7f293404fc50 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f29433ba640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340df820 con 0x7f2934007380 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f29433ba640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340065c0 con 0x7f29340556e0 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2934007380 0x7f29340df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2934007380 0x7f29340df2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56796/0 (socket says 172.21.15.40:56796) 2023-11-04T01:40:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 -- 172.21.15.40:0/1079292125 learned_addr learned my addr 172.21.15.40:0/1079292125 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f4001dc9640 1 --2- 172.21.15.40:0/3761944250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff40df770 0x7f3ff4055d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40564e0 tx=0x7f3fec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b6b363c69d104a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652559a640 1 -- 172.21.15.40:0/946147537 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180ab650 con 0x7f65280cba80 2023-11-04T01:40:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652559a640 1 -- 172.21.15.40:0/946147537 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65180ab7b0 con 0x7f65280cba80 2023-11-04T01:40:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652559a640 1 -- 172.21.15.40:0/946147537 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180abb40 con 0x7f65280cba80 2023-11-04T01:40:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 -- 172.21.15.40:0/946147537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65280cba80 msgr2=0x7f65280c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 --2- 172.21.15.40:0/946147537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65280cba80 0x7f65280c8fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f652806f8a0 tx=0x7f651801c450 comp rx=0 tx=0).stop 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 -- start start 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9010007350 0x7f901017c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010050160 0x7f90100d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90100df510 0x7f9010046840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010046d80 con 0x7f9010050160 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100d17c0 con 0x7f9010007350 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90100d1aa0 con 0x7f90100df510 2023-11-04T01:40:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901cf1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9010007350 0x7f901017c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2933fff640 1 -- 172.21.15.40:0/1079292125 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703285800 0 0) 0x7f2934006ef0 con 0x7f293404fc50 2023-11-04T01:40:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2933fff640 1 -- 172.21.15.40:0/1079292125 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2928003530 con 0x7f293404fc50 2023-11-04T01:40:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 -- 172.21.15.40:0/946147537 shutdown_connections 2023-11-04T01:40:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 --2- 172.21.15.40:0/946147537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f65280cba80 0x7f65280c8fb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 --2- 172.21.15.40:0/946147537 >> v2:172.21.15.40:3300/0 conn(0x7f6528159a50 0x7f6528070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 -- 172.21.15.40:0/946147537 >> 172.21.15.40:0/946147537 conn(0x7f65280b0550 msgr2=0x7f65280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901cf1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9010007350 0x7f901017c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52596/0 (socket says 172.21.15.40:52596) 2023-11-04T01:40:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901cf1b640 1 -- 172.21.15.40:0/2294631688 learned_addr learned my addr 172.21.15.40:0/2294631688 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901d71c640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90100df510 0x7f9010046840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 -- 172.21.15.40:0/946147537 shutdown_connections 2023-11-04T01:40:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010050160 0x7f90100d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a2affd640 1 -- 172.21.15.40:0/2415725780 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0ab600 con 0x7f6a2c0c9880 2023-11-04T01:40:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a2affd640 1 -- 172.21.15.40:0/2415725780 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c0a7050 con 0x7f6a2c0c9880 2023-11-04T01:40:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a2affd640 1 -- 172.21.15.40:0/2415725780 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0ab980 con 0x7f6a2c0c9880 2023-11-04T01:40:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 -- 172.21.15.40:0/2415725780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0c9880 msgr2=0x7f6a2c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 --2- 172.21.15.40:0/2415725780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0c9880 0x7f6a2c0cc900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009740 tx=0x7f6a1c01c190 comp rx=0 tx=0).stop 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 -- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90100df510 msgr2=0x7f9010046840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90100df510 0x7f9010046840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 -- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9010007350 msgr2=0x7f901017c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9010007350 0x7f901017c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 -- 172.21.15.40:0/2294631688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c009d60 con 0x7f9010050160 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f4000dc7640 1 -- 172.21.15.40:0/3761944250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0ab610 con 0x7f3ff40df770 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f4000dc7640 1 -- 172.21.15.40:0/3761944250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec0ab770 con 0x7f3ff40df770 2023-11-04T01:40:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f4000dc7640 1 -- 172.21.15.40:0/3761944250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0abb00 con 0x7f3ff40df770 2023-11-04T01:40:09.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f5de77fe640 1 --2- 172.21.15.40:0/2764871295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00e77c0 0x7f5de0007280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5de000e040 tx=0x7f5ddc01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be63bcbb126b512f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f9017fff640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010050160 0x7f90100d10d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f900c0ae000 tx=0x7f900c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f5de67fc640 1 -- 172.21.15.40:0/2764871295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0a8750 con 0x7f5de00e77c0 2023-11-04T01:40:09.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f5de67fc640 1 -- 172.21.15.40:0/2764871295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0a88b0 con 0x7f5de00e77c0 2023-11-04T01:40:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f5de67fc640 1 -- 172.21.15.40:0/2764871295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0a8c40 con 0x7f5de00e77c0 2023-11-04T01:40:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0b8850 con 0x7f9010050160 2023-11-04T01:40:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 -- 172.21.15.40:0/2415725780 shutdown_connections 2023-11-04T01:40:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 --2- 172.21.15.40:0/2415725780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c0c9880 0x7f6a2c0cc900 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 -- 172.21.15.40:0/2415725780 >> 172.21.15.40:0/2415725780 conn(0x7f6a2c0cb630 msgr2=0x7f6a2c0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 -- 172.21.15.40:0/2415725780 shutdown_connections 2023-11-04T01:40:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f4002dcb640 1 -- 172.21.15.40:0/3761944250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff40df770 msgr2=0x7f3ff4055d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f4002dcb640 1 --2- 172.21.15.40:0/3761944250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff40df770 0x7f3ff4055d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40564e0 tx=0x7f3fec01c490 comp rx=0 tx=0).stop 2023-11-04T01:40:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f6a326be640 1 -- 172.21.15.40:0/2415725780 wait complete. 2023-11-04T01:40:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901017b6a0 con 0x7f9010050160 2023-11-04T01:40:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901017bc60 con 0x7f9010050160 2023-11-04T01:40:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f652759e640 1 -- 172.21.15.40:0/946147537 wait complete. 2023-11-04T01:40:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 Processor -- start 2023-11-04T01:40:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 -- 172.21.15.40:0/3761944250 shutdown_connections 2023-11-04T01:40:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 --2- 172.21.15.40:0/3761944250 >> v2:172.21.15.91:3300/0 conn(0x7f3ff4036620 0x7f3ff403a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 --2- 172.21.15.40:0/3761944250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff40df770 0x7f3ff4055d00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 -- 172.21.15.40:0/3761944250 >> 172.21.15.40:0/3761944250 conn(0x7f3ff401e6b0 msgr2=0x7f3ff40553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 -- 172.21.15.40:0/3761944250 shutdown_connections 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 -- 172.21.15.40:0/2764871295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00e77c0 msgr2=0x7f5de0007280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 --2- 172.21.15.40:0/2764871295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00e77c0 0x7f5de0007280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5de000e040 tx=0x7f5ddc01eb90 comp rx=0 tx=0).stop 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 -- 172.21.15.40:0/2764871295 shutdown_connections 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 --2- 172.21.15.40:0/2764871295 >> v2:172.21.15.91:3300/0 conn(0x7f5de00382a0 0x7f5de0052790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 --2- 172.21.15.40:0/2764871295 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de0047e30 0x7f5de0037d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 --2- 172.21.15.40:0/2764871295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00e77c0 0x7f5de0007280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 -- 172.21.15.40:0/2764871295 >> 172.21.15.40:0/2764871295 conn(0x7f5de0054bc0 msgr2=0x7f5de0054fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 -- 172.21.15.40:0/2764871295 shutdown_connections 2023-11-04T01:40:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0ad660 con 0x7f9010050160 2023-11-04T01:40:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0b8c30 con 0x7f9010050160 2023-11-04T01:40:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 -- 172.21.15.40:0/1079292125 >> v2:172.21.15.91:3300/0 conn(0x7f29340556e0 msgr2=0x7f2934054210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:40:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 --2- 172.21.15.40:0/1079292125 >> v2:172.21.15.91:3300/0 conn(0x7f29340556e0 0x7f2934054210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 -- 172.21.15.40:0/1079292125 >> v1:172.21.15.91:6789/0 conn(0x7f293404fc50 legacy=0x7f29340381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.132+0000 7f2940955640 1 -- 172.21.15.40:0/1079292125 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340068a0 con 0x7f2934007380 2023-11-04T01:40:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 -- 172.21.15.40:0/3761944250 wait complete. 2023-11-04T01:40:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 -- start start 2023-11-04T01:40:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 0x7f65280c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65280cba80 0x7f65280c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6528159a50 0x7f6528154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652806b690 con 0x7f65280cba80 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6528206370 con 0x7f6528071070 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6528206650 con 0x7f6528159a50 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 0x7f65280c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6528159a50 0x7f6528154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652659c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 0x7f65280c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52618/0 (socket says 172.21.15.40:52618) 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652659c640 1 -- 172.21.15.40:0/2158844251 learned_addr learned my addr 172.21.15.40:0/2158844251 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 Processor -- start 2023-11-04T01:40:09.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 Processor -- start 2023-11-04T01:40:09.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f4002dcb640 1 -- start start 2023-11-04T01:40:09.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 -- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 msgr2=0x7f65280c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 0x7f65280c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 -- 172.21.15.40:0/2158844251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65280cba80 msgr2=0x7f65280c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65280cba80 0x7f65280c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 -- 172.21.15.40:0/2158844251 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6518009420 con 0x7f6528159a50 2023-11-04T01:40:09.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 -- 172.21.15.40:0/2764871295 wait complete. 2023-11-04T01:40:09.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 Processor -- start 2023-11-04T01:40:09.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6526d9d640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6528159a50 0x7f6528154290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65180ac000 tx=0x7f651801ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652659c640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 0x7f65280c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180b58d0 con 0x7f6528159a50 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 -- start start 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a2c0c9880 0x7f6a2c1666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a2c0cafe0 0x7f6a2c168f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c169fa0 0x7f6a2c169450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6528206930 con 0x7f6528159a50 2023-11-04T01:40:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff8005260 con 0x7f9010050160 2023-11-04T01:40:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f2940955640 1 --2- 172.21.15.40:0/1079292125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2934007380 0x7f29340df2e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f293c000b70 tx=0x7f293c099750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3f3f005dc74b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c6350 con 0x7f6a2c169fa0 2023-11-04T01:40:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c166c10 con 0x7f6a2c0cafe0 2023-11-04T01:40:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a326be640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c5d90 con 0x7f6a2c0c9880 2023-11-04T01:40:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65280c8910 con 0x7f6528159a50 2023-11-04T01:40:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65180b5a30 con 0x7f6528159a50 2023-11-04T01:40:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180b5da0 con 0x7f6528159a50 2023-11-04T01:40:09.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a2bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a2c0c9880 0x7f6a2c1666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a2bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a2c0c9880 0x7f6a2c1666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:42020/0 (socket says 172.21.15.40:42020) 2023-11-04T01:40:09.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a2bfff640 1 -- 172.21.15.40:0/139440385 learned_addr learned my addr 172.21.15.40:0/139440385 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f6a30c5b640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c169fa0 0x7f6a2c169450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.136+0000 7f5deccca640 1 -- start start 2023-11-04T01:40:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4002dcb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ff4036620 0x7f3ff40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4002dcb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 0x7f3ff40cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 Processor -- start 2023-11-04T01:40:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 -- start start 2023-11-04T01:40:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4002dcb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40df770 0x7f3ff417b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6528206e50 con 0x7f6528159a50 2023-11-04T01:40:09.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 0x7f3ff40cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 0x7f3ff40cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56838/0 (socket says 172.21.15.40:56838) 2023-11-04T01:40:09.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00382a0 0x7f5de00d48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 0x7f5de0047700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de00e77c0 0x7f5de00ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00d3e60 con 0x7f5de00382a0 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00d4410 con 0x7f5de0047e30 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de0047c40 con 0x7f5de00e77c0 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4002dcb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff417bca0 con 0x7f3ff403a5d0 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4002dcb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40e1770 con 0x7f3ff40df770 2023-11-04T01:40:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4002dcb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40d8c40 con 0x7f3ff4036620 2023-11-04T01:40:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 -- 172.21.15.40:0/1695103518 learned_addr learned my addr 172.21.15.40:0/1695103518 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 0x7f5de0047700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 0x7f5de0047700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52630/0 (socket says 172.21.15.40:52630) 2023-11-04T01:40:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 -- 172.21.15.40:0/279646484 learned_addr learned my addr 172.21.15.40:0/279646484 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6a30c5b640 1 -- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a2c0c9880 msgr2=0x7f6a2c1666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6a30c5b640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a2c0c9880 0x7f6a2c1666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6a30c5b640 1 -- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a2c0cafe0 msgr2=0x7f6a2c168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6a30c5b640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a2c0cafe0 0x7f6a2c168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6a30c5b640 1 -- 172.21.15.40:0/139440385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009420 con 0x7f6a2c169fa0 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6a30c5b640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c169fa0 0x7f6a2c169450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0ab000 tx=0x7f6a1c018f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de7fff640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de00e77c0 0x7f5de00ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf0c15aff0 0x7fbf0c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4001dc9640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ff4036620 0x7f3ff40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 -- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ff4036620 msgr2=0x7f3ff40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ff4036620 0x7f3ff40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 -- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40df770 msgr2=0x7f3ff417b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40df770 0x7f3ff417b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 -- 172.21.15.40:0/1695103518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0094d0 con 0x7f3ff403a5d0 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f4001dc9640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ff4036620 0x7f3ff40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:09.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f40015c8640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 0x7f3ff40cdff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800db00 tx=0x7f3ff800a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f900c0c4460 con 0x7f9010050160 2023-11-04T01:40:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de77fe640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00382a0 0x7f5de00d48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 -- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de00e77c0 msgr2=0x7f5de00ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de00e77c0 0x7f5de00ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 -- 172.21.15.40:0/279646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00382a0 msgr2=0x7f5de00d48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00382a0 0x7f5de00d48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 -- 172.21.15.40:0/279646484 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc009420 con 0x7f5de0047e30 2023-11-04T01:40:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f90157fa640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ffc0664a0 0x7f8ffc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65180bf410 con 0x7f6528159a50 2023-11-04T01:40:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbf0c0cf670 0x7fbf0c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0cfb00 con 0x7fbf0c15aff0 2023-11-04T01:40:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f900c11e9c0 con 0x7f9010050160 2023-11-04T01:40:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5de6ffd640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 0x7f5de0047700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400b410 tx=0x7f5dd400b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0cca50 con 0x7fbf0c0cf670 2023-11-04T01:40:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6516ffd640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6508066520 0x7f65080689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf10947640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c15b3d0 con 0x7fbf0c0d1830 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf0c15aff0 0x7fbf0c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf0c15aff0 0x7fbf0c0cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56844/0 (socket says 172.21.15.40:56844) 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3447122336 learned_addr learned my addr 172.21.15.40:0/3447122336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0bfff640 1 --2- 172.21.15.40:0/3447122336 >> v2:172.21.15.91:3300/0 conn(0x7fbf0c0cf670 0x7fbf0c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3447122336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 msgr2=0x7fbf0c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3447122336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3447122336 >> v2:172.21.15.91:3300/0 conn(0x7fbf0c0cf670 msgr2=0x7fbf0c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3447122336 >> v2:172.21.15.91:3300/0 conn(0x7fbf0c0cf670 0x7fbf0c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3447122336 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c06d790 con 0x7fbf0c15aff0 2023-11-04T01:40:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f651811f090 con 0x7f6528159a50 2023-11-04T01:40:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011830 con 0x7f5de0047e30 2023-11-04T01:40:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd40119b0 con 0x7f5de0047e30 2023-11-04T01:40:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4011d60 con 0x7f5de0047e30 2023-11-04T01:40:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f901cf1b640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ffc0664a0 0x7f8ffc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 -- 172.21.15.40:0/279646484 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de00d30f0 con 0x7f5de0047e30 2023-11-04T01:40:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f5deccca640 1 -- 172.21.15.40:0/279646484 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de003a800 con 0x7f5de0047e30 2023-11-04T01:40:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f901cf1b640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ffc0664a0 0x7f8ffc068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9018079b70 tx=0x7f901808d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.140+0000 7f652659c640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6508066520 0x7f65080689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0005260 con 0x7f5de0047e30 2023-11-04T01:40:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f652659c640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6508066520 0x7f65080689e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6520007350 tx=0x7f6520009610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3447122336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c15aff0 0x7fbf0c0cc140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c071ee0 tx=0x7fbefc01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97e07465c2a9d76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5dd4023430 con 0x7f5de0047e30 2023-11-04T01:40:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f5dd3fff640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5dcc0664a0 0x7f5dcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dd4084030 con 0x7f5de0047e30 2023-11-04T01:40:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f900c0ebe90 con 0x7f9010050160 2023-11-04T01:40:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f5de77fe640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5dcc0664a0 0x7f5dcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f2933fff640 1 -- 172.21.15.40:0/1079292125 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c12c070 con 0x7f2934007380 2023-11-04T01:40:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800aa00 con 0x7f3ff403a5d0 2023-11-04T01:40:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff40d8f20 con 0x7f3ff403a5d0 2023-11-04T01:40:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0b4600 con 0x7f6a2c169fa0 2023-11-04T01:40:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f6a326be640 1 -- 172.21.15.40:0/139440385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0c6070 con 0x7f6a2c169fa0 2023-11-04T01:40:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff40d94e0 con 0x7f3ff403a5d0 2023-11-04T01:40:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f6a326be640 1 -- 172.21.15.40:0/139440385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c0b1c50 con 0x7f6a2c169fa0 2023-11-04T01:40:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7fbf0a7fc640 1 -- 172.21.15.40:0/3447122336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0ab600 con 0x7fbf0c15aff0 2023-11-04T01:40:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c0b4760 con 0x7f6a2c169fa0 2023-11-04T01:40:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c005260 con 0x7f6a2c169fa0 2023-11-04T01:40:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f2933fff640 1 -- 172.21.15.40:0/1079292125 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c128410 con 0x7f2934007380 2023-11-04T01:40:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f2933fff640 1 -- 172.21.15.40:0/1079292125 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c128840 con 0x7f2934007380 2023-11-04T01:40:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.144+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0b4ad0 con 0x7f6a2c169fa0 2023-11-04T01:40:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff40e1990 con 0x7f3ff403a5d0 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- 172.21.15.40:0/1079292125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2934007380 msgr2=0x7f29340df2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 --2- 172.21.15.40:0/1079292125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2934007380 0x7f29340df2e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f293c000b70 tx=0x7f293c099750 comp rx=0 tx=0).stop 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- 172.21.15.40:0/1079292125 shutdown_connections 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 --2- 172.21.15.40:0/1079292125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2934007380 0x7f29340df2e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 --2- 172.21.15.40:0/1079292125 >> v2:172.21.15.91:3300/0 conn(0x7f29340556e0 0x7f2934054210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- 172.21.15.40:0/1079292125 >> 172.21.15.40:0/1079292125 conn(0x7f2934054bf0 msgr2=0x7f2934054fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- 172.21.15.40:0/1079292125 shutdown_connections 2023-11-04T01:40:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800ab60 con 0x7f3ff403a5d0 2023-11-04T01:40:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80059a0 con 0x7f3ff403a5d0 2023-11-04T01:40:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf0a7fc640 1 -- 172.21.15.40:0/3447122336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc0a7050 con 0x7fbf0c15aff0 2023-11-04T01:40:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf0a7fc640 1 -- 172.21.15.40:0/3447122336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0ab980 con 0x7fbf0c15aff0 2023-11-04T01:40:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 -- 172.21.15.40:0/3447122336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c15aff0 msgr2=0x7fbf0c0cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 --2- 172.21.15.40:0/3447122336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c15aff0 0x7fbf0c0cc140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c071ee0 tx=0x7fbefc01c180 comp rx=0 tx=0).stop 2023-11-04T01:40:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- 172.21.15.40:0/1079292125 wait complete. 2023-11-04T01:40:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 Processor -- start 2023-11-04T01:40:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 -- 172.21.15.40:0/3447122336 shutdown_connections 2023-11-04T01:40:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 --2- 172.21.15.40:0/3447122336 >> v2:172.21.15.91:3300/0 conn(0x7fbf0c0cf670 0x7fbf0c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 --2- 172.21.15.40:0/3447122336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 --2- 172.21.15.40:0/3447122336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c15aff0 0x7fbf0c0cc140 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 -- 172.21.15.40:0/3447122336 >> 172.21.15.40:0/3447122336 conn(0x7fbf0c0d0b50 msgr2=0x7fbf0c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 -- 172.21.15.40:0/3447122336 shutdown_connections 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- start start 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 0x7f293404bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f293404fc50 0x7f293404aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29340556e0 0x7f29340d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293404ec60 con 0x7f29340556e0 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293404e980 con 0x7f2934007380 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f29433ba640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293404e050 con 0x7f293404fc50 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 0x7f293404bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 0x7f293404bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52648/0 (socket says 172.21.15.40:52648) 2023-11-04T01:40:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 -- 172.21.15.40:0/3155270345 learned_addr learned my addr 172.21.15.40:0/3155270345 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a1c0b2040 con 0x7f6a2c169fa0 2023-11-04T01:40:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f6a28ff9640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a180664a0 0x7f6a18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 -- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f293404fc50 msgr2=0x7f293404aed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:40:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f293404fc50 0x7f293404aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 -- 172.21.15.40:0/3155270345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29340556e0 msgr2=0x7f29340d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29340556e0 0x7f29340d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f2941156640 1 -- 172.21.15.40:0/3155270345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c04f430 con 0x7f2934007380 2023-11-04T01:40:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7f6a2bfff640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a180664a0 0x7f6a18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.148+0000 7fbf10947640 1 -- 172.21.15.40:0/3447122336 wait complete. 2023-11-04T01:40:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7f2941156640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 0x7f293404bcc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f293800b410 tx=0x7f293800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 Processor -- start 2023-11-04T01:40:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a1c0ef5d0 con 0x7f6a2c169fa0 2023-11-04T01:40:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7f6a2bfff640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a180664a0 0x7f6a18068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a20001960 tx=0x7f6a20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7f5de77fe640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5dcc0664a0 0x7f5dcc068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0b2000 tx=0x7f5ddc0aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 -- start start 2023-11-04T01:40:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c0cf670 0x7fbf0c150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf0c15aff0 0x7fbf0c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf0affd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf0affd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:42054/0 (socket says 172.21.15.40:42054) 2023-11-04T01:40:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65180ec4f0 con 0x7f6528159a50 2023-11-04T01:40:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ff8015070 con 0x7f3ff403a5d0 2023-11-04T01:40:09.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f3ff27fc640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe00664a0 0x7f3fe0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff8083d70 con 0x7f3ff403a5d0 2023-11-04T01:40:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0b36d0 con 0x7fbf0c0cf670 2023-11-04T01:40:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0b4250 con 0x7fbf0c15aff0 2023-11-04T01:40:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf10947640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0b3920 con 0x7fbf0c0d1830 2023-11-04T01:40:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf0affd640 1 -- 172.21.15.40:0/3512926020 learned_addr learned my addr 172.21.15.40:0/3512926020 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.152+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c0cf670 0x7fbf0c150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 msgr2=0x7fbf0c0b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf0c15aff0 msgr2=0x7fbf0c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf0c15aff0 0x7fbf0c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7fbf0b7fe640 1 -- 172.21.15.40:0/3512926020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc009480 con 0x7fbf0c0cf670 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f4001dc9640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe00664a0 0x7f3fe0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7fbf0b7fe640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c0cf670 0x7fbf0c150db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0ab000 tx=0x7fbefc018f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f4001dc9640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe00664a0 0x7f3fe0068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0af000 tx=0x7f3fec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6a1c0eb910 con 0x7f6a2c169fa0 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938011830 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938011990 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293404e330 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938011d40 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.156+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29340cb740 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c005260 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f293801a400 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f2931ffb640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29200664a0 0x7f2920068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2938083fc0 con 0x7f2934007380 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f2940955640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29200664a0 0x7f2920068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ff8051290 con 0x7f3ff403a5d0 2023-11-04T01:40:09.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f2940955640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29200664a0 0x7f2920068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f293400d500 tx=0x7f293c125000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0ba070 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7fbf10947640 1 -- 172.21.15.40:0/3512926020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c0b3c00 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc004240 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7fbf10947640 1 -- 172.21.15.40:0/3512926020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c1512f0 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec005260 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.164+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc006040 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.164+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbefc0b2050 con 0x7fbf0c0cf670 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.164+0000 7fbef3fff640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbef80664a0 0x7fbef8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.160+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5dd4051540 con 0x7f5de0047e30 2023-11-04T01:40:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.164+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbefc0efbb0 con 0x7fbf0c0cf670 2023-11-04T01:40:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.168+0000 7fbf0affd640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbef80664a0 0x7fbef8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.168+0000 7fbf0affd640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbef80664a0 0x7fbef8068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0c6ae0 tx=0x7fbf00009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.172+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2938051520 con 0x7f2934007380 2023-11-04T01:40:09.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.176+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbefc0eb7f0 con 0x7fbf0c0cf670 2023-11-04T01:40:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.388+0000 7fc86e5ac640 1 -- 172.21.15.40:0/831918820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc844005510 con 0x7fc868158fc0 2023-11-04T01:40:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.388+0000 7fc864ff9640 1 -- 172.21.15.40:0/831918820 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc85c017020 con 0x7fc868158fc0 2023-11-04T01:40:09.393 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 -- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc84c066470 msgr2=0x7fc84c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc84c066470 0x7fc84c068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8600af000 tx=0x7fc8600a8070 comp rx=0 tx=0).stop 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 -- 172.21.15.40:0/831918820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 msgr2=0x7fc86806b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc86806b690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00c410 tx=0x7fc85c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 -- 172.21.15.40:0/831918820 shutdown_connections 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc84c066470 0x7fc84c068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc868158fc0 0x7fc86806b690 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8680cb830 0x7fc86815a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 --2- 172.21.15.40:0/831918820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc86806d000 0x7fc868149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 -- 172.21.15.40:0/831918820 >> 172.21.15.40:0/831918820 conn(0x7fc8680b0550 msgr2=0x7fc8680cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 -- 172.21.15.40:0/831918820 shutdown_connections 2023-11-04T01:40:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.392+0000 7fc8567fc640 1 -- 172.21.15.40:0/831918820 wait complete. 2023-11-04T01:40:09.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-11-04T01:40:09.416 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.448+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f291c005510 con 0x7f2934007380 2023-11-04T01:40:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.448+0000 7f2931ffb640 1 -- 172.21.15.40:0/3155270345 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2938015090 con 0x7f2934007380 2023-11-04T01:40:09.452 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-11-04T01:40:09.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29200664a0 msgr2=0x7f2920068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29200664a0 0x7f2920068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f293400d500 tx=0x7f293c125000 comp rx=0 tx=0).stop 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 msgr2=0x7f293404bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 0x7f293404bcc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f293800b410 tx=0x7f293800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 shutdown_connections 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29200664a0 0x7f2920068960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29340556e0 0x7f29340d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f293404fc50 0x7f293404aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 --2- 172.21.15.40:0/3155270345 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2934007380 0x7f293404bcc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 >> 172.21.15.40:0/3155270345 conn(0x7f2934054bf0 msgr2=0x7f2934039a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 shutdown_connections 2023-11-04T01:40:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.452+0000 7f29433ba640 1 -- 172.21.15.40:0/3155270345 wait complete. 2023-11-04T01:40:09.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-11-04T01:40:09.470 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.472+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8ff8005510 con 0x7f9010050160 2023-11-04T01:40:09.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.472+0000 7f90157fa640 1 -- 172.21.15.40:0/2294631688 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f900c0ef470 con 0x7f9010050160 2023-11-04T01:40:09.475 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-11-04T01:40:09.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.472+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6528206e50 con 0x7f6528159a50 2023-11-04T01:40:09.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.472+0000 7f6516ffd640 1 -- 172.21.15.40:0/2158844251 <== mon.2 v2:172.21.15.91:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6528206e50 con 0x7f6528159a50 2023-11-04T01:40:09.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ffc0664a0 msgr2=0x7f8ffc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ffc0664a0 0x7f8ffc068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9018079b70 tx=0x7f901808d040 comp rx=0 tx=0).stop 2023-11-04T01:40:09.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010050160 msgr2=0x7f90100d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010050160 0x7f90100d10d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f900c0ae000 tx=0x7f900c01ce90 comp rx=0 tx=0).stop 2023-11-04T01:40:09.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 shutdown_connections 2023-11-04T01:40:09.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8ffc0664a0 0x7f8ffc068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90100df510 0x7f9010046840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9010050160 0x7f90100d10d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 --2- 172.21.15.40:0/2294631688 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9010007350 0x7f901017c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 >> 172.21.15.40:0/2294631688 conn(0x7f9010054bc0 msgr2=0x7f901004aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 shutdown_connections 2023-11-04T01:40:09.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f901df1d640 1 -- 172.21.15.40:0/2294631688 wait complete. 2023-11-04T01:40:09.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a0c0057e0 con 0x7f6a2c169fa0 2023-11-04T01:40:09.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.476+0000 7f6a28ff9640 1 -- 172.21.15.40:0/139440385 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a1c0b0090 con 0x7f6a2c169fa0 2023-11-04T01:40:09.481 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:09.481 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-11-04T01:40:09.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6508066520 msgr2=0x7f65080689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6508066520 0x7f65080689e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6520007350 tx=0x7f6520009610 comp rx=0 tx=0).stop 2023-11-04T01:40:09.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6528159a50 msgr2=0x7f6528154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6528159a50 0x7f6528154290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65180ac000 tx=0x7f651801ac90 comp rx=0 tx=0).stop 2023-11-04T01:40:09.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 shutdown_connections 2023-11-04T01:40:09.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6508066520 0x7f65080689e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6528159a50 0x7f6528154290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65280cba80 0x7f65280c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 --2- 172.21.15.40:0/2158844251 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6528071070 0x7f65280c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 >> 172.21.15.40:0/2158844251 conn(0x7f65280b0550 msgr2=0x7f6528158220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 shutdown_connections 2023-11-04T01:40:09.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a180664a0 msgr2=0x7f6a18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a180664a0 0x7f6a18068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a20001960 tx=0x7f6a20009040 comp rx=0 tx=0).stop 2023-11-04T01:40:09.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f652759e640 1 -- 172.21.15.40:0/2158844251 wait complete. 2023-11-04T01:40:09.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c169fa0 msgr2=0x7f6a2c169450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c169fa0 0x7f6a2c169450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0ab000 tx=0x7f6a1c018f30 comp rx=0 tx=0).stop 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 shutdown_connections 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a180664a0 0x7f6a18068960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2c169fa0 0x7f6a2c169450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a2c0cafe0 0x7f6a2c168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 --2- 172.21.15.40:0/139440385 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a2c0c9880 0x7f6a2c1666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 >> 172.21.15.40:0/139440385 conn(0x7f6a2c0cb630 msgr2=0x7f6a2c16c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 shutdown_connections 2023-11-04T01:40:09.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f6a127fc640 1 -- 172.21.15.40:0/139440385 wait complete. 2023-11-04T01:40:09.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.480+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5dc00057e0 con 0x7f5de0047e30 2023-11-04T01:40:09.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.484+0000 7f5dd3fff640 1 -- 172.21.15.40:0/279646484 <== mon.1 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dd4015020 con 0x7f5de0047e30 2023-11-04T01:40:09.490 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:09.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3ff40056d0 con 0x7f3ff403a5d0 2023-11-04T01:40:09.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f3ff27fc640 1 -- 172.21.15.40:0/1695103518 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ff801c020 con 0x7f3ff403a5d0 2023-11-04T01:40:09.490 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-11-04T01:40:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5dcc0664a0 msgr2=0x7f5dcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5dcc0664a0 0x7f5dcc068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0b2000 tx=0x7f5ddc0aa070 comp rx=0 tx=0).stop 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 msgr2=0x7f5de0047700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 0x7f5de0047700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400b410 tx=0x7f5dd400b810 comp rx=0 tx=0).stop 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 shutdown_connections 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5dcc0664a0 0x7f5dcc068960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5de00e77c0 0x7f5de00ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5de0047e30 0x7f5de0047700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 --2- 172.21.15.40:0/279646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5de00382a0 0x7f5de00d48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 >> 172.21.15.40:0/279646484 conn(0x7f5de0054bc0 msgr2=0x7f5de00e65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 shutdown_connections 2023-11-04T01:40:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.488+0000 7f5dd1ffb640 1 -- 172.21.15.40:0/279646484 wait complete. 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe00664a0 msgr2=0x7f3fe0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe00664a0 0x7f3fe0068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0af000 tx=0x7f3fec008040 comp rx=0 tx=0).stop 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 msgr2=0x7f3ff40cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 0x7f3ff40cdff0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800db00 tx=0x7f3ff800a1d0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 shutdown_connections 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe00664a0 0x7f3fe0068960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ff40df770 0x7f3ff417b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ff403a5d0 0x7f3ff40cdff0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 --2- 172.21.15.40:0/1695103518 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ff4036620 0x7f3ff40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 >> 172.21.15.40:0/1695103518 conn(0x7f3ff401e6b0 msgr2=0x7f3ff4054660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 shutdown_connections 2023-11-04T01:40:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.492+0000 7f4002dcb640 1 -- 172.21.15.40:0/1695103518 wait complete. 2023-11-04T01:40:09.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.496+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbeec0057e0 con 0x7fbf0c0cf670 2023-11-04T01:40:09.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.496+0000 7fbef3fff640 1 -- 172.21.15.40:0/3512926020 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbefc0b0020 con 0x7fbf0c0cf670 2023-11-04T01:40:09.499 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbef80664a0 msgr2=0x7fbef8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbef80664a0 0x7fbef8068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0c6ae0 tx=0x7fbf00009110 comp rx=0 tx=0).stop 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c0cf670 msgr2=0x7fbf0c150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c0cf670 0x7fbf0c150db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0ab000 tx=0x7fbefc018f20 comp rx=0 tx=0).stop 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 shutdown_connections 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbef80664a0 0x7fbef8068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf0c15aff0 0x7fbf0c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c0b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 --2- 172.21.15.40:0/3512926020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf0c0cf670 0x7fbf0c150db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 >> 172.21.15.40:0/3512926020 conn(0x7fbf0c0d0b50 msgr2=0x7fbf0c15a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 shutdown_connections 2023-11-04T01:40:09.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.500+0000 7fbef1ffb640 1 -- 172.21.15.40:0/3512926020 wait complete. 2023-11-04T01:40:09.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-11-04T01:40:09.508 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-11-04T01:40:09.509 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-11-04T01:40:09.516 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-11-04T01:40:09.519 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-11-04T01:40:09.522 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-11-04T01:40:09.527 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:09.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:40:09.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.668+0000 7f39aea82640 1 Processor -- start 2023-11-04T01:40:09.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 -- start start 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39a815b320 0x7f39a806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a806fe30 0x7f39a80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39a80b0b70 0x7f39a80c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a806c7b0 con 0x7f39a815b320 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80b1000 con 0x7f39a80b0b70 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39aea82640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a806bb30 con 0x7f39a806fe30 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39a815b320 0x7f39a806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39a815b320 0x7f39a806f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56878/0 (socket says 172.21.15.40:56878) 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 -- 172.21.15.40:0/3924829904 learned_addr learned my addr 172.21.15.40:0/3924829904 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39a7fff640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a806fe30 0x7f39a80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 -- 172.21.15.40:0/3924829904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a806fe30 msgr2=0x7f39a80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ad01f640 1 --2- 172.21.15.40:0/3924829904 >> v2:172.21.15.91:3300/0 conn(0x7f39a80b0b70 0x7f39a80c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a806fe30 0x7f39a80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 -- 172.21.15.40:0/3924829904 >> v2:172.21.15.91:3300/0 conn(0x7f39a80b0b70 msgr2=0x7f39a80c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 --2- 172.21.15.40:0/3924829904 >> v2:172.21.15.91:3300/0 conn(0x7f39a80b0b70 0x7f39a80c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 -- 172.21.15.40:0/3924829904 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a806be10 con 0x7f39a815b320 2023-11-04T01:40:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39a7fff640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a806fe30 0x7f39a80b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39ac81e640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a815b320 0x7f39a806f8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39a80b15c0 tx=0x7f399801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829c5f2445e53dec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39a77fe640 1 -- 172.21.15.40:0/3924829904 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980ab600 con 0x7f39a815b320 2023-11-04T01:40:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39a77fe640 1 -- 172.21.15.40:0/3924829904 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39980a7050 con 0x7f39a815b320 2023-11-04T01:40:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.672+0000 7f39a77fe640 1 -- 172.21.15.40:0/3924829904 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980ab980 con 0x7f39a815b320 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/3924829904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a815b320 msgr2=0x7f39a806f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a815b320 0x7f39a806f8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f39a80b15c0 tx=0x7f399801c180 comp rx=0 tx=0).stop 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/3924829904 shutdown_connections 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- 172.21.15.40:0/3924829904 >> v2:172.21.15.91:3300/0 conn(0x7f39a80b0b70 0x7f39a80c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a806fe30 0x7f39a80b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- 172.21.15.40:0/3924829904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a815b320 0x7f39a806f8f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/3924829904 >> 172.21.15.40:0/3924829904 conn(0x7f39a80cebb0 msgr2=0x7f39a80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/3924829904 shutdown_connections 2023-11-04T01:40:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/3924829904 wait complete. 2023-11-04T01:40:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 Processor -- start 2023-11-04T01:40:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- start start 2023-11-04T01:40:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 0x7f39a8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80b0b70 0x7f39a80c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a81524b0 0x7f39a80c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c55d0 con 0x7f39a806fe30 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8151730 con 0x7f39a80b0b70 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a81537f0 con 0x7f39a81524b0 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 0x7f39a8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 0x7f39a8153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56882/0 (socket says 172.21.15.40:56882) 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 -- 172.21.15.40:0/178104086 learned_addr learned my addr 172.21.15.40:0/178104086 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39a7fff640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80b0b70 0x7f39a80c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ad01f640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a81524b0 0x7f39a80c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 -- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a81524b0 msgr2=0x7f39a80c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a81524b0 0x7f39a80c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 -- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80b0b70 msgr2=0x7f39a80c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80b0b70 0x7f39a80c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 -- 172.21.15.40:0/178104086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39980094d0 con 0x7f39a806fe30 2023-11-04T01:40:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39ac81e640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 0x7f39a8153160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f399801a830 tx=0x7f3998018f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980b3890 con 0x7f39a806fe30 2023-11-04T01:40:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39980b39f0 con 0x7f39a806fe30 2023-11-04T01:40:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a81519d0 con 0x7f39a806fe30 2023-11-04T01:40:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980b3da0 con 0x7f39a806fe30 2023-11-04T01:40:09.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a8151f90 con 0x7f39a806fe30 2023-11-04T01:40:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.676+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8152180 con 0x7f39a806fe30 2023-11-04T01:40:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.680+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f39980b2070 con 0x7f39a806fe30 2023-11-04T01:40:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.680+0000 7f39a57fa640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.680+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f399811e340 con 0x7f39a806fe30 2023-11-04T01:40:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.680+0000 7f39a7fff640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.680+0000 7f39a7fff640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39a8155db0 tx=0x7f399c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.684+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39980eb690 con 0x7f39a806fe30 2023-11-04T01:40:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.832+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39a80744a0 con 0x7f39940664a0 2023-11-04T01:40:09.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.852+0000 7f39a57fa640 1 -- 172.21.15.40:0/178104086 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264509 (secure 0 0 0) 0x7f39a80744a0 con 0x7f39940664a0 2023-11-04T01:40:09.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 msgr2=0x7f3994068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39a8155db0 tx=0x7f399c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 msgr2=0x7f39a8153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 0x7f39a8153160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f399801a830 tx=0x7f3998018f20 comp rx=0 tx=0).stop 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 shutdown_connections 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f39940664a0 0x7f3994068960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f39a81524b0 0x7f39a80c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80b0b70 0x7f39a80c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 --2- 172.21.15.40:0/178104086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39a806fe30 0x7f39a8153160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 >> 172.21.15.40:0/178104086 conn(0x7f39a80cebb0 msgr2=0x7f39a80cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 shutdown_connections 2023-11-04T01:40:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:09.856+0000 7f39aea82640 1 -- 172.21.15.40:0/178104086 wait complete. 2023-11-04T01:40:09.874 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-04T01:40:09.751775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.883768"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242480+0000","last_change":"2023-11-04T01:39:57.925789+0000","last_active":"2023-11-04T01:39:59.242480+0000","last_peered":"2023-11-04T01:39:59.242480+0000","last_clean":"2023-11-04T01:39:59.242480+0000","last_became_active":"2023-11-04T01:39:57.925151+0000","last_became_peered":"2023-11-04T01:39:57.925151+0000","last_unstale":"2023-11-04T01:39:59.242480+0000","last_undegraded":"2023-11-04T01:39:59.242480+0000","last_fullsized":"2023-11-04T01:39:59.242480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868458+0000","last_change":"2023-11-04T01:39:57.908425+0000","last_active":"2023-11-04T01:39:58.868458+0000","last_peered":"2023-11-04T01:39:58.868458+0000","last_clean":"2023-11-04T01:39:58.868458+0000","last_became_active":"2023-11-04T01:39:57.907722+0000","last_became_peered":"2023-11-04T01:39:57.907722+0000","last_unstale":"2023-11-04T01:39:58.868458+0000","last_undegraded":"2023-11-04T01:39:58.868458+0000","last_fullsized":"2023-11-04T01:39:58.868458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867715+0000","last_change":"2023-11-04T01:39:57.900305+0000","last_active":"2023-11-04T01:39:59.867715+0000","last_peered":"2023-11-04T01:39:59.867715+0000","last_clean":"2023-11-04T01:39:59.867715+0000","last_became_active":"2023-11-04T01:39:57.897404+0000","last_became_peered":"2023-11-04T01:39:57.897404+0000","last_unstale":"2023-11-04T01:39:59.867715+0000","last_undegraded":"2023-11-04T01:39:59.867715+0000","last_fullsized":"2023-11-04T01:39:59.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873355+0000","last_change":"2023-11-04T01:39:57.903325+0000","last_active":"2023-11-04T01:39:58.873355+0000","last_peered":"2023-11-04T01:39:58.873355+0000","last_clean":"2023-11-04T01:39:58.873355+0000","last_became_active":"2023-11-04T01:39:57.902596+0000","last_became_peered":"2023-11-04T01:39:57.902596+0000","last_unstale":"2023-11-04T01:39:58.873355+0000","last_undegraded":"2023-11-04T01:39:58.873355+0000","last_fullsized":"2023-11-04T01:39:58.873355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241536+0000","last_change":"2023-11-04T01:39:57.926330+0000","last_active":"2023-11-04T01:39:59.241536+0000","last_peered":"2023-11-04T01:39:59.241536+0000","last_clean":"2023-11-04T01:39:59.241536+0000","last_became_active":"2023-11-04T01:39:57.924224+0000","last_became_peered":"2023-11-04T01:39:57.924224+0000","last_unstale":"2023-11-04T01:39:59.241536+0000","last_undegraded":"2023-11-04T01:39:59.241536+0000","last_fullsized":"2023-11-04T01:39:59.241536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871995+0000","last_change":"2023-11-04T01:39:57.892846+0000","last_active":"2023-11-04T01:39:58.871995+0000","last_peered":"2023-11-04T01:39:58.871995+0000","last_clean":"2023-11-04T01:39:58.871995+0000","last_became_active":"2023-11-04T01:39:57.892070+0000","last_became_peered":"2023-11-04T01:39:57.892070+0000","last_unstale":"2023-11-04T01:39:58.871995+0000","last_undegraded":"2023-11-04T01:39:58.871995+0000","last_fullsized":"2023-11-04T01:39:58.871995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241310+0000","last_change":"2023-11-04T01:39:57.925014+0000","last_active":"2023-11-04T01:39:59.241310+0000","last_peered":"2023-11-04T01:39:59.241310+0000","last_clean":"2023-11-04T01:39:59.241310+0000","last_became_active":"2023-11-04T01:39:57.924087+0000","last_became_peered":"2023-11-04T01:39:57.924087+0000","last_unstale":"2023-11-04T01:39:59.241310+0000","last_undegraded":"2023-11-04T01:39:59.241310+0000","last_fullsized":"2023-11-04T01:39:59.241310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867175+0000","last_change":"2023-11-04T01:39:57.899378+0000","last_active":"2023-11-04T01:39:59.867175+0000","last_peered":"2023-11-04T01:39:59.867175+0000","last_clean":"2023-11-04T01:39:59.867175+0000","last_became_active":"2023-11-04T01:39:57.898302+0000","last_became_peered":"2023-11-04T01:39:57.898302+0000","last_unstale":"2023-11-04T01:39:59.867175+0000","last_undegraded":"2023-11-04T01:39:59.867175+0000","last_fullsized":"2023-11-04T01:39:59.867175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242662+0000","last_change":"2023-11-04T01:39:57.926979+0000","last_active":"2023-11-04T01:39:59.242662+0000","last_peered":"2023-11-04T01:39:59.242662+0000","last_clean":"2023-11-04T01:39:59.242662+0000","last_became_active":"2023-11-04T01:39:57.926296+0000","last_became_peered":"2023-11-04T01:39:57.926296+0000","last_unstale":"2023-11-04T01:39:59.242662+0000","last_undegraded":"2023-11-04T01:39:59.242662+0000","last_fullsized":"2023-11-04T01:39:59.242662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:16.450490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.904461+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.903712+0000","last_became_peered":"2023-11-04T01:39:57.903712+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867074+0000","last_change":"2023-11-04T01:39:57.916530+0000","last_active":"2023-11-04T01:39:59.867074+0000","last_peered":"2023-11-04T01:39:59.867074+0000","last_clean":"2023-11-04T01:39:59.867074+0000","last_became_active":"2023-11-04T01:39:57.915736+0000","last_became_peered":"2023-11-04T01:39:57.915736+0000","last_unstale":"2023-11-04T01:39:59.867074+0000","last_undegraded":"2023-11-04T01:39:59.867074+0000","last_fullsized":"2023-11-04T01:39:59.867074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872434+0000","last_change":"2023-11-04T01:39:57.910499+0000","last_active":"2023-11-04T01:39:58.872434+0000","last_peered":"2023-11-04T01:39:58.872434+0000","last_clean":"2023-11-04T01:39:58.872434+0000","last_became_active":"2023-11-04T01:39:57.908955+0000","last_became_peered":"2023-11-04T01:39:57.908955+0000","last_unstale":"2023-11-04T01:39:58.872434+0000","last_undegraded":"2023-11-04T01:39:58.872434+0000","last_fullsized":"2023-11-04T01:39:58.872434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:13.526783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868977+0000","last_change":"2023-11-04T01:39:57.910910+0000","last_active":"2023-11-04T01:39:59.868977+0000","last_peered":"2023-11-04T01:39:59.868977+0000","last_clean":"2023-11-04T01:39:59.868977+0000","last_became_active":"2023-11-04T01:39:57.910137+0000","last_became_peered":"2023-11-04T01:39:57.910137+0000","last_unstale":"2023-11-04T01:39:59.868977+0000","last_undegraded":"2023-11-04T01:39:59.868977+0000","last_fullsized":"2023-11-04T01:39:59.868977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865890+0000","last_change":"2023-11-04T01:39:57.899243+0000","last_active":"2023-11-04T01:39:59.865890+0000","last_peered":"2023-11-04T01:39:59.865890+0000","last_clean":"2023-11-04T01:39:59.865890+0000","last_became_active":"2023-11-04T01:39:57.898485+0000","last_became_peered":"2023-11-04T01:39:57.898485+0000","last_unstale":"2023-11-04T01:39:59.865890+0000","last_undegraded":"2023-11-04T01:39:59.865890+0000","last_fullsized":"2023-11-04T01:39:59.865890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:10.549998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868723+0000","last_change":"2023-11-04T01:39:57.908194+0000","last_active":"2023-11-04T01:39:58.868723+0000","last_peered":"2023-11-04T01:39:58.868723+0000","last_clean":"2023-11-04T01:39:58.868723+0000","last_became_active":"2023-11-04T01:39:57.907392+0000","last_became_peered":"2023-11-04T01:39:57.907392+0000","last_unstale":"2023-11-04T01:39:58.868723+0000","last_undegraded":"2023-11-04T01:39:58.868723+0000","last_fullsized":"2023-11-04T01:39:58.868723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871444+0000","last_change":"2023-11-04T01:39:57.880160+0000","last_active":"2023-11-04T01:39:58.871444+0000","last_peered":"2023-11-04T01:39:58.871444+0000","last_clean":"2023-11-04T01:39:58.871444+0000","last_became_active":"2023-11-04T01:39:57.879279+0000","last_became_peered":"2023-11-04T01:39:57.879279+0000","last_unstale":"2023-11-04T01:39:58.871444+0000","last_undegraded":"2023-11-04T01:39:58.871444+0000","last_fullsized":"2023-11-04T01:39:58.871444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874863+0000","last_change":"2023-11-04T01:39:57.921634+0000","last_active":"2023-11-04T01:39:58.874863+0000","last_peered":"2023-11-04T01:39:58.874863+0000","last_clean":"2023-11-04T01:39:58.874863+0000","last_became_active":"2023-11-04T01:39:57.921093+0000","last_became_peered":"2023-11-04T01:39:57.921093+0000","last_unstale":"2023-11-04T01:39:58.874863+0000","last_undegraded":"2023-11-04T01:39:58.874863+0000","last_fullsized":"2023-11-04T01:39:58.874863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866725+0000","last_change":"2023-11-04T01:39:57.905623+0000","last_active":"2023-11-04T01:39:59.866725+0000","last_peered":"2023-11-04T01:39:59.866725+0000","last_clean":"2023-11-04T01:39:59.866725+0000","last_became_active":"2023-11-04T01:39:57.903240+0000","last_became_peered":"2023-11-04T01:39:57.903240+0000","last_unstale":"2023-11-04T01:39:59.866725+0000","last_undegraded":"2023-11-04T01:39:59.866725+0000","last_fullsized":"2023-11-04T01:39:59.866725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242457+0000","last_change":"2023-11-04T01:39:57.926788+0000","last_active":"2023-11-04T01:39:59.242457+0000","last_peered":"2023-11-04T01:39:59.242457+0000","last_clean":"2023-11-04T01:39:59.242457+0000","last_became_active":"2023-11-04T01:39:57.926166+0000","last_became_peered":"2023-11-04T01:39:57.926166+0000","last_unstale":"2023-11-04T01:39:59.242457+0000","last_undegraded":"2023-11-04T01:39:59.242457+0000","last_fullsized":"2023-11-04T01:39:59.242457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867431+0000","last_change":"2023-11-04T01:39:57.911323+0000","last_active":"2023-11-04T01:39:59.867431+0000","last_peered":"2023-11-04T01:39:59.867431+0000","last_clean":"2023-11-04T01:39:59.867431+0000","last_became_active":"2023-11-04T01:39:57.910177+0000","last_became_peered":"2023-11-04T01:39:57.910177+0000","last_unstale":"2023-11-04T01:39:59.867431+0000","last_undegraded":"2023-11-04T01:39:59.867431+0000","last_fullsized":"2023-11-04T01:39:59.867431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866844+0000","last_change":"2023-11-04T01:39:57.905163+0000","last_active":"2023-11-04T01:39:59.866844+0000","last_peered":"2023-11-04T01:39:59.866844+0000","last_clean":"2023-11-04T01:39:59.866844+0000","last_became_active":"2023-11-04T01:39:57.903224+0000","last_became_peered":"2023-11-04T01:39:57.903224+0000","last_unstale":"2023-11-04T01:39:59.866844+0000","last_undegraded":"2023-11-04T01:39:59.866844+0000","last_fullsized":"2023-11-04T01:39:59.866844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:37.716898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872301+0000","last_change":"2023-11-04T01:39:57.921678+0000","last_active":"2023-11-04T01:39:58.872301+0000","last_peered":"2023-11-04T01:39:58.872301+0000","last_clean":"2023-11-04T01:39:58.872301+0000","last_became_active":"2023-11-04T01:39:57.921140+0000","last_became_peered":"2023-11-04T01:39:57.921140+0000","last_unstale":"2023-11-04T01:39:58.872301+0000","last_undegraded":"2023-11-04T01:39:58.872301+0000","last_fullsized":"2023-11-04T01:39:58.872301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867110+0000","last_change":"2023-11-04T01:39:57.896458+0000","last_active":"2023-11-04T01:39:59.867110+0000","last_peered":"2023-11-04T01:39:59.867110+0000","last_clean":"2023-11-04T01:39:59.867110+0000","last_became_active":"2023-11-04T01:39:57.895714+0000","last_became_peered":"2023-11-04T01:39:57.895714+0000","last_unstale":"2023-11-04T01:39:59.867110+0000","last_undegraded":"2023-11-04T01:39:59.867110+0000","last_fullsized":"2023-11-04T01:39:59.867110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871593+0000","last_change":"2023-11-04T01:39:57.915051+0000","last_active":"2023-11-04T01:39:58.871593+0000","last_peered":"2023-11-04T01:39:58.871593+0000","last_clean":"2023-11-04T01:39:58.871593+0000","last_became_active":"2023-11-04T01:39:57.914155+0000","last_became_peered":"2023-11-04T01:39:57.914155+0000","last_unstale":"2023-11-04T01:39:58.871593+0000","last_undegraded":"2023-11-04T01:39:58.871593+0000","last_fullsized":"2023-11-04T01:39:58.871593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869418+0000","last_change":"2023-11-04T01:39:57.896281+0000","last_active":"2023-11-04T01:39:59.869418+0000","last_peered":"2023-11-04T01:39:59.869418+0000","last_clean":"2023-11-04T01:39:59.869418+0000","last_became_active":"2023-11-04T01:39:57.895403+0000","last_became_peered":"2023-11-04T01:39:57.895403+0000","last_unstale":"2023-11-04T01:39:59.869418+0000","last_undegraded":"2023-11-04T01:39:59.869418+0000","last_fullsized":"2023-11-04T01:39:59.869418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867543+0000","last_change":"2023-11-04T01:39:57.921624+0000","last_active":"2023-11-04T01:39:59.867543+0000","last_peered":"2023-11-04T01:39:59.867543+0000","last_clean":"2023-11-04T01:39:59.867543+0000","last_became_active":"2023-11-04T01:39:57.920996+0000","last_became_peered":"2023-11-04T01:39:57.920996+0000","last_unstale":"2023-11-04T01:39:59.867543+0000","last_undegraded":"2023-11-04T01:39:59.867543+0000","last_fullsized":"2023-11-04T01:39:59.867543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868934+0000","last_change":"2023-11-04T01:39:57.893478+0000","last_active":"2023-11-04T01:39:58.868934+0000","last_peered":"2023-11-04T01:39:58.868934+0000","last_clean":"2023-11-04T01:39:58.868934+0000","last_became_active":"2023-11-04T01:39:57.892683+0000","last_became_peered":"2023-11-04T01:39:57.892683+0000","last_unstale":"2023-11-04T01:39:58.868934+0000","last_undegraded":"2023-11-04T01:39:58.868934+0000","last_fullsized":"2023-11-04T01:39:58.868934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869388+0000","last_change":"2023-11-04T01:39:57.905914+0000","last_active":"2023-11-04T01:39:59.869388+0000","last_peered":"2023-11-04T01:39:59.869388+0000","last_clean":"2023-11-04T01:39:59.869388+0000","last_became_active":"2023-11-04T01:39:57.905063+0000","last_became_peered":"2023-11-04T01:39:57.905063+0000","last_unstale":"2023-11-04T01:39:59.869388+0000","last_undegraded":"2023-11-04T01:39:59.869388+0000","last_fullsized":"2023-11-04T01:39:59.869388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867127+0000","last_change":"2023-11-04T01:39:57.904020+0000","last_active":"2023-11-04T01:39:59.867127+0000","last_peered":"2023-11-04T01:39:59.867127+0000","last_clean":"2023-11-04T01:39:59.867127+0000","last_became_active":"2023-11-04T01:39:57.900757+0000","last_became_peered":"2023-11-04T01:39:57.900757+0000","last_unstale":"2023-11-04T01:39:59.867127+0000","last_undegraded":"2023-11-04T01:39:59.867127+0000","last_fullsized":"2023-11-04T01:39:59.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872605+0000","last_change":"2023-11-04T01:39:57.899405+0000","last_active":"2023-11-04T01:39:58.872605+0000","last_peered":"2023-11-04T01:39:58.872605+0000","last_clean":"2023-11-04T01:39:58.872605+0000","last_became_active":"2023-11-04T01:39:57.898321+0000","last_became_peered":"2023-11-04T01:39:57.898321+0000","last_unstale":"2023-11-04T01:39:58.872605+0000","last_undegraded":"2023-11-04T01:39:58.872605+0000","last_fullsized":"2023-11-04T01:39:58.872605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865624+0000","last_change":"2023-11-04T01:39:57.889138+0000","last_active":"2023-11-04T01:39:59.865624+0000","last_peered":"2023-11-04T01:39:59.865624+0000","last_clean":"2023-11-04T01:39:59.865624+0000","last_became_active":"2023-11-04T01:39:57.888387+0000","last_became_peered":"2023-11-04T01:39:57.888387+0000","last_unstale":"2023-11-04T01:39:59.865624+0000","last_undegraded":"2023-11-04T01:39:59.865624+0000","last_fullsized":"2023-11-04T01:39:59.865624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866818+0000","last_change":"2023-11-04T01:39:57.906169+0000","last_active":"2023-11-04T01:39:59.866818+0000","last_peered":"2023-11-04T01:39:59.866818+0000","last_clean":"2023-11-04T01:39:59.866818+0000","last_became_active":"2023-11-04T01:39:57.905475+0000","last_became_peered":"2023-11-04T01:39:57.905475+0000","last_unstale":"2023-11-04T01:39:59.866818+0000","last_undegraded":"2023-11-04T01:39:59.866818+0000","last_fullsized":"2023-11-04T01:39:59.866818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872249+0000","last_change":"2023-11-04T01:39:57.913166+0000","last_active":"2023-11-04T01:39:58.872249+0000","last_peered":"2023-11-04T01:39:58.872249+0000","last_clean":"2023-11-04T01:39:58.872249+0000","last_became_active":"2023-11-04T01:39:57.912369+0000","last_became_peered":"2023-11-04T01:39:57.912369+0000","last_unstale":"2023-11-04T01:39:58.872249+0000","last_undegraded":"2023-11-04T01:39:58.872249+0000","last_fullsized":"2023-11-04T01:39:58.872249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:37.941972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869281+0000","last_change":"2023-11-04T01:39:57.109460+0000","last_active":"2023-11-04T01:39:59.869281+0000","last_peered":"2023-11-04T01:39:59.869281+0000","last_clean":"2023-11-04T01:39:59.869281+0000","last_became_active":"2023-11-04T01:39:57.109057+0000","last_became_peered":"2023-11-04T01:39:57.109057+0000","last_unstale":"2023-11-04T01:39:59.869281+0000","last_undegraded":"2023-11-04T01:39:59.869281+0000","last_fullsized":"2023-11-04T01:39:59.869281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867312+0000","last_change":"2023-11-04T01:39:57.899906+0000","last_active":"2023-11-04T01:39:59.867312+0000","last_peered":"2023-11-04T01:39:59.867312+0000","last_clean":"2023-11-04T01:39:59.867312+0000","last_became_active":"2023-11-04T01:39:57.890228+0000","last_became_peered":"2023-11-04T01:39:57.890228+0000","last_unstale":"2023-11-04T01:39:59.867312+0000","last_undegraded":"2023-11-04T01:39:59.867312+0000","last_fullsized":"2023-11-04T01:39:59.867312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866758+0000","last_change":"2023-11-04T01:39:57.107398+0000","last_active":"2023-11-04T01:39:59.866758+0000","last_peered":"2023-11-04T01:39:59.866758+0000","last_clean":"2023-11-04T01:39:59.866758+0000","last_became_active":"2023-11-04T01:39:57.105860+0000","last_became_peered":"2023-11-04T01:39:57.105860+0000","last_unstale":"2023-11-04T01:39:59.866758+0000","last_undegraded":"2023-11-04T01:39:59.866758+0000","last_fullsized":"2023-11-04T01:39:59.866758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868547+0000","last_change":"2023-11-04T01:39:57.104185+0000","last_active":"2023-11-04T01:39:59.868547+0000","last_peered":"2023-11-04T01:39:59.868547+0000","last_clean":"2023-11-04T01:39:59.868547+0000","last_became_active":"2023-11-04T01:39:57.103699+0000","last_became_peered":"2023-11-04T01:39:57.103699+0000","last_unstale":"2023-11-04T01:39:59.868547+0000","last_undegraded":"2023-11-04T01:39:59.868547+0000","last_fullsized":"2023-11-04T01:39:59.868547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867352+0000","last_change":"2023-11-04T01:39:57.901259+0000","last_active":"2023-11-04T01:39:59.867352+0000","last_peered":"2023-11-04T01:39:59.867352+0000","last_clean":"2023-11-04T01:39:59.867352+0000","last_became_active":"2023-11-04T01:39:57.899400+0000","last_became_peered":"2023-11-04T01:39:57.899400+0000","last_unstale":"2023-11-04T01:39:59.867352+0000","last_undegraded":"2023-11-04T01:39:59.867352+0000","last_fullsized":"2023-11-04T01:39:59.867352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871665+0000","last_change":"2023-11-04T01:39:57.103508+0000","last_active":"2023-11-04T01:39:58.871665+0000","last_peered":"2023-11-04T01:39:58.871665+0000","last_clean":"2023-11-04T01:39:58.871665+0000","last_became_active":"2023-11-04T01:39:57.102807+0000","last_became_peered":"2023-11-04T01:39:57.102807+0000","last_unstale":"2023-11-04T01:39:58.871665+0000","last_undegraded":"2023-11-04T01:39:58.871665+0000","last_fullsized":"2023-11-04T01:39:58.871665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868552+0000","last_change":"2023-11-04T01:39:57.914207+0000","last_active":"2023-11-04T01:39:58.868552+0000","last_peered":"2023-11-04T01:39:58.868552+0000","last_clean":"2023-11-04T01:39:58.868552+0000","last_became_active":"2023-11-04T01:39:57.913328+0000","last_became_peered":"2023-11-04T01:39:57.913328+0000","last_unstale":"2023-11-04T01:39:58.868552+0000","last_undegraded":"2023-11-04T01:39:58.868552+0000","last_fullsized":"2023-11-04T01:39:58.868552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867354+0000","last_change":"2023-11-04T01:39:57.116533+0000","last_active":"2023-11-04T01:39:59.867354+0000","last_peered":"2023-11-04T01:39:59.867354+0000","last_clean":"2023-11-04T01:39:59.867354+0000","last_became_active":"2023-11-04T01:39:57.115805+0000","last_became_peered":"2023-11-04T01:39:57.115805+0000","last_unstale":"2023-11-04T01:39:59.867354+0000","last_undegraded":"2023-11-04T01:39:59.867354+0000","last_fullsized":"2023-11-04T01:39:59.867354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874659+0000","last_change":"2023-11-04T01:39:57.900836+0000","last_active":"2023-11-04T01:39:58.874659+0000","last_peered":"2023-11-04T01:39:58.874659+0000","last_clean":"2023-11-04T01:39:58.874659+0000","last_became_active":"2023-11-04T01:39:57.900068+0000","last_became_peered":"2023-11-04T01:39:57.900068+0000","last_unstale":"2023-11-04T01:39:58.874659+0000","last_undegraded":"2023-11-04T01:39:58.874659+0000","last_fullsized":"2023-11-04T01:39:58.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874438+0000","last_change":"2023-11-04T01:39:57.112275+0000","last_active":"2023-11-04T01:39:58.874438+0000","last_peered":"2023-11-04T01:39:58.874438+0000","last_clean":"2023-11-04T01:39:58.874438+0000","last_became_active":"2023-11-04T01:39:57.111384+0000","last_became_peered":"2023-11-04T01:39:57.111384+0000","last_unstale":"2023-11-04T01:39:58.874438+0000","last_undegraded":"2023-11-04T01:39:58.874438+0000","last_fullsized":"2023-11-04T01:39:58.874438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.460433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868016+0000","last_change":"2023-11-04T01:39:57.889775+0000","last_active":"2023-11-04T01:39:59.868016+0000","last_peered":"2023-11-04T01:39:59.868016+0000","last_clean":"2023-11-04T01:39:59.868016+0000","last_became_active":"2023-11-04T01:39:57.888973+0000","last_became_peered":"2023-11-04T01:39:57.888973+0000","last_unstale":"2023-11-04T01:39:59.868016+0000","last_undegraded":"2023-11-04T01:39:59.868016+0000","last_fullsized":"2023-11-04T01:39:59.868016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869054+0000","last_change":"2023-11-04T01:39:57.104163+0000","last_active":"2023-11-04T01:39:58.869054+0000","last_peered":"2023-11-04T01:39:58.869054+0000","last_clean":"2023-11-04T01:39:58.869054+0000","last_became_active":"2023-11-04T01:39:57.103774+0000","last_became_peered":"2023-11-04T01:39:57.103774+0000","last_unstale":"2023-11-04T01:39:58.869054+0000","last_undegraded":"2023-11-04T01:39:58.869054+0000","last_fullsized":"2023-11-04T01:39:58.869054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872752+0000","last_change":"2023-11-04T01:39:57.908429+0000","last_active":"2023-11-04T01:39:58.872752+0000","last_peered":"2023-11-04T01:39:58.872752+0000","last_clean":"2023-11-04T01:39:58.872752+0000","last_became_active":"2023-11-04T01:39:57.904836+0000","last_became_peered":"2023-11-04T01:39:57.904836+0000","last_unstale":"2023-11-04T01:39:58.872752+0000","last_undegraded":"2023-11-04T01:39:58.872752+0000","last_fullsized":"2023-11-04T01:39:58.872752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867284+0000","last_change":"2023-11-04T01:39:57.104076+0000","last_active":"2023-11-04T01:39:59.867284+0000","last_peered":"2023-11-04T01:39:59.867284+0000","last_clean":"2023-11-04T01:39:59.867284+0000","last_became_active":"2023-11-04T01:39:57.103284+0000","last_became_peered":"2023-11-04T01:39:57.103284+0000","last_unstale":"2023-11-04T01:39:59.867284+0000","last_undegraded":"2023-11-04T01:39:59.867284+0000","last_fullsized":"2023-11-04T01:39:59.867284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242226+0000","last_change":"2023-11-04T01:39:57.925026+0000","last_active":"2023-11-04T01:39:59.242226+0000","last_peered":"2023-11-04T01:39:59.242226+0000","last_clean":"2023-11-04T01:39:59.242226+0000","last_became_active":"2023-11-04T01:39:57.924278+0000","last_became_peered":"2023-11-04T01:39:57.924278+0000","last_unstale":"2023-11-04T01:39:59.242226+0000","last_undegraded":"2023-11-04T01:39:59.242226+0000","last_fullsized":"2023-11-04T01:39:59.242226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867432+0000","last_change":"2023-11-04T01:39:57.089537+0000","last_active":"2023-11-04T01:39:59.867432+0000","last_peered":"2023-11-04T01:39:59.867432+0000","last_clean":"2023-11-04T01:39:59.867432+0000","last_became_active":"2023-11-04T01:39:57.088369+0000","last_became_peered":"2023-11-04T01:39:57.088369+0000","last_unstale":"2023-11-04T01:39:59.867432+0000","last_undegraded":"2023-11-04T01:39:59.867432+0000","last_fullsized":"2023-11-04T01:39:59.867432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866389+0000","last_change":"2023-11-04T01:39:57.921257+0000","last_active":"2023-11-04T01:39:59.866389+0000","last_peered":"2023-11-04T01:39:59.866389+0000","last_clean":"2023-11-04T01:39:59.866389+0000","last_became_active":"2023-11-04T01:39:57.920025+0000","last_became_peered":"2023-11-04T01:39:57.920025+0000","last_unstale":"2023-11-04T01:39:59.866389+0000","last_undegraded":"2023-11-04T01:39:59.866389+0000","last_fullsized":"2023-11-04T01:39:59.866389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:17.627984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872817+0000","last_change":"2023-11-04T01:39:57.114536+0000","last_active":"2023-11-04T01:39:58.872817+0000","last_peered":"2023-11-04T01:39:58.872817+0000","last_clean":"2023-11-04T01:39:58.872817+0000","last_became_active":"2023-11-04T01:39:57.114040+0000","last_became_peered":"2023-11-04T01:39:57.114040+0000","last_unstale":"2023-11-04T01:39:58.872817+0000","last_undegraded":"2023-11-04T01:39:58.872817+0000","last_fullsized":"2023-11-04T01:39:58.872817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241638+0000","last_change":"2023-11-04T01:39:57.927347+0000","last_active":"2023-11-04T01:39:59.241638+0000","last_peered":"2023-11-04T01:39:59.241638+0000","last_clean":"2023-11-04T01:39:59.241638+0000","last_became_active":"2023-11-04T01:39:57.925411+0000","last_became_peered":"2023-11-04T01:39:57.925411+0000","last_unstale":"2023-11-04T01:39:59.241638+0000","last_undegraded":"2023-11-04T01:39:59.241638+0000","last_fullsized":"2023-11-04T01:39:59.241638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866704+0000","last_change":"2023-11-04T01:39:57.104862+0000","last_active":"2023-11-04T01:39:59.866704+0000","last_peered":"2023-11-04T01:39:59.866704+0000","last_clean":"2023-11-04T01:39:59.866704+0000","last_became_active":"2023-11-04T01:39:57.103985+0000","last_became_peered":"2023-11-04T01:39:57.103985+0000","last_unstale":"2023-11-04T01:39:59.866704+0000","last_undegraded":"2023-11-04T01:39:59.866704+0000","last_fullsized":"2023-11-04T01:39:59.866704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:42.123401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866814+0000","last_change":"2023-11-04T01:39:57.903968+0000","last_active":"2023-11-04T01:39:59.866814+0000","last_peered":"2023-11-04T01:39:59.866814+0000","last_clean":"2023-11-04T01:39:59.866814+0000","last_became_active":"2023-11-04T01:39:57.903269+0000","last_became_peered":"2023-11-04T01:39:57.903269+0000","last_unstale":"2023-11-04T01:39:59.866814+0000","last_undegraded":"2023-11-04T01:39:59.866814+0000","last_fullsized":"2023-11-04T01:39:59.866814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865260+0000","last_change":"2023-11-04T01:39:57.083110+0000","last_active":"2023-11-04T01:39:59.865260+0000","last_peered":"2023-11-04T01:39:59.865260+0000","last_clean":"2023-11-04T01:39:59.865260+0000","last_became_active":"2023-11-04T01:39:57.082483+0000","last_became_peered":"2023-11-04T01:39:57.082483+0000","last_unstale":"2023-11-04T01:39:59.865260+0000","last_undegraded":"2023-11-04T01:39:59.865260+0000","last_fullsized":"2023-11-04T01:39:59.865260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:49.424318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241483+0000","last_change":"2023-11-04T01:39:57.925941+0000","last_active":"2023-11-04T01:39:59.241483+0000","last_peered":"2023-11-04T01:39:59.241483+0000","last_clean":"2023-11-04T01:39:59.241483+0000","last_became_active":"2023-11-04T01:39:57.925338+0000","last_became_peered":"2023-11-04T01:39:57.925338+0000","last_unstale":"2023-11-04T01:39:59.241483+0000","last_undegraded":"2023-11-04T01:39:59.241483+0000","last_fullsized":"2023-11-04T01:39:59.241483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873396+0000","last_change":"2023-11-04T01:39:57.089157+0000","last_active":"2023-11-04T01:39:58.873396+0000","last_peered":"2023-11-04T01:39:58.873396+0000","last_clean":"2023-11-04T01:39:58.873396+0000","last_became_active":"2023-11-04T01:39:57.088373+0000","last_became_peered":"2023-11-04T01:39:57.088373+0000","last_unstale":"2023-11-04T01:39:58.873396+0000","last_undegraded":"2023-11-04T01:39:58.873396+0000","last_fullsized":"2023-11-04T01:39:58.873396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.666272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242512+0000","last_change":"2023-11-04T01:39:57.926318+0000","last_active":"2023-11-04T01:39:59.242512+0000","last_peered":"2023-11-04T01:39:59.242512+0000","last_clean":"2023-11-04T01:39:59.242512+0000","last_became_active":"2023-11-04T01:39:57.924998+0000","last_became_peered":"2023-11-04T01:39:57.924998+0000","last_unstale":"2023-11-04T01:39:59.242512+0000","last_undegraded":"2023-11-04T01:39:59.242512+0000","last_fullsized":"2023-11-04T01:39:59.242512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:37.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866744+0000","last_change":"2023-11-04T01:39:57.085866+0000","last_active":"2023-11-04T01:39:59.866744+0000","last_peered":"2023-11-04T01:39:59.866744+0000","last_clean":"2023-11-04T01:39:59.866744+0000","last_became_active":"2023-11-04T01:39:57.085501+0000","last_became_peered":"2023-11-04T01:39:57.085501+0000","last_unstale":"2023-11-04T01:39:59.866744+0000","last_undegraded":"2023-11-04T01:39:59.866744+0000","last_fullsized":"2023-11-04T01:39:59.866744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242796+0000","last_change":"2023-11-04T01:39:57.927164+0000","last_active":"2023-11-04T01:39:59.242796+0000","last_peered":"2023-11-04T01:39:59.242796+0000","last_clean":"2023-11-04T01:39:59.242796+0000","last_became_active":"2023-11-04T01:39:57.926817+0000","last_became_peered":"2023-11-04T01:39:57.926817+0000","last_unstale":"2023-11-04T01:39:59.242796+0000","last_undegraded":"2023-11-04T01:39:59.242796+0000","last_fullsized":"2023-11-04T01:39:59.242796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:14.194200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869221+0000","last_change":"2023-11-04T01:39:57.088611+0000","last_active":"2023-11-04T01:39:58.869221+0000","last_peered":"2023-11-04T01:39:58.869221+0000","last_clean":"2023-11-04T01:39:58.869221+0000","last_became_active":"2023-11-04T01:39:57.088214+0000","last_became_peered":"2023-11-04T01:39:57.088214+0000","last_unstale":"2023-11-04T01:39:58.869221+0000","last_undegraded":"2023-11-04T01:39:58.869221+0000","last_fullsized":"2023-11-04T01:39:58.869221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873978+0000","last_change":"2023-11-04T01:39:57.916146+0000","last_active":"2023-11-04T01:39:58.873978+0000","last_peered":"2023-11-04T01:39:58.873978+0000","last_clean":"2023-11-04T01:39:58.873978+0000","last_became_active":"2023-11-04T01:39:57.914346+0000","last_became_peered":"2023-11-04T01:39:57.914346+0000","last_unstale":"2023-11-04T01:39:58.873978+0000","last_undegraded":"2023-11-04T01:39:58.873978+0000","last_fullsized":"2023-11-04T01:39:58.873978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866304+0000","last_change":"2023-11-04T01:39:57.091428+0000","last_active":"2023-11-04T01:39:59.866304+0000","last_peered":"2023-11-04T01:39:59.866304+0000","last_clean":"2023-11-04T01:39:59.866304+0000","last_became_active":"2023-11-04T01:39:57.090767+0000","last_became_peered":"2023-11-04T01:39:57.090767+0000","last_unstale":"2023-11-04T01:39:59.866304+0000","last_undegraded":"2023-11-04T01:39:59.866304+0000","last_fullsized":"2023-11-04T01:39:59.866304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242170+0000","last_change":"2023-11-04T01:39:57.925040+0000","last_active":"2023-11-04T01:39:59.242170+0000","last_peered":"2023-11-04T01:39:59.242170+0000","last_clean":"2023-11-04T01:39:59.242170+0000","last_became_active":"2023-11-04T01:39:57.924201+0000","last_became_peered":"2023-11-04T01:39:57.924201+0000","last_unstale":"2023-11-04T01:39:59.242170+0000","last_undegraded":"2023-11-04T01:39:59.242170+0000","last_fullsized":"2023-11-04T01:39:59.242170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:39:57.898357+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:57.898357+0000","last_peered":"2023-11-04T01:39:57.898357+0000","last_clean":"2023-11-04T01:39:57.898357+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:57.898357+0000","last_undegraded":"2023-11-04T01:39:57.898357+0000","last_fullsized":"2023-11-04T01:39:57.898357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871472+0000","last_change":"2023-11-04T01:39:57.093034+0000","last_active":"2023-11-04T01:39:58.871472+0000","last_peered":"2023-11-04T01:39:58.871472+0000","last_clean":"2023-11-04T01:39:58.871472+0000","last_became_active":"2023-11-04T01:39:57.092158+0000","last_became_peered":"2023-11-04T01:39:57.092158+0000","last_unstale":"2023-11-04T01:39:58.871472+0000","last_undegraded":"2023-11-04T01:39:58.871472+0000","last_fullsized":"2023-11-04T01:39:58.871472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869011+0000","last_change":"2023-11-04T01:39:57.899138+0000","last_active":"2023-11-04T01:39:59.869011+0000","last_peered":"2023-11-04T01:39:59.869011+0000","last_clean":"2023-11-04T01:39:59.869011+0000","last_became_active":"2023-11-04T01:39:57.898313+0000","last_became_peered":"2023-11-04T01:39:57.898313+0000","last_unstale":"2023-11-04T01:39:59.869011+0000","last_undegraded":"2023-11-04T01:39:59.869011+0000","last_fullsized":"2023-11-04T01:39:59.869011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241057+0000","last_change":"2023-11-04T01:39:57.119969+0000","last_active":"2023-11-04T01:39:59.241057+0000","last_peered":"2023-11-04T01:39:59.241057+0000","last_clean":"2023-11-04T01:39:59.241057+0000","last_became_active":"2023-11-04T01:39:57.118250+0000","last_became_peered":"2023-11-04T01:39:57.118250+0000","last_unstale":"2023-11-04T01:39:59.241057+0000","last_undegraded":"2023-11-04T01:39:59.241057+0000","last_fullsized":"2023-11-04T01:39:59.241057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865841+0000","last_change":"2023-11-04T01:39:57.888041+0000","last_active":"2023-11-04T01:39:59.865841+0000","last_peered":"2023-11-04T01:39:59.865841+0000","last_clean":"2023-11-04T01:39:59.865841+0000","last_became_active":"2023-11-04T01:39:57.887240+0000","last_became_peered":"2023-11-04T01:39:57.887240+0000","last_unstale":"2023-11-04T01:39:59.865841+0000","last_undegraded":"2023-11-04T01:39:59.865841+0000","last_fullsized":"2023-11-04T01:39:59.865841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:00.328908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865848+0000","last_change":"2023-11-04T01:39:57.086891+0000","last_active":"2023-11-04T01:39:59.865848+0000","last_peered":"2023-11-04T01:39:59.865848+0000","last_clean":"2023-11-04T01:39:59.865848+0000","last_became_active":"2023-11-04T01:39:57.086482+0000","last_became_peered":"2023-11-04T01:39:57.086482+0000","last_unstale":"2023-11-04T01:39:59.865848+0000","last_undegraded":"2023-11-04T01:39:59.865848+0000","last_fullsized":"2023-11-04T01:39:59.865848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868387+0000","last_change":"2023-11-04T01:39:57.908737+0000","last_active":"2023-11-04T01:39:58.868387+0000","last_peered":"2023-11-04T01:39:58.868387+0000","last_clean":"2023-11-04T01:39:58.868387+0000","last_became_active":"2023-11-04T01:39:57.907965+0000","last_became_peered":"2023-11-04T01:39:57.907965+0000","last_unstale":"2023-11-04T01:39:58.868387+0000","last_undegraded":"2023-11-04T01:39:58.868387+0000","last_fullsized":"2023-11-04T01:39:58.868387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873025+0000","last_change":"2023-11-04T01:39:57.101402+0000","last_active":"2023-11-04T01:39:58.873025+0000","last_peered":"2023-11-04T01:39:58.873025+0000","last_clean":"2023-11-04T01:39:58.873025+0000","last_became_active":"2023-11-04T01:39:57.100736+0000","last_became_peered":"2023-11-04T01:39:57.100736+0000","last_unstale":"2023-11-04T01:39:58.873025+0000","last_undegraded":"2023-11-04T01:39:58.873025+0000","last_fullsized":"2023-11-04T01:39:58.873025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872956+0000","last_change":"2023-11-04T01:39:57.912134+0000","last_active":"2023-11-04T01:39:58.872956+0000","last_peered":"2023-11-04T01:39:58.872956+0000","last_clean":"2023-11-04T01:39:58.872956+0000","last_became_active":"2023-11-04T01:39:57.909396+0000","last_became_peered":"2023-11-04T01:39:57.909396+0000","last_unstale":"2023-11-04T01:39:58.872956+0000","last_undegraded":"2023-11-04T01:39:58.872956+0000","last_fullsized":"2023-11-04T01:39:58.872956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868443+0000","last_change":"2023-11-04T01:39:57.086794+0000","last_active":"2023-11-04T01:39:58.868443+0000","last_peered":"2023-11-04T01:39:58.868443+0000","last_clean":"2023-11-04T01:39:58.868443+0000","last_became_active":"2023-11-04T01:39:57.086448+0000","last_became_peered":"2023-11-04T01:39:57.086448+0000","last_unstale":"2023-11-04T01:39:58.868443+0000","last_undegraded":"2023-11-04T01:39:58.868443+0000","last_fullsized":"2023-11-04T01:39:58.868443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872724+0000","last_change":"2023-11-04T01:39:57.889388+0000","last_active":"2023-11-04T01:39:58.872724+0000","last_peered":"2023-11-04T01:39:58.872724+0000","last_clean":"2023-11-04T01:39:58.872724+0000","last_became_active":"2023-11-04T01:39:57.888326+0000","last_became_peered":"2023-11-04T01:39:57.888326+0000","last_unstale":"2023-11-04T01:39:58.872724+0000","last_undegraded":"2023-11-04T01:39:58.872724+0000","last_fullsized":"2023-11-04T01:39:58.872724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242500+0000","last_change":"2023-11-04T01:39:57.119606+0000","last_active":"2023-11-04T01:39:59.242500+0000","last_peered":"2023-11-04T01:39:59.242500+0000","last_clean":"2023-11-04T01:39:59.242500+0000","last_became_active":"2023-11-04T01:39:57.118501+0000","last_became_peered":"2023-11-04T01:39:57.118501+0000","last_unstale":"2023-11-04T01:39:59.242500+0000","last_undegraded":"2023-11-04T01:39:59.242500+0000","last_fullsized":"2023-11-04T01:39:59.242500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868674+0000","last_change":"2023-11-04T01:39:57.896425+0000","last_active":"2023-11-04T01:39:58.868674+0000","last_peered":"2023-11-04T01:39:58.868674+0000","last_clean":"2023-11-04T01:39:58.868674+0000","last_became_active":"2023-11-04T01:39:57.895472+0000","last_became_peered":"2023-11-04T01:39:57.895472+0000","last_unstale":"2023-11-04T01:39:58.868674+0000","last_undegraded":"2023-11-04T01:39:58.868674+0000","last_fullsized":"2023-11-04T01:39:58.868674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:40:00.228392+0000","last_change":"2023-11-04T01:39:57.102873+0000","last_active":"2023-11-04T01:40:00.228392+0000","last_peered":"2023-11-04T01:40:00.228392+0000","last_clean":"2023-11-04T01:40:00.228392+0000","last_became_active":"2023-11-04T01:39:57.102500+0000","last_became_peered":"2023-11-04T01:39:57.102500+0000","last_unstale":"2023-11-04T01:40:00.228392+0000","last_undegraded":"2023-11-04T01:40:00.228392+0000","last_fullsized":"2023-11-04T01:40:00.228392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869619+0000","last_change":"2023-11-04T01:39:57.920760+0000","last_active":"2023-11-04T01:39:59.869619+0000","last_peered":"2023-11-04T01:39:59.869619+0000","last_clean":"2023-11-04T01:39:59.869619+0000","last_became_active":"2023-11-04T01:39:57.920036+0000","last_became_peered":"2023-11-04T01:39:57.920036+0000","last_unstale":"2023-11-04T01:39:59.869619+0000","last_undegraded":"2023-11-04T01:39:59.869619+0000","last_fullsized":"2023-11-04T01:39:59.869619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867441+0000","last_change":"2023-11-04T01:39:57.119006+0000","last_active":"2023-11-04T01:39:59.867441+0000","last_peered":"2023-11-04T01:39:59.867441+0000","last_clean":"2023-11-04T01:39:59.867441+0000","last_became_active":"2023-11-04T01:39:57.118360+0000","last_became_peered":"2023-11-04T01:39:57.118360+0000","last_unstale":"2023-11-04T01:39:59.867441+0000","last_undegraded":"2023-11-04T01:39:59.867441+0000","last_fullsized":"2023-11-04T01:39:59.867441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867208+0000","last_change":"2023-11-04T01:39:57.899526+0000","last_active":"2023-11-04T01:39:59.867208+0000","last_peered":"2023-11-04T01:39:59.867208+0000","last_clean":"2023-11-04T01:39:59.867208+0000","last_became_active":"2023-11-04T01:39:57.898663+0000","last_became_peered":"2023-11-04T01:39:57.898663+0000","last_unstale":"2023-11-04T01:39:59.867208+0000","last_undegraded":"2023-11-04T01:39:59.867208+0000","last_fullsized":"2023-11-04T01:39:59.867208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.240990+0000","last_change":"2023-11-04T01:39:57.118965+0000","last_active":"2023-11-04T01:39:59.240990+0000","last_peered":"2023-11-04T01:39:59.240990+0000","last_clean":"2023-11-04T01:39:59.240990+0000","last_became_active":"2023-11-04T01:39:57.117428+0000","last_became_peered":"2023-11-04T01:39:57.117428+0000","last_unstale":"2023-11-04T01:39:59.240990+0000","last_undegraded":"2023-11-04T01:39:59.240990+0000","last_fullsized":"2023-11-04T01:39:59.240990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872736+0000","last_change":"2023-11-04T01:39:57.897837+0000","last_active":"2023-11-04T01:39:58.872736+0000","last_peered":"2023-11-04T01:39:58.872736+0000","last_clean":"2023-11-04T01:39:58.872736+0000","last_became_active":"2023-11-04T01:39:57.897180+0000","last_became_peered":"2023-11-04T01:39:57.897180+0000","last_unstale":"2023-11-04T01:39:58.872736+0000","last_undegraded":"2023-11-04T01:39:58.872736+0000","last_fullsized":"2023-11-04T01:39:58.872736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.657024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868796+0000","last_change":"2023-11-04T01:39:57.109529+0000","last_active":"2023-11-04T01:39:58.868796+0000","last_peered":"2023-11-04T01:39:58.868796+0000","last_clean":"2023-11-04T01:39:58.868796+0000","last_became_active":"2023-11-04T01:39:57.109076+0000","last_became_peered":"2023-11-04T01:39:57.109076+0000","last_unstale":"2023-11-04T01:39:58.868796+0000","last_undegraded":"2023-11-04T01:39:58.868796+0000","last_fullsized":"2023-11-04T01:39:58.868796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.909590+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.908648+0000","last_became_peered":"2023-11-04T01:39:57.908648+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868661+0000","last_change":"2023-11-04T01:39:57.090615+0000","last_active":"2023-11-04T01:39:58.868661+0000","last_peered":"2023-11-04T01:39:58.868661+0000","last_clean":"2023-11-04T01:39:58.868661+0000","last_became_active":"2023-11-04T01:39:57.090254+0000","last_became_peered":"2023-11-04T01:39:57.090254+0000","last_unstale":"2023-11-04T01:39:58.868661+0000","last_undegraded":"2023-11-04T01:39:58.868661+0000","last_fullsized":"2023-11-04T01:39:58.868661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869182+0000","last_change":"2023-11-04T01:39:57.919597+0000","last_active":"2023-11-04T01:39:59.869182+0000","last_peered":"2023-11-04T01:39:59.869182+0000","last_clean":"2023-11-04T01:39:59.869182+0000","last_became_active":"2023-11-04T01:39:57.918813+0000","last_became_peered":"2023-11-04T01:39:57.918813+0000","last_unstale":"2023-11-04T01:39:59.869182+0000","last_undegraded":"2023-11-04T01:39:59.869182+0000","last_fullsized":"2023-11-04T01:39:59.869182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241973+0000","last_change":"2023-11-04T01:39:57.122022+0000","last_active":"2023-11-04T01:39:59.241973+0000","last_peered":"2023-11-04T01:39:59.241973+0000","last_clean":"2023-11-04T01:39:59.241973+0000","last_became_active":"2023-11-04T01:39:57.121383+0000","last_became_peered":"2023-11-04T01:39:57.121383+0000","last_unstale":"2023-11-04T01:39:59.241973+0000","last_undegraded":"2023-11-04T01:39:59.241973+0000","last_fullsized":"2023-11-04T01:39:59.241973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867389+0000","last_change":"2023-11-04T01:39:57.904433+0000","last_active":"2023-11-04T01:39:59.867389+0000","last_peered":"2023-11-04T01:39:59.867389+0000","last_clean":"2023-11-04T01:39:59.867389+0000","last_became_active":"2023-11-04T01:39:57.903609+0000","last_became_peered":"2023-11-04T01:39:57.903609+0000","last_unstale":"2023-11-04T01:39:59.867389+0000","last_undegraded":"2023-11-04T01:39:59.867389+0000","last_fullsized":"2023-11-04T01:39:59.867389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872398+0000","last_change":"2023-11-04T01:39:57.887415+0000","last_active":"2023-11-04T01:39:58.872398+0000","last_peered":"2023-11-04T01:39:58.872398+0000","last_clean":"2023-11-04T01:39:58.872398+0000","last_became_active":"2023-11-04T01:39:57.886545+0000","last_became_peered":"2023-11-04T01:39:57.886545+0000","last_unstale":"2023-11-04T01:39:58.872398+0000","last_undegraded":"2023-11-04T01:39:58.872398+0000","last_fullsized":"2023-11-04T01:39:58.872398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241975+0000","last_change":"2023-11-04T01:39:57.117914+0000","last_active":"2023-11-04T01:39:59.241975+0000","last_peered":"2023-11-04T01:39:59.241975+0000","last_clean":"2023-11-04T01:39:59.241975+0000","last_became_active":"2023-11-04T01:39:57.117315+0000","last_became_peered":"2023-11-04T01:39:57.117315+0000","last_unstale":"2023-11-04T01:39:59.241975+0000","last_undegraded":"2023-11-04T01:39:59.241975+0000","last_fullsized":"2023-11-04T01:39:59.241975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873666+0000","last_change":"2023-11-04T01:39:57.890838+0000","last_active":"2023-11-04T01:39:58.873666+0000","last_peered":"2023-11-04T01:39:58.873666+0000","last_clean":"2023-11-04T01:39:58.873666+0000","last_became_active":"2023-11-04T01:39:57.890240+0000","last_became_peered":"2023-11-04T01:39:57.890240+0000","last_unstale":"2023-11-04T01:39:58.873666+0000","last_undegraded":"2023-11-04T01:39:58.873666+0000","last_fullsized":"2023-11-04T01:39:58.873666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242364+0000","last_change":"2023-11-04T01:39:57.119136+0000","last_active":"2023-11-04T01:39:59.242364+0000","last_peered":"2023-11-04T01:39:59.242364+0000","last_clean":"2023-11-04T01:39:59.242364+0000","last_became_active":"2023-11-04T01:39:57.117698+0000","last_became_peered":"2023-11-04T01:39:57.117698+0000","last_unstale":"2023-11-04T01:39:59.242364+0000","last_undegraded":"2023-11-04T01:39:59.242364+0000","last_fullsized":"2023-11-04T01:39:59.242364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867841+0000","last_change":"2023-11-04T01:39:57.891105+0000","last_active":"2023-11-04T01:39:59.867841+0000","last_peered":"2023-11-04T01:39:59.867841+0000","last_clean":"2023-11-04T01:39:59.867841+0000","last_became_active":"2023-11-04T01:39:57.890260+0000","last_became_peered":"2023-11-04T01:39:57.890260+0000","last_unstale":"2023-11-04T01:39:59.867841+0000","last_undegraded":"2023-11-04T01:39:59.867841+0000","last_fullsized":"2023-11-04T01:39:59.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869471+0000","last_change":"2023-11-04T01:39:57.086637+0000","last_active":"2023-11-04T01:39:59.869471+0000","last_peered":"2023-11-04T01:39:59.869471+0000","last_clean":"2023-11-04T01:39:59.869471+0000","last_became_active":"2023-11-04T01:39:57.086227+0000","last_became_peered":"2023-11-04T01:39:57.086227+0000","last_unstale":"2023-11-04T01:39:59.869471+0000","last_undegraded":"2023-11-04T01:39:59.869471+0000","last_fullsized":"2023-11-04T01:39:59.869471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:34.010007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869390+0000","last_change":"2023-11-04T01:39:57.910463+0000","last_active":"2023-11-04T01:39:59.869390+0000","last_peered":"2023-11-04T01:39:59.869390+0000","last_clean":"2023-11-04T01:39:59.869390+0000","last_became_active":"2023-11-04T01:39:57.909626+0000","last_became_peered":"2023-11-04T01:39:57.909626+0000","last_unstale":"2023-11-04T01:39:59.869390+0000","last_undegraded":"2023-11-04T01:39:59.869390+0000","last_fullsized":"2023-11-04T01:39:59.869390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868143+0000","last_change":"2023-11-04T01:39:57.110005+0000","last_active":"2023-11-04T01:39:59.868143+0000","last_peered":"2023-11-04T01:39:59.868143+0000","last_clean":"2023-11-04T01:39:59.868143+0000","last_became_active":"2023-11-04T01:39:57.109526+0000","last_became_peered":"2023-11-04T01:39:57.109526+0000","last_unstale":"2023-11-04T01:39:59.868143+0000","last_undegraded":"2023-11-04T01:39:59.868143+0000","last_fullsized":"2023-11-04T01:39:59.868143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:09.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:10.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.024+0000 7fc3393d4640 1 Processor -- start 2023-11-04T01:40:10.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.024+0000 7fc3393d4640 1 -- start start 2023-11-04T01:40:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3393d4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 0x7fc3340715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3393d4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3340c2670 con 0x7fc33406f8f0 2023-11-04T01:40:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3393d4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33406bc30 con 0x7fc3340b0d40 2023-11-04T01:40:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3393d4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc334070140 con 0x7fc33415afd0 2023-11-04T01:40:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc33406f8f0 0x7fc3340b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41166/0 (socket says 172.21.15.40:41166) 2023-11-04T01:40:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 -- 172.21.15.40:0/1382296254 learned_addr learned my addr 172.21.15.40:0/1382296254 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc332ffd640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 0x7fc3340715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006834356 0 0) 0x7fc3340c2670 con 0x7fc33406f8f0 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc31c003530 con 0x7fc33406f8f0 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411853236 0 0) 0x7fc31c003530 con 0x7fc33406f8f0 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 msgr2=0x7fc3340715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 0x7fc3340715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 >> v1:172.21.15.91:6789/0 conn(0x7fc3340b0d40 legacy=0x7fc33415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33406bf10 con 0x7fc33406f8f0 2023-11-04T01:40:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fc328001680 con 0x7fc33406f8f0 2023-11-04T01:40:10.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 >> v1:172.21.15.40:6789/0 conn(0x7fc33406f8f0 legacy=0x7fc3340b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 0x7fc31c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc31c003f30 0x7fc31c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c004d10 0x7fc31c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc334070140 con 0x7fc31c003f30 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c00ba70 con 0x7fc31c004d10 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c00bc30 con 0x7fc33415afd0 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc31c003f30 0x7fc31c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc332ffd640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 0x7fc31c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3337fe640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c004d10 0x7fc31c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 -- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 msgr2=0x7fc31c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc33415afd0 0x7fc31c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 -- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c004d10 msgr2=0x7fc31c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c004d10 0x7fc31c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3327fc640 1 -- 172.21.15.40:0/1382296254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c003530 con 0x7fc31c003f30 2023-11-04T01:40:10.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.028+0000 7fc3337fe640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c004d10 0x7fc31c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3327fc640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc31c003f30 0x7fc31c0047d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c1c0 tx=0x7fc32801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8675c10d23813 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328005ae0 con 0x7fc31c003f30 2023-11-04T01:40:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3280ab070 con 0x7fc31c003f30 2023-11-04T01:40:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc331ffb640 1 -- 172.21.15.40:0/1382296254 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328007070 con 0x7fc31c003f30 2023-11-04T01:40:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- 172.21.15.40:0/1382296254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc31c003f30 msgr2=0x7fc31c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 --2- 172.21.15.40:0/1382296254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc31c003f30 0x7fc31c0047d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c1c0 tx=0x7fc32801f390 comp rx=0 tx=0).stop 2023-11-04T01:40:10.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 -- 172.21.15.40:0/1382296254 reap_dead start 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- 172.21.15.40:0/1382296254 shutdown_connections 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- 172.21.15.40:0/1382296254 >> 172.21.15.40:0/1382296254 conn(0x7fc3340cebb0 msgr2=0x7fc3340cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- 172.21.15.40:0/1382296254 shutdown_connections 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- 172.21.15.40:0/1382296254 wait complete. 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 Processor -- start 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- start start 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c003f30 0x7fc3341f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3340c38c0 0x7fc3340c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 0x7fc3340cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340cc2e0 con 0x7fc3340cb6d0 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340ad400 con 0x7fc31c003f30 2023-11-04T01:40:10.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3393d4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc334151640 con 0x7fc3340c38c0 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 0x7fc3340cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 0x7fc3340cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56904/0 (socket says 172.21.15.40:56904) 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 -- 172.21.15.40:0/2579337881 learned_addr learned my addr 172.21.15.40:0/2579337881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3327fc640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3340c38c0 0x7fc3340c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc332ffd640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c003f30 0x7fc3341f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 -- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3340c38c0 msgr2=0x7fc3340c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3340c38c0 0x7fc3340c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 -- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c003f30 msgr2=0x7fc3341f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c003f30 0x7fc3341f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 -- 172.21.15.40:0/2579337881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340c4260 con 0x7fc3340cb6d0 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc332ffd640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c003f30 0x7fc3341f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc3337fe640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 0x7fc3340cbb40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc33406dc70 tx=0x7fc32c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.032+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c006d60 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c003980 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c003d30 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc334150b60 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3340acd40 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3340cc080 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc32c005070 con 0x7fc3340cb6d0 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc31b7fe640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3200664a0 0x7fc320068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc32c083cc0 con 0x7fc3340cb6d0 2023-11-04T01:40:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc332ffd640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3200664a0 0x7fc320068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.036+0000 7fc332ffd640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3200664a0 0x7fc320068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc324009a20 tx=0x7fc324008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.040+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc32c0511d0 con 0x7fc3340cb6d0 2023-11-04T01:40:10.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.188+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc33406c1f0 con 0x7fc3200664a0 2023-11-04T01:40:10.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.208+0000 7fc31b7fe640 1 -- 172.21.15.40:0/2579337881 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264509 (secure 0 0 0) 0x7fc324012950 con 0x7fc3200664a0 2023-11-04T01:40:10.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:10.213 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:40:10.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3200664a0 msgr2=0x7fc320068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3200664a0 0x7fc320068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc324009a20 tx=0x7fc324008040 comp rx=0 tx=0).stop 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 msgr2=0x7fc3340cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 0x7fc3340cbb40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc33406dc70 tx=0x7fc32c00dc00 comp rx=0 tx=0).stop 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 shutdown_connections 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3200664a0 0x7fc320068960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3340cb6d0 0x7fc3340cbb40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3340c38c0 0x7fc3340c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 --2- 172.21.15.40:0/2579337881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc31c003f30 0x7fc3341f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 >> 172.21.15.40:0/2579337881 conn(0x7fc3340cebb0 msgr2=0x7fc3340c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 shutdown_connections 2023-11-04T01:40:10.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.212+0000 7fc3393d4640 1 -- 172.21.15.40:0/2579337881 wait complete. 2023-11-04T01:40:10.229 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-04T01:40:09.751775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.883768"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242480+0000","last_change":"2023-11-04T01:39:57.925789+0000","last_active":"2023-11-04T01:39:59.242480+0000","last_peered":"2023-11-04T01:39:59.242480+0000","last_clean":"2023-11-04T01:39:59.242480+0000","last_became_active":"2023-11-04T01:39:57.925151+0000","last_became_peered":"2023-11-04T01:39:57.925151+0000","last_unstale":"2023-11-04T01:39:59.242480+0000","last_undegraded":"2023-11-04T01:39:59.242480+0000","last_fullsized":"2023-11-04T01:39:59.242480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868458+0000","last_change":"2023-11-04T01:39:57.908425+0000","last_active":"2023-11-04T01:39:58.868458+0000","last_peered":"2023-11-04T01:39:58.868458+0000","last_clean":"2023-11-04T01:39:58.868458+0000","last_became_active":"2023-11-04T01:39:57.907722+0000","last_became_peered":"2023-11-04T01:39:57.907722+0000","last_unstale":"2023-11-04T01:39:58.868458+0000","last_undegraded":"2023-11-04T01:39:58.868458+0000","last_fullsized":"2023-11-04T01:39:58.868458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867715+0000","last_change":"2023-11-04T01:39:57.900305+0000","last_active":"2023-11-04T01:39:59.867715+0000","last_peered":"2023-11-04T01:39:59.867715+0000","last_clean":"2023-11-04T01:39:59.867715+0000","last_became_active":"2023-11-04T01:39:57.897404+0000","last_became_peered":"2023-11-04T01:39:57.897404+0000","last_unstale":"2023-11-04T01:39:59.867715+0000","last_undegraded":"2023-11-04T01:39:59.867715+0000","last_fullsized":"2023-11-04T01:39:59.867715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873355+0000","last_change":"2023-11-04T01:39:57.903325+0000","last_active":"2023-11-04T01:39:58.873355+0000","last_peered":"2023-11-04T01:39:58.873355+0000","last_clean":"2023-11-04T01:39:58.873355+0000","last_became_active":"2023-11-04T01:39:57.902596+0000","last_became_peered":"2023-11-04T01:39:57.902596+0000","last_unstale":"2023-11-04T01:39:58.873355+0000","last_undegraded":"2023-11-04T01:39:58.873355+0000","last_fullsized":"2023-11-04T01:39:58.873355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241536+0000","last_change":"2023-11-04T01:39:57.926330+0000","last_active":"2023-11-04T01:39:59.241536+0000","last_peered":"2023-11-04T01:39:59.241536+0000","last_clean":"2023-11-04T01:39:59.241536+0000","last_became_active":"2023-11-04T01:39:57.924224+0000","last_became_peered":"2023-11-04T01:39:57.924224+0000","last_unstale":"2023-11-04T01:39:59.241536+0000","last_undegraded":"2023-11-04T01:39:59.241536+0000","last_fullsized":"2023-11-04T01:39:59.241536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871995+0000","last_change":"2023-11-04T01:39:57.892846+0000","last_active":"2023-11-04T01:39:58.871995+0000","last_peered":"2023-11-04T01:39:58.871995+0000","last_clean":"2023-11-04T01:39:58.871995+0000","last_became_active":"2023-11-04T01:39:57.892070+0000","last_became_peered":"2023-11-04T01:39:57.892070+0000","last_unstale":"2023-11-04T01:39:58.871995+0000","last_undegraded":"2023-11-04T01:39:58.871995+0000","last_fullsized":"2023-11-04T01:39:58.871995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241310+0000","last_change":"2023-11-04T01:39:57.925014+0000","last_active":"2023-11-04T01:39:59.241310+0000","last_peered":"2023-11-04T01:39:59.241310+0000","last_clean":"2023-11-04T01:39:59.241310+0000","last_became_active":"2023-11-04T01:39:57.924087+0000","last_became_peered":"2023-11-04T01:39:57.924087+0000","last_unstale":"2023-11-04T01:39:59.241310+0000","last_undegraded":"2023-11-04T01:39:59.241310+0000","last_fullsized":"2023-11-04T01:39:59.241310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867175+0000","last_change":"2023-11-04T01:39:57.899378+0000","last_active":"2023-11-04T01:39:59.867175+0000","last_peered":"2023-11-04T01:39:59.867175+0000","last_clean":"2023-11-04T01:39:59.867175+0000","last_became_active":"2023-11-04T01:39:57.898302+0000","last_became_peered":"2023-11-04T01:39:57.898302+0000","last_unstale":"2023-11-04T01:39:59.867175+0000","last_undegraded":"2023-11-04T01:39:59.867175+0000","last_fullsized":"2023-11-04T01:39:59.867175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242662+0000","last_change":"2023-11-04T01:39:57.926979+0000","last_active":"2023-11-04T01:39:59.242662+0000","last_peered":"2023-11-04T01:39:59.242662+0000","last_clean":"2023-11-04T01:39:59.242662+0000","last_became_active":"2023-11-04T01:39:57.926296+0000","last_became_peered":"2023-11-04T01:39:57.926296+0000","last_unstale":"2023-11-04T01:39:59.242662+0000","last_undegraded":"2023-11-04T01:39:59.242662+0000","last_fullsized":"2023-11-04T01:39:59.242662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:16.450490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.904461+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.903712+0000","last_became_peered":"2023-11-04T01:39:57.903712+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867074+0000","last_change":"2023-11-04T01:39:57.916530+0000","last_active":"2023-11-04T01:39:59.867074+0000","last_peered":"2023-11-04T01:39:59.867074+0000","last_clean":"2023-11-04T01:39:59.867074+0000","last_became_active":"2023-11-04T01:39:57.915736+0000","last_became_peered":"2023-11-04T01:39:57.915736+0000","last_unstale":"2023-11-04T01:39:59.867074+0000","last_undegraded":"2023-11-04T01:39:59.867074+0000","last_fullsized":"2023-11-04T01:39:59.867074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872434+0000","last_change":"2023-11-04T01:39:57.910499+0000","last_active":"2023-11-04T01:39:58.872434+0000","last_peered":"2023-11-04T01:39:58.872434+0000","last_clean":"2023-11-04T01:39:58.872434+0000","last_became_active":"2023-11-04T01:39:57.908955+0000","last_became_peered":"2023-11-04T01:39:57.908955+0000","last_unstale":"2023-11-04T01:39:58.872434+0000","last_undegraded":"2023-11-04T01:39:58.872434+0000","last_fullsized":"2023-11-04T01:39:58.872434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:13.526783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868977+0000","last_change":"2023-11-04T01:39:57.910910+0000","last_active":"2023-11-04T01:39:59.868977+0000","last_peered":"2023-11-04T01:39:59.868977+0000","last_clean":"2023-11-04T01:39:59.868977+0000","last_became_active":"2023-11-04T01:39:57.910137+0000","last_became_peered":"2023-11-04T01:39:57.910137+0000","last_unstale":"2023-11-04T01:39:59.868977+0000","last_undegraded":"2023-11-04T01:39:59.868977+0000","last_fullsized":"2023-11-04T01:39:59.868977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865890+0000","last_change":"2023-11-04T01:39:57.899243+0000","last_active":"2023-11-04T01:39:59.865890+0000","last_peered":"2023-11-04T01:39:59.865890+0000","last_clean":"2023-11-04T01:39:59.865890+0000","last_became_active":"2023-11-04T01:39:57.898485+0000","last_became_peered":"2023-11-04T01:39:57.898485+0000","last_unstale":"2023-11-04T01:39:59.865890+0000","last_undegraded":"2023-11-04T01:39:59.865890+0000","last_fullsized":"2023-11-04T01:39:59.865890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:10.549998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868723+0000","last_change":"2023-11-04T01:39:57.908194+0000","last_active":"2023-11-04T01:39:58.868723+0000","last_peered":"2023-11-04T01:39:58.868723+0000","last_clean":"2023-11-04T01:39:58.868723+0000","last_became_active":"2023-11-04T01:39:57.907392+0000","last_became_peered":"2023-11-04T01:39:57.907392+0000","last_unstale":"2023-11-04T01:39:58.868723+0000","last_undegraded":"2023-11-04T01:39:58.868723+0000","last_fullsized":"2023-11-04T01:39:58.868723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871444+0000","last_change":"2023-11-04T01:39:57.880160+0000","last_active":"2023-11-04T01:39:58.871444+0000","last_peered":"2023-11-04T01:39:58.871444+0000","last_clean":"2023-11-04T01:39:58.871444+0000","last_became_active":"2023-11-04T01:39:57.879279+0000","last_became_peered":"2023-11-04T01:39:57.879279+0000","last_unstale":"2023-11-04T01:39:58.871444+0000","last_undegraded":"2023-11-04T01:39:58.871444+0000","last_fullsized":"2023-11-04T01:39:58.871444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874863+0000","last_change":"2023-11-04T01:39:57.921634+0000","last_active":"2023-11-04T01:39:58.874863+0000","last_peered":"2023-11-04T01:39:58.874863+0000","last_clean":"2023-11-04T01:39:58.874863+0000","last_became_active":"2023-11-04T01:39:57.921093+0000","last_became_peered":"2023-11-04T01:39:57.921093+0000","last_unstale":"2023-11-04T01:39:58.874863+0000","last_undegraded":"2023-11-04T01:39:58.874863+0000","last_fullsized":"2023-11-04T01:39:58.874863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:59.569931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866725+0000","last_change":"2023-11-04T01:39:57.905623+0000","last_active":"2023-11-04T01:39:59.866725+0000","last_peered":"2023-11-04T01:39:59.866725+0000","last_clean":"2023-11-04T01:39:59.866725+0000","last_became_active":"2023-11-04T01:39:57.903240+0000","last_became_peered":"2023-11-04T01:39:57.903240+0000","last_unstale":"2023-11-04T01:39:59.866725+0000","last_undegraded":"2023-11-04T01:39:59.866725+0000","last_fullsized":"2023-11-04T01:39:59.866725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242457+0000","last_change":"2023-11-04T01:39:57.926788+0000","last_active":"2023-11-04T01:39:59.242457+0000","last_peered":"2023-11-04T01:39:59.242457+0000","last_clean":"2023-11-04T01:39:59.242457+0000","last_became_active":"2023-11-04T01:39:57.926166+0000","last_became_peered":"2023-11-04T01:39:57.926166+0000","last_unstale":"2023-11-04T01:39:59.242457+0000","last_undegraded":"2023-11-04T01:39:59.242457+0000","last_fullsized":"2023-11-04T01:39:59.242457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867431+0000","last_change":"2023-11-04T01:39:57.911323+0000","last_active":"2023-11-04T01:39:59.867431+0000","last_peered":"2023-11-04T01:39:59.867431+0000","last_clean":"2023-11-04T01:39:59.867431+0000","last_became_active":"2023-11-04T01:39:57.910177+0000","last_became_peered":"2023-11-04T01:39:57.910177+0000","last_unstale":"2023-11-04T01:39:59.867431+0000","last_undegraded":"2023-11-04T01:39:59.867431+0000","last_fullsized":"2023-11-04T01:39:59.867431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866844+0000","last_change":"2023-11-04T01:39:57.905163+0000","last_active":"2023-11-04T01:39:59.866844+0000","last_peered":"2023-11-04T01:39:59.866844+0000","last_clean":"2023-11-04T01:39:59.866844+0000","last_became_active":"2023-11-04T01:39:57.903224+0000","last_became_peered":"2023-11-04T01:39:57.903224+0000","last_unstale":"2023-11-04T01:39:59.866844+0000","last_undegraded":"2023-11-04T01:39:59.866844+0000","last_fullsized":"2023-11-04T01:39:59.866844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:37.716898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872301+0000","last_change":"2023-11-04T01:39:57.921678+0000","last_active":"2023-11-04T01:39:58.872301+0000","last_peered":"2023-11-04T01:39:58.872301+0000","last_clean":"2023-11-04T01:39:58.872301+0000","last_became_active":"2023-11-04T01:39:57.921140+0000","last_became_peered":"2023-11-04T01:39:57.921140+0000","last_unstale":"2023-11-04T01:39:58.872301+0000","last_undegraded":"2023-11-04T01:39:58.872301+0000","last_fullsized":"2023-11-04T01:39:58.872301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:51.630416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867110+0000","last_change":"2023-11-04T01:39:57.896458+0000","last_active":"2023-11-04T01:39:59.867110+0000","last_peered":"2023-11-04T01:39:59.867110+0000","last_clean":"2023-11-04T01:39:59.867110+0000","last_became_active":"2023-11-04T01:39:57.895714+0000","last_became_peered":"2023-11-04T01:39:57.895714+0000","last_unstale":"2023-11-04T01:39:59.867110+0000","last_undegraded":"2023-11-04T01:39:59.867110+0000","last_fullsized":"2023-11-04T01:39:59.867110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871593+0000","last_change":"2023-11-04T01:39:57.915051+0000","last_active":"2023-11-04T01:39:58.871593+0000","last_peered":"2023-11-04T01:39:58.871593+0000","last_clean":"2023-11-04T01:39:58.871593+0000","last_became_active":"2023-11-04T01:39:57.914155+0000","last_became_peered":"2023-11-04T01:39:57.914155+0000","last_unstale":"2023-11-04T01:39:58.871593+0000","last_undegraded":"2023-11-04T01:39:58.871593+0000","last_fullsized":"2023-11-04T01:39:58.871593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869418+0000","last_change":"2023-11-04T01:39:57.896281+0000","last_active":"2023-11-04T01:39:59.869418+0000","last_peered":"2023-11-04T01:39:59.869418+0000","last_clean":"2023-11-04T01:39:59.869418+0000","last_became_active":"2023-11-04T01:39:57.895403+0000","last_became_peered":"2023-11-04T01:39:57.895403+0000","last_unstale":"2023-11-04T01:39:59.869418+0000","last_undegraded":"2023-11-04T01:39:59.869418+0000","last_fullsized":"2023-11-04T01:39:59.869418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867543+0000","last_change":"2023-11-04T01:39:57.921624+0000","last_active":"2023-11-04T01:39:59.867543+0000","last_peered":"2023-11-04T01:39:59.867543+0000","last_clean":"2023-11-04T01:39:59.867543+0000","last_became_active":"2023-11-04T01:39:57.920996+0000","last_became_peered":"2023-11-04T01:39:57.920996+0000","last_unstale":"2023-11-04T01:39:59.867543+0000","last_undegraded":"2023-11-04T01:39:59.867543+0000","last_fullsized":"2023-11-04T01:39:59.867543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868934+0000","last_change":"2023-11-04T01:39:57.893478+0000","last_active":"2023-11-04T01:39:58.868934+0000","last_peered":"2023-11-04T01:39:58.868934+0000","last_clean":"2023-11-04T01:39:58.868934+0000","last_became_active":"2023-11-04T01:39:57.892683+0000","last_became_peered":"2023-11-04T01:39:57.892683+0000","last_unstale":"2023-11-04T01:39:58.868934+0000","last_undegraded":"2023-11-04T01:39:58.868934+0000","last_fullsized":"2023-11-04T01:39:58.868934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869388+0000","last_change":"2023-11-04T01:39:57.905914+0000","last_active":"2023-11-04T01:39:59.869388+0000","last_peered":"2023-11-04T01:39:59.869388+0000","last_clean":"2023-11-04T01:39:59.869388+0000","last_became_active":"2023-11-04T01:39:57.905063+0000","last_became_peered":"2023-11-04T01:39:57.905063+0000","last_unstale":"2023-11-04T01:39:59.869388+0000","last_undegraded":"2023-11-04T01:39:59.869388+0000","last_fullsized":"2023-11-04T01:39:59.869388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867127+0000","last_change":"2023-11-04T01:39:57.904020+0000","last_active":"2023-11-04T01:39:59.867127+0000","last_peered":"2023-11-04T01:39:59.867127+0000","last_clean":"2023-11-04T01:39:59.867127+0000","last_became_active":"2023-11-04T01:39:57.900757+0000","last_became_peered":"2023-11-04T01:39:57.900757+0000","last_unstale":"2023-11-04T01:39:59.867127+0000","last_undegraded":"2023-11-04T01:39:59.867127+0000","last_fullsized":"2023-11-04T01:39:59.867127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872605+0000","last_change":"2023-11-04T01:39:57.899405+0000","last_active":"2023-11-04T01:39:58.872605+0000","last_peered":"2023-11-04T01:39:58.872605+0000","last_clean":"2023-11-04T01:39:58.872605+0000","last_became_active":"2023-11-04T01:39:57.898321+0000","last_became_peered":"2023-11-04T01:39:57.898321+0000","last_unstale":"2023-11-04T01:39:58.872605+0000","last_undegraded":"2023-11-04T01:39:58.872605+0000","last_fullsized":"2023-11-04T01:39:58.872605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865624+0000","last_change":"2023-11-04T01:39:57.889138+0000","last_active":"2023-11-04T01:39:59.865624+0000","last_peered":"2023-11-04T01:39:59.865624+0000","last_clean":"2023-11-04T01:39:59.865624+0000","last_became_active":"2023-11-04T01:39:57.888387+0000","last_became_peered":"2023-11-04T01:39:57.888387+0000","last_unstale":"2023-11-04T01:39:59.865624+0000","last_undegraded":"2023-11-04T01:39:59.865624+0000","last_fullsized":"2023-11-04T01:39:59.865624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866818+0000","last_change":"2023-11-04T01:39:57.906169+0000","last_active":"2023-11-04T01:39:59.866818+0000","last_peered":"2023-11-04T01:39:59.866818+0000","last_clean":"2023-11-04T01:39:59.866818+0000","last_became_active":"2023-11-04T01:39:57.905475+0000","last_became_peered":"2023-11-04T01:39:57.905475+0000","last_unstale":"2023-11-04T01:39:59.866818+0000","last_undegraded":"2023-11-04T01:39:59.866818+0000","last_fullsized":"2023-11-04T01:39:59.866818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872249+0000","last_change":"2023-11-04T01:39:57.913166+0000","last_active":"2023-11-04T01:39:58.872249+0000","last_peered":"2023-11-04T01:39:58.872249+0000","last_clean":"2023-11-04T01:39:58.872249+0000","last_became_active":"2023-11-04T01:39:57.912369+0000","last_became_peered":"2023-11-04T01:39:57.912369+0000","last_unstale":"2023-11-04T01:39:58.872249+0000","last_undegraded":"2023-11-04T01:39:58.872249+0000","last_fullsized":"2023-11-04T01:39:58.872249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:37.941972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869281+0000","last_change":"2023-11-04T01:39:57.109460+0000","last_active":"2023-11-04T01:39:59.869281+0000","last_peered":"2023-11-04T01:39:59.869281+0000","last_clean":"2023-11-04T01:39:59.869281+0000","last_became_active":"2023-11-04T01:39:57.109057+0000","last_became_peered":"2023-11-04T01:39:57.109057+0000","last_unstale":"2023-11-04T01:39:59.869281+0000","last_undegraded":"2023-11-04T01:39:59.869281+0000","last_fullsized":"2023-11-04T01:39:59.869281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867312+0000","last_change":"2023-11-04T01:39:57.899906+0000","last_active":"2023-11-04T01:39:59.867312+0000","last_peered":"2023-11-04T01:39:59.867312+0000","last_clean":"2023-11-04T01:39:59.867312+0000","last_became_active":"2023-11-04T01:39:57.890228+0000","last_became_peered":"2023-11-04T01:39:57.890228+0000","last_unstale":"2023-11-04T01:39:59.867312+0000","last_undegraded":"2023-11-04T01:39:59.867312+0000","last_fullsized":"2023-11-04T01:39:59.867312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866758+0000","last_change":"2023-11-04T01:39:57.107398+0000","last_active":"2023-11-04T01:39:59.866758+0000","last_peered":"2023-11-04T01:39:59.866758+0000","last_clean":"2023-11-04T01:39:59.866758+0000","last_became_active":"2023-11-04T01:39:57.105860+0000","last_became_peered":"2023-11-04T01:39:57.105860+0000","last_unstale":"2023-11-04T01:39:59.866758+0000","last_undegraded":"2023-11-04T01:39:59.866758+0000","last_fullsized":"2023-11-04T01:39:59.866758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868547+0000","last_change":"2023-11-04T01:39:57.104185+0000","last_active":"2023-11-04T01:39:59.868547+0000","last_peered":"2023-11-04T01:39:59.868547+0000","last_clean":"2023-11-04T01:39:59.868547+0000","last_became_active":"2023-11-04T01:39:57.103699+0000","last_became_peered":"2023-11-04T01:39:57.103699+0000","last_unstale":"2023-11-04T01:39:59.868547+0000","last_undegraded":"2023-11-04T01:39:59.868547+0000","last_fullsized":"2023-11-04T01:39:59.868547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867352+0000","last_change":"2023-11-04T01:39:57.901259+0000","last_active":"2023-11-04T01:39:59.867352+0000","last_peered":"2023-11-04T01:39:59.867352+0000","last_clean":"2023-11-04T01:39:59.867352+0000","last_became_active":"2023-11-04T01:39:57.899400+0000","last_became_peered":"2023-11-04T01:39:57.899400+0000","last_unstale":"2023-11-04T01:39:59.867352+0000","last_undegraded":"2023-11-04T01:39:59.867352+0000","last_fullsized":"2023-11-04T01:39:59.867352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871665+0000","last_change":"2023-11-04T01:39:57.103508+0000","last_active":"2023-11-04T01:39:58.871665+0000","last_peered":"2023-11-04T01:39:58.871665+0000","last_clean":"2023-11-04T01:39:58.871665+0000","last_became_active":"2023-11-04T01:39:57.102807+0000","last_became_peered":"2023-11-04T01:39:57.102807+0000","last_unstale":"2023-11-04T01:39:58.871665+0000","last_undegraded":"2023-11-04T01:39:58.871665+0000","last_fullsized":"2023-11-04T01:39:58.871665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868552+0000","last_change":"2023-11-04T01:39:57.914207+0000","last_active":"2023-11-04T01:39:58.868552+0000","last_peered":"2023-11-04T01:39:58.868552+0000","last_clean":"2023-11-04T01:39:58.868552+0000","last_became_active":"2023-11-04T01:39:57.913328+0000","last_became_peered":"2023-11-04T01:39:57.913328+0000","last_unstale":"2023-11-04T01:39:58.868552+0000","last_undegraded":"2023-11-04T01:39:58.868552+0000","last_fullsized":"2023-11-04T01:39:58.868552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:43.146728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867354+0000","last_change":"2023-11-04T01:39:57.116533+0000","last_active":"2023-11-04T01:39:59.867354+0000","last_peered":"2023-11-04T01:39:59.867354+0000","last_clean":"2023-11-04T01:39:59.867354+0000","last_became_active":"2023-11-04T01:39:57.115805+0000","last_became_peered":"2023-11-04T01:39:57.115805+0000","last_unstale":"2023-11-04T01:39:59.867354+0000","last_undegraded":"2023-11-04T01:39:59.867354+0000","last_fullsized":"2023-11-04T01:39:59.867354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874659+0000","last_change":"2023-11-04T01:39:57.900836+0000","last_active":"2023-11-04T01:39:58.874659+0000","last_peered":"2023-11-04T01:39:58.874659+0000","last_clean":"2023-11-04T01:39:58.874659+0000","last_became_active":"2023-11-04T01:39:57.900068+0000","last_became_peered":"2023-11-04T01:39:57.900068+0000","last_unstale":"2023-11-04T01:39:58.874659+0000","last_undegraded":"2023-11-04T01:39:58.874659+0000","last_fullsized":"2023-11-04T01:39:58.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:20:23.068175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.874438+0000","last_change":"2023-11-04T01:39:57.112275+0000","last_active":"2023-11-04T01:39:58.874438+0000","last_peered":"2023-11-04T01:39:58.874438+0000","last_clean":"2023-11-04T01:39:58.874438+0000","last_became_active":"2023-11-04T01:39:57.111384+0000","last_became_peered":"2023-11-04T01:39:57.111384+0000","last_unstale":"2023-11-04T01:39:58.874438+0000","last_undegraded":"2023-11-04T01:39:58.874438+0000","last_fullsized":"2023-11-04T01:39:58.874438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.460433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868016+0000","last_change":"2023-11-04T01:39:57.889775+0000","last_active":"2023-11-04T01:39:59.868016+0000","last_peered":"2023-11-04T01:39:59.868016+0000","last_clean":"2023-11-04T01:39:59.868016+0000","last_became_active":"2023-11-04T01:39:57.888973+0000","last_became_peered":"2023-11-04T01:39:57.888973+0000","last_unstale":"2023-11-04T01:39:59.868016+0000","last_undegraded":"2023-11-04T01:39:59.868016+0000","last_fullsized":"2023-11-04T01:39:59.868016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:10.367101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869054+0000","last_change":"2023-11-04T01:39:57.104163+0000","last_active":"2023-11-04T01:39:58.869054+0000","last_peered":"2023-11-04T01:39:58.869054+0000","last_clean":"2023-11-04T01:39:58.869054+0000","last_became_active":"2023-11-04T01:39:57.103774+0000","last_became_peered":"2023-11-04T01:39:57.103774+0000","last_unstale":"2023-11-04T01:39:58.869054+0000","last_undegraded":"2023-11-04T01:39:58.869054+0000","last_fullsized":"2023-11-04T01:39:58.869054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872752+0000","last_change":"2023-11-04T01:39:57.908429+0000","last_active":"2023-11-04T01:39:58.872752+0000","last_peered":"2023-11-04T01:39:58.872752+0000","last_clean":"2023-11-04T01:39:58.872752+0000","last_became_active":"2023-11-04T01:39:57.904836+0000","last_became_peered":"2023-11-04T01:39:57.904836+0000","last_unstale":"2023-11-04T01:39:58.872752+0000","last_undegraded":"2023-11-04T01:39:58.872752+0000","last_fullsized":"2023-11-04T01:39:58.872752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:43.133338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867284+0000","last_change":"2023-11-04T01:39:57.104076+0000","last_active":"2023-11-04T01:39:59.867284+0000","last_peered":"2023-11-04T01:39:59.867284+0000","last_clean":"2023-11-04T01:39:59.867284+0000","last_became_active":"2023-11-04T01:39:57.103284+0000","last_became_peered":"2023-11-04T01:39:57.103284+0000","last_unstale":"2023-11-04T01:39:59.867284+0000","last_undegraded":"2023-11-04T01:39:59.867284+0000","last_fullsized":"2023-11-04T01:39:59.867284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242226+0000","last_change":"2023-11-04T01:39:57.925026+0000","last_active":"2023-11-04T01:39:59.242226+0000","last_peered":"2023-11-04T01:39:59.242226+0000","last_clean":"2023-11-04T01:39:59.242226+0000","last_became_active":"2023-11-04T01:39:57.924278+0000","last_became_peered":"2023-11-04T01:39:57.924278+0000","last_unstale":"2023-11-04T01:39:59.242226+0000","last_undegraded":"2023-11-04T01:39:59.242226+0000","last_fullsized":"2023-11-04T01:39:59.242226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867432+0000","last_change":"2023-11-04T01:39:57.089537+0000","last_active":"2023-11-04T01:39:59.867432+0000","last_peered":"2023-11-04T01:39:59.867432+0000","last_clean":"2023-11-04T01:39:59.867432+0000","last_became_active":"2023-11-04T01:39:57.088369+0000","last_became_peered":"2023-11-04T01:39:57.088369+0000","last_unstale":"2023-11-04T01:39:59.867432+0000","last_undegraded":"2023-11-04T01:39:59.867432+0000","last_fullsized":"2023-11-04T01:39:59.867432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866389+0000","last_change":"2023-11-04T01:39:57.921257+0000","last_active":"2023-11-04T01:39:59.866389+0000","last_peered":"2023-11-04T01:39:59.866389+0000","last_clean":"2023-11-04T01:39:59.866389+0000","last_became_active":"2023-11-04T01:39:57.920025+0000","last_became_peered":"2023-11-04T01:39:57.920025+0000","last_unstale":"2023-11-04T01:39:59.866389+0000","last_undegraded":"2023-11-04T01:39:59.866389+0000","last_fullsized":"2023-11-04T01:39:59.866389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:17.627984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872817+0000","last_change":"2023-11-04T01:39:57.114536+0000","last_active":"2023-11-04T01:39:58.872817+0000","last_peered":"2023-11-04T01:39:58.872817+0000","last_clean":"2023-11-04T01:39:58.872817+0000","last_became_active":"2023-11-04T01:39:57.114040+0000","last_became_peered":"2023-11-04T01:39:57.114040+0000","last_unstale":"2023-11-04T01:39:58.872817+0000","last_undegraded":"2023-11-04T01:39:58.872817+0000","last_fullsized":"2023-11-04T01:39:58.872817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241638+0000","last_change":"2023-11-04T01:39:57.927347+0000","last_active":"2023-11-04T01:39:59.241638+0000","last_peered":"2023-11-04T01:39:59.241638+0000","last_clean":"2023-11-04T01:39:59.241638+0000","last_became_active":"2023-11-04T01:39:57.925411+0000","last_became_peered":"2023-11-04T01:39:57.925411+0000","last_unstale":"2023-11-04T01:39:59.241638+0000","last_undegraded":"2023-11-04T01:39:59.241638+0000","last_fullsized":"2023-11-04T01:39:59.241638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866704+0000","last_change":"2023-11-04T01:39:57.104862+0000","last_active":"2023-11-04T01:39:59.866704+0000","last_peered":"2023-11-04T01:39:59.866704+0000","last_clean":"2023-11-04T01:39:59.866704+0000","last_became_active":"2023-11-04T01:39:57.103985+0000","last_became_peered":"2023-11-04T01:39:57.103985+0000","last_unstale":"2023-11-04T01:39:59.866704+0000","last_undegraded":"2023-11-04T01:39:59.866704+0000","last_fullsized":"2023-11-04T01:39:59.866704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:42.123401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866814+0000","last_change":"2023-11-04T01:39:57.903968+0000","last_active":"2023-11-04T01:39:59.866814+0000","last_peered":"2023-11-04T01:39:59.866814+0000","last_clean":"2023-11-04T01:39:59.866814+0000","last_became_active":"2023-11-04T01:39:57.903269+0000","last_became_peered":"2023-11-04T01:39:57.903269+0000","last_unstale":"2023-11-04T01:39:59.866814+0000","last_undegraded":"2023-11-04T01:39:59.866814+0000","last_fullsized":"2023-11-04T01:39:59.866814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865260+0000","last_change":"2023-11-04T01:39:57.083110+0000","last_active":"2023-11-04T01:39:59.865260+0000","last_peered":"2023-11-04T01:39:59.865260+0000","last_clean":"2023-11-04T01:39:59.865260+0000","last_became_active":"2023-11-04T01:39:57.082483+0000","last_became_peered":"2023-11-04T01:39:57.082483+0000","last_unstale":"2023-11-04T01:39:59.865260+0000","last_undegraded":"2023-11-04T01:39:59.865260+0000","last_fullsized":"2023-11-04T01:39:59.865260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:49.424318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241483+0000","last_change":"2023-11-04T01:39:57.925941+0000","last_active":"2023-11-04T01:39:59.241483+0000","last_peered":"2023-11-04T01:39:59.241483+0000","last_clean":"2023-11-04T01:39:59.241483+0000","last_became_active":"2023-11-04T01:39:57.925338+0000","last_became_peered":"2023-11-04T01:39:57.925338+0000","last_unstale":"2023-11-04T01:39:59.241483+0000","last_undegraded":"2023-11-04T01:39:59.241483+0000","last_fullsized":"2023-11-04T01:39:59.241483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873396+0000","last_change":"2023-11-04T01:39:57.089157+0000","last_active":"2023-11-04T01:39:58.873396+0000","last_peered":"2023-11-04T01:39:58.873396+0000","last_clean":"2023-11-04T01:39:58.873396+0000","last_became_active":"2023-11-04T01:39:57.088373+0000","last_became_peered":"2023-11-04T01:39:57.088373+0000","last_unstale":"2023-11-04T01:39:58.873396+0000","last_undegraded":"2023-11-04T01:39:58.873396+0000","last_fullsized":"2023-11-04T01:39:58.873396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:19:10.666272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242512+0000","last_change":"2023-11-04T01:39:57.926318+0000","last_active":"2023-11-04T01:39:59.242512+0000","last_peered":"2023-11-04T01:39:59.242512+0000","last_clean":"2023-11-04T01:39:59.242512+0000","last_became_active":"2023-11-04T01:39:57.924998+0000","last_became_peered":"2023-11-04T01:39:57.924998+0000","last_unstale":"2023-11-04T01:39:59.242512+0000","last_undegraded":"2023-11-04T01:39:59.242512+0000","last_fullsized":"2023-11-04T01:39:59.242512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:56:37.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866744+0000","last_change":"2023-11-04T01:39:57.085866+0000","last_active":"2023-11-04T01:39:59.866744+0000","last_peered":"2023-11-04T01:39:59.866744+0000","last_clean":"2023-11-04T01:39:59.866744+0000","last_became_active":"2023-11-04T01:39:57.085501+0000","last_became_peered":"2023-11-04T01:39:57.085501+0000","last_unstale":"2023-11-04T01:39:59.866744+0000","last_undegraded":"2023-11-04T01:39:59.866744+0000","last_fullsized":"2023-11-04T01:39:59.866744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242796+0000","last_change":"2023-11-04T01:39:57.927164+0000","last_active":"2023-11-04T01:39:59.242796+0000","last_peered":"2023-11-04T01:39:59.242796+0000","last_clean":"2023-11-04T01:39:59.242796+0000","last_became_active":"2023-11-04T01:39:57.926817+0000","last_became_peered":"2023-11-04T01:39:57.926817+0000","last_unstale":"2023-11-04T01:39:59.242796+0000","last_undegraded":"2023-11-04T01:39:59.242796+0000","last_fullsized":"2023-11-04T01:39:59.242796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:14.194200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.869221+0000","last_change":"2023-11-04T01:39:57.088611+0000","last_active":"2023-11-04T01:39:58.869221+0000","last_peered":"2023-11-04T01:39:58.869221+0000","last_clean":"2023-11-04T01:39:58.869221+0000","last_became_active":"2023-11-04T01:39:57.088214+0000","last_became_peered":"2023-11-04T01:39:57.088214+0000","last_unstale":"2023-11-04T01:39:58.869221+0000","last_undegraded":"2023-11-04T01:39:58.869221+0000","last_fullsized":"2023-11-04T01:39:58.869221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873978+0000","last_change":"2023-11-04T01:39:57.916146+0000","last_active":"2023-11-04T01:39:58.873978+0000","last_peered":"2023-11-04T01:39:58.873978+0000","last_clean":"2023-11-04T01:39:58.873978+0000","last_became_active":"2023-11-04T01:39:57.914346+0000","last_became_peered":"2023-11-04T01:39:57.914346+0000","last_unstale":"2023-11-04T01:39:58.873978+0000","last_undegraded":"2023-11-04T01:39:58.873978+0000","last_fullsized":"2023-11-04T01:39:58.873978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.866304+0000","last_change":"2023-11-04T01:39:57.091428+0000","last_active":"2023-11-04T01:39:59.866304+0000","last_peered":"2023-11-04T01:39:59.866304+0000","last_clean":"2023-11-04T01:39:59.866304+0000","last_became_active":"2023-11-04T01:39:57.090767+0000","last_became_peered":"2023-11-04T01:39:57.090767+0000","last_unstale":"2023-11-04T01:39:59.866304+0000","last_undegraded":"2023-11-04T01:39:59.866304+0000","last_fullsized":"2023-11-04T01:39:59.866304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242170+0000","last_change":"2023-11-04T01:39:57.925040+0000","last_active":"2023-11-04T01:39:59.242170+0000","last_peered":"2023-11-04T01:39:59.242170+0000","last_clean":"2023-11-04T01:39:59.242170+0000","last_became_active":"2023-11-04T01:39:57.924201+0000","last_became_peered":"2023-11-04T01:39:57.924201+0000","last_unstale":"2023-11-04T01:39:59.242170+0000","last_undegraded":"2023-11-04T01:39:59.242170+0000","last_fullsized":"2023-11-04T01:39:59.242170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:39:57.898357+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:39:57.898357+0000","last_peered":"2023-11-04T01:39:57.898357+0000","last_clean":"2023-11-04T01:39:57.898357+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:39:57.898357+0000","last_undegraded":"2023-11-04T01:39:57.898357+0000","last_fullsized":"2023-11-04T01:39:57.898357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.871472+0000","last_change":"2023-11-04T01:39:57.093034+0000","last_active":"2023-11-04T01:39:58.871472+0000","last_peered":"2023-11-04T01:39:58.871472+0000","last_clean":"2023-11-04T01:39:58.871472+0000","last_became_active":"2023-11-04T01:39:57.092158+0000","last_became_peered":"2023-11-04T01:39:57.092158+0000","last_unstale":"2023-11-04T01:39:58.871472+0000","last_undegraded":"2023-11-04T01:39:58.871472+0000","last_fullsized":"2023-11-04T01:39:58.871472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869011+0000","last_change":"2023-11-04T01:39:57.899138+0000","last_active":"2023-11-04T01:39:59.869011+0000","last_peered":"2023-11-04T01:39:59.869011+0000","last_clean":"2023-11-04T01:39:59.869011+0000","last_became_active":"2023-11-04T01:39:57.898313+0000","last_became_peered":"2023-11-04T01:39:57.898313+0000","last_unstale":"2023-11-04T01:39:59.869011+0000","last_undegraded":"2023-11-04T01:39:59.869011+0000","last_fullsized":"2023-11-04T01:39:59.869011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241057+0000","last_change":"2023-11-04T01:39:57.119969+0000","last_active":"2023-11-04T01:39:59.241057+0000","last_peered":"2023-11-04T01:39:59.241057+0000","last_clean":"2023-11-04T01:39:59.241057+0000","last_became_active":"2023-11-04T01:39:57.118250+0000","last_became_peered":"2023-11-04T01:39:57.118250+0000","last_unstale":"2023-11-04T01:39:59.241057+0000","last_undegraded":"2023-11-04T01:39:59.241057+0000","last_fullsized":"2023-11-04T01:39:59.241057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:12.516847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865841+0000","last_change":"2023-11-04T01:39:57.888041+0000","last_active":"2023-11-04T01:39:59.865841+0000","last_peered":"2023-11-04T01:39:59.865841+0000","last_clean":"2023-11-04T01:39:59.865841+0000","last_became_active":"2023-11-04T01:39:57.887240+0000","last_became_peered":"2023-11-04T01:39:57.887240+0000","last_unstale":"2023-11-04T01:39:59.865841+0000","last_undegraded":"2023-11-04T01:39:59.865841+0000","last_fullsized":"2023-11-04T01:39:59.865841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:00.328908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.865848+0000","last_change":"2023-11-04T01:39:57.086891+0000","last_active":"2023-11-04T01:39:59.865848+0000","last_peered":"2023-11-04T01:39:59.865848+0000","last_clean":"2023-11-04T01:39:59.865848+0000","last_became_active":"2023-11-04T01:39:57.086482+0000","last_became_peered":"2023-11-04T01:39:57.086482+0000","last_unstale":"2023-11-04T01:39:59.865848+0000","last_undegraded":"2023-11-04T01:39:59.865848+0000","last_fullsized":"2023-11-04T01:39:59.865848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868387+0000","last_change":"2023-11-04T01:39:57.908737+0000","last_active":"2023-11-04T01:39:58.868387+0000","last_peered":"2023-11-04T01:39:58.868387+0000","last_clean":"2023-11-04T01:39:58.868387+0000","last_became_active":"2023-11-04T01:39:57.907965+0000","last_became_peered":"2023-11-04T01:39:57.907965+0000","last_unstale":"2023-11-04T01:39:58.868387+0000","last_undegraded":"2023-11-04T01:39:58.868387+0000","last_fullsized":"2023-11-04T01:39:58.868387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:19.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873025+0000","last_change":"2023-11-04T01:39:57.101402+0000","last_active":"2023-11-04T01:39:58.873025+0000","last_peered":"2023-11-04T01:39:58.873025+0000","last_clean":"2023-11-04T01:39:58.873025+0000","last_became_active":"2023-11-04T01:39:57.100736+0000","last_became_peered":"2023-11-04T01:39:57.100736+0000","last_unstale":"2023-11-04T01:39:58.873025+0000","last_undegraded":"2023-11-04T01:39:58.873025+0000","last_fullsized":"2023-11-04T01:39:58.873025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872956+0000","last_change":"2023-11-04T01:39:57.912134+0000","last_active":"2023-11-04T01:39:58.872956+0000","last_peered":"2023-11-04T01:39:58.872956+0000","last_clean":"2023-11-04T01:39:58.872956+0000","last_became_active":"2023-11-04T01:39:57.909396+0000","last_became_peered":"2023-11-04T01:39:57.909396+0000","last_unstale":"2023-11-04T01:39:58.872956+0000","last_undegraded":"2023-11-04T01:39:58.872956+0000","last_fullsized":"2023-11-04T01:39:58.872956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:36.494196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868443+0000","last_change":"2023-11-04T01:39:57.086794+0000","last_active":"2023-11-04T01:39:58.868443+0000","last_peered":"2023-11-04T01:39:58.868443+0000","last_clean":"2023-11-04T01:39:58.868443+0000","last_became_active":"2023-11-04T01:39:57.086448+0000","last_became_peered":"2023-11-04T01:39:57.086448+0000","last_unstale":"2023-11-04T01:39:58.868443+0000","last_undegraded":"2023-11-04T01:39:58.868443+0000","last_fullsized":"2023-11-04T01:39:58.868443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872724+0000","last_change":"2023-11-04T01:39:57.889388+0000","last_active":"2023-11-04T01:39:58.872724+0000","last_peered":"2023-11-04T01:39:58.872724+0000","last_clean":"2023-11-04T01:39:58.872724+0000","last_became_active":"2023-11-04T01:39:57.888326+0000","last_became_peered":"2023-11-04T01:39:57.888326+0000","last_unstale":"2023-11-04T01:39:58.872724+0000","last_undegraded":"2023-11-04T01:39:58.872724+0000","last_fullsized":"2023-11-04T01:39:58.872724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:58.690480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242500+0000","last_change":"2023-11-04T01:39:57.119606+0000","last_active":"2023-11-04T01:39:59.242500+0000","last_peered":"2023-11-04T01:39:59.242500+0000","last_clean":"2023-11-04T01:39:59.242500+0000","last_became_active":"2023-11-04T01:39:57.118501+0000","last_became_peered":"2023-11-04T01:39:57.118501+0000","last_unstale":"2023-11-04T01:39:59.242500+0000","last_undegraded":"2023-11-04T01:39:59.242500+0000","last_fullsized":"2023-11-04T01:39:59.242500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:42.136792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868674+0000","last_change":"2023-11-04T01:39:57.896425+0000","last_active":"2023-11-04T01:39:58.868674+0000","last_peered":"2023-11-04T01:39:58.868674+0000","last_clean":"2023-11-04T01:39:58.868674+0000","last_became_active":"2023-11-04T01:39:57.895472+0000","last_became_peered":"2023-11-04T01:39:57.895472+0000","last_unstale":"2023-11-04T01:39:58.868674+0000","last_undegraded":"2023-11-04T01:39:58.868674+0000","last_fullsized":"2023-11-04T01:39:58.868674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:40:00.228392+0000","last_change":"2023-11-04T01:39:57.102873+0000","last_active":"2023-11-04T01:40:00.228392+0000","last_peered":"2023-11-04T01:40:00.228392+0000","last_clean":"2023-11-04T01:40:00.228392+0000","last_became_active":"2023-11-04T01:39:57.102500+0000","last_became_peered":"2023-11-04T01:39:57.102500+0000","last_unstale":"2023-11-04T01:40:00.228392+0000","last_undegraded":"2023-11-04T01:40:00.228392+0000","last_fullsized":"2023-11-04T01:40:00.228392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869619+0000","last_change":"2023-11-04T01:39:57.920760+0000","last_active":"2023-11-04T01:39:59.869619+0000","last_peered":"2023-11-04T01:39:59.869619+0000","last_clean":"2023-11-04T01:39:59.869619+0000","last_became_active":"2023-11-04T01:39:57.920036+0000","last_became_peered":"2023-11-04T01:39:57.920036+0000","last_unstale":"2023-11-04T01:39:59.869619+0000","last_undegraded":"2023-11-04T01:39:59.869619+0000","last_fullsized":"2023-11-04T01:39:59.869619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:43.261421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867441+0000","last_change":"2023-11-04T01:39:57.119006+0000","last_active":"2023-11-04T01:39:59.867441+0000","last_peered":"2023-11-04T01:39:59.867441+0000","last_clean":"2023-11-04T01:39:59.867441+0000","last_became_active":"2023-11-04T01:39:57.118360+0000","last_became_peered":"2023-11-04T01:39:57.118360+0000","last_unstale":"2023-11-04T01:39:59.867441+0000","last_undegraded":"2023-11-04T01:39:59.867441+0000","last_fullsized":"2023-11-04T01:39:59.867441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:45.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867208+0000","last_change":"2023-11-04T01:39:57.899526+0000","last_active":"2023-11-04T01:39:59.867208+0000","last_peered":"2023-11-04T01:39:59.867208+0000","last_clean":"2023-11-04T01:39:59.867208+0000","last_became_active":"2023-11-04T01:39:57.898663+0000","last_became_peered":"2023-11-04T01:39:57.898663+0000","last_unstale":"2023-11-04T01:39:59.867208+0000","last_undegraded":"2023-11-04T01:39:59.867208+0000","last_fullsized":"2023-11-04T01:39:59.867208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:35.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.240990+0000","last_change":"2023-11-04T01:39:57.118965+0000","last_active":"2023-11-04T01:39:59.240990+0000","last_peered":"2023-11-04T01:39:59.240990+0000","last_clean":"2023-11-04T01:39:59.240990+0000","last_became_active":"2023-11-04T01:39:57.117428+0000","last_became_peered":"2023-11-04T01:39:57.117428+0000","last_unstale":"2023-11-04T01:39:59.240990+0000","last_undegraded":"2023-11-04T01:39:59.240990+0000","last_fullsized":"2023-11-04T01:39:59.240990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.932036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872736+0000","last_change":"2023-11-04T01:39:57.897837+0000","last_active":"2023-11-04T01:39:58.872736+0000","last_peered":"2023-11-04T01:39:58.872736+0000","last_clean":"2023-11-04T01:39:58.872736+0000","last_became_active":"2023-11-04T01:39:57.897180+0000","last_became_peered":"2023-11-04T01:39:57.897180+0000","last_unstale":"2023-11-04T01:39:58.872736+0000","last_undegraded":"2023-11-04T01:39:58.872736+0000","last_fullsized":"2023-11-04T01:39:58.872736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.657024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868796+0000","last_change":"2023-11-04T01:39:57.109529+0000","last_active":"2023-11-04T01:39:58.868796+0000","last_peered":"2023-11-04T01:39:58.868796+0000","last_clean":"2023-11-04T01:39:58.868796+0000","last_became_active":"2023-11-04T01:39:57.109076+0000","last_became_peered":"2023-11-04T01:39:57.109076+0000","last_unstale":"2023-11-04T01:39:58.868796+0000","last_undegraded":"2023-11-04T01:39:58.868796+0000","last_fullsized":"2023-11-04T01:39:58.868796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:09.540062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867468+0000","last_change":"2023-11-04T01:39:57.909590+0000","last_active":"2023-11-04T01:39:59.867468+0000","last_peered":"2023-11-04T01:39:59.867468+0000","last_clean":"2023-11-04T01:39:59.867468+0000","last_became_active":"2023-11-04T01:39:57.908648+0000","last_became_peered":"2023-11-04T01:39:57.908648+0000","last_unstale":"2023-11-04T01:39:59.867468+0000","last_undegraded":"2023-11-04T01:39:59.867468+0000","last_fullsized":"2023-11-04T01:39:59.867468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:44.946682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.868661+0000","last_change":"2023-11-04T01:39:57.090615+0000","last_active":"2023-11-04T01:39:58.868661+0000","last_peered":"2023-11-04T01:39:58.868661+0000","last_clean":"2023-11-04T01:39:58.868661+0000","last_became_active":"2023-11-04T01:39:57.090254+0000","last_became_peered":"2023-11-04T01:39:57.090254+0000","last_unstale":"2023-11-04T01:39:58.868661+0000","last_undegraded":"2023-11-04T01:39:58.868661+0000","last_fullsized":"2023-11-04T01:39:58.868661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:56.647088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869182+0000","last_change":"2023-11-04T01:39:57.919597+0000","last_active":"2023-11-04T01:39:59.869182+0000","last_peered":"2023-11-04T01:39:59.869182+0000","last_clean":"2023-11-04T01:39:59.869182+0000","last_became_active":"2023-11-04T01:39:57.918813+0000","last_became_peered":"2023-11-04T01:39:57.918813+0000","last_unstale":"2023-11-04T01:39:59.869182+0000","last_undegraded":"2023-11-04T01:39:59.869182+0000","last_fullsized":"2023-11-04T01:39:59.869182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:14.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241973+0000","last_change":"2023-11-04T01:39:57.122022+0000","last_active":"2023-11-04T01:39:59.241973+0000","last_peered":"2023-11-04T01:39:59.241973+0000","last_clean":"2023-11-04T01:39:59.241973+0000","last_became_active":"2023-11-04T01:39:57.121383+0000","last_became_peered":"2023-11-04T01:39:57.121383+0000","last_unstale":"2023-11-04T01:39:59.241973+0000","last_undegraded":"2023-11-04T01:39:59.241973+0000","last_fullsized":"2023-11-04T01:39:59.241973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:16.618048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867389+0000","last_change":"2023-11-04T01:39:57.904433+0000","last_active":"2023-11-04T01:39:59.867389+0000","last_peered":"2023-11-04T01:39:59.867389+0000","last_clean":"2023-11-04T01:39:59.867389+0000","last_became_active":"2023-11-04T01:39:57.903609+0000","last_became_peered":"2023-11-04T01:39:57.903609+0000","last_unstale":"2023-11-04T01:39:59.867389+0000","last_undegraded":"2023-11-04T01:39:59.867389+0000","last_fullsized":"2023-11-04T01:39:59.867389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:08.470369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.872398+0000","last_change":"2023-11-04T01:39:57.887415+0000","last_active":"2023-11-04T01:39:58.872398+0000","last_peered":"2023-11-04T01:39:58.872398+0000","last_clean":"2023-11-04T01:39:58.872398+0000","last_became_active":"2023-11-04T01:39:57.886545+0000","last_became_peered":"2023-11-04T01:39:57.886545+0000","last_unstale":"2023-11-04T01:39:58.872398+0000","last_undegraded":"2023-11-04T01:39:58.872398+0000","last_fullsized":"2023-11-04T01:39:58.872398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:06.291423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.241975+0000","last_change":"2023-11-04T01:39:57.117914+0000","last_active":"2023-11-04T01:39:59.241975+0000","last_peered":"2023-11-04T01:39:59.241975+0000","last_clean":"2023-11-04T01:39:59.241975+0000","last_became_active":"2023-11-04T01:39:57.117315+0000","last_became_peered":"2023-11-04T01:39:57.117315+0000","last_unstale":"2023-11-04T01:39:59.241975+0000","last_undegraded":"2023-11-04T01:39:59.241975+0000","last_fullsized":"2023-11-04T01:39:59.241975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:35.484260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:58.873666+0000","last_change":"2023-11-04T01:39:57.890838+0000","last_active":"2023-11-04T01:39:58.873666+0000","last_peered":"2023-11-04T01:39:58.873666+0000","last_clean":"2023-11-04T01:39:58.873666+0000","last_became_active":"2023-11-04T01:39:57.890240+0000","last_became_peered":"2023-11-04T01:39:57.890240+0000","last_unstale":"2023-11-04T01:39:58.873666+0000","last_undegraded":"2023-11-04T01:39:58.873666+0000","last_fullsized":"2023-11-04T01:39:58.873666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:32.739678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.242364+0000","last_change":"2023-11-04T01:39:57.119136+0000","last_active":"2023-11-04T01:39:59.242364+0000","last_peered":"2023-11-04T01:39:59.242364+0000","last_clean":"2023-11-04T01:39:59.242364+0000","last_became_active":"2023-11-04T01:39:57.117698+0000","last_became_peered":"2023-11-04T01:39:57.117698+0000","last_unstale":"2023-11-04T01:39:59.242364+0000","last_undegraded":"2023-11-04T01:39:59.242364+0000","last_fullsized":"2023-11-04T01:39:59.242364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:36.706962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.867841+0000","last_change":"2023-11-04T01:39:57.891105+0000","last_active":"2023-11-04T01:39:59.867841+0000","last_peered":"2023-11-04T01:39:59.867841+0000","last_clean":"2023-11-04T01:39:59.867841+0000","last_became_active":"2023-11-04T01:39:57.890260+0000","last_became_peered":"2023-11-04T01:39:57.890260+0000","last_unstale":"2023-11-04T01:39:59.867841+0000","last_undegraded":"2023-11-04T01:39:59.867841+0000","last_fullsized":"2023-11-04T01:39:59.867841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:40:52.724736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869471+0000","last_change":"2023-11-04T01:39:57.086637+0000","last_active":"2023-11-04T01:39:59.869471+0000","last_peered":"2023-11-04T01:39:59.869471+0000","last_clean":"2023-11-04T01:39:59.869471+0000","last_became_active":"2023-11-04T01:39:57.086227+0000","last_became_peered":"2023-11-04T01:39:57.086227+0000","last_unstale":"2023-11-04T01:39:59.869471+0000","last_undegraded":"2023-11-04T01:39:59.869471+0000","last_fullsized":"2023-11-04T01:39:59.869471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:42:34.010007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.869390+0000","last_change":"2023-11-04T01:39:57.910463+0000","last_active":"2023-11-04T01:39:59.869390+0000","last_peered":"2023-11-04T01:39:59.869390+0000","last_clean":"2023-11-04T01:39:59.869390+0000","last_became_active":"2023-11-04T01:39:57.909626+0000","last_became_peered":"2023-11-04T01:39:57.909626+0000","last_unstale":"2023-11-04T01:39:59.869390+0000","last_undegraded":"2023-11-04T01:39:59.869390+0000","last_fullsized":"2023-11-04T01:39:59.869390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:57.051939+0000","last_clean_scrub_stamp":"2023-11-04T01:39:57.051939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:27.454902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:39:59.868143+0000","last_change":"2023-11-04T01:39:57.110005+0000","last_active":"2023-11-04T01:39:59.868143+0000","last_peered":"2023-11-04T01:39:59.868143+0000","last_clean":"2023-11-04T01:39:59.868143+0000","last_became_active":"2023-11-04T01:39:57.109526+0000","last_became_peered":"2023-11-04T01:39:57.109526+0000","last_unstale":"2023-11-04T01:39:59.868143+0000","last_undegraded":"2023-11-04T01:39:59.868143+0000","last_fullsized":"2023-11-04T01:39:59.868143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:56.042003+0000","last_clean_scrub_stamp":"2023-11-04T01:39:56.042003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:58.246280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:10.233 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T01:40:10.233 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T01:40:10.234 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T01:40:10.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T01:40:10.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 Processor -- start 2023-11-04T01:40:10.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 -- start start 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff80c06baa0 0x7ff80c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff80c0cb9e0 0x7ff80c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c071450 con 0x7ff80c144500 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c0cbe30 con 0x7ff80c0cb9e0 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff813da7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c0ce8a0 con 0x7ff80c06baa0 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff812344640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff80c0cb9e0 0x7ff80c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff811b43640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff80c144500 0x7ff80c15bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41168/0 (socket says 172.21.15.40:41168) 2023-11-04T01:40:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff811b43640 1 -- 172.21.15.40:0/285212432 learned_addr learned my addr 172.21.15.40:0/285212432 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff812344640 1 -- 172.21.15.40:0/285212432 >> v2:172.21.15.91:3300/0 conn(0x7ff80c06baa0 msgr2=0x7ff80c0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff812344640 1 --2- 172.21.15.40:0/285212432 >> v2:172.21.15.91:3300/0 conn(0x7ff80c06baa0 0x7ff80c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff812344640 1 -- 172.21.15.40:0/285212432 >> v1:172.21.15.40:6789/0 conn(0x7ff80c144500 legacy=0x7ff80c15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff810b41640 1 -- 172.21.15.40:0/285212432 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889517608 0 0) 0x7ff80c071450 con 0x7ff80c144500 2023-11-04T01:40:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.388+0000 7ff812344640 1 -- 172.21.15.40:0/285212432 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c071cd0 con 0x7ff80c0cb9e0 2023-11-04T01:40:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff812344640 1 --2- 172.21.15.40:0/285212432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c0cb9e0 0x7ff80c0ccd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff80c06dee0 tx=0x7ff80401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd923a992061887 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff810b41640 1 -- 172.21.15.40:0/285212432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040a59a0 con 0x7ff80c0cb9e0 2023-11-04T01:40:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff810b41640 1 -- 172.21.15.40:0/285212432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8040a5b00 con 0x7ff80c0cb9e0 2023-11-04T01:40:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff810b41640 1 -- 172.21.15.40:0/285212432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040a5e90 con 0x7ff80c0cb9e0 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 -- 172.21.15.40:0/285212432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c0cb9e0 msgr2=0x7ff80c0ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 --2- 172.21.15.40:0/285212432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c0cb9e0 0x7ff80c0ccd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff80c06dee0 tx=0x7ff80401c8e0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 -- 172.21.15.40:0/285212432 shutdown_connections 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 --2- 172.21.15.40:0/285212432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c0cb9e0 0x7ff80c0ccd00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 --2- 172.21.15.40:0/285212432 >> v2:172.21.15.91:3300/0 conn(0x7ff80c06baa0 0x7ff80c0cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 -- 172.21.15.40:0/285212432 >> 172.21.15.40:0/285212432 conn(0x7ff80c0b07d0 msgr2=0x7ff80c0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 -- 172.21.15.40:0/285212432 shutdown_connections 2023-11-04T01:40:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 -- 172.21.15.40:0/285212432 wait complete. 2023-11-04T01:40:10.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 Processor -- start 2023-11-04T01:40:10.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.392+0000 7ff813da7640 1 -- start start 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 0x7ff80c163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff80c0cb9e0 0x7ff80c13f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff80c144500 0x7ff80c1f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1f3ec0 con 0x7ff80c06baa0 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c13e160 con 0x7ff80c144500 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1f40d0 con 0x7ff80c0cb9e0 2023-11-04T01:40:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 0x7ff80c163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 0x7ff80c163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56920/0 (socket says 172.21.15.40:56920) 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 -- 172.21.15.40:0/2140857585 learned_addr learned my addr 172.21.15.40:0/2140857585 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811342640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff80c0cb9e0 0x7ff80c13f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff812344640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff80c144500 0x7ff80c1f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 -- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff80c0cb9e0 msgr2=0x7ff80c13f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff80c0cb9e0 0x7ff80c13f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 -- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff80c144500 msgr2=0x7ff80c1f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff80c144500 0x7ff80c1f3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 -- 172.21.15.40:0/2140857585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804009a70 con 0x7ff80c06baa0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff811b43640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 0x7ff80c163920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8080011f0 tx=0x7ff80800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080074e0 con 0x7ff80c06baa0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff808007640 con 0x7ff80c06baa0 2023-11-04T01:40:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c1f43b0 con 0x7ff80c06baa0 2023-11-04T01:40:10.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808004a10 con 0x7ff80c06baa0 2023-11-04T01:40:10.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c1f4970 con 0x7ff80c06baa0 2023-11-04T01:40:10.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c13e2f0 con 0x7ff80c06baa0 2023-11-04T01:40:10.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff808004b70 con 0x7ff80c06baa0 2023-11-04T01:40:10.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff8027fc640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7f00664a0 0x7ff7f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.396+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8080835d0 con 0x7ff80c06baa0 2023-11-04T01:40:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.400+0000 7ff811342640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7f00664a0 0x7ff7f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.400+0000 7ff811342640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7f00664a0 0x7ff7f0068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.400+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff808050a50 con 0x7ff80c06baa0 2023-11-04T01:40:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff80c074510 con 0x7ff80c06baa0 2023-11-04T01:40:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff8027fc640 1 -- 172.21.15.40:0/2140857585 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff808018080 con 0x7ff80c06baa0 2023-11-04T01:40:10.587 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:10.588 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T01:40:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7f00664a0 msgr2=0x7ff7f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7f00664a0 0x7ff7f0068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 msgr2=0x7ff80c163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 0x7ff80c163920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff8080011f0 tx=0x7ff80800c9b0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 shutdown_connections 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7f00664a0 0x7ff7f0068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff80c144500 0x7ff80c1f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff80c0cb9e0 0x7ff80c13f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 --2- 172.21.15.40:0/2140857585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff80c06baa0 0x7ff80c163920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.584+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 >> 172.21.15.40:0/2140857585 conn(0x7ff80c0b07d0 msgr2=0x7ff80c15bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.588+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 shutdown_connections 2023-11-04T01:40:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.588+0000 7ff813da7640 1 -- 172.21.15.40:0/2140857585 wait complete. 2023-11-04T01:40:10.605 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T01:40:10.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:10.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28eb663640 1 Processor -- start 2023-11-04T01:40:10.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28eb663640 1 -- start start 2023-11-04T01:40:10.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28eb663640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 0x7f28e40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28eb663640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40cdc80 con 0x7f28e40b1d40 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28eb663640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40cf5a0 con 0x7f28e415cd60 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28eb663640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4071e40 con 0x7f28e40b1960 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e8bfe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f28e40b1d40 0x7f28e40ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41180/0 (socket says 172.21.15.40:41180) 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e8bfe640 1 -- 172.21.15.40:0/3048215438 learned_addr learned my addr 172.21.15.40:0/3048215438 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 0x7f28e40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524657508 0 0) 0x7f28e40cdc80 con 0x7f28e40b1d40 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0003530 con 0x7f28e40b1d40 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165544016 0 0) 0x7f28d0003530 con 0x7f28e40b1d40 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 msgr2=0x7f28e40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 0x7f28e40cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 >> v1:172.21.15.91:6789/0 conn(0x7f28e415cd60 legacy=0x7f28e406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40cf880 con 0x7f28e40b1d40 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f28d40016a0 con 0x7f28e40b1d40 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 >> v1:172.21.15.40:6789/0 conn(0x7f28e40b1d40 legacy=0x7f28e40ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 0x7f28d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28d0004d10 0x7f28d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4071e40 con 0x7f28d00039b0 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000ba70 con 0x7f28d0004d10 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000bc30 con 0x7f28e40b1960 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 -- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 msgr2=0x7f28d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e40b1960 0x7f28d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 -- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28d0004d10 msgr2=0x7f28d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28d0004d10 0x7f28d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.724+0000 7f28e93ff640 1 -- 172.21.15.40:0/3048215438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0003530 con 0x7f28d00039b0 2023-11-04T01:40:10.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28e93ff640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28d0003dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009f90 tx=0x7f28e001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b831b974b2af30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e00a5b30 con 0x7f28d00039b0 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000f040 con 0x7f28d00039b0 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28dbfff640 1 -- 172.21.15.40:0/3048215438 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e00ad440 con 0x7f28d00039b0 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- 172.21.15.40:0/3048215438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 msgr2=0x7f28d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 --2- 172.21.15.40:0/3048215438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28d0003dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009f90 tx=0x7f28e001cc30 comp rx=0 tx=0).stop 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28e9c00640 1 -- 172.21.15.40:0/3048215438 reap_dead start 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- 172.21.15.40:0/3048215438 shutdown_connections 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- 172.21.15.40:0/3048215438 >> 172.21.15.40:0/3048215438 conn(0x7f28e406e760 msgr2=0x7f28e406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- 172.21.15.40:0/3048215438 shutdown_connections 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- 172.21.15.40:0/3048215438 wait complete. 2023-11-04T01:40:10.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 Processor -- start 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- start start 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28e4158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28e415d170 0x7f28e415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e415f080 0x7f28e415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40c74a0 con 0x7f28d00039b0 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e415db30 con 0x7f28e415d170 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28eb663640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e415ffd0 con 0x7f28e415f080 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28e93ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28e4158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28e93ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28e4158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56940/0 (socket says 172.21.15.40:56940) 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.728+0000 7f28e93ff640 1 -- 172.21.15.40:0/453150685 learned_addr learned my addr 172.21.15.40:0/453150685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e9c00640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e415f080 0x7f28e415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e8bfe640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28e415d170 0x7f28e415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e93ff640 1 -- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e415f080 msgr2=0x7f28e415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e93ff640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e415f080 0x7f28e415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e93ff640 1 -- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28e415d170 msgr2=0x7f28e415d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e93ff640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28e415d170 0x7f28e415d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e93ff640 1 -- 172.21.15.40:0/453150685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e414e970 con 0x7f28d00039b0 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e9c00640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e415f080 0x7f28e415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e8bfe640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28e415d170 0x7f28e415d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e93ff640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28e4158930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28e001ca60 tx=0x7f28e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e00ad640 con 0x7f28d00039b0 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e00ad7a0 con 0x7f28d00039b0 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e415fa40 con 0x7f28d00039b0 2023-11-04T01:40:10.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e00adb30 con 0x7f28d00039b0 2023-11-04T01:40:10.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e40c6de0 con 0x7f28d00039b0 2023-11-04T01:40:10.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e40c6c40 con 0x7f28d00039b0 2023-11-04T01:40:10.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28e00b4040 con 0x7f28d00039b0 2023-11-04T01:40:10.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28d9ffb640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28c80664d0 0x7f28c8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28e011e560 con 0x7f28d00039b0 2023-11-04T01:40:10.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e8bfe640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28c80664d0 0x7f28c8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.732+0000 7f28e8bfe640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28c80664d0 0x7f28c8068990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28e40c94e0 tx=0x7f28d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.736+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28e40c6c40 con 0x7f28d00039b0 2023-11-04T01:40:10.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.884+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e40c6c40 con 0x7f28d00039b0 2023-11-04T01:40:10.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28d9ffb640 1 -- 172.21.15.40:0/453150685 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f28e40c6c40 con 0x7f28d00039b0 2023-11-04T01:40:10.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:10.891 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28c80664d0 msgr2=0x7f28c8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28c80664d0 0x7f28c8068990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28e40c94e0 tx=0x7f28d4009040 comp rx=0 tx=0).stop 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 msgr2=0x7f28e4158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28e4158930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28e001ca60 tx=0x7f28e0009750 comp rx=0 tx=0).stop 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 shutdown_connections 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28c80664d0 0x7f28c8068990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28e415f080 0x7f28e415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28e415d170 0x7f28e415d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 --2- 172.21.15.40:0/453150685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28d00039b0 0x7f28e4158930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 >> 172.21.15.40:0/453150685 conn(0x7f28e406e760 msgr2=0x7f28e4168660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 shutdown_connections 2023-11-04T01:40:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:10.888+0000 7f28eb663640 1 -- 172.21.15.40:0/453150685 wait complete. 2023-11-04T01:40:10.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:10.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:11.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc969a4a640 1 Processor -- start 2023-11-04T01:40:11.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc969a4a640 1 -- start start 2023-11-04T01:40:11.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc969a4a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc96415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc969a4a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640cb130 con 0x7fc9640b0c20 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc969a4a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96415b680 con 0x7fc96415acb0 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc969a4a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96415bd40 con 0x7fc96415c160 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc9640b0c20 0x7fc9640ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41186/0 (socket says 172.21.15.40:41186) 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 -- 172.21.15.40:0/2060346175 learned_addr learned my addr 172.21.15.40:0/2060346175 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9637fe640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc96415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526682504 0 0) 0x7fc9640cb130 con 0x7fc9640b0c20 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc950003530 con 0x7fc9640b0c20 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 745527267 0 0) 0x7fc950003530 con 0x7fc9640b0c20 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 msgr2=0x7fc96415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc96415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 >> v1:172.21.15.91:6789/0 conn(0x7fc96415acb0 legacy=0x7fc9640b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96415b960 con 0x7fc9640b0c20 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fc94c001680 con 0x7fc9640b0c20 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9637fe640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc96415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 >> v1:172.21.15.40:6789/0 conn(0x7fc9640b0c20 legacy=0x7fc9640ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500039b0 0x7fc950003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc950005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96415bd40 con 0x7fc9500047d0 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95000ba40 con 0x7fc9500039b0 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95000bbd0 con 0x7fc96415c160 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc9637fe640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc950005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc962ffd640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500039b0 0x7fc950003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 -- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 msgr2=0x7fc950005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc96415c160 0x7fc950005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 -- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500039b0 msgr2=0x7fc950003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500039b0 0x7fc950003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.028+0000 7fc95bfff640 1 -- 172.21.15.40:0/2060346175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009a70 con 0x7fc9500047d0 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc95bfff640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c190 tx=0x7fc94c01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccfa95897b2f1b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c005ae0 con 0x7fc9500047d0 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c0ab070 con 0x7fc9500047d0 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9627fc640 1 -- 172.21.15.40:0/2060346175 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c005e80 con 0x7fc9500047d0 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- 172.21.15.40:0/2060346175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9500047d0 msgr2=0x7fc950004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 --2- 172.21.15.40:0/2060346175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9500047d0 0x7fc950004c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00c190 tx=0x7fc94c01f330 comp rx=0 tx=0).stop 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9637fe640 1 -- 172.21.15.40:0/2060346175 reap_dead start 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- 172.21.15.40:0/2060346175 shutdown_connections 2023-11-04T01:40:11.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- 172.21.15.40:0/2060346175 >> 172.21.15.40:0/2060346175 conn(0x7fc9640cb510 msgr2=0x7fc9640cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- 172.21.15.40:0/2060346175 shutdown_connections 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- 172.21.15.40:0/2060346175 wait complete. 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 Processor -- start 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- start start 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500047d0 0x7fc9641f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9641f1680 0x7fc964157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 0x7fc9640cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641f1260 con 0x7fc9640a86e0 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641f0960 con 0x7fc9500047d0 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc969a4a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964158480 con 0x7fc9641f1680 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 0x7fc9640cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 0x7fc9640cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56950/0 (socket says 172.21.15.40:56950) 2023-11-04T01:40:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc9637fe640 1 -- 172.21.15.40:0/273510711 learned_addr learned my addr 172.21.15.40:0/273510711 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc962ffd640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500047d0 0x7fc9641f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.032+0000 7fc95bfff640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9641f1680 0x7fc964157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc9637fe640 1 -- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9641f1680 msgr2=0x7fc964157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc9637fe640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9641f1680 0x7fc964157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc9637fe640 1 -- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500047d0 msgr2=0x7fc9641f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc9637fe640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500047d0 0x7fc9641f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc9637fe640 1 -- 172.21.15.40:0/273510711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640a8f30 con 0x7fc9640a86e0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc9637fe640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 0x7fc9640cc990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9640ae4c0 tx=0x7fc95c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00e070 con 0x7fc9640a86e0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0039a0 con 0x7fc9640a86e0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640a9210 con 0x7fc9640a86e0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c003b50 con 0x7fc9640a86e0 2023-11-04T01:40:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9641f0e80 con 0x7fc9640a86e0 2023-11-04T01:40:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9641f13a0 con 0x7fc9640a86e0 2023-11-04T01:40:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc95c003cb0 con 0x7fc9640a86e0 2023-11-04T01:40:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc960ff9640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9440664a0 0x7fc944068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc95c084670 con 0x7fc9640a86e0 2023-11-04T01:40:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc962ffd640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9440664a0 0x7fc944068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.036+0000 7fc962ffd640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9440664a0 0x7fc944068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9640cd670 tx=0x7fc954009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.040+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc9641f13a0 con 0x7fc9640a86e0 2023-11-04T01:40:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.192+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9641f13a0 con 0x7fc9640a86e0 2023-11-04T01:40:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.196+0000 7fc960ff9640 1 -- 172.21.15.40:0/273510711 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9641f13a0 con 0x7fc9640a86e0 2023-11-04T01:40:11.200 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:11.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9440664a0 msgr2=0x7fc944068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9440664a0 0x7fc944068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9640cd670 tx=0x7fc954009040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 msgr2=0x7fc9640cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 0x7fc9640cc990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9640ae4c0 tx=0x7fc95c011890 comp rx=0 tx=0).stop 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 shutdown_connections 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9440664a0 0x7fc944068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640a86e0 0x7fc9640cc990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9641f1680 0x7fc964157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 --2- 172.21.15.40:0/273510711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9500047d0 0x7fc9641f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 >> 172.21.15.40:0/273510711 conn(0x7fc9640cb510 msgr2=0x7fc9640ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 shutdown_connections 2023-11-04T01:40:11.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.200+0000 7fc969a4a640 1 -- 172.21.15.40:0/273510711 wait complete. 2023-11-04T01:40:11.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:11.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.328+0000 7ff860da0640 1 Processor -- start 2023-11-04T01:40:11.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.328+0000 7ff860da0640 1 -- start start 2023-11-04T01:40:11.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c15d0b0 0x7ff85c160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff85c1610f0 0x7ff85c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff85c0cfd50 0x7ff85c0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c0d1520 con 0x7ff85c0cfd50 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c0d01e0 con 0x7ff85c1610f0 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0b5e00 con 0x7ff85c15d0b0 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff85c0cfd50 0x7ff85c0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff85c0cfd50 0x7ff85c0b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56966/0 (socket says 172.21.15.40:56966) 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 -- 172.21.15.40:0/2607588674 learned_addr learned my addr 172.21.15.40:0/2607588674 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85a59c640 1 --2- 172.21.15.40:0/2607588674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c15d0b0 0x7ff85c160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff859d9b640 1 --2- 172.21.15.40:0/2607588674 >> v2:172.21.15.91:3300/0 conn(0x7ff85c1610f0 0x7ff85c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 -- 172.21.15.40:0/2607588674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c15d0b0 msgr2=0x7ff85c160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 --2- 172.21.15.40:0/2607588674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c15d0b0 0x7ff85c160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 -- 172.21.15.40:0/2607588674 >> v2:172.21.15.91:3300/0 conn(0x7ff85c1610f0 msgr2=0x7ff85c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 --2- 172.21.15.40:0/2607588674 >> v2:172.21.15.91:3300/0 conn(0x7ff85c1610f0 0x7ff85c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 -- 172.21.15.40:0/2607588674 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c15d490 con 0x7ff85c0cfd50 2023-11-04T01:40:11.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff859d9b640 1 --2- 172.21.15.40:0/2607588674 >> v2:172.21.15.91:3300/0 conn(0x7ff85c1610f0 0x7ff85c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85ad9d640 1 --2- 172.21.15.40:0/2607588674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c0b48c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0b5940 tx=0x7ff85401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b99558df11ac302 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85959a640 1 -- 172.21.15.40:0/2607588674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8540a64b0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85959a640 1 -- 172.21.15.40:0/2607588674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8540a6610 con 0x7ff85c0cfd50 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff85959a640 1 -- 172.21.15.40:0/2607588674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8540a69a0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- 172.21.15.40:0/2607588674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 msgr2=0x7ff85c0b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- 172.21.15.40:0/2607588674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c0b48c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0b5940 tx=0x7ff85401c710 comp rx=0 tx=0).stop 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- 172.21.15.40:0/2607588674 shutdown_connections 2023-11-04T01:40:11.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- 172.21.15.40:0/2607588674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c0b48c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- 172.21.15.40:0/2607588674 >> v2:172.21.15.91:3300/0 conn(0x7ff85c1610f0 0x7ff85c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 --2- 172.21.15.40:0/2607588674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c15d0b0 0x7ff85c160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- 172.21.15.40:0/2607588674 >> 172.21.15.40:0/2607588674 conn(0x7ff85c06a890 msgr2=0x7ff85c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- 172.21.15.40:0/2607588674 shutdown_connections 2023-11-04T01:40:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.332+0000 7ff860da0640 1 -- 172.21.15.40:0/2607588674 wait complete. 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 Processor -- start 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- start start 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c15b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff85c15d0b0 0x7ff85c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c1610f0 0x7ff85c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0c9f10 con 0x7ff85c0cfd50 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0d2190 con 0x7ff85c15d0b0 2023-11-04T01:40:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c0caca0 con 0x7ff85c1610f0 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c15b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56980/0 (socket says 172.21.15.40:56980) 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 -- 172.21.15.40:0/4071800805 learned_addr learned my addr 172.21.15.40:0/4071800805 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85ad9d640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c1610f0 0x7ff85c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff859d9b640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff85c15d0b0 0x7ff85c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 -- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c1610f0 msgr2=0x7ff85c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c1610f0 0x7ff85c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 -- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff85c15d0b0 msgr2=0x7ff85c15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff85c15d0b0 0x7ff85c15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 -- 172.21.15.40:0/4071800805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff854009b30 con 0x7ff85c0cfd50 2023-11-04T01:40:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff85a59c640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c15b1b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00d830 tx=0x7ff84c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0096a0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c009800 con 0x7ff85c0cfd50 2023-11-04T01:40:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c0ca160 con 0x7ff85c0cfd50 2023-11-04T01:40:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c009b70 con 0x7ff85c0cfd50 2023-11-04T01:40:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c0ca8c0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c0744a0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.336+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff84c014410 con 0x7ff85c0cfd50 2023-11-04T01:40:11.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.340+0000 7ff84affd640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff83c0664a0 0x7ff83c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.340+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff84c0847a0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.340+0000 7ff859d9b640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff83c0664a0 0x7ff83c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.340+0000 7ff859d9b640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff83c0664a0 0x7ff83c068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff850006fd0 tx=0x7ff850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.344+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff84c051cb0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.492+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff85c0d0a10 con 0x7ff85c0cfd50 2023-11-04T01:40:11.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.492+0000 7ff84affd640 1 -- 172.21.15.40:0/4071800805 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff84c0552d0 con 0x7ff85c0cfd50 2023-11-04T01:40:11.497 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff83c0664a0 msgr2=0x7ff83c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff83c0664a0 0x7ff83c068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff850006fd0 tx=0x7ff850008040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 msgr2=0x7ff85c15b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c15b1b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00d830 tx=0x7ff84c00dcf0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 shutdown_connections 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff83c0664a0 0x7ff83c068960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff85c1610f0 0x7ff85c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff85c15d0b0 0x7ff85c15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 --2- 172.21.15.40:0/4071800805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85c0cfd50 0x7ff85c15b1b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 >> 172.21.15.40:0/4071800805 conn(0x7ff85c06a890 msgr2=0x7ff85c0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 shutdown_connections 2023-11-04T01:40:11.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.496+0000 7ff860da0640 1 -- 172.21.15.40:0/4071800805 wait complete. 2023-11-04T01:40:11.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:11.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf218fc640 1 Processor -- start 2023-11-04T01:40:11.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf218fc640 1 -- start start 2023-11-04T01:40:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf218fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 0x7fbf1c0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf218fc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0b5e00 con 0x7fbf1c15d0b0 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf218fc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0d0190 con 0x7fbf1c0d1940 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf218fc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0d1520 con 0x7fbf1c0cf810 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbf1c15d0b0 0x7fbf1c160bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41202/0 (socket says 172.21.15.40:41202) 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1affd640 1 -- 172.21.15.40:0/446949874 learned_addr learned my addr 172.21.15.40:0/446949874 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1a7fc640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 0x7fbf1c0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372539189 0 0) 0x7fbf1c0b5e00 con 0x7fbf1c15d0b0 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf08003530 con 0x7fbf1c15d0b0 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118971766 0 0) 0x7fbf08003530 con 0x7fbf1c15d0b0 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 msgr2=0x7fbf1c0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 0x7fbf1c0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 >> v1:172.21.15.91:6789/0 conn(0x7fbf1c0d1940 legacy=0x7fbf1c0d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c15d490 con 0x7fbf1c15d0b0 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fbf0c001a00 con 0x7fbf1c15d0b0 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 >> v1:172.21.15.40:6789/0 conn(0x7fbf1c15d0b0 legacy=0x7fbf1c160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 0x7fbf080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf08003f30 0x7fbf080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf08004d10 0x7fbf08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0d1520 con 0x7fbf08004d10 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0800ba70 con 0x7fbf08003f30 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0800bc30 con 0x7fbf1c0cf810 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf08004d10 0x7fbf08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1a7fc640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf08003f30 0x7fbf080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1affd640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 0x7fbf080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 msgr2=0x7fbf080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf1c0cf810 0x7fbf080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf08003f30 msgr2=0x7fbf080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf08003f30 0x7fbf080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.640+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/446949874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08003530 con 0x7fbf08004d10 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf08004d10 0x7fbf08005190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf14001780 tx=0x7fbf1401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978c96183f745394 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140052d0 con 0x7fbf08004d10 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140a7050 con 0x7fbf08004d10 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf19ffb640 1 -- 172.21.15.40:0/446949874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14003600 con 0x7fbf08004d10 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- 172.21.15.40:0/446949874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf08004d10 msgr2=0x7fbf08005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 --2- 172.21.15.40:0/446949874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf08004d10 0x7fbf08005190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf14001780 tx=0x7fbf1401c400 comp rx=0 tx=0).stop 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/446949874 reap_dead start 2023-11-04T01:40:11.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- 172.21.15.40:0/446949874 shutdown_connections 2023-11-04T01:40:11.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- 172.21.15.40:0/446949874 >> 172.21.15.40:0/446949874 conn(0x7fbf1c06a890 msgr2=0x7fbf1c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- 172.21.15.40:0/446949874 shutdown_connections 2023-11-04T01:40:11.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- 172.21.15.40:0/446949874 wait complete. 2023-11-04T01:40:11.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 Processor -- start 2023-11-04T01:40:11.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- start start 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf08004d10 0x7fbf1c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf1c0b3000 0x7fbf1c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 0x7fbf1c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0cac30 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0b5770 con 0x7fbf1c0b3000 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf218fc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0c9fb0 con 0x7fbf08004d10 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 0x7fbf1c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 0x7fbf1c0b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56984/0 (socket says 172.21.15.40:56984) 2023-11-04T01:40:11.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/1558923492 learned_addr learned my addr 172.21.15.40:0/1558923492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.644+0000 7fbf1affd640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf08004d10 0x7fbf1c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1a7fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf1c0b3000 0x7fbf1c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf08004d10 msgr2=0x7fbf1c1513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf08004d10 0x7fbf1c1513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf1c0b3000 msgr2=0x7fbf1c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf1c0b3000 0x7fbf1c0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1b7fe640 1 -- 172.21.15.40:0/1558923492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0ca290 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1affd640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf08004d10 0x7fbf1c1513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1b7fe640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 0x7fbf1c0b5230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf1401c8e0 tx=0x7fbf08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14007a40 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14007500 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c0ca570 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140069e0 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c151920 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c0cad70 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf14006b40 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf13fff640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbefc0664a0 0x7fbefc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf1411e2d0 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1affd640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbefc0664a0 0x7fbefc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.648+0000 7fbf1affd640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbefc0664a0 0x7fbefc068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0013e0 tx=0x7fbf0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.652+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf1c0cad70 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf1c0cad70 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf13fff640 1 -- 172.21.15.40:0/1558923492 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf1c0cad70 con 0x7fbf1c0b4da0 2023-11-04T01:40:11.806 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:11.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbefc0664a0 msgr2=0x7fbefc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbefc0664a0 0x7fbefc068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0013e0 tx=0x7fbf0c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 msgr2=0x7fbf1c0b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 0x7fbf1c0b5230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf1401c8e0 tx=0x7fbf08005800 comp rx=0 tx=0).stop 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 shutdown_connections 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbefc0664a0 0x7fbefc068960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1c0b4da0 0x7fbf1c0b5230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf1c0b3000 0x7fbf1c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 --2- 172.21.15.40:0/1558923492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf08004d10 0x7fbf1c1513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 >> 172.21.15.40:0/1558923492 conn(0x7fbf1c06a890 msgr2=0x7fbf1c0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 shutdown_connections 2023-11-04T01:40:11.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.804+0000 7fbf218fc640 1 -- 172.21.15.40:0/1558923492 wait complete. 2023-11-04T01:40:11.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.940+0000 7ff191994640 1 Processor -- start 2023-11-04T01:40:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.940+0000 7ff191994640 1 -- start start 2023-11-04T01:40:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff18c0b1960 0x7ff18c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff18c0b1d40 0x7ff18c0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0cdc80 con 0x7ff18c15cd60 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c071e40 con 0x7ff18c0b1960 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0ca700 con 0x7ff18c0b1d40 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff18c0b1960 0x7ff18c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff18c15cd60 0x7ff18c15d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41216/0 (socket says 172.21.15.40:41216) 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18b7fe640 1 -- 172.21.15.40:0/3783436200 learned_addr learned my addr 172.21.15.40:0/3783436200 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18a7fc640 1 --2- 172.21.15.40:0/3783436200 >> v2:172.21.15.91:3300/0 conn(0x7ff18c0b1d40 0x7ff18c0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18affd640 1 -- 172.21.15.40:0/3783436200 >> v2:172.21.15.91:3300/0 conn(0x7ff18c0b1d40 msgr2=0x7ff18c0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18affd640 1 --2- 172.21.15.40:0/3783436200 >> v2:172.21.15.91:3300/0 conn(0x7ff18c0b1d40 0x7ff18c0ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18affd640 1 -- 172.21.15.40:0/3783436200 >> v1:172.21.15.40:6789/0 conn(0x7ff18c15cd60 legacy=0x7ff18c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18affd640 1 -- 172.21.15.40:0/3783436200 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0cf5a0 con 0x7ff18c0b1960 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff18affd640 1 --2- 172.21.15.40:0/3783436200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c0cd740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0b27b0 tx=0x7ff17c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c77c2be235722b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff189ffb640 1 -- 172.21.15.40:0/3783436200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0a7070 con 0x7ff18c0b1960 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff189ffb640 1 -- 172.21.15.40:0/3783436200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0ab430 con 0x7ff18c0b1960 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff189ffb640 1 -- 172.21.15.40:0/3783436200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0ab7c0 con 0x7ff18c0b1960 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- 172.21.15.40:0/3783436200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 msgr2=0x7ff18c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 --2- 172.21.15.40:0/3783436200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c0cd740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0b27b0 tx=0x7ff17c01c430 comp rx=0 tx=0).stop 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- 172.21.15.40:0/3783436200 shutdown_connections 2023-11-04T01:40:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 --2- 172.21.15.40:0/3783436200 >> v2:172.21.15.91:3300/0 conn(0x7ff18c0b1d40 0x7ff18c0ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 --2- 172.21.15.40:0/3783436200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c0cd740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- 172.21.15.40:0/3783436200 >> 172.21.15.40:0/3783436200 conn(0x7ff18c06e760 msgr2=0x7ff18c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- 172.21.15.40:0/3783436200 shutdown_connections 2023-11-04T01:40:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.944+0000 7ff191994640 1 -- 172.21.15.40:0/3783436200 wait complete. 2023-11-04T01:40:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 Processor -- start 2023-11-04T01:40:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- start start 2023-11-04T01:40:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff18c0b1d40 0x7ff18c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff18c15cd60 0x7ff18c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c7710 con 0x7ff18c0b1960 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c8ba0 con 0x7ff18c0b1d40 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c6de0 con 0x7ff18c15cd60 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c15e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57000/0 (socket says 172.21.15.40:57000) 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 -- 172.21.15.40:0/1226798015 learned_addr learned my addr 172.21.15.40:0/1226798015 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 -- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff18c15cd60 msgr2=0x7ff18c15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff18c15cd60 0x7ff18c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 -- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff18c0b1d40 msgr2=0x7ff18c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff18c0b1d40 0x7ff18c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 -- 172.21.15.40:0/1226798015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009420 con 0x7ff18c0b1960 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff18affd640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c15e7d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0ad040 tx=0x7ff17c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0b5810 con 0x7ff18c0b1960 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0b59b0 con 0x7ff18c0b1960 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c0c70c0 con 0x7ff18c0b1960 2023-11-04T01:40:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0b5d60 con 0x7ff18c0b1960 2023-11-04T01:40:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c0c7ba0 con 0x7ff18c0b1960 2023-11-04T01:40:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.948+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0c7d90 con 0x7ff18c0b1960 2023-11-04T01:40:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.952+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff17c0b4390 con 0x7ff18c0b1960 2023-11-04T01:40:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.952+0000 7ff173fff640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff1780664a0 0x7ff178068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.952+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff17c11e5d0 con 0x7ff18c0b1960 2023-11-04T01:40:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.952+0000 7ff18a7fc640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff1780664a0 0x7ff178068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.952+0000 7ff18a7fc640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff1780664a0 0x7ff178068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0aca50 tx=0x7ff180008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:11.956+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff17c0ebc20 con 0x7ff18c0b1960 2023-11-04T01:40:12.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff18c0c6f20 con 0x7ff18c0b1960 2023-11-04T01:40:12.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff173fff640 1 -- 172.21.15.40:0/1226798015 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff18c0c6f20 con 0x7ff18c0b1960 2023-11-04T01:40:12.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:12.139 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:12.140 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:12.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff1780664a0 msgr2=0x7ff178068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff1780664a0 0x7ff178068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0aca50 tx=0x7ff180008040 comp rx=0 tx=0).stop 2023-11-04T01:40:12.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 msgr2=0x7ff18c15e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c15e7d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0ad040 tx=0x7ff17c01ac70 comp rx=0 tx=0).stop 2023-11-04T01:40:12.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 shutdown_connections 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff1780664a0 0x7ff178068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff18c15cd60 0x7ff18c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff18c0b1d40 0x7ff18c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 --2- 172.21.15.40:0/1226798015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff18c0b1960 0x7ff18c15e7d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.136+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 >> 172.21.15.40:0/1226798015 conn(0x7ff18c06e760 msgr2=0x7ff18c06b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.140+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 shutdown_connections 2023-11-04T01:40:12.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.140+0000 7ff191994640 1 -- 172.21.15.40:0/1226798015 wait complete. 2023-11-04T01:40:12.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 Processor -- start 2023-11-04T01:40:12.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 -- start start 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb015d2b0 0x7f1fb006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1fb015d690 0x7f1fb00ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00cd160 con 0x7f1fb006f8f0 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00ad450 con 0x7f1fb015d690 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1fb62a1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00cd400 con 0x7f1fb015d2b0 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1fb015d690 0x7f1fb00ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1fb015d690 0x7f1fb00ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57012/0 (socket says 172.21.15.40:57012) 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 -- 172.21.15.40:0/388805740 learned_addr learned my addr 172.21.15.40:0/388805740 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 -- 172.21.15.40:0/388805740 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb015d2b0 msgr2=0x7f1fb006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faffff640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb015d2b0 0x7f1fb006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb015d2b0 0x7f1fb006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 -- 172.21.15.40:0/388805740 >> v1:172.21.15.40:6789/0 conn(0x7f1fb006f8f0 legacy=0x7f1fb00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faeffd640 1 -- 172.21.15.40:0/388805740 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053306170 0 0) 0x7f1fb00cd160 con 0x7f1fb006f8f0 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 -- 172.21.15.40:0/388805740 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00cd6e0 con 0x7f1fb015d690 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faffff640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb015d2b0 0x7f1fb006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faf7fe640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d690 0x7f1fb00ccc20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009870 tx=0x7f1f9801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370efb1a94d3e0ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faeffd640 1 -- 172.21.15.40:0/388805740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980a6040 con 0x7f1fb015d690 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faeffd640 1 -- 172.21.15.40:0/388805740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f980aa600 con 0x7f1fb015d690 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.272+0000 7f1faeffd640 1 -- 172.21.15.40:0/388805740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980aa990 con 0x7f1fb015d690 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/388805740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d690 msgr2=0x7f1fb00ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d690 0x7f1fb00ccc20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009870 tx=0x7f1f9801c480 comp rx=0 tx=0).stop 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/388805740 shutdown_connections 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d690 0x7f1fb00ccc20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/388805740 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb015d2b0 0x7f1fb006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/388805740 >> 172.21.15.40:0/388805740 conn(0x7f1fb00cebb0 msgr2=0x7f1fb00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/388805740 shutdown_connections 2023-11-04T01:40:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/388805740 wait complete. 2023-11-04T01:40:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 Processor -- start 2023-11-04T01:40:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- start start 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb006f8f0 0x7f1fb015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 0x7f1fb0152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fb015d690 0x7f1fb01585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015a2a0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015a580 con 0x7f1fb015d690 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb0157af0 con 0x7f1fb006f8f0 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 0x7f1fb0152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 0x7f1fb0152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57018/0 (socket says 172.21.15.40:57018) 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 -- 172.21.15.40:0/137052528 learned_addr learned my addr 172.21.15.40:0/137052528 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faffff640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb006f8f0 0x7f1fb015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb483e640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fb015d690 0x7f1fb01585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 -- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb006f8f0 msgr2=0x7f1fb015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb006f8f0 0x7f1fb015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 -- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fb015d690 msgr2=0x7f1fb01585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fb015d690 0x7f1fb01585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 -- 172.21.15.40:0/137052528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980094d0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb483e640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fb015d690 0x7f1fb01585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1faf7fe640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 0x7f1fb0152a60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1f9801a0b0 tx=0x7f1f9801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980aae90 con 0x7f1fb015d2b0 2023-11-04T01:40:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f980b7070 con 0x7f1fb015d2b0 2023-11-04T01:40:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98004220 con 0x7f1fb015d2b0 2023-11-04T01:40:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb0157dd0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.276+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb0159ec0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.280+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb00744a0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.280+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f98004380 con 0x7f1fb015d2b0 2023-11-04T01:40:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.280+0000 7f1facff9640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1f900664a0 0x7f1f90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.280+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f9811e2d0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.280+0000 7f1faffff640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1f900664a0 0x7f1f90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.280+0000 7f1faffff640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1f900664a0 0x7f1f90068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00075b0 tx=0x7f1fa0007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.284+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f980eb6c0 con 0x7f1fb015d2b0 2023-11-04T01:40:12.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.440+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb0158280 con 0x7f1fb015d2b0 2023-11-04T01:40:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.440+0000 7f1facff9640 1 -- 172.21.15.40:0/137052528 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f1f980c2090 con 0x7f1fb015d2b0 2023-11-04T01:40:12.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:12.444 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1f900664a0 msgr2=0x7f1f90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1f900664a0 0x7f1f90068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00075b0 tx=0x7f1fa0007540 comp rx=0 tx=0).stop 2023-11-04T01:40:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 msgr2=0x7f1fb0152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 0x7f1fb0152a60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1f9801a0b0 tx=0x7f1f9801acc0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 shutdown_connections 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1f900664a0 0x7f1f90068960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fb015d690 0x7f1fb01585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fb015d2b0 0x7f1fb0152a60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 --2- 172.21.15.40:0/137052528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1fb006f8f0 0x7f1fb015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 >> 172.21.15.40:0/137052528 conn(0x7f1fb00cebb0 msgr2=0x7f1fb00af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 shutdown_connections 2023-11-04T01:40:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.444+0000 7f1fb62a1640 1 -- 172.21.15.40:0/137052528 wait complete. 2023-11-04T01:40:12.463 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:12.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 Processor -- start 2023-11-04T01:40:12.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 -- start start 2023-11-04T01:40:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f478c15acb0 0x7f478c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f478c15c160 0x7f478c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c0b0a50 0x7f478c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c15bd40 con 0x7f478c15acb0 2023-11-04T01:40:12.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478c06fd80 con 0x7f478c15c160 2023-11-04T01:40:12.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f479148d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b0ee0 con 0x7f478c0b0a50 2023-11-04T01:40:12.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f478c15acb0 0x7f478c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f478c15acb0 0x7f478c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57030/0 (socket says 172.21.15.40:57030) 2023-11-04T01:40:12.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 -- 172.21.15.40:0/3307658320 learned_addr learned my addr 172.21.15.40:0/3307658320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478b7fe640 1 --2- 172.21.15.40:0/3307658320 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c0b0a50 0x7f478c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478a7fc640 1 --2- 172.21.15.40:0/3307658320 >> v2:172.21.15.91:3300/0 conn(0x7f478c15c160 0x7f478c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 -- 172.21.15.40:0/3307658320 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c0b0a50 msgr2=0x7f478c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 --2- 172.21.15.40:0/3307658320 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c0b0a50 0x7f478c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 -- 172.21.15.40:0/3307658320 >> v2:172.21.15.91:3300/0 conn(0x7f478c15c160 msgr2=0x7f478c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 --2- 172.21.15.40:0/3307658320 >> v2:172.21.15.91:3300/0 conn(0x7f478c15c160 0x7f478c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478affd640 1 -- 172.21.15.40:0/3307658320 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0cb130 con 0x7f478c15acb0 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.584+0000 7f478a7fc640 1 --2- 172.21.15.40:0/3307658320 >> v2:172.21.15.91:3300/0 conn(0x7f478c15c160 0x7f478c0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f478affd640 1 --2- 172.21.15.40:0/3307658320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15acb0 0x7f478c15b090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f478c0ce4b0 tx=0x7f477401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba06aa792f43126 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f4789ffb640 1 -- 172.21.15.40:0/3307658320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740aa5f0 con 0x7f478c15acb0 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f4789ffb640 1 -- 172.21.15.40:0/3307658320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47740aa750 con 0x7f478c15acb0 2023-11-04T01:40:12.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f4789ffb640 1 -- 172.21.15.40:0/3307658320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740aaae0 con 0x7f478c15acb0 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 -- 172.21.15.40:0/3307658320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15acb0 msgr2=0x7f478c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 --2- 172.21.15.40:0/3307658320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15acb0 0x7f478c15b090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f478c0ce4b0 tx=0x7f477401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 -- 172.21.15.40:0/3307658320 shutdown_connections 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 --2- 172.21.15.40:0/3307658320 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c0b0a50 0x7f478c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 --2- 172.21.15.40:0/3307658320 >> v2:172.21.15.91:3300/0 conn(0x7f478c15c160 0x7f478c0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 --2- 172.21.15.40:0/3307658320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15acb0 0x7f478c15b090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 -- 172.21.15.40:0/3307658320 >> 172.21.15.40:0/3307658320 conn(0x7f478c0cb510 msgr2=0x7f478c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 -- 172.21.15.40:0/3307658320 shutdown_connections 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 -- 172.21.15.40:0/3307658320 wait complete. 2023-11-04T01:40:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.588+0000 7f479148d640 1 Processor -- start 2023-11-04T01:40:12.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- start start 2023-11-04T01:40:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f478c0b0a50 0x7f478c0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c15acb0 0x7f478c0c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 0x7f478c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0c6ac0 con 0x7f478c15c160 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0b3830 con 0x7f478c0b0a50 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c0c5b60 con 0x7f478c15acb0 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 0x7f478c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 0x7f478c157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57034/0 (socket says 172.21.15.40:57034) 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 -- 172.21.15.40:0/1084473160 learned_addr learned my addr 172.21.15.40:0/1084473160 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478a7fc640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c15acb0 0x7f478c0c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478affd640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f478c0b0a50 0x7f478c0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 -- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c15acb0 msgr2=0x7f478c0c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c15acb0 0x7f478c0c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 -- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f478c0b0a50 msgr2=0x7f478c0b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f478c0b0a50 0x7f478c0b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 -- 172.21.15.40:0/1084473160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740094d0 con 0x7f478c15c160 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478affd640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f478c0b0a50 0x7f478c0b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f478b7fe640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 0x7f478c157e90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4784007e40 tx=0x7f478400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784014620 con 0x7f478c15c160 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47840147a0 con 0x7f478c15c160 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784014b50 con 0x7f478c15c160 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c0c5e40 con 0x7f478c15c160 2023-11-04T01:40:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478c0c6400 con 0x7f478c15c160 2023-11-04T01:40:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478c0c6c00 con 0x7f478c15c160 2023-11-04T01:40:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.592+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4784014cb0 con 0x7f478c15c160 2023-11-04T01:40:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.596+0000 7f47837fe640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f476c0664a0 0x7f476c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.596+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4784084670 con 0x7f478c15c160 2023-11-04T01:40:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.596+0000 7f478affd640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f476c0664a0 0x7f476c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.596+0000 7f478affd640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f476c0664a0 0x7f476c068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47740ae000 tx=0x7f47740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.600+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f478c0c6c00 con 0x7f478c15c160 2023-11-04T01:40:12.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.752+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f478c0c6c00 con 0x7f478c15c160 2023-11-04T01:40:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.752+0000 7f47837fe640 1 -- 172.21.15.40:0/1084473160 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f478c0c6c00 con 0x7f478c15c160 2023-11-04T01:40:12.757 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f476c0664a0 msgr2=0x7f476c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f476c0664a0 0x7f476c068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47740ae000 tx=0x7f47740a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 msgr2=0x7f478c157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 0x7f478c157e90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4784007e40 tx=0x7f478400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 shutdown_connections 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f476c0664a0 0x7f476c068960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478c15c160 0x7f478c157e90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f478c15acb0 0x7f478c0c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 --2- 172.21.15.40:0/1084473160 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f478c0b0a50 0x7f478c0b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 >> 172.21.15.40:0/1084473160 conn(0x7f478c0cb510 msgr2=0x7f478c15d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 shutdown_connections 2023-11-04T01:40:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.756+0000 7f479148d640 1 -- 172.21.15.40:0/1084473160 wait complete. 2023-11-04T01:40:12.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.892+0000 7fc27aaa8640 1 Processor -- start 2023-11-04T01:40:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.892+0000 7fc27aaa8640 1 -- start start 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc27aaa8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc27aaa8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc27415d420 0x7fc27415d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc27aaa8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc274160cb0 con 0x7fc27406b580 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc27aaa8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2740b2fe0 con 0x7fc27415d420 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc27aaa8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27406c390 con 0x7fc2740b26c0 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc273fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc27406b580 0x7fc27406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41244/0 (socket says 172.21.15.40:41244) 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc273fff640 1 -- 172.21.15.40:0/2721776640 learned_addr learned my addr 172.21.15.40:0/2721776640 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc279045640 1 --2- 172.21.15.40:0/2721776640 >> v2:172.21.15.40:3300/0 conn(0x7fc27415d420 0x7fc27415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc278844640 1 --2- 172.21.15.40:0/2721776640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc2737fe640 1 -- 172.21.15.40:0/2721776640 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902327113 0 0) 0x7fc274160cb0 con 0x7fc27406b580 2023-11-04T01:40:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc2737fe640 1 -- 172.21.15.40:0/2721776640 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc25c003530 con 0x7fc27406b580 2023-11-04T01:40:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc279045640 1 -- 172.21.15.40:0/2721776640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 msgr2=0x7fc2740b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc279045640 1 --2- 172.21.15.40:0/2721776640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc279045640 1 -- 172.21.15.40:0/2721776640 >> v1:172.21.15.40:6789/0 conn(0x7fc27406b580 legacy=0x7fc27406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc279045640 1 -- 172.21.15.40:0/2721776640 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274160f50 con 0x7fc27415d420 2023-11-04T01:40:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc279045640 1 --2- 172.21.15.40:0/2721776640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415d890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d90 tx=0x7fc26c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9a99a0f54e2c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc2737fe640 1 -- 172.21.15.40:0/2721776640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0a59e0 con 0x7fc27415d420 2023-11-04T01:40:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc2737fe640 1 -- 172.21.15.40:0/2721776640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c0a5b40 con 0x7fc27415d420 2023-11-04T01:40:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.896+0000 7fc2737fe640 1 -- 172.21.15.40:0/2721776640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0ad440 con 0x7fc27415d420 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- 172.21.15.40:0/2721776640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 msgr2=0x7fc27415d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/2721776640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415d890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009d90 tx=0x7fc26c01c920 comp rx=0 tx=0).stop 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- 172.21.15.40:0/2721776640 shutdown_connections 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/2721776640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415d890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/2721776640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- 172.21.15.40:0/2721776640 >> 172.21.15.40:0/2721776640 conn(0x7fc27409a030 msgr2=0x7fc2740d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- 172.21.15.40:0/2721776640 shutdown_connections 2023-11-04T01:40:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- 172.21.15.40:0/2721776640 wait complete. 2023-11-04T01:40:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 Processor -- start 2023-11-04T01:40:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- start start 2023-11-04T01:40:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc27406b580 0x7fc274160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274160980 con 0x7fc27415d420 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740b5650 con 0x7fc27406b580 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc27aaa8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc274153ee0 con 0x7fc2740b26c0 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57046/0 (socket says 172.21.15.40:57046) 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 -- 172.21.15.40:0/975090164 learned_addr learned my addr 172.21.15.40:0/975090164 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc273fff640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc278844640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc27406b580 0x7fc274160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 -- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 msgr2=0x7fc2740c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 -- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc27406b580 msgr2=0x7fc274160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc27406b580 0x7fc274160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 -- 172.21.15.40:0/975090164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009a70 con 0x7fc27415d420 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.900+0000 7fc279045640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415bcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0b0040 tx=0x7fc26c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0add50 con 0x7fc27415d420 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c009450 con 0x7fc27415d420 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc274153be0 con 0x7fc27415d420 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0b9690 con 0x7fc27415d420 2023-11-04T01:40:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2740b5b80 con 0x7fc27415d420 2023-11-04T01:40:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc274154090 con 0x7fc27415d420 2023-11-04T01:40:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc26c0b97f0 con 0x7fc27415d420 2023-11-04T01:40:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc2717fa640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2600664d0 0x7fc260068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc26c11f480 con 0x7fc27415d420 2023-11-04T01:40:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc278844640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2600664d0 0x7fc260068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.904+0000 7fc278844640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2600664d0 0x7fc260068990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc264006fd0 tx=0x7fc264008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:12.908+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc274154090 con 0x7fc27415d420 2023-11-04T01:40:13.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.056+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc274154050 con 0x7fc27415d420 2023-11-04T01:40:13.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc2717fa640 1 -- 172.21.15.40:0/975090164 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc26c0ec990 con 0x7fc27415d420 2023-11-04T01:40:13.062 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:13.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2600664d0 msgr2=0x7fc260068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2600664d0 0x7fc260068990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc264006fd0 tx=0x7fc264008040 comp rx=0 tx=0).stop 2023-11-04T01:40:13.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 msgr2=0x7fc27415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415bcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0b0040 tx=0x7fc26c0196c0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 shutdown_connections 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2600664d0 0x7fc260068990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27415d420 0x7fc27415bcd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2740b26c0 0x7fc2740c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 --2- 172.21.15.40:0/975090164 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc27406b580 0x7fc274160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 >> 172.21.15.40:0/975090164 conn(0x7fc27409a030 msgr2=0x7fc2740ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 shutdown_connections 2023-11-04T01:40:13.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.060+0000 7fc27aaa8640 1 -- 172.21.15.40:0/975090164 wait complete. 2023-11-04T01:40:13.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:13.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b3daa640 1 Processor -- start 2023-11-04T01:40:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b3daa640 1 -- start start 2023-11-04T01:40:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b3daa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f29ac06b280 0x7f29ac0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b3daa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0cf0b0 con 0x7f29ac160790 2023-11-04T01:40:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b3daa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0ca010 con 0x7f29ac065dc0 2023-11-04T01:40:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b3daa640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac066270 con 0x7f29ac06b280 2023-11-04T01:40:13.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1b46640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f29ac160790 0x7f29ac06ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41250/0 (socket says 172.21.15.40:41250) 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1b46640 1 -- 172.21.15.40:0/2090707148 learned_addr learned my addr 172.21.15.40:0/2090707148 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b2347640 1 --2- 172.21.15.40:0/2090707148 >> v2:172.21.15.91:3300/0 conn(0x7f29ac06b280 0x7f29ac0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223509092 0 0) 0x7f299c001120 con 0x7f29ac160790 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2994003530 con 0x7f29ac160790 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719816202 0 0) 0x7f2994003530 con 0x7f29ac160790 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 >> v2:172.21.15.91:3300/0 conn(0x7f29ac06b280 msgr2=0x7f29ac0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 --2- 172.21.15.40:0/2090707148 >> v2:172.21.15.91:3300/0 conn(0x7f29ac06b280 0x7f29ac0ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 >> v1:172.21.15.91:6789/0 conn(0x7f29ac065dc0 legacy=0x7f29ac160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0c9a30 con 0x7f29ac160790 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f299c001810 con 0x7f29ac160790 2023-11-04T01:40:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 >> v1:172.21.15.40:6789/0 conn(0x7f29ac160790 legacy=0x7f29ac06ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940039d0 0x7f2994003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29940047d0 0x7f2994004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2994005190 0x7f299400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299400c060 con 0x7f29940047d0 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299400c1d0 con 0x7f29940039d0 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299400c390 con 0x7f2994005190 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1345640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29940047d0 0x7f2994004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1b46640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940039d0 0x7f2994003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b2347640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2994005190 0x7f299400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1345640 1 -- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2994005190 msgr2=0x7f299400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1345640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2994005190 0x7f299400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1345640 1 -- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940039d0 msgr2=0x7f2994003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1345640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940039d0 0x7f2994003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b1345640 1 -- 172.21.15.40:0/2090707148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994003530 con 0x7f29940047d0 2023-11-04T01:40:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.200+0000 7f29b2347640 1 -- 172.21.15.40:0/2090707148 reap_dead start 2023-11-04T01:40:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.204+0000 7f29b1345640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29940047d0 0x7f2994004c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f29a0001780 tx=0x7f29a001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bd6c0ee310b57d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.204+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00052d0 con 0x7f29940047d0 2023-11-04T01:40:13.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.204+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00a7050 con 0x7f29940047d0 2023-11-04T01:40:13.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.204+0000 7f29b0b44640 1 -- 172.21.15.40:0/2090707148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0003600 con 0x7f29940047d0 2023-11-04T01:40:13.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/2090707148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29940047d0 msgr2=0x7f2994004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29940047d0 0x7f2994004c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f29a0001780 tx=0x7f29a001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/2090707148 shutdown_connections 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 --2- 172.21.15.40:0/2090707148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29940047d0 0x7f2994004c50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/2090707148 >> 172.21.15.40:0/2090707148 conn(0x7f29ac0b0e30 msgr2=0x7f29ac0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/2090707148 shutdown_connections 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/2090707148 wait complete. 2023-11-04T01:40:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 Processor -- start 2023-11-04T01:40:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- start start 2023-11-04T01:40:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940047d0 0x7f29ac0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f29ac0c81e0 0x7f29ac155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 0x7f29ac1efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c8660 con 0x7f29ac155850 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0b36f0 con 0x7f29940047d0 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac155f90 con 0x7f29ac0c81e0 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 0x7f29ac1efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 0x7f29ac1efe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57066/0 (socket says 172.21.15.40:57066) 2023-11-04T01:40:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 -- 172.21.15.40:0/1291764052 learned_addr learned my addr 172.21.15.40:0/1291764052 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b1345640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f29ac0c81e0 0x7f29ac155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b1b46640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940047d0 0x7f29ac0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 -- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f29ac0c81e0 msgr2=0x7f29ac155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f29ac0c81e0 0x7f29ac155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 -- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940047d0 msgr2=0x7f29ac0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940047d0 0x7f29ac0c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 -- 172.21.15.40:0/1291764052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac155cd0 con 0x7f29ac155850 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b1b46640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940047d0 0x7f29ac0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b2347640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 0x7f29ac1efe40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29ac066f60 tx=0x7f29a40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400e070 con 0x7f29ac155850 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4011db0 con 0x7f29ac155850 2023-11-04T01:40:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac1f72f0 con 0x7f29ac155850 2023-11-04T01:40:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a40039a0 con 0x7f29ac155850 2023-11-04T01:40:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac1f6810 con 0x7f29ac155850 2023-11-04T01:40:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.208+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac0675f0 con 0x7f29ac155850 2023-11-04T01:40:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.212+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29a4003b00 con 0x7f29ac155850 2023-11-04T01:40:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.212+0000 7f29aa7fc640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29980664d0 0x7f2998068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.212+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29a40846e0 con 0x7f29ac155850 2023-11-04T01:40:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.212+0000 7f29b1b46640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29980664d0 0x7f2998068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.212+0000 7f29b1b46640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29980664d0 0x7f2998068990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f299c001ec0 tx=0x7f299c001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.216+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29a4051b60 con 0x7f29ac155850 2023-11-04T01:40:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.364+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29ac0cbb00 con 0x7f29ac155850 2023-11-04T01:40:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29aa7fc640 1 -- 172.21.15.40:0/1291764052 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29a4055180 con 0x7f29ac155850 2023-11-04T01:40:13.370 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29980664d0 msgr2=0x7f2998068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29980664d0 0x7f2998068990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f299c001ec0 tx=0x7f299c001e10 comp rx=0 tx=0).stop 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 msgr2=0x7f29ac1efe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 0x7f29ac1efe40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29ac066f60 tx=0x7f29a40115a0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 shutdown_connections 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f29980664d0 0x7f2998068990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29ac155850 0x7f29ac1efe40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f29ac0c81e0 0x7f29ac155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 --2- 172.21.15.40:0/1291764052 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29940047d0 0x7f29ac0c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 >> 172.21.15.40:0/1291764052 conn(0x7f29ac0b0e30 msgr2=0x7f29ac0b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 shutdown_connections 2023-11-04T01:40:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.368+0000 7f29b3daa640 1 -- 172.21.15.40:0/1291764052 wait complete. 2023-11-04T01:40:13.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:13.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc55b9b7640 1 Processor -- start 2023-11-04T01:40:13.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc55b9b7640 1 -- start start 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc55b9b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc55415d2b0 0x7fc55406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc55b9b7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5540cd400 con 0x7fc55406f8f0 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc55b9b7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5540cd6e0 con 0x7fc55415d690 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc55b9b7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540ad450 con 0x7fc55415d2b0 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc559f54640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc55406f8f0 0x7fc5540b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41264/0 (socket says 172.21.15.40:41264) 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc559f54640 1 -- 172.21.15.40:0/3304884031 learned_addr learned my addr 172.21.15.40:0/3304884031 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc559753640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc55415d2b0 0x7fc55406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc559753640 1 -- 172.21.15.40:0/3304884031 >> v1:172.21.15.91:6789/0 conn(0x7fc55415d690 legacy=0x7fc5540ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc559753640 1 -- 172.21.15.40:0/3304884031 >> v1:172.21.15.40:6789/0 conn(0x7fc55406f8f0 legacy=0x7fc5540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc559753640 1 -- 172.21.15.40:0/3304884031 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5540ad070 con 0x7fc55415d2b0 2023-11-04T01:40:13.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.508+0000 7fc54bfff640 1 -- 172.21.15.40:0/3304884031 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985559550 0 0) 0x7fc5540cd400 con 0x7fc55406f8f0 2023-11-04T01:40:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc559753640 1 --2- 172.21.15.40:0/3304884031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55415d2b0 0x7fc55406c630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5440097c0 tx=0x7fc54401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3d7dc9cb2716d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc54bfff640 1 -- 172.21.15.40:0/3304884031 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440ab610 con 0x7fc55415d2b0 2023-11-04T01:40:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc54bfff640 1 -- 172.21.15.40:0/3304884031 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440ab770 con 0x7fc55415d2b0 2023-11-04T01:40:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc54bfff640 1 -- 172.21.15.40:0/3304884031 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440abb00 con 0x7fc55415d2b0 2023-11-04T01:40:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 -- 172.21.15.40:0/3304884031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55415d2b0 msgr2=0x7fc55406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/3304884031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55415d2b0 0x7fc55406c630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5440097c0 tx=0x7fc54401c3f0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 -- 172.21.15.40:0/3304884031 shutdown_connections 2023-11-04T01:40:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/3304884031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55415d2b0 0x7fc55406c630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 -- 172.21.15.40:0/3304884031 >> 172.21.15.40:0/3304884031 conn(0x7fc5540cebb0 msgr2=0x7fc5540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 -- 172.21.15.40:0/3304884031 shutdown_connections 2023-11-04T01:40:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.512+0000 7fc55b9b7640 1 -- 172.21.15.40:0/3304884031 wait complete. 2023-11-04T01:40:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 Processor -- start 2023-11-04T01:40:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- start start 2023-11-04T01:40:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 0x7fc5540c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc55415d2b0 0x7fc5540cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc55415d690 0x7fc55415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540b2520 con 0x7fc55406f8f0 2023-11-04T01:40:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540cc150 con 0x7fc55415d690 2023-11-04T01:40:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc554146970 con 0x7fc55415d2b0 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 0x7fc5540c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 0x7fc5540c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57082/0 (socket says 172.21.15.40:57082) 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 -- 172.21.15.40:0/1609145224 learned_addr learned my addr 172.21.15.40:0/1609145224 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc558f52640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc55415d2b0 0x7fc5540cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559f54640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc55415d690 0x7fc55415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 -- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc55415d2b0 msgr2=0x7fc5540cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc55415d2b0 0x7fc5540cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 -- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc55415d690 msgr2=0x7fc55415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc55415d690 0x7fc55415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 -- 172.21.15.40:0/1609145224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009420 con 0x7fc55406f8f0 2023-11-04T01:40:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559f54640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc55415d690 0x7fc55415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc559753640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 0x7fc5540c4dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc54401a020 tx=0x7fc54401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440b5810 con 0x7fc55406f8f0 2023-11-04T01:40:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5440b5970 con 0x7fc55406f8f0 2023-11-04T01:40:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc554146f30 con 0x7fc55406f8f0 2023-11-04T01:40:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5440b5d20 con 0x7fc55406f8f0 2023-11-04T01:40:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5540b3ca0 con 0x7fc55406f8f0 2023-11-04T01:40:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.516+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5540744a0 con 0x7fc55406f8f0 2023-11-04T01:40:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.520+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5440c83a0 con 0x7fc55406f8f0 2023-11-04T01:40:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.520+0000 7fc549ffb640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc5380664a0 0x7fc538068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.520+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc54411ecc0 con 0x7fc55406f8f0 2023-11-04T01:40:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.520+0000 7fc558f52640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc5380664a0 0x7fc538068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.520+0000 7fc558f52640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc5380664a0 0x7fc538068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5540c5300 tx=0x7fc550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.524+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5440ec1d0 con 0x7fc55406f8f0 2023-11-04T01:40:13.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.728+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc554071cb0 con 0x7fc55406f8f0 2023-11-04T01:40:13.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.728+0000 7fc549ffb640 1 -- 172.21.15.40:0/1609145224 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fc5440ef7f0 con 0x7fc55406f8f0 2023-11-04T01:40:13.731 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:13.731 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc5380664a0 msgr2=0x7fc538068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc5380664a0 0x7fc538068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5540c5300 tx=0x7fc550009040 comp rx=0 tx=0).stop 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 msgr2=0x7fc5540c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 0x7fc5540c4dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc54401a020 tx=0x7fc54401ac30 comp rx=0 tx=0).stop 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 shutdown_connections 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc5380664a0 0x7fc538068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc55415d690 0x7fc55415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc55415d2b0 0x7fc5540cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 --2- 172.21.15.40:0/1609145224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc55406f8f0 0x7fc5540c4dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 >> 172.21.15.40:0/1609145224 conn(0x7fc5540cebb0 msgr2=0x7fc5540ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 shutdown_connections 2023-11-04T01:40:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.732+0000 7fc55b9b7640 1 -- 172.21.15.40:0/1609145224 wait complete. 2023-11-04T01:40:13.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:13.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 Processor -- start 2023-11-04T01:40:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 -- start start 2023-11-04T01:40:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc1b415afd0 0x7fc1b40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b406f8f0 0x7fc1b40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1b40b0b70 0x7fc1b40c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b4070140 con 0x7fc1b40b0b70 2023-11-04T01:40:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b40b1000 con 0x7fc1b415afd0 2023-11-04T01:40:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b9ca5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b406c9f0 con 0x7fc1b406f8f0 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1b40b0b70 0x7fc1b40c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1b40b0b70 0x7fc1b40c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57086/0 (socket says 172.21.15.40:57086) 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 -- 172.21.15.40:0/1885675313 learned_addr learned my addr 172.21.15.40:0/1885675313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 -- 172.21.15.40:0/1885675313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b406f8f0 msgr2=0x7fc1b40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b2ffd640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b406f8f0 0x7fc1b40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b37fe640 1 --2- 172.21.15.40:0/1885675313 >> v2:172.21.15.91:3300/0 conn(0x7fc1b415afd0 0x7fc1b40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b406f8f0 0x7fc1b40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 -- 172.21.15.40:0/1885675313 >> v2:172.21.15.91:3300/0 conn(0x7fc1b415afd0 msgr2=0x7fc1b40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 --2- 172.21.15.40:0/1885675313 >> v2:172.21.15.91:3300/0 conn(0x7fc1b415afd0 0x7fc1b40715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b3fff640 1 -- 172.21.15.40:0/1885675313 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40c2670 con 0x7fc1b40b0b70 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b37fe640 1 --2- 172.21.15.40:0/1885675313 >> v2:172.21.15.91:3300/0 conn(0x7fc1b415afd0 0x7fc1b40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.860+0000 7fc1b2ffd640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b406f8f0 0x7fc1b40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:13.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b3fff640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b40b0b70 0x7fc1b40c9170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40ce980 tx=0x7fc1ac01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428fa5b03f503fbf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b27fc640 1 -- 172.21.15.40:0/1885675313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0ab600 con 0x7fc1b40b0b70 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b27fc640 1 -- 172.21.15.40:0/1885675313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac0a7050 con 0x7fc1b40b0b70 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b27fc640 1 -- 172.21.15.40:0/1885675313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0ab980 con 0x7fc1b40b0b70 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/1885675313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b40b0b70 msgr2=0x7fc1b40c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b40b0b70 0x7fc1b40c9170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40ce980 tx=0x7fc1ac01c210 comp rx=0 tx=0).stop 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/1885675313 shutdown_connections 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b40b0b70 0x7fc1b40c9170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/1885675313 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b406f8f0 0x7fc1b40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/1885675313 >> v2:172.21.15.91:3300/0 conn(0x7fc1b415afd0 0x7fc1b40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/1885675313 >> 172.21.15.40:0/1885675313 conn(0x7fc1b40cebb0 msgr2=0x7fc1b40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/1885675313 shutdown_connections 2023-11-04T01:40:13.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/1885675313 wait complete. 2023-11-04T01:40:13.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 Processor -- start 2023-11-04T01:40:13.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.864+0000 7fc1b9ca5640 1 -- start start 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b406f8f0 0x7fc1b415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b40b0b70 0x7fc1b4146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 0x7fc1b4159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b41564d0 con 0x7fc1b415afd0 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b415bc40 con 0x7fc1b406f8f0 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4155430 con 0x7fc1b40b0b70 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 0x7fc1b4159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 0x7fc1b4159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57094/0 (socket says 172.21.15.40:57094) 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 -- 172.21.15.40:0/263982834 learned_addr learned my addr 172.21.15.40:0/263982834 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:13.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b37fe640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b406f8f0 0x7fc1b415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b2ffd640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b40b0b70 0x7fc1b4146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 -- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b40b0b70 msgr2=0x7fc1b4146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b40b0b70 0x7fc1b4146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 -- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b406f8f0 msgr2=0x7fc1b415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b406f8f0 0x7fc1b415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 -- 172.21.15.40:0/263982834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0094d0 con 0x7fc1b415afd0 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b37fe640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b406f8f0 0x7fc1b415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b3fff640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 0x7fc1b4159400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0097f0 tx=0x7fc1ac018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0b37d0 con 0x7fc1b415afd0 2023-11-04T01:40:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac0b3930 con 0x7fc1b415afd0 2023-11-04T01:40:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0b3ca0 con 0x7fc1b415afd0 2023-11-04T01:40:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b4155710 con 0x7fc1b415afd0 2023-11-04T01:40:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b4155cd0 con 0x7fc1b415afd0 2023-11-04T01:40:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b40744a0 con 0x7fc1b415afd0 2023-11-04T01:40:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1ac0b2070 con 0x7fc1b415afd0 2023-11-04T01:40:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1abfff640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1940664a0 0x7fc194068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1ac11e0d0 con 0x7fc1b415afd0 2023-11-04T01:40:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.868+0000 7fc1b37fe640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1940664a0 0x7fc194068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:13.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.872+0000 7fc1b37fe640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1940664a0 0x7fc194068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc19c008890 tx=0x7fc19c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:13.872+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc1ac0eb550 con 0x7fc1b415afd0 2023-11-04T01:40:14.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.036+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b40c9490 con 0x7fc1b415afd0 2023-11-04T01:40:14.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.036+0000 7fc1abfff640 1 -- 172.21.15.40:0/263982834 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fc1ac0b0090 con 0x7fc1b415afd0 2023-11-04T01:40:14.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:14.041 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1940664a0 msgr2=0x7fc194068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1940664a0 0x7fc194068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc19c008890 tx=0x7fc19c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 msgr2=0x7fc1b4159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 0x7fc1b4159400 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0097f0 tx=0x7fc1ac018fb0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 shutdown_connections 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1940664a0 0x7fc194068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1b415afd0 0x7fc1b4159400 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc1b40b0b70 0x7fc1b4146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 --2- 172.21.15.40:0/263982834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc1b406f8f0 0x7fc1b415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 >> 172.21.15.40:0/263982834 conn(0x7fc1b40cebb0 msgr2=0x7fc1b4156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 shutdown_connections 2023-11-04T01:40:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.040+0000 7fc1b9ca5640 1 -- 172.21.15.40:0/263982834 wait complete. 2023-11-04T01:40:14.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:14.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 Processor -- start 2023-11-04T01:40:14.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 -- start start 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80b4990 0x7f0fd80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0fd80d0690 0x7f0fd80cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd80d0ae0 0x7f0fd80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd80b6070 con 0x7f0fd80d0ae0 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd80b8ed0 con 0x7f0fd80d0690 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdeffa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80b52b0 con 0x7f0fd80b4990 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd80d0ae0 0x7f0fd80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd80d0ae0 0x7f0fd80cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57104/0 (socket says 172.21.15.40:57104) 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 -- 172.21.15.40:0/1516618477 learned_addr learned my addr 172.21.15.40:0/1516618477 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdcd96640 1 --2- 172.21.15.40:0/1516618477 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80b4990 0x7f0fd80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fd7fff640 1 --2- 172.21.15.40:0/1516618477 >> v2:172.21.15.91:3300/0 conn(0x7f0fd80d0690 0x7f0fd80cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 -- 172.21.15.40:0/1516618477 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80b4990 msgr2=0x7f0fd80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 --2- 172.21.15.40:0/1516618477 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80b4990 0x7f0fd80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 -- 172.21.15.40:0/1516618477 >> v2:172.21.15.91:3300/0 conn(0x7f0fd80d0690 msgr2=0x7f0fd80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 --2- 172.21.15.40:0/1516618477 >> v2:172.21.15.91:3300/0 conn(0x7f0fd80d0690 0x7f0fd80cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.172+0000 7f0fdd597640 1 -- 172.21.15.40:0/1516618477 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd80d1ce0 con 0x7f0fd80d0ae0 2023-11-04T01:40:14.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdd597640 1 --2- 172.21.15.40:0/1516618477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80cdcb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8066d30 tx=0x7f0fd001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d134f30591ad772c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fd77fe640 1 -- 172.21.15.40:0/1516618477 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00af400 con 0x7f0fd80d0ae0 2023-11-04T01:40:14.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fd77fe640 1 -- 172.21.15.40:0/1516618477 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd00ab050 con 0x7f0fd80d0ae0 2023-11-04T01:40:14.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fd77fe640 1 -- 172.21.15.40:0/1516618477 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00af780 con 0x7f0fd80d0ae0 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 -- 172.21.15.40:0/1516618477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80d0ae0 msgr2=0x7f0fd80cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/1516618477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80cdcb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8066d30 tx=0x7f0fd001f1c0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 -- 172.21.15.40:0/1516618477 shutdown_connections 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/1516618477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80cdcb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/1516618477 >> v2:172.21.15.91:3300/0 conn(0x7f0fd80d0690 0x7f0fd80cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/1516618477 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80b4990 0x7f0fd80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 -- 172.21.15.40:0/1516618477 >> 172.21.15.40:0/1516618477 conn(0x7f0fd80cf990 msgr2=0x7f0fd80cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 -- 172.21.15.40:0/1516618477 shutdown_connections 2023-11-04T01:40:14.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 -- 172.21.15.40:0/1516618477 wait complete. 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 Processor -- start 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.176+0000 7f0fdeffa640 1 -- start start 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 0x7f0fd815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80d0690 0x7f0fd80aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80ab790 con 0x7f0fd80b4990 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80ab300 con 0x7f0fd80d0ae0 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80aa6f0 con 0x7f0fd80d0690 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 0x7f0fd815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 0x7f0fd815bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57114/0 (socket says 172.21.15.40:57114) 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 -- 172.21.15.40:0/964896513 learned_addr learned my addr 172.21.15.40:0/964896513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd7fff640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80d0690 0x7f0fd80aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdd597640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 -- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80d0690 msgr2=0x7f0fd80aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80d0690 0x7f0fd80aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 -- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fd80d0ae0 msgr2=0x7f0fd80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 -- 172.21.15.40:0/964896513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd0009b30 con 0x7f0fd80b4990 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdd597640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd7fff640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80d0690 0x7f0fd80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdcd96640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 0x7f0fd815bfe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800d800 tx=0x7f0fc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8009640 con 0x7f0fd80b4990 2023-11-04T01:40:14.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc80097a0 con 0x7f0fd80b4990 2023-11-04T01:40:14.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd80aa9d0 con 0x7f0fd80b4990 2023-11-04T01:40:14.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8009930 con 0x7f0fd80b4990 2023-11-04T01:40:14.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd80aaf90 con 0x7f0fd80b4990 2023-11-04T01:40:14.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd80744a0 con 0x7f0fd80b4990 2023-11-04T01:40:14.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0fc8009a90 con 0x7f0fd80b4990 2023-11-04T01:40:14.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd57fa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0fc40664d0 0x7f0fc4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc8084230 con 0x7f0fd80b4990 2023-11-04T01:40:14.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.180+0000 7f0fd7fff640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0fc40664d0 0x7f0fc4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.184+0000 7f0fd7fff640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0fc40664d0 0x7f0fc4068990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80b7160 tx=0x7f0fcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.184+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0fc8051740 con 0x7f0fd80b4990 2023-11-04T01:40:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.368+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fd80d35a0 con 0x7f0fd80b4990 2023-11-04T01:40:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fd57fa640 1 -- 172.21.15.40:0/964896513 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f0fc800b3a0 con 0x7f0fd80b4990 2023-11-04T01:40:14.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:14.374 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0fc40664d0 msgr2=0x7f0fc4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0fc40664d0 0x7f0fc4068990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80b7160 tx=0x7f0fcc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 msgr2=0x7f0fd815bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 0x7f0fd815bfe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800d800 tx=0x7f0fc800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 shutdown_connections 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0fc40664d0 0x7f0fc4068990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fd80d0ae0 0x7f0fd80ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0fd80d0690 0x7f0fd80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 --2- 172.21.15.40:0/964896513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd80b4990 0x7f0fd815bfe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 >> 172.21.15.40:0/964896513 conn(0x7f0fd80cf990 msgr2=0x7f0fd80b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 shutdown_connections 2023-11-04T01:40:14.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.372+0000 7f0fdeffa640 1 -- 172.21.15.40:0/964896513 wait complete. 2023-11-04T01:40:14.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:39:57.440417+0000', 'modified': '2023-11-04T01:39:59.453939+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/2082160457', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 2082160457}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 2082160457}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:14.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:40:14.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:40:14.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 Processor -- start 2023-11-04T01:40:14.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 -- start start 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f02a40b4990 0x7f02a40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02a40d0690 0x7f02a40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a40b6070 con 0x7f02a40d0ae0 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40b8ed0 con 0x7f02a40d0690 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02aa287640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40b52b0 con 0x7f02a40b4990 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a8824640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f02a40d0ae0 0x7f02a40cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41280/0 (socket says 172.21.15.40:41280) 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a8824640 1 -- 172.21.15.40:0/1657652298 learned_addr learned my addr 172.21.15.40:0/1657652298 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a37fe640 1 --2- 172.21.15.40:0/1657652298 >> v2:172.21.15.40:3300/0 conn(0x7f02a40d0690 0x7f02a40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a3fff640 1 --2- 172.21.15.40:0/1657652298 >> v2:172.21.15.91:3300/0 conn(0x7f02a40b4990 0x7f02a40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a2ffd640 1 -- 172.21.15.40:0/1657652298 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343747639 0 0) 0x7f02a40b6070 con 0x7f02a40d0ae0 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a2ffd640 1 -- 172.21.15.40:0/1657652298 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c003530 con 0x7f02a40d0ae0 2023-11-04T01:40:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a37fe640 1 -- 172.21.15.40:0/1657652298 >> v2:172.21.15.91:3300/0 conn(0x7f02a40b4990 msgr2=0x7f02a40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a37fe640 1 --2- 172.21.15.40:0/1657652298 >> v2:172.21.15.91:3300/0 conn(0x7f02a40b4990 0x7f02a40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a37fe640 1 -- 172.21.15.40:0/1657652298 >> v1:172.21.15.40:6789/0 conn(0x7f02a40d0ae0 legacy=0x7f02a40cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.924+0000 7f02a37fe640 1 -- 172.21.15.40:0/1657652298 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40d1ce0 con 0x7f02a40d0690 2023-11-04T01:40:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02a37fe640 1 --2- 172.21.15.40:0/1657652298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0690 0x7f02a40cd770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f02a4160ce0 tx=0x7f029801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83349349d6fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02a2ffd640 1 -- 172.21.15.40:0/1657652298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980a8950 con 0x7f02a40d0690 2023-11-04T01:40:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02a2ffd640 1 -- 172.21.15.40:0/1657652298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02980a8ab0 con 0x7f02a40d0690 2023-11-04T01:40:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02a2ffd640 1 -- 172.21.15.40:0/1657652298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980a8e40 con 0x7f02a40d0690 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 -- 172.21.15.40:0/1657652298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0690 msgr2=0x7f02a40cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 --2- 172.21.15.40:0/1657652298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0690 0x7f02a40cd770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f02a4160ce0 tx=0x7f029801ec50 comp rx=0 tx=0).stop 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 -- 172.21.15.40:0/1657652298 shutdown_connections 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 --2- 172.21.15.40:0/1657652298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0690 0x7f02a40cd770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 --2- 172.21.15.40:0/1657652298 >> v2:172.21.15.91:3300/0 conn(0x7f02a40b4990 0x7f02a40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 -- 172.21.15.40:0/1657652298 >> 172.21.15.40:0/1657652298 conn(0x7f02a40cf990 msgr2=0x7f02a40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 -- 172.21.15.40:0/1657652298 shutdown_connections 2023-11-04T01:40:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 -- 172.21.15.40:0/1657652298 wait complete. 2023-11-04T01:40:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 Processor -- start 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.928+0000 7f02aa287640 1 -- start start 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02a40b4990 0x7f02a40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02a40d0690 0x7f02a40cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 0x7f02a41e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40ccff0 con 0x7f02a40d0ae0 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40cba10 con 0x7f02a40d0690 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40cbcf0 con 0x7f02a40b4990 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 0x7f02a41e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 0x7f02a41e6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57134/0 (socket says 172.21.15.40:57134) 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 -- 172.21.15.40:0/443276254 learned_addr learned my addr 172.21.15.40:0/443276254 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a3fff640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02a40b4990 0x7f02a40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a37fe640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02a40d0690 0x7f02a40cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 -- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02a40b4990 msgr2=0x7f02a40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02a40b4990 0x7f02a40ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 -- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02a40d0690 msgr2=0x7f02a40cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02a40d0690 0x7f02a40cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 -- 172.21.15.40:0/443276254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298009420 con 0x7f02a40d0ae0 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a3fff640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02a40b4990 0x7f02a40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a37fe640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02a40d0690 0x7f02a40cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a8824640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 0x7f02a41e6220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c390 tx=0x7f029c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a0ff9640 1 -- 172.21.15.40:0/443276254 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c005cf0 con 0x7f02a40d0ae0 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a0ff9640 1 -- 172.21.15.40:0/443276254 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c005e50 con 0x7f02a40d0ae0 2023-11-04T01:40:14.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a40cbfd0 con 0x7f02a40d0ae0 2023-11-04T01:40:14.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a0ff9640 1 -- 172.21.15.40:0/443276254 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0072d0 con 0x7f02a40d0ae0 2023-11-04T01:40:14.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a40cc590 con 0x7f02a40d0ae0 2023-11-04T01:40:14.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a0ff9640 1 -- 172.21.15.40:0/443276254 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f029c007430 con 0x7f02a40d0ae0 2023-11-04T01:40:14.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a0ff9640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02900664a0 0x7f0290068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a0ff9640 1 -- 172.21.15.40:0/443276254 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f029c083300 con 0x7f02a40d0ae0 2023-11-04T01:40:14.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.932+0000 7f02a3fff640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02900664a0 0x7f0290068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 Processor -- start 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- start start 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02900664a0 0x7f0290068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0294009f50 tx=0x7f029400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e58c0 0x565089998600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x565089998f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x565089863460 con 0x5650899e4fa0 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650897f4690 con 0x5650899e58c0 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650897f1bc0 con 0x565089998b40 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57150/0 (socket says 172.21.15.40:57150) 2023-11-04T01:40:14.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 -- 172.21.15.40:0/222984292 learned_addr learned my addr 172.21.15.40:0/222984292 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a37fe640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e58c0 0x565089998600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a8824640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x565089998f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 -- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 msgr2=0x565089998f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x565089998f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 -- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e58c0 msgr2=0x565089998600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e58c0 0x565089998600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 -- 172.21.15.40:0/222984292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650894e5890 con 0x5650899e4fa0 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a37fe640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e58c0 0x565089998600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a8824640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x565089998f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:14.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02a3fff640 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e5380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0294003d70 tx=0x7f0294012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b71d1f78d73d43 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f0289ffb640 1 -- 172.21.15.40:0/222984292 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029401e070 con 0x5650899e4fa0 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f0289ffb640 1 -- 172.21.15.40:0/222984292 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294003e60 con 0x5650899e4fa0 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f0289ffb640 1 -- 172.21.15.40:0/222984292 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294014820 con 0x5650899e4fa0 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- 172.21.15.40:0/222984292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 msgr2=0x5650899e5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e5380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0294003d70 tx=0x7f0294012000 comp rx=0 tx=0).stop 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- 172.21.15.40:0/222984292 shutdown_connections 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x565089998f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e58c0 0x565089998600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/222984292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e5380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- 172.21.15.40:0/222984292 >> 172.21.15.40:0/222984292 conn(0x5650899c5d40 msgr2=0x5650899c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- 172.21.15.40:0/222984292 shutdown_connections 2023-11-04T01:40:14.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- 172.21.15.40:0/222984292 wait complete. 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- start start 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 Processor -- start 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x56508999da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e4fa0 0x56508999dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x56508999e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650897ed4b0 con 0x5650899e58c0 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650897a5aa0 con 0x5650899e4fa0 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650897ab940 con 0x565089998b40 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.936+0000 7f02ad3b4000 10 client.0 _ll_register_callbacks cb 0x565089986460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x56508999e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x56508999e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57154/0 (socket says 172.21.15.40:57154) 2023-11-04T01:40:14.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 -- 172.21.15.40:0/574364773 learned_addr learned my addr 172.21.15.40:0/574364773 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a3fff640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x56508999da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a37fe640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e4fa0 0x56508999dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 -- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 msgr2=0x56508999da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x56508999da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 -- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e4fa0 msgr2=0x56508999dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e4fa0 0x56508999dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 -- 172.21.15.40:0/574364773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0294003a20 con 0x5650899e58c0 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a3fff640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x56508999da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a8824640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x56508999e4e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f029c081850 tx=0x7f029c05c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8da437dbfa4194a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 1 -- 172.21.15.40:0/574364773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c05c570 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 1 -- 172.21.15.40:0/574364773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f029c052a10 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650897aae10 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 1 -- 172.21.15.40:0/574364773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f029c081260 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 10 client.4695 fetch_fsmap learned FSMap version 6 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5650897ae1a0 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 1 -- 172.21.15.40:0/574364773 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c06f030 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 1 -- 172.21.15.40:0/574364773 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f029c0813c0 con 0x5650899e58c0 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 10 client.4695 fetch_fsmap finished waiting for FSMap version 6 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 10 client.4695 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 20 client.4695 populate_metadata read hostname 'smithi040' 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x56508999eef0 0x5650899f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 4 client.4695 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 --> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650897ebe00 con 0x56508999eef0 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a3fff640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x56508999eef0 0x5650899f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 10 client.4695 ms_handle_connect on v2:172.21.15.40:6834/2082160457 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02a3fff640 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x56508999eef0 0x5650899f6250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d3822dbcc125fdf server_cookie=7b6af18d6687023e in_seq=0 out_seq=0 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 1 -- 172.21.15.40:0/574364773 <== mds.0 v2:172.21.15.40:6834/2082160457 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5650897ebe00 con 0x56508999eef0 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 10 client.4695 handle_command_reply: tid=0 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 client.4695 shutdown 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 msgr2=0x56508999e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x56508999e4e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f029c081850 tx=0x7f029c05c800 comp rx=0 tx=0).stop 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 shutdown_connections 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x56508999eef0 0x5650899f6250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x56508999e4e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5650899e4fa0 0x56508999dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/574364773 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x565089998b40 0x56508999da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 >> 172.21.15.40:0/574364773 conn(0x5650899c5d40 msgr2=0x5650899c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f0282ffd640 0 client.4695 ms_handle_reset on v2:172.21.15.40:6834/2082160457 2023-11-04T01:40:14.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 shutdown_connections 2023-11-04T01:40:14.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 1 -- 172.21.15.40:0/574364773 wait complete. 2023-11-04T01:40:14.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.940+0000 7f02ad3b4000 20 client.4695 trim_cache size 0 max 16384 2023-11-04T01:40:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 Processor -- start 2023-11-04T01:40:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 -- start start 2023-11-04T01:40:14.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x5650899e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e58c0 0x5650899f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650894a6940 con 0x5650899e4fa0 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650897e77b0 con 0x565089998b40 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x56508982d830 con 0x5650899e58c0 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57166/0 (socket says 172.21.15.40:57166) 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 -- 172.21.15.40:0/3922400775 learned_addr learned my addr 172.21.15.40:0/3922400775 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a3fff640 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x5650899e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a8824640 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e58c0 0x5650899f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 -- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e58c0 msgr2=0x5650899f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e58c0 0x5650899f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 -- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 msgr2=0x5650899e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x5650899e4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 -- 172.21.15.40:0/3922400775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650897944a0 con 0x5650899e4fa0 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.956+0000 7f02a37fe640 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e45a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c10 tx=0x7f0298004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b5898bb7ddd358 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f028a7fc640 1 -- 172.21.15.40:0/3922400775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980bb640 con 0x5650899e4fa0 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f028a7fc640 1 -- 172.21.15.40:0/3922400775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02980bb7a0 con 0x5650899e4fa0 2023-11-04T01:40:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f028a7fc640 1 -- 172.21.15.40:0/3922400775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980bbb10 con 0x5650899e4fa0 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/3922400775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 msgr2=0x5650899e45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e45a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c10 tx=0x7f0298004740 comp rx=0 tx=0).stop 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/3922400775 shutdown_connections 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e58c0 0x5650899f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e4fa0 0x5650899e45a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/3922400775 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x5650899e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/3922400775 >> 172.21.15.40:0/3922400775 conn(0x5650899c5d40 msgr2=0x5650899c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/3922400775 shutdown_connections 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/3922400775 wait complete. 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- start start 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 Processor -- start 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x565089a45ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e4fa0 0x565089a46420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x565089a42440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650897ebff0 con 0x5650899e58c0 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650897ea8b0 con 0x565089998b40 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x565089770460 con 0x5650899e4fa0 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 10 client.0 _ll_register_callbacks cb 0x7f0294009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x565089a42440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x565089a42440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57182/0 (socket says 172.21.15.40:57182) 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 -- 172.21.15.40:0/845268265 learned_addr learned my addr 172.21.15.40:0/845268265 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a37fe640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e4fa0 0x565089a46420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a3fff640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x565089a45ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 -- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e4fa0 msgr2=0x565089a46420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e4fa0 0x565089a46420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 -- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 msgr2=0x565089a45ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x565089a45ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 -- 172.21.15.40:0/845268265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a40d1ce0 con 0x5650899e58c0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a8824640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x565089a42440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f029c000f70 tx=0x7f029c081700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778aa167feaca2ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 1 -- 172.21.15.40:0/845268265 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c054640 con 0x5650899e58c0 2023-11-04T01:40:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 1 -- 172.21.15.40:0/845268265 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f029c052a10 con 0x5650899e58c0 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565089997900 con 0x5650899e58c0 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 1 -- 172.21.15.40:0/845268265 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f029c00e040 con 0x5650899e58c0 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 10 client.4701 fetch_fsmap learned FSMap version 6 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5650894e5cc0 con 0x5650899e58c0 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 1 -- 172.21.15.40:0/845268265 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565089997900 con 0x5650899e58c0 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 1 -- 172.21.15.40:0/845268265 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f029c07b300 con 0x5650899e58c0 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 10 client.4701 fetch_fsmap finished waiting for FSMap version 6 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 10 client.4701 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 20 client.4701 populate_metadata read hostname 'smithi040' 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x565089a42d70 0x565089a43150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 4 client.4701 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 --> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5650897b7d10 con 0x565089a42d70 2023-11-04T01:40:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a3fff640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x565089a42d70 0x565089a43150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f0282ffd640 10 client.4701 ms_handle_connect on v2:172.21.15.40:6834/2082160457 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.960+0000 7f02a3fff640 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x565089a42d70 0x565089a43150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb97607ab023a22b server_cookie=c324d1c4bfff88f5 in_seq=0 out_seq=0 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f0282ffd640 1 -- 172.21.15.40:0/845268265 <== mds.0 v2:172.21.15.40:6834/2082160457 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5650897b7d10 con 0x565089a42d70 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f0282ffd640 10 client.4701 handle_command_reply: tid=0 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 client.4701 shutdown 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 msgr2=0x565089a42440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x565089a42440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f029c000f70 tx=0x7f029c081700 comp rx=0 tx=0).stop 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 shutdown_connections 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:6834/2082160457,v1:172.21.15.40:6835/2082160457] conn(0x565089a42d70 0x565089a43150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5650899e58c0 0x565089a42440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5650899e4fa0 0x565089a46420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 --2- 172.21.15.40:0/845268265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x565089998b40 0x565089a45ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 >> 172.21.15.40:0/845268265 conn(0x5650899c5d40 msgr2=0x5650899e38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f0282ffd640 0 client.4701 ms_handle_reset on v2:172.21.15.40:6834/2082160457 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 shutdown_connections 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 1 -- 172.21.15.40:0/845268265 wait complete. 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02ad3b4000 20 client.4701 trim_cache size 0 max 16384 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:40:14.972 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4260, 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 16.863173423999999, 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 6, 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 20, 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 20, 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 23.952834805999998 2023-11-04T01:40:14.973 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02900664a0 msgr2=0x7f0290068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02900664a0 0x7f0290068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0294009f50 tx=0x7f029400b040 comp rx=0 tx=0).stop 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 msgr2=0x7f02a41e6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 0x7f02a41e6220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c390 tx=0x7f029c00c850 comp rx=0 tx=0).stop 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 shutdown_connections 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02900664a0 0x7f0290068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a40d0ae0 0x7f02a41e6220 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02a40d0690 0x7f02a40cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 --2- 172.21.15.40:0/443276254 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02a40b4990 0x7f02a40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 >> 172.21.15.40:0/443276254 conn(0x7f02a40cf990 msgr2=0x7f02a40b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 shutdown_connections 2023-11-04T01:40:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:14.964+0000 7f02aa287640 1 -- 172.21.15.40:0/443276254 wait complete. 2023-11-04T01:40:14.982 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T01:40:15.008 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T01:40:15.008 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-04T01:40:15.008 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T01:40:15.008 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:15.009 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:15.009 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-04T01:40:15.009 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:15.009 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:15.009 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-04T01:40:15.009 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:15.010 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:15.010 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-04T01:40:15.010 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:15.010 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:15.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.010 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:40:15.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-11-04T01:40:15.070 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-11-04T01:40:15.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:15.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.072 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-04T01:40:15.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.079 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-11-04T01:40:15.138 INFO:teuthology.orchestra.run.smithi091.stderr:Cannot find device "ceph-brx" 2023-11-04T01:40:15.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:15.139 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T01:40:15.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2348656640 1 Processor -- start 2023-11-04T01:40:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2348656640 1 -- start start 2023-11-04T01:40:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2348656640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23400cd6d0 0x7f23400cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2348656640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23400d0a60 con 0x7f23400cb400 2023-11-04T01:40:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2348656640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23400d04a0 con 0x7f234015afb0 2023-11-04T01:40:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2348656640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234015b390 con 0x7f23400cd6d0 2023-11-04T01:40:15.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2345bf1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f23400cb400 0x7f23400cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41284/0 (socket says 172.21.15.40:41284) 2023-11-04T01:40:15.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2345bf1640 1 -- 172.21.15.40:0/1321706059 learned_addr learned my addr 172.21.15.40:0/1321706059 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:15.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2346bf3640 1 --2- 172.21.15.40:0/1321706059 >> v2:172.21.15.40:3300/0 conn(0x7f23400cd6d0 0x7f23400cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2346bf3640 1 -- 172.21.15.40:0/1321706059 >> v1:172.21.15.91:6789/0 conn(0x7f234015afb0 legacy=0x7f23400b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2346bf3640 1 -- 172.21.15.40:0/1321706059 >> v1:172.21.15.40:6789/0 conn(0x7f23400cb400 legacy=0x7f23400cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.264+0000 7f2346bf3640 1 -- 172.21.15.40:0/1321706059 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400d0780 con 0x7f23400cd6d0 2023-11-04T01:40:15.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2346bf3640 1 --2- 172.21.15.40:0/1321706059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cd6d0 0x7f23400cdab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2338009d90 tx=0x7f233801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4fef01606c4e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f23453f0640 1 -- 172.21.15.40:0/1321706059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380a5780 con 0x7f23400cd6d0 2023-11-04T01:40:15.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f23453f0640 1 -- 172.21.15.40:0/1321706059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23380a58e0 con 0x7f23400cd6d0 2023-11-04T01:40:15.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f23453f0640 1 -- 172.21.15.40:0/1321706059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380a5c70 con 0x7f23400cd6d0 2023-11-04T01:40:15.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- 172.21.15.40:0/1321706059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cd6d0 msgr2=0x7f23400cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 --2- 172.21.15.40:0/1321706059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cd6d0 0x7f23400cdab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2338009d90 tx=0x7f233801c8c0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- 172.21.15.40:0/1321706059 shutdown_connections 2023-11-04T01:40:15.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 --2- 172.21.15.40:0/1321706059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cd6d0 0x7f23400cdab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- 172.21.15.40:0/1321706059 >> 172.21.15.40:0/1321706059 conn(0x7f2340065dc0 msgr2=0x7f23400661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- 172.21.15.40:0/1321706059 shutdown_connections 2023-11-04T01:40:15.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- 172.21.15.40:0/1321706059 wait complete. 2023-11-04T01:40:15.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 Processor -- start 2023-11-04T01:40:15.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- start start 2023-11-04T01:40:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 0x7f2340153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f23400cd6d0 0x7f234015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f234015afb0 0x7f23401582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340164800 con 0x7f23400cb400 2023-11-04T01:40:15.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400b1650 con 0x7f234015afb0 2023-11-04T01:40:15.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f2348656640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2340154660 con 0x7f23400cd6d0 2023-11-04T01:40:15.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f23463f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 0x7f2340153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f23463f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 0x7f2340153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57200/0 (socket says 172.21.15.40:57200) 2023-11-04T01:40:15.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.268+0000 7f23463f2640 1 -- 172.21.15.40:0/528633278 learned_addr learned my addr 172.21.15.40:0/528633278 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:15.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2346bf3640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f234015afb0 0x7f23401582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2345bf1640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f23400cd6d0 0x7f234015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f23463f2640 1 -- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f23400cd6d0 msgr2=0x7f234015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f23463f2640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f23400cd6d0 0x7f234015c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f23463f2640 1 -- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f234015afb0 msgr2=0x7f23401582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f23463f2640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f234015afb0 0x7f23401582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f23463f2640 1 -- 172.21.15.40:0/528633278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2338009a70 con 0x7f23400cb400 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2346bf3640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f234015afb0 0x7f23401582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f23463f2640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 0x7f2340153b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f233c00c420 tx=0x7f233c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0052d0 con 0x7f23400cb400 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c005430 con 0x7f23400cb400 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23400b1370 con 0x7f23400cb400 2023-11-04T01:40:15.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c007260 con 0x7f23400cb400 2023-11-04T01:40:15.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2340164d10 con 0x7f23400cb400 2023-11-04T01:40:15.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23400675f0 con 0x7f23400cb400 2023-11-04T01:40:15.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f233c0073c0 con 0x7f23400cb400 2023-11-04T01:40:15.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2336ffd640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f23240664a0 0x7f2324068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:15.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f233c083250 con 0x7f23400cb400 2023-11-04T01:40:15.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.272+0000 7f2345bf1640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f23240664a0 0x7f2324068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:15.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.276+0000 7f2345bf1640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f23240664a0 0x7f2324068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23400cd1c0 tx=0x7f2330009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:15.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.276+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f233c0506d0 con 0x7f23400cb400 2023-11-04T01:40:15.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.468+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2340066b00 con 0x7f23400cb400 2023-11-04T01:40:15.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2336ffd640 1 -- 172.21.15.40:0/528633278 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f233c053cf0 con 0x7f23400cb400 2023-11-04T01:40:15.473 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:40:15.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f23240664a0 msgr2=0x7f2324068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f23240664a0 0x7f2324068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23400cd1c0 tx=0x7f2330009040 comp rx=0 tx=0).stop 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 msgr2=0x7f2340153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 0x7f2340153b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f233c00c420 tx=0x7f233c00c8e0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 shutdown_connections 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f23240664a0 0x7f2324068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f234015afb0 0x7f23401582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f23400cd6d0 0x7f234015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 --2- 172.21.15.40:0/528633278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23400cb400 0x7f2340153b30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 >> 172.21.15.40:0/528633278 conn(0x7f2340065dc0 msgr2=0x7f234006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 shutdown_connections 2023-11-04T01:40:15.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:15.472+0000 7f2348656640 1 -- 172.21.15.40:0/528633278 wait complete. 2023-11-04T01:40:15.492 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:15.492 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:15.492 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:40:15.492 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:40:15.492 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:15.493 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:15.493 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:15.493 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:15.493 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:40:15.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.493 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:40:15.499 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:15.500 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42258sec preferred_lft 42258sec 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:40:15.501 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:15.502 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:40:15.502 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:15.502 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:40:15.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.502 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:15.502 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:15.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:40:15.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-11-04T01:40:15.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-11-04T01:40:15.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:40:15.503 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:15.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.579 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:15.634 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:40:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.636 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:40:15.695 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:40:15.695 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:15.695 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:40:15.695 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:40:15.695 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:40:15.695 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:15.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.696 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:15.696 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:15.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:40:15.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:40:15.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:40:15.696 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:15.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.772 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:40:15.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.819 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-11-04T01:40:15.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.867 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:15.867 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:15.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:15.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T01:40:15.867 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:15.936 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T01:40:15.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.936 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:15.936 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:15.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T01:40:15.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:15.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T01:40:15.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T01:40:15.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T01:40:15.937 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:16.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:16.045 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:16.045 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:16.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:40:16.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:40:16.046 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:16.065 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:40:16.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:16.066 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:16.117 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:40:16.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:16.118 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:16.165 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:16.216 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:40:16.217 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:40:16.218 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:16.219 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:16.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:16.220 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:40:16.266 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:40:16.267 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:40:16.311 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:40:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:16.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:16.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:16.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:16.321 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:40:16.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:40:16.404+0000 7f09d3a6b580 -1 init, newargv = 0x55a680939cb0 newargc=15 2023-11-04T01:40:16.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[45683]: starting ceph client 2023-11-04T01:40:16.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[45683]: starting fuse 2023-11-04T01:40:17.475 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:40:17.483 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:40:17.484 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:17.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:17.486 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:40:17.538 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:40:17.539 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:40:17.539 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:17.540 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:40:17.541 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:40:17.541 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:40:17.541 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:17.541 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:17.541 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:40:17.541 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:40:17.668 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.45683.asok 2023-11-04T01:40:17.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:17.680 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45683.asok 2023-11-04T01:40:17.680 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:17.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.45683.asok status 2023-11-04T01:40:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:40:17.881 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "45683", 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:17.882 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4719, 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4719 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3260586161 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3260586161 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4719 192.168.0.1:0/3260586161", 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/3260586161", 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 6, 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 20, 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:40:17.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:17.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.020+0000 7faa56daf640 1 Processor -- start 2023-11-04T01:40:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.020+0000 7faa56daf640 1 -- start start 2023-11-04T01:40:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa56daf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cb400 0x7faa500cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa56daf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa500cd6d0 0x7faa500cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa56daf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500d0a60 con 0x7faa5015afb0 2023-11-04T01:40:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa56daf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5015b390 con 0x7faa500cd6d0 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa56daf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500d04a0 con 0x7faa500cb400 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa5534c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa500cd6d0 0x7faa500cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa54b4b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faa5015afb0 0x7faa500b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51942/0 (socket says 172.21.15.40:51942) 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa54b4b640 1 -- 172.21.15.40:0/3240247936 learned_addr learned my addr 172.21.15.40:0/3240247936 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa4ffff640 1 --2- 172.21.15.40:0/3240247936 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cb400 0x7faa500cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa5534c640 1 -- 172.21.15.40:0/3240247936 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cb400 msgr2=0x7faa500cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa5534c640 1 --2- 172.21.15.40:0/3240247936 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cb400 0x7faa500cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa5534c640 1 -- 172.21.15.40:0/3240247936 >> v1:172.21.15.40:6789/0 conn(0x7faa5015afb0 legacy=0x7faa500b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa5534c640 1 -- 172.21.15.40:0/3240247936 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500d0780 con 0x7faa500cd6d0 2023-11-04T01:40:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa5534c640 1 --2- 172.21.15.40:0/3240247936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cd6d0 0x7faa500cdae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa48009d90 tx=0x7faa4801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecd05f391515ed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.024+0000 7faa4f7fe640 1 -- 172.21.15.40:0/3240247936 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a5870 con 0x7faa500cd6d0 2023-11-04T01:40:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa4f7fe640 1 -- 172.21.15.40:0/3240247936 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480a59d0 con 0x7faa500cd6d0 2023-11-04T01:40:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa4f7fe640 1 -- 172.21.15.40:0/3240247936 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a5d60 con 0x7faa500cd6d0 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- 172.21.15.40:0/3240247936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cd6d0 msgr2=0x7faa500cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 --2- 172.21.15.40:0/3240247936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cd6d0 0x7faa500cdae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa48009d90 tx=0x7faa4801c8c0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- 172.21.15.40:0/3240247936 shutdown_connections 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 --2- 172.21.15.40:0/3240247936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cd6d0 0x7faa500cdae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 --2- 172.21.15.40:0/3240247936 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cb400 0x7faa500cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- 172.21.15.40:0/3240247936 >> 172.21.15.40:0/3240247936 conn(0x7faa50065dc0 msgr2=0x7faa500661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- 172.21.15.40:0/3240247936 shutdown_connections 2023-11-04T01:40:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- 172.21.15.40:0/3240247936 wait complete. 2023-11-04T01:40:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 Processor -- start 2023-11-04T01:40:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- start start 2023-11-04T01:40:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 0x7faa50155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cd6d0 0x7faa500b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa5015afb0 0x7faa5006b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50155b50 con 0x7faa500cb400 2023-11-04T01:40:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500b50e0 con 0x7faa500cd6d0 2023-11-04T01:40:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa56daf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa50163610 con 0x7faa5015afb0 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa54b4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 0x7faa50155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa54b4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 0x7faa50155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46116/0 (socket says 172.21.15.40:46116) 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa54b4b640 1 -- 172.21.15.40:0/347593336 learned_addr learned my addr 172.21.15.40:0/347593336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa5534c640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa5015afb0 0x7faa5006b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa4ffff640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cd6d0 0x7faa500b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa54b4b640 1 -- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa5015afb0 msgr2=0x7faa5006b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.028+0000 7faa54b4b640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa5015afb0 0x7faa5006b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa54b4b640 1 -- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cd6d0 msgr2=0x7faa500b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa54b4b640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cd6d0 0x7faa500b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa54b4b640 1 -- 172.21.15.40:0/347593336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009a70 con 0x7faa500cb400 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4ffff640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cd6d0 0x7faa500b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa5534c640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa5015afb0 0x7faa5006b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:18.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa54b4b640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 0x7faa50155610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa4000c500 tx=0x7faa4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40005cf0 con 0x7faa500cb400 2023-11-04T01:40:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa40005e50 con 0x7faa500cb400 2023-11-04T01:40:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400072f0 con 0x7faa500cb400 2023-11-04T01:40:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa501638f0 con 0x7faa500cb400 2023-11-04T01:40:18.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5006d080 con 0x7faa500cb400 2023-11-04T01:40:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5006d2c0 con 0x7faa500cb400 2023-11-04T01:40:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa40007450 con 0x7faa500cb400 2023-11-04T01:40:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4d7fa640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa3c0664a0 0x7faa3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa40083290 con 0x7faa500cb400 2023-11-04T01:40:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4ffff640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa3c0664a0 0x7faa3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.032+0000 7faa4ffff640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa3c0664a0 0x7faa3c068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa500cdfa0 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.036+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa5006d2c0 con 0x7faa500cb400 2023-11-04T01:40:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.228+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa5006d2c0 con 0x7faa500cb400 2023-11-04T01:40:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.228+0000 7faa4d7fa640 1 -- 172.21.15.40:0/347593336 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7faa40017060 con 0x7faa500cb400 2023-11-04T01:40:18.231 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:40:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.228+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa3c0664a0 msgr2=0x7faa3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.228+0000 7faa56daf640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa3c0664a0 0x7faa3c068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa500cdfa0 tx=0x7faa44008040 comp rx=0 tx=0).stop 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 msgr2=0x7faa50155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 0x7faa50155610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa4000c500 tx=0x7faa4000c9c0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 shutdown_connections 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa3c0664a0 0x7faa3c068960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa5015afb0 0x7faa5006b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cd6d0 0x7faa500b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 --2- 172.21.15.40:0/347593336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa500cb400 0x7faa50155610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 >> 172.21.15.40:0/347593336 conn(0x7faa50065dc0 msgr2=0x7faa500b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 shutdown_connections 2023-11-04T01:40:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:18.232+0000 7faa56daf640 1 -- 172.21.15.40:0/347593336 wait complete. 2023-11-04T01:40:18.250 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:18.251 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:40:18.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.252 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:40:18.258 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42256sec preferred_lft 42256sec 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.259 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:40:18.260 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.261 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:40:18.261 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:18.261 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:40:18.261 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.261 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:18.310 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:40:18.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.312 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:40:18.360 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:40:18.360 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:18.360 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:40:18.361 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:40:18.361 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:40:18.361 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:18.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.362 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:18.362 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:18.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:40:18.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:40:18.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:40:18.363 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:18.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.434 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:40:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:40:18.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.483 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-11-04T01:40:18.530 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-04T01:40:18.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.531 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:18.531 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:18.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:18.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-04T01:40:18.531 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:18.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:40:18.649 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 2e:2c:61:e2:15:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:18.650 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.651 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::2c2c:61ff:fee2:15f7/64 scope link 2023-11-04T01:40:18.651 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 2e:2c:61:e2:15:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:18.706 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:18.707 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.707 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::2c2c:61ff:fee2:15f7/64 scope link 2023-11-04T01:40:18.707 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:18.708 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-04T01:40:18.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-04T01:40:18.709 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:18.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.802 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:40:18.802 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:40:18.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-11-04T01:40:18.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:40:18.802 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:40:18.822 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-04T01:40:18.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:18.822 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:18.870 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:40:18.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:18.870 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:18.922 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:18.971 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:40:18.971 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:40:18.971 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:40:18.971 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:40:18.971 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:40:18.971 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:40:18.972 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:18.973 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:18.974 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:18.974 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:18.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:18.975 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:40:19.026 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:40:19.027 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-11-04T01:40:19.027 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-04T01:40:19.071 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:19.078 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:40:19.078 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:40:19.078 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:40:19.078 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:40:19.079 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:40:19.080 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:19.081 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:19.081 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:19.081 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:19.081 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:19.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:19.082 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:40:19.130 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:40:19.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:2023-11-04T01:40:19.152+0000 7f1fe9227580 -1 init, newargv = 0x559a6bf2f980 newargc=15 2023-11-04T01:40:19.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[45819]: starting ceph client 2023-11-04T01:40:19.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[45819]: starting fuse 2023-11-04T01:40:20.231 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:40:20.239 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:40:20.240 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:20.241 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:20.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:20.243 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:40:20.290 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:40:20.290 INFO:teuthology.orchestra.run.smithi040.stdout:46 2023-11-04T01:40:20.290 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-04T01:40:20.291 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:40:20.292 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:40:20.293 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:20.293 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:40:20.293 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.2")) 2023-11-04T01:40:20.293 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:40:20.417 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.2.45819.asok 2023-11-04T01:40:20.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:20.432 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45819.asok 2023-11-04T01:40:20.432 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:20.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.45819.asok status 2023-11-04T01:40:20.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "2", 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "45819", 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4731, 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4731 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2791889295 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:20.628 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2791889295 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4731 192.168.0.2:0/2791889295", 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.2:0/2791889295", 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 6, 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 20, 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:20.629 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:40:20.630 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:40:20.630 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:40:20.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:20.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.764+0000 7f6a72c76640 1 Processor -- start 2023-11-04T01:40:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.764+0000 7f6a72c76640 1 -- start start 2023-11-04T01:40:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a72c76640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 0x7f6a6c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a72c76640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0b6070 con 0x7f6a6c0b4990 2023-11-04T01:40:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a72c76640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6c0b8ed0 con 0x7f6a6c0d0690 2023-11-04T01:40:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a72c76640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0d1ce0 con 0x7f6a6c0d0ae0 2023-11-04T01:40:20.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a70a12640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6a6c0b4990 0x7f6a6c0b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51952/0 (socket says 172.21.15.40:51952) 2023-11-04T01:40:20.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a70a12640 1 -- 172.21.15.40:0/3582147634 learned_addr learned my addr 172.21.15.40:0/3582147634 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:20.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a71213640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 0x7f6a6c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141507649 0 0) 0x7f6a6c0b6070 con 0x7f6a6c0b4990 2023-11-04T01:40:20.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a54003530 con 0x7f6a6c0b4990 2023-11-04T01:40:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 54854037 0 0) 0x7f6a54003530 con 0x7f6a6c0b4990 2023-11-04T01:40:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 msgr2=0x7f6a6c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 0x7f6a6c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 >> v1:172.21.15.91:6789/0 conn(0x7f6a6c0d0690 legacy=0x7f6a6c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0d1fc0 con 0x7f6a6c0b4990 2023-11-04T01:40:20.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f6a5c001680 con 0x7f6a6c0b4990 2023-11-04T01:40:20.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 >> v1:172.21.15.40:6789/0 conn(0x7f6a6c0b4990 legacy=0x7f6a6c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 0x7f6a540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a54003f30 0x7f6a540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0d1ce0 con 0x7f6a54003f30 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400bb00 con 0x7f6a54004d10 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400bcc0 con 0x7f6a6c0d0ae0 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a54003f30 0x7f6a540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a71213640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a70a12640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 0x7f6a540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6bfff640 1 -- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 msgr2=0x7f6a540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c0d0ae0 0x7f6a540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6bfff640 1 -- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54004d10 msgr2=0x7f6a54005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.768+0000 7f6a6bfff640 1 -- 172.21.15.40:0/3582147634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54003530 con 0x7f6a54003f30 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a54003f30 0x7f6a540047d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a60001750 tx=0x7f6a6001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821cb277cba10e0c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600052d0 con 0x7f6a54003f30 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a600a7050 con 0x7f6a54003f30 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6b7fe640 1 -- 172.21.15.40:0/3582147634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60003600 con 0x7f6a54003f30 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- 172.21.15.40:0/3582147634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a54003f30 msgr2=0x7f6a540047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 --2- 172.21.15.40:0/3582147634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a54003f30 0x7f6a540047d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a60001750 tx=0x7f6a6001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a71213640 1 -- 172.21.15.40:0/3582147634 reap_dead start 2023-11-04T01:40:20.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- 172.21.15.40:0/3582147634 shutdown_connections 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- 172.21.15.40:0/3582147634 >> 172.21.15.40:0/3582147634 conn(0x7f6a6c0cf990 msgr2=0x7f6a6c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- 172.21.15.40:0/3582147634 shutdown_connections 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- 172.21.15.40:0/3582147634 wait complete. 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 Processor -- start 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- start start 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54003f30 0x7f6a6c14ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 0x7f6a6c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c1f2440 0x7f6a6c15ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c15fd70 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c15f070 con 0x7f6a54003f30 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0a99a0 con 0x7f6a6c1f2440 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 0x7f6a6c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 0x7f6a6c15e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46140/0 (socket says 172.21.15.40:46140) 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 -- 172.21.15.40:0/1872455408 learned_addr learned my addr 172.21.15.40:0/1872455408 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a71213640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c1f2440 0x7f6a6c15ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a70a12640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54003f30 0x7f6a6c14ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 -- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c1f2440 msgr2=0x7f6a6c15ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c1f2440 0x7f6a6c15ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 -- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54003f30 msgr2=0x7f6a6c14ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54003f30 0x7f6a6c14ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 -- 172.21.15.40:0/1872455408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0a9c80 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a71213640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c1f2440 0x7f6a6c15ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a6bfff640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 0x7f6a6c15e520 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a60005040 tx=0x7f6a54005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60007a40 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60007680 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.772+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6c0a9f60 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60006a20 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c0b3950 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6c0744a0 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a60006b80 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a697fa640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a580664a0 0x7f6a58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a6011e6d0 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a70a12640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a580664a0 0x7f6a58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.776+0000 7f6a70a12640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a580664a0 0x7f6a58068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001ca0 tx=0x7f6a5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.780+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6a600ebab0 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.968+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a6c0b7f40 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a697fa640 1 -- 172.21.15.40:0/1872455408 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a600ef0d0 con 0x7f6a6c1f1fe0 2023-11-04T01:40:20.974 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a580664a0 msgr2=0x7f6a58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a580664a0 0x7f6a58068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001ca0 tx=0x7f6a5c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 msgr2=0x7f6a6c15e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 0x7f6a6c15e520 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6a60005040 tx=0x7f6a54005800 comp rx=0 tx=0).stop 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 shutdown_connections 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a580664a0 0x7f6a58068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6a6c1f2440 0x7f6a6c15ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c1f1fe0 0x7f6a6c15e520 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 --2- 172.21.15.40:0/1872455408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6a54003f30 0x7f6a6c14ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 >> 172.21.15.40:0/1872455408 conn(0x7f6a6c0cf990 msgr2=0x7f6a6c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 shutdown_connections 2023-11-04T01:40:20.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:20.972+0000 7f6a72c76640 1 -- 172.21.15.40:0/1872455408 wait complete. 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:20.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:20.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:20.994 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:40:20.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:20.994 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:21.001 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42255sec preferred_lft 42255sec 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:40:21.002 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 02:42:b2:3b:1a:bc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:21.003 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:40:21.003 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:21.003 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:40:21.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.003 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:21.003 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:21.003 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:40:21.003 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr flush dev ceph-brx 2023-11-04T01:40:21.003 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set ceph-brx up 2023-11-04T01:40:21.004 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:40:21.004 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:21.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.086 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:21.142 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-04T01:40:21.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.144 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-04T01:40:21.211 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:40:21.212 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:21.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.213 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:21.213 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:21.213 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:21.213 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:21.213 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:21.213 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:21.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.287 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-04T01:40:21.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.334 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-11-04T01:40:21.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.382 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:21.382 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:21.382 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:21.382 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-04T01:40:21.383 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:21.451 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-04T01:40:21.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-04T01:40:21.452 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:21.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.561 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:21.561 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:21.561 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-11-04T01:40:21.561 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:40:21.561 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:21.580 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-04T01:40:21.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:21.580 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:21.629 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:40:21.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:21.630 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:21.678 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:21.730 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-04T01:40:21.730 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-04T01:40:21.730 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-04T01:40:21.730 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-04T01:40:21.731 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:21.732 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-04T01:40:21.733 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:21.733 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:21.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.734 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-04T01:40:21.786 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:40:21.786 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-04T01:40:21.831 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:21.837 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-04T01:40:21.838 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:21.839 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:21.840 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:21.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:21.841 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-04T01:40:21.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi091.stderr:2023-11-04T01:40:21.922+0000 7f7c02ba3580 -1 init, newargv = 0x563662aafca0 newargc=15 2023-11-04T01:40:21.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi091.stderr:ceph-fuse[43893]: starting ceph client 2023-11-04T01:40:21.936 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi091.stderr:ceph-fuse[43893]: starting fuse 2023-11-04T01:40:22.994 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:23.002 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-04T01:40:23.002 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-04T01:40:23.002 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-04T01:40:23.002 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-04T01:40:23.002 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-04T01:40:23.003 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:23.005 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:23.006 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:23.006 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:23.006 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-04T01:40:23.006 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:23.006 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:23.006 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:23.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.008 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-04T01:40:23.054 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-11-04T01:40:23.054 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:40:23.054 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:23.054 DEBUG:teuthology.orchestra.run.smithi091:> import glob 2023-11-04T01:40:23.054 DEBUG:teuthology.orchestra.run.smithi091:> import re 2023-11-04T01:40:23.054 DEBUG:teuthology.orchestra.run.smithi091:> import os 2023-11-04T01:40:23.054 DEBUG:teuthology.orchestra.run.smithi091:> import subprocess 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> def _find_admin_socket(client_name): 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> files = glob.glob(asok_path) 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> # Given a non-glob path, it better be there 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> if "*" not in asok_path: 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> assert(len(files) == 1) 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> return files[0] 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> for f in files: 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:23.055 DEBUG:teuthology.orchestra.run.smithi091:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> contents = proc_f.read() 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> if mountpoint in contents: 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> return f 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> print(_find_admin_socket("client.1")) 2023-11-04T01:40:23.056 DEBUG:teuthology.orchestra.run.smithi091:> ' 2023-11-04T01:40:23.178 INFO:teuthology.orchestra.run.smithi091.stdout:/var/run/ceph/ceph-client.1.43893.asok 2023-11-04T01:40:23.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:23.190 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43893.asok 2023-11-04T01:40:23.190 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:23.190 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.43893.asok status 2023-11-04T01:40:23.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:23.389 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-04T01:40:23.389 INFO:teuthology.orchestra.run.smithi091.stdout: "metadata": { 2023-11-04T01:40:23.389 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "entity_id": "1", 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "hostname": "smithi091", 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "pid": "43893", 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "root": "/" 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_count": 0, 2023-11-04T01:40:23.390 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4508, 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "inst": { 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "name": { 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "client", 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "num": 4508 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 2260233339 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:23.391 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 2260233339 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "inst_str": "client.4508 192.168.0.1:0/2260233339", 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "addr_str": "192.168.0.1:0/2260233339", 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "inode_count": 1, 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_epoch": 6, 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch": 20, 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "blocklisted": false, 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs" 2023-11-04T01:40:23.392 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-04T01:40:23.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:23.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.540+0000 7fd1b2cfd640 1 Processor -- start 2023-11-04T01:40:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.540+0000 7fd1b2cfd640 1 -- start start 2023-11-04T01:40:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b2cfd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b2cfd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd1ac0722e0 0x7fd1ac06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b2cfd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0b4270 con 0x7fd1ac06a370 2023-11-04T01:40:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b2cfd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac06cb40 con 0x7fd1ac0722e0 2023-11-04T01:40:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b2cfd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac06ce20 con 0x7fd1ac15d540 2023-11-04T01:40:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:40804/0 (socket says 172.21.15.40:40804) 2023-11-04T01:40:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 -- 172.21.15.40:0/663071057 learned_addr learned my addr 172.21.15.40:0/663071057 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1abfff640 1 --2- 172.21.15.40:0/663071057 >> v2:172.21.15.91:3300/0 conn(0x7fd1ac0722e0 0x7fd1ac06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 -- 172.21.15.40:0/663071057 >> v2:172.21.15.91:3300/0 conn(0x7fd1ac0722e0 msgr2=0x7fd1ac06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 --2- 172.21.15.40:0/663071057 >> v2:172.21.15.91:3300/0 conn(0x7fd1ac0722e0 0x7fd1ac06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 -- 172.21.15.40:0/663071057 >> v1:172.21.15.91:6789/0 conn(0x7fd1ac06a370 legacy=0x7fd1ac0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1b0a99640 1 -- 172.21.15.40:0/663071057 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac06d100 con 0x7fd1ac15d540 2023-11-04T01:40:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.544+0000 7fd1abfff640 1 --2- 172.21.15.40:0/663071057 >> v2:172.21.15.91:3300/0 conn(0x7fd1ac0722e0 0x7fd1ac06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b0a99640 1 --2- 172.21.15.40:0/663071057 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac0b4f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd194009870 tx=0x7fd19401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad482169fff5a593 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1ab7fe640 1 -- 172.21.15.40:0/663071057 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940ab600 con 0x7fd1ac15d540 2023-11-04T01:40:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1ab7fe640 1 -- 172.21.15.40:0/663071057 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940ab760 con 0x7fd1ac15d540 2023-11-04T01:40:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1ab7fe640 1 -- 172.21.15.40:0/663071057 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940abaf0 con 0x7fd1ac15d540 2023-11-04T01:40:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/663071057 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 msgr2=0x7fd1ac0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/663071057 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac0b4f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd194009870 tx=0x7fd19401c420 comp rx=0 tx=0).stop 2023-11-04T01:40:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/663071057 shutdown_connections 2023-11-04T01:40:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/663071057 >> v2:172.21.15.91:3300/0 conn(0x7fd1ac0722e0 0x7fd1ac06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/663071057 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac0b4f10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/663071057 >> 172.21.15.40:0/663071057 conn(0x7fd1ac0716a0 msgr2=0x7fd1ac071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/663071057 shutdown_connections 2023-11-04T01:40:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/663071057 wait complete. 2023-11-04T01:40:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 Processor -- start 2023-11-04T01:40:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- start start 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1ac06a370 0x7fd1ac153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 0x7fd1ac154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac157ab0 con 0x7fd1ac0722e0 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1572a0 con 0x7fd1ac06a370 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b2cfd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1574f0 con 0x7fd1ac15d540 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1abfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 0x7fd1ac154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1abfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 0x7fd1ac154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46154/0 (socket says 172.21.15.40:46154) 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1abfff640 1 -- 172.21.15.40:0/325291370 learned_addr learned my addr 172.21.15.40:0/325291370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b0a99640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1ac06a370 0x7fd1ac153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.548+0000 7fd1b129a640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1abfff640 1 -- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 msgr2=0x7fd1ac154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1abfff640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1abfff640 1 -- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1ac06a370 msgr2=0x7fd1ac153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1abfff640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1ac06a370 0x7fd1ac153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1abfff640 1 -- 172.21.15.40:0/325291370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c009a70 con 0x7fd1ac0722e0 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1b0a99640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1ac06a370 0x7fd1ac153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1abfff640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 0x7fd1ac154510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00efc0 tx=0x7fd19c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c014680 con 0x7fd1ac0722e0 2023-11-04T01:40:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00f040 con 0x7fd1ac0722e0 2023-11-04T01:40:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1940094d0 con 0x7fd1ac0722e0 2023-11-04T01:40:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c014a00 con 0x7fd1ac0722e0 2023-11-04T01:40:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac15b590 con 0x7fd1ac0722e0 2023-11-04T01:40:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac15b3f0 con 0x7fd1ac0722e0 2023-11-04T01:40:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd19c014b60 con 0x7fd1ac0722e0 2023-11-04T01:40:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1a97fa640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd18c0664a0 0x7fd18c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd19c085180 con 0x7fd1ac0722e0 2023-11-04T01:40:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.552+0000 7fd1b0a99640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd18c0664a0 0x7fd18c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.556+0000 7fd1b0a99640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd18c0664a0 0x7fd18c068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1940af000 tx=0x7fd1940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.560+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd19c0526e0 con 0x7fd1ac0722e0 2023-11-04T01:40:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.744+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1ac15b3f0 con 0x7fd1ac0722e0 2023-11-04T01:40:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.744+0000 7fd1a97fa640 1 -- 172.21.15.40:0/325291370 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd1ac15b3f0 con 0x7fd1ac0722e0 2023-11-04T01:40:23.749 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:40:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd18c0664a0 msgr2=0x7fd18c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd18c0664a0 0x7fd18c068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1940af000 tx=0x7fd1940a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 msgr2=0x7fd1ac154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 0x7fd1ac154510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00efc0 tx=0x7fd19c00c490 comp rx=0 tx=0).stop 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 shutdown_connections 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd18c0664a0 0x7fd18c068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1ac15d540 0x7fd1ac154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1ac0722e0 0x7fd1ac154510 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 --2- 172.21.15.40:0/325291370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1ac06a370 0x7fd1ac153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 >> 172.21.15.40:0/325291370 conn(0x7fd1ac0716a0 msgr2=0x7fd1ac0cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 shutdown_connections 2023-11-04T01:40:23.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:23.748+0000 7fd1b2cfd640 1 -- 172.21.15.40:0/325291370 wait complete. 2023-11-04T01:40:23.767 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:23.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:23.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-11-04T01:40:23.768 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-04T01:40:23.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:23.768 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:23.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:23.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:23.768 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:40:23.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.768 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-11-04T01:40:23.775 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:23.775 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:23.775 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:23.775 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.775 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:23.775 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-04T01:40:23.776 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42253sec preferred_lft 42253sec 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 02:42:b2:3b:1a:bc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:40:23.777 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.778 INFO:teuthology.orchestra.run.smithi091.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:40:23.778 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:23.778 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:40:23.778 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:23.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.778 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:23.830 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-11-04T01:40:23.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.832 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-11-04T01:40:23.881 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-11-04T01:40:23.881 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:23.881 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-04T01:40:23.881 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:23.881 INFO:teuthology.orchestra.run.smithi091.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:40:23.881 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:23.882 INFO:teuthology.orchestra.run.smithi091.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:40:23.882 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:40:23.882 INFO:teuthology.orchestra.run.smithi091.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:40:23.882 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:23.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.882 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:23.882 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:23.882 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:23.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:23.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:23.883 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:23.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:23.963 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-04T01:40:24.010 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:40:24.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.011 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-11-04T01:40:24.058 INFO:teuthology.orchestra.run.smithi091.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-04T01:40:24.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.058 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:24.058 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:24.059 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:24.059 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-04T01:40:24.059 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:24.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.129 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:40:24.186 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:24.186 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 92:85:55:42:d3:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::9085:55ff:fe42:d365/64 scope link 2023-11-04T01:40:24.187 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.188 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:40:24.246 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:24.246 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:24.246 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:24.246 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.246 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:24.246 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.247 INFO:teuthology.orchestra.run.smithi091.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:24.247 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 92:85:55:42:d3:65 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:24.247 INFO:teuthology.orchestra.run.smithi091.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:24.247 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.247 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::9085:55ff:fe42:d365/64 scope link 2023-11-04T01:40:24.247 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:24.248 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-04T01:40:24.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.248 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:24.248 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:24.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-04T01:40:24.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:24.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-04T01:40:24.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-04T01:40:24.249 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-04T01:40:24.249 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:24.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.347 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-11-04T01:40:24.347 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-11-04T01:40:24.347 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.1 up 2023-11-04T01:40:24.347 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:40:24.347 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-11-04T01:40:24.365 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-04T01:40:24.366 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:24.366 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:24.413 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:40:24.414 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:24.414 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:24.461 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-04T01:40:24.512 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:24.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.514 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-04T01:40:24.562 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-11-04T01:40:24.562 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-11-04T01:40:24.562 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-04T01:40:24.607 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-04T01:40:24.613 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-04T01:40:24.614 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:24.615 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:24.616 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:24.616 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:24.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:24.617 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-04T01:40:24.662 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-11-04T01:40:24.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi091.stderr:2023-11-04T01:40:24.682+0000 7f56d6d3e580 -1 init, newargv = 0x557b78708c40 newargc=15 2023-11-04T01:40:24.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi091.stderr:ceph-fuse[44003]: starting ceph client 2023-11-04T01:40:24.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi091.stderr:ceph-fuse[44003]: starting fuse 2023-11-04T01:40:25.763 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:25.771 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-11-04T01:40:25.771 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-11-04T01:40:25.771 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-11-04T01:40:25.771 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-11-04T01:40:25.771 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-11-04T01:40:25.772 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-11-04T01:40:25.773 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:25.774 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:25.774 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:25.774 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:25.774 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:25.774 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:25.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:25.775 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-11-04T01:40:25.822 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-11-04T01:40:25.822 INFO:teuthology.orchestra.run.smithi091.stdout:46 2023-11-04T01:40:25.822 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-11-04T01:40:25.822 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:25.822 DEBUG:teuthology.orchestra.run.smithi091:> import glob 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> import re 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> import os 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> import subprocess 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> def _find_admin_socket(client_name): 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> files = glob.glob(asok_path) 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> # Given a non-glob path, it better be there 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> if "*" not in asok_path: 2023-11-04T01:40:25.823 DEBUG:teuthology.orchestra.run.smithi091:> assert(len(files) == 1) 2023-11-04T01:40:25.824 DEBUG:teuthology.orchestra.run.smithi091:> return files[0] 2023-11-04T01:40:25.824 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:25.824 DEBUG:teuthology.orchestra.run.smithi091:> for f in files: 2023-11-04T01:40:25.824 DEBUG:teuthology.orchestra.run.smithi091:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:25.824 DEBUG:teuthology.orchestra.run.smithi091:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:25.824 DEBUG:teuthology.orchestra.run.smithi091:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> contents = proc_f.read() 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> if mountpoint in contents: 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> return f 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> print(_find_admin_socket("client.3")) 2023-11-04T01:40:25.825 DEBUG:teuthology.orchestra.run.smithi091:> ' 2023-11-04T01:40:25.946 INFO:teuthology.orchestra.run.smithi091.stdout:/var/run/ceph/ceph-client.3.44003.asok 2023-11-04T01:40:25.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:25.957 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44003.asok 2023-11-04T01:40:25.958 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:25.958 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.44003.asok status 2023-11-04T01:40:26.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "metadata": { 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "entity_id": "3", 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "hostname": "smithi091", 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-04T01:40:26.158 INFO:teuthology.orchestra.run.smithi091.stdout: "pid": "44003", 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "root": "/" 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_count": 0, 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4633, 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "inst": { 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "name": { 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "client", 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "num": 4633 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-04T01:40:26.159 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 2557235607 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 2557235607 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "inst_str": "client.4633 192.168.0.2:0/2557235607", 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "addr_str": "192.168.0.2:0/2557235607", 2023-11-04T01:40:26.160 INFO:teuthology.orchestra.run.smithi091.stdout: "inode_count": 1, 2023-11-04T01:40:26.161 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_epoch": 6, 2023-11-04T01:40:26.161 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch": 20, 2023-11-04T01:40:26.161 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:26.161 INFO:teuthology.orchestra.run.smithi091.stdout: "blocklisted": false, 2023-11-04T01:40:26.161 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs" 2023-11-04T01:40:26.161 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-11-04T01:40:26.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.178 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:26.179 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.238 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:40:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.246 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:26.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:26.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.299 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.309 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:26.309 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.423 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:40:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.430 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:26.431 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:26.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.488 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.489 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:26.489 DEBUG:teuthology.orchestra.run.smithi091:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:26.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.544 INFO:teuthology.orchestra.run.smithi091.stdout:fuseblk 2023-11-04T01:40:26.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.551 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:26.551 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.552 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:26.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.604 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.604 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:26.604 DEBUG:teuthology.orchestra.run.smithi091:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:26.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.689 INFO:teuthology.orchestra.run.smithi091.stdout:fuseblk 2023-11-04T01:40:26.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.695 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:26.696 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:26.696 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:26.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:26.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:26.792 INFO:teuthology.run_tasks:Running task exec... 2023-11-04T01:40:26.802 INFO:teuthology.task.exec:Executing custom commands... 2023-11-04T01:40:26.802 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:40:26.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-04T01:40:26.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 Processor -- start 2023-11-04T01:40:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 -- start start 2023-11-04T01:40:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5c400cb9e0 0x7f5c4015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c400cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c40071a20 con 0x7f5c40070bf0 2023-11-04T01:40:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4015f0a0 con 0x7f5c400cb9e0 2023-11-04T01:40:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c46cc5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400cc300 con 0x7f5c400a0db0 2023-11-04T01:40:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c45262640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5c40070bf0 0x7f5c4015b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51960/0 (socket says 172.21.15.40:51960) 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c45262640 1 -- 172.21.15.40:0/2922246923 learned_addr learned my addr 172.21.15.40:0/2922246923 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 --2- 172.21.15.40:0/2922246923 >> v2:172.21.15.91:3300/0 conn(0x7f5c400cb9e0 0x7f5c4015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3ffff640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c400cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961923323 0 0) 0x7f5c40071a20 con 0x7f5c40070bf0 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c2c003530 con 0x7f5c40070bf0 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834851776 0 0) 0x7f5c2c003530 con 0x7f5c40070bf0 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 msgr2=0x7f5c400cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c400cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 >> v2:172.21.15.91:3300/0 conn(0x7f5c400cb9e0 msgr2=0x7f5c4015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 --2- 172.21.15.40:0/2922246923 >> v2:172.21.15.91:3300/0 conn(0x7f5c400cb9e0 0x7f5c4015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4006b050 con 0x7f5c40070bf0 2023-11-04T01:40:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f5c38001a00 con 0x7f5c40070bf0 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 >> v1:172.21.15.40:6789/0 conn(0x7f5c40070bf0 legacy=0x7f5c4015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c2c0047d0 0x7f5c2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015f0a0 con 0x7f5c2c003980 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400cc300 con 0x7f5c2c0047d0 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c00b990 con 0x7f5c400a0db0 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3ffff640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c2c0047d0 0x7f5c2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c45262640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 -- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 msgr2=0x7f5c2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 -- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c2c0047d0 msgr2=0x7f5c2c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c2c0047d0 0x7f5c2c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c44a61640 1 -- 172.21.15.40:0/2922246923 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c003530 con 0x7f5c2c003980 2023-11-04T01:40:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c3ffff640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c2c0047d0 0x7f5c2c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.936+0000 7f5c45262640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c400a0db0 0x7f5c2c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c44a61640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c2c003da0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009ae0 tx=0x7f5c3001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740eea82ae525083 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300a6470 con 0x7f5c2c003980 2023-11-04T01:40:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300a65d0 con 0x7f5c2c003980 2023-11-04T01:40:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c3f7fe640 1 -- 172.21.15.40:0/2922246923 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300a6980 con 0x7f5c2c003980 2023-11-04T01:40:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c46cc5640 1 -- 172.21.15.40:0/2922246923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 msgr2=0x7f5c2c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/2922246923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c2c003da0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009ae0 tx=0x7f5c3001ca60 comp rx=0 tx=0).stop 2023-11-04T01:40:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c45262640 1 -- 172.21.15.40:0/2922246923 reap_dead start 2023-11-04T01:40:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c46cc5640 1 -- 172.21.15.40:0/2922246923 shutdown_connections 2023-11-04T01:40:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c46cc5640 1 -- 172.21.15.40:0/2922246923 >> 172.21.15.40:0/2922246923 conn(0x7f5c400cfc70 msgr2=0x7f5c400d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c46cc5640 1 -- 172.21.15.40:0/2922246923 shutdown_connections 2023-11-04T01:40:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.940+0000 7f5c46cc5640 1 -- 172.21.15.40:0/2922246923 wait complete. 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 Processor -- start 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- start start 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c400c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c4009de60 0x7f5c400cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c4015a870 0x7f5c4015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4009fa60 con 0x7f5c2c003980 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400c5790 con 0x7f5c4015a870 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015b230 con 0x7f5c4009de60 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c400c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c400c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46162/0 (socket says 172.21.15.40:46162) 2023-11-04T01:40:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 -- 172.21.15.40:0/591951321 learned_addr learned my addr 172.21.15.40:0/591951321 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c3ffff640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c4009de60 0x7f5c400cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c45262640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c4015a870 0x7f5c4015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 -- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c4009de60 msgr2=0x7f5c400cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c4009de60 0x7f5c400cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 -- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c4015a870 msgr2=0x7f5c4015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c4015a870 0x7f5c4015acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 -- 172.21.15.40:0/591951321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400c4ef0 con 0x7f5c2c003980 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c44a61640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c400c47f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c3001cf40 tx=0x7f5c2c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000f000 con 0x7f5c2c003980 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300bc450 con 0x7f5c2c003980 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c400c51d0 con 0x7f5c2c003980 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300bc800 con 0x7f5c2c003980 2023-11-04T01:40:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4009e2e0 con 0x7f5c2c003980 2023-11-04T01:40:26.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40074770 con 0x7f5c2c003980 2023-11-04T01:40:26.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c300bc960 con 0x7f5c2c003980 2023-11-04T01:40:26.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.944+0000 7f5c3d7fa640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c200664a0 0x7f5c20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.948+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c3011e280 con 0x7f5c2c003980 2023-11-04T01:40:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.948+0000 7f5c3ffff640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c200664a0 0x7f5c20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.948+0000 7f5c3ffff640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c200664a0 0x7f5c20068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c400ceb70 tx=0x7f5c28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:26.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:26.952+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c300eb790 con 0x7f5c2c003980 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.108+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7f5c400c9f70 con 0x7f5c2c003980 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c3d7fa640 1 -- 172.21.15.40:0/591951321 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7f5c300c10c0 con 0x7f5c2c003980 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c200664a0 msgr2=0x7f5c20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c200664a0 0x7f5c20068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5c400ceb70 tx=0x7f5c28008040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 msgr2=0x7f5c400c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c400c47f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c3001cf40 tx=0x7f5c2c005800 comp rx=0 tx=0).stop 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 shutdown_connections 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c200664a0 0x7f5c20068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c4015a870 0x7f5c4015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c4009de60 0x7f5c400cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 --2- 172.21.15.40:0/591951321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2c003980 0x7f5c400c47f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 >> 172.21.15.40:0/591951321 conn(0x7f5c400cfc70 msgr2=0x7f5c400ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 shutdown_connections 2023-11-04T01:40:27.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.116+0000 7f5c46cc5640 1 -- 172.21.15.40:0/591951321 wait complete. 2023-11-04T01:40:27.137 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-04T01:40:27.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 Processor -- start 2023-11-04T01:40:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 -- start start 2023-11-04T01:40:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4d10159a50 0x7f4d100cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d100ce720 0x7f4d1006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce070 0x7f4d1006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d10159e30 con 0x7f4d10159a50 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d100ccfd0 con 0x7f4d100ce720 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d15ee8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100cd2b0 con 0x7f4d100ce070 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4d10159a50 0x7f4d100cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4d10159a50 0x7f4d100cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40222/0 (socket says 172.21.15.40:40222) 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/1327602797 learned_addr learned my addr 172.21.15.40:0/1327602797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d07fff640 1 --2- 172.21.15.40:0/1327602797 >> v2:172.21.15.91:3300/0 conn(0x7f4d100ce720 0x7f4d1006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0ffff640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce070 0x7f4d1006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/1327602797 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce070 msgr2=0x7f4d1006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce070 0x7f4d1006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/1327602797 >> v2:172.21.15.91:3300/0 conn(0x7f4d100ce720 msgr2=0x7f4d1006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 --2- 172.21.15.40:0/1327602797 >> v2:172.21.15.91:3300/0 conn(0x7f4d100ce720 0x7f4d1006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/1327602797 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100cd590 con 0x7f4d10159a50 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d0ffff640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce070 0x7f4d1006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.276+0000 7f4d07fff640 1 --2- 172.21.15.40:0/1327602797 >> v2:172.21.15.91:3300/0 conn(0x7f4d100ce720 0x7f4d1006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d0f7fe640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d10159a50 0x7f4d100cc6f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d1006db30 tx=0x7f4d000211a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3b4b73eac0dd3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d0effd640 1 -- 172.21.15.40:0/1327602797 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00004030 con 0x7f4d10159a50 2023-11-04T01:40:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d0effd640 1 -- 172.21.15.40:0/1327602797 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d000ad030 con 0x7f4d10159a50 2023-11-04T01:40:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d0effd640 1 -- 172.21.15.40:0/1327602797 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00004410 con 0x7f4d10159a50 2023-11-04T01:40:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 -- 172.21.15.40:0/1327602797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d10159a50 msgr2=0x7f4d100cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d10159a50 0x7f4d100cc6f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d1006db30 tx=0x7f4d000211a0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 -- 172.21.15.40:0/1327602797 shutdown_connections 2023-11-04T01:40:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce070 0x7f4d1006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/1327602797 >> v2:172.21.15.91:3300/0 conn(0x7f4d100ce720 0x7f4d1006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/1327602797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d10159a50 0x7f4d100cc6f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 -- 172.21.15.40:0/1327602797 >> 172.21.15.40:0/1327602797 conn(0x7f4d100cebb0 msgr2=0x7f4d100cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 -- 172.21.15.40:0/1327602797 shutdown_connections 2023-11-04T01:40:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 -- 172.21.15.40:0/1327602797 wait complete. 2023-11-04T01:40:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 Processor -- start 2023-11-04T01:40:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.280+0000 7f4d15ee8640 1 -- start start 2023-11-04T01:40:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 0x7f4d100b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce720 0x7f4d100c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d10159a50 0x7f4d100b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100b3dc0 con 0x7f4d100ce070 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c49a0 con 0x7f4d10159a50 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c4bf0 con 0x7f4d100ce720 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 0x7f4d100b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 0x7f4d100b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40230/0 (socket says 172.21.15.40:40230) 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/2998285932 learned_addr learned my addr 172.21.15.40:0/2998285932 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce720 0x7f4d100c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0ffff640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d10159a50 0x7f4d100b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce720 msgr2=0x7f4d100c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce720 0x7f4d100c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d10159a50 msgr2=0x7f4d100b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d10159a50 0x7f4d100b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 -- 172.21.15.40:0/2998285932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0000b780 con 0x7f4d100ce070 2023-11-04T01:40:27.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0f7fe640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 0x7f4d100b3880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000ba70 tx=0x7f4d0001df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00003a30 con 0x7f4d100ce070 2023-11-04T01:40:27.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00003b90 con 0x7f4d100ce070 2023-11-04T01:40:27.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d100c4ed0 con 0x7f4d100ce070 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000044d0 con 0x7f4d100ce070 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d100c5490 con 0x7f4d100ce070 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d100744a0 con 0x7f4d100ce070 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d000bc420 con 0x7f4d100ce070 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0cff9640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4cf00664a0 0x7f4cf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d00123820 con 0x7f4d100ce070 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.284+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4cf00664a0 0x7f4cf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.288+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4cf00664a0 0x7f4cf0068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d1015d010 tx=0x7f4cf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.288+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d000f0dc0 con 0x7f4d100ce070 2023-11-04T01:40:27.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.448+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d100b4b30 con 0x7f4d100ce070 2023-11-04T01:40:27.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d0cff9640 1 -- 172.21.15.40:0/2998285932 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4d000c0090 con 0x7f4d100ce070 2023-11-04T01:40:27.454 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4cf00664a0 msgr2=0x7f4cf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4cf00664a0 0x7f4cf0068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d1015d010 tx=0x7f4cf8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 msgr2=0x7f4d100b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 0x7f4d100b3880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000ba70 tx=0x7f4d0001df40 comp rx=0 tx=0).stop 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 shutdown_connections 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4cf00664a0 0x7f4cf0068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d10159a50 0x7f4d100b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4d100ce720 0x7f4d100c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 --2- 172.21.15.40:0/2998285932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d100ce070 0x7f4d100b3880 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 >> 172.21.15.40:0/2998285932 conn(0x7f4d100cebb0 msgr2=0x7f4d100cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 shutdown_connections 2023-11-04T01:40:27.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.452+0000 7f4d15ee8640 1 -- 172.21.15.40:0/2998285932 wait complete. 2023-11-04T01:40:27.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:27.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:27.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a8b09c640 1 Processor -- start 2023-11-04T01:40:27.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a8b09c640 1 -- start start 2023-11-04T01:40:27.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a8b09c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a840cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a8b09c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a84166090 con 0x7f0a840c2190 2023-11-04T01:40:27.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a8b09c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840cc990 con 0x7f0a840c1db0 2023-11-04T01:40:27.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a8b09c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8406cc90 con 0x7f0a84165c70 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a83fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0a840c2190 0x7f0a8406f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43528/0 (socket says 172.21.15.40:43528) 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a83fff640 1 -- 172.21.15.40:0/2015524269 learned_addr learned my addr 172.21.15.40:0/2015524269 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a840cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476776667 0 0) 0x7f0a6c001120 con 0x7f0a840c2190 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a70003530 con 0x7f0a840c2190 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813792 0 0) 0x7f0a840cc990 con 0x7f0a840c1db0 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a6c001120 con 0x7f0a840c1db0 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513285827 0 0) 0x7f0a70003530 con 0x7f0a840c2190 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 msgr2=0x7f0a840cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a840cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 >> v1:172.21.15.91:6789/0 conn(0x7f0a840c1db0 legacy=0x7f0a840cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8406cf70 con 0x7f0a840c2190 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f0a6c001810 con 0x7f0a840c2190 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a840cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 >> v1:172.21.15.40:6789/0 conn(0x7f0a840c2190 legacy=0x7f0a8406f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a70003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a700040d0 0x7f0a700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a70004d10 0x7f0a70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8406cc90 con 0x7f0a70004d10 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7000baa0 con 0x7f0a700040d0 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7000bc60 con 0x7f0a84165c70 2023-11-04T01:40:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a70004d10 0x7f0a70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a88e38640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a70003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a83fff640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a700040d0 0x7f0a700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 -- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 msgr2=0x7f0a70003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a84165c70 0x7f0a70003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 -- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a700040d0 msgr2=0x7f0a700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a700040d0 0x7f0a700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a89639640 1 -- 172.21.15.40:0/2015524269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c009420 con 0x7f0a70004d10 2023-11-04T01:40:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.600+0000 7f0a83fff640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a700040d0 0x7f0a700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a89639640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a70004d10 0x7f0a70005190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009c60 tx=0x7f0a7c01cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3540be2b864124a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004030 con 0x7f0a70004d10 2023-11-04T01:40:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c004190 con 0x7f0a70004d10 2023-11-04T01:40:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a837fe640 1 -- 172.21.15.40:0/2015524269 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0a5870 con 0x7f0a70004d10 2023-11-04T01:40:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 -- 172.21.15.40:0/2015524269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a70004d10 msgr2=0x7f0a70005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/2015524269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a70004d10 0x7f0a70005190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009c60 tx=0x7f0a7c01cbb0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a89639640 1 -- 172.21.15.40:0/2015524269 reap_dead start 2023-11-04T01:40:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 -- 172.21.15.40:0/2015524269 shutdown_connections 2023-11-04T01:40:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 -- 172.21.15.40:0/2015524269 >> 172.21.15.40:0/2015524269 conn(0x7f0a840cb510 msgr2=0x7f0a840cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 -- 172.21.15.40:0/2015524269 shutdown_connections 2023-11-04T01:40:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 -- 172.21.15.40:0/2015524269 wait complete. 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 Processor -- start 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.604+0000 7f0a8b09c640 1 -- start start 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a70004d10 0x7f0a840c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a841f81b0 0x7f0a841f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 0x7f0a840c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c9810 con 0x7f0a840c8e50 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c29e0 con 0x7f0a70004d10 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c2cc0 con 0x7f0a841f81b0 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 0x7f0a840c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 0x7f0a840c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40248/0 (socket says 172.21.15.40:40248) 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 -- 172.21.15.40:0/340254131 learned_addr learned my addr 172.21.15.40:0/340254131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a83fff640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a841f81b0 0x7f0a841f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a88e38640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a70004d10 0x7f0a840c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 -- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a841f81b0 msgr2=0x7f0a841f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a841f81b0 0x7f0a841f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 -- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a70004d10 msgr2=0x7f0a840c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a70004d10 0x7f0a840c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 -- 172.21.15.40:0/340254131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840c2fa0 con 0x7f0a840c8e50 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a88e38640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a70004d10 0x7f0a840c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a89639640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 0x7f0a840c92d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0af040 tx=0x7f0a70005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004030 con 0x7f0a840c8e50 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c004500 con 0x7f0a840c8e50 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a840c3280 con 0x7f0a840c8e50 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c005ba0 con 0x7f0a840c8e50 2023-11-04T01:40:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a841f8630 con 0x7f0a840c8e50 2023-11-04T01:40:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a840c3410 con 0x7f0a840c8e50 2023-11-04T01:40:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a7c005d00 con 0x7f0a840c8e50 2023-11-04T01:40:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a817fa640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0a640664a0 0x7f0a64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a7c11ebf0 con 0x7f0a840c8e50 2023-11-04T01:40:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.608+0000 7f0a88e38640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0a640664a0 0x7f0a64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.612+0000 7f0a88e38640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0a640664a0 0x7f0a64068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a84159870 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.612+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0a7c0ec190 con 0x7f0a840c8e50 2023-11-04T01:40:27.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.764+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a840744a0 con 0x7f0a840c8e50 2023-11-04T01:40:27.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.764+0000 7f0a817fa640 1 -- 172.21.15.40:0/340254131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a7c006e20 con 0x7f0a840c8e50 2023-11-04T01:40:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0a640664a0 msgr2=0x7f0a64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0a640664a0 0x7f0a64068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a84159870 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 msgr2=0x7f0a840c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 0x7f0a840c92d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0af040 tx=0x7f0a70005800 comp rx=0 tx=0).stop 2023-11-04T01:40:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 shutdown_connections 2023-11-04T01:40:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0a640664a0 0x7f0a64068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a840c8e50 0x7f0a840c92d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0a841f81b0 0x7f0a841f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 --2- 172.21.15.40:0/340254131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0a70004d10 0x7f0a840c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 >> 172.21.15.40:0/340254131 conn(0x7f0a840cb510 msgr2=0x7f0a84070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 shutdown_connections 2023-11-04T01:40:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.768+0000 7f0a8b09c640 1 -- 172.21.15.40:0/340254131 wait complete. 2023-11-04T01:40:27.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:27.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 Processor -- start 2023-11-04T01:40:27.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 -- start start 2023-11-04T01:40:27.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5040b26c0 0x7ff5040b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff50406b580 0x7ff50406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff50406c1c0 0x7ff5040ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff504160cb0 con 0x7ff50406c1c0 2023-11-04T01:40:27.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040b2fe0 con 0x7ff50406b580 2023-11-04T01:40:27.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50c304640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff504160f50 con 0x7ff5040b26c0 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff50406c1c0 0x7ff5040ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff50406c1c0 0x7ff5040ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40256/0 (socket says 172.21.15.40:40256) 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 -- 172.21.15.40:0/1068104910 learned_addr learned my addr 172.21.15.40:0/1068104910 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a0a0640 1 --2- 172.21.15.40:0/1068104910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5040b26c0 0x7ff5040b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50989f640 1 --2- 172.21.15.40:0/1068104910 >> v2:172.21.15.91:3300/0 conn(0x7ff50406b580 0x7ff50406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 -- 172.21.15.40:0/1068104910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5040b26c0 msgr2=0x7ff5040b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 --2- 172.21.15.40:0/1068104910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5040b26c0 0x7ff5040b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 -- 172.21.15.40:0/1068104910 >> v2:172.21.15.91:3300/0 conn(0x7ff50406b580 msgr2=0x7ff50406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 --2- 172.21.15.40:0/1068104910 >> v2:172.21.15.91:3300/0 conn(0x7ff50406b580 0x7ff50406bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.912+0000 7ff50a8a1640 1 -- 172.21.15.40:0/1068104910 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504161230 con 0x7ff50406c1c0 2023-11-04T01:40:27.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50a8a1640 1 --2- 172.21.15.40:0/1068104910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff50406c1c0 0x7ff5040ceee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff50408b550 tx=0x7ff4fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f03bb525ff0c568 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50909e640 1 -- 172.21.15.40:0/1068104910 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5750 con 0x7ff50406c1c0 2023-11-04T01:40:27.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50909e640 1 -- 172.21.15.40:0/1068104910 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0a58b0 con 0x7ff50406c1c0 2023-11-04T01:40:27.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50909e640 1 -- 172.21.15.40:0/1068104910 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5c40 con 0x7ff50406c1c0 2023-11-04T01:40:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- 172.21.15.40:0/1068104910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff50406c1c0 msgr2=0x7ff5040ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- 172.21.15.40:0/1068104910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff50406c1c0 0x7ff5040ceee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff50408b550 tx=0x7ff4fc01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- 172.21.15.40:0/1068104910 shutdown_connections 2023-11-04T01:40:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- 172.21.15.40:0/1068104910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff50406c1c0 0x7ff5040ceee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- 172.21.15.40:0/1068104910 >> v2:172.21.15.91:3300/0 conn(0x7ff50406b580 0x7ff50406bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- 172.21.15.40:0/1068104910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5040b26c0 0x7ff5040b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- 172.21.15.40:0/1068104910 >> 172.21.15.40:0/1068104910 conn(0x7ff50409a030 msgr2=0x7ff5040d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- 172.21.15.40:0/1068104910 shutdown_connections 2023-11-04T01:40:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- 172.21.15.40:0/1068104910 wait complete. 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 Processor -- start 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- start start 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff50406b580 0x7ff5040b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff50406c1c0 0x7ff504152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 0x7ff5040ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b5890 con 0x7ff5040b26c0 2023-11-04T01:40:27.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b55b0 con 0x7ff50406b580 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50c304640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5041536e0 con 0x7ff50406c1c0 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50a8a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 0x7ff5040ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50a8a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 0x7ff5040ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40270/0 (socket says 172.21.15.40:40270) 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.916+0000 7ff50a8a1640 1 -- 172.21.15.40:0/316617107 learned_addr learned my addr 172.21.15.40:0/316617107 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50989f640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff50406c1c0 0x7ff504152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a0a0640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff50406b580 0x7ff5040b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a8a1640 1 -- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff50406c1c0 msgr2=0x7ff504152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a8a1640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff50406c1c0 0x7ff504152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a8a1640 1 -- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff50406b580 msgr2=0x7ff5040b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a8a1640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff50406b580 0x7ff5040b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a8a1640 1 -- 172.21.15.40:0/316617107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc009b30 con 0x7ff5040b26c0 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a8a1640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 0x7ff5040ae4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0af040 tx=0x7ff4fc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0b8670 con 0x7ff5040b26c0 2023-11-04T01:40:27.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0b87f0 con 0x7ff5040b26c0 2023-11-04T01:40:27.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5041539c0 con 0x7ff5040b26c0 2023-11-04T01:40:27.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0b8ba0 con 0x7ff5040b26c0 2023-11-04T01:40:27.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5041542c0 con 0x7ff5040b26c0 2023-11-04T01:40:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff504153540 con 0x7ff5040b26c0 2023-11-04T01:40:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4fc0b8d00 con 0x7ff5040b26c0 2023-11-04T01:40:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff4faffd640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff4e80664a0 0x7ff4e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4fc11f660 con 0x7ff5040b26c0 2023-11-04T01:40:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a0a0640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff4e80664a0 0x7ff4e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.920+0000 7ff50a0a0640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff4e80664a0 0x7ff4e8068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff500006fd0 tx=0x7ff500008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:27.924+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff504153540 con 0x7ff5040b26c0 2023-11-04T01:40:28.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.080+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff504153820 con 0x7ff5040b26c0 2023-11-04T01:40:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.080+0000 7ff4faffd640 1 -- 172.21.15.40:0/316617107 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff504153820 con 0x7ff5040b26c0 2023-11-04T01:40:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff4e80664a0 msgr2=0x7ff4e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff4e80664a0 0x7ff4e8068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff500006fd0 tx=0x7ff500008040 comp rx=0 tx=0).stop 2023-11-04T01:40:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 msgr2=0x7ff5040ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 0x7ff5040ae4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0af040 tx=0x7ff4fc019740 comp rx=0 tx=0).stop 2023-11-04T01:40:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 shutdown_connections 2023-11-04T01:40:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff4e80664a0 0x7ff4e8068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5040b26c0 0x7ff5040ae4c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff50406c1c0 0x7ff504152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 --2- 172.21.15.40:0/316617107 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff50406b580 0x7ff5040b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 >> 172.21.15.40:0/316617107 conn(0x7ff50409a030 msgr2=0x7ff5040b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 shutdown_connections 2023-11-04T01:40:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.084+0000 7ff50c304640 1 -- 172.21.15.40:0/316617107 wait complete. 2023-11-04T01:40:28.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:28.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 Processor -- start 2023-11-04T01:40:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 -- start start 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15c00ca550 0x7f15c00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c00cba30 con 0x7f15c015b240 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c0071e90 con 0x7f15c00ca550 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15c572c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0072170 con 0x7f15c015ae60 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15c00ca550 0x7f15c00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15c00ca550 0x7f15c00c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40276/0 (socket says 172.21.15.40:40276) 2023-11-04T01:40:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 -- 172.21.15.40:0/2158804419 learned_addr learned my addr 172.21.15.40:0/2158804419 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15beffd640 1 --2- 172.21.15.40:0/2158804419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 -- 172.21.15.40:0/2158804419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 msgr2=0x7f15c00c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 --2- 172.21.15.40:0/2158804419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 -- 172.21.15.40:0/2158804419 >> v1:172.21.15.91:6789/0 conn(0x7f15c015b240 legacy=0x7f15c015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 -- 172.21.15.40:0/2158804419 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0072450 con 0x7f15c00ca550 2023-11-04T01:40:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.224+0000 7f15be7fc640 1 --2- 172.21.15.40:0/2158804419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c00ca550 0x7f15c00c9ed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009870 tx=0x7f15a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8247cbbf6605f363 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bdffb640 1 -- 172.21.15.40:0/2158804419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80aa610 con 0x7f15c00ca550 2023-11-04T01:40:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bdffb640 1 -- 172.21.15.40:0/2158804419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80a6040 con 0x7f15c00ca550 2023-11-04T01:40:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bdffb640 1 -- 172.21.15.40:0/2158804419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80aa990 con 0x7f15c00ca550 2023-11-04T01:40:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2158804419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c00ca550 msgr2=0x7f15c00c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 --2- 172.21.15.40:0/2158804419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c00ca550 0x7f15c00c9ed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009870 tx=0x7f15a801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2158804419 shutdown_connections 2023-11-04T01:40:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 --2- 172.21.15.40:0/2158804419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c00ca550 0x7f15c00c9ed0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 --2- 172.21.15.40:0/2158804419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2158804419 >> 172.21.15.40:0/2158804419 conn(0x7f15c00b0e30 msgr2=0x7f15c00b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2158804419 shutdown_connections 2023-11-04T01:40:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2158804419 wait complete. 2023-11-04T01:40:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 Processor -- start 2023-11-04T01:40:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- start start 2023-11-04T01:40:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c00ca550 0x7f15c01550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 0x7f15c0154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01556a0 con 0x7f15c015b240 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0155980 con 0x7f15c00ca550 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0155c60 con 0x7f15c015ae60 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 0x7f15c0154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 0x7f15c0154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40292/0 (socket says 172.21.15.40:40292) 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 -- 172.21.15.40:0/2760202085 learned_addr learned my addr 172.21.15.40:0/2760202085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15be7fc640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15beffd640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c00ca550 0x7f15c01550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 -- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 msgr2=0x7f15c00c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 -- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c00ca550 msgr2=0x7f15c01550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c00ca550 0x7f15c01550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 -- 172.21.15.40:0/2760202085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80094d0 con 0x7f15c015b240 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15bf7fe640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 0x7f15c0154820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b970 tx=0x7f15b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800cb40 con 0x7f15c015b240 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b800cca0 con 0x7f15c015b240 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c0155f40 con 0x7f15c015b240 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8014680 con 0x7f15c015b240 2023-11-04T01:40:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.228+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c00c33b0 con 0x7f15c015b240 2023-11-04T01:40:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.232+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c0156460 con 0x7f15c015b240 2023-11-04T01:40:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.232+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15b801d3b0 con 0x7f15c015b240 2023-11-04T01:40:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.232+0000 7f15b77fe640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15a00664a0 0x7f15a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.232+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b8083e20 con 0x7f15c015b240 2023-11-04T01:40:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.232+0000 7f15beffd640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15a00664a0 0x7f15a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.232+0000 7f15beffd640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15a00664a0 0x7f15a0068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f15b000a970 tx=0x7f15b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.236+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15c0156460 con 0x7f15c015b240 2023-11-04T01:40:28.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.388+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15c0156460 con 0x7f15c015b240 2023-11-04T01:40:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.388+0000 7f15b77fe640 1 -- 172.21.15.40:0/2760202085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15c0156460 con 0x7f15c015b240 2023-11-04T01:40:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:28.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15a00664a0 msgr2=0x7f15a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15a00664a0 0x7f15a0068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f15b000a970 tx=0x7f15b0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 msgr2=0x7f15c0154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 0x7f15c0154820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15b800b970 tx=0x7f15b800be30 comp rx=0 tx=0).stop 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 shutdown_connections 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15a00664a0 0x7f15a0068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15c015b240 0x7f15c0154820 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15c015ae60 0x7f15c00c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 --2- 172.21.15.40:0/2760202085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15c00ca550 0x7f15c01550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 >> 172.21.15.40:0/2760202085 conn(0x7f15c00b0e30 msgr2=0x7f15c015eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 shutdown_connections 2023-11-04T01:40:28.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.392+0000 7f15c572c640 1 -- 172.21.15.40:0/2760202085 wait complete. 2023-11-04T01:40:28.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 Processor -- start 2023-11-04T01:40:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 -- start start 2023-11-04T01:40:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f26bc0b0890 0x7f26bc0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc0ce320 con 0x7f26bc0b0c70 2023-11-04T01:40:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc06d2f0 con 0x7f26bc0b0890 2023-11-04T01:40:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c343c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0ce110 con 0x7f26bc0c9960 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c11d8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f26bc0b0890 0x7f26bc0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc0704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:37722/0 (socket says 172.21.15.40:37722) 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 -- 172.21.15.40:0/1071601710 learned_addr learned my addr 172.21.15.40:0/1071601710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 -- 172.21.15.40:0/1071601710 >> v2:172.21.15.91:3300/0 conn(0x7f26bc0b0890 msgr2=0x7f26bc0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 --2- 172.21.15.40:0/1071601710 >> v2:172.21.15.91:3300/0 conn(0x7f26bc0b0890 0x7f26bc0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 -- 172.21.15.40:0/1071601710 >> v1:172.21.15.91:6789/0 conn(0x7f26bc0b0c70 legacy=0x7f26bc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.520+0000 7f26c09d7640 1 -- 172.21.15.40:0/1071601710 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0ce600 con 0x7f26bc0c9960 2023-11-04T01:40:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c09d7640 1 --2- 172.21.15.40:0/1071601710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc0704e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00bb10 tx=0x7f26ac01ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86753de6dc932d97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26b3fff640 1 -- 172.21.15.40:0/1071601710 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0a7cb0 con 0x7f26bc0c9960 2023-11-04T01:40:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26b3fff640 1 -- 172.21.15.40:0/1071601710 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0a7e10 con 0x7f26bc0c9960 2023-11-04T01:40:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26b3fff640 1 -- 172.21.15.40:0/1071601710 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0af660 con 0x7f26bc0c9960 2023-11-04T01:40:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 -- 172.21.15.40:0/1071601710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 msgr2=0x7f26bc0704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 --2- 172.21.15.40:0/1071601710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc0704e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00bb10 tx=0x7f26ac01ebe0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 -- 172.21.15.40:0/1071601710 shutdown_connections 2023-11-04T01:40:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 --2- 172.21.15.40:0/1071601710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc0704e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 --2- 172.21.15.40:0/1071601710 >> v2:172.21.15.91:3300/0 conn(0x7f26bc0b0890 0x7f26bc0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 -- 172.21.15.40:0/1071601710 >> 172.21.15.40:0/1071601710 conn(0x7f26bc0cebb0 msgr2=0x7f26bc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 -- 172.21.15.40:0/1071601710 shutdown_connections 2023-11-04T01:40:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.524+0000 7f26c343c640 1 -- 172.21.15.40:0/1071601710 wait complete. 2023-11-04T01:40:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 Processor -- start 2023-11-04T01:40:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- start start 2023-11-04T01:40:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26bc0b0890 0x7f26bc06bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 0x7f26bc0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc14f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0b3c40 con 0x7f26bc0b0c70 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc14dcd0 con 0x7f26bc0b0890 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0b30c0 con 0x7f26bc0c9960 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 0x7f26bc0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 0x7f26bc0b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40302/0 (socket says 172.21.15.40:40302) 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 -- 172.21.15.40:0/3277982115 learned_addr learned my addr 172.21.15.40:0/3277982115 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c11d8640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26bc0b0890 0x7f26bc06bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c19d9640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 -- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 msgr2=0x7f26bc14f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc14f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 -- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26bc0b0890 msgr2=0x7f26bc06bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26bc0b0890 0x7f26bc06bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 -- 172.21.15.40:0/3277982115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac00b770 con 0x7f26bc0b0c70 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c11d8640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26bc0b0890 0x7f26bc06bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c09d7640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 0x7f26bc0b26c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00b2c0 tx=0x7f26ac01b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0be070 con 0x7f26bc0b0c70 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0afbd0 con 0x7f26bc0b0c70 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc0b33a0 con 0x7f26bc0b0c70 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac006ee0 con 0x7f26bc0b0c70 2023-11-04T01:40:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc0b3960 con 0x7f26bc0b0c70 2023-11-04T01:40:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc0744a0 con 0x7f26bc0b0c70 2023-11-04T01:40:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.528+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26ac0b9440 con 0x7f26bc0b0c70 2023-11-04T01:40:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.532+0000 7f26b1ffb640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26a00664a0 0x7f26a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.532+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26ac120910 con 0x7f26bc0b0c70 2023-11-04T01:40:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.532+0000 7f26c11d8640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26a00664a0 0x7f26a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.532+0000 7f26c11d8640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26a00664a0 0x7f26a0068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26bc15bf50 tx=0x7f26b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.536+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26ac0edeb0 con 0x7f26bc0b0c70 2023-11-04T01:40:28.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.688+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26bc0cdd50 con 0x7f26bc0b0c70 2023-11-04T01:40:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26b1ffb640 1 -- 172.21.15.40:0/3277982115 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f26ac0b4090 con 0x7f26bc0b0c70 2023-11-04T01:40:28.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:28.694 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:28.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26a00664a0 msgr2=0x7f26a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26a00664a0 0x7f26a0068960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26bc15bf50 tx=0x7f26b8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 msgr2=0x7f26bc0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 0x7f26bc0b26c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00b2c0 tx=0x7f26ac01b980 comp rx=0 tx=0).stop 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 shutdown_connections 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26a00664a0 0x7f26a0068960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26bc0c9960 0x7f26bc14f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26bc0b0c70 0x7f26bc0b26c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 --2- 172.21.15.40:0/3277982115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26bc0b0890 0x7f26bc06bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 >> 172.21.15.40:0/3277982115 conn(0x7f26bc0cebb0 msgr2=0x7f26bc151970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 shutdown_connections 2023-11-04T01:40:28.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.692+0000 7f26c343c640 1 -- 172.21.15.40:0/3277982115 wait complete. 2023-11-04T01:40:28.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:28.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.824+0000 7f2604e13640 1 Processor -- start 2023-11-04T01:40:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.824+0000 7f2604e13640 1 -- start start 2023-11-04T01:40:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f2604e13640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f260015d290 0x7f26000b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f2604e13640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f26000b0a50 0x7f260006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f2604e13640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26000b0eb0 con 0x7f260006b840 2023-11-04T01:40:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f2604e13640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2600161cc0 con 0x7f26000b0a50 2023-11-04T01:40:28.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f2604e13640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000c90e0 con 0x7f260015d290 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f260015d290 0x7f26000b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fdd9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f26000b0a50 0x7f260006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f260015d290 0x7f26000b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:37736/0 (socket says 172.21.15.40:37736) 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fe59c640 1 -- 172.21.15.40:0/3667029941 learned_addr learned my addr 172.21.15.40:0/3667029941 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fed9d640 1 --1- 172.21.15.40:0/3667029941 >> v1:172.21.15.91:6789/0 conn(0x7f260006b840 0x7f26000cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46078/0 (socket says 172.21.15.40:46078) 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fdd9b640 1 -- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f260015d290 msgr2=0x7f26000b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fdd9b640 1 --2- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f260015d290 0x7f26000b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fdd9b640 1 -- 172.21.15.40:0/3667029941 >> v1:172.21.15.91:6789/0 conn(0x7f260006b840 legacy=0x7f26000cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fdd9b640 1 -- 172.21.15.40:0/3667029941 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260006c010 con 0x7f26000b0a50 2023-11-04T01:40:28.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fdd9b640 1 --2- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26000b0a50 0x7f260006b300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097c0 tx=0x7f25f401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4526e325637ae539 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fd59a640 1 -- 172.21.15.40:0/3667029941 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40ab600 con 0x7f26000b0a50 2023-11-04T01:40:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fd59a640 1 -- 172.21.15.40:0/3667029941 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f40a7050 con 0x7f26000b0a50 2023-11-04T01:40:28.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.828+0000 7f25fd59a640 1 -- 172.21.15.40:0/3667029941 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40ab980 con 0x7f26000b0a50 2023-11-04T01:40:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26000b0a50 msgr2=0x7f260006b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 --2- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26000b0a50 0x7f260006b300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f25f40097c0 tx=0x7f25f401c450 comp rx=0 tx=0).stop 2023-11-04T01:40:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3667029941 shutdown_connections 2023-11-04T01:40:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 --2- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26000b0a50 0x7f260006b300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 --2- 172.21.15.40:0/3667029941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f260015d290 0x7f26000b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3667029941 >> 172.21.15.40:0/3667029941 conn(0x7f26000cb510 msgr2=0x7f26000cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3667029941 shutdown_connections 2023-11-04T01:40:28.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3667029941 wait complete. 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 Processor -- start 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- start start 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f260006b840 0x7f2600070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26000b0a50 0x7f26001531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 0x7f2600153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600071d10 con 0x7f260015d290 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000b18e0 con 0x7f260006b840 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000b1b30 con 0x7f26000b0a50 2023-11-04T01:40:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 0x7f2600153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 0x7f2600153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40308/0 (socket says 172.21.15.40:40308) 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 -- 172.21.15.40:0/3820161735 learned_addr learned my addr 172.21.15.40:0/3820161735 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fe59c640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f260006b840 0x7f2600070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fdd9b640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26000b0a50 0x7f26001531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 -- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26000b0a50 msgr2=0x7f26001531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26000b0a50 0x7f26001531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 -- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f260006b840 msgr2=0x7f2600070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f260006b840 0x7f2600070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 -- 172.21.15.40:0/3820161735 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4009420 con 0x7f260015d290 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25fed9d640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 0x7f2600153720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c7a0 tx=0x7f25f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f800a640 con 0x7f260015d290 2023-11-04T01:40:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f800a7a0 con 0x7f260015d290 2023-11-04T01:40:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000b1e10 con 0x7f260015d290 2023-11-04T01:40:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f800ab10 con 0x7f260015d290 2023-11-04T01:40:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.832+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26000b23d0 con 0x7f260015d290 2023-11-04T01:40:28.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.836+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000744a0 con 0x7f260015d290 2023-11-04T01:40:28.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.836+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25f800ac70 con 0x7f260015d290 2023-11-04T01:40:28.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.836+0000 7f25eeffd640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25e00664d0 0x7f25e0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.836+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f80835d0 con 0x7f260015d290 2023-11-04T01:40:28.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.836+0000 7f25fe59c640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25e00664d0 0x7f25e0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.836+0000 7f25fe59c640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25e00664d0 0x7f25e0068990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009ab0 tx=0x7f25f0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.840+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25f8050b00 con 0x7f260015d290 2023-11-04T01:40:28.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26000ade30 con 0x7f260015d290 2023-11-04T01:40:28.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f25eeffd640 1 -- 172.21.15.40:0/3820161735 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25f8054120 con 0x7f260015d290 2023-11-04T01:40:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:29.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25e00664d0 msgr2=0x7f25e0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25e00664d0 0x7f25e0068990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009ab0 tx=0x7f25f0009240 comp rx=0 tx=0).stop 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 msgr2=0x7f2600153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 0x7f2600153720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c7a0 tx=0x7f25f800cc60 comp rx=0 tx=0).stop 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 shutdown_connections 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25e00664d0 0x7f25e0068990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f260015d290 0x7f2600153720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26000b0a50 0x7f26001531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 --2- 172.21.15.40:0/3820161735 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f260006b840 0x7f2600070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 >> 172.21.15.40:0/3820161735 conn(0x7f26000cb510 msgr2=0x7f26000cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 shutdown_connections 2023-11-04T01:40:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:28.996+0000 7f2604e13640 1 -- 172.21.15.40:0/3820161735 wait complete. 2023-11-04T01:40:29.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.132+0000 7fbd55761640 1 Processor -- start 2023-11-04T01:40:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.132+0000 7fbd55761640 1 -- start start 2023-11-04T01:40:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbd501541a0 0x7fbd500cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd5015e090 0x7fbd5006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd500cdea0 con 0x7fbd50154580 2023-11-04T01:40:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500ce180 con 0x7fbd5015e090 2023-11-04T01:40:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500ce460 con 0x7fbd501541a0 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd5015e090 0x7fbd5006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd5015e090 0x7fbd5006a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40312/0 (socket says 172.21.15.40:40312) 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 -- 172.21.15.40:0/3749930858 learned_addr learned my addr 172.21.15.40:0/3749930858 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4effd640 1 --2- 172.21.15.40:0/3749930858 >> v2:172.21.15.91:3300/0 conn(0x7fbd501541a0 0x7fbd500cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 -- 172.21.15.40:0/3749930858 >> v2:172.21.15.91:3300/0 conn(0x7fbd501541a0 msgr2=0x7fbd500cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 --2- 172.21.15.40:0/3749930858 >> v2:172.21.15.91:3300/0 conn(0x7fbd501541a0 0x7fbd500cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 -- 172.21.15.40:0/3749930858 >> v1:172.21.15.91:6789/0 conn(0x7fbd50154580 legacy=0x7fbd5015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 -- 172.21.15.40:0/3749930858 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500ce740 con 0x7fbd5015e090 2023-11-04T01:40:29.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4f7fe640 1 --2- 172.21.15.40:0/3749930858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5015e090 0x7fbd5006a160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd500cd320 tx=0x7fbd4801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bb48b69e58c032 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4dffb640 1 -- 172.21.15.40:0/3749930858 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480a6480 con 0x7fbd5015e090 2023-11-04T01:40:29.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4dffb640 1 -- 172.21.15.40:0/3749930858 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd480a65e0 con 0x7fbd5015e090 2023-11-04T01:40:29.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd4dffb640 1 -- 172.21.15.40:0/3749930858 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480a6970 con 0x7fbd5015e090 2023-11-04T01:40:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- 172.21.15.40:0/3749930858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5015e090 msgr2=0x7fbd5006a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 --2- 172.21.15.40:0/3749930858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5015e090 0x7fbd5006a160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd500cd320 tx=0x7fbd4801c960 comp rx=0 tx=0).stop 2023-11-04T01:40:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- 172.21.15.40:0/3749930858 shutdown_connections 2023-11-04T01:40:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 --2- 172.21.15.40:0/3749930858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5015e090 0x7fbd5006a160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 --2- 172.21.15.40:0/3749930858 >> v2:172.21.15.91:3300/0 conn(0x7fbd501541a0 0x7fbd500cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- 172.21.15.40:0/3749930858 >> 172.21.15.40:0/3749930858 conn(0x7fbd500cf340 msgr2=0x7fbd500cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- 172.21.15.40:0/3749930858 shutdown_connections 2023-11-04T01:40:29.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.136+0000 7fbd55761640 1 -- 172.21.15.40:0/3749930858 wait complete. 2023-11-04T01:40:29.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 Processor -- start 2023-11-04T01:40:29.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- start start 2023-11-04T01:40:29.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd501541a0 0x7fbd50153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 0x7fbd50151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd5015e090 0x7fbd50151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5014c9d0 con 0x7fbd50154580 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd501531f0 con 0x7fbd501541a0 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5014f3a0 con 0x7fbd5015e090 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 0x7fbd50151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 0x7fbd50151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40322/0 (socket says 172.21.15.40:40322) 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 -- 172.21.15.40:0/4035014704 learned_addr learned my addr 172.21.15.40:0/4035014704 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 -- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd5015e090 msgr2=0x7fbd50151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd5015e090 0x7fbd50151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 -- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd501541a0 msgr2=0x7fbd50153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd501541a0 0x7fbd50153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 -- 172.21.15.40:0/4035014704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48009b30 con 0x7fbd50154580 2023-11-04T01:40:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd4e7fc640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 0x7fbd50151580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c480 tx=0x7fbd4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44011790 con 0x7fbd50154580 2023-11-04T01:40:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44011910 con 0x7fbd50154580 2023-11-04T01:40:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50150f20 con 0x7fbd50154580 2023-11-04T01:40:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44011cc0 con 0x7fbd50154580 2023-11-04T01:40:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd50153440 con 0x7fbd50154580 2023-11-04T01:40:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd50153630 con 0x7fbd50154580 2023-11-04T01:40:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.140+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd4401c460 con 0x7fbd50154580 2023-11-04T01:40:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.144+0000 7fbd377fe640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd3c0664a0 0x7fbd3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.144+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd44083c80 con 0x7fbd50154580 2023-11-04T01:40:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.144+0000 7fbd4effd640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd3c0664a0 0x7fbd3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.144+0000 7fbd4effd640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd3c0664a0 0x7fbd3c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbd501f4ef0 tx=0x7fbd40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.148+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd44051190 con 0x7fbd50154580 2023-11-04T01:40:29.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.292+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd500744a0 con 0x7fbd50154580 2023-11-04T01:40:29.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd377fe640 1 -- 172.21.15.40:0/4035014704 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd440547b0 con 0x7fbd50154580 2023-11-04T01:40:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd3c0664a0 msgr2=0x7fbd3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd3c0664a0 0x7fbd3c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbd501f4ef0 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 msgr2=0x7fbd50151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 0x7fbd50151580 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c480 tx=0x7fbd4400c940 comp rx=0 tx=0).stop 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 shutdown_connections 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd3c0664a0 0x7fbd3c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd5015e090 0x7fbd50151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd50154580 0x7fbd50151580 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 --2- 172.21.15.40:0/4035014704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd501541a0 0x7fbd50153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 >> 172.21.15.40:0/4035014704 conn(0x7fbd500cf340 msgr2=0x7fbd5006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 shutdown_connections 2023-11-04T01:40:29.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.296+0000 7fbd55761640 1 -- 172.21.15.40:0/4035014704 wait complete. 2023-11-04T01:40:29.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 Processor -- start 2023-11-04T01:40:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 -- start start 2023-11-04T01:40:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d000b32f0 0x7f3d000cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d000cf4c0 0x7f3d000d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000cd830 con 0x7f3d0015af50 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d000b3780 con 0x7f3d000b32f0 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d06f3b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000cdad0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d04cd7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3d0015af50 0x7f3d000ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43542/0 (socket says 172.21.15.40:43542) 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d04cd7640 1 -- 172.21.15.40:0/2932108280 learned_addr learned my addr 172.21.15.40:0/2932108280 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cfffff640 1 --2- 172.21.15.40:0/2932108280 >> v2:172.21.15.40:3300/0 conn(0x7f3d000b32f0 0x7f3d000cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cff7fe640 1 -- 172.21.15.40:0/2932108280 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191820677 0 0) 0x7f3d000cd830 con 0x7f3d0015af50 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d054d8640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d000cf4c0 0x7f3d000d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cff7fe640 1 -- 172.21.15.40:0/2932108280 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce8003530 con 0x7f3d0015af50 2023-11-04T01:40:29.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cfffff640 1 -- 172.21.15.40:0/2932108280 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d000cf4c0 msgr2=0x7f3d000d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cfffff640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d000cf4c0 0x7f3d000d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cfffff640 1 -- 172.21.15.40:0/2932108280 >> v1:172.21.15.40:6789/0 conn(0x7f3d0015af50 legacy=0x7f3d000ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3cfffff640 1 -- 172.21.15.40:0/2932108280 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000cddb0 con 0x7f3d000b32f0 2023-11-04T01:40:29.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.436+0000 7f3d054d8640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d000cf4c0 0x7f3d000d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cfffff640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000b32f0 0x7f3d000cb330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40097c0 tx=0x7f3cf401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308dd6ee9dfce18b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cff7fe640 1 -- 172.21.15.40:0/2932108280 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40ab610 con 0x7f3d000b32f0 2023-11-04T01:40:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cff7fe640 1 -- 172.21.15.40:0/2932108280 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf40ab770 con 0x7f3d000b32f0 2023-11-04T01:40:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cff7fe640 1 -- 172.21.15.40:0/2932108280 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40abb00 con 0x7f3d000b32f0 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/2932108280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000b32f0 msgr2=0x7f3d000cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000b32f0 0x7f3d000cb330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40097c0 tx=0x7f3cf401c3f0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/2932108280 shutdown_connections 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d000cf4c0 0x7f3d000d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/2932108280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000b32f0 0x7f3d000cb330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/2932108280 >> 172.21.15.40:0/2932108280 conn(0x7f3d00065dc0 msgr2=0x7f3d000661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/2932108280 shutdown_connections 2023-11-04T01:40:29.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/2932108280 wait complete. 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 Processor -- start 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- start start 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 0x7f3d00159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d0015af50 0x7f3d000b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d000c7db0 0x7f3d001520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000b5060 con 0x7f3d000cf4c0 2023-11-04T01:40:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006bd40 con 0x7f3d000c7db0 2023-11-04T01:40:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006b410 con 0x7f3d0015af50 2023-11-04T01:40:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 0x7f3d00159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 0x7f3d00159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40340/0 (socket says 172.21.15.40:40340) 2023-11-04T01:40:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 -- 172.21.15.40:0/662426036 learned_addr learned my addr 172.21.15.40:0/662426036 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 -- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d0015af50 msgr2=0x7f3d000b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d0015af50 0x7f3d000b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 -- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d000c7db0 msgr2=0x7f3d001520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d000c7db0 0x7f3d001520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 -- 172.21.15.40:0/662426036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4009420 con 0x7f3d000cf4c0 2023-11-04T01:40:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d04cd7640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 0x7f3d00159e50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c450 tx=0x7f3cf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0007480 con 0x7f3d000cf4c0 2023-11-04T01:40:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf00075e0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0006b6f0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00059d0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.440+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d00152630 con 0x7f3d000cf4c0 2023-11-04T01:40:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.444+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d000675f0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.444+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cf0005b30 con 0x7f3d000cf4c0 2023-11-04T01:40:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.444+0000 7f3cfd7fa640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3cec0664a0 0x7f3cec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.444+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cf0083350 con 0x7f3d000cf4c0 2023-11-04T01:40:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.444+0000 7f3cfffff640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3cec0664a0 0x7f3cec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.444+0000 7f3cfffff640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3cec0664a0 0x7f3cec068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40af000 tx=0x7f3cf4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.448+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3cf00542f0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.596+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d000ceca0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.596+0000 7f3cfd7fa640 1 -- 172.21.15.40:0/662426036 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3cf00170a0 con 0x7f3d000cf4c0 2023-11-04T01:40:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3cec0664a0 msgr2=0x7f3cec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3cec0664a0 0x7f3cec068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40af000 tx=0x7f3cf4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 msgr2=0x7f3d00159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 0x7f3d00159e50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000c450 tx=0x7f3cf000c910 comp rx=0 tx=0).stop 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 shutdown_connections 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3cec0664a0 0x7f3cec068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d000c7db0 0x7f3d001520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d0015af50 0x7f3d000b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 --2- 172.21.15.40:0/662426036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d000cf4c0 0x7f3d00159e50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 >> 172.21.15.40:0/662426036 conn(0x7f3d00065dc0 msgr2=0x7f3d000cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 shutdown_connections 2023-11-04T01:40:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.600+0000 7f3d06f3b640 1 -- 172.21.15.40:0/662426036 wait complete. 2023-11-04T01:40:29.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.736+0000 7fa6fde3a640 1 Processor -- start 2023-11-04T01:40:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.736+0000 7fa6fde3a640 1 -- start start 2023-11-04T01:40:29.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6fde3a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d2b0 0x7fa6f806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6fde3a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa6f815d690 0x7fa6f80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6fde3a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6f806f8f0 0x7fa6f80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6fde3a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80ad450 con 0x7fa6f806f8f0 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6fde3a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80cd160 con 0x7fa6f815d690 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6fde3a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80cd400 con 0x7fa6f815d2b0 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6f806f8f0 0x7fa6f80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6f806f8f0 0x7fa6f80b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40354/0 (socket says 172.21.15.40:40354) 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 -- 172.21.15.40:0/3255573395 learned_addr learned my addr 172.21.15.40:0/3255573395 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f6ffd640 1 --2- 172.21.15.40:0/3255573395 >> v2:172.21.15.91:3300/0 conn(0x7fa6f815d690 0x7fa6f80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f77fe640 1 --2- 172.21.15.40:0/3255573395 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d2b0 0x7fa6f806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 -- 172.21.15.40:0/3255573395 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d2b0 msgr2=0x7fa6f806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 --2- 172.21.15.40:0/3255573395 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d2b0 0x7fa6f806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 -- 172.21.15.40:0/3255573395 >> v2:172.21.15.91:3300/0 conn(0x7fa6f815d690 msgr2=0x7fa6f80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 --2- 172.21.15.40:0/3255573395 >> v2:172.21.15.91:3300/0 conn(0x7fa6f815d690 0x7fa6f80ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 -- 172.21.15.40:0/3255573395 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80cd6e0 con 0x7fa6f806f8f0 2023-11-04T01:40:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f7fff640 1 --2- 172.21.15.40:0/3255573395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f80b0630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806df00 tx=0x7fa6f001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22196f475f4c25cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f67fc640 1 -- 172.21.15.40:0/3255573395 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00a56a0 con 0x7fa6f806f8f0 2023-11-04T01:40:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f67fc640 1 -- 172.21.15.40:0/3255573395 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f00a5800 con 0x7fa6f806f8f0 2023-11-04T01:40:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.740+0000 7fa6f67fc640 1 -- 172.21.15.40:0/3255573395 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00a5b90 con 0x7fa6f806f8f0 2023-11-04T01:40:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3255573395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 msgr2=0x7fa6f80b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3255573395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f80b0630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806df00 tx=0x7fa6f001c910 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3255573395 shutdown_connections 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3255573395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f80b0630 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3255573395 >> v2:172.21.15.91:3300/0 conn(0x7fa6f815d690 0x7fa6f80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3255573395 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d2b0 0x7fa6f806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3255573395 >> 172.21.15.40:0/3255573395 conn(0x7fa6f80cebb0 msgr2=0x7fa6f80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3255573395 shutdown_connections 2023-11-04T01:40:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3255573395 wait complete. 2023-11-04T01:40:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 Processor -- start 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- start start 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6f815d2b0 0x7fa6f8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d690 0x7fa6f815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f81f75e0 con 0x7fa6f806f8f0 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f81f6a60 con 0x7fa6f815d2b0 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6fde3a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f81f6d40 con 0x7fa6f815d690 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f8152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f8152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40368/0 (socket says 172.21.15.40:40368) 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 -- 172.21.15.40:0/3703278306 learned_addr learned my addr 172.21.15.40:0/3703278306 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f6ffd640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6f815d2b0 0x7fa6f8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f7fff640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d690 0x7fa6f815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 -- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d690 msgr2=0x7fa6f815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d690 0x7fa6f815abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 -- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6f815d2b0 msgr2=0x7fa6f8152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6f815d2b0 0x7fa6f8152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 -- 172.21.15.40:0/3703278306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0009b30 con 0x7fa6f806f8f0 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f6ffd640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6f815d2b0 0x7fa6f8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.744+0000 7fa6f77fe640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f8152610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800e8b0 tx=0x7fa6e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800c940 con 0x7fa6f806f8f0 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e800caa0 con 0x7fa6f806f8f0 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f81f7020 con 0x7fa6f806f8f0 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800ce30 con 0x7fa6f806f8f0 2023-11-04T01:40:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f8151c60 con 0x7fa6f806f8f0 2023-11-04T01:40:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f80744a0 con 0x7fa6f806f8f0 2023-11-04T01:40:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6e8013470 con 0x7fa6f806f8f0 2023-11-04T01:40:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6dffff640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa6e40664a0 0x7fa6e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6e8083f50 con 0x7fa6f806f8f0 2023-11-04T01:40:29.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6f6ffd640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa6e40664a0 0x7fa6e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.748+0000 7fa6f6ffd640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa6e40664a0 0x7fa6e4068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80c2240 tx=0x7fa6ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.752+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa6e8051460 con 0x7fa6f806f8f0 2023-11-04T01:40:29.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.916+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f8071cb0 con 0x7fa6f806f8f0 2023-11-04T01:40:29.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.916+0000 7fa6dffff640 1 -- 172.21.15.40:0/3703278306 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa6e8054a80 con 0x7fa6f806f8f0 2023-11-04T01:40:29.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa6e40664a0 msgr2=0x7fa6e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa6e40664a0 0x7fa6e4068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80c2240 tx=0x7fa6ec008040 comp rx=0 tx=0).stop 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 msgr2=0x7fa6f8152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f8152610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800e8b0 tx=0x7fa6e800ed70 comp rx=0 tx=0).stop 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 shutdown_connections 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa6e40664a0 0x7fa6e4068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa6f815d690 0x7fa6f815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6f815d2b0 0x7fa6f8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 --2- 172.21.15.40:0/3703278306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f806f8f0 0x7fa6f8152610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 >> 172.21.15.40:0/3703278306 conn(0x7fa6f80cebb0 msgr2=0x7fa6f8071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 shutdown_connections 2023-11-04T01:40:29.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:29.920+0000 7fa6fde3a640 1 -- 172.21.15.40:0/3703278306 wait complete. 2023-11-04T01:40:29.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:29.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:30.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 Processor -- start 2023-11-04T01:40:30.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 -- start start 2023-11-04T01:40:30.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff700b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7eff7006ba10 0x7eff70160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700b0eb0 con 0x7eff700b0a50 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700c90e0 con 0x7eff7006ba10 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff77059640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7006c010 con 0x7eff7015d290 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff67fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7eff700b0a50 0x7eff7006b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43554/0 (socket says 172.21.15.40:43554) 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff67fff640 1 -- 172.21.15.40:0/3809499016 learned_addr learned my addr 172.21.15.40:0/3809499016 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff700b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff755f6640 1 --2- 172.21.15.40:0/3809499016 >> v2:172.21.15.91:3300/0 conn(0x7eff7006ba10 0x7eff70160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055503299 0 0) 0x7eff700b0eb0 con 0x7eff700b0a50 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff58003530 con 0x7eff700b0a50 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157269183 0 0) 0x7eff58003530 con 0x7eff700b0a50 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 msgr2=0x7eff700b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff700b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 >> v2:172.21.15.91:3300/0 conn(0x7eff7006ba10 msgr2=0x7eff70160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 --2- 172.21.15.40:0/3809499016 >> v2:172.21.15.91:3300/0 conn(0x7eff7006ba10 0x7eff70160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700ac960 con 0x7eff700b0a50 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7eff60001680 con 0x7eff700b0a50 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 >> v1:172.21.15.40:6789/0 conn(0x7eff700b0a50 legacy=0x7eff7006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff58004d10 0x7eff58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700c90e0 con 0x7eff58003980 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7006c010 con 0x7eff58004d10 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5800b990 con 0x7eff7015d290 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff67fff640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff755f6640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff58004d10 0x7eff58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 -- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 msgr2=0x7eff580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 -- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff58004d10 msgr2=0x7eff58005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff58004d10 0x7eff58005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff74df5640 1 -- 172.21.15.40:0/3809499016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58003530 con 0x7eff58003980 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff755f6640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff58004d10 0x7eff58005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:30.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.060+0000 7eff67fff640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff7015d290 0x7eff580047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff74df5640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff58003da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009ae0 tx=0x7eff6c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e54380fdd0ad293 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a6510 con 0x7eff58003980 2023-11-04T01:40:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c0a6670 con 0x7eff58003980 2023-11-04T01:40:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff677fe640 1 -- 172.21.15.40:0/3809499016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a6a20 con 0x7eff58003980 2023-11-04T01:40:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 -- 172.21.15.40:0/3809499016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 msgr2=0x7eff58003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 --2- 172.21.15.40:0/3809499016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff58003da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009ae0 tx=0x7eff6c01ca20 comp rx=0 tx=0).stop 2023-11-04T01:40:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff755f6640 1 -- 172.21.15.40:0/3809499016 reap_dead start 2023-11-04T01:40:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 -- 172.21.15.40:0/3809499016 shutdown_connections 2023-11-04T01:40:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 -- 172.21.15.40:0/3809499016 >> 172.21.15.40:0/3809499016 conn(0x7eff700cb510 msgr2=0x7eff700cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 -- 172.21.15.40:0/3809499016 shutdown_connections 2023-11-04T01:40:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 -- 172.21.15.40:0/3809499016 wait complete. 2023-11-04T01:40:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 Processor -- start 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.064+0000 7eff77059640 1 -- start start 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff700c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff70154d50 0x7eff700c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff700c9f20 0x7eff700c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700ca3d0 con 0x7eff58003980 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700c7140 con 0x7eff70154d50 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700c8970 con 0x7eff700c9f20 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff700c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff700c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40372/0 (socket says 172.21.15.40:40372) 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 -- 172.21.15.40:0/2880848159 learned_addr learned my addr 172.21.15.40:0/2880848159 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 -- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff700c9f20 msgr2=0x7eff700c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff67fff640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff70154d50 0x7eff700c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff755f6640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff700c9f20 0x7eff700c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff700c9f20 0x7eff700c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 -- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff70154d50 msgr2=0x7eff700c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff70154d50 0x7eff700c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 -- 172.21.15.40:0/2880848159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700c7390 con 0x7eff58003980 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff74df5640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff700c8430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff6c01c850 tx=0x7eff58005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00f0c0 con 0x7eff58003980 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c0a67e0 con 0x7eff58003980 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a6b90 con 0x7eff58003980 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff700c7670 con 0x7eff58003980 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff700c7c30 con 0x7eff58003980 2023-11-04T01:40:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff700744a0 con 0x7eff58003980 2023-11-04T01:40:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff6c0a6cf0 con 0x7eff58003980 2023-11-04T01:40:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff657fa640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff5c0664d0 0x7eff5c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff6c0aa070 con 0x7eff58003980 2023-11-04T01:40:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.068+0000 7eff67fff640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff5c0664d0 0x7eff5c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.072+0000 7eff67fff640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff5c0664d0 0x7eff5c068990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff60001ec0 tx=0x7eff60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.072+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff6c0ebfb0 con 0x7eff58003980 2023-11-04T01:40:30.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.228+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff700ccc40 con 0x7eff58003980 2023-11-04T01:40:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff657fa640 1 -- 172.21.15.40:0/2880848159 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff6c0ef5d0 con 0x7eff58003980 2023-11-04T01:40:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff5c0664d0 msgr2=0x7eff5c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff5c0664d0 0x7eff5c068990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff60001ec0 tx=0x7eff60009040 comp rx=0 tx=0).stop 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 msgr2=0x7eff700c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff700c8430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff6c01c850 tx=0x7eff58005800 comp rx=0 tx=0).stop 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 shutdown_connections 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff5c0664d0 0x7eff5c068990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff700c9f20 0x7eff700c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff70154d50 0x7eff700c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 --2- 172.21.15.40:0/2880848159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff58003980 0x7eff700c8430 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 >> 172.21.15.40:0/2880848159 conn(0x7eff700cb510 msgr2=0x7eff7006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 shutdown_connections 2023-11-04T01:40:30.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.232+0000 7eff77059640 1 -- 172.21.15.40:0/2880848159 wait complete. 2023-11-04T01:40:30.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 Processor -- start 2023-11-04T01:40:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 -- start start 2023-11-04T01:40:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13b815af70 0x7f13b80cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b806c0c0 con 0x7f13b806d160 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b815e8e0 con 0x7f13b815af70 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bfe7c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8071200 con 0x7f13b815e490 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13be419640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bdc18640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13b815af70 0x7f13b80cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13be419640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:37830/0 (socket says 172.21.15.40:37830) 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bd417640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f13b806d160 0x7f13b815dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46092/0 (socket says 172.21.15.40:46092) 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13bdc18640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13b815af70 0x7f13b80cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:39948/0 (socket says 172.21.15.40:39948) 2023-11-04T01:40:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.388+0000 7f13be419640 1 -- 172.21.15.40:0/1245714714 learned_addr learned my addr 172.21.15.40:0/1245714714 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13be419640 1 -- 172.21.15.40:0/1245714714 >> v2:172.21.15.91:3300/0 conn(0x7f13b815af70 msgr2=0x7f13b80cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13be419640 1 --2- 172.21.15.40:0/1245714714 >> v2:172.21.15.91:3300/0 conn(0x7f13b815af70 0x7f13b80cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13be419640 1 -- 172.21.15.40:0/1245714714 >> v1:172.21.15.91:6789/0 conn(0x7f13b806d160 legacy=0x7f13b815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13be419640 1 -- 172.21.15.40:0/1245714714 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b806c3a0 con 0x7f13b815e490 2023-11-04T01:40:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13be419640 1 --2- 172.21.15.40:0/1245714714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80cdfe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009e50 tx=0x7f13b001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a6d587e380c3b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bcc16640 1 -- 172.21.15.40:0/1245714714 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00a57d0 con 0x7f13b815e490 2023-11-04T01:40:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bcc16640 1 -- 172.21.15.40:0/1245714714 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00a5930 con 0x7f13b815e490 2023-11-04T01:40:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bcc16640 1 -- 172.21.15.40:0/1245714714 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00a5cc0 con 0x7f13b815e490 2023-11-04T01:40:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 -- 172.21.15.40:0/1245714714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 msgr2=0x7f13b80cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/1245714714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80cdfe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009e50 tx=0x7f13b001ca10 comp rx=0 tx=0).stop 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 -- 172.21.15.40:0/1245714714 shutdown_connections 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/1245714714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80cdfe0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/1245714714 >> v2:172.21.15.91:3300/0 conn(0x7f13b815af70 0x7f13b80cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 -- 172.21.15.40:0/1245714714 >> 172.21.15.40:0/1245714714 conn(0x7f13b80cb510 msgr2=0x7f13b80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 -- 172.21.15.40:0/1245714714 shutdown_connections 2023-11-04T01:40:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.392+0000 7f13bfe7c640 1 -- 172.21.15.40:0/1245714714 wait complete. 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 Processor -- start 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 -- start start 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 0x7f13b8151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13b815af70 0x7f13b80b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80c25c0 con 0x7f13b806d160 2023-11-04T01:40:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80c2e60 con 0x7f13b815af70 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80b42b0 con 0x7f13b815e490 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 0x7f13b8151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 0x7f13b8151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40382/0 (socket says 172.21.15.40:40382) 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 -- 172.21.15.40:0/695469084 learned_addr learned my addr 172.21.15.40:0/695469084 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13be419640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bd417640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13b815af70 0x7f13b80b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 -- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 msgr2=0x7f13b80b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 -- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13b815af70 msgr2=0x7f13b80b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13b815af70 0x7f13b80b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 -- 172.21.15.40:0/695469084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009b30 con 0x7f13b806d160 2023-11-04T01:40:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bdc18640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 0x7f13b8151430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13b400e960 tx=0x7f13b400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4009690 con 0x7f13b806d160 2023-11-04T01:40:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b400ca00 con 0x7f13b806d160 2023-11-04T01:40:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b80c2810 con 0x7f13b806d160 2023-11-04T01:40:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b400cd70 con 0x7f13b806d160 2023-11-04T01:40:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.396+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b8148c60 con 0x7f13b806d160 2023-11-04T01:40:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.400+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b80744a0 con 0x7f13b806d160 2023-11-04T01:40:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.400+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13b4013470 con 0x7f13b806d160 2023-11-04T01:40:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.400+0000 7f13ae7fc640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f139c0664d0 0x7f139c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.400+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13b4084050 con 0x7f13b806d160 2023-11-04T01:40:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.400+0000 7f13bd417640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f139c0664d0 0x7f139c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.400+0000 7f13bd417640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f139c0664d0 0x7f139c068990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13b815a970 tx=0x7f13a8007c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.404+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13b40b5090 con 0x7f13b806d160 2023-11-04T01:40:30.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13b806b950 con 0x7f13b806d160 2023-11-04T01:40:30.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13ae7fc640 1 -- 172.21.15.40:0/695469084 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13b40514e0 con 0x7f13b806d160 2023-11-04T01:40:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f139c0664d0 msgr2=0x7f139c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f139c0664d0 0x7f139c068990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13b815a970 tx=0x7f13a8007c50 comp rx=0 tx=0).stop 2023-11-04T01:40:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 msgr2=0x7f13b8151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 0x7f13b8151430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13b400e960 tx=0x7f13b400ee20 comp rx=0 tx=0).stop 2023-11-04T01:40:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 shutdown_connections 2023-11-04T01:40:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f139c0664d0 0x7f139c068990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13b815e490 0x7f13b80b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13b815af70 0x7f13b80b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 --2- 172.21.15.40:0/695469084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b806d160 0x7f13b8151430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 >> 172.21.15.40:0/695469084 conn(0x7f13b80cb510 msgr2=0x7f13b815ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 shutdown_connections 2023-11-04T01:40:30.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.556+0000 7f13bfe7c640 1 -- 172.21.15.40:0/695469084 wait complete. 2023-11-04T01:40:30.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:30.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 Processor -- start 2023-11-04T01:40:30.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 -- start start 2023-11-04T01:40:30.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b9015cb90 0x7f2b900704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b900716c0 0x7f2b900c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b900c9830 0x7f2b9015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b900c9cc0 con 0x7f2b900716c0 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b900ccda0 con 0x7f2b9015cb90 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b96d53640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b90070db0 con 0x7f2b900c9830 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b900716c0 0x7f2b900c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b900716c0 0x7f2b900c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40388/0 (socket says 172.21.15.40:40388) 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 -- 172.21.15.40:0/1817636626 learned_addr learned my addr 172.21.15.40:0/1817636626 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b94aef640 1 --2- 172.21.15.40:0/1817636626 >> v2:172.21.15.91:3300/0 conn(0x7f2b9015cb90 0x7f2b900704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b952f0640 1 --2- 172.21.15.40:0/1817636626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b900c9830 0x7f2b9015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 -- 172.21.15.40:0/1817636626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b900c9830 msgr2=0x7f2b9015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 --2- 172.21.15.40:0/1817636626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b900c9830 0x7f2b9015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 -- 172.21.15.40:0/1817636626 >> v2:172.21.15.91:3300/0 conn(0x7f2b9015cb90 msgr2=0x7f2b900704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 --2- 172.21.15.40:0/1817636626 >> v2:172.21.15.91:3300/0 conn(0x7f2b9015cb90 0x7f2b900704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.688+0000 7f2b8ffff640 1 -- 172.21.15.40:0/1817636626 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90071090 con 0x7f2b900716c0 2023-11-04T01:40:30.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 --2- 172.21.15.40:0/1817636626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900716c0 0x7f2b900c92f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b900cc590 tx=0x7f2b8401d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f76a84c906cd1a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8f7fe640 1 -- 172.21.15.40:0/1817636626 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840a6760 con 0x7f2b900716c0 2023-11-04T01:40:30.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8f7fe640 1 -- 172.21.15.40:0/1817636626 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840a68c0 con 0x7f2b900716c0 2023-11-04T01:40:30.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8f7fe640 1 -- 172.21.15.40:0/1817636626 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840a6c50 con 0x7f2b900716c0 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- 172.21.15.40:0/1817636626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900716c0 msgr2=0x7f2b900c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- 172.21.15.40:0/1817636626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900716c0 0x7f2b900c92f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b900cc590 tx=0x7f2b8401d8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- 172.21.15.40:0/1817636626 shutdown_connections 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- 172.21.15.40:0/1817636626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b900c9830 0x7f2b9015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- 172.21.15.40:0/1817636626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900716c0 0x7f2b900c92f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- 172.21.15.40:0/1817636626 >> v2:172.21.15.91:3300/0 conn(0x7f2b9015cb90 0x7f2b900704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- 172.21.15.40:0/1817636626 >> 172.21.15.40:0/1817636626 conn(0x7f2b900cb510 msgr2=0x7f2b900cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- 172.21.15.40:0/1817636626 shutdown_connections 2023-11-04T01:40:30.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- 172.21.15.40:0/1817636626 wait complete. 2023-11-04T01:40:30.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 Processor -- start 2023-11-04T01:40:30.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- start start 2023-11-04T01:40:30.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b900716c0 0x7f2b900b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 0x7f2b900cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b9015cb90 0x7f2b900c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900cdff0 con 0x7f2b900c9830 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c34e0 con 0x7f2b900716c0 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b96d53640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c3200 con 0x7f2b9015cb90 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 0x7f2b900cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 0x7f2b900cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40402/0 (socket says 172.21.15.40:40402) 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 -- 172.21.15.40:0/4279412274 learned_addr learned my addr 172.21.15.40:0/4279412274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b94aef640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b900716c0 0x7f2b900b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b952f0640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b9015cb90 0x7f2b900c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 -- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b9015cb90 msgr2=0x7f2b900c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b9015cb90 0x7f2b900c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 -- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b900716c0 msgr2=0x7f2b900b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b900716c0 0x7f2b900b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 -- 172.21.15.40:0/4279412274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8400a670 con 0x7f2b900c9830 2023-11-04T01:40:30.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.692+0000 7f2b8ffff640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 0x7f2b900cdab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400a1c0 tx=0x7f2b8401a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840ae850 con 0x7f2b900c9830 2023-11-04T01:40:30.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840ae9d0 con 0x7f2b900c9830 2023-11-04T01:40:30.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840aed80 con 0x7f2b900c9830 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b90151b30 con 0x7f2b900c9830 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b901520f0 con 0x7f2b900c9830 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b90151990 con 0x7f2b900c9830 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b840b63f0 con 0x7f2b900c9830 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b8d7fa640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b7c0664a0 0x7f2b7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b8411e0b0 con 0x7f2b900c9830 2023-11-04T01:40:30.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b94aef640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b7c0664a0 0x7f2b7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.696+0000 7f2b94aef640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b7c0664a0 0x7f2b7c068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800d8d0 tx=0x7f2b88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.700+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b90151990 con 0x7f2b900c9830 2023-11-04T01:40:30.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.848+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b90151990 con 0x7f2b900c9830 2023-11-04T01:40:30.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.848+0000 7f2b8d7fa640 1 -- 172.21.15.40:0/4279412274 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b90151990 con 0x7f2b900c9830 2023-11-04T01:40:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b7c0664a0 msgr2=0x7f2b7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b7c0664a0 0x7f2b7c068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800d8d0 tx=0x7f2b88008040 comp rx=0 tx=0).stop 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 msgr2=0x7f2b900cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 0x7f2b900cdab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400a1c0 tx=0x7f2b8401a670 comp rx=0 tx=0).stop 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 shutdown_connections 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b7c0664a0 0x7f2b7c068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b9015cb90 0x7f2b900c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b900c9830 0x7f2b900cdab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 --2- 172.21.15.40:0/4279412274 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b900716c0 0x7f2b900b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 >> 172.21.15.40:0/4279412274 conn(0x7f2b900cb510 msgr2=0x7f2b90153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 shutdown_connections 2023-11-04T01:40:30.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.852+0000 7f2b96d53640 1 -- 172.21.15.40:0/4279412274 wait complete. 2023-11-04T01:40:30.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:30.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9e399640 1 Processor -- start 2023-11-04T01:40:30.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9e399640 1 -- start start 2023-11-04T01:40:30.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9e399640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d98159a50 0x7f5d980cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9e399640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d98159e30 con 0x7f5d9806c1a0 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9e399640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d980ccfd0 con 0x7f5d980ce720 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9e399640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d980cd2b0 con 0x7f5d98159a50 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d98159a50 0x7f5d980cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d98159a50 0x7f5d980cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40418/0 (socket says 172.21.15.40:40418) 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d97fff640 1 -- 172.21.15.40:0/525710728 learned_addr learned my addr 172.21.15.40:0/525710728 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d9c936640 1 --1- 172.21.15.40:0/525710728 >> v1:172.21.15.40:6789/0 conn(0x7f5d9806c1a0 0x7f5d9806fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43560/0 (socket says 172.21.15.40:43560) 2023-11-04T01:40:30.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d97fff640 1 -- 172.21.15.40:0/525710728 >> v1:172.21.15.91:6789/0 conn(0x7f5d980ce720 legacy=0x7f5d9806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d97fff640 1 -- 172.21.15.40:0/525710728 >> v1:172.21.15.40:6789/0 conn(0x7f5d9806c1a0 legacy=0x7f5d9806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d97fff640 1 -- 172.21.15.40:0/525710728 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980cd590 con 0x7f5d98159a50 2023-11-04T01:40:30.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.984+0000 7f5d96ffd640 1 -- 172.21.15.40:0/525710728 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929791503 0 0) 0x7f5d88001120 con 0x7f5d9806c1a0 2023-11-04T01:40:30.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d97fff640 1 --2- 172.21.15.40:0/525710728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d98159a50 0x7f5d980cc6f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009e50 tx=0x7f5d9001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ca108eb0e261d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d96ffd640 1 -- 172.21.15.40:0/525710728 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d900af400 con 0x7f5d98159a50 2023-11-04T01:40:30.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d96ffd640 1 -- 172.21.15.40:0/525710728 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d900ab050 con 0x7f5d98159a50 2023-11-04T01:40:30.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d96ffd640 1 -- 172.21.15.40:0/525710728 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d900af780 con 0x7f5d98159a50 2023-11-04T01:40:30.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- 172.21.15.40:0/525710728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d98159a50 msgr2=0x7f5d980cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 --2- 172.21.15.40:0/525710728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d98159a50 0x7f5d980cc6f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009e50 tx=0x7f5d9001f1c0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- 172.21.15.40:0/525710728 shutdown_connections 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 --2- 172.21.15.40:0/525710728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d98159a50 0x7f5d980cc6f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- 172.21.15.40:0/525710728 >> 172.21.15.40:0/525710728 conn(0x7f5d980cebb0 msgr2=0x7f5d980cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- 172.21.15.40:0/525710728 shutdown_connections 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- 172.21.15.40:0/525710728 wait complete. 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 Processor -- start 2023-11-04T01:40:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- start start 2023-11-04T01:40:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d9806c1a0 0x7f5d980c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 0x7f5d980b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d98159a50 0x7f5d980b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98155780 con 0x7f5d980ce720 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981f19f0 con 0x7f5d98159a50 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9e399640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981f4430 con 0x7f5d9806c1a0 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 0x7f5d980b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 0x7f5d980b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40424/0 (socket says 172.21.15.40:40424) 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 -- 172.21.15.40:0/453929897 learned_addr learned my addr 172.21.15.40:0/453929897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d97fff640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d9806c1a0 0x7f5d980c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 -- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d9806c1a0 msgr2=0x7f5d980c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d9c936640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d98159a50 0x7f5d980b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d9806c1a0 0x7f5d980c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 -- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d98159a50 msgr2=0x7f5d980b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d98159a50 0x7f5d980b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 -- 172.21.15.40:0/453929897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d90009b30 con 0x7f5d980ce720 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d977fe640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 0x7f5d980b3da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c410 tx=0x7f5d8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80011790 con 0x7f5d980ce720 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800118f0 con 0x7f5d980ce720 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.988+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d80011ce0 con 0x7f5d980ce720 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d981f4710 con 0x7f5d980ce720 2023-11-04T01:40:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d980c4cd0 con 0x7f5d980ce720 2023-11-04T01:40:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d980744a0 con 0x7f5d980ce720 2023-11-04T01:40:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d8001c460 con 0x7f5d980ce720 2023-11-04T01:40:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d94ff9640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d780664a0 0x7f5d78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d80083bd0 con 0x7f5d980ce720 2023-11-04T01:40:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d97fff640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d780664a0 0x7f5d78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.992+0000 7f5d97fff640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d780664a0 0x7f5d78068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d900b1000 tx=0x7f5d900aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:30.996+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d80051040 con 0x7f5d980ce720 2023-11-04T01:40:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.156+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d981f4bc0 con 0x7f5d980ce720 2023-11-04T01:40:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.156+0000 7f5d94ff9640 1 -- 172.21.15.40:0/453929897 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f5d80054660 con 0x7f5d980ce720 2023-11-04T01:40:31.160 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d780664a0 msgr2=0x7f5d78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d780664a0 0x7f5d78068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5d900b1000 tx=0x7f5d900aa000 comp rx=0 tx=0).stop 2023-11-04T01:40:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 msgr2=0x7f5d980b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 0x7f5d980b3da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000c410 tx=0x7f5d8000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 shutdown_connections 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d780664a0 0x7f5d78068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d98159a50 0x7f5d980b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d980ce720 0x7f5d980b3da0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 --2- 172.21.15.40:0/453929897 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d9806c1a0 0x7f5d980c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 >> 172.21.15.40:0/453929897 conn(0x7f5d980cebb0 msgr2=0x7f5d98159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 shutdown_connections 2023-11-04T01:40:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.160+0000 7f5d9e399640 1 -- 172.21.15.40:0/453929897 wait complete. 2023-11-04T01:40:31.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:31.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:31.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 Processor -- start 2023-11-04T01:40:31.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 -- start start 2023-11-04T01:40:31.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b81438e0 0x7fe0b80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0b806a870 0x7fe0b806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b8161760 con 0x7fe0b8146510 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b8161a40 con 0x7fe0b806a870 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0bd759640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80d0790 con 0x7fe0b81438e0 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0b806a870 0x7fe0b806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0b806a870 0x7fe0b806cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40426/0 (socket says 172.21.15.40:40426) 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 -- 172.21.15.40:0/3214131244 learned_addr learned my addr 172.21.15.40:0/3214131244 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b6ffd640 1 --2- 172.21.15.40:0/3214131244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b81438e0 0x7fe0b80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 -- 172.21.15.40:0/3214131244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b81438e0 msgr2=0x7fe0b80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 --2- 172.21.15.40:0/3214131244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b81438e0 0x7fe0b80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 -- 172.21.15.40:0/3214131244 >> v1:172.21.15.91:6789/0 conn(0x7fe0b8146510 legacy=0x7fe0b806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.308+0000 7fe0b77fe640 1 -- 172.21.15.40:0/3214131244 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b80d0a00 con 0x7fe0b806a870 2023-11-04T01:40:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0b77fe640 1 --2- 172.21.15.40:0/3214131244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b806cca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009870 tx=0x7fe0b001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd22b88df096b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0b5ffb640 1 -- 172.21.15.40:0/3214131244 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00ab600 con 0x7fe0b806a870 2023-11-04T01:40:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0b5ffb640 1 -- 172.21.15.40:0/3214131244 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b00a7050 con 0x7fe0b806a870 2023-11-04T01:40:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0b5ffb640 1 -- 172.21.15.40:0/3214131244 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00ab980 con 0x7fe0b806a870 2023-11-04T01:40:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 -- 172.21.15.40:0/3214131244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 msgr2=0x7fe0b806cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 --2- 172.21.15.40:0/3214131244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b806cca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009870 tx=0x7fe0b001c4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 -- 172.21.15.40:0/3214131244 shutdown_connections 2023-11-04T01:40:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 --2- 172.21.15.40:0/3214131244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b806cca0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 --2- 172.21.15.40:0/3214131244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b81438e0 0x7fe0b80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 -- 172.21.15.40:0/3214131244 >> 172.21.15.40:0/3214131244 conn(0x7fe0b80cfc70 msgr2=0x7fe0b80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 -- 172.21.15.40:0/3214131244 shutdown_connections 2023-11-04T01:40:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 -- 172.21.15.40:0/3214131244 wait complete. 2023-11-04T01:40:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 Processor -- start 2023-11-04T01:40:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.312+0000 7fe0bd759640 1 -- start start 2023-11-04T01:40:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b815c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0b81438e0 0x7fe0b8147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b8146510 0x7fe0b815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b81480d0 con 0x7fe0b806a870 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815caa0 con 0x7fe0b81438e0 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815cd80 con 0x7fe0b8146510 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b815c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40442/0 (socket says 172.21.15.40:40442) 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 -- 172.21.15.40:0/2480129685 learned_addr learned my addr 172.21.15.40:0/2480129685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b77fe640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b8146510 0x7fe0b815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 -- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b8146510 msgr2=0x7fe0b815ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b8146510 0x7fe0b815ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b67fc640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0b81438e0 0x7fe0b8147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 -- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0b81438e0 msgr2=0x7fe0b8147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0b81438e0 0x7fe0b8147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 -- 172.21.15.40:0/2480129685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00094d0 con 0x7fe0b806a870 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b6ffd640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b815c450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e930 tx=0x7fe0a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0009690 con 0x7fe0b806a870 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000ca00 con 0x7fe0b806a870 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b815d060 con 0x7fe0b806a870 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000cd70 con 0x7fe0b806a870 2023-11-04T01:40:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b815d620 con 0x7fe0b806a870 2023-11-04T01:40:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b80675f0 con 0x7fe0b806a870 2023-11-04T01:40:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0a0013470 con 0x7fe0b806a870 2023-11-04T01:40:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0af7fe640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0980664a0 0x7fe098068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0a00840c0 con 0x7fe0b806a870 2023-11-04T01:40:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.316+0000 7fe0b67fc640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0980664a0 0x7fe098068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.320+0000 7fe0b67fc640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0980664a0 0x7fe098068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe0b814ea50 tx=0x7fe0a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.320+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe0a0051690 con 0x7fe0b806a870 2023-11-04T01:40:31.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.476+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0b8071b50 con 0x7fe0b806a870 2023-11-04T01:40:31.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.476+0000 7fe0af7fe640 1 -- 172.21.15.40:0/2480129685 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0a0054cb0 con 0x7fe0b806a870 2023-11-04T01:40:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:31.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0980664a0 msgr2=0x7fe098068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0980664a0 0x7fe098068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe0b814ea50 tx=0x7fe0a8009040 comp rx=0 tx=0).stop 2023-11-04T01:40:31.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 msgr2=0x7fe0b815c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b815c450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000e930 tx=0x7fe0a000edf0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 shutdown_connections 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0980664a0 0x7fe098068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0b8146510 0x7fe0b815ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0b81438e0 0x7fe0b8147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 --2- 172.21.15.40:0/2480129685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b806a870 0x7fe0b815c450 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 >> 172.21.15.40:0/2480129685 conn(0x7fe0b80cfc70 msgr2=0x7fe0b806e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 shutdown_connections 2023-11-04T01:40:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.480+0000 7fe0bd759640 1 -- 172.21.15.40:0/2480129685 wait complete. 2023-11-04T01:40:31.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2ae25d640 1 Processor -- start 2023-11-04T01:40:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2ae25d640 1 -- start start 2023-11-04T01:40:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2ae25d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2a8070270 0x7ff2a80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2ae25d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80ca460 con 0x7ff2a815aed0 2023-11-04T01:40:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2ae25d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80cbb90 con 0x7ff2a80ca8f0 2023-11-04T01:40:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2ae25d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80c9810 con 0x7ff2a8070270 2023-11-04T01:40:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2a8070270 0x7ff2a80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff2a815aed0 0x7ff2a80c6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43576/0 (socket says 172.21.15.40:43576) 2023-11-04T01:40:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a77fe640 1 -- 172.21.15.40:0/139318211 learned_addr learned my addr 172.21.15.40:0/139318211 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a6ffd640 1 -- 172.21.15.40:0/139318211 >> v1:172.21.15.91:6789/0 conn(0x7ff2a80ca8f0 legacy=0x7ff2a806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a6ffd640 1 -- 172.21.15.40:0/139318211 >> v1:172.21.15.40:6789/0 conn(0x7ff2a815aed0 legacy=0x7ff2a80c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a6ffd640 1 -- 172.21.15.40:0/139318211 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a80c9b30 con 0x7ff2a8070270 2023-11-04T01:40:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.620+0000 7ff2a67fc640 1 -- 172.21.15.40:0/139318211 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566629277 0 0) 0x7ff2a80ca460 con 0x7ff2a815aed0 2023-11-04T01:40:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a6ffd640 1 --2- 172.21.15.40:0/139318211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80cb4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0097c0 tx=0x7ff29c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6078753b890d61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a67fc640 1 -- 172.21.15.40:0/139318211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0ad680 con 0x7ff2a8070270 2023-11-04T01:40:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a67fc640 1 -- 172.21.15.40:0/139318211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c0ad7e0 con 0x7ff2a8070270 2023-11-04T01:40:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a67fc640 1 -- 172.21.15.40:0/139318211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0adb70 con 0x7ff2a8070270 2023-11-04T01:40:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/139318211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 msgr2=0x7ff2a80cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/139318211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80cb4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0097c0 tx=0x7ff29c01c380 comp rx=0 tx=0).stop 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/139318211 shutdown_connections 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/139318211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80cb4d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/139318211 >> 172.21.15.40:0/139318211 conn(0x7ff2a80cf340 msgr2=0x7ff2a80cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/139318211 shutdown_connections 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/139318211 wait complete. 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 Processor -- start 2023-11-04T01:40:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- start start 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff2a80ca8f0 0x7ff2a8154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2a815aed0 0x7ff2a8155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b2830 con 0x7ff2a8070270 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b2b10 con 0x7ff2a815aed0 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b2df0 con 0x7ff2a80ca8f0 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40454/0 (socket says 172.21.15.40:40454) 2023-11-04T01:40:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 -- 172.21.15.40:0/283072946 learned_addr learned my addr 172.21.15.40:0/283072946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a6ffd640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff2a80ca8f0 0x7ff2a8154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a7fff640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2a815aed0 0x7ff2a8155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 -- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff2a80ca8f0 msgr2=0x7ff2a8154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff2a80ca8f0 0x7ff2a8154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 -- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2a815aed0 msgr2=0x7ff2a8155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2a815aed0 0x7ff2a8155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 -- 172.21.15.40:0/283072946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009420 con 0x7ff2a8070270 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a7fff640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2a815aed0 0x7ff2a8155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2a77fe640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80b1f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff29800c480 tx=0x7ff29800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980074e0 con 0x7ff2a8070270 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298007660 con 0x7ff2a8070270 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a80b30d0 con 0x7ff2a8070270 2023-11-04T01:40:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298004a30 con 0x7ff2a8070270 2023-11-04T01:40:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.624+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a814d0a0 con 0x7ff2a8070270 2023-11-04T01:40:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.628+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a815ca60 con 0x7ff2a8070270 2023-11-04T01:40:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.628+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff29801c3b0 con 0x7ff2a8070270 2023-11-04T01:40:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.628+0000 7ff28ffff640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2940664a0 0x7ff294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.628+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2980835f0 con 0x7ff2a8070270 2023-11-04T01:40:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.628+0000 7ff2a6ffd640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2940664a0 0x7ff294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.628+0000 7ff2a6ffd640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2940664a0 0x7ff294068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0af000 tx=0x7ff29c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.632+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff298054670 con 0x7ff2a8070270 2023-11-04T01:40:31.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.784+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2a80b3580 con 0x7ff2a8070270 2023-11-04T01:40:31.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.784+0000 7ff28ffff640 1 -- 172.21.15.40:0/283072946 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff298018020 con 0x7ff2a8070270 2023-11-04T01:40:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2940664a0 msgr2=0x7ff294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2940664a0 0x7ff294068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0af000 tx=0x7ff29c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 msgr2=0x7ff2a80b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80b1f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff29800c480 tx=0x7ff29800c940 comp rx=0 tx=0).stop 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 shutdown_connections 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2940664a0 0x7ff294068960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2a815aed0 0x7ff2a8155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff2a80ca8f0 0x7ff2a8154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 --2- 172.21.15.40:0/283072946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2a8070270 0x7ff2a80b1f30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 >> 172.21.15.40:0/283072946 conn(0x7ff2a80cf340 msgr2=0x7ff2a806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 shutdown_connections 2023-11-04T01:40:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.788+0000 7ff2ae25d640 1 -- 172.21.15.40:0/283072946 wait complete. 2023-11-04T01:40:31.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 Processor -- start 2023-11-04T01:40:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 -- start start 2023-11-04T01:40:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19cc15acb0 0x7f19cc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc0cb130 con 0x7f19cc0b0a50 2023-11-04T01:40:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19cc15bd40 con 0x7f19cc15acb0 2023-11-04T01:40:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19d1508640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc06fd80 con 0x7f19cc15c160 2023-11-04T01:40:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19caffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19cc15acb0 0x7f19cc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19ca7fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19cb7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f19cc0b0a50 0x7f19cc0ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46138/0 (socket says 172.21.15.40:46138) 2023-11-04T01:40:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19cb7fe640 1 -- 172.21.15.40:0/480648349 learned_addr learned my addr 172.21.15.40:0/480648349 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19ca7fc640 1 -- 172.21.15.40:0/480648349 >> v2:172.21.15.91:3300/0 conn(0x7f19cc15acb0 msgr2=0x7f19cc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19ca7fc640 1 --2- 172.21.15.40:0/480648349 >> v2:172.21.15.91:3300/0 conn(0x7f19cc15acb0 0x7f19cc15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19ca7fc640 1 -- 172.21.15.40:0/480648349 >> v1:172.21.15.91:6789/0 conn(0x7f19cc0b0a50 legacy=0x7f19cc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.916+0000 7f19ca7fc640 1 -- 172.21.15.40:0/480648349 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc15b680 con 0x7f19cc15c160 2023-11-04T01:40:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19ca7fc640 1 --2- 172.21.15.40:0/480648349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc0b0510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097c0 tx=0x7f19c001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68773a9eb577c0b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19c9ffb640 1 -- 172.21.15.40:0/480648349 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00ad640 con 0x7f19cc15c160 2023-11-04T01:40:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19c9ffb640 1 -- 172.21.15.40:0/480648349 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c00ad7a0 con 0x7f19cc15c160 2023-11-04T01:40:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19c9ffb640 1 -- 172.21.15.40:0/480648349 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00adb30 con 0x7f19cc15c160 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 -- 172.21.15.40:0/480648349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 msgr2=0x7f19cc0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 --2- 172.21.15.40:0/480648349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc0b0510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097c0 tx=0x7f19c001c480 comp rx=0 tx=0).stop 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 -- 172.21.15.40:0/480648349 shutdown_connections 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 --2- 172.21.15.40:0/480648349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc0b0510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 --2- 172.21.15.40:0/480648349 >> v2:172.21.15.91:3300/0 conn(0x7f19cc15acb0 0x7f19cc15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 -- 172.21.15.40:0/480648349 >> 172.21.15.40:0/480648349 conn(0x7f19cc0cb510 msgr2=0x7f19cc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 -- 172.21.15.40:0/480648349 shutdown_connections 2023-11-04T01:40:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.920+0000 7f19d1508640 1 -- 172.21.15.40:0/480648349 wait complete. 2023-11-04T01:40:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 Processor -- start 2023-11-04T01:40:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- start start 2023-11-04T01:40:31.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 0x7f19cc0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19cc15acb0 0x7f19cc15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc15f1b0 con 0x7f19cc0b0a50 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc15e5a0 con 0x7f19cc15acb0 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc15e880 con 0x7f19cc15c160 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 0x7f19cc0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 0x7f19cc0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40468/0 (socket says 172.21.15.40:40468) 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 -- 172.21.15.40:0/161112482 learned_addr learned my addr 172.21.15.40:0/161112482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19ca7fc640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19cc15acb0 0x7f19cc15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19cb7fe640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 -- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 msgr2=0x7f19cc15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 -- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19cc15acb0 msgr2=0x7f19cc15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19cc15acb0 0x7f19cc15d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 -- 172.21.15.40:0/161112482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0009420 con 0x7f19cc0b0a50 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19ca7fc640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19cc15acb0 0x7f19cc15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19cb7fe640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19caffd640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 0x7f19cc0c9c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e930 tx=0x7f19bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc009690 con 0x7f19cc0b0a50 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00ca00 con 0x7f19cc0b0a50 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00cd70 con 0x7f19cc0b0a50 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc15eb60 con 0x7f19cc0b0a50 2023-11-04T01:40:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc13b880 con 0x7f19cc0b0a50 2023-11-04T01:40:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc0744a0 con 0x7f19cc0b0a50 2023-11-04T01:40:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.924+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19bc013470 con 0x7f19cc0b0a50 2023-11-04T01:40:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.928+0000 7f19b37fe640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19b80664a0 0x7f19b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.928+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19bc084870 con 0x7f19cc0b0a50 2023-11-04T01:40:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.928+0000 7f19ca7fc640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19b80664a0 0x7f19b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.928+0000 7f19ca7fc640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19b80664a0 0x7f19b8068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19c00af000 tx=0x7f19c00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:31.928+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19bc051e90 con 0x7f19cc0b0a50 2023-11-04T01:40:32.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.076+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19cc0cbd90 con 0x7f19cc0b0a50 2023-11-04T01:40:32.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.076+0000 7f19b37fe640 1 -- 172.21.15.40:0/161112482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19bc0554b0 con 0x7f19cc0b0a50 2023-11-04T01:40:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19b80664a0 msgr2=0x7f19b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19b80664a0 0x7f19b8068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19c00af000 tx=0x7f19c00a7070 comp rx=0 tx=0).stop 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 msgr2=0x7f19cc0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 0x7f19cc0c9c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e930 tx=0x7f19bc00edf0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 shutdown_connections 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19b80664a0 0x7f19b8068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f19cc15c160 0x7f19cc15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19cc15acb0 0x7f19cc15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 --2- 172.21.15.40:0/161112482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19cc0b0a50 0x7f19cc0c9c50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 >> 172.21.15.40:0/161112482 conn(0x7f19cc0cb510 msgr2=0x7f19cc154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 shutdown_connections 2023-11-04T01:40:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.080+0000 7f19d1508640 1 -- 172.21.15.40:0/161112482 wait complete. 2023-11-04T01:40:32.108 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-04T01:40:32.108 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:40:32.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.216+0000 7f0e9811e640 1 Processor -- start 2023-11-04T01:40:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.216+0000 7f0e9811e640 1 -- start start 2023-11-04T01:40:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e9811e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 0x7f0e900b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e9811e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0e900b74f0 0x7f0e900cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e9811e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900b6070 con 0x7f0e900d0690 2023-11-04T01:40:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e9811e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900b8ed0 con 0x7f0e900b74f0 2023-11-04T01:40:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e9811e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900b52b0 con 0x7f0e900b4990 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 0x7f0e900b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e966bb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0e900b74f0 0x7f0e900cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e956b9640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0e900d0690 0x7f0e900cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46144/0 (socket says 172.21.15.40:46144) 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e956b9640 1 -- 172.21.15.40:0/3210545482 learned_addr learned my addr 172.21.15.40:0/3210545482 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 --2- 172.21.15.40:0/3210545482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 0x7f0e900b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:37910/0 (socket says 172.21.15.40:37910) 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 -- 172.21.15.40:0/3210545482 >> v2:172.21.15.91:3300/0 conn(0x7f0e900b74f0 msgr2=0x7f0e900cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 --2- 172.21.15.40:0/3210545482 >> v2:172.21.15.91:3300/0 conn(0x7f0e900b74f0 0x7f0e900cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 -- 172.21.15.40:0/3210545482 >> v1:172.21.15.91:6789/0 conn(0x7f0e900d0690 legacy=0x7f0e900cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 -- 172.21.15.40:0/3210545482 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e900d1ce0 con 0x7f0e900b4990 2023-11-04T01:40:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e966bb640 1 --2- 172.21.15.40:0/3210545482 >> v2:172.21.15.91:3300/0 conn(0x7f0e900b74f0 0x7f0e900cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e95eba640 1 --2- 172.21.15.40:0/3210545482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 0x7f0e900b4d70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0097c0 tx=0x7f0e8c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bfc7c55aa9d05c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.220+0000 7f0e94eb8640 1 -- 172.21.15.40:0/3210545482 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0a8970 con 0x7f0e900b4990 2023-11-04T01:40:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e94eb8640 1 -- 172.21.15.40:0/3210545482 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0a8ad0 con 0x7f0e900b4990 2023-11-04T01:40:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e94eb8640 1 -- 172.21.15.40:0/3210545482 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0a8e60 con 0x7f0e900b4990 2023-11-04T01:40:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- 172.21.15.40:0/3210545482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 msgr2=0x7f0e900b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 --2- 172.21.15.40:0/3210545482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 0x7f0e900b4d70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0097c0 tx=0x7f0e8c01ec70 comp rx=0 tx=0).stop 2023-11-04T01:40:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- 172.21.15.40:0/3210545482 shutdown_connections 2023-11-04T01:40:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 --2- 172.21.15.40:0/3210545482 >> v2:172.21.15.91:3300/0 conn(0x7f0e900b74f0 0x7f0e900cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 --2- 172.21.15.40:0/3210545482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900b4990 0x7f0e900b4d70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- 172.21.15.40:0/3210545482 >> 172.21.15.40:0/3210545482 conn(0x7f0e900cf990 msgr2=0x7f0e900cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- 172.21.15.40:0/3210545482 shutdown_connections 2023-11-04T01:40:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- 172.21.15.40:0/3210545482 wait complete. 2023-11-04T01:40:32.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 Processor -- start 2023-11-04T01:40:32.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- start start 2023-11-04T01:40:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e900b4990 0x7f0e900cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 0x7f0e9015f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900d0690 0x7f0e90145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e901533b0 con 0x7f0e900b74f0 2023-11-04T01:40:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90153670 con 0x7f0e900b4990 2023-11-04T01:40:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e9811e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90153950 con 0x7f0e900d0690 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e956b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 0x7f0e9015f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e956b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 0x7f0e9015f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40472/0 (socket says 172.21.15.40:40472) 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e956b9640 1 -- 172.21.15.40:0/2703108754 learned_addr learned my addr 172.21.15.40:0/2703108754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.224+0000 7f0e95eba640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e900b4990 0x7f0e900cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e966bb640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900d0690 0x7f0e90145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e956b9640 1 -- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900d0690 msgr2=0x7f0e90145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e956b9640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900d0690 0x7f0e90145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e956b9640 1 -- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e900b4990 msgr2=0x7f0e900cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e956b9640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e900b4990 0x7f0e900cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e956b9640 1 -- 172.21.15.40:0/2703108754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88009a70 con 0x7f0e900b74f0 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e95eba640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e900b4990 0x7f0e900cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e956b9640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 0x7f0e9015f7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001ec0 tx=0x7f0e8000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80005cf0 con 0x7f0e900b74f0 2023-11-04T01:40:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80005e50 con 0x7f0e900b74f0 2023-11-04T01:40:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8c009420 con 0x7f0e900b74f0 2023-11-04T01:40:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800072d0 con 0x7f0e900b74f0 2023-11-04T01:40:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9015f2b0 con 0x7f0e900b74f0 2023-11-04T01:40:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9015ee30 con 0x7f0e900b74f0 2023-11-04T01:40:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e80007430 con 0x7f0e900b74f0 2023-11-04T01:40:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e867fc640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e740664a0 0x7f0e74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e80083430 con 0x7f0e900b74f0 2023-11-04T01:40:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e95eba640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e740664a0 0x7f0e74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.228+0000 7f0e95eba640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e740664a0 0x7f0e74068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0b2000 tx=0x7f0e8c0aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.232+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e9015ee30 con 0x7f0e900b74f0 2023-11-04T01:40:32.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.384+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e9015ee30 con 0x7f0e900b74f0 2023-11-04T01:40:32.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.388+0000 7f0e867fc640 1 -- 172.21.15.40:0/2703108754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f0e9015ee30 con 0x7f0e900b74f0 2023-11-04T01:40:32.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e740664a0 msgr2=0x7f0e74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e740664a0 0x7f0e74068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0b2000 tx=0x7f0e8c0aa070 comp rx=0 tx=0).stop 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 msgr2=0x7f0e9015f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 0x7f0e9015f7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001ec0 tx=0x7f0e8000c890 comp rx=0 tx=0).stop 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 shutdown_connections 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0e740664a0 0x7f0e74068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e900d0690 0x7f0e90145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e900b74f0 0x7f0e9015f7d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 --2- 172.21.15.40:0/2703108754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e900b4990 0x7f0e900cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 >> 172.21.15.40:0/2703108754 conn(0x7f0e900cf990 msgr2=0x7f0e900b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 shutdown_connections 2023-11-04T01:40:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.392+0000 7f0e9811e640 1 -- 172.21.15.40:0/2703108754 wait complete. 2023-11-04T01:40:32.409 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:32.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bd09d6640 1 Processor -- start 2023-11-04T01:40:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bd09d6640 1 -- start start 2023-11-04T01:40:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bd09d6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 0x7f3bcc15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bd09d6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc06c0c0 con 0x7f3bcc15af70 2023-11-04T01:40:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bd09d6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc06c3a0 con 0x7f3bcc0ce1b0 2023-11-04T01:40:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bd09d6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc071200 con 0x7f3bcc06d160 2023-11-04T01:40:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bca59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3bcc15af70 0x7f3bcc0cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43588/0 (socket says 172.21.15.40:43588) 2023-11-04T01:40:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bca59c640 1 -- 172.21.15.40:0/1881610457 learned_addr learned my addr 172.21.15.40:0/1881610457 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bcad9d640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 0x7f3bcc15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896530052 0 0) 0x7f3bcc06c0c0 con 0x7f3bcc15af70 2023-11-04T01:40:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb4005740 con 0x7f3bcc15af70 2023-11-04T01:40:32.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940726324 0 0) 0x7f3bb4005740 con 0x7f3bcc15af70 2023-11-04T01:40:32.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 msgr2=0x7f3bcc15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 0x7f3bcc15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 >> v1:172.21.15.91:6789/0 conn(0x7f3bcc0ce1b0 legacy=0x7f3bcc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc06c680 con 0x7f3bcc15af70 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3bbc0016a0 con 0x7f3bcc15af70 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 >> v1:172.21.15.40:6789/0 conn(0x7f3bcc15af70 legacy=0x7f3bcc0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 0x7f3bb4005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb4006140 0x7f3bb40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bb4006f20 0x7f3bb40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc071200 con 0x7f3bb4006140 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb400dc80 con 0x7f3bb4006f20 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb400de40 con 0x7f3bcc06d160 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc9d9b640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb4006140 0x7f3bb40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bcad9d640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bb4006f20 0x7f3bb40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bca59c640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 0x7f3bb4005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc9d9b640 1 -- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 msgr2=0x7f3bb4005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc9d9b640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc06d160 0x7f3bb4005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc9d9b640 1 -- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bb4006f20 msgr2=0x7f3bb40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc9d9b640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bb4006f20 0x7f3bb40073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bc9d9b640 1 -- 172.21.15.40:0/1881610457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4005740 con 0x7f3bb4006140 2023-11-04T01:40:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.532+0000 7f3bcad9d640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bb4006f20 0x7f3bb40073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bc9d9b640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb4006140 0x7f3bb40069e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0001780 tx=0x7f3bc001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb8934c2abd375a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00052d0 con 0x7f3bb4006140 2023-11-04T01:40:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00a7050 con 0x7f3bb4006140 2023-11-04T01:40:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bc959a640 1 -- 172.21.15.40:0/1881610457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0003600 con 0x7f3bb4006140 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bd09d6640 1 -- 172.21.15.40:0/1881610457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb4006140 msgr2=0x7f3bb40069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/1881610457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb4006140 0x7f3bb40069e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0001780 tx=0x7f3bc001c400 comp rx=0 tx=0).stop 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bcad9d640 1 -- 172.21.15.40:0/1881610457 reap_dead start 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bd09d6640 1 -- 172.21.15.40:0/1881610457 shutdown_connections 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bd09d6640 1 -- 172.21.15.40:0/1881610457 >> 172.21.15.40:0/1881610457 conn(0x7f3bcc0cb510 msgr2=0x7f3bcc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bd09d6640 1 -- 172.21.15.40:0/1881610457 shutdown_connections 2023-11-04T01:40:32.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.536+0000 7f3bd09d6640 1 -- 172.21.15.40:0/1881610457 wait complete. 2023-11-04T01:40:32.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 Processor -- start 2023-11-04T01:40:32.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- start start 2023-11-04T01:40:32.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bcc156800 0x7f3bcc0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc156be0 0x7f3bcc0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 0x7f3bcc0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b18e0 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b1b30 con 0x7f3bcc156800 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b1e10 con 0x7f3bcc156be0 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 0x7f3bcc0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 0x7f3bcc0b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40494/0 (socket says 172.21.15.40:40494) 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 -- 172.21.15.40:0/2579771281 learned_addr learned my addr 172.21.15.40:0/2579771281 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bca59c640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bcc156800 0x7f3bcc0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bc9d9b640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc156be0 0x7f3bcc0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 -- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc156be0 msgr2=0x7f3bcc0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc156be0 0x7f3bcc0b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 -- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bcc156800 msgr2=0x7f3bcc0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bcc156800 0x7f3bcc0c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 -- 172.21.15.40:0/2579771281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0b20f0 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bcad9d640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 0x7f3bcc0b2e30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc06f950 tx=0x7f3bc4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc401b070 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400f040 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400e050 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc0b23d0 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc0b0720 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc0b25c0 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.540+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bc4003be0 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.544+0000 7f3bbaffd640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3bac0664a0 0x7f3bac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.544+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bc4084430 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.544+0000 7f3bca59c640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3bac0664a0 0x7f3bac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.544+0000 7f3bca59c640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3bac0664a0 0x7f3bac068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc004850 tx=0x7f3bbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.548+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3bc4051940 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.692+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bcc0744a0 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.692+0000 7f3bbaffd640 1 -- 172.21.15.40:0/2579771281 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bc4054f60 con 0x7f3bcc0c3e20 2023-11-04T01:40:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:32.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3bac0664a0 msgr2=0x7f3bac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3bac0664a0 0x7f3bac068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc004850 tx=0x7f3bbc009040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 msgr2=0x7f3bcc0b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 0x7f3bcc0b2e30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc06f950 tx=0x7f3bc4010590 comp rx=0 tx=0).stop 2023-11-04T01:40:32.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 shutdown_connections 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3bac0664a0 0x7f3bac068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc0c3e20 0x7f3bcc0b2e30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3bcc156be0 0x7f3bcc0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 --2- 172.21.15.40:0/2579771281 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3bcc156800 0x7f3bcc0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 >> 172.21.15.40:0/2579771281 conn(0x7f3bcc0cb510 msgr2=0x7f3bcc0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 shutdown_connections 2023-11-04T01:40:32.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.696+0000 7f3bd09d6640 1 -- 172.21.15.40:0/2579771281 wait complete. 2023-11-04T01:40:32.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:32.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.824+0000 7f28c10c4640 1 Processor -- start 2023-11-04T01:40:32.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.824+0000 7f28c10c4640 1 -- start start 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28bc144840 0x7f28bc15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc06cc10 con 0x7f28bc0b56a0 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc071d10 con 0x7f28bc070b40 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc15fb20 con 0x7f28bc144840 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28bc144840 0x7f28bc15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28bc144840 0x7f28bc15f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40506/0 (socket says 172.21.15.40:40506) 2023-11-04T01:40:32.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bb59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f28bc0b56a0 0x7f28bc0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43590/0 (socket says 172.21.15.40:43590) 2023-11-04T01:40:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 -- 172.21.15.40:0/4204680565 learned_addr learned my addr 172.21.15.40:0/4204680565 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 -- 172.21.15.40:0/4204680565 >> v1:172.21.15.91:6789/0 conn(0x7f28bc070b40 legacy=0x7f28bc0b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 -- 172.21.15.40:0/4204680565 >> v1:172.21.15.40:6789/0 conn(0x7f28bc0b56a0 legacy=0x7f28bc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 -- 172.21.15.40:0/4204680565 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc071100 con 0x7f28bc144840 2023-11-04T01:40:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28b9d9b640 1 -- 172.21.15.40:0/4204680565 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407527915 0 0) 0x7f28bc06cc10 con 0x7f28bc0b56a0 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28bad9d640 1 --2- 172.21.15.40:0/4204680565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc144840 0x7f28bc15f5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009870 tx=0x7f28ac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90a0ebc02763785 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28b9d9b640 1 -- 172.21.15.40:0/4204680565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0ab640 con 0x7f28bc144840 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28b9d9b640 1 -- 172.21.15.40:0/4204680565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0a7070 con 0x7f28bc144840 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28b9d9b640 1 -- 172.21.15.40:0/4204680565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0ab9c0 con 0x7f28bc144840 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- 172.21.15.40:0/4204680565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc144840 msgr2=0x7f28bc15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 --2- 172.21.15.40:0/4204680565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc144840 0x7f28bc15f5e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009870 tx=0x7f28ac01c440 comp rx=0 tx=0).stop 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- 172.21.15.40:0/4204680565 shutdown_connections 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 --2- 172.21.15.40:0/4204680565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc144840 0x7f28bc15f5e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- 172.21.15.40:0/4204680565 >> 172.21.15.40:0/4204680565 conn(0x7f28bc0cfc70 msgr2=0x7f28bc0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- 172.21.15.40:0/4204680565 shutdown_connections 2023-11-04T01:40:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.828+0000 7f28c10c4640 1 -- 172.21.15.40:0/4204680565 wait complete. 2023-11-04T01:40:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 Processor -- start 2023-11-04T01:40:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- start start 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 0x7f28bc15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc0b56a0 0x7f28bc15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc144840 0x7f28bc139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc143880 con 0x7f28bc070b40 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc156d00 con 0x7f28bc144840 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc156fe0 con 0x7f28bc0b56a0 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 0x7f28bc15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 0x7f28bc15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40516/0 (socket says 172.21.15.40:40516) 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 -- 172.21.15.40:0/1524583513 learned_addr learned my addr 172.21.15.40:0/1524583513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bb59e640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc144840 0x7f28bc139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28ba59c640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc0b56a0 0x7f28bc15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 -- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc0b56a0 msgr2=0x7f28bc15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc0b56a0 0x7f28bc15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 -- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc144840 msgr2=0x7f28bc139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc144840 0x7f28bc139d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 -- 172.21.15.40:0/1524583513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0094d0 con 0x7f28bc070b40 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bb59e640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc144840 0x7f28bc139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28bad9d640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 0x7f28bc15a280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0ad040 tx=0x7f28ac01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0be3f0 con 0x7f28bc070b40 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0be570 con 0x7f28bc070b40 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc1572c0 con 0x7f28bc070b40 2023-11-04T01:40:32.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0be920 con 0x7f28bc070b40 2023-11-04T01:40:32.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc13a4a0 con 0x7f28bc070b40 2023-11-04T01:40:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc157500 con 0x7f28bc070b40 2023-11-04T01:40:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.832+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28ac0b43f0 con 0x7f28bc070b40 2023-11-04T01:40:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.836+0000 7f28a37fe640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28a80664a0 0x7f28a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.836+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28ac11e7b0 con 0x7f28bc070b40 2023-11-04T01:40:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.836+0000 7f28ba59c640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28a80664a0 0x7f28a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.836+0000 7f28ba59c640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28a80664a0 0x7f28a8068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28bc13b2d0 tx=0x7f28b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.840+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28bc157500 con 0x7f28bc070b40 2023-11-04T01:40:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28bc157500 con 0x7f28bc070b40 2023-11-04T01:40:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28a37fe640 1 -- 172.21.15.40:0/1524583513 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28bc157500 con 0x7f28bc070b40 2023-11-04T01:40:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28a80664a0 msgr2=0x7f28a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28a80664a0 0x7f28a8068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28bc13b2d0 tx=0x7f28b0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 msgr2=0x7f28bc15a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 0x7f28bc15a280 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0ad040 tx=0x7f28ac01ac80 comp rx=0 tx=0).stop 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 shutdown_connections 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28a80664a0 0x7f28a8068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc144840 0x7f28bc139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc0b56a0 0x7f28bc15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 --2- 172.21.15.40:0/1524583513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc070b40 0x7f28bc15a280 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 >> 172.21.15.40:0/1524583513 conn(0x7f28bc0cfc70 msgr2=0x7f28bc06d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 shutdown_connections 2023-11-04T01:40:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:32.988+0000 7f28c10c4640 1 -- 172.21.15.40:0/1524583513 wait complete. 2023-11-04T01:40:33.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:33.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.132+0000 7f977e1a4640 1 Processor -- start 2023-11-04T01:40:33.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.132+0000 7f977e1a4640 1 -- start start 2023-11-04T01:40:33.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f977e1a4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f977815c160 0x7f977815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f977e1a4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780cb130 con 0x7f97780b0c20 2023-11-04T01:40:33.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f977e1a4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977815b680 con 0x7f977815acb0 2023-11-04T01:40:33.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f977e1a4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977815bd40 con 0x7f977815c160 2023-11-04T01:40:33.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9776ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f97780b0c20 0x7f97780ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43596/0 (socket says 172.21.15.40:43596) 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9776ffd640 1 -- 172.21.15.40:0/33323233 learned_addr learned my addr 172.21.15.40:0/33323233 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9777fff640 1 --2- 172.21.15.40:0/33323233 >> v2:172.21.15.91:3300/0 conn(0x7f977815c160 0x7f977815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238380797 0 0) 0x7f97780cb130 con 0x7f97780b0c20 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760003530 con 0x7f97780b0c20 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 57309858 0 0) 0x7f9760003530 con 0x7f97780b0c20 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 >> v2:172.21.15.91:3300/0 conn(0x7f977815c160 msgr2=0x7f977815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 --2- 172.21.15.40:0/33323233 >> v2:172.21.15.91:3300/0 conn(0x7f977815c160 0x7f977815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 >> v1:172.21.15.91:6789/0 conn(0x7f977815acb0 legacy=0x7f97780b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977815b960 con 0x7f97780b0c20 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f976c001680 con 0x7f97780b0c20 2023-11-04T01:40:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 >> v1:172.21.15.40:6789/0 conn(0x7f97780b0c20 legacy=0x7f97780ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760003980 0x7f9760003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97600047d0 0x7f9760004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9760005190 0x7f976000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977815bd40 con 0x7f9760003980 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976000c030 con 0x7f97600047d0 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976000c1f0 con 0x7f9760005190 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97777fe640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760003980 0x7f9760003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9777fff640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9760005190 0x7f976000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9776ffd640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97600047d0 0x7f9760004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97777fe640 1 -- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9760005190 msgr2=0x7f976000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97777fe640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9760005190 0x7f976000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97777fe640 1 -- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97600047d0 msgr2=0x7f9760004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97777fe640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97600047d0 0x7f9760004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f97777fe640 1 -- 172.21.15.40:0/33323233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760003530 con 0x7f9760003980 2023-11-04T01:40:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9777fff640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9760005190 0x7f976000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.136+0000 7f9777fff640 1 -- 172.21.15.40:0/33323233 reap_dead start 2023-11-04T01:40:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f97777fe640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760003980 0x7f9760003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9768001780 tx=0x7f976801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87252dc8972f2ba0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680052d0 con 0x7f9760003980 2023-11-04T01:40:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97680a7050 con 0x7f9760003980 2023-11-04T01:40:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f97767fc640 1 -- 172.21.15.40:0/33323233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768003600 con 0x7f9760003980 2023-11-04T01:40:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- 172.21.15.40:0/33323233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760003980 msgr2=0x7f9760003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760003980 0x7f9760003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9768001780 tx=0x7f976801c3e0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- 172.21.15.40:0/33323233 shutdown_connections 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 --2- 172.21.15.40:0/33323233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760003980 0x7f9760003da0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- 172.21.15.40:0/33323233 >> 172.21.15.40:0/33323233 conn(0x7f97780cb510 msgr2=0x7f97780cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- 172.21.15.40:0/33323233 shutdown_connections 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- 172.21.15.40:0/33323233 wait complete. 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 Processor -- start 2023-11-04T01:40:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- start start 2023-11-04T01:40:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9760003980 0x7f97780c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 0x7f97780c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f977814ee10 0x7f97780b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780c60a0 con 0x7f977815f730 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778152940 con 0x7f9760003980 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f977e1a4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9778152100 con 0x7f977814ee10 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 0x7f97780c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f9776ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 0x7f97780c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40546/0 (socket says 172.21.15.40:40546) 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.140+0000 7f9776ffd640 1 -- 172.21.15.40:0/3118017081 learned_addr learned my addr 172.21.15.40:0/3118017081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f97777fe640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9760003980 0x7f97780c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9777fff640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f977814ee10 0x7f97780b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9776ffd640 1 -- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f977814ee10 msgr2=0x7f97780b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9776ffd640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f977814ee10 0x7f97780b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9776ffd640 1 -- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9760003980 msgr2=0x7f97780c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9776ffd640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9760003980 0x7f97780c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9776ffd640 1 -- 172.21.15.40:0/3118017081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778152380 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f9776ffd640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 0x7f97780c4fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e7b0 tx=0x7f976c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00ee60 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c00c8d0 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9778152660 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00cc80 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977815e310 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97780744a0 con 0x7f977815f730 2023-11-04T01:40:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f976c01d460 con 0x7f977815f730 2023-11-04T01:40:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f975ffff640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97640664d0 0x7f9764068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c083d50 con 0x7f977815f730 2023-11-04T01:40:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f97777fe640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97640664d0 0x7f9764068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.144+0000 7f97777fe640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97640664d0 0x7f9764068990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9768001750 tx=0x7f97680011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.148+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f976c087030 con 0x7f977815f730 2023-11-04T01:40:33.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.308+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97780cde30 con 0x7f977815f730 2023-11-04T01:40:33.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.308+0000 7f975ffff640 1 -- 172.21.15.40:0/3118017081 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f976c0511d0 con 0x7f977815f730 2023-11-04T01:40:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97640664d0 msgr2=0x7f9764068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97640664d0 0x7f9764068990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9768001750 tx=0x7f97680011a0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 msgr2=0x7f97780c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 0x7f97780c4fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e7b0 tx=0x7f976c00ec70 comp rx=0 tx=0).stop 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 shutdown_connections 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97640664d0 0x7f9764068990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f977814ee10 0x7f97780b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f977815f730 0x7f97780c4fc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 --2- 172.21.15.40:0/3118017081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9760003980 0x7f97780c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 >> 172.21.15.40:0/3118017081 conn(0x7f97780cb510 msgr2=0x7f97780c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 shutdown_connections 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.312+0000 7f977e1a4640 1 -- 172.21.15.40:0/3118017081 wait complete. 2023-11-04T01:40:33.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:40:33.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.444+0000 7fc233008640 1 Processor -- start 2023-11-04T01:40:33.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.444+0000 7fc233008640 1 -- start start 2023-11-04T01:40:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc233008640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc22c0d0690 0x7fc22c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc233008640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 0x7fc22c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc233008640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0b6070 con 0x7fc22c0b4990 2023-11-04T01:40:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc233008640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c0b8ed0 con 0x7fc22c0d0690 2023-11-04T01:40:33.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc233008640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0d1ce0 con 0x7fc22c0d0ae0 2023-11-04T01:40:33.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 0x7fc22c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc22bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc22c0d0690 0x7fc22c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 0x7fc22c0b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:37992/0 (socket says 172.21.15.40:37992) 2023-11-04T01:40:33.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 -- 172.21.15.40:0/283888671 learned_addr learned my addr 172.21.15.40:0/283888671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:33.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 -- 172.21.15.40:0/283888671 >> v2:172.21.15.91:3300/0 conn(0x7fc22c0d0690 msgr2=0x7fc22c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 --2- 172.21.15.40:0/283888671 >> v2:172.21.15.91:3300/0 conn(0x7fc22c0d0690 0x7fc22c0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 -- 172.21.15.40:0/283888671 >> v1:172.21.15.91:6789/0 conn(0x7fc22c0b4990 legacy=0x7fc22c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc2315a5640 1 -- 172.21.15.40:0/283888671 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0d1fc0 con 0x7fc22c0d0ae0 2023-11-04T01:40:33.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.448+0000 7fc22bfff640 1 --2- 172.21.15.40:0/283888671 >> v2:172.21.15.91:3300/0 conn(0x7fc22c0d0690 0x7fc22c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:33.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.452+0000 7fc2315a5640 1 --2- 172.21.15.40:0/283888671 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 0x7fc22c0b6a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc224009e50 tx=0x7fc22401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c28f33b584f894d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.452+0000 7fc22b7fe640 1 -- 172.21.15.40:0/283888671 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240af400 con 0x7fc22c0d0ae0 2023-11-04T01:40:33.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.452+0000 7fc22b7fe640 1 -- 172.21.15.40:0/283888671 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2240ab050 con 0x7fc22c0d0ae0 2023-11-04T01:40:33.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.452+0000 7fc22b7fe640 1 -- 172.21.15.40:0/283888671 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240af780 con 0x7fc22c0d0ae0 2023-11-04T01:40:33.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- 172.21.15.40:0/283888671 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 msgr2=0x7fc22c0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 --2- 172.21.15.40:0/283888671 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 0x7fc22c0b6a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc224009e50 tx=0x7fc22401f1f0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- 172.21.15.40:0/283888671 shutdown_connections 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 --2- 172.21.15.40:0/283888671 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0ae0 0x7fc22c0b6a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 --2- 172.21.15.40:0/283888671 >> v2:172.21.15.91:3300/0 conn(0x7fc22c0d0690 0x7fc22c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- 172.21.15.40:0/283888671 >> 172.21.15.40:0/283888671 conn(0x7fc22c0cf990 msgr2=0x7fc22c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- 172.21.15.40:0/283888671 shutdown_connections 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- 172.21.15.40:0/283888671 wait complete. 2023-11-04T01:40:33.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 Processor -- start 2023-11-04T01:40:33.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- start start 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 0x7fc22c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0690 0x7fc22c1effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc22c0d0ae0 0x7fc22c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0ca740 con 0x7fc22c0b4990 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c1f3bb0 con 0x7fc22c0d0ae0 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc233008640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c1f38d0 con 0x7fc22c0d0690 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 0x7fc22c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 0x7fc22c0cabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40562/0 (socket says 172.21.15.40:40562) 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 -- 172.21.15.40:0/2496281302 learned_addr learned my addr 172.21.15.40:0/2496281302 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:33.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc2315a5640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc22c0d0ae0 0x7fc22c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc22bfff640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0690 0x7fc22c1effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 -- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0690 msgr2=0x7fc22c1effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0690 0x7fc22c1effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 -- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc22c0d0ae0 msgr2=0x7fc22c15a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc22c0d0ae0 0x7fc22c15a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 -- 172.21.15.40:0/2496281302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009420 con 0x7fc22c0b4990 2023-11-04T01:40:33.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.456+0000 7fc230da4640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 0x7fc22c0cabd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc22000c3f0 tx=0x7fc22000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200052d0 con 0x7fc22c0b4990 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220005430 con 0x7fc22c0b4990 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220003840 con 0x7fc22c0b4990 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc224009b30 con 0x7fc22c0b4990 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c0ca3d0 con 0x7fc22c0b4990 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c0744a0 con 0x7fc22c0b4990 2023-11-04T01:40:33.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2200039a0 con 0x7fc22c0b4990 2023-11-04T01:40:33.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc2297fa640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2180664a0 0x7fc218068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc220083340 con 0x7fc22c0b4990 2023-11-04T01:40:33.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc22bfff640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2180664a0 0x7fc218068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.460+0000 7fc22bfff640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2180664a0 0x7fc218068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc22c156c00 tx=0x7fc21c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.464+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc220050870 con 0x7fc22c0b4990 2023-11-04T01:40:33.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:33.672+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7fc22c0b6d90 con 0x7fc22c0b4990 2023-11-04T01:40:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.160+0000 7fc2297fa640 1 -- 172.21.15.40:0/2496281302 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v54) v1 ==== 176+0+0 (secure 0 0 0) 0x7fc220053e90 con 0x7fc22c0b4990 2023-11-04T01:40:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2180664a0 msgr2=0x7fc218068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2180664a0 0x7fc218068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc22c156c00 tx=0x7fc21c009190 comp rx=0 tx=0).stop 2023-11-04T01:40:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 msgr2=0x7fc22c0cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 0x7fc22c0cabd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc22000c3f0 tx=0x7fc22000c8b0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 shutdown_connections 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2180664a0 0x7fc218068960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc22c0d0ae0 0x7fc22c15a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc22c0d0690 0x7fc22c1effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 --2- 172.21.15.40:0/2496281302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22c0b4990 0x7fc22c0cabd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 >> 172.21.15.40:0/2496281302 conn(0x7fc22c0cf990 msgr2=0x7fc22c0b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 shutdown_connections 2023-11-04T01:40:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.164+0000 7fc233008640 1 -- 172.21.15.40:0/2496281302 wait complete. 2023-11-04T01:40:34.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:40:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c39a0640 1 Processor -- start 2023-11-04T01:40:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c39a0640 1 -- start start 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c39a0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27bc15c160 0x7f27bc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c39a0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0cb130 con 0x7f27bc15acb0 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c39a0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc15b680 con 0x7f27bc0b0c20 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c39a0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc15bd40 con 0x7f27bc15c160 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c173c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f27bc15acb0 0x7f27bc0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43606/0 (socket says 172.21.15.40:43606) 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c1f3d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27bc15c160 0x7f27bc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c173c640 1 -- 172.21.15.40:0/352255147 learned_addr learned my addr 172.21.15.40:0/352255147 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:34.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c1f3d640 1 -- 172.21.15.40:0/352255147 >> v1:172.21.15.91:6789/0 conn(0x7f27bc0b0c20 legacy=0x7f27bc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:34.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c1f3d640 1 -- 172.21.15.40:0/352255147 >> v1:172.21.15.40:6789/0 conn(0x7f27bc15acb0 legacy=0x7f27bc0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c1f3d640 1 -- 172.21.15.40:0/352255147 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc15b960 con 0x7f27bc15c160 2023-11-04T01:40:34.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27b3fff640 1 -- 172.21.15.40:0/352255147 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280634572 0 0) 0x7f27bc0cb130 con 0x7f27bc15acb0 2023-11-04T01:40:34.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.308+0000 7f27c1f3d640 1 --2- 172.21.15.40:0/352255147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc15b090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f27b40097c0 tx=0x7f27b401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c9c9a3ce85fd11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27b3fff640 1 -- 172.21.15.40:0/352255147 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4004230 con 0x7f27bc15c160 2023-11-04T01:40:34.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27b3fff640 1 -- 172.21.15.40:0/352255147 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40a7050 con 0x7f27bc15c160 2023-11-04T01:40:34.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27b3fff640 1 -- 172.21.15.40:0/352255147 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4003620 con 0x7f27bc15c160 2023-11-04T01:40:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/352255147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 msgr2=0x7f27bc15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 --2- 172.21.15.40:0/352255147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc15b090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f27b40097c0 tx=0x7f27b401c440 comp rx=0 tx=0).stop 2023-11-04T01:40:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/352255147 shutdown_connections 2023-11-04T01:40:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 --2- 172.21.15.40:0/352255147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc15b090 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/352255147 >> 172.21.15.40:0/352255147 conn(0x7f27bc0cb510 msgr2=0x7f27bc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/352255147 shutdown_connections 2023-11-04T01:40:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/352255147 wait complete. 2023-11-04T01:40:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 Processor -- start 2023-11-04T01:40:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- start start 2023-11-04T01:40:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc0b0c20 0x7f27bc0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15acb0 0x7f27bc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc149600 con 0x7f27bc15c160 2023-11-04T01:40:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0b2130 con 0x7f27bc15acb0 2023-11-04T01:40:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc148f40 con 0x7f27bc0b0c20 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40580/0 (socket says 172.21.15.40:40580) 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 -- 172.21.15.40:0/1722361146 learned_addr learned my addr 172.21.15.40:0/1722361146 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c0f3b640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15acb0 0x7f27bc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c173c640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc0b0c20 0x7f27bc0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 -- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc0b0c20 msgr2=0x7f27bc0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc0b0c20 0x7f27bc0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 -- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15acb0 msgr2=0x7f27bc0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15acb0 0x7f27bc0b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 -- 172.21.15.40:0/1722361146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009420 con 0x7f27bc15c160 2023-11-04T01:40:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c173c640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc0b0c20 0x7f27bc0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c1f3d640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc149a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f27b401a070 tx=0x7f27b40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40ab640 con 0x7f27bc15c160 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40ab7a0 con 0x7f27bc15c160 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc149220 con 0x7f27bc15c160 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40abb10 con 0x7f27bc15c160 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.312+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc0b4330 con 0x7f27bc15c160 2023-11-04T01:40:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.316+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc149740 con 0x7f27bc15c160 2023-11-04T01:40:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.316+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27b40b2050 con 0x7f27bc15c160 2023-11-04T01:40:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.316+0000 7f27b1ffb640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a00664a0 0x7f27a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.316+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27b411e5b0 con 0x7f27bc15c160 2023-11-04T01:40:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.316+0000 7f27c173c640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a00664a0 0x7f27a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.316+0000 7f27c173c640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a00664a0 0x7f27a0068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27b8007fd0 tx=0x7f27b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.320+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27bc149740 con 0x7f27bc15c160 2023-11-04T01:40:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.468+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f27bc149740 con 0x7f27bc15c160 2023-11-04T01:40:34.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27b1ffb640 1 -- 172.21.15.40:0/1722361146 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27bc149740 con 0x7f27bc15c160 2023-11-04T01:40:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a00664a0 msgr2=0x7f27a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a00664a0 0x7f27a0068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27b8007fd0 tx=0x7f27b8009040 comp rx=0 tx=0).stop 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 msgr2=0x7f27bc149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc149a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f27b401a070 tx=0x7f27b40191e0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 shutdown_connections 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a00664a0 0x7f27a0068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc15c160 0x7f27bc149a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15acb0 0x7f27bc0b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 --2- 172.21.15.40:0/1722361146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc0b0c20 0x7f27bc0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 >> 172.21.15.40:0/1722361146 conn(0x7f27bc0cb510 msgr2=0x7f27bc1575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 shutdown_connections 2023-11-04T01:40:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.476+0000 7f27c39a0640 1 -- 172.21.15.40:0/1722361146 wait complete. 2023-11-04T01:40:34.498 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:40:34.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:40:34.543 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:40:34.587 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:40:34.587 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:40:34.587 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:34.592 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:40:34.592 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:34.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:34.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:40:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:34.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.792+0000 7fd69f666640 1 Processor -- start 2023-11-04T01:40:34.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69f666640 1 -- start start 2023-11-04T01:40:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69f666640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd698159e70 0x7fd6980ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69f666640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd69806cd30 0x7fd6980ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69f666640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd698070d90 con 0x7fd6980caf10 2023-11-04T01:40:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69f666640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69806dd90 con 0x7fd698159e70 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69f666640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980cefe0 con 0x7fd69806cd30 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd698159e70 0x7fd6980ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69dc03640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6980caf10 0x7fd6980b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43620/0 (socket says 172.21.15.40:43620) 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd698159e70 0x7fd6980ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69dc03640 1 -- 172.21.15.40:0/2223480239 learned_addr learned my addr 172.21.15.40:0/2223480239 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69cc01640 1 --2- 172.21.15.40:0/2223480239 >> v2:172.21.15.91:3300/0 conn(0x7fd69806cd30 0x7fd6980ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 -- 172.21.15.40:0/2223480239 >> v2:172.21.15.91:3300/0 conn(0x7fd69806cd30 msgr2=0x7fd6980ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 --2- 172.21.15.40:0/2223480239 >> v2:172.21.15.91:3300/0 conn(0x7fd69806cd30 0x7fd6980ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 -- 172.21.15.40:0/2223480239 >> v1:172.21.15.40:6789/0 conn(0x7fd6980caf10 legacy=0x7fd6980b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd68ffff640 1 -- 172.21.15.40:0/2223480239 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260587646 0 0) 0x7fd698070d90 con 0x7fd6980caf10 2023-11-04T01:40:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 -- 172.21.15.40:0/2223480239 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69806d4f0 con 0x7fd698159e70 2023-11-04T01:40:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd69d402640 1 --2- 172.21.15.40:0/2223480239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd698159e70 0x7fd6980ceaa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd698070480 tx=0x7fd69401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeefed5b57d32f95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.796+0000 7fd68ffff640 1 -- 172.21.15.40:0/2223480239 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6940a59a0 con 0x7fd698159e70 2023-11-04T01:40:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd68ffff640 1 -- 172.21.15.40:0/2223480239 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6940a5b00 con 0x7fd698159e70 2023-11-04T01:40:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd68ffff640 1 -- 172.21.15.40:0/2223480239 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6940a5e90 con 0x7fd698159e70 2023-11-04T01:40:34.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/2223480239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd698159e70 msgr2=0x7fd6980ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 --2- 172.21.15.40:0/2223480239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd698159e70 0x7fd6980ceaa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd698070480 tx=0x7fd69401c8e0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/2223480239 shutdown_connections 2023-11-04T01:40:34.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 --2- 172.21.15.40:0/2223480239 >> v2:172.21.15.91:3300/0 conn(0x7fd69806cd30 0x7fd6980ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 --2- 172.21.15.40:0/2223480239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd698159e70 0x7fd6980ceaa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/2223480239 >> 172.21.15.40:0/2223480239 conn(0x7fd69806e760 msgr2=0x7fd69806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/2223480239 shutdown_connections 2023-11-04T01:40:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/2223480239 wait complete. 2023-11-04T01:40:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 Processor -- start 2023-11-04T01:40:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- start start 2023-11-04T01:40:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd69806cd30 0x7fd698158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 0x7fd698156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd698159e70 0x7fd698163120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981eb8b0 con 0x7fd6980caf10 2023-11-04T01:40:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69814fc00 con 0x7fd698159e70 2023-11-04T01:40:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6981570c0 con 0x7fd69806cd30 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 0x7fd698156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 0x7fd698156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40604/0 (socket says 172.21.15.40:40604) 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 -- 172.21.15.40:0/1729604751 learned_addr learned my addr 172.21.15.40:0/1729604751 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69dc03640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd698159e70 0x7fd698163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 -- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd69806cd30 msgr2=0x7fd698158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69d402640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd69806cd30 0x7fd698158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd69806cd30 0x7fd698158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 -- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd698159e70 msgr2=0x7fd698163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd698159e70 0x7fd698163120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 -- 172.21.15.40:0/1729604751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694009a70 con 0x7fd6980caf10 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69cc01640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 0x7fd698156870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d5f0 tx=0x7fd68800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880125f0 con 0x7fd6980caf10 2023-11-04T01:40:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688012750 con 0x7fd6980caf10 2023-11-04T01:40:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6981573a0 con 0x7fd6980caf10 2023-11-04T01:40:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012ae0 con 0x7fd6980caf10 2023-11-04T01:40:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.800+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd698157960 con 0x7fd6980caf10 2023-11-04T01:40:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.804+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6980675f0 con 0x7fd6980caf10 2023-11-04T01:40:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.804+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd688012c40 con 0x7fd6980caf10 2023-11-04T01:40:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.804+0000 7fd68dffb640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd67c0664a0 0x7fd67c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.804+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6880842a0 con 0x7fd6980caf10 2023-11-04T01:40:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.804+0000 7fd69d402640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd67c0664a0 0x7fd67c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.804+0000 7fd69d402640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd67c0664a0 0x7fd67c068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd6940af000 tx=0x7fd6940a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.808+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6880517b0 con 0x7fd6980caf10 2023-11-04T01:40:34.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.960+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd69815ad40 con 0x7fd6980caf10 2023-11-04T01:40:34.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.964+0000 7fd68dffb640 1 -- 172.21.15.40:0/1729604751 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fd688007380 con 0x7fd6980caf10 2023-11-04T01:40:34.968 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:34.969 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd67c0664a0 msgr2=0x7fd67c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd67c0664a0 0x7fd67c068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd6940af000 tx=0x7fd6940a7070 comp rx=0 tx=0).stop 2023-11-04T01:40:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 msgr2=0x7fd698156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 0x7fd698156870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d5f0 tx=0x7fd68800dab0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 shutdown_connections 2023-11-04T01:40:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd67c0664a0 0x7fd67c068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd698159e70 0x7fd698163120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6980caf10 0x7fd698156870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 --2- 172.21.15.40:0/1729604751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd69806cd30 0x7fd698158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 >> 172.21.15.40:0/1729604751 conn(0x7fd69806e760 msgr2=0x7fd69806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 shutdown_connections 2023-11-04T01:40:34.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:34.968+0000 7fd69f666640 1 -- 172.21.15.40:0/1729604751 wait complete. 2023-11-04T01:40:34.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:34.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:35.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 Processor -- start 2023-11-04T01:40:35.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 -- start start 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8f40b0c20 0x7ff8f406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f406b840 0x7ff8f4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f406c010 con 0x7ff8f415d290 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40c90e0 con 0x7ff8f406b840 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8fa7ce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40ac960 con 0x7ff8f40b0c20 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f406b840 0x7ff8f4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f406b840 0x7ff8f4160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40606/0 (socket says 172.21.15.40:40606) 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 -- 172.21.15.40:0/1120529933 learned_addr learned my addr 172.21.15.40:0/1120529933 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f37fe640 1 --2- 172.21.15.40:0/1120529933 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40b0c20 0x7ff8f406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 -- 172.21.15.40:0/1120529933 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40b0c20 msgr2=0x7ff8f406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 --2- 172.21.15.40:0/1120529933 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40b0c20 0x7ff8f406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 -- 172.21.15.40:0/1120529933 >> v1:172.21.15.91:6789/0 conn(0x7ff8f415d290 legacy=0x7ff8f40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f8d6b640 1 -- 172.21.15.40:0/1120529933 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40acc40 con 0x7ff8f406b840 2023-11-04T01:40:35.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.112+0000 7ff8f37fe640 1 --2- 172.21.15.40:0/1120529933 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40b0c20 0x7ff8f406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:35.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f8d6b640 1 --2- 172.21.15.40:0/1120529933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f406b840 0x7ff8f4160cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40cc410 tx=0x7ff8ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b530df48e265ad26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f2ffd640 1 -- 172.21.15.40:0/1120529933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0a5860 con 0x7ff8f406b840 2023-11-04T01:40:35.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f2ffd640 1 -- 172.21.15.40:0/1120529933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0a59c0 con 0x7ff8f406b840 2023-11-04T01:40:35.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f2ffd640 1 -- 172.21.15.40:0/1120529933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0a5d50 con 0x7ff8f406b840 2023-11-04T01:40:35.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/1120529933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f406b840 msgr2=0x7ff8f4160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/1120529933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f406b840 0x7ff8f4160cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40cc410 tx=0x7ff8ec01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/1120529933 shutdown_connections 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/1120529933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f406b840 0x7ff8f4160cb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/1120529933 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40b0c20 0x7ff8f406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/1120529933 >> 172.21.15.40:0/1120529933 conn(0x7ff8f40cb510 msgr2=0x7ff8f40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/1120529933 shutdown_connections 2023-11-04T01:40:35.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/1120529933 wait complete. 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 Processor -- start 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- start start 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f406b840 0x7ff8f4150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 0x7ff8f4151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f415d290 0x7ff8f4156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4152740 con 0x7ff8f40b0c20 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4152510 con 0x7ff8f406b840 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8fa7ce640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4070c30 con 0x7ff8f415d290 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 0x7ff8f4151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 0x7ff8f4151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40608/0 (socket says 172.21.15.40:40608) 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 -- 172.21.15.40:0/3264201053 learned_addr learned my addr 172.21.15.40:0/3264201053 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f8d6b640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f415d290 0x7ff8f4156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f3fff640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f406b840 0x7ff8f4150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 -- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f415d290 msgr2=0x7ff8f4156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f415d290 0x7ff8f4156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 -- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f406b840 msgr2=0x7ff8f4150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f406b840 0x7ff8f4150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f37fe640 1 -- 172.21.15.40:0/3264201053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009b30 con 0x7ff8f40b0c20 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f8d6b640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f415d290 0x7ff8f4156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:35.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.116+0000 7ff8f3fff640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f406b840 0x7ff8f4150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:35.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f37fe640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 0x7ff8f4151fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800e840 tx=0x7ff8e800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800c8d0 con 0x7ff8f40b0c20 2023-11-04T01:40:35.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800ca30 con 0x7ff8f40b0c20 2023-11-04T01:40:35.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f4157530 con 0x7ff8f40b0c20 2023-11-04T01:40:35.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800cde0 con 0x7ff8f40b0c20 2023-11-04T01:40:35.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f4070300 con 0x7ff8f40b0c20 2023-11-04T01:40:35.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f40c59b0 con 0x7ff8f40b0c20 2023-11-04T01:40:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8e8013410 con 0x7ff8f40b0c20 2023-11-04T01:40:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f0ff9640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8e00664a0 0x7ff8e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8e8083c10 con 0x7ff8f40b0c20 2023-11-04T01:40:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f3fff640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8e00664a0 0x7ff8e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.120+0000 7ff8f3fff640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8e00664a0 0x7ff8e0068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4000f70 tx=0x7ff8e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.124+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8e8051120 con 0x7ff8f40b0c20 2023-11-04T01:40:35.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.280+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8f4070dc0 con 0x7ff8f40b0c20 2023-11-04T01:40:35.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8f0ff9640 1 -- 172.21.15.40:0/3264201053 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8e8054740 con 0x7ff8f40b0c20 2023-11-04T01:40:35.286 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8e00664a0 msgr2=0x7ff8e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8e00664a0 0x7ff8e0068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4000f70 tx=0x7ff8e4009040 comp rx=0 tx=0).stop 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 msgr2=0x7ff8f4151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 0x7ff8f4151fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800e840 tx=0x7ff8e800ed00 comp rx=0 tx=0).stop 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 shutdown_connections 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8e00664a0 0x7ff8e0068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f415d290 0x7ff8f4156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b0c20 0x7ff8f4151fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 --2- 172.21.15.40:0/3264201053 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f406b840 0x7ff8f4150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 >> 172.21.15.40:0/3264201053 conn(0x7ff8f40cb510 msgr2=0x7ff8f40cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 shutdown_connections 2023-11-04T01:40:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.284+0000 7ff8fa7ce640 1 -- 172.21.15.40:0/3264201053 wait complete. 2023-11-04T01:40:35.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:35.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.424+0000 7fcd34f6e640 1 Processor -- start 2023-11-04T01:40:35.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.424+0000 7fcd34f6e640 1 -- start start 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd34f6e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcd3015af70 0x7fcd300cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd34f6e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3015e890 con 0x7fcd3006d160 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd34f6e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3006c0c0 con 0x7fcd3015e490 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd34f6e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3006c3a0 con 0x7fcd3015af70 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2dd9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcd3006d160 0x7fcd3015dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43632/0 (socket says 172.21.15.40:43632) 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2dd9b640 1 -- 172.21.15.40:0/1325394977 learned_addr learned my addr 172.21.15.40:0/1325394977 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2e59c640 1 --2- 172.21.15.40:0/1325394977 >> v2:172.21.15.91:3300/0 conn(0x7fcd3015af70 0x7fcd300cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206432525 0 0) 0x7fcd24001120 con 0x7fcd3006d160 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18003530 con 0x7fcd3006d160 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 960108686 0 0) 0x7fcd18003530 con 0x7fcd3006d160 2023-11-04T01:40:35.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 >> v2:172.21.15.91:3300/0 conn(0x7fcd3015af70 msgr2=0x7fcd300cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 --2- 172.21.15.40:0/1325394977 >> v2:172.21.15.91:3300/0 conn(0x7fcd3015af70 0x7fcd300cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 >> v1:172.21.15.91:6789/0 conn(0x7fcd3015e490 legacy=0x7fcd300701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3006c680 con 0x7fcd3006d160 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fcd24001810 con 0x7fcd3006d160 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 >> v1:172.21.15.40:6789/0 conn(0x7fcd3006d160 legacy=0x7fcd3015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd180047d0 0x7fcd18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd18005190 0x7fcd1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3006c3a0 con 0x7fcd18005190 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800c030 con 0x7fcd18003980 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800c1f0 con 0x7fcd180047d0 2023-11-04T01:40:35.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2ed9d640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd18005190 0x7fcd1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2e59c640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2ed9d640 1 -- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd180047d0 msgr2=0x7fcd18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2ed9d640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd180047d0 0x7fcd18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2ed9d640 1 -- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd18003980 msgr2=0x7fcd18003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2ed9d640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.428+0000 7fcd2ed9d640 1 -- 172.21.15.40:0/1325394977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18003530 con 0x7fcd18005190 2023-11-04T01:40:35.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2ed9d640 1 -- 172.21.15.40:0/1325394977 reap_dead start 2023-11-04T01:40:35.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2ed9d640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd18005190 0x7fcd1800b990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd28001780 tx=0x7fcd2801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a5db382b221060 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280052d0 con 0x7fcd18005190 2023-11-04T01:40:35.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd280a7050 con 0x7fcd18005190 2023-11-04T01:40:35.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2d59a640 1 -- 172.21.15.40:0/1325394977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28003600 con 0x7fcd18005190 2023-11-04T01:40:35.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- 172.21.15.40:0/1325394977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd18005190 msgr2=0x7fcd1800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd18005190 0x7fcd1800b990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd28001780 tx=0x7fcd2801c400 comp rx=0 tx=0).stop 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- 172.21.15.40:0/1325394977 shutdown_connections 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/1325394977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd18005190 0x7fcd1800b990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- 172.21.15.40:0/1325394977 >> 172.21.15.40:0/1325394977 conn(0x7fcd300cb510 msgr2=0x7fcd300cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- 172.21.15.40:0/1325394977 shutdown_connections 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- 172.21.15.40:0/1325394977 wait complete. 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 Processor -- start 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- start start 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd18005190 0x7fcd3015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 0x7fcd30149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd300c2a40 0x7fcd3014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3014a680 con 0x7fcd300c25c0 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3014e760 con 0x7fcd300c2a40 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd34f6e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301696c0 con 0x7fcd18005190 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 0x7fcd30149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 0x7fcd30149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40622/0 (socket says 172.21.15.40:40622) 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 -- 172.21.15.40:0/114437565 learned_addr learned my addr 172.21.15.40:0/114437565 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2ed9d640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd300c2a40 0x7fcd3014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2e59c640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd18005190 0x7fcd3015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 -- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd18005190 msgr2=0x7fcd3015b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd18005190 0x7fcd3015b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 -- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd300c2a40 msgr2=0x7fcd3014a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd300c2a40 0x7fcd3014a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.432+0000 7fcd2dd9b640 1 -- 172.21.15.40:0/114437565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd301699a0 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd2dd9b640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 0x7fcd30149c00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c700 tx=0x7fcd2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240072d0 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24007450 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240047f0 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd30169c80 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3014ec80 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd300744a0 con 0x7fcd300c25c0 2023-11-04T01:40:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcd24004950 con 0x7fcd300c25c0 2023-11-04T01:40:35.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd1effd640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcd100664d0 0x7fcd10068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd24082f50 con 0x7fcd300c25c0 2023-11-04T01:40:35.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd2e59c640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcd100664d0 0x7fcd10068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.436+0000 7fcd2e59c640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcd100664d0 0x7fcd10068990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd200074a0 tx=0x7fcd2000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.440+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd24050460 con 0x7fcd300c25c0 2023-11-04T01:40:35.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.588+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd3015e890 con 0x7fcd300c25c0 2023-11-04T01:40:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd1effd640 1 -- 172.21.15.40:0/114437565 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd3015e890 con 0x7fcd300c25c0 2023-11-04T01:40:35.593 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcd100664d0 msgr2=0x7fcd10068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcd100664d0 0x7fcd10068990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd200074a0 tx=0x7fcd2000d040 comp rx=0 tx=0).stop 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 msgr2=0x7fcd30149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 0x7fcd30149c00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400c700 tx=0x7fcd2400cbc0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 shutdown_connections 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcd100664d0 0x7fcd10068990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcd300c2a40 0x7fcd3014a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd300c25c0 0x7fcd30149c00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 --2- 172.21.15.40:0/114437565 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcd18005190 0x7fcd3015b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 >> 172.21.15.40:0/114437565 conn(0x7fcd300cb510 msgr2=0x7fcd300cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 shutdown_connections 2023-11-04T01:40:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.592+0000 7fcd34f6e640 1 -- 172.21.15.40:0/114437565 wait complete. 2023-11-04T01:40:35.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:35.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 Processor -- start 2023-11-04T01:40:35.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 -- start start 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe2ec15d0b0 0x7fe2ec160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 0x7fe2ec0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec0b5e00 con 0x7fe2ec0cfd50 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d1520 con 0x7fe2ec15d0b0 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f2673640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d01e0 con 0x7fe2ec1610f0 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f0c10640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe2ec0cfd50 0x7fe2ec0b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43640/0 (socket says 172.21.15.40:43640) 2023-11-04T01:40:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f0c10640 1 -- 172.21.15.40:0/3504129245 learned_addr learned my addr 172.21.15.40:0/3504129245 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2ebfff640 1 --2- 172.21.15.40:0/3504129245 >> v2:172.21.15.91:3300/0 conn(0x7fe2ec15d0b0 0x7fe2ec160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 0x7fe2ec0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008730714 0 0) 0x7fe2ec0b5e00 con 0x7fe2ec0cfd50 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003530 con 0x7fe2ec0cfd50 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092027076 0 0) 0x7fe2d4003530 con 0x7fe2ec0cfd50 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 msgr2=0x7fe2ec0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 0x7fe2ec0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 >> v2:172.21.15.91:3300/0 conn(0x7fe2ec15d0b0 msgr2=0x7fe2ec160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 --2- 172.21.15.40:0/3504129245 >> v2:172.21.15.91:3300/0 conn(0x7fe2ec15d0b0 0x7fe2ec160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec15d490 con 0x7fe2ec0cfd50 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fe2dc001680 con 0x7fe2ec0cfd50 2023-11-04T01:40:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 >> v1:172.21.15.40:6789/0 conn(0x7fe2ec0cfd50 legacy=0x7fe2ec0b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 0x7fe2d4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d4003f00 0x7fe2d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2d4004d10 0x7fe2d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d1520 con 0x7fe2d4003f00 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d01e0 con 0x7fe2d4004d10 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d400b990 con 0x7fe2ec1610f0 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d4003f00 0x7fe2d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2ebfff640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 0x7fe2d4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 msgr2=0x7fe2d4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f0c10640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2d4004d10 0x7fe2d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2ec1610f0 0x7fe2d4003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2d4004d10 msgr2=0x7fe2d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:35.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2d4004d10 0x7fe2d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/3504129245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4003530 con 0x7fe2d4003f00 2023-11-04T01:40:35.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.728+0000 7fe2f0c10640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2d4004d10 0x7fe2d4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d4003f00 0x7fe2d40047d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009fc0 tx=0x7fe2e001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2235a3b756cdf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00a5b60 con 0x7fe2d4003f00 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000f040 con 0x7fe2d4003f00 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eaffd640 1 -- 172.21.15.40:0/3504129245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00ad440 con 0x7fe2d4003f00 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- 172.21.15.40:0/3504129245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d4003f00 msgr2=0x7fe2d40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 --2- 172.21.15.40:0/3504129245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d4003f00 0x7fe2d40047d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009fc0 tx=0x7fe2e001cc00 comp rx=0 tx=0).stop 2023-11-04T01:40:35.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f0c10640 1 -- 172.21.15.40:0/3504129245 reap_dead start 2023-11-04T01:40:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- 172.21.15.40:0/3504129245 shutdown_connections 2023-11-04T01:40:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- 172.21.15.40:0/3504129245 >> 172.21.15.40:0/3504129245 conn(0x7fe2ec06a890 msgr2=0x7fe2ec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- 172.21.15.40:0/3504129245 shutdown_connections 2023-11-04T01:40:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- 172.21.15.40:0/3504129245 wait complete. 2023-11-04T01:40:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 Processor -- start 2023-11-04T01:40:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- start start 2023-11-04T01:40:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2d4003f00 0x7fe2ec157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 0x7fe2ec0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2ec0b63f0 0x7fe2ec1f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0ca700 con 0x7fe2ec0cab20 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0b6870 con 0x7fe2ec0b63f0 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f2673640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec1f3ad0 con 0x7fe2d4003f00 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 0x7fe2ec0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 0x7fe2ec0b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40632/0 (socket says 172.21.15.40:40632) 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/2289578155 learned_addr learned my addr 172.21.15.40:0/2289578155 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2ebfff640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2d4003f00 0x7fe2ec157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f0c10640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2ec0b63f0 0x7fe2ec1f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2d4003f00 msgr2=0x7fe2ec157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2d4003f00 0x7fe2ec157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2ec0b63f0 msgr2=0x7fe2ec1f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2ec0b63f0 0x7fe2ec1f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 -- 172.21.15.40:0/2289578155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec158280 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2f0c10640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2ec0b63f0 0x7fe2ec1f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.732+0000 7fe2eb7fe640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 0x7fe2ec0b5eb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00b0040 tx=0x7fe2e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00bd070 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e00039a0 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec0b14e0 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0003d30 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec0ca040 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0744a0 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe2e00b4040 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2e8ff9640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2d80664a0 0x7fe2d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2e011db00 con 0x7fe2ec0cab20 2023-11-04T01:40:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2ebfff640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2d80664a0 0x7fe2d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:35.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.736+0000 7fe2ebfff640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2d80664a0 0x7fe2d8068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009ab0 tx=0x7fe2e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:35.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.740+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2e00eb010 con 0x7fe2ec0cab20 2023-11-04T01:40:35.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.896+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2ec0d0a10 con 0x7fe2ec0cab20 2023-11-04T01:40:35.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.896+0000 7fe2e8ff9640 1 -- 172.21.15.40:0/2289578155 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2e00b20a0 con 0x7fe2ec0cab20 2023-11-04T01:40:35.900 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2d80664a0 msgr2=0x7fe2d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2d80664a0 0x7fe2d8068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009ab0 tx=0x7fe2e4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 msgr2=0x7fe2ec0b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 0x7fe2ec0b5eb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00b0040 tx=0x7fe2e0009750 comp rx=0 tx=0).stop 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 shutdown_connections 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2d80664a0 0x7fe2d8068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2ec0b63f0 0x7fe2ec1f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ec0cab20 0x7fe2ec0b5eb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 --2- 172.21.15.40:0/2289578155 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2d4003f00 0x7fe2ec157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 >> 172.21.15.40:0/2289578155 conn(0x7fe2ec06a890 msgr2=0x7fe2ec0b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 shutdown_connections 2023-11-04T01:40:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:35.900+0000 7fe2f2673640 1 -- 172.21.15.40:0/2289578155 wait complete. 2023-11-04T01:40:35.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 Processor -- start 2023-11-04T01:40:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 -- start start 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6f64159fc0 0x7f6f640ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f640b0d40 0x7f6f6415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6406cfd0 con 0x7f6f640ca990 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640ca030 con 0x7f6f640b0d40 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.036+0000 7f6f69d5a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6415e830 con 0x7f6f64159fc0 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f640b0d40 0x7f6f6415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f5bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6f640ca990 0x7f6f640b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43642/0 (socket says 172.21.15.40:43642) 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f640b0d40 0x7f6f6415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40644/0 (socket says 172.21.15.40:40644) 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f5bfff640 1 -- 172.21.15.40:0/385929395 learned_addr learned my addr 172.21.15.40:0/385929395 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f637fe640 1 --2- 172.21.15.40:0/385929395 >> v2:172.21.15.91:3300/0 conn(0x7f6f64159fc0 0x7f6f640ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 -- 172.21.15.40:0/385929395 >> v2:172.21.15.91:3300/0 conn(0x7f6f64159fc0 msgr2=0x7f6f640ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 --2- 172.21.15.40:0/385929395 >> v2:172.21.15.91:3300/0 conn(0x7f6f64159fc0 0x7f6f640ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 -- 172.21.15.40:0/385929395 >> v1:172.21.15.40:6789/0 conn(0x7f6f640ca990 legacy=0x7f6f640b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 -- 172.21.15.40:0/385929395 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6415eb10 con 0x7f6f640b0d40 2023-11-04T01:40:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f62ffd640 1 -- 172.21.15.40:0/385929395 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388855583 0 0) 0x7f6f6406cfd0 con 0x7f6f640ca990 2023-11-04T01:40:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f63fff640 1 --2- 172.21.15.40:0/385929395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f640b0d40 0x7f6f6415dc50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f6406de50 tx=0x7f6f5c01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50e505089412c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f62ffd640 1 -- 172.21.15.40:0/385929395 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00b2d0 con 0x7f6f640b0d40 2023-11-04T01:40:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f62ffd640 1 -- 172.21.15.40:0/385929395 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0a78c0 con 0x7f6f640b0d40 2023-11-04T01:40:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f62ffd640 1 -- 172.21.15.40:0/385929395 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0a7c50 con 0x7f6f640b0d40 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 -- 172.21.15.40:0/385929395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f640b0d40 msgr2=0x7f6f6415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/385929395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f640b0d40 0x7f6f6415dc50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f6406de50 tx=0x7f6f5c01eae0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 -- 172.21.15.40:0/385929395 shutdown_connections 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/385929395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f640b0d40 0x7f6f6415dc50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/385929395 >> v2:172.21.15.91:3300/0 conn(0x7f6f64159fc0 0x7f6f640ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 -- 172.21.15.40:0/385929395 >> 172.21.15.40:0/385929395 conn(0x7f6f640cebb0 msgr2=0x7f6f640cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 -- 172.21.15.40:0/385929395 shutdown_connections 2023-11-04T01:40:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.040+0000 7f6f69d5a640 1 -- 172.21.15.40:0/385929395 wait complete. 2023-11-04T01:40:36.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 Processor -- start 2023-11-04T01:40:36.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- start start 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6f640b0d40 0x7f6f6414cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6f640ca990 0x7f6f6414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 0x7f6f64151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640c78f0 con 0x7f6f64159fc0 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640c7270 con 0x7f6f640ca990 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640b21b0 con 0x7f6f640b0d40 2023-11-04T01:40:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 0x7f6f64151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 0x7f6f64151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40658/0 (socket says 172.21.15.40:40658) 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 -- 172.21.15.40:0/2213282675 learned_addr learned my addr 172.21.15.40:0/2213282675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f5bfff640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6f640ca990 0x7f6f6414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 -- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6f640b0d40 msgr2=0x7f6f6414cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6f640b0d40 0x7f6f6414cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 -- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6f640ca990 msgr2=0x7f6f6414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6f640ca990 0x7f6f6414eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 -- 172.21.15.40:0/2213282675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c00bc80 con 0x7f6f64159fc0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f63fff640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 0x7f6f64151a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c01b6f0 tx=0x7f6f5c01b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c009740 con 0x7f6f64159fc0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0098c0 con 0x7f6f64159fc0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f640b1ed0 con 0x7f6f64159fc0 2023-11-04T01:40:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c009c70 con 0x7f6f64159fc0 2023-11-04T01:40:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6414f2e0 con 0x7f6f64159fc0 2023-11-04T01:40:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f640c7a30 con 0x7f6f64159fc0 2023-11-04T01:40:36.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f5c0ba470 con 0x7f6f64159fc0 2023-11-04T01:40:36.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f60ff9640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f440664d0 0x7f6f44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.044+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f5c1215a0 con 0x7f6f64159fc0 2023-11-04T01:40:36.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.048+0000 7f6f637fe640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f440664d0 0x7f6f44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.048+0000 7f6f637fe640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f440664d0 0x7f6f44068990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f640c5300 tx=0x7f6f54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.048+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6f640c7a30 con 0x7f6f64159fc0 2023-11-04T01:40:36.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.216+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f640c7a30 con 0x7f6f64159fc0 2023-11-04T01:40:36.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.216+0000 7f6f60ff9640 1 -- 172.21.15.40:0/2213282675 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f640c7a30 con 0x7f6f64159fc0 2023-11-04T01:40:36.220 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f440664d0 msgr2=0x7f6f44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f440664d0 0x7f6f44068990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f640c5300 tx=0x7f6f54008040 comp rx=0 tx=0).stop 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 msgr2=0x7f6f64151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 0x7f6f64151a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c01b6f0 tx=0x7f6f5c01b880 comp rx=0 tx=0).stop 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 shutdown_connections 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6f440664d0 0x7f6f44068990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f64159fc0 0x7f6f64151a30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6f640ca990 0x7f6f6414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 --2- 172.21.15.40:0/2213282675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6f640b0d40 0x7f6f6414cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 >> 172.21.15.40:0/2213282675 conn(0x7f6f640cebb0 msgr2=0x7f6f6406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 shutdown_connections 2023-11-04T01:40:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.220+0000 7f6f69d5a640 1 -- 172.21.15.40:0/2213282675 wait complete. 2023-11-04T01:40:36.239 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:40:36.239 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:36.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:36.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 Processor -- start 2023-11-04T01:40:36.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 -- start start 2023-11-04T01:40:36.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000d0690 0x7f88000b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88000d0ae0 0x7f88000b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88000b6070 con 0x7f88000b4990 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000b8ed0 con 0x7f88000d0ae0 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f8807f23640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88000d1ce0 con 0x7f88000d0690 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88000d0ae0 0x7f88000b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88000d0ae0 0x7f88000b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40666/0 (socket says 172.21.15.40:40666) 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 -- 172.21.15.40:0/1960180065 learned_addr learned my addr 172.21.15.40:0/1960180065 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88054be640 1 --2- 172.21.15.40:0/1960180065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000d0690 0x7f88000b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 -- 172.21.15.40:0/1960180065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000d0690 msgr2=0x7f88000b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:36.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 --2- 172.21.15.40:0/1960180065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000d0690 0x7f88000b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 -- 172.21.15.40:0/1960180065 >> v1:172.21.15.91:6789/0 conn(0x7f88000b4990 legacy=0x7f88000b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.404+0000 7f88064c0640 1 -- 172.21.15.40:0/1960180065 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000d1fc0 con 0x7f88000d0ae0 2023-11-04T01:40:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f88064c0640 1 --2- 172.21.15.40:0/1960180065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0ae0 0x7f88000b6a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009e50 tx=0x7f87f801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6875a4b4673994 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8804cbd640 1 -- 172.21.15.40:0/1960180065 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80af400 con 0x7f88000d0ae0 2023-11-04T01:40:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8804cbd640 1 -- 172.21.15.40:0/1960180065 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f80ab050 con 0x7f88000d0ae0 2023-11-04T01:40:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8804cbd640 1 -- 172.21.15.40:0/1960180065 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80af780 con 0x7f88000d0ae0 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 -- 172.21.15.40:0/1960180065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0ae0 msgr2=0x7f88000b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 --2- 172.21.15.40:0/1960180065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0ae0 0x7f88000b6a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009e50 tx=0x7f87f801f1f0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 -- 172.21.15.40:0/1960180065 shutdown_connections 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 --2- 172.21.15.40:0/1960180065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0ae0 0x7f88000b6a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 --2- 172.21.15.40:0/1960180065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000d0690 0x7f88000b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 -- 172.21.15.40:0/1960180065 >> 172.21.15.40:0/1960180065 conn(0x7f88000cf990 msgr2=0x7f88000cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 -- 172.21.15.40:0/1960180065 shutdown_connections 2023-11-04T01:40:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.408+0000 7f8807f23640 1 -- 172.21.15.40:0/1960180065 wait complete. 2023-11-04T01:40:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 Processor -- start 2023-11-04T01:40:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- start start 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000b4990 0x7f88001f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 0x7f8800153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88000d0ae0 0x7f88000b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880015ee70 con 0x7f88000d0690 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001f6db0 con 0x7f88000d0ae0 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800154270 con 0x7f88000b4990 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 0x7f8800153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 0x7f8800153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40678/0 (socket says 172.21.15.40:40678) 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 -- 172.21.15.40:0/136140865 learned_addr learned my addr 172.21.15.40:0/136140865 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8805cbf640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000b4990 0x7f88001f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88064c0640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88000d0ae0 0x7f88000b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 -- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000b4990 msgr2=0x7f88001f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000b4990 0x7f88001f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 -- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88000d0ae0 msgr2=0x7f88000b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88000d0ae0 0x7f88000b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 -- 172.21.15.40:0/136140865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009b30 con 0x7f88000d0690 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f88054be640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 0x7f8800153d30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f87f000d7d0 tx=0x7f87f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f000b6c0 con 0x7f88000d0690 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f000b820 con 0x7f88000d0690 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88001f6510 con 0x7f88000d0690 2023-11-04T01:40:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f000bbb0 con 0x7f88000d0690 2023-11-04T01:40:36.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88001f6ad0 con 0x7f88000d0690 2023-11-04T01:40:36.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88000744a0 con 0x7f88000d0690 2023-11-04T01:40:36.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.412+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87f000bd10 con 0x7f88000d0690 2023-11-04T01:40:36.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.416+0000 7f87f67fc640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87e40664a0 0x7f87e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.416+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87f0084170 con 0x7f88000d0690 2023-11-04T01:40:36.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.416+0000 7f8805cbf640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87e40664a0 0x7f87e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.416+0000 7f8805cbf640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87e40664a0 0x7f87e4068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87fc007fd0 tx=0x7f87fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.420+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87f0051730 con 0x7f88000d0690 2023-11-04T01:40:36.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.576+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88000d1060 con 0x7f88000d0690 2023-11-04T01:40:36.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.576+0000 7f87f67fc640 1 -- 172.21.15.40:0/136140865 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f87f0054d50 con 0x7f88000d0690 2023-11-04T01:40:36.580 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:36.580 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:39:58.859082+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87e40664a0 msgr2=0x7f87e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87e40664a0 0x7f87e4068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87fc007fd0 tx=0x7f87fc009040 comp rx=0 tx=0).stop 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 msgr2=0x7f8800153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 0x7f8800153d30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f87f000d7d0 tx=0x7f87f000dc90 comp rx=0 tx=0).stop 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 shutdown_connections 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87e40664a0 0x7f87e4068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f88000d0ae0 0x7f88000b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88000d0690 0x7f8800153d30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 --2- 172.21.15.40:0/136140865 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f88000b4990 0x7f88001f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 >> 172.21.15.40:0/136140865 conn(0x7f88000cf990 msgr2=0x7f88000b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 shutdown_connections 2023-11-04T01:40:36.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.580+0000 7f8807f23640 1 -- 172.21.15.40:0/136140865 wait complete. 2023-11-04T01:40:36.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:36.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:36.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 Processor -- start 2023-11-04T01:40:36.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 -- start start 2023-11-04T01:40:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f64540b0c20 0x7f645415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f645415c160 0x7f64540ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540cb130 con 0x7f645415acb0 2023-11-04T01:40:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645415bd40 con 0x7f645415c160 2023-11-04T01:40:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645c53c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645406fd80 con 0x7f64540b0c20 2023-11-04T01:40:36.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645aad9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f645415c160 0x7f64540ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645a2d8640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f645415acb0 0x7f64540b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46232/0 (socket says 172.21.15.40:46232) 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645a2d8640 1 -- 172.21.15.40:0/1086888455 learned_addr learned my addr 172.21.15.40:0/1086888455 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f6459ad7640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f64540b0c20 0x7f645415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645aad9640 1 -- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f64540b0c20 msgr2=0x7f645415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645aad9640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f64540b0c20 0x7f645415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645aad9640 1 -- 172.21.15.40:0/1086888455 >> v1:172.21.15.91:6789/0 conn(0x7f645415acb0 legacy=0x7f64540b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f645aad9640 1 -- 172.21.15.40:0/1086888455 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645415b680 con 0x7f645415c160 2023-11-04T01:40:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.716+0000 7f6459ad7640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f64540b0c20 0x7f645415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645aad9640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415c160 0x7f64540ca490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f644c009d90 tx=0x7f644c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbd08384fd96e7e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f64592d6640 1 -- 172.21.15.40:0/1086888455 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0a5a00 con 0x7f645415c160 2023-11-04T01:40:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f64592d6640 1 -- 172.21.15.40:0/1086888455 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c0a5b60 con 0x7f645415c160 2023-11-04T01:40:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f64592d6640 1 -- 172.21.15.40:0/1086888455 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c0ad440 con 0x7f645415c160 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 -- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415c160 msgr2=0x7f64540ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415c160 0x7f64540ca490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f644c009d90 tx=0x7f644c01c920 comp rx=0 tx=0).stop 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 -- 172.21.15.40:0/1086888455 shutdown_connections 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415c160 0x7f64540ca490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 --2- 172.21.15.40:0/1086888455 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f64540b0c20 0x7f645415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 -- 172.21.15.40:0/1086888455 >> 172.21.15.40:0/1086888455 conn(0x7f64540cb510 msgr2=0x7f64540cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 -- 172.21.15.40:0/1086888455 shutdown_connections 2023-11-04T01:40:36.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 -- 172.21.15.40:0/1086888455 wait complete. 2023-11-04T01:40:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.720+0000 7f645c53c640 1 Processor -- start 2023-11-04T01:40:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- start start 2023-11-04T01:40:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 0x7f64541520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415acb0 0x7f64540cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f645415c160 0x7f64540ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454154e70 con 0x7f64540b0c20 2023-11-04T01:40:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454155150 con 0x7f645415acb0 2023-11-04T01:40:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454155430 con 0x7f645415c160 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 0x7f64541520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 0x7f64541520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40684/0 (socket says 172.21.15.40:40684) 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 -- 172.21.15.40:0/2896799489 learned_addr learned my addr 172.21.15.40:0/2896799489 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f6459ad7640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415acb0 0x7f64540cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645aad9640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f645415c160 0x7f64540ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 -- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f645415c160 msgr2=0x7f64540ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f645415c160 0x7f64540ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 -- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415acb0 msgr2=0x7f64540cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415acb0 0x7f64540cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 -- 172.21.15.40:0/2896799489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444009420 con 0x7f64540b0c20 2023-11-04T01:40:36.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645a2d8640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 0x7f64541520e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f645000c420 tx=0x7f645000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450005cf0 con 0x7f64540b0c20 2023-11-04T01:40:36.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450005e50 con 0x7f64540b0c20 2023-11-04T01:40:36.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500072f0 con 0x7f64540b0c20 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c009a70 con 0x7f64540b0c20 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540c65a0 con 0x7f64540b0c20 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64540744a0 con 0x7f64540b0c20 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.724+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6450007450 con 0x7f64540b0c20 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.728+0000 7f644affd640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f64380664a0 0x7f6438068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.728+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64500833e0 con 0x7f64540b0c20 2023-11-04T01:40:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.728+0000 7f6459ad7640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f64380664a0 0x7f6438068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.728+0000 7f6459ad7640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f64380664a0 0x7f6438068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f645415d020 tx=0x7f6444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.732+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64500508f0 con 0x7f64540b0c20 2023-11-04T01:40:36.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6454071c80 con 0x7f64540b0c20 2023-11-04T01:40:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f644affd640 1 -- 172.21.15.40:0/2896799489 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64500170a0 con 0x7f64540b0c20 2023-11-04T01:40:36.883 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:36.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f64380664a0 msgr2=0x7f6438068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f64380664a0 0x7f6438068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f645415d020 tx=0x7f6444008040 comp rx=0 tx=0).stop 2023-11-04T01:40:36.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 msgr2=0x7f64541520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 0x7f64541520e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f645000c420 tx=0x7f645000c8e0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 shutdown_connections 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f64380664a0 0x7f6438068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f645415c160 0x7f64540ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f645415acb0 0x7f64540cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 --2- 172.21.15.40:0/2896799489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64540b0c20 0x7f64541520e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 >> 172.21.15.40:0/2896799489 conn(0x7f64540cb510 msgr2=0x7f645415d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 shutdown_connections 2023-11-04T01:40:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:36.880+0000 7f645c53c640 1 -- 172.21.15.40:0/2896799489 wait complete. 2023-11-04T01:40:36.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:37.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.012+0000 7eff9e0ca640 1 Processor -- start 2023-11-04T01:40:37.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.012+0000 7eff9e0ca640 1 -- start start 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff9e0ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff9815ae20 0x7eff980ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff9e0ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff980cecc0 0x7eff9806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff9e0ca640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980cbb30 con 0x7eff980d18a0 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff9e0ca640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff980cbe10 con 0x7eff980cecc0 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff9e0ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff980cc0f0 con 0x7eff9815ae20 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff980cecc0 0x7eff9806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff980cecc0 0x7eff9806d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40696/0 (socket says 172.21.15.40:40696) 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 -- 172.21.15.40:0/3919074893 learned_addr learned my addr 172.21.15.40:0/3919074893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff977fe640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff9815ae20 0x7eff980ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 -- 172.21.15.40:0/3919074893 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff9815ae20 msgr2=0x7eff980ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff9815ae20 0x7eff980ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 -- 172.21.15.40:0/3919074893 >> v1:172.21.15.91:6789/0 conn(0x7eff980d18a0 legacy=0x7eff980b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 -- 172.21.15.40:0/3919074893 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980cc3d0 con 0x7eff980cecc0 2023-11-04T01:40:37.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff977fe640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff9815ae20 0x7eff980ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:37.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff97fff640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff9806d6c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7eff90009e50 tx=0x7eff9001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7566b91d006d1a0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff96ffd640 1 -- 172.21.15.40:0/3919074893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900af400 con 0x7eff980cecc0 2023-11-04T01:40:37.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff96ffd640 1 -- 172.21.15.40:0/3919074893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900ab050 con 0x7eff980cecc0 2023-11-04T01:40:37.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.016+0000 7eff96ffd640 1 -- 172.21.15.40:0/3919074893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900af780 con 0x7eff980cecc0 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/3919074893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 msgr2=0x7eff9806d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff9806d6c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7eff90009e50 tx=0x7eff9001f1c0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/3919074893 shutdown_connections 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff9806d6c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/3919074893 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff9815ae20 0x7eff980ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/3919074893 >> 172.21.15.40:0/3919074893 conn(0x7eff9809a030 msgr2=0x7eff980d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/3919074893 shutdown_connections 2023-11-04T01:40:37.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/3919074893 wait complete. 2023-11-04T01:40:37.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 Processor -- start 2023-11-04T01:40:37.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- start start 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff98156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff9815ae20 0x7eff980c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff980c5840 0x7eff9815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980b4100 con 0x7eff980cecc0 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff981f4b80 con 0x7eff9815ae20 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff980b37d0 con 0x7eff980c5840 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff98156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff98156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40698/0 (socket says 172.21.15.40:40698) 2023-11-04T01:40:37.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 -- 172.21.15.40:0/353189132 learned_addr learned my addr 172.21.15.40:0/353189132 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff97fff640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff980c5840 0x7eff9815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 -- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff980c5840 msgr2=0x7eff9815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff980c5840 0x7eff9815d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff8effd640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff9815ae20 0x7eff980c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 -- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff9815ae20 msgr2=0x7eff980c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff9815ae20 0x7eff980c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 -- 172.21.15.40:0/353189132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009b30 con 0x7eff980cecc0 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff977fe640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff98156ce0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c7f0 tx=0x7eff8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88005ba0 con 0x7eff980cecc0 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88005d00 con 0x7eff980cecc0 2023-11-04T01:40:37.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff980b3ab0 con 0x7eff980cecc0 2023-11-04T01:40:37.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88007a50 con 0x7eff980cecc0 2023-11-04T01:40:37.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9815da10 con 0x7eff980cecc0 2023-11-04T01:40:37.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.020+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff980744a0 con 0x7eff980cecc0 2023-11-04T01:40:37.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.024+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff88007bb0 con 0x7eff980cecc0 2023-11-04T01:40:37.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.024+0000 7eff94ff9640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff7c0664a0 0x7eff7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.024+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff88083d90 con 0x7eff980cecc0 2023-11-04T01:40:37.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.024+0000 7eff8effd640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff7c0664a0 0x7eff7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.024+0000 7eff8effd640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff7c0664a0 0x7eff7c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff980c41b0 tx=0x7eff80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.028+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff880512a0 con 0x7eff980cecc0 2023-11-04T01:40:37.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff9815d2b0 con 0x7eff980cecc0 2023-11-04T01:40:37.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff94ff9640 1 -- 172.21.15.40:0/353189132 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff8801e020 con 0x7eff980cecc0 2023-11-04T01:40:37.183 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff7c0664a0 msgr2=0x7eff7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff7c0664a0 0x7eff7c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff980c41b0 tx=0x7eff80009040 comp rx=0 tx=0).stop 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 msgr2=0x7eff98156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff98156ce0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c7f0 tx=0x7eff8800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 shutdown_connections 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff7c0664a0 0x7eff7c068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff980c5840 0x7eff9815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff9815ae20 0x7eff980c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 --2- 172.21.15.40:0/353189132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff980cecc0 0x7eff98156ce0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 >> 172.21.15.40:0/353189132 conn(0x7eff9809a030 msgr2=0x7eff980af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 shutdown_connections 2023-11-04T01:40:37.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.180+0000 7eff9e0ca640 1 -- 172.21.15.40:0/353189132 wait complete. 2023-11-04T01:40:37.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:37.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.320+0000 7ff8aa2b6640 1 Processor -- start 2023-11-04T01:40:37.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.320+0000 7ff8aa2b6640 1 -- start start 2023-11-04T01:40:37.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8aa2b6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8a40adb50 0x7ff8a40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8aa2b6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a40cc990 0x7ff8a40ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8aa2b6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40cd020 con 0x7ff8a406c3d0 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8aa2b6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40cce40 con 0x7ff8a40cc990 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8aa2b6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40b0c90 con 0x7ff8a40adb50 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a40cc990 0x7ff8a40ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a40cc990 0x7ff8a40ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47170/0 (socket says 172.21.15.40:47170) 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a8853640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff8a406c3d0 0x7ff8a40b0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45336/0 (socket says 172.21.15.40:45336) 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 -- 172.21.15.40:0/643391756 learned_addr learned my addr 172.21.15.40:0/643391756 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a3fff640 1 --2- 172.21.15.40:0/643391756 >> v2:172.21.15.91:3300/0 conn(0x7ff8a40adb50 0x7ff8a40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 -- 172.21.15.40:0/643391756 >> v2:172.21.15.91:3300/0 conn(0x7ff8a40adb50 msgr2=0x7ff8a40adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 --2- 172.21.15.40:0/643391756 >> v2:172.21.15.91:3300/0 conn(0x7ff8a40adb50 0x7ff8a40adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 -- 172.21.15.40:0/643391756 >> v1:172.21.15.40:6789/0 conn(0x7ff8a406c3d0 legacy=0x7ff8a40b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a2ffd640 1 -- 172.21.15.40:0/643391756 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868728149 0 0) 0x7ff8a40cd020 con 0x7ff8a406c3d0 2023-11-04T01:40:37.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 -- 172.21.15.40:0/643391756 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40cd300 con 0x7ff8a40cc990 2023-11-04T01:40:37.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a37fe640 1 --2- 172.21.15.40:0/643391756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40cc990 0x7ff8a40ce0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40b0fa0 tx=0x7ff88c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3bf7c823219919 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a2ffd640 1 -- 172.21.15.40:0/643391756 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0a7c70 con 0x7ff8a40cc990 2023-11-04T01:40:37.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a2ffd640 1 -- 172.21.15.40:0/643391756 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c0a7dd0 con 0x7ff8a40cc990 2023-11-04T01:40:37.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.324+0000 7ff8a2ffd640 1 -- 172.21.15.40:0/643391756 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0af660 con 0x7ff8a40cc990 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/643391756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40cc990 msgr2=0x7ff8a40ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/643391756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40cc990 0x7ff8a40ce0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40b0fa0 tx=0x7ff88c01eba0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/643391756 shutdown_connections 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/643391756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40cc990 0x7ff8a40ce0c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/643391756 >> v2:172.21.15.91:3300/0 conn(0x7ff8a40adb50 0x7ff8a40adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/643391756 >> 172.21.15.40:0/643391756 conn(0x7ff8a40cb510 msgr2=0x7ff8a40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/643391756 shutdown_connections 2023-11-04T01:40:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/643391756 wait complete. 2023-11-04T01:40:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 Processor -- start 2023-11-04T01:40:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- start start 2023-11-04T01:40:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8a406c3d0 0x7ff8a41f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 0x7ff8a40c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a40cc990 0x7ff8a40c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c7830 con 0x7ff8a40adb50 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c7b10 con 0x7ff8a40cc990 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c7df0 con 0x7ff8a406c3d0 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 0x7ff8a40c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 0x7ff8a40c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47172/0 (socket says 172.21.15.40:47172) 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 -- 172.21.15.40:0/1337837892 learned_addr learned my addr 172.21.15.40:0/1337837892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 -- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8a406c3d0 msgr2=0x7ff8a41f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8a406c3d0 0x7ff8a41f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 -- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a40cc990 msgr2=0x7ff8a40c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a40cc990 0x7ff8a40c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 -- 172.21.15.40:0/1337837892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c00b770 con 0x7ff8a40adb50 2023-11-04T01:40:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a37fe640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 0x7ff8a40c4620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff88c01b7b0 tx=0x7ff88c01b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0afea0 con 0x7ff8a40adb50 2023-11-04T01:40:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c004020 con 0x7ff8a40adb50 2023-11-04T01:40:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a40c80d0 con 0x7ff8a40adb50 2023-11-04T01:40:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0043b0 con 0x7ff8a40adb50 2023-11-04T01:40:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a41f4bf0 con 0x7ff8a40adb50 2023-11-04T01:40:37.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.328+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a40744a0 con 0x7ff8a40adb50 2023-11-04T01:40:37.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.332+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff88c003620 con 0x7ff8a40adb50 2023-11-04T01:40:37.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.332+0000 7ff8a0ff9640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8840664a0 0x7ff884068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.332+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff88c120a90 con 0x7ff8a40adb50 2023-11-04T01:40:37.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.332+0000 7ff8a3fff640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8840664a0 0x7ff884068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.332+0000 7ff8a3fff640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8840664a0 0x7ff884068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4152f50 tx=0x7ff894008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.336+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff88c0edf10 con 0x7ff8a40adb50 2023-11-04T01:40:37.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.480+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8a40b1420 con 0x7ff8a40adb50 2023-11-04T01:40:37.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8a0ff9640 1 -- 172.21.15.40:0/1337837892 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff88c0b40a0 con 0x7ff8a40adb50 2023-11-04T01:40:37.486 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:37.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8840664a0 msgr2=0x7ff884068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8840664a0 0x7ff884068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4152f50 tx=0x7ff894008040 comp rx=0 tx=0).stop 2023-11-04T01:40:37.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 msgr2=0x7ff8a40c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 0x7ff8a40c4620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff88c01b7b0 tx=0x7ff88c01b940 comp rx=0 tx=0).stop 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 shutdown_connections 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8840664a0 0x7ff884068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8a40cc990 0x7ff8a40c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a40adb50 0x7ff8a40c4620 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 --2- 172.21.15.40:0/1337837892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8a406c3d0 0x7ff8a41f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 >> 172.21.15.40:0/1337837892 conn(0x7ff8a40cb510 msgr2=0x7ff8a41587f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 shutdown_connections 2023-11-04T01:40:37.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.484+0000 7ff8aa2b6640 1 -- 172.21.15.40:0/1337837892 wait complete. 2023-11-04T01:40:37.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:37.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.616+0000 7f46a851d640 1 Processor -- start 2023-11-04T01:40:37.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a851d640 1 -- start start 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a851d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46a015d240 0x7f46a015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a851d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a00b49c0 0x7f46a00b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a851d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00b52e0 con 0x7f46a00d0b10 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a851d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00d2280 con 0x7f46a00b49c0 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a851d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00d2560 con 0x7f46a015d240 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a00b49c0 0x7f46a00b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a00b49c0 0x7f46a00b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47188/0 (socket says 172.21.15.40:47188) 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 -- 172.21.15.40:0/1755999897 learned_addr learned my addr 172.21.15.40:0/1755999897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:37.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a62b9640 1 --2- 172.21.15.40:0/1755999897 >> v2:172.21.15.91:3300/0 conn(0x7f46a015d240 0x7f46a015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 -- 172.21.15.40:0/1755999897 >> v2:172.21.15.91:3300/0 conn(0x7f46a015d240 msgr2=0x7f46a015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:37.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 --2- 172.21.15.40:0/1755999897 >> v2:172.21.15.91:3300/0 conn(0x7f46a015d240 0x7f46a015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 -- 172.21.15.40:0/1755999897 >> v1:172.21.15.91:6789/0 conn(0x7f46a00d0b10 legacy=0x7f46a00d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.620+0000 7f46a6aba640 1 -- 172.21.15.40:0/1755999897 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00d2840 con 0x7f46a00b49c0 2023-11-04T01:40:37.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a6aba640 1 --2- 172.21.15.40:0/1755999897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a00b49c0 0x7f46a00b4da0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f46a008c090 tx=0x7f469801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d4bc526de02082 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a52b7640 1 -- 172.21.15.40:0/1755999897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980aa650 con 0x7f46a00b49c0 2023-11-04T01:40:37.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a52b7640 1 -- 172.21.15.40:0/1755999897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980aa7b0 con 0x7f46a00b49c0 2023-11-04T01:40:37.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a52b7640 1 -- 172.21.15.40:0/1755999897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980aab40 con 0x7f46a00b49c0 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- 172.21.15.40:0/1755999897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a00b49c0 msgr2=0x7f46a00b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 --2- 172.21.15.40:0/1755999897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a00b49c0 0x7f46a00b4da0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f46a008c090 tx=0x7f469801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- 172.21.15.40:0/1755999897 shutdown_connections 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 --2- 172.21.15.40:0/1755999897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a00b49c0 0x7f46a00b4da0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 --2- 172.21.15.40:0/1755999897 >> v2:172.21.15.91:3300/0 conn(0x7f46a015d240 0x7f46a015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- 172.21.15.40:0/1755999897 >> 172.21.15.40:0/1755999897 conn(0x7f46a00cf9c0 msgr2=0x7f46a00cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- 172.21.15.40:0/1755999897 shutdown_connections 2023-11-04T01:40:37.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- 172.21.15.40:0/1755999897 wait complete. 2023-11-04T01:40:37.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 Processor -- start 2023-11-04T01:40:37.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- start start 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46a00b49c0 0x7f46a015f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46a00d0b10 0x7f46a014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 0x7f46a0150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a015a8d0 con 0x7f46a015d240 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0160420 con 0x7f46a00d0b10 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a851d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a014eb30 con 0x7f46a00b49c0 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a6aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 0x7f46a0150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a6aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 0x7f46a0150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47202/0 (socket says 172.21.15.40:47202) 2023-11-04T01:40:37.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a6aba640 1 -- 172.21.15.40:0/3512148562 learned_addr learned my addr 172.21.15.40:0/3512148562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:37.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a5ab8640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46a00d0b10 0x7f46a014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.624+0000 7f46a62b9640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46a00b49c0 0x7f46a015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a6aba640 1 -- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46a00b49c0 msgr2=0x7f46a015f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a6aba640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46a00b49c0 0x7f46a015f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a6aba640 1 -- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46a00d0b10 msgr2=0x7f46a014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a6aba640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46a00d0b10 0x7f46a014e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a6aba640 1 -- 172.21.15.40:0/3512148562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980094d0 con 0x7f46a015d240 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a6aba640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 0x7f46a0150860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f46980190e0 tx=0x7f469801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980bd5f0 con 0x7f46a015d240 2023-11-04T01:40:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980bd750 con 0x7f46a015d240 2023-11-04T01:40:37.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a0160140 con 0x7f46a015d240 2023-11-04T01:40:37.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980bdae0 con 0x7f46a015d240 2023-11-04T01:40:37.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a015adb0 con 0x7f46a015d240 2023-11-04T01:40:37.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a00675f0 con 0x7f46a015d240 2023-11-04T01:40:37.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f46980c8470 con 0x7f46a015d240 2023-11-04T01:40:37.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f469effd640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f468c0664d0 0x7f468c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:37.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f469811ef40 con 0x7f46a015d240 2023-11-04T01:40:37.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a62b9640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f468c0664d0 0x7f468c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:37.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.628+0000 7f46a62b9640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f468c0664d0 0x7f468c068990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46a0155170 tx=0x7f4694009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:37.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.632+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46980ec550 con 0x7f46a015d240 2023-11-04T01:40:37.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.792+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f46a00c6cc0 con 0x7f46a015d240 2023-11-04T01:40:37.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.792+0000 7f469effd640 1 -- 172.21.15.40:0/3512148562 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f46980efb70 con 0x7f46a015d240 2023-11-04T01:40:37.797 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f468c0664d0 msgr2=0x7f468c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f468c0664d0 0x7f468c068990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46a0155170 tx=0x7f4694009190 comp rx=0 tx=0).stop 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 msgr2=0x7f46a0150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 0x7f46a0150860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f46980190e0 tx=0x7f469801ad10 comp rx=0 tx=0).stop 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 shutdown_connections 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f468c0664d0 0x7f468c068990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015d240 0x7f46a0150860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f46a00d0b10 0x7f46a014e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 --2- 172.21.15.40:0/3512148562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46a00b49c0 0x7f46a015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 >> 172.21.15.40:0/3512148562 conn(0x7f46a00cf9c0 msgr2=0x7f46a015d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 shutdown_connections 2023-11-04T01:40:37.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37.796+0000 7f46a851d640 1 -- 172.21.15.40:0/3512148562 wait complete. 2023-11-04T01:40:37.814 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:40:37.814 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:37.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:37.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:37.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[45683]: fuse finished with error 0 and tester_r 0 2023-11-04T01:40:37.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:37.882 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:37.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:37.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:40:37.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.892 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:40:37.952 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:40:37.952 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:37.959 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:40:37.959 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:38.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:38.058 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi091.stderr:2023-11-04T01:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 Processor -- start 2023-11-04T01:40:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 -- start start 2023-11-04T01:40:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f01980ce8a0 0x7f01980cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f01980cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019815eb30 con 0x7f01980b3270 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019815ee10 con 0x7f01980ce8a0 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019cb53640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019815f0f0 con 0x7f01980cec80 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f0196d9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f01980cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f01980ce8a0 0x7f01980cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f0196d9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f01980cfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:33452/0 (socket says 172.21.15.40:33452) 2023-11-04T01:40:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f0196d9d640 1 -- 172.21.15.40:0/3883697004 learned_addr learned my addr 172.21.15.40:0/3883697004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019659c640 1 -- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 msgr2=0x7f01980cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019659c640 1 --2- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f01980cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019659c640 1 -- 172.21.15.40:0/3883697004 >> v1:172.21.15.91:6789/0 conn(0x7f01980b3270 legacy=0x7f019815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f019659c640 1 -- 172.21.15.40:0/3883697004 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019815f3d0 con 0x7f01980ce8a0 2023-11-04T01:40:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.136+0000 7f0196d9d640 1 --2- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f01980cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019659c640 1 --2- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980ce8a0 0x7f01980cca90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f01880097c0 tx=0x7f018801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b5f3bcc0538d3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019559a640 1 -- 172.21.15.40:0/3883697004 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880ac640 con 0x7f01980ce8a0 2023-11-04T01:40:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019559a640 1 -- 172.21.15.40:0/3883697004 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01880ac7a0 con 0x7f01980ce8a0 2023-11-04T01:40:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019559a640 1 -- 172.21.15.40:0/3883697004 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880acb30 con 0x7f01980ce8a0 2023-11-04T01:40:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 -- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980ce8a0 msgr2=0x7f01980cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 --2- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980ce8a0 0x7f01980cca90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f01880097c0 tx=0x7f018801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 -- 172.21.15.40:0/3883697004 shutdown_connections 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 --2- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f01980cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 --2- 172.21.15.40:0/3883697004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980ce8a0 0x7f01980cca90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 -- 172.21.15.40:0/3883697004 >> 172.21.15.40:0/3883697004 conn(0x7f019806f6e0 msgr2=0x7f019806faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 -- 172.21.15.40:0/3883697004 shutdown_connections 2023-11-04T01:40:38.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 -- 172.21.15.40:0/3883697004 wait complete. 2023-11-04T01:40:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 Processor -- start 2023-11-04T01:40:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.140+0000 7f019cb53640 1 -- start start 2023-11-04T01:40:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980b3270 0x7f01980b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 0x7f019806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f019806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198155e00 con 0x7f01980ce8a0 2023-11-04T01:40:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198155af0 con 0x7f01980b3270 2023-11-04T01:40:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b4470 con 0x7f01980cec80 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 0x7f019806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 0x7f019806bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47210/0 (socket says 172.21.15.40:47210) 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 -- 172.21.15.40:0/2035903366 learned_addr learned my addr 172.21.15.40:0/2035903366 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019659c640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980b3270 0x7f01980b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0196d9d640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f019806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 -- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 msgr2=0x7f019806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f019806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 -- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980b3270 msgr2=0x7f01980b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980b3270 0x7f01980b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 -- 172.21.15.40:0/2035903366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009b30 con 0x7f01980ce8a0 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019659c640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980b3270 0x7f01980b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:38.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0195d9b640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 0x7f019806bc80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c3a0 tx=0x7f018c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0052d0 con 0x7f01980ce8a0 2023-11-04T01:40:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c005430 con 0x7f01980ce8a0 2023-11-04T01:40:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c007260 con 0x7f01980ce8a0 2023-11-04T01:40:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188009420 con 0x7f01980ce8a0 2023-11-04T01:40:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019806c860 con 0x7f01980ce8a0 2023-11-04T01:40:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198155f40 con 0x7f01980ce8a0 2023-11-04T01:40:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f018c0073c0 con 0x7f01980ce8a0 2023-11-04T01:40:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0186ffd640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f01780664a0 0x7f0178068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f018c0831c0 con 0x7f01980ce8a0 2023-11-04T01:40:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.144+0000 7f019659c640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f01780664a0 0x7f0178068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.148+0000 7f019659c640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f01780664a0 0x7f0178068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01880ae000 tx=0x7f0188008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.152+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0198155f40 con 0x7f01980ce8a0 2023-11-04T01:40:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.304+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0198155f40 con 0x7f01980ce8a0 2023-11-04T01:40:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f0186ffd640 1 -- 172.21.15.40:0/2035903366 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f0198155f40 con 0x7f01980ce8a0 2023-11-04T01:40:38.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:38.311 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:38.177386+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f01780664a0 msgr2=0x7f0178068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f01780664a0 0x7f0178068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01880ae000 tx=0x7f0188008040 comp rx=0 tx=0).stop 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 msgr2=0x7f019806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 0x7f019806bc80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c3a0 tx=0x7f018c00c860 comp rx=0 tx=0).stop 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 shutdown_connections 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f01780664a0 0x7f0178068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01980cec80 0x7f019806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01980ce8a0 0x7f019806bc80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 --2- 172.21.15.40:0/2035903366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01980b3270 0x7f01980b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 >> 172.21.15.40:0/2035903366 conn(0x7f019806f6e0 msgr2=0x7f019815b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 shutdown_connections 2023-11-04T01:40:38.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.308+0000 7f019cb53640 1 -- 172.21.15.40:0/2035903366 wait complete. 2023-11-04T01:40:38.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:38.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.448+0000 7f10de0fa640 1 Processor -- start 2023-11-04T01:40:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.448+0000 7f10de0fa640 1 -- start start 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10de0fa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d8160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10de0fa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10d81610f0 0x7f10d80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10de0fa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d80b5e00 con 0x7f10d80cfd50 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10de0fa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d80d1520 con 0x7f10d81610f0 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10de0fa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80d01e0 con 0x7f10d815d0b0 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10d81610f0 0x7f10d80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10d81610f0 0x7f10d80cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47226/0 (socket says 172.21.15.40:47226) 2023-11-04T01:40:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 -- 172.21.15.40:0/439181445 learned_addr learned my addr 172.21.15.40:0/439181445 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d77fe640 1 --2- 172.21.15.40:0/439181445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d8160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 -- 172.21.15.40:0/439181445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 msgr2=0x7f10d8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 --2- 172.21.15.40:0/439181445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d8160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 -- 172.21.15.40:0/439181445 >> v1:172.21.15.91:6789/0 conn(0x7f10d80cfd50 legacy=0x7f10d80b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 -- 172.21.15.40:0/439181445 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d815d490 con 0x7f10d81610f0 2023-11-04T01:40:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d6ffd640 1 --2- 172.21.15.40:0/439181445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d80cf810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009870 tx=0x7f10cc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8931ffba3e903f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d67fc640 1 -- 172.21.15.40:0/439181445 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0ac630 con 0x7f10d81610f0 2023-11-04T01:40:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d67fc640 1 -- 172.21.15.40:0/439181445 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0ac790 con 0x7f10d81610f0 2023-11-04T01:40:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.452+0000 7f10d67fc640 1 -- 172.21.15.40:0/439181445 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0acb20 con 0x7f10d81610f0 2023-11-04T01:40:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/439181445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 msgr2=0x7f10d80cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 --2- 172.21.15.40:0/439181445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d80cf810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009870 tx=0x7f10cc01c500 comp rx=0 tx=0).stop 2023-11-04T01:40:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/439181445 shutdown_connections 2023-11-04T01:40:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 --2- 172.21.15.40:0/439181445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d80cf810 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 --2- 172.21.15.40:0/439181445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/439181445 >> 172.21.15.40:0/439181445 conn(0x7f10d806a890 msgr2=0x7f10d806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/439181445 shutdown_connections 2023-11-04T01:40:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/439181445 wait complete. 2023-11-04T01:40:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 Processor -- start 2023-11-04T01:40:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- start start 2023-11-04T01:40:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10d80cfd50 0x7f10d814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d81585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d8158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80c9f10 con 0x7f10d81610f0 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d815e2f0 con 0x7f10d80cfd50 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80ca0f0 con 0x7f10d815d0b0 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d8158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d8158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47236/0 (socket says 172.21.15.40:47236) 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 -- 172.21.15.40:0/2114174675 learned_addr learned my addr 172.21.15.40:0/2114174675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d77fe640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10d80cfd50 0x7f10d814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d6ffd640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d81585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 -- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 msgr2=0x7f10d81585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d81585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 -- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10d80cfd50 msgr2=0x7f10d814aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10d80cfd50 0x7f10d814aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 -- 172.21.15.40:0/2114174675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0094d0 con 0x7f10d81610f0 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10d7fff640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d8158b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c780 tx=0x7f10d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0004b70 con 0x7f10d81610f0 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000ce90 con 0x7f10d81610f0 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d80ca3d0 con 0x7f10d81610f0 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000a850 con 0x7f10d81610f0 2023-11-04T01:40:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.456+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d80ca990 con 0x7f10d81610f0 2023-11-04T01:40:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.460+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d80cab80 con 0x7f10d81610f0 2023-11-04T01:40:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.460+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10d000a9b0 con 0x7f10d81610f0 2023-11-04T01:40:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.460+0000 7f10bffff640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f10c40664d0 0x7f10c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.460+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f10d00842a0 con 0x7f10d81610f0 2023-11-04T01:40:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.460+0000 7f10d77fe640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f10c40664d0 0x7f10c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.460+0000 7f10d77fe640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f10c40664d0 0x7f10c4068990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10c800a970 tx=0x7f10c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.464+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10d0051730 con 0x7f10d81610f0 2023-11-04T01:40:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.616+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10d80744a0 con 0x7f10d81610f0 2023-11-04T01:40:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.616+0000 7f10bffff640 1 -- 172.21.15.40:0/2114174675 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10d0054d50 con 0x7f10d81610f0 2023-11-04T01:40:38.619 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.616+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f10c40664d0 msgr2=0x7f10c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.616+0000 7f10de0fa640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f10c40664d0 0x7f10c4068990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10c800a970 tx=0x7f10c8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.616+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 msgr2=0x7f10d8158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.616+0000 7f10de0fa640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d8158b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c780 tx=0x7f10d000cc40 comp rx=0 tx=0).stop 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 shutdown_connections 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f10c40664d0 0x7f10c4068990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10d81610f0 0x7f10d8158b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10d815d0b0 0x7f10d81585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 --2- 172.21.15.40:0/2114174675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10d80cfd50 0x7f10d814aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 >> 172.21.15.40:0/2114174675 conn(0x7f10d806a890 msgr2=0x7f10d8159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 shutdown_connections 2023-11-04T01:40:38.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.620+0000 7f10de0fa640 1 -- 172.21.15.40:0/2114174675 wait complete. 2023-11-04T01:40:38.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 Processor -- start 2023-11-04T01:40:38.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 -- start start 2023-11-04T01:40:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53b015d0b0 0x7f53b0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53b00cff20 0x7f53b00d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b00b5e00 con 0x7f53b01610f0 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b00d1520 con 0x7f53b00cff20 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53b4947640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b015d490 con 0x7f53b015d0b0 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53aed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53b00cff20 0x7f53b00d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53add9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f53b01610f0 0x7f53b00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45342/0 (socket says 172.21.15.40:45342) 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53add9b640 1 -- 172.21.15.40:0/1653114762 learned_addr learned my addr 172.21.15.40:0/1653114762 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53ae59c640 1 --2- 172.21.15.40:0/1653114762 >> v2:172.21.15.91:3300/0 conn(0x7f53b015d0b0 0x7f53b0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53aed9d640 1 -- 172.21.15.40:0/1653114762 >> v2:172.21.15.91:3300/0 conn(0x7f53b015d0b0 msgr2=0x7f53b0160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53aed9d640 1 --2- 172.21.15.40:0/1653114762 >> v2:172.21.15.91:3300/0 conn(0x7f53b015d0b0 0x7f53b0160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53aed9d640 1 -- 172.21.15.40:0/1653114762 >> v1:172.21.15.40:6789/0 conn(0x7f53b01610f0 legacy=0x7f53b00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53ad59a640 1 -- 172.21.15.40:0/1653114762 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928953011 0 0) 0x7f53b00b5e00 con 0x7f53b01610f0 2023-11-04T01:40:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53aed9d640 1 -- 172.21.15.40:0/1653114762 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00b8930 con 0x7f53b00cff20 2023-11-04T01:40:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.752+0000 7f53ae59c640 1 --2- 172.21.15.40:0/1653114762 >> v2:172.21.15.91:3300/0 conn(0x7f53b015d0b0 0x7f53b0160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:38.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53aed9d640 1 --2- 172.21.15.40:0/1653114762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b00d1940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53b006b900 tx=0x7f53a801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ab79e60af4473e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ad59a640 1 -- 172.21.15.40:0/1653114762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80a58e0 con 0x7f53b00cff20 2023-11-04T01:40:38.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ad59a640 1 -- 172.21.15.40:0/1653114762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a80a5a40 con 0x7f53b00cff20 2023-11-04T01:40:38.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ad59a640 1 -- 172.21.15.40:0/1653114762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80a5dd0 con 0x7f53b00cff20 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- 172.21.15.40:0/1653114762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 msgr2=0x7f53b00d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 --2- 172.21.15.40:0/1653114762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b00d1940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53b006b900 tx=0x7f53a801c910 comp rx=0 tx=0).stop 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- 172.21.15.40:0/1653114762 shutdown_connections 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 --2- 172.21.15.40:0/1653114762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b00d1940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 --2- 172.21.15.40:0/1653114762 >> v2:172.21.15.91:3300/0 conn(0x7f53b015d0b0 0x7f53b0160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- 172.21.15.40:0/1653114762 >> 172.21.15.40:0/1653114762 conn(0x7f53b006a890 msgr2=0x7f53b006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- 172.21.15.40:0/1653114762 shutdown_connections 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- 172.21.15.40:0/1653114762 wait complete. 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 Processor -- start 2023-11-04T01:40:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- start start 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b0155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53b015d0b0 0x7f53b00ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53b01610f0 0x7f53b015f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00b4d90 con 0x7f53b00cff20 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00b4f80 con 0x7f53b015d0b0 2023-11-04T01:40:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53b4947640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00b5260 con 0x7f53b01610f0 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b0155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b0155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47258/0 (socket says 172.21.15.40:47258) 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 -- 172.21.15.40:0/2361286490 learned_addr learned my addr 172.21.15.40:0/2361286490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 -- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53b01610f0 msgr2=0x7f53b015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53b01610f0 0x7f53b015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 -- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53b015d0b0 msgr2=0x7f53b00ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53b015d0b0 0x7f53b00ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 -- 172.21.15.40:0/2361286490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a8009a70 con 0x7f53b00cff20 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f53ae59c640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b0155f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c7c0 tx=0x7f53a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0007a30 con 0x7f53b00cff20 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a0007b90 con 0x7f53b00cff20 2023-11-04T01:40:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.756+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000ce70 con 0x7f53b00cff20 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b00b5540 con 0x7f53b00cff20 2023-11-04T01:40:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b00cc680 con 0x7f53b00cff20 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b00b28a0 con 0x7f53b00cff20 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53a00113f0 con 0x7f53b00cff20 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f539effd640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53900664a0 0x7f5390068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f53a0084370 con 0x7f53b00cff20 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f53add9b640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53900664a0 0x7f5390068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.760+0000 7f53add9b640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53900664a0 0x7f5390068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f53a4000c10 tx=0x7f53a40079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:38.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.764+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f53b00b28a0 con 0x7f53b00cff20 2023-11-04T01:40:38.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.916+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53b00b28a0 con 0x7f53b00cff20 2023-11-04T01:40:38.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f539effd640 1 -- 172.21.15.40:0/2361286490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53b00b28a0 con 0x7f53b00cff20 2023-11-04T01:40:38.921 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53900664a0 msgr2=0x7f5390068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53900664a0 0x7f5390068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f53a4000c10 tx=0x7f53a40079d0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 msgr2=0x7f53b0155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b0155f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c7c0 tx=0x7f53a000cc80 comp rx=0 tx=0).stop 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 shutdown_connections 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53900664a0 0x7f5390068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53b01610f0 0x7f53b015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53b015d0b0 0x7f53b00ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 --2- 172.21.15.40:0/2361286490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b00cff20 0x7f53b0155f40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:38.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 >> 172.21.15.40:0/2361286490 conn(0x7f53b006a890 msgr2=0x7f53b00b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:38.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 shutdown_connections 2023-11-04T01:40:38.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:38.920+0000 7f53b4947640 1 -- 172.21.15.40:0/2361286490 wait complete. 2023-11-04T01:40:38.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 Processor -- start 2023-11-04T01:40:39.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 -- start start 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f368415af70 0x7f36840cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f368415e490 0x7f36840cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368415e890 con 0x7f368406d160 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3684071200 con 0x7f368415af70 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f368adb8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368406c0c0 con 0x7f368415e490 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3683fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f368406d160 0x7f368415dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45356/0 (socket says 172.21.15.40:45356) 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3683fff640 1 -- 172.21.15.40:0/894798370 learned_addr learned my addr 172.21.15.40:0/894798370 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3688b54640 1 --2- 172.21.15.40:0/894798370 >> v2:172.21.15.40:3300/0 conn(0x7f368415af70 0x7f36840cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3689355640 1 --2- 172.21.15.40:0/894798370 >> v2:172.21.15.91:3300/0 conn(0x7f368415e490 0x7f36840cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f36837fe640 1 -- 172.21.15.40:0/894798370 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981037673 0 0) 0x7f3670001120 con 0x7f368406d160 2023-11-04T01:40:39.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f36837fe640 1 -- 172.21.15.40:0/894798370 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3674005740 con 0x7f368406d160 2023-11-04T01:40:39.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3688b54640 1 -- 172.21.15.40:0/894798370 >> v2:172.21.15.91:3300/0 conn(0x7f368415e490 msgr2=0x7f36840cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3688b54640 1 --2- 172.21.15.40:0/894798370 >> v2:172.21.15.91:3300/0 conn(0x7f368415e490 0x7f36840cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3688b54640 1 -- 172.21.15.40:0/894798370 >> v1:172.21.15.40:6789/0 conn(0x7f368406d160 legacy=0x7f368415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.068+0000 7f3688b54640 1 -- 172.21.15.40:0/894798370 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368406c3a0 con 0x7f368415af70 2023-11-04T01:40:39.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3688b54640 1 --2- 172.21.15.40:0/894798370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840cdaa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f368415ead0 tx=0x7f367801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b7ab7ac3daee44 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f36837fe640 1 -- 172.21.15.40:0/894798370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678004230 con 0x7f368415af70 2023-11-04T01:40:39.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f36837fe640 1 -- 172.21.15.40:0/894798370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780a7050 con 0x7f368415af70 2023-11-04T01:40:39.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f36837fe640 1 -- 172.21.15.40:0/894798370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3678003620 con 0x7f368415af70 2023-11-04T01:40:39.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- 172.21.15.40:0/894798370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 msgr2=0x7f36840cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 --2- 172.21.15.40:0/894798370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840cdaa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f368415ead0 tx=0x7f367801c460 comp rx=0 tx=0).stop 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- 172.21.15.40:0/894798370 shutdown_connections 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 --2- 172.21.15.40:0/894798370 >> v2:172.21.15.91:3300/0 conn(0x7f368415e490 0x7f36840cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 --2- 172.21.15.40:0/894798370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840cdaa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- 172.21.15.40:0/894798370 >> 172.21.15.40:0/894798370 conn(0x7f36840cb510 msgr2=0x7f36840cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- 172.21.15.40:0/894798370 shutdown_connections 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- 172.21.15.40:0/894798370 wait complete. 2023-11-04T01:40:39.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 Processor -- start 2023-11-04T01:40:39.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- start start 2023-11-04T01:40:39.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f368406d160 0x7f36840c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f368415e490 0x7f36840acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840c7a70 con 0x7f368415af70 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840c6220 con 0x7f368406d160 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f368adb8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36840c6500 con 0x7f368415e490 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47280/0 (socket says 172.21.15.40:47280) 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 -- 172.21.15.40:0/278761900 learned_addr learned my addr 172.21.15.40:0/278761900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3688b54640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f368406d160 0x7f36840c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3689355640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f368415e490 0x7f36840acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 -- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f368415e490 msgr2=0x7f36840acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f368415e490 0x7f36840acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 -- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f368406d160 msgr2=0x7f36840c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f368406d160 0x7f36840c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 -- 172.21.15.40:0/278761900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009420 con 0x7f368415af70 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3688b54640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f368406d160 0x7f36840c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.072+0000 7f3683fff640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840c5b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f367000c4d0 tx=0x7f367000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670005cf0 con 0x7f368415af70 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670005e50 con 0x7f368415af70 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36840c67e0 con 0x7f368415af70 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670007290 con 0x7f368415af70 2023-11-04T01:40:39.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36840c6da0 con 0x7f368415af70 2023-11-04T01:40:39.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36840aedb0 con 0x7f368415af70 2023-11-04T01:40:39.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36700073f0 con 0x7f368415af70 2023-11-04T01:40:39.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f36817fa640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36680664a0 0x7f3668068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3670083340 con 0x7f368415af70 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f3688b54640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36680664a0 0x7f3668068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.076+0000 7f3688b54640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36680664a0 0x7f3668068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36780ad000 tx=0x7f36780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.080+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36700507d0 con 0x7f368415af70 2023-11-04T01:40:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.240+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f368415e890 con 0x7f368415af70 2023-11-04T01:40:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.240+0000 7f36817fa640 1 -- 172.21.15.40:0/278761900 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f368415e890 con 0x7f368415af70 2023-11-04T01:40:39.244 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36680664a0 msgr2=0x7f3668068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36680664a0 0x7f3668068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36780ad000 tx=0x7f36780a6000 comp rx=0 tx=0).stop 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 msgr2=0x7f36840c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840c5b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f367000c4d0 tx=0x7f367000c990 comp rx=0 tx=0).stop 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 shutdown_connections 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36680664a0 0x7f3668068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f368415e490 0x7f36840acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f368415af70 0x7f36840c5b60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 --2- 172.21.15.40:0/278761900 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f368406d160 0x7f36840c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 >> 172.21.15.40:0/278761900 conn(0x7f36840cb510 msgr2=0x7f36840cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 shutdown_connections 2023-11-04T01:40:39.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.244+0000 7f368adb8640 1 -- 172.21.15.40:0/278761900 wait complete. 2023-11-04T01:40:39.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 Processor -- start 2023-11-04T01:40:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 -- start start 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f271c15afd0 0x7f271c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f271c06f8f0 0x7f271c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c0b0b70 0x7f271c0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c070140 con 0x7f271c06f8f0 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0b1000 con 0x7f271c15afd0 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2723789640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c06c9f0 con 0x7f271c0b0b70 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f271c06f8f0 0x7f271c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f271c06f8f0 0x7f271c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47296/0 (socket says 172.21.15.40:47296) 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 -- 172.21.15.40:0/159778543 learned_addr learned my addr 172.21.15.40:0/159778543 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2721d26640 1 --2- 172.21.15.40:0/159778543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c0b0b70 0x7f271c0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2721525640 1 --2- 172.21.15.40:0/159778543 >> v2:172.21.15.91:3300/0 conn(0x7f271c15afd0 0x7f271c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 -- 172.21.15.40:0/159778543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c0b0b70 msgr2=0x7f271c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 --2- 172.21.15.40:0/159778543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c0b0b70 0x7f271c0c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 -- 172.21.15.40:0/159778543 >> v2:172.21.15.91:3300/0 conn(0x7f271c15afd0 msgr2=0x7f271c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 --2- 172.21.15.40:0/159778543 >> v2:172.21.15.91:3300/0 conn(0x7f271c15afd0 0x7f271c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.384+0000 7f2720d24640 1 -- 172.21.15.40:0/159778543 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0c2670 con 0x7f271c06f8f0 2023-11-04T01:40:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2720d24640 1 --2- 172.21.15.40:0/159778543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c06f8f0 0x7f271c0b0630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f271c0ce980 tx=0x7f271001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615a8f4d7b83c11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f271bfff640 1 -- 172.21.15.40:0/159778543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab600 con 0x7f271c06f8f0 2023-11-04T01:40:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f271bfff640 1 -- 172.21.15.40:0/159778543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100a7050 con 0x7f271c06f8f0 2023-11-04T01:40:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f271bfff640 1 -- 172.21.15.40:0/159778543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab980 con 0x7f271c06f8f0 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 -- 172.21.15.40:0/159778543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c06f8f0 msgr2=0x7f271c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 --2- 172.21.15.40:0/159778543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c06f8f0 0x7f271c0b0630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f271c0ce980 tx=0x7f271001c210 comp rx=0 tx=0).stop 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 -- 172.21.15.40:0/159778543 shutdown_connections 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 --2- 172.21.15.40:0/159778543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c0b0b70 0x7f271c0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 --2- 172.21.15.40:0/159778543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c06f8f0 0x7f271c0b0630 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 --2- 172.21.15.40:0/159778543 >> v2:172.21.15.91:3300/0 conn(0x7f271c15afd0 0x7f271c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 -- 172.21.15.40:0/159778543 >> 172.21.15.40:0/159778543 conn(0x7f271c0cebb0 msgr2=0x7f271c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 -- 172.21.15.40:0/159778543 shutdown_connections 2023-11-04T01:40:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 -- 172.21.15.40:0/159778543 wait complete. 2023-11-04T01:40:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 Processor -- start 2023-11-04T01:40:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.388+0000 7f2723789640 1 -- start start 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c06f8f0 0x7f271c1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 0x7f271c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c15afd0 0x7f271c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0b25b0 con 0x7f271c0b0b70 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0c6130 con 0x7f271c06f8f0 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0ce130 con 0x7f271c15afd0 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 0x7f271c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 0x7f271c0adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47302/0 (socket says 172.21.15.40:47302) 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 -- 172.21.15.40:0/3384692244 learned_addr learned my addr 172.21.15.40:0/3384692244 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2721d26640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c15afd0 0x7f271c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2721525640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c06f8f0 0x7f271c1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 -- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c15afd0 msgr2=0x7f271c0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c15afd0 0x7f271c0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 -- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c06f8f0 msgr2=0x7f271c1509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c06f8f0 0x7f271c1509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 -- 172.21.15.40:0/3384692244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094d0 con 0x7f271c0b0b70 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2721525640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c06f8f0 0x7f271c1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2720d24640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 0x7f271c0adfe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f271001a8c0 tx=0x7f271001aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100b6620 con 0x7f271c0b0b70 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100abe90 con 0x7f271c0b0b70 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c0ce6d0 con 0x7f271c0b0b70 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100b69c0 con 0x7f271c0b0b70 2023-11-04T01:40:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c0cc790 con 0x7f271c0b0b70 2023-11-04T01:40:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271c0744a0 con 0x7f271c0b0b70 2023-11-04T01:40:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27100b2040 con 0x7f271c0b0b70 2023-11-04T01:40:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2719ffb640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27080664a0 0x7f2708068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f271011e020 con 0x7f271c0b0b70 2023-11-04T01:40:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.392+0000 7f2721525640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27080664a0 0x7f2708068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.396+0000 7f2721525640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27080664a0 0x7f2708068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2714007330 tx=0x7f271400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.396+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27100eb420 con 0x7f271c0b0b70 2023-11-04T01:40:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f271c06cba0 con 0x7f271c0b0b70 2023-11-04T01:40:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2719ffb640 1 -- 172.21.15.40:0/3384692244 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27100eea40 con 0x7f271c0b0b70 2023-11-04T01:40:39.571 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27080664a0 msgr2=0x7f2708068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27080664a0 0x7f2708068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2714007330 tx=0x7f271400b040 comp rx=0 tx=0).stop 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 msgr2=0x7f271c0adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 0x7f271c0adfe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f271001a8c0 tx=0x7f271001aa50 comp rx=0 tx=0).stop 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 shutdown_connections 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27080664a0 0x7f2708068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f271c15afd0 0x7f271c0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c0b0b70 0x7f271c0adfe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 --2- 172.21.15.40:0/3384692244 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f271c06f8f0 0x7f271c1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 >> 172.21.15.40:0/3384692244 conn(0x7f271c0cebb0 msgr2=0x7f271c0c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 shutdown_connections 2023-11-04T01:40:39.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.568+0000 7f2723789640 1 -- 172.21.15.40:0/3384692244 wait complete. 2023-11-04T01:40:39.590 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:40:39.590 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:39.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:39.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 Processor -- start 2023-11-04T01:40:39.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 -- start start 2023-11-04T01:40:39.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ab40cdea0 0x7f6ab40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab40ca400 0x7f6ab40b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40ccee0 con 0x7f6ab415a1f0 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab415a5d0 con 0x7f6ab40cdea0 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ababbc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40ca900 con 0x7f6ab40ca400 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ab3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ab40cdea0 0x7f6ab40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ab3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ab40cdea0 0x7f6ab40b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47314/0 (socket says 172.21.15.40:47314) 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ab3fff640 1 -- 172.21.15.40:0/193447038 learned_addr learned my addr 172.21.15.40:0/193447038 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.720+0000 7f6ab9159640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab40ca400 0x7f6ab40b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab3fff640 1 -- 172.21.15.40:0/193447038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab40ca400 msgr2=0x7f6ab40b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab3fff640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab40ca400 0x7f6ab40b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab3fff640 1 -- 172.21.15.40:0/193447038 >> v1:172.21.15.91:6789/0 conn(0x7f6ab415a1f0 legacy=0x7f6ab40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab3fff640 1 -- 172.21.15.40:0/193447038 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40cabe0 con 0x7f6ab40cdea0 2023-11-04T01:40:39.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab9159640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab40ca400 0x7f6ab40b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:39.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab3fff640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40cdea0 0x7f6ab40b0630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e50 tx=0x7f6a9c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dba695ebf3f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab37fe640 1 -- 172.21.15.40:0/193447038 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0a5740 con 0x7f6ab40cdea0 2023-11-04T01:40:39.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab37fe640 1 -- 172.21.15.40:0/193447038 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c0a58a0 con 0x7f6ab40cdea0 2023-11-04T01:40:39.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ab37fe640 1 -- 172.21.15.40:0/193447038 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0a5c30 con 0x7f6ab40cdea0 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 -- 172.21.15.40:0/193447038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40cdea0 msgr2=0x7f6ab40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40cdea0 0x7f6ab40b0630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c009e50 tx=0x7f6a9c01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 -- 172.21.15.40:0/193447038 shutdown_connections 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab40ca400 0x7f6ab40b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 --2- 172.21.15.40:0/193447038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40cdea0 0x7f6ab40b0630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 -- 172.21.15.40:0/193447038 >> 172.21.15.40:0/193447038 conn(0x7f6ab40cebb0 msgr2=0x7f6ab40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 -- 172.21.15.40:0/193447038 shutdown_connections 2023-11-04T01:40:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.724+0000 7f6ababbc640 1 -- 172.21.15.40:0/193447038 wait complete. 2023-11-04T01:40:39.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 Processor -- start 2023-11-04T01:40:39.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- start start 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 0x7f6ab414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ab40cdea0 0x7f6ab415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab415a1f0 0x7f6ab415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40c78f0 con 0x7f6ab40ca400 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40c2650 con 0x7f6ab40cdea0 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40c6c70 con 0x7f6ab415a1f0 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 0x7f6ab414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 0x7f6ab414e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47324/0 (socket says 172.21.15.40:47324) 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 -- 172.21.15.40:0/2914115413 learned_addr learned my addr 172.21.15.40:0/2914115413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab3fff640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ab40cdea0 0x7f6ab415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab9159640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab415a1f0 0x7f6ab415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 -- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab415a1f0 msgr2=0x7f6ab415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab415a1f0 0x7f6ab415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 -- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ab40cdea0 msgr2=0x7f6ab415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ab40cdea0 0x7f6ab415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 -- 172.21.15.40:0/2914115413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009b30 con 0x7f6ab40ca400 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab9159640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab415a1f0 0x7f6ab415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab8958640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 0x7f6ab414e250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00b410 tx=0x7f6aac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac004020 con 0x7f6ab40ca400 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac004180 con 0x7f6ab40ca400 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab40c6f50 con 0x7f6ab40ca400 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac011630 con 0x7f6ab40ca400 2023-11-04T01:40:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab40c7510 con 0x7f6ab40ca400 2023-11-04T01:40:39.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab40744a0 con 0x7f6ab40ca400 2023-11-04T01:40:39.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6aac011790 con 0x7f6ab40ca400 2023-11-04T01:40:39.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.728+0000 7f6ab17fa640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a940664a0 0x7f6a94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.732+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6aac083c60 con 0x7f6ab40ca400 2023-11-04T01:40:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.732+0000 7f6ab3fff640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a940664a0 0x7f6a94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.732+0000 7f6ab3fff640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a940664a0 0x7f6a94068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ae000 tx=0x7f6a9c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.736+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6aac051060 con 0x7f6ab40ca400 2023-11-04T01:40:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.884+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ab406cfb0 con 0x7f6ab40ca400 2023-11-04T01:40:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.888+0000 7f6ab17fa640 1 -- 172.21.15.40:0/2914115413 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f6aac054680 con 0x7f6ab40ca400 2023-11-04T01:40:39.892 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:39.892 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a940664a0 msgr2=0x7f6a94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a940664a0 0x7f6a94068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ae000 tx=0x7f6a9c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:40:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 msgr2=0x7f6ab414e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 0x7f6ab414e250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00b410 tx=0x7f6aac00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 shutdown_connections 2023-11-04T01:40:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6a940664a0 0x7f6a94068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ab415a1f0 0x7f6ab415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ab40cdea0 0x7f6ab415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 --2- 172.21.15.40:0/2914115413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab40ca400 0x7f6ab414e250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 >> 172.21.15.40:0/2914115413 conn(0x7f6ab40cebb0 msgr2=0x7f6ab40b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 shutdown_connections 2023-11-04T01:40:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:39.892+0000 7f6ababbc640 1 -- 172.21.15.40:0/2914115413 wait complete. 2023-11-04T01:40:39.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:39.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13cb65640 1 Processor -- start 2023-11-04T01:40:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13cb65640 1 -- start start 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13cb65640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 0x7fe1380cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13cb65640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380b5e00 con 0x7fe1380d1940 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13cb65640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380d0190 con 0x7fe13815d0b0 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13cb65640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1380d1520 con 0x7fe1380cf810 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe136d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1380d1940 0x7fe1380d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45364/0 (socket says 172.21.15.40:45364) 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe136d9d640 1 -- 172.21.15.40:0/1459087922 learned_addr learned my addr 172.21.15.40:0/1459087922 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe135d9b640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 0x7fe1380cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692133187 0 0) 0x7fe1380b5e00 con 0x7fe1380d1940 2023-11-04T01:40:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe120003530 con 0x7fe1380d1940 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283926578 0 0) 0x7fe120003530 con 0x7fe1380d1940 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 msgr2=0x7fe1380cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 0x7fe1380cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 >> v1:172.21.15.91:6789/0 conn(0x7fe13815d0b0 legacy=0x7fe138160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13815d490 con 0x7fe1380d1940 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fe130001a00 con 0x7fe1380d1940 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 >> v1:172.21.15.40:6789/0 conn(0x7fe1380d1940 legacy=0x7fe1380d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe120003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 0x7fe1200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe120004d10 0x7fe120005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1380d1520 con 0x7fe1200039b0 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12000ba40 con 0x7fe120004d10 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12000bbb0 con 0x7fe1380cf810 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13659c640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe120003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe136d9d640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe120004d10 0x7fe120005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe135d9b640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 0x7fe1200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13659c640 1 -- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 msgr2=0x7fe1200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13659c640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1380cf810 0x7fe1200047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13659c640 1 -- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe120004d10 msgr2=0x7fe120005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13659c640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe120004d10 0x7fe120005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.024+0000 7fe13659c640 1 -- 172.21.15.40:0/1459087922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120003530 con 0x7fe1200039b0 2023-11-04T01:40:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13659c640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe120003d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe128001860 tx=0x7fe12801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bac39f0c17087b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280ab600 con 0x7fe1200039b0 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1280a7050 con 0x7fe1200039b0 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13559a640 1 -- 172.21.15.40:0/1459087922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280ab9a0 con 0x7fe1200039b0 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 -- 172.21.15.40:0/1459087922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 msgr2=0x7fe120003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 --2- 172.21.15.40:0/1459087922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe120003d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe128001860 tx=0x7fe12801c500 comp rx=0 tx=0).stop 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe136d9d640 1 -- 172.21.15.40:0/1459087922 reap_dead start 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 -- 172.21.15.40:0/1459087922 shutdown_connections 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 -- 172.21.15.40:0/1459087922 >> 172.21.15.40:0/1459087922 conn(0x7fe13806a890 msgr2=0x7fe13806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 -- 172.21.15.40:0/1459087922 shutdown_connections 2023-11-04T01:40:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 -- 172.21.15.40:0/1459087922 wait complete. 2023-11-04T01:40:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 Processor -- start 2023-11-04T01:40:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.028+0000 7fe13cb65640 1 -- start start 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe13815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe138152a20 0x7fe1381f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe138150bf0 0x7fe138151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13815d6b0 con 0x7fe1200039b0 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13815d950 con 0x7fe138152a20 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1381f63a0 con 0x7fe138150bf0 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe13815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe13815ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47352/0 (socket says 172.21.15.40:47352) 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 -- 172.21.15.40:0/4085546560 learned_addr learned my addr 172.21.15.40:0/4085546560 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe136d9d640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe138150bf0 0x7fe138151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe135d9b640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe138152a20 0x7fe1381f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 -- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe138150bf0 msgr2=0x7fe138151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe138150bf0 0x7fe138151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 -- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe138152a20 msgr2=0x7fe1381f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe138152a20 0x7fe1381f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 -- 172.21.15.40:0/4085546560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1381f6680 con 0x7fe1200039b0 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13659c640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe13815ef20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1280ae040 tx=0x7fe120005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128005390 con 0x7fe1200039b0 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1280aba80 con 0x7fe1200039b0 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1381f6960 con 0x7fe1200039b0 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280abdf0 con 0x7fe1200039b0 2023-11-04T01:40:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13815dde0 con 0x7fe1200039b0 2023-11-04T01:40:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1280b2050 con 0x7fe1200039b0 2023-11-04T01:40:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe138152e00 con 0x7fe1200039b0 2023-11-04T01:40:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe126ffd640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1180664a0 0x7fe118068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe12811dae0 con 0x7fe1200039b0 2023-11-04T01:40:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.032+0000 7fe135d9b640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1180664a0 0x7fe118068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.036+0000 7fe135d9b640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1180664a0 0x7fe118068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe138163460 tx=0x7fe12c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.036+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe1280eaf90 con 0x7fe1200039b0 2023-11-04T01:40:40.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1381f6af0 con 0x7fe1200039b0 2023-11-04T01:40:40.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe126ffd640 1 -- 172.21.15.40:0/4085546560 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1280ee5b0 con 0x7fe1200039b0 2023-11-04T01:40:40.195 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1180664a0 msgr2=0x7fe118068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1180664a0 0x7fe118068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe138163460 tx=0x7fe12c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 msgr2=0x7fe13815ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe13815ef20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1280ae040 tx=0x7fe120005800 comp rx=0 tx=0).stop 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 shutdown_connections 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1180664a0 0x7fe118068960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe138150bf0 0x7fe138151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe138152a20 0x7fe1381f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 --2- 172.21.15.40:0/4085546560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1200039b0 0x7fe13815ef20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 >> 172.21.15.40:0/4085546560 conn(0x7fe13806a890 msgr2=0x7fe1380b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 shutdown_connections 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.192+0000 7fe13cb65640 1 -- 172.21.15.40:0/4085546560 wait complete. 2023-11-04T01:40:40.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a2d9cc640 1 Processor -- start 2023-11-04T01:40:40.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a2d9cc640 1 -- start start 2023-11-04T01:40:40.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a2d9cc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a280b0c20 0x7f1a2815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a2d9cc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280cb130 con 0x7f1a2815c160 2023-11-04T01:40:40.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a2d9cc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2815b680 con 0x7f1a2815acb0 2023-11-04T01:40:40.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a2d9cc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2815bd40 con 0x7f1a280b0c20 2023-11-04T01:40:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a277fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1a2815c160 0x7f1a280ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45376/0 (socket says 172.21.15.40:45376) 2023-11-04T01:40:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a277fe640 1 -- 172.21.15.40:0/3013039402 learned_addr learned my addr 172.21.15.40:0/3013039402 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a267fc640 1 --2- 172.21.15.40:0/3013039402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a280b0c20 0x7f1a2815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263604905 0 0) 0x7f1a2815b680 con 0x7f1a2815acb0 2023-11-04T01:40:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a10003530 con 0x7f1a2815acb0 2023-11-04T01:40:40.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282759386 0 0) 0x7f1a280cb130 con 0x7f1a2815c160 2023-11-04T01:40:40.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a2815b680 con 0x7f1a2815c160 2023-11-04T01:40:40.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a267fc640 1 -- 172.21.15.40:0/3013039402 >> v1:172.21.15.91:6789/0 conn(0x7f1a2815acb0 legacy=0x7f1a280b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a267fc640 1 -- 172.21.15.40:0/3013039402 >> v1:172.21.15.40:6789/0 conn(0x7f1a2815c160 legacy=0x7f1a280ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.332+0000 7f1a267fc640 1 -- 172.21.15.40:0/3013039402 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2815b960 con 0x7f1a280b0c20 2023-11-04T01:40:40.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a267fc640 1 --2- 172.21.15.40:0/3013039402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a280b0c20 0x7f1a2815b090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a180097f0 tx=0x7f1a1801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc602675277c0ce2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180ac630 con 0x7f1a280b0c20 2023-11-04T01:40:40.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a180ac790 con 0x7f1a280b0c20 2023-11-04T01:40:40.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a25ffb640 1 -- 172.21.15.40:0/3013039402 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180acb00 con 0x7f1a280b0c20 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3013039402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a280b0c20 msgr2=0x7f1a2815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3013039402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a280b0c20 0x7f1a2815b090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a180097f0 tx=0x7f1a1801c4c0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3013039402 shutdown_connections 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3013039402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a280b0c20 0x7f1a2815b090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3013039402 >> 172.21.15.40:0/3013039402 conn(0x7f1a280cb510 msgr2=0x7f1a280cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3013039402 shutdown_connections 2023-11-04T01:40:40.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3013039402 wait complete. 2023-11-04T01:40:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 Processor -- start 2023-11-04T01:40:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.336+0000 7f1a2d9cc640 1 -- start start 2023-11-04T01:40:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a280b0c20 0x7f1a2814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a2815acb0 0x7f1a280aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 0x7f1a280c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280b4120 con 0x7f1a2815c160 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280b31c0 con 0x7f1a280b0c20 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280b22f0 con 0x7f1a2815acb0 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 0x7f1a280c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 0x7f1a280c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47368/0 (socket says 172.21.15.40:47368) 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 -- 172.21.15.40:0/3437924426 learned_addr learned my addr 172.21.15.40:0/3437924426 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a26ffd640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a280b0c20 0x7f1a2814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a267fc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a2815acb0 0x7f1a280aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 -- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a2815acb0 msgr2=0x7f1a280aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a2815acb0 0x7f1a280aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 -- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a280b0c20 msgr2=0x7f1a2814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a280b0c20 0x7f1a2814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 -- 172.21.15.40:0/3437924426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18009420 con 0x7f1a2815c160 2023-11-04T01:40:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a277fe640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 0x7f1a280c6540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000ca50 tx=0x7f1a2000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000abb0 con 0x7f1a2815c160 2023-11-04T01:40:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000ad10 con 0x7f1a2815c160 2023-11-04T01:40:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20012620 con 0x7f1a2815c160 2023-11-04T01:40:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a280b2540 con 0x7f1a2815c160 2023-11-04T01:40:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a280b2de0 con 0x7f1a2815c160 2023-11-04T01:40:40.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a280b3300 con 0x7f1a2815c160 2023-11-04T01:40:40.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a20007070 con 0x7f1a2815c160 2023-11-04T01:40:40.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a0ffff640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a140664a0 0x7f1a14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.340+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1a20083e30 con 0x7f1a2815c160 2023-11-04T01:40:40.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.344+0000 7f1a26ffd640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a140664a0 0x7f1a14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.344+0000 7f1a26ffd640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a140664a0 0x7f1a14068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0011f0 tx=0x7f1a1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.344+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a280b3300 con 0x7f1a2815c160 2023-11-04T01:40:40.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a280b3300 con 0x7f1a2815c160 2023-11-04T01:40:40.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a0ffff640 1 -- 172.21.15.40:0/3437924426 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a280b3300 con 0x7f1a2815c160 2023-11-04T01:40:40.507 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a140664a0 msgr2=0x7f1a14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a140664a0 0x7f1a14068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0011f0 tx=0x7f1a1c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 msgr2=0x7f1a280c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 0x7f1a280c6540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000ca50 tx=0x7f1a2000cf10 comp rx=0 tx=0).stop 2023-11-04T01:40:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 shutdown_connections 2023-11-04T01:40:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a140664a0 0x7f1a14068960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2815c160 0x7f1a280c6540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a2815acb0 0x7f1a280aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 --2- 172.21.15.40:0/3437924426 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a280b0c20 0x7f1a2814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 >> 172.21.15.40:0/3437924426 conn(0x7f1a280cb510 msgr2=0x7f1a280c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 shutdown_connections 2023-11-04T01:40:40.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.503+0000 7f1a2d9cc640 1 -- 172.21.15.40:0/3437924426 wait complete. 2023-11-04T01:40:40.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 Processor -- start 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 -- start start 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f023c0cd670 0x7f023c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c15d290 0x7f023c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c160c50 con 0x7f023c06cfc0 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c0cedf0 con 0x7f023c0cd670 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f02409ae640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c160ef0 con 0x7f023c15d290 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f023c0cd670 0x7f023c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f0239d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f023c06cfc0 0x7f023c15cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45388/0 (socket says 172.21.15.40:45388) 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f0239d9b640 1 -- 172.21.15.40:0/892610626 learned_addr learned my addr 172.21.15.40:0/892610626 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023ad9d640 1 --2- 172.21.15.40:0/892610626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c15d290 0x7f023c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023a59c640 1 -- 172.21.15.40:0/892610626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c15d290 msgr2=0x7f023c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023a59c640 1 --2- 172.21.15.40:0/892610626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c15d290 0x7f023c0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023a59c640 1 -- 172.21.15.40:0/892610626 >> v1:172.21.15.40:6789/0 conn(0x7f023c06cfc0 legacy=0x7f023c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023959a640 1 -- 172.21.15.40:0/892610626 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245320478 0 0) 0x7f023c160c50 con 0x7f023c06cfc0 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.647+0000 7f023a59c640 1 -- 172.21.15.40:0/892610626 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c1611d0 con 0x7f023c0cd670 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f023a59c640 1 --2- 172.21.15.40:0/892610626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c0cd670 0x7f023c0ce8b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f022c0097a0 tx=0x7f022c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbc7924567b0cee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f023959a640 1 -- 172.21.15.40:0/892610626 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0ab600 con 0x7f023c0cd670 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f023959a640 1 -- 172.21.15.40:0/892610626 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c0a7050 con 0x7f023c0cd670 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f023959a640 1 -- 172.21.15.40:0/892610626 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0ab980 con 0x7f023c0cd670 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- 172.21.15.40:0/892610626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c0cd670 msgr2=0x7f023c0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 --2- 172.21.15.40:0/892610626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c0cd670 0x7f023c0ce8b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f022c0097a0 tx=0x7f022c01c430 comp rx=0 tx=0).stop 2023-11-04T01:40:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- 172.21.15.40:0/892610626 shutdown_connections 2023-11-04T01:40:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 --2- 172.21.15.40:0/892610626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c15d290 0x7f023c0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 --2- 172.21.15.40:0/892610626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c0cd670 0x7f023c0ce8b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- 172.21.15.40:0/892610626 >> 172.21.15.40:0/892610626 conn(0x7f023c065dc0 msgr2=0x7f023c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- 172.21.15.40:0/892610626 shutdown_connections 2023-11-04T01:40:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- 172.21.15.40:0/892610626 wait complete. 2023-11-04T01:40:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 Processor -- start 2023-11-04T01:40:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- start start 2023-11-04T01:40:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 0x7f023c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c0cd670 0x7f023c0d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f023c15d290 0x7f023c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0b3aa0 con 0x7f023c06cfc0 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c157810 con 0x7f023c15d290 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.651+0000 7f02409ae640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1596c0 con 0x7f023c0cd670 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 0x7f023c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 0x7f023c1572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47384/0 (socket says 172.21.15.40:47384) 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 -- 172.21.15.40:0/2085409817 learned_addr learned my addr 172.21.15.40:0/2085409817 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023ad9d640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f023c15d290 0x7f023c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f0239d9b640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c0cd670 0x7f023c0d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 -- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c0cd670 msgr2=0x7f023c0d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c0cd670 0x7f023c0d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 -- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f023c15d290 msgr2=0x7f023c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f023c15d290 0x7f023c0d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 -- 172.21.15.40:0/2085409817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0093b0 con 0x7f023c06cfc0 2023-11-04T01:40:40.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f023a59c640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 0x7f023c1572d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f022c0097a0 tx=0x7f022c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c004030 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c004190 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c0aed80 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c004500 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c0ae7c0 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c0675f0 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f022c0b2040 con 0x7f023c06cfc0 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f022affd640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f022c11d1a0 con 0x7f023c06cfc0 2023-11-04T01:40:40.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f0239d9b640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.655+0000 7f0239d9b640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f023c0b5820 tx=0x7f0230007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.659+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f022c0ea630 con 0x7f023c06cfc0 2023-11-04T01:40:40.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.807+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f023c0cc5d0 con 0x7f023c06cfc0 2023-11-04T01:40:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f022affd640 1 -- 172.21.15.40:0/2085409817 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f022c0edc50 con 0x7f023c06cfc0 2023-11-04T01:40:40.814 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:40.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f021c0664a0 msgr2=0x7f021c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f023c0b5820 tx=0x7f0230007b60 comp rx=0 tx=0).stop 2023-11-04T01:40:40.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 msgr2=0x7f023c1572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 0x7f023c1572d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f022c0097a0 tx=0x7f022c0191d0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 shutdown_connections 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f023c15d290 0x7f023c0d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f023c0cd670 0x7f023c0d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 --2- 172.21.15.40:0/2085409817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023c06cfc0 0x7f023c1572d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 >> 172.21.15.40:0/2085409817 conn(0x7f023c065dc0 msgr2=0x7f023c0b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 shutdown_connections 2023-11-04T01:40:40.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.811+0000 7f02409ae640 1 -- 172.21.15.40:0/2085409817 wait complete. 2023-11-04T01:40:40.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:40.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 Processor -- start 2023-11-04T01:40:40.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 -- start start 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b090 0x7f5bd815f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5bd815b470 0x7f5bd806a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80cbe40 con 0x7f5bd8065fd0 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd815fca0 con 0x7f5bd815b470 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5be004a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80cc120 con 0x7f5bd815b090 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bde5e7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5bd8065fd0 0x7f5bd80cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45400/0 (socket says 172.21.15.40:45400) 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bde5e7640 1 -- 172.21.15.40:0/200374531 learned_addr learned my addr 172.21.15.40:0/200374531 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bdd5e5640 1 --2- 172.21.15.40:0/200374531 >> v2:172.21.15.91:3300/0 conn(0x7f5bd815b470 0x7f5bd806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bddde6640 1 --2- 172.21.15.40:0/200374531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b090 0x7f5bd815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bdcde4640 1 -- 172.21.15.40:0/200374531 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434444477 0 0) 0x7f5bd80cbe40 con 0x7f5bd8065fd0 2023-11-04T01:40:40.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bdcde4640 1 -- 172.21.15.40:0/200374531 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc4003530 con 0x7f5bd8065fd0 2023-11-04T01:40:40.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bddde6640 1 -- 172.21.15.40:0/200374531 >> v2:172.21.15.91:3300/0 conn(0x7f5bd815b470 msgr2=0x7f5bd806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:40.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bddde6640 1 --2- 172.21.15.40:0/200374531 >> v2:172.21.15.91:3300/0 conn(0x7f5bd815b470 0x7f5bd806a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bddde6640 1 -- 172.21.15.40:0/200374531 >> v1:172.21.15.40:6789/0 conn(0x7f5bd8065fd0 legacy=0x7f5bd80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bddde6640 1 -- 172.21.15.40:0/200374531 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80cc400 con 0x7f5bd815b090 2023-11-04T01:40:40.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.951+0000 7f5bdd5e5640 1 --2- 172.21.15.40:0/200374531 >> v2:172.21.15.91:3300/0 conn(0x7f5bd815b470 0x7f5bd806a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:40.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5bddde6640 1 --2- 172.21.15.40:0/200374531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b090 0x7f5bd815f760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00097c0 tx=0x7f5bd001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d74e2d0b3da9139 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5bdcde4640 1 -- 172.21.15.40:0/200374531 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00ad660 con 0x7f5bd815b090 2023-11-04T01:40:40.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5bdcde4640 1 -- 172.21.15.40:0/200374531 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd00ad7c0 con 0x7f5bd815b090 2023-11-04T01:40:40.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5bdcde4640 1 -- 172.21.15.40:0/200374531 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00adb30 con 0x7f5bd815b090 2023-11-04T01:40:40.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 -- 172.21.15.40:0/200374531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b090 msgr2=0x7f5bd815f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 --2- 172.21.15.40:0/200374531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b090 0x7f5bd815f760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00097c0 tx=0x7f5bd001c450 comp rx=0 tx=0).stop 2023-11-04T01:40:40.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 -- 172.21.15.40:0/200374531 shutdown_connections 2023-11-04T01:40:40.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 --2- 172.21.15.40:0/200374531 >> v2:172.21.15.91:3300/0 conn(0x7f5bd815b470 0x7f5bd806a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 --2- 172.21.15.40:0/200374531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b090 0x7f5bd815f760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 -- 172.21.15.40:0/200374531 >> 172.21.15.40:0/200374531 conn(0x7f5bd80716a0 msgr2=0x7f5bd8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 -- 172.21.15.40:0/200374531 shutdown_connections 2023-11-04T01:40:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 -- 172.21.15.40:0/200374531 wait complete. 2023-11-04T01:40:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 Processor -- start 2023-11-04T01:40:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.955+0000 7f5be004a640 1 -- start start 2023-11-04T01:40:40.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 0x7f5bd80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5bd815b090 0x7f5bd8165670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b470 0x7f5bd8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c4d10 con 0x7f5bd8065fd0 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c4ff0 con 0x7f5bd815b090 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80c52d0 con 0x7f5bd815b470 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 0x7f5bd80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 0x7f5bd80c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47388/0 (socket says 172.21.15.40:47388) 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 -- 172.21.15.40:0/1598318676 learned_addr learned my addr 172.21.15.40:0/1598318676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bdd5e5640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5bd815b090 0x7f5bd8165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 -- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b470 msgr2=0x7f5bd8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bde5e7640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b470 0x7f5bd8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b470 0x7f5bd8154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 -- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5bd815b090 msgr2=0x7f5bd8165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5bd815b090 0x7f5bd8165670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 -- 172.21.15.40:0/1598318676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc8009420 con 0x7f5bd8065fd0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bdd5e5640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5bd815b090 0x7f5bd8165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bddde6640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 0x7f5bd80c43e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0000c10 tx=0x7f5bd00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00bd070 con 0x7f5bd8065fd0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0006e20 con 0x7f5bd8065fd0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd0009420 con 0x7f5bd8065fd0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00b6620 con 0x7f5bd8065fd0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd80c5890 con 0x7f5bd8065fd0 2023-11-04T01:40:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd80675f0 con 0x7f5bd8065fd0 2023-11-04T01:40:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bd00b4040 con 0x7f5bd8065fd0 2023-11-04T01:40:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bce7fc640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5bbc0664a0 0x7f5bbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5bd011d6d0 con 0x7f5bd8065fd0 2023-11-04T01:40:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.959+0000 7f5bdd5e5640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5bbc0664a0 0x7f5bbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.963+0000 7f5bdd5e5640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5bbc0664a0 0x7f5bbc068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8166050 tx=0x7f5bc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:40.963+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5bd00eac00 con 0x7f5bd8065fd0 2023-11-04T01:40:41.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.127+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5bd806b500 con 0x7f5bd8065fd0 2023-11-04T01:40:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.127+0000 7f5bce7fc640 1 -- 172.21.15.40:0/1598318676 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5bd00ee220 con 0x7f5bd8065fd0 2023-11-04T01:40:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5bbc0664a0 msgr2=0x7f5bbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5bbc0664a0 0x7f5bbc068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8166050 tx=0x7f5bc8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 msgr2=0x7f5bd80c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 0x7f5bd80c43e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0000c10 tx=0x7f5bd00191f0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 shutdown_connections 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5bbc0664a0 0x7f5bbc068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bd815b470 0x7f5bd8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5bd815b090 0x7f5bd8165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 --2- 172.21.15.40:0/1598318676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bd8065fd0 0x7f5bd80c43e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 >> 172.21.15.40:0/1598318676 conn(0x7f5bd80716a0 msgr2=0x7f5bd80ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:41.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 shutdown_connections 2023-11-04T01:40:41.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.131+0000 7f5be004a640 1 -- 172.21.15.40:0/1598318676 wait complete. 2023-11-04T01:40:41.152 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi091.front.sepia.ceph.com... 2023-11-04T01:40:41.152 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:41.152 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:41.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:41.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi091.stderr:ceph-fuse[43893]: fuse finished with error 0 and tester_r 0 2023-11-04T01:40:41.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:41.297 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:41.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi091.stderr:2023-11-04T01:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:41.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:40:41.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:41.310 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:40:41.375 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:40:41.376 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:41.382 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:40:41.382 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:41.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:41.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:2023-11-04T01:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:41.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.599+0000 7fba33b55640 1 Processor -- start 2023-11-04T01:40:41.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.599+0000 7fba33b55640 1 -- start start 2023-11-04T01:40:41.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba33b55640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fba2c15b150 0x7fba2c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba33b55640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 0x7fba2c06f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba33b55640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c0d02f0 con 0x7fba2c0b27d0 2023-11-04T01:40:41.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba33b55640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c15f980 con 0x7fba2c15b150 2023-11-04T01:40:41.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba33b55640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c15f4f0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 0x7fba2c06f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba310f0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fba2c15b150 0x7fba2c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba318f1640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fba2c0b27d0 0x7fba2c0b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46060/0 (socket says 172.21.15.40:46060) 2023-11-04T01:40:41.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 0x7fba2c06f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:33604/0 (socket says 172.21.15.40:33604) 2023-11-04T01:40:41.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba318f1640 1 -- 172.21.15.40:0/1357282303 learned_addr learned my addr 172.21.15.40:0/1357282303 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 -- 172.21.15.40:0/1357282303 >> v2:172.21.15.91:3300/0 conn(0x7fba2c15b150 msgr2=0x7fba2c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 --2- 172.21.15.40:0/1357282303 >> v2:172.21.15.91:3300/0 conn(0x7fba2c15b150 0x7fba2c0d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 -- 172.21.15.40:0/1357282303 >> v1:172.21.15.91:6789/0 conn(0x7fba2c0b27d0 legacy=0x7fba2c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 -- 172.21.15.40:0/1357282303 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0d0af0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba310f0640 1 --2- 172.21.15.40:0/1357282303 >> v2:172.21.15.91:3300/0 conn(0x7fba2c15b150 0x7fba2c0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:41.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.603+0000 7fba320f2640 1 --2- 172.21.15.40:0/1357282303 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 0x7fba2c06f480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00dbe0 tx=0x7fba1c020700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3a2c306d6efcb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:41.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba308ef640 1 -- 172.21.15.40:0/1357282303 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00d0d0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba308ef640 1 -- 172.21.15.40:0/1357282303 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c00d230 con 0x7fba2c0cfe40 2023-11-04T01:40:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba308ef640 1 -- 172.21.15.40:0/1357282303 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0aa6f0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- 172.21.15.40:0/1357282303 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 msgr2=0x7fba2c06f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 --2- 172.21.15.40:0/1357282303 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 0x7fba2c06f480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00dbe0 tx=0x7fba1c020700 comp rx=0 tx=0).stop 2023-11-04T01:40:41.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- 172.21.15.40:0/1357282303 shutdown_connections 2023-11-04T01:40:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 --2- 172.21.15.40:0/1357282303 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0cfe40 0x7fba2c06f480 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 --2- 172.21.15.40:0/1357282303 >> v2:172.21.15.91:3300/0 conn(0x7fba2c15b150 0x7fba2c0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- 172.21.15.40:0/1357282303 >> 172.21.15.40:0/1357282303 conn(0x7fba2c0cd7d0 msgr2=0x7fba2c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- 172.21.15.40:0/1357282303 shutdown_connections 2023-11-04T01:40:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- 172.21.15.40:0/1357282303 wait complete. 2023-11-04T01:40:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 Processor -- start 2023-11-04T01:40:41.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- start start 2023-11-04T01:40:41.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0b27d0 0x7fba2c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 0x7fba2c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba2c15b150 0x7fba2c0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c155010 con 0x7fba2c0cfe40 2023-11-04T01:40:41.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c14c290 con 0x7fba2c15b150 2023-11-04T01:40:41.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba33b55640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c156ad0 con 0x7fba2c0b27d0 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 0x7fba2c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba318f1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0b27d0 0x7fba2c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 0x7fba2c154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47404/0 (socket says 172.21.15.40:47404) 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 -- 172.21.15.40:0/2817237614 learned_addr learned my addr 172.21.15.40:0/2817237614 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba320f2640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba2c15b150 0x7fba2c0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 -- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0b27d0 msgr2=0x7fba2c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0b27d0 0x7fba2c156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 -- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba2c15b150 msgr2=0x7fba2c0b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba2c15b150 0x7fba2c0b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 -- 172.21.15.40:0/2817237614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009420 con 0x7fba2c0cfe40 2023-11-04T01:40:41.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.607+0000 7fba310f0640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 0x7fba2c154ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba2000ebe0 tx=0x7fba2000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:41.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000eee0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000cc30 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20013470 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c00d8c0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c0ceb00 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c165bb0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba200135d0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba2a7fc640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fba180664a0 0x7fba18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fba20084140 con 0x7fba2c0cfe40 2023-11-04T01:40:41.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba318f1640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fba180664a0 0x7fba18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.611+0000 7fba318f1640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fba180664a0 0x7fba18068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba24005c10 tx=0x7fba24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:41.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.615+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fba20051600 con 0x7fba2c0cfe40 2023-11-04T01:40:41.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.771+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2c0744a0 con 0x7fba2c0cfe40 2023-11-04T01:40:41.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba2a7fc640 1 -- 172.21.15.40:0/2817237614 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fba20054c20 con 0x7fba2c0cfe40 2023-11-04T01:40:41.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:41.778 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fba180664a0 msgr2=0x7fba18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fba180664a0 0x7fba18068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba24005c10 tx=0x7fba24009040 comp rx=0 tx=0).stop 2023-11-04T01:40:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 msgr2=0x7fba2c154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 0x7fba2c154ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba2000ebe0 tx=0x7fba2000c520 comp rx=0 tx=0).stop 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 shutdown_connections 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fba180664a0 0x7fba18068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fba2c15b150 0x7fba2c0b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba2c0cfe40 0x7fba2c154ad0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 --2- 172.21.15.40:0/2817237614 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fba2c0b27d0 0x7fba2c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 >> 172.21.15.40:0/2817237614 conn(0x7fba2c0cd7d0 msgr2=0x7fba2c0b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 shutdown_connections 2023-11-04T01:40:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.775+0000 7fba33b55640 1 -- 172.21.15.40:0/2817237614 wait complete. 2023-11-04T01:40:41.796 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:41.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:41.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 Processor -- start 2023-11-04T01:40:41.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 -- start start 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 0x7f1a840cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1a840cf4c0 0x7f1a840d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840cd830 con 0x7f1a840b32f0 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840b3780 con 0x7f1a840cf4c0 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a88a7d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840cdad0 con 0x7f1a8415af50 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a81d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1a840b32f0 0x7f1a840ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45414/0 (socket says 172.21.15.40:45414) 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a81d9b640 1 -- 172.21.15.40:0/785185094 learned_addr learned my addr 172.21.15.40:0/785185094 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:41.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a82d9d640 1 --2- 172.21.15.40:0/785185094 >> v2:172.21.15.91:3300/0 conn(0x7f1a840cf4c0 0x7f1a840d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8259c640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 0x7f1a840cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039137132 0 0) 0x7f1a840cd830 con 0x7f1a840b32f0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a70003530 con 0x7f1a840b32f0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1630225861 0 0) 0x7f1a70003530 con 0x7f1a840b32f0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 msgr2=0x7f1a840cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 0x7f1a840cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 >> v2:172.21.15.91:3300/0 conn(0x7f1a840cf4c0 msgr2=0x7f1a840d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 --2- 172.21.15.40:0/785185094 >> v2:172.21.15.91:3300/0 conn(0x7f1a840cf4c0 0x7f1a840d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840cddb0 con 0x7f1a840b32f0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1a6c001680 con 0x7f1a840b32f0 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 >> v1:172.21.15.40:6789/0 conn(0x7f1a840b32f0 legacy=0x7f1a840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a70003980 0x7f1a70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a700047d0 0x7f1a70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 0x7f1a70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840b3780 con 0x7f1a700047d0 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840cdad0 con 0x7f1a70003980 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7000b990 con 0x7f1a8415af50 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.907+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a700047d0 0x7f1a70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a8259c640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a70003980 0x7f1a70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a81d9b640 1 -- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 msgr2=0x7f1a70005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8415af50 0x7f1a70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a81d9b640 1 -- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a70003980 msgr2=0x7f1a70003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a70003980 0x7f1a70003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a81d9b640 1 -- 172.21.15.40:0/785185094 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70003530 con 0x7f1a700047d0 2023-11-04T01:40:41.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a8259c640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a70003980 0x7f1a70003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:41.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a700047d0 0x7f1a70004c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00c270 tx=0x7f1a6c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4707972d6ac0c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0058e0 con 0x7f1a700047d0 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c005a40 con 0x7f1a700047d0 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a8159a640 1 -- 172.21.15.40:0/785185094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c005e10 con 0x7f1a700047d0 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a88a7d640 1 -- 172.21.15.40:0/785185094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a700047d0 msgr2=0x7f1a70004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/785185094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a700047d0 0x7f1a70004c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00c270 tx=0x7f1a6c01cc60 comp rx=0 tx=0).stop 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a82d9d640 1 -- 172.21.15.40:0/785185094 reap_dead start 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a88a7d640 1 -- 172.21.15.40:0/785185094 shutdown_connections 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a88a7d640 1 -- 172.21.15.40:0/785185094 >> 172.21.15.40:0/785185094 conn(0x7f1a84065dc0 msgr2=0x7f1a840661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a88a7d640 1 -- 172.21.15.40:0/785185094 shutdown_connections 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.911+0000 7f1a88a7d640 1 -- 172.21.15.40:0/785185094 wait complete. 2023-11-04T01:40:41.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 Processor -- start 2023-11-04T01:40:41.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- start start 2023-11-04T01:40:41.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a700047d0 0x7f1a840aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 0x7f1a8406bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8406c210 0x7f1a8406c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8415b6d0 con 0x7f1a840c6250 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840c69c0 con 0x7f1a700047d0 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840c6ca0 con 0x7f1a8406c210 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 0x7f1a8406bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 0x7f1a8406bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47432/0 (socket says 172.21.15.40:47432) 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 -- 172.21.15.40:0/3485256252 learned_addr learned my addr 172.21.15.40:0/3485256252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a8259c640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a700047d0 0x7f1a840aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a82d9d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8406c210 0x7f1a8406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 -- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8406c210 msgr2=0x7f1a8406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8406c210 0x7f1a8406c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 -- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a700047d0 msgr2=0x7f1a840aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a700047d0 0x7f1a840aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:41.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 -- 172.21.15.40:0/3485256252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840c6f80 con 0x7f1a840c6250 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a82d9d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8406c210 0x7f1a8406c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a81d9b640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 0x7f1a8406bcd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00c210 tx=0x7f1a70005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0a5880 con 0x7f1a840c6250 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c0a59e0 con 0x7f1a840c6250 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0a5d50 con 0x7f1a840c6250 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840c66d0 con 0x7f1a840c6250 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8415baf0 con 0x7f1a840c6250 2023-11-04T01:40:41.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a840b04b0 con 0x7f1a840c6250 2023-11-04T01:40:41.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a6c0047f0 con 0x7f1a840c6250 2023-11-04T01:40:41.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a7affd640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a640664a0 0x7f1a64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:41.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.915+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1a6c11d3e0 con 0x7f1a840c6250 2023-11-04T01:40:41.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.919+0000 7f1a8259c640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a640664a0 0x7f1a64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:41.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.919+0000 7f1a8259c640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a640664a0 0x7f1a64068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c003d30 tx=0x7f1a7c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:41.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:41.919+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a6c0ea890 con 0x7f1a840c6250 2023-11-04T01:40:42.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.071+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a8415b450 con 0x7f1a840c6250 2023-11-04T01:40:42.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.071+0000 7f1a7affd640 1 -- 172.21.15.40:0/3485256252 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a6c0edeb0 con 0x7f1a840c6250 2023-11-04T01:40:42.077 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:42.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a640664a0 msgr2=0x7f1a64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a640664a0 0x7f1a64068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c003d30 tx=0x7f1a7c00b040 comp rx=0 tx=0).stop 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 msgr2=0x7f1a8406bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 0x7f1a8406bcd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00c210 tx=0x7f1a70005800 comp rx=0 tx=0).stop 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 shutdown_connections 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a640664a0 0x7f1a64068960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a8406c210 0x7f1a8406c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a840c6250 0x7f1a8406bcd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 --2- 172.21.15.40:0/3485256252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a700047d0 0x7f1a840aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 >> 172.21.15.40:0/3485256252 conn(0x7f1a84065dc0 msgr2=0x7f1a840b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 shutdown_connections 2023-11-04T01:40:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.075+0000 7f1a88a7d640 1 -- 172.21.15.40:0/3485256252 wait complete. 2023-11-04T01:40:42.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:42.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c50262640 1 Processor -- start 2023-11-04T01:40:42.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c50262640 1 -- start start 2023-11-04T01:40:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c50262640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480cf810 0x7f9c480cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c50262640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c480b5e00 con 0x7f9c480d1940 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c50262640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c480d0190 con 0x7f9c4815d0b0 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c50262640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480d1520 con 0x7f9c480cf810 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c4e7ff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c480d1940 0x7f9c480d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45420/0 (socket says 172.21.15.40:45420) 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c4e7ff640 1 -- 172.21.15.40:0/2592440650 learned_addr learned my addr 172.21.15.40:0/2592440650 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c4d7fd640 1 --2- 172.21.15.40:0/2592440650 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480cf810 0x7f9c480cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c4d7fd640 1 -- 172.21.15.40:0/2592440650 >> v1:172.21.15.91:6789/0 conn(0x7f9c4815d0b0 legacy=0x7f9c48160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c4d7fd640 1 -- 172.21.15.40:0/2592440650 >> v1:172.21.15.40:6789/0 conn(0x7f9c480d1940 legacy=0x7f9c480d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.219+0000 7f9c4d7fd640 1 -- 172.21.15.40:0/2592440650 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4815d490 con 0x7f9c480cf810 2023-11-04T01:40:42.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.223+0000 7f9c4d7fd640 1 --2- 172.21.15.40:0/2592440650 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480cf810 0x7f9c480cfc50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c380097f0 tx=0x7f9c3801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb92910eb8d07e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c4cffc640 1 -- 172.21.15.40:0/2592440650 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380aa620 con 0x7f9c480cf810 2023-11-04T01:40:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c4cffc640 1 -- 172.21.15.40:0/2592440650 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c380aa780 con 0x7f9c480cf810 2023-11-04T01:40:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c4cffc640 1 -- 172.21.15.40:0/2592440650 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380aab10 con 0x7f9c480cf810 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 -- 172.21.15.40:0/2592440650 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480cf810 msgr2=0x7f9c480cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 --2- 172.21.15.40:0/2592440650 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480cf810 0x7f9c480cfc50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c380097f0 tx=0x7f9c3801c4c0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 -- 172.21.15.40:0/2592440650 shutdown_connections 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 --2- 172.21.15.40:0/2592440650 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480cf810 0x7f9c480cfc50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 -- 172.21.15.40:0/2592440650 >> 172.21.15.40:0/2592440650 conn(0x7f9c4806a890 msgr2=0x7f9c4806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 -- 172.21.15.40:0/2592440650 shutdown_connections 2023-11-04T01:40:42.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 -- 172.21.15.40:0/2592440650 wait complete. 2023-11-04T01:40:42.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 Processor -- start 2023-11-04T01:40:42.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.227+0000 7f9c50262640 1 -- start start 2023-11-04T01:40:42.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c480cf810 0x7f9c480cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480d1940 0x7f9c480b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 0x7f9c480c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480c8250 con 0x7f9c4815d0b0 2023-11-04T01:40:42.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480b28a0 con 0x7f9c480cf810 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480b7050 con 0x7f9c480d1940 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 0x7f9c480c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 0x7f9c480c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47440/0 (socket says 172.21.15.40:47440) 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 -- 172.21.15.40:0/3323204116 learned_addr learned my addr 172.21.15.40:0/3323204116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4dffe640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c480cf810 0x7f9c480cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4d7fd640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480d1940 0x7f9c480b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 -- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480d1940 msgr2=0x7f9c480b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480d1940 0x7f9c480b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 -- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c480cf810 msgr2=0x7f9c480cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c480cf810 0x7f9c480cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 -- 172.21.15.40:0/3323204116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c38009420 con 0x7f9c4815d0b0 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4e7ff640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 0x7f9c480c73f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000cbf0 tx=0x7f9c4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000ad40 con 0x7f9c4815d0b0 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40012400 con 0x7f9c4815d0b0 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c480b6a40 con 0x7f9c4815d0b0 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000aea0 con 0x7f9c4815d0b0 2023-11-04T01:40:42.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c480b2af0 con 0x7f9c4815d0b0 2023-11-04T01:40:42.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c480744a0 con 0x7f9c4815d0b0 2023-11-04T01:40:42.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c40007070 con 0x7f9c4815d0b0 2023-11-04T01:40:42.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c3e7fc640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c2c0664a0 0x7f9c2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9c40083d90 con 0x7f9c4815d0b0 2023-11-04T01:40:42.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.231+0000 7f9c4dffe640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c2c0664a0 0x7f9c2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.235+0000 7f9c4dffe640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c2c0664a0 0x7f9c2c068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9c4815cad0 tx=0x7f9c44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.235+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c400511c0 con 0x7f9c4815d0b0 2023-11-04T01:40:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c480b7190 con 0x7f9c4815d0b0 2023-11-04T01:40:42.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c3e7fc640 1 -- 172.21.15.40:0/3323204116 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c400547e0 con 0x7f9c4815d0b0 2023-11-04T01:40:42.391 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:42.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c2c0664a0 msgr2=0x7f9c2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c2c0664a0 0x7f9c2c068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9c4815cad0 tx=0x7f9c44009040 comp rx=0 tx=0).stop 2023-11-04T01:40:42.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 msgr2=0x7f9c480c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 0x7f9c480c73f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000cbf0 tx=0x7f9c4000a430 comp rx=0 tx=0).stop 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 shutdown_connections 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c2c0664a0 0x7f9c2c068960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4815d0b0 0x7f9c480c73f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c480d1940 0x7f9c480b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 --2- 172.21.15.40:0/3323204116 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c480cf810 0x7f9c480cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 >> 172.21.15.40:0/3323204116 conn(0x7f9c4806a890 msgr2=0x7f9c4815d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 shutdown_connections 2023-11-04T01:40:42.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.387+0000 7f9c50262640 1 -- 172.21.15.40:0/3323204116 wait complete. 2023-11-04T01:40:42.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2622515640 1 Processor -- start 2023-11-04T01:40:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2622515640 1 -- start start 2023-11-04T01:40:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2622515640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f261c0ce0c0 0x7f261c0b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2622515640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0af250 con 0x7f261c0b15c0 2023-11-04T01:40:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2622515640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c06cd80 con 0x7f261c159d90 2023-11-04T01:40:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2622515640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0b1f90 con 0x7f261c0ce0c0 2023-11-04T01:40:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f261c0b15c0 0x7f261c0cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45422/0 (socket says 172.21.15.40:45422) 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261b7fe640 1 -- 172.21.15.40:0/1636837543 learned_addr learned my addr 172.21.15.40:0/1636837543 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1636837543 >> v2:172.21.15.91:3300/0 conn(0x7f261c0ce0c0 0x7f261c0b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395396524 0 0) 0x7f261c0af250 con 0x7f261c0b15c0 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2608003530 con 0x7f261c0b15c0 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684992738 0 0) 0x7f2608003530 con 0x7f261c0b15c0 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 >> v2:172.21.15.91:3300/0 conn(0x7f261c0ce0c0 msgr2=0x7f261c0b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 --2- 172.21.15.40:0/1636837543 >> v2:172.21.15.91:3300/0 conn(0x7f261c0ce0c0 0x7f261c0b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 >> v1:172.21.15.91:6789/0 conn(0x7f261c159d90 legacy=0x7f261c06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0ce590 con 0x7f261c0b15c0 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f2614001a20 con 0x7f261c0b15c0 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 >> v1:172.21.15.40:6789/0 conn(0x7f261c0b15c0 legacy=0x7f261c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2608003980 0x7f2608003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2608005190 0x7f260800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b1f90 con 0x7f2608005190 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2608005190 0x7f260800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260800c130 con 0x7f2608003980 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260800c2f0 con 0x7f26080047d0 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261bfff640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2608003980 0x7f2608003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f261b7fe640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 -- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26080047d0 msgr2=0x7f2608004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26080047d0 0x7f2608004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 -- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2608003980 msgr2=0x7f2608003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2608003980 0x7f2608003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.527+0000 7f2620ab2640 1 -- 172.21.15.40:0/1636837543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608003530 con 0x7f2608005190 2023-11-04T01:40:42.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2620ab2640 1 -- 172.21.15.40:0/1636837543 reap_dead start 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2608005190 0x7f260800b990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2604009ae0 tx=0x7f260401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a2e49c1c1554b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604004020 con 0x7f2608005190 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040041c0 con 0x7f2608005190 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f261affd640 1 -- 172.21.15.40:0/1636837543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604003620 con 0x7f2608005190 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 -- 172.21.15.40:0/1636837543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2608005190 msgr2=0x7f260800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2608005190 0x7f260800b990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2604009ae0 tx=0x7f260401ca90 comp rx=0 tx=0).stop 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 -- 172.21.15.40:0/1636837543 shutdown_connections 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 --2- 172.21.15.40:0/1636837543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2608005190 0x7f260800b990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 -- 172.21.15.40:0/1636837543 >> 172.21.15.40:0/1636837543 conn(0x7f261c0cc5c0 msgr2=0x7f261c0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 -- 172.21.15.40:0/1636837543 shutdown_connections 2023-11-04T01:40:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 -- 172.21.15.40:0/1636837543 wait complete. 2023-11-04T01:40:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 Processor -- start 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.531+0000 7f2622515640 1 -- start start 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2608005190 0x7f261c14e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f261c0c5880 0x7f261c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 0x7f261c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c3f60 con 0x7f261c0b3da0 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c3650 con 0x7f261c0c5880 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c6320 con 0x7f2608005190 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 0x7f261c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 0x7f261c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47456/0 (socket says 172.21.15.40:47456) 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 -- 172.21.15.40:0/1702150494 learned_addr learned my addr 172.21.15.40:0/1702150494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f261bfff640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2608005190 0x7f261c14e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f261b7fe640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f261c0c5880 0x7f261c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 -- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2608005190 msgr2=0x7f261c14e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2608005190 0x7f261c14e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 -- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f261c0c5880 msgr2=0x7f261c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f261c0c5880 0x7f261c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 -- 172.21.15.40:0/1702150494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0c38a0 con 0x7f261c0b3da0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f261b7fe640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f261c0c5880 0x7f261c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2620ab2640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 0x7f261c0b4250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f260401c8c0 tx=0x7f2608005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604004530 con 0x7f261c0b3da0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040a5c40 con 0x7f261c0b3da0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c0c3b80 con 0x7f261c0b3da0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604003620 con 0x7f261c0b3da0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c15c190 con 0x7f261c0b3da0 2023-11-04T01:40:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c0cc430 con 0x7f261c0b3da0 2023-11-04T01:40:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26040037a0 con 0x7f261c0b3da0 2023-11-04T01:40:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2618ff9640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25fc0664d0 0x7f25fc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f260411e3b0 con 0x7f261c0b3da0 2023-11-04T01:40:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.535+0000 7f261bfff640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25fc0664d0 0x7f25fc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.539+0000 7f261bfff640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25fc0664d0 0x7f25fc068990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f261c0ccdc0 tx=0x7f260c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.539+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26040eb840 con 0x7f261c0b3da0 2023-11-04T01:40:42.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.691+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f261c0c40a0 con 0x7f261c0b3da0 2023-11-04T01:40:42.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.691+0000 7f2618ff9640 1 -- 172.21.15.40:0/1702150494 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f261c0c40a0 con 0x7f261c0b3da0 2023-11-04T01:40:42.696 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25fc0664d0 msgr2=0x7f25fc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25fc0664d0 0x7f25fc068990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f261c0ccdc0 tx=0x7f260c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 msgr2=0x7f261c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 0x7f261c0b4250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f260401c8c0 tx=0x7f2608005800 comp rx=0 tx=0).stop 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 shutdown_connections 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f25fc0664d0 0x7f25fc068990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f261c0b3da0 0x7f261c0b4250 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f261c0c5880 0x7f261c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 --2- 172.21.15.40:0/1702150494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2608005190 0x7f261c14e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 >> 172.21.15.40:0/1702150494 conn(0x7f261c0cc5c0 msgr2=0x7f261c150000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 shutdown_connections 2023-11-04T01:40:42.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.695+0000 7f2622515640 1 -- 172.21.15.40:0/1702150494 wait complete. 2023-11-04T01:40:42.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:42.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 Processor -- start 2023-11-04T01:40:42.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 -- start start 2023-11-04T01:40:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6eac15d170 0x7f6eac0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6eac070bf0 0x7f6eac0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac06a160 0x7f6eac06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac06ab10 con 0x7f6eac15d170 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0c4fb0 con 0x7f6eac070bf0 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb3f46640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0711b0 con 0x7f6eac06a160 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6eac15d170 0x7f6eac0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6eac15d170 0x7f6eac0ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47472/0 (socket says 172.21.15.40:47472) 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 -- 172.21.15.40:0/3655087552 learned_addr learned my addr 172.21.15.40:0/3655087552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb24e3640 1 --2- 172.21.15.40:0/3655087552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac06a160 0x7f6eac06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb14e1640 1 --2- 172.21.15.40:0/3655087552 >> v2:172.21.15.91:3300/0 conn(0x7f6eac070bf0 0x7f6eac0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 -- 172.21.15.40:0/3655087552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac06a160 msgr2=0x7f6eac06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/3655087552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac06a160 0x7f6eac06a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 -- 172.21.15.40:0/3655087552 >> v2:172.21.15.91:3300/0 conn(0x7f6eac070bf0 msgr2=0x7f6eac0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/3655087552 >> v2:172.21.15.91:3300/0 conn(0x7f6eac070bf0 0x7f6eac0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.835+0000 7f6eb1ce2640 1 -- 172.21.15.40:0/3655087552 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac071490 con 0x7f6eac15d170 2023-11-04T01:40:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/3655087552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac0ce1b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6eac06b240 tx=0x7f6e9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68326feeeddd5b36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb0ce0640 1 -- 172.21.15.40:0/3655087552 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0ac600 con 0x7f6eac15d170 2023-11-04T01:40:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb0ce0640 1 -- 172.21.15.40:0/3655087552 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c0a8050 con 0x7f6eac15d170 2023-11-04T01:40:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb0ce0640 1 -- 172.21.15.40:0/3655087552 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0ac980 con 0x7f6eac15d170 2023-11-04T01:40:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 -- 172.21.15.40:0/3655087552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 msgr2=0x7f6eac0ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/3655087552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac0ce1b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6eac06b240 tx=0x7f6e9c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 -- 172.21.15.40:0/3655087552 shutdown_connections 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/3655087552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac06a160 0x7f6eac06a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/3655087552 >> v2:172.21.15.91:3300/0 conn(0x7f6eac070bf0 0x7f6eac0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/3655087552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac0ce1b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 -- 172.21.15.40:0/3655087552 >> 172.21.15.40:0/3655087552 conn(0x7f6eac0cfc00 msgr2=0x7f6eac0d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 -- 172.21.15.40:0/3655087552 shutdown_connections 2023-11-04T01:40:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 -- 172.21.15.40:0/3655087552 wait complete. 2023-11-04T01:40:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.839+0000 7f6eb3f46640 1 Processor -- start 2023-11-04T01:40:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- start start 2023-11-04T01:40:42.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6eac06a160 0x7f6eac0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac070bf0 0x7f6eac153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac154940 con 0x7f6eac15d170 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac154c20 con 0x7f6eac06a160 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac154f00 con 0x7f6eac070bf0 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac14f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47478/0 (socket says 172.21.15.40:47478) 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 -- 172.21.15.40:0/767927219 learned_addr learned my addr 172.21.15.40:0/767927219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb14e1640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac070bf0 0x7f6eac153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6eac06a160 0x7f6eac0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 -- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac070bf0 msgr2=0x7f6eac153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac070bf0 0x7f6eac153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 -- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6eac06a160 msgr2=0x7f6eac0b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6eac06a160 0x7f6eac0b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 -- 172.21.15.40:0/767927219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0094d0 con 0x7f6eac15d170 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6eac06a160 0x7f6eac0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb24e3640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac14f260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400d5d0 tx=0x7f6ea400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4014620 con 0x7f6eac15d170 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40147a0 con 0x7f6eac15d170 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4014b50 con 0x7f6eac15d170 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac1551e0 con 0x7f6eac15d170 2023-11-04T01:40:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac06d630 con 0x7f6eac15d170 2023-11-04T01:40:42.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac0675f0 con 0x7f6eac15d170 2023-11-04T01:40:42.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ea4014cb0 con 0x7f6eac15d170 2023-11-04T01:40:42.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eaa7fc640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e980664a0 0x7f6e98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.843+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6ea4084520 con 0x7f6eac15d170 2023-11-04T01:40:42.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.847+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e980664a0 0x7f6e98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.847+0000 7f6eb1ce2640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e980664a0 0x7f6e98068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0ae000 tx=0x7f6e9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:42.851+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ea4051920 con 0x7f6eac15d170 2023-11-04T01:40:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6eac0d0a30 con 0x7f6eac15d170 2023-11-04T01:40:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eaa7fc640 1 -- 172.21.15.40:0/767927219 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ea4054f40 con 0x7f6eac15d170 2023-11-04T01:40:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:43.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e980664a0 msgr2=0x7f6e98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e980664a0 0x7f6e98068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0ae000 tx=0x7f6e9c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 msgr2=0x7f6eac14f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac14f260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400d5d0 tx=0x7f6ea400da90 comp rx=0 tx=0).stop 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 shutdown_connections 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6e980664a0 0x7f6e98068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6eac15d170 0x7f6eac14f260 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6eac070bf0 0x7f6eac153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 --2- 172.21.15.40:0/767927219 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6eac06a160 0x7f6eac0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 >> 172.21.15.40:0/767927219 conn(0x7f6eac0cfc00 msgr2=0x7f6eac0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 shutdown_connections 2023-11-04T01:40:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.011+0000 7f6eb3f46640 1 -- 172.21.15.40:0/767927219 wait complete. 2023-11-04T01:40:43.032 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:40:43.032 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:43.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:43.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.199+0000 7fdcdc567640 1 Processor -- start 2023-11-04T01:40:43.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.199+0000 7fdcdc567640 1 -- start start 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdc567640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdcd415a1f0 0x7fdcd40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdc567640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 0x7fdcd40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdc567640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd40ccee0 con 0x7fdcd40ca400 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdc567640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd415a5d0 con 0x7fdcd415a1f0 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdc567640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40ca900 con 0x7fdcd40cdea0 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdab04640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdcd40ca400 0x7fdcd40704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45432/0 (socket says 172.21.15.40:45432) 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdab04640 1 -- 172.21.15.40:0/841744192 learned_addr learned my addr 172.21.15.40:0/841744192 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 --2- 172.21.15.40:0/841744192 >> v2:172.21.15.91:3300/0 conn(0x7fdcd415a1f0 0x7fdcd40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9b02640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 0x7fdcd40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476684205 0 0) 0x7fdcd40ccee0 con 0x7fdcd40ca400 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc0005740 con 0x7fdcd40ca400 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509332368 0 0) 0x7fdcc0005740 con 0x7fdcd40ca400 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 msgr2=0x7fdcd40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 0x7fdcd40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 >> v2:172.21.15.91:3300/0 conn(0x7fdcd415a1f0 msgr2=0x7fdcd40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 --2- 172.21.15.40:0/841744192 >> v2:172.21.15.91:3300/0 conn(0x7fdcd415a1f0 0x7fdcd40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40cabe0 con 0x7fdcd40ca400 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fdccc001a00 con 0x7fdcd40ca400 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 >> v1:172.21.15.40:6789/0 conn(0x7fdcd40ca400 legacy=0x7fdcd40704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc0005b90 0x7fdcc0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 0x7fdcc00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc0006f20 0x7fdcc00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd415a5d0 con 0x7fdcc0005b90 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40ca900 con 0x7fdcc0006f20 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc000dba0 con 0x7fdcd40cdea0 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc0005b90 0x7fdcc0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcdab04640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc0006f20 0x7fdcc00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 -- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 msgr2=0x7fdcc00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcd40cdea0 0x7fdcc00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 -- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc0006f20 msgr2=0x7fdcc00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcc0006f20 0x7fdcc00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.203+0000 7fdcda303640 1 -- 172.21.15.40:0/841744192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0005740 con 0x7fdcc0005b90 2023-11-04T01:40:43.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcda303640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc0005b90 0x7fdcc0005fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ae0 tx=0x7fdcd001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6134b416119c1ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a5630 con 0x7fdcc0005b90 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd00a5790 con 0x7fdcc0005b90 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9301640 1 -- 172.21.15.40:0/841744192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a5b40 con 0x7fdcc0005b90 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/841744192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc0005b90 msgr2=0x7fdcc0005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 --2- 172.21.15.40:0/841744192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc0005b90 0x7fdcc0005fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ae0 tx=0x7fdcd001ca60 comp rx=0 tx=0).stop 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdab04640 1 -- 172.21.15.40:0/841744192 reap_dead start 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/841744192 shutdown_connections 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/841744192 >> 172.21.15.40:0/841744192 conn(0x7fdcd40cebb0 msgr2=0x7fdcd40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/841744192 shutdown_connections 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/841744192 wait complete. 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 Processor -- start 2023-11-04T01:40:43.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- start start 2023-11-04T01:40:43.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcc0005b90 0x7fdcd41f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 0x7fdcd4154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcd4160170 0x7fdcd41605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4160ea0 con 0x7fdcd4154730 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41550f0 con 0x7fdcd4160170 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd415e970 con 0x7fdcc0005b90 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 0x7fdcd4154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 0x7fdcd4154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47486/0 (socket says 172.21.15.40:47486) 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 -- 172.21.15.40:0/4012199497 learned_addr learned my addr 172.21.15.40:0/4012199497 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcda303640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcc0005b90 0x7fdcd41f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdab04640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcd4160170 0x7fdcd41605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 -- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcc0005b90 msgr2=0x7fdcd41f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcc0005b90 0x7fdcd41f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 -- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcd4160170 msgr2=0x7fdcd41605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcd4160170 0x7fdcd41605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 -- 172.21.15.40:0/4012199497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd415ec50 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcd9b02640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 0x7fdcd4154bb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400e7f0 tx=0x7fdcc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400c940 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400caa0 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd415ef30 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400ce50 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.207+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd4160b30 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.211+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd415eab0 con 0x7fdcd4154730 2023-11-04T01:40:43.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.211+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcc4013470 con 0x7fdcd4154730 2023-11-04T01:40:43.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.211+0000 7fdccaffd640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdcb80664a0 0x7fdcb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.211+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdcc4083fa0 con 0x7fdcd4154730 2023-11-04T01:40:43.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.211+0000 7fdcda303640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdcb80664a0 0x7fdcb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.211+0000 7fdcda303640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdcb80664a0 0x7fdcb8068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00af000 tx=0x7fdcd00046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.215+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdcc40b5090 con 0x7fdcd4154730 2023-11-04T01:40:43.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.371+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd40744a0 con 0x7fdcd4154730 2023-11-04T01:40:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.371+0000 7fdccaffd640 1 -- 172.21.15.40:0/4012199497 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fdcd415eab0 con 0x7fdcd4154730 2023-11-04T01:40:43.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:43.376 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdcb80664a0 msgr2=0x7fdcb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdcb80664a0 0x7fdcb8068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00af000 tx=0x7fdcd00046d0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 msgr2=0x7fdcd4154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 0x7fdcd4154bb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400e7f0 tx=0x7fdcc400ecb0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 shutdown_connections 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdcb80664a0 0x7fdcb8068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdcd4160170 0x7fdcd41605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4154730 0x7fdcd4154bb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 --2- 172.21.15.40:0/4012199497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdcc0005b90 0x7fdcd41f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 >> 172.21.15.40:0/4012199497 conn(0x7fdcd40cebb0 msgr2=0x7fdcd4155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 shutdown_connections 2023-11-04T01:40:43.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.375+0000 7fdcdc567640 1 -- 172.21.15.40:0/4012199497 wait complete. 2023-11-04T01:40:43.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:43.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:43.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 Processor -- start 2023-11-04T01:40:43.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 -- start start 2023-11-04T01:40:43.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d880cf4c0 0x7f5d880d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d880cd830 con 0x7f5d880b32f0 2023-11-04T01:40:43.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880b3780 con 0x7f5d880cf4c0 2023-11-04T01:40:43.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d9003e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880cdad0 con 0x7f5d8815af50 2023-11-04T01:40:43.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d880cf4c0 0x7f5d880d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d880cf4c0 0x7f5d880d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47502/0 (socket says 172.21.15.40:47502) 2023-11-04T01:40:43.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2807630930 learned_addr learned my addr 172.21.15.40:0/2807630930 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:43.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8ddda640 1 --2- 172.21.15.40:0/2807630930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2807630930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 msgr2=0x7f5d880cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 --2- 172.21.15.40:0/2807630930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2807630930 >> v1:172.21.15.91:6789/0 conn(0x7f5d880b32f0 legacy=0x7f5d880ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:43.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.515+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2807630930 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880cddb0 con 0x7f5d880cf4c0 2023-11-04T01:40:43.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8e5db640 1 --2- 172.21.15.40:0/2807630930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d880cf4c0 0x7f5d880d0610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009e50 tx=0x7f5d8001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ea5e3c77f9e5d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8cdd8640 1 -- 172.21.15.40:0/2807630930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800a57e0 con 0x7f5d880cf4c0 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8cdd8640 1 -- 172.21.15.40:0/2807630930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800a5940 con 0x7f5d880cf4c0 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8cdd8640 1 -- 172.21.15.40:0/2807630930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800a5cd0 con 0x7f5d880cf4c0 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- 172.21.15.40:0/2807630930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d880cf4c0 msgr2=0x7f5d880d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2807630930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d880cf4c0 0x7f5d880d0610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009e50 tx=0x7f5d8001c940 comp rx=0 tx=0).stop 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- 172.21.15.40:0/2807630930 shutdown_connections 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2807630930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d880cf4c0 0x7f5d880d0610 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2807630930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- 172.21.15.40:0/2807630930 >> 172.21.15.40:0/2807630930 conn(0x7f5d88065dc0 msgr2=0x7f5d880661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- 172.21.15.40:0/2807630930 shutdown_connections 2023-11-04T01:40:43.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- 172.21.15.40:0/2807630930 wait complete. 2023-11-04T01:40:43.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 Processor -- start 2023-11-04T01:40:43.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- start start 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d880cf4c0 0x7f5d881f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 0x7f5d881f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881f41e0 con 0x7f5d881f6810 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881f3220 con 0x7f5d880cf4c0 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d9003e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881f72d0 con 0x7f5d8815af50 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8e5db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 0x7f5d881f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8e5db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 0x7f5d881f6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47512/0 (socket says 172.21.15.40:47512) 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.519+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2005231866 learned_addr learned my addr 172.21.15.40:0/2005231866 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8ddda640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d880cf4c0 0x7f5d881f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8d5d9640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 msgr2=0x7f5d880b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8e5db640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d880cf4c0 msgr2=0x7f5d881f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8e5db640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d880cf4c0 0x7f5d881f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8e5db640 1 -- 172.21.15.40:0/2005231866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80009b30 con 0x7f5d881f6810 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8d5d9640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8e5db640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 0x7f5d881f6ca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001aff0 tx=0x7f5d800196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b8470 con 0x7f5d881f6810 2023-11-04T01:40:43.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800b85d0 con 0x7f5d881f6810 2023-11-04T01:40:43.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d881f75b0 con 0x7f5d881f6810 2023-11-04T01:40:43.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b8960 con 0x7f5d881f6810 2023-11-04T01:40:43.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d881f3780 con 0x7f5d881f6810 2023-11-04T01:40:43.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d881f3970 con 0x7f5d881f6810 2023-11-04T01:40:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d800b8ac0 con 0x7f5d881f6810 2023-11-04T01:40:43.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d7e7fc640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d6c0664a0 0x7f5d6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5d8011f270 con 0x7f5d881f6810 2023-11-04T01:40:43.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8ddda640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d6c0664a0 0x7f5d6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.523+0000 7f5d8ddda640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d6c0664a0 0x7f5d6c068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d84006fd0 tx=0x7f5d84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.527+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d800ec730 con 0x7f5d881f6810 2023-11-04T01:40:43.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.679+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d880675f0 con 0x7f5d881f6810 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.679+0000 7f5d7e7fc640 1 -- 172.21.15.40:0/2005231866 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d800efd50 con 0x7f5d881f6810 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d6c0664a0 msgr2=0x7f5d6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d6c0664a0 0x7f5d6c068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d84006fd0 tx=0x7f5d84008040 comp rx=0 tx=0).stop 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 msgr2=0x7f5d881f6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 0x7f5d881f6ca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001aff0 tx=0x7f5d800196e0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 shutdown_connections 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5d6c0664a0 0x7f5d6c068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d881f6810 0x7f5d881f6ca0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5d8815af50 0x7f5d880b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 --2- 172.21.15.40:0/2005231866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d880cf4c0 0x7f5d881f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 >> 172.21.15.40:0/2005231866 conn(0x7f5d88065dc0 msgr2=0x7f5d880661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 shutdown_connections 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.683+0000 7f5d9003e640 1 -- 172.21.15.40:0/2005231866 wait complete. 2023-11-04T01:40:43.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:43.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b7a50640 1 Processor -- start 2023-11-04T01:40:43.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b7a50640 1 -- start start 2023-11-04T01:40:43.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b7a50640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b006c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b7a50640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b0160ca0 con 0x7fa8b015cfd0 2023-11-04T01:40:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b7a50640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00ca0a0 con 0x7fa8b006c750 2023-11-04T01:40:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b7a50640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b006cbe0 con 0x7fa8b0070270 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b57ec640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8b015cfd0 0x7fa8b00c9990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45448/0 (socket says 172.21.15.40:45448) 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b57ec640 1 -- 172.21.15.40:0/2914602141 learned_addr learned my addr 172.21.15.40:0/2914602141 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b4feb640 1 --2- 172.21.15.40:0/2914602141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8a7fff640 1 -- 172.21.15.40:0/2914602141 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890065649 0 0) 0x7fa8b0160ca0 con 0x7fa8b015cfd0 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8a7fff640 1 -- 172.21.15.40:0/2914602141 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c003530 con 0x7fa8b015cfd0 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8a7fff640 1 -- 172.21.15.40:0/2914602141 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674955697 0 0) 0x7fa8b00ca0a0 con 0x7fa8b006c750 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b4feb640 1 -- 172.21.15.40:0/2914602141 >> v1:172.21.15.91:6789/0 conn(0x7fa8b006c750 legacy=0x7fa8b00ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b4feb640 1 -- 172.21.15.40:0/2914602141 >> v1:172.21.15.40:6789/0 conn(0x7fa8b015cfd0 legacy=0x7fa8b00c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.827+0000 7fa8b4feb640 1 -- 172.21.15.40:0/2914602141 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0160ef0 con 0x7fa8b0070270 2023-11-04T01:40:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b4feb640 1 --2- 172.21.15.40:0/2914602141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b006c210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00097f0 tx=0x7fa8a001c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe19d7fdad034034 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8a7fff640 1 -- 172.21.15.40:0/2914602141 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac001680 con 0x7fa8b0070270 2023-11-04T01:40:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8a7fff640 1 -- 172.21.15.40:0/2914602141 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00a7050 con 0x7fa8b0070270 2023-11-04T01:40:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8a7fff640 1 -- 172.21.15.40:0/2914602141 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00ab600 con 0x7fa8b0070270 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 -- 172.21.15.40:0/2914602141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 msgr2=0x7fa8b006c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/2914602141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b006c210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00097f0 tx=0x7fa8a001c300 comp rx=0 tx=0).stop 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 -- 172.21.15.40:0/2914602141 shutdown_connections 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/2914602141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b006c210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 -- 172.21.15.40:0/2914602141 >> 172.21.15.40:0/2914602141 conn(0x7fa8b00cf340 msgr2=0x7fa8b00cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 -- 172.21.15.40:0/2914602141 shutdown_connections 2023-11-04T01:40:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.831+0000 7fa8b7a50640 1 -- 172.21.15.40:0/2914602141 wait complete. 2023-11-04T01:40:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 Processor -- start 2023-11-04T01:40:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- start start 2023-11-04T01:40:43.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 0x7fa8b00710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8b015cfd0 0x7fa8b00c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00715e0 con 0x7fa8b006c750 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00b0080 con 0x7fa8b015cfd0 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00b37b0 con 0x7fa8b0070270 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 0x7fa8b00710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 0x7fa8b00710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47526/0 (socket says 172.21.15.40:47526) 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 -- 172.21.15.40:0/1036461408 learned_addr learned my addr 172.21.15.40:0/1036461408 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b4feb640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b5fed640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8b015cfd0 0x7fa8b00c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 -- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 msgr2=0x7fa8b0156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b0156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 -- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8b015cfd0 msgr2=0x7fa8b00c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8b015cfd0 0x7fa8b00c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:43.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 -- 172.21.15.40:0/1036461408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009420 con 0x7fa8b006c750 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b4feb640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b0156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b57ec640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 0x7fa8b00710a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00c7a0 tx=0x7fa8ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0074e0 con 0x7fa8b006c750 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac007660 con 0x7fa8b006c750 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00b3a90 con 0x7fa8b006c750 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac004a30 con 0x7fa8b006c750 2023-11-04T01:40:43.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00b0360 con 0x7fa8b006c750 2023-11-04T01:40:43.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.835+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b00b3fb0 con 0x7fa8b006c750 2023-11-04T01:40:43.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.839+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8ac00a640 con 0x7fa8b006c750 2023-11-04T01:40:43.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.839+0000 7fa8a5ffb640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8940664f0 0x7fa8940689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:43.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.839+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa8ac083a20 con 0x7fa8b006c750 2023-11-04T01:40:43.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.839+0000 7fa8b4feb640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8940664f0 0x7fa8940689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.839+0000 7fa8b4feb640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8940664f0 0x7fa8940689b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00ad000 tx=0x7fa8a00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.843+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8ac050f90 con 0x7fa8b006c750 2023-11-04T01:40:44.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.995+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8b00b3fb0 con 0x7fa8b006c750 2023-11-04T01:40:44.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.995+0000 7fa8a5ffb640 1 -- 172.21.15.40:0/1036461408 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8b00b3fb0 con 0x7fa8b006c750 2023-11-04T01:40:44.001 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:44.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8940664f0 msgr2=0x7fa8940689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8940664f0 0x7fa8940689b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00ad000 tx=0x7fa8a00a6000 comp rx=0 tx=0).stop 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 msgr2=0x7fa8b00710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 0x7fa8b00710a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00c7a0 tx=0x7fa8ac00cc60 comp rx=0 tx=0).stop 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 shutdown_connections 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8940664f0 0x7fa8940689b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8b015cfd0 0x7fa8b00c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8b0070270 0x7fa8b0156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 --2- 172.21.15.40:0/1036461408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b006c750 0x7fa8b00710a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 >> 172.21.15.40:0/1036461408 conn(0x7fa8b00cf340 msgr2=0x7fa8b00ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 shutdown_connections 2023-11-04T01:40:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:43.999+0000 7fa8b7a50640 1 -- 172.21.15.40:0/1036461408 wait complete. 2023-11-04T01:40:44.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:44.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 Processor -- start 2023-11-04T01:40:44.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 -- start start 2023-11-04T01:40:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b90160790 0x7f6b90065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6b9006b280 0x7f6b90160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b900ca010 con 0x7f6b900ceb70 2023-11-04T01:40:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b90160b70 con 0x7f6b90160790 2023-11-04T01:40:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b97c54640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b900c9a30 con 0x7f6b9006b280 2023-11-04T01:40:44.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b951ef640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6b900ceb70 0x7f6b9006ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45460/0 (socket says 172.21.15.40:45460) 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b951ef640 1 -- 172.21.15.40:0/77718546 learned_addr learned my addr 172.21.15.40:0/77718546 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b959f0640 1 --2- 172.21.15.40:0/77718546 >> v2:172.21.15.40:3300/0 conn(0x7f6b90160790 0x7f6b90065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b961f1640 1 --2- 172.21.15.40:0/77718546 >> v2:172.21.15.91:3300/0 conn(0x7f6b9006b280 0x7f6b90160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b949ee640 1 -- 172.21.15.40:0/77718546 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340191199 0 0) 0x7f6b900ca010 con 0x7f6b900ceb70 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b949ee640 1 -- 172.21.15.40:0/77718546 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b78003530 con 0x7f6b900ceb70 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b959f0640 1 -- 172.21.15.40:0/77718546 >> v2:172.21.15.91:3300/0 conn(0x7f6b9006b280 msgr2=0x7f6b90160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b959f0640 1 --2- 172.21.15.40:0/77718546 >> v2:172.21.15.91:3300/0 conn(0x7f6b9006b280 0x7f6b90160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b959f0640 1 -- 172.21.15.40:0/77718546 >> v1:172.21.15.40:6789/0 conn(0x7f6b900ceb70 legacy=0x7f6b9006ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.139+0000 7f6b959f0640 1 -- 172.21.15.40:0/77718546 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900cb590 con 0x7f6b90160790 2023-11-04T01:40:44.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b959f0640 1 --2- 172.21.15.40:0/77718546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b90160790 0x7f6b90065dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6b900c9920 tx=0x7f6b8801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872021bb008ec734 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b949ee640 1 -- 172.21.15.40:0/77718546 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b880ab600 con 0x7f6b90160790 2023-11-04T01:40:44.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b949ee640 1 -- 172.21.15.40:0/77718546 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b880a7050 con 0x7f6b90160790 2023-11-04T01:40:44.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b949ee640 1 -- 172.21.15.40:0/77718546 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b880ab980 con 0x7f6b90160790 2023-11-04T01:40:44.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 -- 172.21.15.40:0/77718546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b90160790 msgr2=0x7f6b90065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 --2- 172.21.15.40:0/77718546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b90160790 0x7f6b90065dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6b900c9920 tx=0x7f6b8801c1a0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 -- 172.21.15.40:0/77718546 shutdown_connections 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 --2- 172.21.15.40:0/77718546 >> v2:172.21.15.91:3300/0 conn(0x7f6b9006b280 0x7f6b90160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 --2- 172.21.15.40:0/77718546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b90160790 0x7f6b90065dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 -- 172.21.15.40:0/77718546 >> 172.21.15.40:0/77718546 conn(0x7f6b900b0e30 msgr2=0x7f6b900b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 -- 172.21.15.40:0/77718546 shutdown_connections 2023-11-04T01:40:44.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.143+0000 7f6b97c54640 1 -- 172.21.15.40:0/77718546 wait complete. 2023-11-04T01:40:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 Processor -- start 2023-11-04T01:40:44.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- start start 2023-11-04T01:40:44.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 0x7f6b90156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b900ceb70 0x7f6b90157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6b90160790 0x7f6b9015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b901507f0 con 0x7f6b9006b280 2023-11-04T01:40:44.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90151b40 con 0x7f6b900ceb70 2023-11-04T01:40:44.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b90155310 con 0x7f6b90160790 2023-11-04T01:40:44.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 0x7f6b90156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 0x7f6b90156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47546/0 (socket says 172.21.15.40:47546) 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 -- 172.21.15.40:0/885590050 learned_addr learned my addr 172.21.15.40:0/885590050 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b961f1640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6b90160790 0x7f6b9015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b951ef640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b900ceb70 0x7f6b90157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 -- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6b90160790 msgr2=0x7f6b9015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6b90160790 0x7f6b9015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 -- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b900ceb70 msgr2=0x7f6b90157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b900ceb70 0x7f6b90157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 -- 172.21.15.40:0/885590050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88009420 con 0x7f6b9006b280 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b961f1640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6b90160790 0x7f6b9015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b951ef640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b900ceb70 0x7f6b90157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b959f0640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 0x7f6b90156500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6b880ae040 tx=0x7f6b88018f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b880b4430 con 0x7f6b9006b280 2023-11-04T01:40:44.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b880b45b0 con 0x7f6b9006b280 2023-11-04T01:40:44.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b880b4960 con 0x7f6b9006b280 2023-11-04T01:40:44.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b901555f0 con 0x7f6b9006b280 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b901520e0 con 0x7f6b9006b280 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b901522d0 con 0x7f6b9006b280 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b880b2040 con 0x7f6b9006b280 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.147+0000 7f6b8e7fc640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b7c0664a0 0x7f6b7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.151+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6b8811de70 con 0x7f6b9006b280 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.151+0000 7f6b951ef640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b7c0664a0 0x7f6b7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.151+0000 7f6b951ef640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b7c0664a0 0x7f6b7c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6b90154230 tx=0x7f6b84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.151+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b880eb270 con 0x7f6b9006b280 2023-11-04T01:40:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.311+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b900675f0 con 0x7f6b9006b280 2023-11-04T01:40:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.311+0000 7f6b8e7fc640 1 -- 172.21.15.40:0/885590050 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b880ee890 con 0x7f6b9006b280 2023-11-04T01:40:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b7c0664a0 msgr2=0x7f6b7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b7c0664a0 0x7f6b7c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6b90154230 tx=0x7f6b84009040 comp rx=0 tx=0).stop 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 msgr2=0x7f6b90156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 0x7f6b90156500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6b880ae040 tx=0x7f6b88018f40 comp rx=0 tx=0).stop 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 shutdown_connections 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b7c0664a0 0x7f6b7c068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6b90160790 0x7f6b9015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6b900ceb70 0x7f6b90157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 --2- 172.21.15.40:0/885590050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9006b280 0x7f6b90156500 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 >> 172.21.15.40:0/885590050 conn(0x7f6b900b0e30 msgr2=0x7f6b9006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 shutdown_connections 2023-11-04T01:40:44.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.315+0000 7f6b97c54640 1 -- 172.21.15.40:0/885590050 wait complete. 2023-11-04T01:40:44.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4222875640 1 Processor -- start 2023-11-04T01:40:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4222875640 1 -- start start 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4222875640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f421c15d690 0x7f421c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4222875640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c0cd400 con 0x7f421c15d2b0 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4222875640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c0cd6e0 con 0x7f421c06f8f0 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4222875640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c0ad450 con 0x7f421c15d690 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f421c15d2b0 0x7f421c0ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45476/0 (socket says 172.21.15.40:45476) 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421bfff640 1 -- 172.21.15.40:0/4022513253 learned_addr learned my addr 172.21.15.40:0/4022513253 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421b7fe640 1 --2- 172.21.15.40:0/4022513253 >> v2:172.21.15.91:3300/0 conn(0x7f421c15d690 0x7f421c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077953455 0 0) 0x7f421c0cd400 con 0x7f421c15d2b0 2023-11-04T01:40:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4204003530 con 0x7f421c15d2b0 2023-11-04T01:40:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 523129531 0 0) 0x7f4204003530 con 0x7f421c15d2b0 2023-11-04T01:40:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 >> v2:172.21.15.91:3300/0 conn(0x7f421c15d690 msgr2=0x7f421c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 --2- 172.21.15.40:0/4022513253 >> v2:172.21.15.91:3300/0 conn(0x7f421c15d690 0x7f421c06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 >> v1:172.21.15.91:6789/0 conn(0x7f421c06f8f0 legacy=0x7f421c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0ad070 con 0x7f421c15d2b0 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f420c001680 con 0x7f421c15d2b0 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 >> v1:172.21.15.40:6789/0 conn(0x7f421c15d2b0 legacy=0x7f421c0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4204003980 0x7f4204003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4204004380 0x7f4204004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42040050f0 0x7f420400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0ad450 con 0x7f42040050f0 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420400c030 con 0x7f4204003980 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420400c1f0 con 0x7f4204004380 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4220e12640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42040050f0 0x7f420400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421bfff640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4204003980 0x7f4204003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f421b7fe640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4204004380 0x7f4204004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4220e12640 1 -- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4204004380 msgr2=0x7f4204004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4220e12640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4204004380 0x7f4204004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4220e12640 1 -- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4204003980 msgr2=0x7f4204003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4220e12640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4204003980 0x7f4204003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.459+0000 7f4220e12640 1 -- 172.21.15.40:0/4022513253 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204003530 con 0x7f42040050f0 2023-11-04T01:40:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4220e12640 1 -- 172.21.15.40:0/4022513253 reap_dead start 2023-11-04T01:40:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4220e12640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42040050f0 0x7f420400b990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4214001f60 tx=0x7f421401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e84a61493776e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214003b80 con 0x7f42040050f0 2023-11-04T01:40:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c06ff00 con 0x7f42040050f0 2023-11-04T01:40:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f421affd640 1 -- 172.21.15.40:0/4022513253 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140050d0 con 0x7f42040050f0 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 -- 172.21.15.40:0/4022513253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42040050f0 msgr2=0x7f420400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42040050f0 0x7f420400b990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4214001f60 tx=0x7f421401c810 comp rx=0 tx=0).stop 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 -- 172.21.15.40:0/4022513253 shutdown_connections 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 --2- 172.21.15.40:0/4022513253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42040050f0 0x7f420400b990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 -- 172.21.15.40:0/4022513253 >> 172.21.15.40:0/4022513253 conn(0x7f421c0cebb0 msgr2=0x7f421c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 -- 172.21.15.40:0/4022513253 shutdown_connections 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 -- 172.21.15.40:0/4022513253 wait complete. 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 Processor -- start 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.463+0000 7f4222875640 1 -- start start 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42040050f0 0x7f421c14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f421c14ff50 0x7f421c0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 0x7f421c0c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c150930 con 0x7f421c1503d0 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c150c10 con 0x7f42040050f0 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c150ef0 con 0x7f421c14ff50 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 0x7f421c0c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 0x7f421c0c1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47566/0 (socket says 172.21.15.40:47566) 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 -- 172.21.15.40:0/3172200681 learned_addr learned my addr 172.21.15.40:0/3172200681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f421bfff640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42040050f0 0x7f421c14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f421b7fe640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f421c14ff50 0x7f421c0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 -- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f421c14ff50 msgr2=0x7f421c0c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f421c14ff50 0x7f421c0c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 -- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42040050f0 msgr2=0x7f421c14b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42040050f0 0x7f421c14b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 -- 172.21.15.40:0/3172200681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c1511d0 con 0x7f421c1503d0 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4220e12640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 0x7f421c0c1450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f421400a030 tx=0x7f4204005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140052d0 con 0x7f421c1503d0 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214005430 con 0x7f421c1503d0 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140057e0 con 0x7f421c1503d0 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c1514b0 con 0x7f421c1503d0 2023-11-04T01:40:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c1519d0 con 0x7f421c1503d0 2023-11-04T01:40:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c0744a0 con 0x7f421c1503d0 2023-11-04T01:40:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42140a5560 con 0x7f421c1503d0 2023-11-04T01:40:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4218ff9640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42080664d0 0x7f4208068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f421411d8a0 con 0x7f421c1503d0 2023-11-04T01:40:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.467+0000 7f421bfff640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42080664d0 0x7f4208068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.471+0000 7f421bfff640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42080664d0 0x7f4208068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f420c000c10 tx=0x7f420c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.471+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42140eac10 con 0x7f421c1503d0 2023-11-04T01:40:44.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.639+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f421c071cb0 con 0x7f421c1503d0 2023-11-04T01:40:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4218ff9640 1 -- 172.21.15.40:0/3172200681 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f421411d020 con 0x7f421c1503d0 2023-11-04T01:40:44.646 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42080664d0 msgr2=0x7f4208068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42080664d0 0x7f4208068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f420c000c10 tx=0x7f420c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 msgr2=0x7f421c0c1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 0x7f421c0c1450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f421400a030 tx=0x7f4204005800 comp rx=0 tx=0).stop 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 shutdown_connections 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42080664d0 0x7f4208068990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f421c1503d0 0x7f421c0c1450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f421c14ff50 0x7f421c0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 --2- 172.21.15.40:0/3172200681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42040050f0 0x7f421c14b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 >> 172.21.15.40:0/3172200681 conn(0x7f421c0cebb0 msgr2=0x7f421c15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 shutdown_connections 2023-11-04T01:40:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.643+0000 7f4222875640 1 -- 172.21.15.40:0/3172200681 wait complete. 2023-11-04T01:40:44.666 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:40:44.666 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:44.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:44.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[45819]: fuse finished with error 0 and tester_r 0 2023-11-04T01:40:44.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:44.719 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:44.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:2023-11-04T01:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:44.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:40:44.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:44.729 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:40:44.775 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:40:44.775 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:44.781 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:40:44.782 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:44.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:44.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi091.stderr:2023-11-04T01:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 Processor -- start 2023-11-04T01:40:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 -- start start 2023-11-04T01:40:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f15100b4990 0x7f15100b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 0x7f15100cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15100b6070 con 0x7f15100d0690 2023-11-04T01:40:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15100b8ed0 con 0x7f15100b4990 2023-11-04T01:40:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f15178f3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15100b52b0 con 0x7f15100b74f0 2023-11-04T01:40:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1514e8e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f15100d0690 0x7f15100cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45482/0 (socket says 172.21.15.40:45482) 2023-11-04T01:40:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1514e8e640 1 -- 172.21.15.40:0/681603038 learned_addr learned my addr 172.21.15.40:0/681603038 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 --2- 172.21.15.40:0/681603038 >> v2:172.21.15.91:3300/0 conn(0x7f15100b4990 0x7f15100b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1515e90640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 0x7f15100cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567738519 0 0) 0x7f15100b6070 con 0x7f15100d0690 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14fc003530 con 0x7f15100d0690 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2636307480 0 0) 0x7f14fc003530 con 0x7f15100d0690 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 msgr2=0x7f15100cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 0x7f15100cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 >> v2:172.21.15.91:3300/0 conn(0x7f15100b4990 msgr2=0x7f15100b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 --2- 172.21.15.40:0/681603038 >> v2:172.21.15.91:3300/0 conn(0x7f15100b4990 0x7f15100b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15100d1ce0 con 0x7f15100d0690 2023-11-04T01:40:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1500001680 con 0x7f15100d0690 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 >> v1:172.21.15.40:6789/0 conn(0x7f15100d0690 legacy=0x7f15100cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14fc003980 0x7f14fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 0x7f14fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14fc004d10 0x7f14fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100b8ed0 con 0x7f14fc003980 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100b52b0 con 0x7f14fc004d10 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc00ba10 con 0x7f15100b74f0 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14fc003980 0x7f14fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1514e8e640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 0x7f14fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1515e90640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14fc004d10 0x7f14fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 -- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 msgr2=0x7f14fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15100b74f0 0x7f14fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 -- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14fc004d10 msgr2=0x7f14fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14fc004d10 0x7f14fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f151568f640 1 -- 172.21.15.40:0/681603038 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc003530 con 0x7f14fc003980 2023-11-04T01:40:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.947+0000 7f1515e90640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14fc004d10 0x7f14fc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f151568f640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14fc003980 0x7f14fc003da0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f150c009ae0 tx=0x7f150c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc327e64bd4a0d06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0a5680 con 0x7f14fc003980 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c0a57e0 con 0x7f14fc003980 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f1507fff640 1 -- 172.21.15.40:0/681603038 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c0a5b90 con 0x7f14fc003980 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 -- 172.21.15.40:0/681603038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14fc003980 msgr2=0x7f14fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 --2- 172.21.15.40:0/681603038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14fc003980 0x7f14fc003da0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f150c009ae0 tx=0x7f150c01ca90 comp rx=0 tx=0).stop 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f1515e90640 1 -- 172.21.15.40:0/681603038 reap_dead start 2023-11-04T01:40:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 -- 172.21.15.40:0/681603038 shutdown_connections 2023-11-04T01:40:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 -- 172.21.15.40:0/681603038 >> 172.21.15.40:0/681603038 conn(0x7f15100cf990 msgr2=0x7f15100cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 -- 172.21.15.40:0/681603038 shutdown_connections 2023-11-04T01:40:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 -- 172.21.15.40:0/681603038 wait complete. 2023-11-04T01:40:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 Processor -- start 2023-11-04T01:40:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.951+0000 7f15178f3640 1 -- start start 2023-11-04T01:40:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1510148eb0 0x7f151015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f151015e650 0x7f15101f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 0x7f15100a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151015f790 con 0x7f15100a9900 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100aa2f0 con 0x7f151015e650 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151014f590 con 0x7f1510148eb0 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 0x7f15100a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 0x7f15100a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47590/0 (socket says 172.21.15.40:47590) 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 -- 172.21.15.40:0/1076892883 learned_addr learned my addr 172.21.15.40:0/1076892883 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f151568f640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1510148eb0 0x7f151015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1514e8e640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f151015e650 0x7f15101f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 -- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1510148eb0 msgr2=0x7f151015fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1510148eb0 0x7f151015fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 -- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f151015e650 msgr2=0x7f15101f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f151015e650 0x7f15101f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:44.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 -- 172.21.15.40:0/1076892883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15101f6d50 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1515e90640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 0x7f15100a9db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f15100cf650 tx=0x7f150800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800fe90 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508011040 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151015eb10 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508017640 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151015f0d0 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151015f8d0 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15080203b0 con 0x7f15100a9900 2023-11-04T01:40:44.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1505ffb640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14f40664d0 0x7f14f4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1508084460 con 0x7f15100a9900 2023-11-04T01:40:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.955+0000 7f151568f640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14f40664d0 0x7f14f4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:44.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.959+0000 7f151568f640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14f40664d0 0x7f14f4068990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f150c0af000 tx=0x7f150c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:44.959+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1508051950 con 0x7f15100a9900 2023-11-04T01:40:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.119+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15100744a0 con 0x7f15100a9900 2023-11-04T01:40:45.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f1505ffb640 1 -- 172.21.15.40:0/1076892883 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f1508054f70 con 0x7f15100a9900 2023-11-04T01:40:45.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:45.127 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:45.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14f40664d0 msgr2=0x7f14f4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14f40664d0 0x7f14f4068990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f150c0af000 tx=0x7f150c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 msgr2=0x7f15100a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 0x7f15100a9db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f15100cf650 tx=0x7f150800f4a0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 shutdown_connections 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14f40664d0 0x7f14f4068990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15100a9900 0x7f15100a9db0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f151015e650 0x7f15101f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 --2- 172.21.15.40:0/1076892883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1510148eb0 0x7f151015fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 >> 172.21.15.40:0/1076892883 conn(0x7f15100cf990 msgr2=0x7f15100d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 shutdown_connections 2023-11-04T01:40:45.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.123+0000 7f15178f3640 1 -- 172.21.15.40:0/1076892883 wait complete. 2023-11-04T01:40:45.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:45.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:45.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 Processor -- start 2023-11-04T01:40:45.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 -- start start 2023-11-04T01:40:45.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94065dc0 0x7fde9406b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde940ceb70 0x7fde94160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9406b7c0 con 0x7fde94160790 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde94160b70 con 0x7fde940ceb70 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde9a844640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde94066240 con 0x7fde94065dc0 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde940ceb70 0x7fde94160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde940ceb70 0x7fde94160d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47596/0 (socket says 172.21.15.40:47596) 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 -- 172.21.15.40:0/1229393094 learned_addr learned my addr 172.21.15.40:0/1229393094 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde937fe640 1 --2- 172.21.15.40:0/1229393094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94065dc0 0x7fde9406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 -- 172.21.15.40:0/1229393094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94065dc0 msgr2=0x7fde9406b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 --2- 172.21.15.40:0/1229393094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94065dc0 0x7fde9406b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 -- 172.21.15.40:0/1229393094 >> v1:172.21.15.91:6789/0 conn(0x7fde94160790 legacy=0x7fde9406ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.271+0000 7fde98de1640 1 -- 172.21.15.40:0/1229393094 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940ca010 con 0x7fde940ceb70 2023-11-04T01:40:45.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde98de1640 1 --2- 172.21.15.40:0/1229393094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde940ceb70 0x7fde94160d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fde84009870 tx=0x7fde8401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ffdea076e64850 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde92ffd640 1 -- 172.21.15.40:0/1229393094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840ab600 con 0x7fde940ceb70 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde92ffd640 1 -- 172.21.15.40:0/1229393094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde840a7050 con 0x7fde940ceb70 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde92ffd640 1 -- 172.21.15.40:0/1229393094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840ab980 con 0x7fde940ceb70 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 -- 172.21.15.40:0/1229393094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde940ceb70 msgr2=0x7fde94160d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 --2- 172.21.15.40:0/1229393094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde940ceb70 0x7fde94160d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fde84009870 tx=0x7fde8401c280 comp rx=0 tx=0).stop 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 -- 172.21.15.40:0/1229393094 shutdown_connections 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 --2- 172.21.15.40:0/1229393094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde940ceb70 0x7fde94160d40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 --2- 172.21.15.40:0/1229393094 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94065dc0 0x7fde9406b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 -- 172.21.15.40:0/1229393094 >> 172.21.15.40:0/1229393094 conn(0x7fde940b0e30 msgr2=0x7fde940b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 -- 172.21.15.40:0/1229393094 shutdown_connections 2023-11-04T01:40:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 -- 172.21.15.40:0/1229393094 wait complete. 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 Processor -- start 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.275+0000 7fde9a844640 1 -- start start 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 0x7fde940c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde940ceb70 0x7fde94155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94160790 0x7fde94157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94156cc0 con 0x7fde94065dc0 2023-11-04T01:40:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94156420 con 0x7fde940ceb70 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde94156700 con 0x7fde94160790 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 0x7fde940c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 0x7fde940c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47612/0 (socket says 172.21.15.40:47612) 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 -- 172.21.15.40:0/1255333540 learned_addr learned my addr 172.21.15.40:0/1255333540 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde98de1640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94160790 0x7fde94157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde937fe640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde940ceb70 0x7fde94155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 -- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94160790 msgr2=0x7fde94157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94160790 0x7fde94157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 -- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde940ceb70 msgr2=0x7fde94155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde940ceb70 0x7fde94155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 -- 172.21.15.40:0/1255333540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840094d0 con 0x7fde94065dc0 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde93fff640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 0x7fde940c8f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c500 tx=0x7fde8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c005220 con 0x7fde94065dc0 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c005380 con 0x7fde94065dc0 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c007270 con 0x7fde94065dc0 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde941569e0 con 0x7fde94065dc0 2023-11-04T01:40:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde94155ac0 con 0x7fde94065dc0 2023-11-04T01:40:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde941546b0 con 0x7fde94065dc0 2023-11-04T01:40:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde8c0073d0 con 0x7fde94065dc0 2023-11-04T01:40:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde90ff9640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fde780664a0 0x7fde78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fde8c083620 con 0x7fde94065dc0 2023-11-04T01:40:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.279+0000 7fde937fe640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fde780664a0 0x7fde78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.283+0000 7fde937fe640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fde780664a0 0x7fde78068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde7c003fd0 tx=0x7fde7c0039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.283+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde941546b0 con 0x7fde94065dc0 2023-11-04T01:40:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.439+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde9406b7c0 con 0x7fde94065dc0 2023-11-04T01:40:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.439+0000 7fde90ff9640 1 -- 172.21.15.40:0/1255333540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde9406b7c0 con 0x7fde94065dc0 2023-11-04T01:40:45.445 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fde780664a0 msgr2=0x7fde78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fde780664a0 0x7fde78068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde7c003fd0 tx=0x7fde7c0039a0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 msgr2=0x7fde940c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 0x7fde940c8f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c500 tx=0x7fde8c00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 shutdown_connections 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fde780664a0 0x7fde78068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fde94160790 0x7fde94157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fde940ceb70 0x7fde94155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 --2- 172.21.15.40:0/1255333540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde94065dc0 0x7fde940c8f30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 >> 172.21.15.40:0/1255333540 conn(0x7fde940b0e30 msgr2=0x7fde940af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 shutdown_connections 2023-11-04T01:40:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.443+0000 7fde9a844640 1 -- 172.21.15.40:0/1255333540 wait complete. 2023-11-04T01:40:45.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 Processor -- start 2023-11-04T01:40:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 -- start start 2023-11-04T01:40:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a880b0c20 0x7f2a8815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 0x7f2a880ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a880cb130 con 0x7f2a8815acb0 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8815bd40 con 0x7f2a880b0c20 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a90031640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8806fd80 con 0x7f2a8815c160 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8ddcd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a8815acb0 0x7f2a880b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45484/0 (socket says 172.21.15.40:45484) 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8ddcd640 1 -- 172.21.15.40:0/2588284147 learned_addr learned my addr 172.21.15.40:0/2588284147 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 0x7f2a880ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8d5cc640 1 --2- 172.21.15.40:0/2588284147 >> v2:172.21.15.91:3300/0 conn(0x7f2a880b0c20 0x7f2a8815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904821290 0 0) 0x7f2a880cb130 con 0x7f2a8815acb0 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a74003530 con 0x7f2a8815acb0 2023-11-04T01:40:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451942494 0 0) 0x7f2a74003530 con 0x7f2a8815acb0 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 msgr2=0x7f2a880ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 0x7f2a880ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 >> v2:172.21.15.91:3300/0 conn(0x7f2a880b0c20 msgr2=0x7f2a8815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 --2- 172.21.15.40:0/2588284147 >> v2:172.21.15.91:3300/0 conn(0x7f2a880b0c20 0x7f2a8815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8815b680 con 0x7f2a8815acb0 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f2a84001a00 con 0x7f2a8815acb0 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 >> v1:172.21.15.40:6789/0 conn(0x7f2a8815acb0 legacy=0x7f2a880b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 0x7f2a74003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a74003f00 0x7f2a740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a74004d10 0x7f2a74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8815bd40 con 0x7f2a74004d10 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7400b990 con 0x7f2a74003f00 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7400bad0 con 0x7f2a8815c160 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a74004d10 0x7f2a74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8ddcd640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 0x7f2a74003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8d5cc640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a74003f00 0x7f2a740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 -- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 msgr2=0x7f2a74003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8815c160 0x7f2a74003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 -- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a74003f00 msgr2=0x7f2a740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a74003f00 0x7f2a740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.591+0000 7f2a8e5ce640 1 -- 172.21.15.40:0/2588284147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74003530 con 0x7f2a74004d10 2023-11-04T01:40:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a8e5ce640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a74004d10 0x7f2a74005190 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009ae0 tx=0x7f2a8001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a3e54147b12563 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800a5640 con 0x7f2a74004d10 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a800a57a0 con 0x7f2a74004d10 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a8cdcb640 1 -- 172.21.15.40:0/2588284147 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800a5b50 con 0x7f2a74004d10 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 -- 172.21.15.40:0/2588284147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a74004d10 msgr2=0x7f2a74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 --2- 172.21.15.40:0/2588284147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a74004d10 0x7f2a74005190 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009ae0 tx=0x7f2a8001c9f0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a8e5ce640 1 -- 172.21.15.40:0/2588284147 reap_dead start 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 -- 172.21.15.40:0/2588284147 shutdown_connections 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 -- 172.21.15.40:0/2588284147 >> 172.21.15.40:0/2588284147 conn(0x7f2a880cb510 msgr2=0x7f2a880cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 -- 172.21.15.40:0/2588284147 shutdown_connections 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 -- 172.21.15.40:0/2588284147 wait complete. 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 Processor -- start 2023-11-04T01:40:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.595+0000 7f2a90031640 1 -- start start 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 0x7f2a880acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a8814be80 0x7f2a880aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8814c300 0x7f2a880ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880ae030 con 0x7f2a8814baa0 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881f0430 con 0x7f2a8814be80 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880ad420 con 0x7f2a8814c300 2023-11-04T01:40:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 0x7f2a880acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 0x7f2a880acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47630/0 (socket says 172.21.15.40:47630) 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 -- 172.21.15.40:0/1201336237 learned_addr learned my addr 172.21.15.40:0/1201336237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8d5cc640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a8814be80 0x7f2a880aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8e5ce640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8814c300 0x7f2a880ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 -- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8814c300 msgr2=0x7f2a880ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8814c300 0x7f2a880ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 -- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a8814be80 msgr2=0x7f2a880aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a8814be80 0x7f2a880aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 -- 172.21.15.40:0/1201336237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880ad700 con 0x7f2a8814baa0 2023-11-04T01:40:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8d5cc640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a8814be80 0x7f2a880aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8ddcd640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 0x7f2a880acd80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2a84002240 tx=0x7f2a8400e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84013610 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a84013790 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84013b40 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a880ad9e0 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a881f3b90 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a880744a0 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a84013ca0 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a7a7fc640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a6c0664a0 0x7f2a6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2a840848d0 con 0x7f2a8814baa0 2023-11-04T01:40:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.599+0000 7f2a8d5cc640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a6c0664a0 0x7f2a6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.603+0000 7f2a8d5cc640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a6c0664a0 0x7f2a6c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a8814fb90 tx=0x7f2a7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.607+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a84051cd0 con 0x7f2a8814baa0 2023-11-04T01:40:45.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a88159660 con 0x7f2a8814baa0 2023-11-04T01:40:45.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/1201336237 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a84017020 con 0x7f2a8814baa0 2023-11-04T01:40:45.763 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a6c0664a0 msgr2=0x7f2a6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a6c0664a0 0x7f2a6c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a8814fb90 tx=0x7f2a7c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 msgr2=0x7f2a880acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 0x7f2a880acd80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2a84002240 tx=0x7f2a8400e910 comp rx=0 tx=0).stop 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 shutdown_connections 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a6c0664a0 0x7f2a6c068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a8814c300 0x7f2a880ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a8814be80 0x7f2a880aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 --2- 172.21.15.40:0/1201336237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8814baa0 0x7f2a880acd80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 >> 172.21.15.40:0/1201336237 conn(0x7f2a880cb510 msgr2=0x7f2a8815cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 shutdown_connections 2023-11-04T01:40:45.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.759+0000 7f2a90031640 1 -- 172.21.15.40:0/1201336237 wait complete. 2023-11-04T01:40:45.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 Processor -- start 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 -- start start 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f487415aff0 0x7f48740cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4874070270 0x7f48740c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740ca330 con 0x7f48740c9ed0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487406a290 con 0x7f487415aff0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f487a540640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740cbba0 con 0x7f4874070270 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f487415aff0 0x7f48740cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f487415aff0 0x7f48740cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47644/0 (socket says 172.21.15.40:47644) 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 -- 172.21.15.40:0/3427063311 learned_addr learned my addr 172.21.15.40:0/3427063311 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4878add640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f48740c9ed0 0x7f487415ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45492/0 (socket says 172.21.15.40:45492) 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f48737fe640 1 --2- 172.21.15.40:0/3427063311 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4874070270 0x7f48740c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4872ffd640 1 -- 172.21.15.40:0/3427063311 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715030952 0 0) 0x7f48740ca330 con 0x7f48740c9ed0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4872ffd640 1 -- 172.21.15.40:0/3427063311 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f485c003530 con 0x7f48740c9ed0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 -- 172.21.15.40:0/3427063311 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4874070270 msgr2=0x7f48740c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 --2- 172.21.15.40:0/3427063311 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4874070270 0x7f48740c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 -- 172.21.15.40:0/3427063311 >> v1:172.21.15.40:6789/0 conn(0x7f48740c9ed0 legacy=0x7f487415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.903+0000 7f4873fff640 1 -- 172.21.15.40:0/3427063311 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874071e90 con 0x7f487415aff0 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 --2- 172.21.15.40:0/3427063311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487415aff0 0x7f48740cb5c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4864009e50 tx=0x7f486401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4181c416570755b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4872ffd640 1 -- 172.21.15.40:0/3427063311 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640af400 con 0x7f487415aff0 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4872ffd640 1 -- 172.21.15.40:0/3427063311 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48640ab050 con 0x7f487415aff0 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4872ffd640 1 -- 172.21.15.40:0/3427063311 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640af760 con 0x7f487415aff0 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- 172.21.15.40:0/3427063311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487415aff0 msgr2=0x7f48740cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 --2- 172.21.15.40:0/3427063311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487415aff0 0x7f48740cb5c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4864009e50 tx=0x7f486401f1f0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- 172.21.15.40:0/3427063311 shutdown_connections 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 --2- 172.21.15.40:0/3427063311 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4874070270 0x7f48740c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 --2- 172.21.15.40:0/3427063311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487415aff0 0x7f48740cb5c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- 172.21.15.40:0/3427063311 >> 172.21.15.40:0/3427063311 conn(0x7f48740b0e30 msgr2=0x7f48740b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- 172.21.15.40:0/3427063311 shutdown_connections 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- 172.21.15.40:0/3427063311 wait complete. 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 Processor -- start 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- start start 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 0x7f48740c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48740c9ed0 0x7f48740c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487415aff0 0x7f4874153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741524d0 con 0x7f4874070270 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741527b0 con 0x7f48740c9ed0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f487a540640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4874152a90 con 0x7f487415aff0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 0x7f48740c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 0x7f48740c1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47654/0 (socket says 172.21.15.40:47654) 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 -- 172.21.15.40:0/2199273212 learned_addr learned my addr 172.21.15.40:0/2199273212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4878add640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487415aff0 0x7f4874153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f48737fe640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48740c9ed0 0x7f48740c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 -- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487415aff0 msgr2=0x7f4874153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487415aff0 0x7f4874153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 -- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48740c9ed0 msgr2=0x7f48740c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.907+0000 7f4873fff640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48740c9ed0 0x7f48740c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4873fff640 1 -- 172.21.15.40:0/2199273212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009b30 con 0x7f4874070270 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4873fff640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 0x7f48740c1040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f486401ce20 tx=0x7f486401bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640afd90 con 0x7f4874070270 2023-11-04T01:40:45.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864009510 con 0x7f4874070270 2023-11-04T01:40:45.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4874152d70 con 0x7f4874070270 2023-11-04T01:40:45.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640b9610 con 0x7f4874070270 2023-11-04T01:40:45.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48740c1580 con 0x7f4874070270 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874153290 con 0x7f4874070270 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48640b6070 con 0x7f4874070270 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4870ff9640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f48600664a0 0x7f4860068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f48641214f0 con 0x7f4874070270 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f48737fe640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f48600664a0 0x7f4860068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.911+0000 7f48737fe640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f48600664a0 0x7f4860068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4874157c20 tx=0x7f4868008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:45.915+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4874153290 con 0x7f4874070270 2023-11-04T01:40:46.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.063+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4874153290 con 0x7f4874070270 2023-11-04T01:40:46.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f4870ff9640 1 -- 172.21.15.40:0/2199273212 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48640ee8f0 con 0x7f4874070270 2023-11-04T01:40:46.070 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f48600664a0 msgr2=0x7f4860068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f48600664a0 0x7f4860068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4874157c20 tx=0x7f4868008040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 msgr2=0x7f48740c1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 0x7f48740c1040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f486401ce20 tx=0x7f486401bf90 comp rx=0 tx=0).stop 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 shutdown_connections 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f48600664a0 0x7f4860068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487415aff0 0x7f4874153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48740c9ed0 0x7f48740c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 --2- 172.21.15.40:0/2199273212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4874070270 0x7f48740c1040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 >> 172.21.15.40:0/2199273212 conn(0x7f48740b0e30 msgr2=0x7f48740c9650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 shutdown_connections 2023-11-04T01:40:46.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.067+0000 7f487a540640 1 -- 172.21.15.40:0/2199273212 wait complete. 2023-11-04T01:40:46.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.207+0000 7fbbf8e7e640 1 Processor -- start 2023-11-04T01:40:46.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.207+0000 7fbbf8e7e640 1 -- start start 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.207+0000 7fbbf8e7e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbbf40b4990 0x7fbbf40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.207+0000 7fbbf8e7e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40b6070 con 0x7fbbf40d0690 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.207+0000 7fbbf8e7e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40b8ed0 con 0x7fbbf40b74f0 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.207+0000 7fbbf8e7e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40ce590 con 0x7fbbf40b4990 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbe9d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbbf40d0690 0x7fbbf40cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45500/0 (socket says 172.21.15.40:45500) 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbe9d9b640 1 -- 172.21.15.40:0/96823343 learned_addr learned my addr 172.21.15.40:0/96823343 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf259c640 1 --2- 172.21.15.40:0/96823343 >> v2:172.21.15.91:3300/0 conn(0x7fbbf40b4990 0x7fbbf40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523512699 0 0) 0x7fbbf40b6070 con 0x7fbbf40d0690 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe0003530 con 0x7fbbf40d0690 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057038393 0 0) 0x7fbbe0003530 con 0x7fbbf40d0690 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 >> v2:172.21.15.91:3300/0 conn(0x7fbbf40b4990 msgr2=0x7fbbf40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 --2- 172.21.15.40:0/96823343 >> v2:172.21.15.91:3300/0 conn(0x7fbbf40b4990 0x7fbbf40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 >> v1:172.21.15.91:6789/0 conn(0x7fbbf40b74f0 legacy=0x7fbbf40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40b52b0 con 0x7fbbf40d0690 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fbbdc001680 con 0x7fbbf40d0690 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 >> v1:172.21.15.40:6789/0 conn(0x7fbbf40d0690 legacy=0x7fbbf40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0003980 0x7fbbe0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe00047d0 0x7fbbe0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe0005190 0x7fbbe000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40ce590 con 0x7fbbe0005190 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe000c040 con 0x7fbbe0003980 2023-11-04T01:40:46.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe000c200 con 0x7fbbe00047d0 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe0005190 0x7fbbe000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbe9d9b640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe00047d0 0x7fbbe0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf259c640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0003980 0x7fbbe0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 -- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe00047d0 msgr2=0x7fbbe0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe00047d0 0x7fbbe0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 -- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0003980 msgr2=0x7fbbe0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0003980 0x7fbbe0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 -- 172.21.15.40:0/96823343 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0003530 con 0x7fbbe0005190 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 -- 172.21.15.40:0/96823343 reap_dead start 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf2d9d640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe0005190 0x7fbbe000b990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbbec001e40 tx=0x7fbbec01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae60563fb401826 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec003b80 con 0x7fbbe0005190 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec003ce0 con 0x7fbbe0005190 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.211+0000 7fbbf1d9b640 1 -- 172.21.15.40:0/96823343 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec005260 con 0x7fbbe0005190 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/96823343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe0005190 msgr2=0x7fbbe000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe0005190 0x7fbbe000b990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbbec001e40 tx=0x7fbbec01c740 comp rx=0 tx=0).stop 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/96823343 shutdown_connections 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/96823343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe0005190 0x7fbbe000b990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/96823343 >> 172.21.15.40:0/96823343 conn(0x7fbbf40cf990 msgr2=0x7fbbf40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/96823343 shutdown_connections 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/96823343 wait complete. 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 Processor -- start 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- start start 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0005190 0x7fbbf40c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 0x7fbbf4159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbf415a2a0 0x7fbbf415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf415a7f0 con 0x7fbbf40a9b70 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40cb790 con 0x7fbbe0005190 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40ca650 con 0x7fbbf415a2a0 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 0x7fbbf4159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 0x7fbbf4159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47672/0 (socket says 172.21.15.40:47672) 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 -- 172.21.15.40:0/3805995086 learned_addr learned my addr 172.21.15.40:0/3805995086 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf2d9d640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbf415a2a0 0x7fbbf415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf259c640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0005190 0x7fbbf40c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 -- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbf415a2a0 msgr2=0x7fbbf415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbf415a2a0 0x7fbbf415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 -- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0005190 msgr2=0x7fbbf40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0005190 0x7fbbf40c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 -- 172.21.15.40:0/3805995086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40ca930 con 0x7fbbf40a9b70 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf2d9d640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbf415a2a0 0x7fbbf415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbe9d9b640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 0x7fbbf4159d60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc001210 tx=0x7fbbdc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00ee60 con 0x7fbbf40a9b70 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00c8d0 con 0x7fbbf40a9b70 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf40cac10 con 0x7fbbf40a9b70 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00cc60 con 0x7fbbf40a9b70 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.215+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf40a9ff0 con 0x7fbbf40a9b70 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.219+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40744a0 con 0x7fbbf40a9b70 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.219+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbdc01d460 con 0x7fbbf40a9b70 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.219+0000 7fbbeb7fe640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbd40664a0 0x7fbbd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.219+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbbdc083e00 con 0x7fbbf40a9b70 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.219+0000 7fbbf259c640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbd40664a0 0x7fbbd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.219+0000 7fbbf259c640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbd40664a0 0x7fbbd4068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40098f0 tx=0x7fbbe4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.223+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbdc051290 con 0x7fbbf40a9b70 2023-11-04T01:40:46.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbf40cd320 con 0x7fbbf40a9b70 2023-11-04T01:40:46.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbeb7fe640 1 -- 172.21.15.40:0/3805995086 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbdc0548b0 con 0x7fbbf40a9b70 2023-11-04T01:40:46.395 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:46.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbd40664a0 msgr2=0x7fbbd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbd40664a0 0x7fbbd4068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40098f0 tx=0x7fbbe4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 msgr2=0x7fbbf4159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 0x7fbbf4159d60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc001210 tx=0x7fbbdc00ec10 comp rx=0 tx=0).stop 2023-11-04T01:40:46.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 shutdown_connections 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbd40664a0 0x7fbbd4068960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbf415a2a0 0x7fbbf415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbf40a9b70 0x7fbbf4159d60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 --2- 172.21.15.40:0/3805995086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe0005190 0x7fbbf40c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 >> 172.21.15.40:0/3805995086 conn(0x7fbbf40cf990 msgr2=0x7fbbf40d0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 shutdown_connections 2023-11-04T01:40:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.391+0000 7fbbf8e7e640 1 -- 172.21.15.40:0/3805995086 wait complete. 2023-11-04T01:40:46.413 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:40:46.413 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:46.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 Processor -- start 2023-11-04T01:40:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 -- start start 2023-11-04T01:40:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa07415d690 0x7fa07406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa0740b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740cd400 con 0x7fa07415d2b0 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740ad450 con 0x7fa07415d690 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa07a4a0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0740cd6e0 con 0x7fa07406f8f0 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa07415d690 0x7fa07406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa07415d690 0x7fa07406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47678/0 (socket says 172.21.15.40:47678) 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 -- 172.21.15.40:0/3043711389 learned_addr learned my addr 172.21.15.40:0/3043711389 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa078a3d640 1 --2- 172.21.15.40:0/3043711389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa0740b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 -- 172.21.15.40:0/3043711389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 msgr2=0x7fa0740b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 --2- 172.21.15.40:0/3043711389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa0740b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 -- 172.21.15.40:0/3043711389 >> v1:172.21.15.91:6789/0 conn(0x7fa07415d2b0 legacy=0x7fa0740ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 -- 172.21.15.40:0/3043711389 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740ad070 con 0x7fa07415d690 2023-11-04T01:40:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.527+0000 7fa0737fe640 1 --2- 172.21.15.40:0/3043711389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d690 0x7fa07406c630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa07406b120 tx=0x7fa06801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8b8453e50bfdaf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa072ffd640 1 -- 172.21.15.40:0/3043711389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ab600 con 0x7fa07415d690 2023-11-04T01:40:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa072ffd640 1 -- 172.21.15.40:0/3043711389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680a7050 con 0x7fa07415d690 2023-11-04T01:40:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa072ffd640 1 -- 172.21.15.40:0/3043711389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ab980 con 0x7fa07415d690 2023-11-04T01:40:46.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/3043711389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d690 msgr2=0x7fa07406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/3043711389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d690 0x7fa07406c630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa07406b120 tx=0x7fa06801c450 comp rx=0 tx=0).stop 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/3043711389 shutdown_connections 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/3043711389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa0740b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/3043711389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d690 0x7fa07406c630 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/3043711389 >> 172.21.15.40:0/3043711389 conn(0x7fa0740cebb0 msgr2=0x7fa0740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/3043711389 shutdown_connections 2023-11-04T01:40:46.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/3043711389 wait complete. 2023-11-04T01:40:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 Processor -- start 2023-11-04T01:40:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- start start 2023-11-04T01:40:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa074151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 0x7fa0740c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa07415d690 0x7fa074151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0741519b0 con 0x7fa07415d2b0 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074159350 con 0x7fa07415d690 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa074159630 con 0x7fa07406f8f0 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 0x7fa0740c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 0x7fa0740c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47680/0 (socket says 172.21.15.40:47680) 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 -- 172.21.15.40:0/2524501478 learned_addr learned my addr 172.21.15.40:0/2524501478 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa073fff640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa074151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa078a3d640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa07415d690 0x7fa074151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 -- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 msgr2=0x7fa074151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa074151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 -- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa07415d690 msgr2=0x7fa074151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa07415d690 0x7fa074151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 -- 172.21.15.40:0/2524501478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680094d0 con 0x7fa07415d2b0 2023-11-04T01:40:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa0737fe640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 0x7fa0740c5e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa0680ae040 tx=0x7fa0680191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b4640 con 0x7fa07415d2b0 2023-11-04T01:40:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680b47a0 con 0x7fa07415d2b0 2023-11-04T01:40:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07406fee0 con 0x7fa07415d2b0 2023-11-04T01:40:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0680b4b50 con 0x7fa07415d2b0 2023-11-04T01:40:46.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.531+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa074159bf0 con 0x7fa07415d2b0 2023-11-04T01:40:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.535+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0740744a0 con 0x7fa07415d2b0 2023-11-04T01:40:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.535+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0680b2070 con 0x7fa07415d2b0 2023-11-04T01:40:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.535+0000 7fa070ff9640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0600664a0 0x7fa060068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.535+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa06811df80 con 0x7fa07415d2b0 2023-11-04T01:40:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.535+0000 7fa073fff640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0600664a0 0x7fa060068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.535+0000 7fa073fff640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0600664a0 0x7fa060068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0640016c0 tx=0x7fa064009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.539+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0680eb370 con 0x7fa07415d2b0 2023-11-04T01:40:46.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.695+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa074159770 con 0x7fa07415d2b0 2023-11-04T01:40:46.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.699+0000 7fa070ff9640 1 -- 172.21.15.40:0/2524501478 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fa074159770 con 0x7fa07415d2b0 2023-11-04T01:40:46.704 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:46.704 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0600664a0 msgr2=0x7fa060068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0600664a0 0x7fa060068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0640016c0 tx=0x7fa064009040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 msgr2=0x7fa0740c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 0x7fa0740c5e50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa0680ae040 tx=0x7fa0680191f0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 shutdown_connections 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0600664a0 0x7fa060068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa07415d690 0x7fa074151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07415d2b0 0x7fa0740c5e50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 --2- 172.21.15.40:0/2524501478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa07406f8f0 0x7fa074151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 >> 172.21.15.40:0/2524501478 conn(0x7fa0740cebb0 msgr2=0x7fa074157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 shutdown_connections 2023-11-04T01:40:46.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.703+0000 7fa07a4a0640 1 -- 172.21.15.40:0/2524501478 wait complete. 2023-11-04T01:40:46.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:46.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.839+0000 7f03f76ff640 1 Processor -- start 2023-11-04T01:40:46.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.839+0000 7f03f76ff640 1 -- start start 2023-11-04T01:40:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f76ff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f76ff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03f00cf4c0 0x7f03f00d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f76ff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00cd830 con 0x7f03f00b32f0 2023-11-04T01:40:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f76ff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00b3780 con 0x7f03f00cf4c0 2023-11-04T01:40:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f76ff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00cdad0 con 0x7f03f015af50 2023-11-04T01:40:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03f00cf4c0 0x7f03f00d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03f00cf4c0 0x7f03f00d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47696/0 (socket says 172.21.15.40:47696) 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 -- 172.21.15.40:0/3156312458 learned_addr learned my addr 172.21.15.40:0/3156312458 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f4c9a640 1 --1- 172.21.15.40:0/3156312458 >> v1:172.21.15.40:6789/0 conn(0x7f03f00b32f0 0x7f03f00ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45510/0 (socket says 172.21.15.40:45510) 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f549b640 1 --2- 172.21.15.40:0/3156312458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 -- 172.21.15.40:0/3156312458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 msgr2=0x7f03f00cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 --2- 172.21.15.40:0/3156312458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f00cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 -- 172.21.15.40:0/3156312458 >> v1:172.21.15.40:6789/0 conn(0x7f03f00b32f0 legacy=0x7f03f00ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 -- 172.21.15.40:0/3156312458 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00cddb0 con 0x7f03f00cf4c0 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03f5c9c640 1 --2- 172.21.15.40:0/3156312458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f00cf4c0 0x7f03f00d0610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009e50 tx=0x7f03e801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd013a344341f02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03e7fff640 1 -- 172.21.15.40:0/3156312458 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80a5860 con 0x7f03f00cf4c0 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03e7fff640 1 -- 172.21.15.40:0/3156312458 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80a59c0 con 0x7f03f00cf4c0 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.843+0000 7f03e7fff640 1 -- 172.21.15.40:0/3156312458 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80a5d50 con 0x7f03f00cf4c0 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/3156312458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f00cf4c0 msgr2=0x7f03f00d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 --2- 172.21.15.40:0/3156312458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f00cf4c0 0x7f03f00d0610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009e50 tx=0x7f03e801c980 comp rx=0 tx=0).stop 2023-11-04T01:40:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/3156312458 shutdown_connections 2023-11-04T01:40:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 --2- 172.21.15.40:0/3156312458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f00cf4c0 0x7f03f00d0610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 --2- 172.21.15.40:0/3156312458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f00cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/3156312458 >> 172.21.15.40:0/3156312458 conn(0x7f03f0065dc0 msgr2=0x7f03f00661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/3156312458 shutdown_connections 2023-11-04T01:40:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/3156312458 wait complete. 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 Processor -- start 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- start start 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f00cf4c0 0x7f03f0152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 0x7f03f0163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01529c0 con 0x7f03f01535e0 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f006c4d0 con 0x7f03f00cf4c0 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f006c7b0 con 0x7f03f015af50 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 0x7f03f0163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 0x7f03f0163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47704/0 (socket says 172.21.15.40:47704) 2023-11-04T01:40:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 -- 172.21.15.40:0/1472319360 learned_addr learned my addr 172.21.15.40:0/1472319360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 -- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 msgr2=0x7f03f006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 -- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f00cf4c0 msgr2=0x7f03f0152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f549b640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f00cf4c0 0x7f03f0152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f00cf4c0 0x7f03f0152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 -- 172.21.15.40:0/1472319360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009b30 con 0x7f03f01535e0 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f5c9c640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 0x7f03f0163f10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03e80af040 tx=0x7f03e8019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80b8470 con 0x7f03f01535e0 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80b85d0 con 0x7f03f01535e0 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f006ca90 con 0x7f03f01535e0 2023-11-04T01:40:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80b8980 con 0x7f03f01535e0 2023-11-04T01:40:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.847+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f006d050 con 0x7f03f01535e0 2023-11-04T01:40:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.851+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f006d240 con 0x7f03f01535e0 2023-11-04T01:40:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.851+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03e80b8ae0 con 0x7f03f01535e0 2023-11-04T01:40:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.851+0000 7f03e5ffb640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03d40664d0 0x7f03d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.851+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f03e811f2b0 con 0x7f03f01535e0 2023-11-04T01:40:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.851+0000 7f03f549b640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03d40664d0 0x7f03d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.851+0000 7f03f549b640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03d40664d0 0x7f03d4068990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fd0 tx=0x7f03ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:46.855+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03e80ec6c0 con 0x7f03f01535e0 2023-11-04T01:40:47.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.011+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03f00675f0 con 0x7f03f01535e0 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03e5ffb640 1 -- 172.21.15.40:0/1472319360 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03e80efce0 con 0x7f03f01535e0 2023-11-04T01:40:47.018 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:47.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03d40664d0 msgr2=0x7f03d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03d40664d0 0x7f03d4068990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fd0 tx=0x7f03ec008040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 msgr2=0x7f03f0163f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 0x7f03f0163f10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03e80af040 tx=0x7f03e8019720 comp rx=0 tx=0).stop 2023-11-04T01:40:47.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 shutdown_connections 2023-11-04T01:40:47.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03d40664d0 0x7f03d4068990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03f01535e0 0x7f03f0163f10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f03f015af50 0x7f03f006bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 --2- 172.21.15.40:0/1472319360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f03f00cf4c0 0x7f03f0152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 >> 172.21.15.40:0/1472319360 conn(0x7f03f0065dc0 msgr2=0x7f03f00b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 shutdown_connections 2023-11-04T01:40:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.015+0000 7f03f76ff640 1 -- 172.21.15.40:0/1472319360 wait complete. 2023-11-04T01:40:47.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe90f8640 1 Processor -- start 2023-11-04T01:40:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe90f8640 1 -- start start 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe90f8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcbe415cef0 0x7fcbe406c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe90f8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe40cbc00 con 0x7fcbe40cb460 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe90f8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe40cb920 con 0x7fcbe406b840 2023-11-04T01:40:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe90f8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe4161500 con 0x7fcbe415cef0 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcbe40cb460 0x7fcbe406a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45518/0 (socket says 172.21.15.40:45518) 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe259c640 1 -- 172.21.15.40:0/317094192 learned_addr learned my addr 172.21.15.40:0/317094192 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/317094192 >> v2:172.21.15.91:3300/0 conn(0x7fcbe415cef0 0x7fcbe406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054113917 0 0) 0x7fcbe40cbc00 con 0x7fcbe40cb460 2023-11-04T01:40:47.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbcc003530 con 0x7fcbe40cb460 2023-11-04T01:40:47.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1783153653 0 0) 0x7fcbcc003530 con 0x7fcbe40cb460 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 >> v2:172.21.15.91:3300/0 conn(0x7fcbe415cef0 msgr2=0x7fcbe406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 --2- 172.21.15.40:0/317094192 >> v2:172.21.15.91:3300/0 conn(0x7fcbe415cef0 0x7fcbe406c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 >> v1:172.21.15.91:6789/0 conn(0x7fcbe406b840 legacy=0x7fcbe406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4160e40 con 0x7fcbe40cb460 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fcbd40016a0 con 0x7fcbe40cb460 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 >> v1:172.21.15.40:6789/0 conn(0x7fcbe40cb460 legacy=0x7fcbe406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbcc003980 0x7fcbcc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbcc0052b0 0x7fcbcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4161500 con 0x7fcbcc003980 2023-11-04T01:40:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00c180 con 0x7fcbcc0047d0 2023-11-04T01:40:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00c340 con 0x7fcbcc0052b0 2023-11-04T01:40:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbcc003980 0x7fcbcc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe259c640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.155+0000 7fcbe359e640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbcc0052b0 0x7fcbcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe2d9d640 1 -- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbcc0052b0 msgr2=0x7fcbcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbcc0052b0 0x7fcbcc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe2d9d640 1 -- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc0047d0 msgr2=0x7fcbcc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe2d9d640 1 -- 172.21.15.40:0/317094192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc003530 con 0x7fcbcc003980 2023-11-04T01:40:47.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe359e640 1 -- 172.21.15.40:0/317094192 reap_dead start 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbcc003980 0x7fcbcc003da0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009ab0 tx=0x7fcbd801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be94af352ca92c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80a5510 con 0x7fcbcc003980 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80a5670 con 0x7fcbcc003980 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe1d9b640 1 -- 172.21.15.40:0/317094192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80a5a20 con 0x7fcbcc003980 2023-11-04T01:40:47.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 -- 172.21.15.40:0/317094192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbcc003980 msgr2=0x7fcbcc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbcc003980 0x7fcbcc003da0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009ab0 tx=0x7fcbd801ca30 comp rx=0 tx=0).stop 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 -- 172.21.15.40:0/317094192 shutdown_connections 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/317094192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbcc003980 0x7fcbcc003da0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 -- 172.21.15.40:0/317094192 >> 172.21.15.40:0/317094192 conn(0x7fcbe40cf340 msgr2=0x7fcbe40cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 -- 172.21.15.40:0/317094192 shutdown_connections 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.159+0000 7fcbe90f8640 1 -- 172.21.15.40:0/317094192 wait complete. 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 Processor -- start 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- start start 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc003980 0x7fcbe4156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 0x7fcbe40afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbe40b2170 0x7fcbe40b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c2e70 con 0x7fcbe4156840 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40b2b40 con 0x7fcbcc003980 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c7500 con 0x7fcbe40b2170 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 0x7fcbe40afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 0x7fcbe40afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47710/0 (socket says 172.21.15.40:47710) 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 -- 172.21.15.40:0/3438385646 learned_addr learned my addr 172.21.15.40:0/3438385646 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe359e640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbe40b2170 0x7fcbe40b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc003980 0x7fcbe4156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 -- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbe40b2170 msgr2=0x7fcbe40b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbe40b2170 0x7fcbe40b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 -- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc003980 msgr2=0x7fcbe4156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc003980 0x7fcbe4156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 -- 172.21.15.40:0/3438385646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40b15a0 con 0x7fcbe4156840 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe359e640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbe40b2170 0x7fcbe40b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe259c640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 0x7fcbe40afc90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4007290 tx=0x7fcbd4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400f8e0 con 0x7fcbe4156840 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400fa40 con 0x7fcbe4156840 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400fdd0 con 0x7fcbe4156840 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40b1880 con 0x7fcbe4156840 2023-11-04T01:40:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe40b2ff0 con 0x7fcbe4156840 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe40744a0 con 0x7fcbe4156840 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.163+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbd401d460 con 0x7fcbe4156840 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.167+0000 7fcbcb7fe640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcbd00664a0 0x7fcbd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.167+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcbd4083ff0 con 0x7fcbe4156840 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.167+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcbd00664a0 0x7fcbd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.167+0000 7fcbe2d9d640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcbd00664a0 0x7fcbd0068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80af000 tx=0x7fcbd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.171+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcbd40513f0 con 0x7fcbe4156840 2023-11-04T01:40:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.323+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbe40c7940 con 0x7fcbe4156840 2023-11-04T01:40:47.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.323+0000 7fcbcb7fe640 1 -- 172.21.15.40:0/3438385646 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbd4054a10 con 0x7fcbe4156840 2023-11-04T01:40:47.329 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcbd00664a0 msgr2=0x7fcbd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcbd00664a0 0x7fcbd0068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80af000 tx=0x7fcbd8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 msgr2=0x7fcbe40afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 0x7fcbe40afc90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4007290 tx=0x7fcbd4007750 comp rx=0 tx=0).stop 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 shutdown_connections 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcbd00664a0 0x7fcbd0068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcbe40b2170 0x7fcbe40b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4156840 0x7fcbe40afc90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 --2- 172.21.15.40:0/3438385646 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbcc003980 0x7fcbe4156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 >> 172.21.15.40:0/3438385646 conn(0x7fcbe40cf340 msgr2=0x7fcbe40add10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 shutdown_connections 2023-11-04T01:40:47.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.327+0000 7fcbe90f8640 1 -- 172.21.15.40:0/3438385646 wait complete. 2023-11-04T01:40:47.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:47.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.459+0000 7fa94bfaa640 1 Processor -- start 2023-11-04T01:40:47.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.459+0000 7fa94bfaa640 1 -- start start 2023-11-04T01:40:47.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa94bfaa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa94415acb0 0x7fa94415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa94bfaa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa94bfaa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440cb130 con 0x7fa94415c160 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa94bfaa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94415bd40 con 0x7fa94415acb0 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa94bfaa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94406fd80 con 0x7fa9440b0c20 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa94415acb0 0x7fa94415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa94415acb0 0x7fa94415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34492/0 (socket says 172.21.15.40:34492) 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 -- 172.21.15.40:0/3222386216 learned_addr learned my addr 172.21.15.40:0/3222386216 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa94a547640 1 --2- 172.21.15.40:0/3222386216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 -- 172.21.15.40:0/3222386216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 msgr2=0x7fa9440ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 --2- 172.21.15.40:0/3222386216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 -- 172.21.15.40:0/3222386216 >> v1:172.21.15.91:6789/0 conn(0x7fa94415c160 legacy=0x7fa9440b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 -- 172.21.15.40:0/3222386216 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94415b680 con 0x7fa94415acb0 2023-11-04T01:40:47.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa949d46640 1 --2- 172.21.15.40:0/3222386216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415acb0 0x7fa94415b090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa940009870 tx=0x7fa94001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c437891d233ad324 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa948d44640 1 -- 172.21.15.40:0/3222386216 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400aa610 con 0x7fa94415acb0 2023-11-04T01:40:47.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa948d44640 1 -- 172.21.15.40:0/3222386216 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9400a6040 con 0x7fa94415acb0 2023-11-04T01:40:47.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.463+0000 7fa948d44640 1 -- 172.21.15.40:0/3222386216 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400aa990 con 0x7fa94415acb0 2023-11-04T01:40:47.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3222386216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415acb0 msgr2=0x7fa94415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3222386216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415acb0 0x7fa94415b090 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa940009870 tx=0x7fa94001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3222386216 shutdown_connections 2023-11-04T01:40:47.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3222386216 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3222386216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415acb0 0x7fa94415b090 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3222386216 >> 172.21.15.40:0/3222386216 conn(0x7fa9440cb510 msgr2=0x7fa9440cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3222386216 shutdown_connections 2023-11-04T01:40:47.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3222386216 wait complete. 2023-11-04T01:40:47.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 Processor -- start 2023-11-04T01:40:47.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- start start 2023-11-04T01:40:47.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa94415acb0 0x7fa944153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 0x7fa9440c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944154a80 con 0x7fa94415c160 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440b33d0 con 0x7fa94415acb0 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9441544c0 con 0x7fa9440b0c20 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 0x7fa9440c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 0x7fa9440c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34494/0 (socket says 172.21.15.40:34494) 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 -- 172.21.15.40:0/3625546577 learned_addr learned my addr 172.21.15.40:0/3625546577 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa949d46640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa949545640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa94415acb0 0x7fa944153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 -- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 msgr2=0x7fa9440c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 -- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa94415acb0 msgr2=0x7fa944153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa94415acb0 0x7fa944153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 -- 172.21.15.40:0/3625546577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400094d0 con 0x7fa94415c160 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94a547640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 0x7fa9440c6e80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa93c007e40 tx=0x7fa93c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c014620 con 0x7fa94415c160 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c00ee90 con 0x7fa94415c160 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9441547a0 con 0x7fa94415c160 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0149e0 con 0x7fa94415c160 2023-11-04T01:40:47.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.467+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94414fcb0 con 0x7fa94415c160 2023-11-04T01:40:47.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.471+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9440b2ec0 con 0x7fa94415c160 2023-11-04T01:40:47.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.471+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa93c014b40 con 0x7fa94415c160 2023-11-04T01:40:47.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.471+0000 7fa93a7fc640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa9280664a0 0x7fa928068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.471+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa93c084880 con 0x7fa94415c160 2023-11-04T01:40:47.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.471+0000 7fa949d46640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa9280664a0 0x7fa928068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.471+0000 7fa949d46640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa9280664a0 0x7fa928068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa9400ae000 tx=0x7fa9400a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.475+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9440b2ec0 con 0x7fa94415c160 2023-11-04T01:40:47.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.627+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9440b2ec0 con 0x7fa94415c160 2023-11-04T01:40:47.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.627+0000 7fa93a7fc640 1 -- 172.21.15.40:0/3625546577 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9440b2ec0 con 0x7fa94415c160 2023-11-04T01:40:47.632 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:47.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa9280664a0 msgr2=0x7fa928068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa9280664a0 0x7fa928068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa9400ae000 tx=0x7fa9400a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:47.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 msgr2=0x7fa9440c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 0x7fa9440c6e80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa93c007e40 tx=0x7fa93c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 shutdown_connections 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa9280664a0 0x7fa928068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa94415c160 0x7fa9440c6e80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa94415acb0 0x7fa944153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 --2- 172.21.15.40:0/3625546577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa9440b0c20 0x7fa9440c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 >> 172.21.15.40:0/3625546577 conn(0x7fa9440cb510 msgr2=0x7fa94415d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 shutdown_connections 2023-11-04T01:40:47.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.631+0000 7fa94bfaa640 1 -- 172.21.15.40:0/3625546577 wait complete. 2023-11-04T01:40:47.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:47.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 Processor -- start 2023-11-04T01:40:47.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 -- start start 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c340b1e10 0x7f0c340ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0c3406ace0 0x7f0c3415eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3415b360 con 0x7f0c3415af80 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c34071880 con 0x7f0c340b1e10 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c3a8df640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c34071b60 con 0x7f0c3406ace0 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c2bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c340b1e10 0x7f0c340ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c2bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c340b1e10 0x7f0c340ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34508/0 (socket says 172.21.15.40:34508) 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.759+0000 7f0c2bfff640 1 -- 172.21.15.40:0/505879637 learned_addr learned my addr 172.21.15.40:0/505879637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:47.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c38e7c640 1 --2- 172.21.15.40:0/505879637 >> v2:172.21.15.91:3300/0 conn(0x7f0c3406ace0 0x7f0c3415eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c2bfff640 1 -- 172.21.15.40:0/505879637 >> v2:172.21.15.91:3300/0 conn(0x7f0c3406ace0 msgr2=0x7f0c3415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c2bfff640 1 --2- 172.21.15.40:0/505879637 >> v2:172.21.15.91:3300/0 conn(0x7f0c3406ace0 0x7f0c3415eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c2bfff640 1 -- 172.21.15.40:0/505879637 >> v1:172.21.15.91:6789/0 conn(0x7f0c3415af80 legacy=0x7f0c340b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c2bfff640 1 -- 172.21.15.40:0/505879637 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3406a200 con 0x7f0c340b1e10 2023-11-04T01:40:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c2bfff640 1 --2- 172.21.15.40:0/505879637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c340b1e10 0x7f0c340ca1c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c340c6bd0 tx=0x7f0c1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8bda3d5d1b3d38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c337fe640 1 -- 172.21.15.40:0/505879637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0ab600 con 0x7f0c340b1e10 2023-11-04T01:40:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c337fe640 1 -- 172.21.15.40:0/505879637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0a7050 con 0x7f0c340b1e10 2023-11-04T01:40:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c337fe640 1 -- 172.21.15.40:0/505879637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0ab980 con 0x7f0c340b1e10 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 -- 172.21.15.40:0/505879637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c340b1e10 msgr2=0x7f0c340ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/505879637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c340b1e10 0x7f0c340ca1c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c340c6bd0 tx=0x7f0c1c01c430 comp rx=0 tx=0).stop 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 -- 172.21.15.40:0/505879637 shutdown_connections 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/505879637 >> v2:172.21.15.91:3300/0 conn(0x7f0c3406ace0 0x7f0c3415eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/505879637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c340b1e10 0x7f0c340ca1c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 -- 172.21.15.40:0/505879637 >> 172.21.15.40:0/505879637 conn(0x7f0c3406e760 msgr2=0x7f0c3406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 -- 172.21.15.40:0/505879637 shutdown_connections 2023-11-04T01:40:47.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.763+0000 7f0c3a8df640 1 -- 172.21.15.40:0/505879637 wait complete. 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 Processor -- start 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- start start 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 0x7f0c341f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0c340b1e10 0x7f0c340b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0c3415af80 0x7f0c341540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34152730 con 0x7f0c3406ace0 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c340c6c40 con 0x7f0c340b1e10 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34154d60 con 0x7f0c3415af80 2023-11-04T01:40:47.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 0x7f0c341f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 0x7f0c341f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34512/0 (socket says 172.21.15.40:34512) 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 -- 172.21.15.40:0/1231924447 learned_addr learned my addr 172.21.15.40:0/1231924447 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c2bfff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0c340b1e10 0x7f0c340b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c38e7c640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0c3415af80 0x7f0c341540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 -- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0c3415af80 msgr2=0x7f0c341540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0c3415af80 0x7f0c341540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 -- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0c340b1e10 msgr2=0x7f0c340b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0c340b1e10 0x7f0c340b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 -- 172.21.15.40:0/1231924447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0094d0 con 0x7f0c3406ace0 2023-11-04T01:40:47.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c2bfff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0c340b1e10 0x7f0c340b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c33fff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 0x7f0c341f4020 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400b410 tx=0x7f0c2400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24004020 con 0x7f0c3406ace0 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24004180 con 0x7f0c3406ace0 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c340c6ee0 con 0x7f0c3406ace0 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011630 con 0x7f0c3406ace0 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c340c74a0 con 0x7f0c3406ace0 2023-11-04T01:40:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c340c7690 con 0x7f0c3406ace0 2023-11-04T01:40:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c24011790 con 0x7f0c3406ace0 2023-11-04T01:40:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c317fa640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0c140664a0 0x7f0c14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.767+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0c24083be0 con 0x7f0c3406ace0 2023-11-04T01:40:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.771+0000 7f0c2bfff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0c140664a0 0x7f0c14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.771+0000 7f0c2bfff640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0c140664a0 0x7f0c14068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0ad000 tx=0x7f0c1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.771+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c24051070 con 0x7f0c3406ace0 2023-11-04T01:40:47.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.931+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c340675f0 con 0x7f0c3406ace0 2023-11-04T01:40:47.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c317fa640 1 -- 172.21.15.40:0/1231924447 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0c24054690 con 0x7f0c3406ace0 2023-11-04T01:40:47.938 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:40:47.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0c140664a0 msgr2=0x7f0c14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0c140664a0 0x7f0c14068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0ad000 tx=0x7f0c1c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 msgr2=0x7f0c341f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 0x7f0c341f4020 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400b410 tx=0x7f0c2400b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 shutdown_connections 2023-11-04T01:40:47.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0c140664a0 0x7f0c14068960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0c3415af80 0x7f0c341540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0c340b1e10 0x7f0c340b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 --2- 172.21.15.40:0/1231924447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c3406ace0 0x7f0c341f4020 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 >> 172.21.15.40:0/1231924447 conn(0x7f0c3406e760 msgr2=0x7f0c3415bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 shutdown_connections 2023-11-04T01:40:47.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:47.935+0000 7f0c3a8df640 1 -- 172.21.15.40:0/1231924447 wait complete. 2023-11-04T01:40:47.955 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi091.front.sepia.ceph.com... 2023-11-04T01:40:47.955 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:47.955 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:48.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:48.010 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi091.stderr:ceph-fuse[44003]: fuse finished with error 0 and tester_r 0 2023-11-04T01:40:48.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-11-04T01:40:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:48.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi091.stderr:2023-11-04T01:40:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:48.019 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:48.028 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:40:48.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:48.029 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:40:48.074 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:40:48.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 Processor -- start 2023-11-04T01:40:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 -- start start 2023-11-04T01:40:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 0x7fcf280715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcf2806f8f0 0x7fcf280b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf280c2670 con 0x7fcf280b0b70 2023-11-04T01:40:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf28070140 con 0x7fcf2806f8f0 2023-11-04T01:40:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2e915640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2815fc90 con 0x7fcf2815afd0 2023-11-04T01:40:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2ceb2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcf280b0b70 0x7fcf280c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44978/0 (socket says 172.21.15.40:44978) 2023-11-04T01:40:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2ceb2640 1 -- 172.21.15.40:0/350040703 learned_addr learned my addr 172.21.15.40:0/350040703 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf27fff640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 0x7fcf280715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 --2- 172.21.15.40:0/350040703 >> v2:172.21.15.91:3300/0 conn(0x7fcf2806f8f0 0x7fcf280b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227513683 0 0) 0x7fcf280c2670 con 0x7fcf280b0b70 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003530 con 0x7fcf280b0b70 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3322150889 0 0) 0x7fcf10003530 con 0x7fcf280b0b70 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 msgr2=0x7fcf280715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 0x7fcf280715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 >> v2:172.21.15.91:3300/0 conn(0x7fcf2806f8f0 msgr2=0x7fcf280b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 --2- 172.21.15.40:0/350040703 >> v2:172.21.15.91:3300/0 conn(0x7fcf2806f8f0 0x7fcf280b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2806bc30 con 0x7fcf280b0b70 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fcf20001680 con 0x7fcf280b0b70 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 >> v1:172.21.15.40:6789/0 conn(0x7fcf280b0b70 legacy=0x7fcf280c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf10003980 0x7fcf10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 0x7fcf10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28070140 con 0x7fcf100047d0 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2815fc90 con 0x7fcf10003980 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000b990 con 0x7fcf2815afd0 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf27fff640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf10003980 0x7fcf10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 -- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 msgr2=0x7fcf10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf2ceb2640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 0x7fcf10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf2815afd0 0x7fcf10005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 -- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf10003980 msgr2=0x7fcf10003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf10003980 0x7fcf10003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.199+0000 7fcf277fe640 1 -- 172.21.15.40:0/350040703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10003530 con 0x7fcf100047d0 2023-11-04T01:40:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf277fe640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf10004c50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009fc0 tx=0x7fcf1c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ae1204158c9f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0a5bd0 con 0x7fcf100047d0 2023-11-04T01:40:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00f040 con 0x7fcf100047d0 2023-11-04T01:40:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf26ffd640 1 -- 172.21.15.40:0/350040703 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0ad440 con 0x7fcf100047d0 2023-11-04T01:40:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- 172.21.15.40:0/350040703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 msgr2=0x7fcf10004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 --2- 172.21.15.40:0/350040703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf10004c50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009fc0 tx=0x7fcf1c01cca0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2ceb2640 1 -- 172.21.15.40:0/350040703 reap_dead start 2023-11-04T01:40:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- 172.21.15.40:0/350040703 shutdown_connections 2023-11-04T01:40:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- 172.21.15.40:0/350040703 >> 172.21.15.40:0/350040703 conn(0x7fcf280cebb0 msgr2=0x7fcf280cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- 172.21.15.40:0/350040703 shutdown_connections 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- 172.21.15.40:0/350040703 wait complete. 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 Processor -- start 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- start start 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf280ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf280cdf60 0x7fcf2814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf280ce3e0 0x7fcf2814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280cca40 con 0x7fcf100047d0 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280ccd20 con 0x7fcf280cdf60 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.203+0000 7fcf2e915640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280cd000 con 0x7fcf280ce3e0 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf280ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf280ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34536/0 (socket says 172.21.15.40:34536) 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 -- 172.21.15.40:0/2896572656 learned_addr learned my addr 172.21.15.40:0/2896572656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf277fe640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf280cdf60 0x7fcf2814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf2ceb2640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf280ce3e0 0x7fcf2814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 -- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf280ce3e0 msgr2=0x7fcf2814dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf280ce3e0 0x7fcf2814dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 -- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf280cdf60 msgr2=0x7fcf2814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf280cdf60 0x7fcf2814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 -- 172.21.15.40:0/2896572656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280cd2e0 con 0x7fcf100047d0 2023-11-04T01:40:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf27fff640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf280ca910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcf180115e0 tx=0x7fcf18011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800f8f0 con 0x7fcf100047d0 2023-11-04T01:40:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800fa50 con 0x7fcf100047d0 2023-11-04T01:40:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280cd5c0 con 0x7fcf100047d0 2023-11-04T01:40:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800fdc0 con 0x7fcf100047d0 2023-11-04T01:40:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf280cc6f0 con 0x7fcf100047d0 2023-11-04T01:40:48.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf280744a0 con 0x7fcf100047d0 2023-11-04T01:40:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf18015460 con 0x7fcf100047d0 2023-11-04T01:40:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf24ff9640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcf140664a0 0x7fcf14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcf18084790 con 0x7fcf100047d0 2023-11-04T01:40:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf277fe640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcf140664a0 0x7fcf14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.207+0000 7fcf277fe640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcf140664a0 0x7fcf14068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0af000 tx=0x7fcf1c0a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.211+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcf18051af0 con 0x7fcf100047d0 2023-11-04T01:40:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf2806c4c0 con 0x7fcf100047d0 2023-11-04T01:40:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf24ff9640 1 -- 172.21.15.40:0/2896572656 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fcf18055110 con 0x7fcf100047d0 2023-11-04T01:40:48.411 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:48.411 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcf140664a0 msgr2=0x7fcf14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcf140664a0 0x7fcf14068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0af000 tx=0x7fcf1c0a7040 comp rx=0 tx=0).stop 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 msgr2=0x7fcf280ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf280ca910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcf180115e0 tx=0x7fcf18011aa0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 shutdown_connections 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcf140664a0 0x7fcf14068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcf280ce3e0 0x7fcf2814dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcf280cdf60 0x7fcf2814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 --2- 172.21.15.40:0/2896572656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf100047d0 0x7fcf280ca910 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 >> 172.21.15.40:0/2896572656 conn(0x7fcf280cebb0 msgr2=0x7fcf280c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.407+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 shutdown_connections 2023-11-04T01:40:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.411+0000 7fcf2e915640 1 -- 172.21.15.40:0/2896572656 wait complete. 2023-11-04T01:40:48.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:48.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 Processor -- start 2023-11-04T01:40:48.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 -- start start 2023-11-04T01:40:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2a40715d0 0x7fe2a40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe2a40b0b70 0x7fe2a415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40c2670 con 0x7fe2a415afd0 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a4070140 con 0x7fe2a40715d0 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a916b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a4071a60 con 0x7fe2a40b0b70 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2a40715d0 0x7fe2a40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2a40715d0 0x7fe2a40b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34538/0 (socket says 172.21.15.40:34538) 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 -- 172.21.15.40:0/1858040348 learned_addr learned my addr 172.21.15.40:0/1858040348 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a359e640 1 --2- 172.21.15.40:0/1858040348 >> v2:172.21.15.91:3300/0 conn(0x7fe2a40b0b70 0x7fe2a415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 -- 172.21.15.40:0/1858040348 >> v2:172.21.15.91:3300/0 conn(0x7fe2a40b0b70 msgr2=0x7fe2a415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 --2- 172.21.15.40:0/1858040348 >> v2:172.21.15.91:3300/0 conn(0x7fe2a40b0b70 0x7fe2a415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 -- 172.21.15.40:0/1858040348 >> v1:172.21.15.91:6789/0 conn(0x7fe2a415afd0 legacy=0x7fe2a406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.555+0000 7fe2a259c640 1 -- 172.21.15.40:0/1858040348 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a406bc30 con 0x7fe2a40715d0 2023-11-04T01:40:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 --2- 172.21.15.40:0/1858040348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40715d0 0x7fe2a40b0630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406f7b0 tx=0x7fe28c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0abf8f9d2214ccd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a1d9b640 1 -- 172.21.15.40:0/1858040348 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0a5690 con 0x7fe2a40715d0 2023-11-04T01:40:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a1d9b640 1 -- 172.21.15.40:0/1858040348 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c0a57f0 con 0x7fe2a40715d0 2023-11-04T01:40:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a1d9b640 1 -- 172.21.15.40:0/1858040348 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0a5b80 con 0x7fe2a40715d0 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- 172.21.15.40:0/1858040348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40715d0 msgr2=0x7fe2a40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1858040348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40715d0 0x7fe2a40b0630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406f7b0 tx=0x7fe28c01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- 172.21.15.40:0/1858040348 shutdown_connections 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1858040348 >> v2:172.21.15.91:3300/0 conn(0x7fe2a40b0b70 0x7fe2a415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1858040348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40715d0 0x7fe2a40b0630 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- 172.21.15.40:0/1858040348 >> 172.21.15.40:0/1858040348 conn(0x7fe2a40cebb0 msgr2=0x7fe2a40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- 172.21.15.40:0/1858040348 shutdown_connections 2023-11-04T01:40:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- 172.21.15.40:0/1858040348 wait complete. 2023-11-04T01:40:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 Processor -- start 2023-11-04T01:40:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- start start 2023-11-04T01:40:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2a40715d0 0x7fe2a41510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 0x7fe2a41518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2a415afd0 0x7fe2a40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4151610 con 0x7fe2a40b0b70 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4152320 con 0x7fe2a40715d0 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4152600 con 0x7fe2a415afd0 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 0x7fe2a41518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 0x7fe2a41518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34554/0 (socket says 172.21.15.40:34554) 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 -- 172.21.15.40:0/1617866793 learned_addr learned my addr 172.21.15.40:0/1617866793 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a2d9d640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2a40715d0 0x7fe2a41510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a359e640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2a415afd0 0x7fe2a40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 -- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2a415afd0 msgr2=0x7fe2a40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2a415afd0 0x7fe2a40b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 -- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2a40715d0 msgr2=0x7fe2a41510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2a40715d0 0x7fe2a41510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 -- 172.21.15.40:0/1617866793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c009b30 con 0x7fe2a40b0b70 2023-11-04T01:40:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a259c640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 0x7fe2a41518d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0af040 tx=0x7fe28c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b8670 con 0x7fe2a40b0b70 2023-11-04T01:40:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c0b8810 con 0x7fe2a40b0b70 2023-11-04T01:40:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a41528e0 con 0x7fe2a40b0b70 2023-11-04T01:40:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.559+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b8bc0 con 0x7fe2a40b0b70 2023-11-04T01:40:48.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a4152ea0 con 0x7fe2a40b0b70 2023-11-04T01:40:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a4153090 con 0x7fe2a40b0b70 2023-11-04T01:40:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe28c0b8d20 con 0x7fe2a40b0b70 2023-11-04T01:40:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe29b7fe640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2840664d0 0x7fe284068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe28c11f660 con 0x7fe2a40b0b70 2023-11-04T01:40:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe2a2d9d640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2840664d0 0x7fe284068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.563+0000 7fe2a2d9d640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2840664d0 0x7fe284068990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe294000f70 tx=0x7fe294009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.567+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe28c0ecc60 con 0x7fe2a40b0b70 2023-11-04T01:40:48.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.715+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2a40744a0 con 0x7fe2a40b0b70 2023-11-04T01:40:48.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.719+0000 7fe29b7fe640 1 -- 172.21.15.40:0/1617866793 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fe28c0f0280 con 0x7fe2a40b0b70 2023-11-04T01:40:48.724 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:48.725 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2840664d0 msgr2=0x7fe284068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2840664d0 0x7fe284068990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe294000f70 tx=0x7fe294009040 comp rx=0 tx=0).stop 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 msgr2=0x7fe2a41518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 0x7fe2a41518d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0af040 tx=0x7fe28c019770 comp rx=0 tx=0).stop 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 shutdown_connections 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe2840664d0 0x7fe284068990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe2a415afd0 0x7fe2a40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2a40b0b70 0x7fe2a41518d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 --2- 172.21.15.40:0/1617866793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2a40715d0 0x7fe2a41510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 >> 172.21.15.40:0/1617866793 conn(0x7fe2a40cebb0 msgr2=0x7fe2a40cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 shutdown_connections 2023-11-04T01:40:48.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.723+0000 7fe2a916b640 1 -- 172.21.15.40:0/1617866793 wait complete. 2023-11-04T01:40:48.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:39:55.526771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:39:56.421275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:48.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:48.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.863+0000 7ff8b4b5f640 1 Processor -- start 2023-11-04T01:40:48.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.863+0000 7ff8b4b5f640 1 -- start start 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8b4b5f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8b00adb50 0x7ff8b00adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8b4b5f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8b00c9a00 0x7ff8b00ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8b4b5f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00cd020 con 0x7ff8b00cc990 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8b4b5f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00cce40 con 0x7ff8b00adb50 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8b4b5f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00cd300 con 0x7ff8b00c9a00 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8ae59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8b00adb50 0x7ff8b00adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8add9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff8b00cc990 0x7ff8b00c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44984/0 (socket says 172.21.15.40:44984) 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8add9b640 1 -- 172.21.15.40:0/661371251 learned_addr learned my addr 172.21.15.40:0/661371251 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8aed9d640 1 --2- 172.21.15.40:0/661371251 >> v2:172.21.15.91:3300/0 conn(0x7ff8b00c9a00 0x7ff8b00ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8ae59c640 1 -- 172.21.15.40:0/661371251 >> v2:172.21.15.91:3300/0 conn(0x7ff8b00c9a00 msgr2=0x7ff8b00ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8ae59c640 1 --2- 172.21.15.40:0/661371251 >> v2:172.21.15.91:3300/0 conn(0x7ff8b00c9a00 0x7ff8b00ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8ae59c640 1 -- 172.21.15.40:0/661371251 >> v1:172.21.15.40:6789/0 conn(0x7ff8b00cc990 legacy=0x7ff8b00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.867+0000 7ff8ae59c640 1 -- 172.21.15.40:0/661371251 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00cd5e0 con 0x7ff8b00adb50 2023-11-04T01:40:48.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8ae59c640 1 --2- 172.21.15.40:0/661371251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00adb50 0x7ff8b00adf30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0071b90 tx=0x7ff8a001d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a3f0361b4fcae7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8ad59a640 1 -- 172.21.15.40:0/661371251 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a6730 con 0x7ff8b00adb50 2023-11-04T01:40:48.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8ad59a640 1 -- 172.21.15.40:0/661371251 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00a6890 con 0x7ff8b00adb50 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8ad59a640 1 -- 172.21.15.40:0/661371251 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a6c20 con 0x7ff8b00adb50 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/661371251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00adb50 msgr2=0x7ff8b00adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/661371251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00adb50 0x7ff8b00adf30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0071b90 tx=0x7ff8a001d6c0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/661371251 shutdown_connections 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/661371251 >> v2:172.21.15.91:3300/0 conn(0x7ff8b00c9a00 0x7ff8b00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/661371251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00adb50 0x7ff8b00adf30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/661371251 >> 172.21.15.40:0/661371251 conn(0x7ff8b00cb510 msgr2=0x7ff8b00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/661371251 shutdown_connections 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/661371251 wait complete. 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 Processor -- start 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- start start 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8b00adb50 0x7ff8b01f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b00c9a00 0x7ff8b0145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 0x7ff8b0145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01f2830 con 0x7ff8b00cc990 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01467a0 con 0x7ff8b00c9a00 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8b4b5f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0146a80 con 0x7ff8b00adb50 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 0x7ff8b0145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 0x7ff8b0145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34578/0 (socket says 172.21.15.40:34578) 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8aed9d640 1 -- 172.21.15.40:0/3106940408 learned_addr learned my addr 172.21.15.40:0/3106940408 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8add9b640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b00c9a00 0x7ff8b0145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.871+0000 7ff8ae59c640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8b00adb50 0x7ff8b01f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8aed9d640 1 -- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8b00adb50 msgr2=0x7ff8b01f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8aed9d640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8b00adb50 0x7ff8b01f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8aed9d640 1 -- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b00c9a00 msgr2=0x7ff8b0145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8aed9d640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b00c9a00 0x7ff8b0145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8aed9d640 1 -- 172.21.15.40:0/3106940408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a000a5c0 con 0x7ff8b00cc990 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8aed9d640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 0x7ff8b0145f40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8007e40 tx=0x7ff8a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8014620 con 0x7ff8b00cc990 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a800ee90 con 0x7ff8b00cc990 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b0146d60 con 0x7ff8b00cc990 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80149e0 con 0x7ff8b00cc990 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b0147320 con 0x7ff8b00cc990 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b0147510 con 0x7ff8b00cc990 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8a8014b40 con 0x7ff8b00cc990 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff89effd640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8900664a0 0x7ff890068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff8a8084820 con 0x7ff8b00cc990 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8ae59c640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8900664a0 0x7ff890068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.875+0000 7ff8ae59c640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8900664a0 0x7ff890068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00b0000 tx=0x7ff8a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:48.879+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8a8051c20 con 0x7ff8b00cc990 2023-11-04T01:40:49.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.027+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8b00744a0 con 0x7ff8b00cc990 2023-11-04T01:40:49.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.027+0000 7ff89effd640 1 -- 172.21.15.40:0/3106940408 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8a8055240 con 0x7ff8b00cc990 2023-11-04T01:40:49.033 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:49.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8900664a0 msgr2=0x7ff890068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8900664a0 0x7ff890068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00b0000 tx=0x7ff8a0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 msgr2=0x7ff8b0145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 0x7ff8b0145f40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8007e40 tx=0x7ff8a800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 shutdown_connections 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8900664a0 0x7ff890068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8b00cc990 0x7ff8b0145f40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8b00c9a00 0x7ff8b0145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 --2- 172.21.15.40:0/3106940408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8b00adb50 0x7ff8b01f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 >> 172.21.15.40:0/3106940408 conn(0x7ff8b00cb510 msgr2=0x7ff8b00cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 shutdown_connections 2023-11-04T01:40:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.031+0000 7ff8b4b5f640 1 -- 172.21.15.40:0/3106940408 wait complete. 2023-11-04T01:40:49.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 Processor -- start 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 -- start start 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6a415af70 0x7fb6a40cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415e490 0x7fb6a40cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a406c0c0 con 0x7fb6a406d160 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a415e8e0 con 0x7fb6a415af70 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6aa513640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4071200 con 0x7fb6a415e490 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6a415af70 0x7fb6a40cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb69b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb6a406d160 0x7fb6a415dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44998/0 (socket says 172.21.15.40:44998) 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb69b7fe640 1 -- 172.21.15.40:0/349920413 learned_addr learned my addr 172.21.15.40:0/349920413 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a8ab0640 1 --2- 172.21.15.40:0/349920413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415e490 0x7fb6a40cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a37fe640 1 -- 172.21.15.40:0/349920413 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679678971 0 0) 0x7fb6a406c0c0 con 0x7fb6a406d160 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a3fff640 1 -- 172.21.15.40:0/349920413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415e490 msgr2=0x7fb6a40cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a3fff640 1 --2- 172.21.15.40:0/349920413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415e490 0x7fb6a40cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a3fff640 1 -- 172.21.15.40:0/349920413 >> v1:172.21.15.40:6789/0 conn(0x7fb6a406d160 legacy=0x7fb6a415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.171+0000 7fb6a3fff640 1 -- 172.21.15.40:0/349920413 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a406c3a0 con 0x7fb6a415af70 2023-11-04T01:40:49.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6a3fff640 1 --2- 172.21.15.40:0/349920413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a415af70 0x7fb6a40cdaa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb6940097f0 tx=0x7fb69401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e931b8a3d9f4d8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6a37fe640 1 -- 172.21.15.40:0/349920413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6940ab600 con 0x7fb6a415af70 2023-11-04T01:40:49.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6a37fe640 1 -- 172.21.15.40:0/349920413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6940a7050 con 0x7fb6a415af70 2023-11-04T01:40:49.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6a37fe640 1 -- 172.21.15.40:0/349920413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6940ab980 con 0x7fb6a415af70 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- 172.21.15.40:0/349920413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a415af70 msgr2=0x7fb6a40cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 --2- 172.21.15.40:0/349920413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a415af70 0x7fb6a40cdaa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb6940097f0 tx=0x7fb69401c480 comp rx=0 tx=0).stop 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- 172.21.15.40:0/349920413 shutdown_connections 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 --2- 172.21.15.40:0/349920413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415e490 0x7fb6a40cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 --2- 172.21.15.40:0/349920413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a415af70 0x7fb6a40cdaa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- 172.21.15.40:0/349920413 >> 172.21.15.40:0/349920413 conn(0x7fb6a40cb510 msgr2=0x7fb6a40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- 172.21.15.40:0/349920413 shutdown_connections 2023-11-04T01:40:49.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- 172.21.15.40:0/349920413 wait complete. 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 Processor -- start 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- start start 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 0x7fb6a40b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415af70 0x7fb6a40b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6a415e490 0x7fb6a4155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a41555c0 con 0x7fb6a406d160 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b2b80 con 0x7fb6a415e490 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.175+0000 7fb6aa513640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b3860 con 0x7fb6a415af70 2023-11-04T01:40:49.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 0x7fb6a40b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 0x7fb6a40b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34588/0 (socket says 172.21.15.40:34588) 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 -- 172.21.15.40:0/1303600305 learned_addr learned my addr 172.21.15.40:0/1303600305 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb69b7fe640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415af70 0x7fb6a40b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a8ab0640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6a415e490 0x7fb6a4155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 -- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415af70 msgr2=0x7fb6a40b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415af70 0x7fb6a40b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 -- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6a415e490 msgr2=0x7fb6a4155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6a415e490 0x7fb6a4155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 -- 172.21.15.40:0/1303600305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694009420 con 0x7fb6a406d160 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a8ab0640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6a415e490 0x7fb6a4155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a3fff640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 0x7fb6a40b4450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb6940097f0 tx=0x7fb69401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694004230 con 0x7fb6a406d160 2023-11-04T01:40:49.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb694004390 con 0x7fb6a406d160 2023-11-04T01:40:49.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a40b1f70 con 0x7fb6a406d160 2023-11-04T01:40:49.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694003820 con 0x7fb6a406d160 2023-11-04T01:40:49.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a40b2530 con 0x7fb6a406d160 2023-11-04T01:40:49.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a40744a0 con 0x7fb6a406d160 2023-11-04T01:40:49.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb694003980 con 0x7fb6a406d160 2023-11-04T01:40:49.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a17fa640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6840664a0 0x7fb684068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb69411e840 con 0x7fb6a406d160 2023-11-04T01:40:49.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb69b7fe640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6840664a0 0x7fb684068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.179+0000 7fb69b7fe640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6840664a0 0x7fb684068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40b11f0 tx=0x7fb68c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.183+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6940ebcd0 con 0x7fb6a406d160 2023-11-04T01:40:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6a40c2160 con 0x7fb6a406d160 2023-11-04T01:40:49.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6a17fa640 1 -- 172.21.15.40:0/1303600305 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6940c4020 con 0x7fb6a406d160 2023-11-04T01:40:49.339 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6840664a0 msgr2=0x7fb684068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6840664a0 0x7fb684068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40b11f0 tx=0x7fb68c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 msgr2=0x7fb6a40b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 0x7fb6a40b4450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb6940097f0 tx=0x7fb69401acc0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 shutdown_connections 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6840664a0 0x7fb684068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6a415e490 0x7fb6a4155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6a415af70 0x7fb6a40b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 --2- 172.21.15.40:0/1303600305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a406d160 0x7fb6a40b4450 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 >> 172.21.15.40:0/1303600305 conn(0x7fb6a40cb510 msgr2=0x7fb6a40cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 shutdown_connections 2023-11-04T01:40:49.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.335+0000 7fb6aa513640 1 -- 172.21.15.40:0/1303600305 wait complete. 2023-11-04T01:40:49.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 Processor -- start 2023-11-04T01:40:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 -- start start 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2100c2190 0x7fc210165c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc21006f9c0 0x7fc21006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100cc990 con 0x7fc2100c1db0 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21006cc90 con 0x7fc21006f9c0 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc216ef7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21006cf70 con 0x7fc2100c2190 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc214c93640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2100c1db0 0x7fc2100cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45010/0 (socket says 172.21.15.40:45010) 2023-11-04T01:40:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc214c93640 1 -- 172.21.15.40:0/335559616 learned_addr learned my addr 172.21.15.40:0/335559616 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc20ffff640 1 --2- 172.21.15.40:0/335559616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2100c2190 0x7fc210165c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc215494640 1 --2- 172.21.15.40:0/335559616 >> v2:172.21.15.91:3300/0 conn(0x7fc21006f9c0 0x7fc21006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc20f7fe640 1 -- 172.21.15.40:0/335559616 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375532536 0 0) 0x7fc2100cc990 con 0x7fc2100c1db0 2023-11-04T01:40:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.475+0000 7fc20f7fe640 1 -- 172.21.15.40:0/335559616 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f8003530 con 0x7fc2100c1db0 2023-11-04T01:40:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20ffff640 1 -- 172.21.15.40:0/335559616 >> v2:172.21.15.91:3300/0 conn(0x7fc21006f9c0 msgr2=0x7fc21006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20ffff640 1 --2- 172.21.15.40:0/335559616 >> v2:172.21.15.91:3300/0 conn(0x7fc21006f9c0 0x7fc21006fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20ffff640 1 -- 172.21.15.40:0/335559616 >> v1:172.21.15.40:6789/0 conn(0x7fc2100c1db0 legacy=0x7fc2100cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20ffff640 1 -- 172.21.15.40:0/335559616 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21006d250 con 0x7fc2100c2190 2023-11-04T01:40:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20ffff640 1 --2- 172.21.15.40:0/335559616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2100c2190 0x7fc210165c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2000097c0 tx=0x7fc20001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3094dd6238546a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20f7fe640 1 -- 172.21.15.40:0/335559616 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000a8970 con 0x7fc2100c2190 2023-11-04T01:40:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20f7fe640 1 -- 172.21.15.40:0/335559616 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2000a8ad0 con 0x7fc2100c2190 2023-11-04T01:40:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc20f7fe640 1 -- 172.21.15.40:0/335559616 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000a8e40 con 0x7fc2100c2190 2023-11-04T01:40:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 -- 172.21.15.40:0/335559616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2100c2190 msgr2=0x7fc210165c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 --2- 172.21.15.40:0/335559616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2100c2190 0x7fc210165c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2000097c0 tx=0x7fc20001ec70 comp rx=0 tx=0).stop 2023-11-04T01:40:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 -- 172.21.15.40:0/335559616 shutdown_connections 2023-11-04T01:40:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 --2- 172.21.15.40:0/335559616 >> v2:172.21.15.91:3300/0 conn(0x7fc21006f9c0 0x7fc21006fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 --2- 172.21.15.40:0/335559616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2100c2190 0x7fc210165c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 -- 172.21.15.40:0/335559616 >> 172.21.15.40:0/335559616 conn(0x7fc2100cb510 msgr2=0x7fc2100cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 -- 172.21.15.40:0/335559616 shutdown_connections 2023-11-04T01:40:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.479+0000 7fc216ef7640 1 -- 172.21.15.40:0/335559616 wait complete. 2023-11-04T01:40:49.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 Processor -- start 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- start start 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc21006f9c0 0x7fc2100c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2100c1db0 0x7fc210159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 0x7fc21015fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21014faa0 con 0x7fc2100c2190 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100c4cc0 con 0x7fc2100c1db0 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100c42a0 con 0x7fc21006f9c0 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 0x7fc21015fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 0x7fc21015fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34598/0 (socket says 172.21.15.40:34598) 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 -- 172.21.15.40:0/493254862 learned_addr learned my addr 172.21.15.40:0/493254862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:49.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc214c93640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc21006f9c0 0x7fc2100c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc20ffff640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2100c1db0 0x7fc210159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 -- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc21006f9c0 msgr2=0x7fc2100c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc21006f9c0 0x7fc2100c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 -- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2100c1db0 msgr2=0x7fc210159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2100c1db0 0x7fc210159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 -- 172.21.15.40:0/493254862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009420 con 0x7fc2100c2190 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc215494640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 0x7fc21015fb80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc208009dd0 tx=0x7fc20800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208014480 con 0x7fc2100c2190 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20800f040 con 0x7fc2100c2190 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2100b2590 con 0x7fc2100c2190 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208014840 con 0x7fc2100c2190 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2101570d0 con 0x7fc2100c2190 2023-11-04T01:40:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2100b2360 con 0x7fc2100c2190 2023-11-04T01:40:49.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.483+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2080149a0 con 0x7fc2100c2190 2023-11-04T01:40:49.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.487+0000 7fc20d7fa640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1fc0664a0 0x7fc1fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.487+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc208084a90 con 0x7fc2100c2190 2023-11-04T01:40:49.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.487+0000 7fc214c93640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1fc0664a0 0x7fc1fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.487+0000 7fc214c93640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1fc0664a0 0x7fc1fc068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc204005890 tx=0x7fc204009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.491+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2100b2360 con 0x7fc2100c2190 2023-11-04T01:40:49.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.643+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2100b2360 con 0x7fc2100c2190 2023-11-04T01:40:49.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.643+0000 7fc20d7fa640 1 -- 172.21.15.40:0/493254862 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2100b2360 con 0x7fc2100c2190 2023-11-04T01:40:49.648 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:40:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1fc0664a0 msgr2=0x7fc1fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1fc0664a0 0x7fc1fc068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc204005890 tx=0x7fc204009040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 msgr2=0x7fc21015fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 0x7fc21015fb80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc208009dd0 tx=0x7fc20800c490 comp rx=0 tx=0).stop 2023-11-04T01:40:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 shutdown_connections 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc1fc0664a0 0x7fc1fc068960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100c2190 0x7fc21015fb80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2100c1db0 0x7fc210159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 --2- 172.21.15.40:0/493254862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc21006f9c0 0x7fc2100c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 >> 172.21.15.40:0/493254862 conn(0x7fc2100cb510 msgr2=0x7fc2100c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 shutdown_connections 2023-11-04T01:40:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.647+0000 7fc216ef7640 1 -- 172.21.15.40:0/493254862 wait complete. 2023-11-04T01:40:49.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 Processor -- start 2023-11-04T01:40:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 -- start start 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f931c0d0ae0 0x7f931c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931c0b6070 con 0x7f931c0b4990 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c0b8ed0 con 0x7f931c0d0ae0 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f93238c3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0d1ce0 con 0x7f931c0d0690 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f932165f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f931c0b4990 0x7f931c0b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45024/0 (socket says 172.21.15.40:45024) 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9321e60640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f931c0d0ae0 0x7f931c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f932165f640 1 -- 172.21.15.40:0/777222828 learned_addr learned my addr 172.21.15.40:0/777222828 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9313fff640 1 -- 172.21.15.40:0/777222828 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935397696 0 0) 0x7f931c0b6070 con 0x7f931c0b4990 2023-11-04T01:40:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9320e5e640 1 --2- 172.21.15.40:0/777222828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9313fff640 1 -- 172.21.15.40:0/777222828 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9308003530 con 0x7f931c0b4990 2023-11-04T01:40:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9321e60640 1 -- 172.21.15.40:0/777222828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 msgr2=0x7f931c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9321e60640 1 --2- 172.21.15.40:0/777222828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9321e60640 1 -- 172.21.15.40:0/777222828 >> v1:172.21.15.40:6789/0 conn(0x7f931c0b4990 legacy=0x7f931c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.783+0000 7f9321e60640 1 -- 172.21.15.40:0/777222828 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0d1fc0 con 0x7f931c0d0ae0 2023-11-04T01:40:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9321e60640 1 --2- 172.21.15.40:0/777222828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c0b6a20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9314009d90 tx=0x7f931401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1f7bfe738d708a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9313fff640 1 -- 172.21.15.40:0/777222828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93140af600 con 0x7f931c0d0ae0 2023-11-04T01:40:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9313fff640 1 -- 172.21.15.40:0/777222828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93140ab050 con 0x7f931c0d0ae0 2023-11-04T01:40:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9313fff640 1 -- 172.21.15.40:0/777222828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93140af960 con 0x7f931c0d0ae0 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- 172.21.15.40:0/777222828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 msgr2=0x7f931c0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 --2- 172.21.15.40:0/777222828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c0b6a20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9314009d90 tx=0x7f931401f130 comp rx=0 tx=0).stop 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- 172.21.15.40:0/777222828 shutdown_connections 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 --2- 172.21.15.40:0/777222828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c0b6a20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 --2- 172.21.15.40:0/777222828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- 172.21.15.40:0/777222828 >> 172.21.15.40:0/777222828 conn(0x7f931c0cf990 msgr2=0x7f931c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- 172.21.15.40:0/777222828 shutdown_connections 2023-11-04T01:40:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- 172.21.15.40:0/777222828 wait complete. 2023-11-04T01:40:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 Processor -- start 2023-11-04T01:40:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- start start 2023-11-04T01:40:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f931c0b4990 0x7f931c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0ca6a0 con 0x7f931c0d0ae0 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c15f1e0 con 0x7f931c0b4990 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f93238c3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0ccd60 con 0x7f931c0d0690 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9321e60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9321e60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c1567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34616/0 (socket says 172.21.15.40:34616) 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9321e60640 1 -- 172.21.15.40:0/3463181541 learned_addr learned my addr 172.21.15.40:0/3463181541 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f932165f640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f931c0b4990 0x7f931c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.787+0000 7f9320e5e640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9321e60640 1 -- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 msgr2=0x7f931c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9321e60640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9321e60640 1 -- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f931c0b4990 msgr2=0x7f931c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9321e60640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f931c0b4990 0x7f931c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9321e60640 1 -- 172.21.15.40:0/3463181541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314009a70 con 0x7f931c0d0ae0 2023-11-04T01:40:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9321e60640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c1567f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f931401cd60 tx=0x7f931401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93140bf070 con 0x7f931c0d0ae0 2023-11-04T01:40:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9314004250 con 0x7f931c0d0ae0 2023-11-04T01:40:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c0cd040 con 0x7f931c0d0ae0 2023-11-04T01:40:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314004600 con 0x7f931c0d0ae0 2023-11-04T01:40:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c156d30 con 0x7f931c0d0ae0 2023-11-04T01:40:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c0744a0 con 0x7f931c0d0ae0 2023-11-04T01:40:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9314004760 con 0x7f931c0d0ae0 2023-11-04T01:40:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9311ffb640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93000664a0 0x7f9300068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9314122d10 con 0x7f931c0d0ae0 2023-11-04T01:40:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f932165f640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93000664a0 0x7f9300068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.791+0000 7f932165f640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93000664a0 0x7f9300068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9318005890 tx=0x7f9318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.795+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93140f3c80 con 0x7f931c0d0ae0 2023-11-04T01:40:49.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.983+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f931c15ee90 con 0x7f931c0d0ae0 2023-11-04T01:40:49.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.983+0000 7f9311ffb640 1 -- 172.21.15.40:0/3463181541 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f93140b4020 con 0x7f931c0d0ae0 2023-11-04T01:40:49.988 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:49.988 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:49.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93000664a0 msgr2=0x7f9300068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93000664a0 0x7f9300068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9318005890 tx=0x7f9318009040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 msgr2=0x7f931c1567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c1567f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f931401cd60 tx=0x7f931401bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 shutdown_connections 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93000664a0 0x7f9300068960 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f931c0d0ae0 0x7f931c1567f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f931c0d0690 0x7f931c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 --2- 172.21.15.40:0/3463181541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f931c0b4990 0x7f931c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 >> 172.21.15.40:0/3463181541 conn(0x7f931c0cf990 msgr2=0x7f931c0b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 shutdown_connections 2023-11-04T01:40:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:49.987+0000 7f93238c3640 1 -- 172.21.15.40:0/3463181541 wait complete. 2023-11-04T01:40:50.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.123+0000 7fb1c4a63640 1 Processor -- start 2023-11-04T01:40:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.123+0000 7fb1c4a63640 1 -- start start 2023-11-04T01:40:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1c4a63640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb1c015b470 0x7fb1c015f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1c4a63640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00cbe40 con 0x7fb1c015b090 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1c4a63640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00cc120 con 0x7fb1c006a870 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1c4a63640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c015fca0 con 0x7fb1c015b470 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1be59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb1c015b090 0x7fb1c006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45030/0 (socket says 172.21.15.40:45030) 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1be59c640 1 -- 172.21.15.40:0/2255611113 learned_addr learned my addr 172.21.15.40:0/2255611113 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/2255611113 >> v2:172.21.15.91:3300/0 conn(0x7fb1c015b470 0x7fb1c015f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970886026 0 0) 0x7fb1c00cbe40 con 0x7fb1c015b090 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a8003530 con 0x7fb1c015b090 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3747379149 0 0) 0x7fb1a8003530 con 0x7fb1c015b090 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 >> v2:172.21.15.91:3300/0 conn(0x7fb1c015b470 msgr2=0x7fb1c015f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 --2- 172.21.15.40:0/2255611113 >> v2:172.21.15.91:3300/0 conn(0x7fb1c015b470 0x7fb1c015f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 >> v1:172.21.15.91:6789/0 conn(0x7fb1c006a870 legacy=0x7fb1c00b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00cc400 con 0x7fb1c015b090 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fb1b0001680 con 0x7fb1c015b090 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 >> v1:172.21.15.40:6789/0 conn(0x7fb1c015b090 legacy=0x7fb1c006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1a80039d0 0x7fb1a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a8005190 0x7fb1a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015fca0 con 0x7fb1a80047d0 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a800c090 con 0x7fb1a8005190 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a800c250 con 0x7fb1a80039d0 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1be59c640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1a80039d0 0x7fb1a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bed9d640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a8005190 0x7fb1a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 -- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1a80039d0 msgr2=0x7fb1a8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1a80039d0 0x7fb1a8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 -- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a8005190 msgr2=0x7fb1a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a8005190 0x7fb1a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 -- 172.21.15.40:0/2255611113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8003530 con 0x7fb1a80047d0 2023-11-04T01:40:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bed9d640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1a8005190 0x7fb1a800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bed9d640 1 -- 172.21.15.40:0/2255611113 reap_dead start 2023-11-04T01:40:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1a8004c50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009ae0 tx=0x7fb1b401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac8ecaaaf3057f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a55e0 con 0x7fb1a80047d0 2023-11-04T01:40:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40a5740 con 0x7fb1a80047d0 2023-11-04T01:40:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.127+0000 7fb1bd59a640 1 -- 172.21.15.40:0/2255611113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5af0 con 0x7fb1a80047d0 2023-11-04T01:40:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/2255611113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 msgr2=0x7fb1a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1a8004c50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009ae0 tx=0x7fb1b401c9f0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/2255611113 shutdown_connections 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/2255611113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1a8004c50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/2255611113 >> 172.21.15.40:0/2255611113 conn(0x7fb1c00716a0 msgr2=0x7fb1c0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/2255611113 shutdown_connections 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/2255611113 wait complete. 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 Processor -- start 2023-11-04T01:40:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- start start 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1c0158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1c00cda00 0x7fb1c00b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1c00c7ac0 0x7fb1c00c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00c8480 con 0x7fb1a80047d0 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00cf040 con 0x7fb1c00c7ac0 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00b1a10 con 0x7fb1c00cda00 2023-11-04T01:40:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1c0158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1c0158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34634/0 (socket says 172.21.15.40:34634) 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 -- 172.21.15.40:0/1016627265 learned_addr learned my addr 172.21.15.40:0/1016627265 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1c00cda00 0x7fb1c00b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1bed9d640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1c00c7ac0 0x7fb1c00c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 -- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1c00cda00 msgr2=0x7fb1c00b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1c00cda00 0x7fb1c00b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 -- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1c00c7ac0 msgr2=0x7fb1c00c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1c00c7ac0 0x7fb1c00c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 -- 172.21.15.40:0/1016627265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00cdfa0 con 0x7fb1a80047d0 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1c00cda00 0x7fb1c00b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1bed9d640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1c00c7ac0 0x7fb1c00c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1be59c640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1c0158b60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0011980 tx=0x7fb1b0011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000fce0 con 0x7fb1a80047d0 2023-11-04T01:40:50.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b000fe80 con 0x7fb1a80047d0 2023-11-04T01:40:50.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00ce280 con 0x7fb1a80047d0 2023-11-04T01:40:50.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0015650 con 0x7fb1a80047d0 2023-11-04T01:40:50.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.131+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c00ce840 con 0x7fb1a80047d0 2023-11-04T01:40:50.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.135+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c006c600 con 0x7fb1a80047d0 2023-11-04T01:40:50.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.135+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1b00157b0 con 0x7fb1a80047d0 2023-11-04T01:40:50.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.135+0000 7fb1aeffd640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1a00664a0 0x7fb1a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.135+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb1b0087430 con 0x7fb1a80047d0 2023-11-04T01:40:50.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.135+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1a00664a0 0x7fb1a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.135+0000 7fb1bdd9b640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1a00664a0 0x7fb1a0068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40af000 tx=0x7fb1b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.139+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1b0054830 con 0x7fb1a80047d0 2023-11-04T01:40:50.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.291+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1c00675f0 con 0x7fb1a80047d0 2023-11-04T01:40:50.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.291+0000 7fb1aeffd640 1 -- 172.21.15.40:0/1016627265 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fb1b0057e50 con 0x7fb1a80047d0 2023-11-04T01:40:50.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:50.297 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:50.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1a00664a0 msgr2=0x7fb1a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1a00664a0 0x7fb1a0068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40af000 tx=0x7fb1b4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 msgr2=0x7fb1c0158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1c0158b60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0011980 tx=0x7fb1b0011e40 comp rx=0 tx=0).stop 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 shutdown_connections 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1a00664a0 0x7fb1a0068960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1c00c7ac0 0x7fb1c00c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1c00cda00 0x7fb1c00b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 --2- 172.21.15.40:0/1016627265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a80047d0 0x7fb1c0158b60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 >> 172.21.15.40:0/1016627265 conn(0x7fb1c00716a0 msgr2=0x7fb1c015ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 shutdown_connections 2023-11-04T01:40:50.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.295+0000 7fb1c4a63640 1 -- 172.21.15.40:0/1016627265 wait complete. 2023-11-04T01:40:50.315 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:40:50.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.435+0000 7f212360a640 1 Processor -- start 2023-11-04T01:40:50.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.435+0000 7f212360a640 1 -- start start 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f212360a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f211c0b1d40 0x7f211c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f212360a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f211c15cd60 0x7f211c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f212360a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0cdc80 con 0x7f211c0b1960 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f212360a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c071e40 con 0x7f211c15cd60 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f212360a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c15d710 con 0x7f211c0b1d40 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2121ba7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f211c15cd60 0x7f211c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f21213a6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f211c0b1960 0x7f211c0ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45038/0 (socket says 172.21.15.40:45038) 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f21213a6640 1 -- 172.21.15.40:0/1125497635 learned_addr learned my addr 172.21.15.40:0/1125497635 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2120ba5640 1 --2- 172.21.15.40:0/1125497635 >> v2:172.21.15.91:3300/0 conn(0x7f211c0b1d40 0x7f211c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2121ba7640 1 -- 172.21.15.40:0/1125497635 >> v2:172.21.15.91:3300/0 conn(0x7f211c0b1d40 msgr2=0x7f211c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2121ba7640 1 --2- 172.21.15.40:0/1125497635 >> v2:172.21.15.91:3300/0 conn(0x7f211c0b1d40 0x7f211c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2113fff640 1 -- 172.21.15.40:0/1125497635 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915671915 0 0) 0x7f211c0cdc80 con 0x7f211c0b1960 2023-11-04T01:40:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2121ba7640 1 -- 172.21.15.40:0/1125497635 >> v1:172.21.15.40:6789/0 conn(0x7f211c0b1960 legacy=0x7f211c0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.439+0000 7f2121ba7640 1 -- 172.21.15.40:0/1125497635 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0cf5a0 con 0x7f211c15cd60 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2121ba7640 1 --2- 172.21.15.40:0/1125497635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c15cd60 0x7f211c15d1d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f211c0af6b0 tx=0x7f211401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6201c2bc3b2a2b1e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2113fff640 1 -- 172.21.15.40:0/1125497635 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140ab600 con 0x7f211c15cd60 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2113fff640 1 -- 172.21.15.40:0/1125497635 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21140a7050 con 0x7f211c15cd60 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2113fff640 1 -- 172.21.15.40:0/1125497635 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140ab980 con 0x7f211c15cd60 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1125497635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c15cd60 msgr2=0x7f211c15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 --2- 172.21.15.40:0/1125497635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c15cd60 0x7f211c15d1d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f211c0af6b0 tx=0x7f211401c430 comp rx=0 tx=0).stop 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1125497635 shutdown_connections 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 --2- 172.21.15.40:0/1125497635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c15cd60 0x7f211c15d1d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 --2- 172.21.15.40:0/1125497635 >> v2:172.21.15.91:3300/0 conn(0x7f211c0b1d40 0x7f211c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1125497635 >> 172.21.15.40:0/1125497635 conn(0x7f211c06e760 msgr2=0x7f211c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1125497635 shutdown_connections 2023-11-04T01:40:50.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1125497635 wait complete. 2023-11-04T01:40:50.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 Processor -- start 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- start start 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 0x7f211c0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f211c0b1d40 0x7f211c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f211c15cd60 0x7f211c1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c1604d0 con 0x7f211c0b1960 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0c9720 con 0x7f211c0b1d40 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15d8e0 con 0x7f211c15cd60 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 0x7f211c0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 0x7f211c0c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34652/0 (socket says 172.21.15.40:34652) 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 -- 172.21.15.40:0/1830601753 learned_addr learned my addr 172.21.15.40:0/1830601753 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 -- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f211c15cd60 msgr2=0x7f211c1f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f211c15cd60 0x7f211c1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 -- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f211c0b1d40 msgr2=0x7f211c15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f211c0b1d40 0x7f211c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 -- 172.21.15.40:0/1830601753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009420 con 0x7f211c0b1960 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f21213a6640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 0x7f211c0c8610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2118001570 tx=0x7f211800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800a640 con 0x7f211c0b1960 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211800a7c0 con 0x7f211c0b1960 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c1f5cd0 con 0x7f211c0b1960 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800ab70 con 0x7f211c0b1960 2023-11-04T01:40:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.443+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c1f6290 con 0x7f211c0b1960 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.447+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c15da90 con 0x7f211c0b1960 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.447+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f211800acd0 con 0x7f211c0b1960 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.447+0000 7f2111ffb640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21000664d0 0x7f2100068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.447+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2118083700 con 0x7f211c0b1960 2023-11-04T01:40:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.447+0000 7f2120ba5640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21000664d0 0x7f2100068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.447+0000 7f2120ba5640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21000664d0 0x7f2100068990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f211c1f6620 tx=0x7f210c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.451+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f211c15da90 con 0x7f211c0b1960 2023-11-04T01:40:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.639+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f211c15da50 con 0x7f211c0b1960 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.639+0000 7f2111ffb640 1 -- 172.21.15.40:0/1830601753 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f2118050b90 con 0x7f211c0b1960 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21000664d0 msgr2=0x7f2100068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21000664d0 0x7f2100068990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f211c1f6620 tx=0x7f210c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 msgr2=0x7f211c0c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 0x7f211c0c8610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2118001570 tx=0x7f211800cd20 comp rx=0 tx=0).stop 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 shutdown_connections 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f21000664d0 0x7f2100068990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f211c15cd60 0x7f211c1f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f211c0b1d40 0x7f211c15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 --2- 172.21.15.40:0/1830601753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211c0b1960 0x7f211c0c8610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 >> 172.21.15.40:0/1830601753 conn(0x7f211c06e760 msgr2=0x7f211c0cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 shutdown_connections 2023-11-04T01:40:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.643+0000 7f212360a640 1 -- 172.21.15.40:0/1830601753 wait complete. 2023-11-04T01:40:50.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:50.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 Processor -- start 2023-11-04T01:40:50.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 -- start start 2023-11-04T01:40:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 0x7ff7080715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff7080b0d40 0x7ff70815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7080c2670 con 0x7ff70806f8f0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff708070140 con 0x7ff7080b0d40 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70cc35640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70806c9f0 con 0x7ff70815afd0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff705d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff70806f8f0 0x7ff7080b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45044/0 (socket says 172.21.15.40:45044) 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff705d9b640 1 -- 172.21.15.40:0/3975945384 learned_addr learned my addr 172.21.15.40:0/3975945384 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 0x7ff7080715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff706d9d640 1 --2- 172.21.15.40:0/3975945384 >> v2:172.21.15.91:3300/0 conn(0x7ff7080b0d40 0x7ff70815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255570460 0 0) 0x7ff7080c2670 con 0x7ff70806f8f0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f4003530 con 0x7ff70806f8f0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4247011931 0 0) 0x7ff6f4003530 con 0x7ff70806f8f0 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 msgr2=0x7ff7080715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 0x7ff7080715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 >> v2:172.21.15.91:3300/0 conn(0x7ff7080b0d40 msgr2=0x7ff70815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 --2- 172.21.15.40:0/3975945384 >> v2:172.21.15.91:3300/0 conn(0x7ff7080b0d40 0x7ff70815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70806bc30 con 0x7ff70806f8f0 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff6f0001680 con 0x7ff70806f8f0 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 >> v1:172.21.15.40:6789/0 conn(0x7ff70806f8f0 legacy=0x7ff7080b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff6f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 0x7ff6f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f4004d10 0x7ff6f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff708070140 con 0x7ff6f40039b0 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70806c9f0 con 0x7ff6f4004d10 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f400b990 con 0x7ff70815afd0 2023-11-04T01:40:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff6f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 -- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 msgr2=0x7ff6f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff705d9b640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 0x7ff6f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff706d9d640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f4004d10 0x7ff6f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff70815afd0 0x7ff6f40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 -- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f4004d10 msgr2=0x7ff6f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6f4004d10 0x7ff6f4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.783+0000 7ff70659c640 1 -- 172.21.15.40:0/3975945384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4003530 con 0x7ff6f40039b0 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70659c640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff6f4003dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800e170 tx=0x7ff6f801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d930cdacc394a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80a5b10 con 0x7ff6f40039b0 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f800f040 con 0x7ff6f40039b0 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70559a640 1 -- 172.21.15.40:0/3975945384 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80ad440 con 0x7ff6f40039b0 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 -- 172.21.15.40:0/3975945384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 msgr2=0x7ff6f4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3975945384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff6f4003dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800e170 tx=0x7ff6f801cc10 comp rx=0 tx=0).stop 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff706d9d640 1 -- 172.21.15.40:0/3975945384 reap_dead start 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 -- 172.21.15.40:0/3975945384 shutdown_connections 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 -- 172.21.15.40:0/3975945384 >> 172.21.15.40:0/3975945384 conn(0x7ff7080cebb0 msgr2=0x7ff7080cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 -- 172.21.15.40:0/3975945384 shutdown_connections 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 -- 172.21.15.40:0/3975945384 wait complete. 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 Processor -- start 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.787+0000 7ff70cc35640 1 -- start start 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff7080c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7080b17d0 0x7ff7081f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7080c65c0 0x7ff7080c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70815c730 con 0x7ff6f40039b0 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7081f2780 con 0x7ff7080c65c0 2023-11-04T01:40:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff708146d30 con 0x7ff7080b17d0 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff7080c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff7080c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34668/0 (socket says 172.21.15.40:34668) 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 -- 172.21.15.40:0/3951179317 learned_addr learned my addr 172.21.15.40:0/3951179317 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff705d9b640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7080b17d0 0x7ff7081f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff706d9d640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7080c65c0 0x7ff7080c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 -- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7080b17d0 msgr2=0x7ff7081f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7080b17d0 0x7ff7081f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 -- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7080c65c0 msgr2=0x7ff7080c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7080c65c0 0x7ff7080c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 -- 172.21.15.40:0/3951179317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70815c3a0 con 0x7ff6f40039b0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff706d9d640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7080c65c0 0x7ff7080c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70659c640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff7080c85f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff6f801ca40 tx=0x7ff6f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80ad640 con 0x7ff6f40039b0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f80ad7a0 con 0x7ff6f40039b0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7080b4490 con 0x7ff6f40039b0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80adb30 con 0x7ff6f40039b0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70815cb50 con 0x7ff6f40039b0 2023-11-04T01:40:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7080744a0 con 0x7ff6f40039b0 2023-11-04T01:40:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6f80b4040 con 0x7ff6f40039b0 2023-11-04T01:40:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff6feffd640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6e80664d0 0x7ff6e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff6f811e850 con 0x7ff6f40039b0 2023-11-04T01:40:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff705d9b640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6e80664d0 0x7ff6e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.791+0000 7ff705d9b640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6e80664d0 0x7ff6e8068990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001210 tx=0x7ff6f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.795+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6f80ebe10 con 0x7ff6f40039b0 2023-11-04T01:40:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7080b1bb0 con 0x7ff6f40039b0 2023-11-04T01:40:50.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff6feffd640 1 -- 172.21.15.40:0/3951179317 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff6f80ef430 con 0x7ff6f40039b0 2023-11-04T01:40:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:50.984 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2152899070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2152899070},{"type":"v1","addr":"172.21.15.91:6835","nonce":2152899070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2196632484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2196632484},{"type":"v1","addr":"172.21.15.91:6837","nonce":2196632484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1098502170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1098502170},{"type":"v1","addr":"172.21.15.40:6833","nonce":1098502170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:39:57.440417+0000","modified":"2023-11-04T01:39:59.453939+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/2082160457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2082160457},{"type":"v1","addr":"172.21.15.40:6835","nonce":2082160457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6e80664d0 msgr2=0x7ff6e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6e80664d0 0x7ff6e8068990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001210 tx=0x7ff6f0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 msgr2=0x7ff7080c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff7080c85f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff6f801ca40 tx=0x7ff6f8009750 comp rx=0 tx=0).stop 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 shutdown_connections 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6e80664d0 0x7ff6e8068990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7080c65c0 0x7ff7080c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7080b17d0 0x7ff7081f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 --2- 172.21.15.40:0/3951179317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f40039b0 0x7ff7080c85f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.979+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 >> 172.21.15.40:0/3951179317 conn(0x7ff7080cebb0 msgr2=0x7ff7080aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.983+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 shutdown_connections 2023-11-04T01:40:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:50.983+0000 7ff70cc35640 1 -- 172.21.15.40:0/3951179317 wait complete. 2023-11-04T01:40:51.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2474235640 1 Processor -- start 2023-11-04T01:40:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2474235640 1 -- start start 2023-11-04T01:40:51.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2474235640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f246c0d0690 0x7f246c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2474235640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0b6070 con 0x7f246c0d0ae0 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2474235640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0b8ed0 con 0x7f246c0b4990 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2474235640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0d1ce0 con 0x7f246c0d0690 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f246c0d0ae0 0x7f246c0b6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45060/0 (socket says 172.21.15.40:45060) 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 -- 172.21.15.40:0/384627278 learned_addr learned my addr 172.21.15.40:0/384627278 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370735780 0 0) 0x7f246c0b6070 con 0x7f246c0d0ae0 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24717d0640 1 --2- 172.21.15.40:0/384627278 >> v2:172.21.15.91:3300/0 conn(0x7f246c0d0690 0x7f246c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2458003530 con 0x7f246c0d0ae0 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521421035 0 0) 0x7f2458003530 con 0x7f246c0d0ae0 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 >> v2:172.21.15.91:3300/0 conn(0x7f246c0d0690 msgr2=0x7f246c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 --2- 172.21.15.40:0/384627278 >> v2:172.21.15.91:3300/0 conn(0x7f246c0d0690 0x7f246c0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 >> v1:172.21.15.91:6789/0 conn(0x7f246c0b4990 legacy=0x7f246c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0d1fc0 con 0x7f246c0d0ae0 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f2468001680 con 0x7f246c0d0ae0 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24717d0640 1 --2- 172.21.15.40:0/384627278 >> v2:172.21.15.91:3300/0 conn(0x7f246c0d0690 0x7f246c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 >> v1:172.21.15.40:6789/0 conn(0x7f246c0d0ae0 legacy=0x7f246c0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2458003980 0x7f2458003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f24580047d0 0x7f2458004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2458005190 0x7f245800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0d1ce0 con 0x7f2458005190 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245800c0c0 con 0x7f2458003980 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245800c280 con 0x7f24580047d0 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2458005190 0x7f245800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f2471fd1640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2458003980 0x7f2458003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24717d0640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f24580047d0 0x7f2458004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 -- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f24580047d0 msgr2=0x7f2458004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f24580047d0 0x7f2458004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 -- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2458003980 msgr2=0x7f2458003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2458003980 0x7f2458003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24727d2640 1 -- 172.21.15.40:0/384627278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458003530 con 0x7f2458005190 2023-11-04T01:40:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.107+0000 7f24717d0640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f24580047d0 0x7f2458004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 -- 172.21.15.40:0/384627278 reap_dead start 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2458005190 0x7f245800b990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f246800c210 tx=0x7f246801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a52e8c56916b305 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680a5b20 con 0x7f2458005190 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24680a5c80 con 0x7f2458005190 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2470fcf640 1 -- 172.21.15.40:0/384627278 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680058e0 con 0x7f2458005190 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- 172.21.15.40:0/384627278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2458005190 msgr2=0x7f245800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2458005190 0x7f245800b990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f246800c210 tx=0x7f246801cc20 comp rx=0 tx=0).stop 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- 172.21.15.40:0/384627278 shutdown_connections 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 --2- 172.21.15.40:0/384627278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2458005190 0x7f245800b990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- 172.21.15.40:0/384627278 >> 172.21.15.40:0/384627278 conn(0x7f246c0cf990 msgr2=0x7f246c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- 172.21.15.40:0/384627278 shutdown_connections 2023-11-04T01:40:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- 172.21.15.40:0/384627278 wait complete. 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 Processor -- start 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- start start 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2458005190 0x7f246c1f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f246c1f3910 0x7f246c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 0x7f246c0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1f2720 con 0x7f246c0c9fe0 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1f3d90 con 0x7f246c1f3910 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2474235640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c1f4030 con 0x7f2458005190 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 0x7f246c0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 0x7f246c0aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34686/0 (socket says 172.21.15.40:34686) 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 -- 172.21.15.40:0/3880455659 learned_addr learned my addr 172.21.15.40:0/3880455659 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24717d0640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f246c1f3910 0x7f246c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2471fd1640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2458005190 0x7f246c1f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 -- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2458005190 msgr2=0x7f246c1f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2458005190 0x7f246c1f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 -- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f246c1f3910 msgr2=0x7f246c1f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f246c1f3910 0x7f246c1f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 -- 172.21.15.40:0/3880455659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c1f4310 con 0x7f246c0c9fe0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f2471fd1640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2458005190 0x7f246c1f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24727d2640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 0x7f246c0aa260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f246801d4c0 tx=0x7f2458005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24680049f0 con 0x7f246c0c9fe0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468004b50 con 0x7f246c0c9fe0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.111+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468007090 con 0x7f246c0c9fe0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c1f45f0 con 0x7f246c0c9fe0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c1f4bb0 con 0x7f246c0c9fe0 2023-11-04T01:40:51.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c1f4da0 con 0x7f246c0c9fe0 2023-11-04T01:40:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24680071f0 con 0x7f246c0c9fe0 2023-11-04T01:40:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f24627fc640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24500664d0 0x7f2450068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f24680b3020 con 0x7f246c0c9fe0 2023-11-04T01:40:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f2471fd1640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24500664d0 0x7f2450068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.115+0000 7f2471fd1640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24500664d0 0x7f2450068990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f246c0b1b60 tx=0x7f2464009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.119+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24680eb070 con 0x7f246c0c9fe0 2023-11-04T01:40:51.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.267+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f246c0744a0 con 0x7f246c0c9fe0 2023-11-04T01:40:51.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.271+0000 7f24627fc640 1 -- 172.21.15.40:0/3880455659 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f24680ee690 con 0x7f246c0c9fe0 2023-11-04T01:40:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:51.276 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:39.188566+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:39:55.526771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:39:56.421275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:51.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24500664d0 msgr2=0x7f2450068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24500664d0 0x7f2450068990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f246c0b1b60 tx=0x7f2464009040 comp rx=0 tx=0).stop 2023-11-04T01:40:51.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 msgr2=0x7f246c0aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 0x7f246c0aa260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f246801d4c0 tx=0x7f2458005800 comp rx=0 tx=0).stop 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 shutdown_connections 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24500664d0 0x7f2450068990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f246c0c9fe0 0x7f246c0aa260 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f246c1f3910 0x7f246c1f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 --2- 172.21.15.40:0/3880455659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2458005190 0x7f246c1f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 >> 172.21.15.40:0/3880455659 conn(0x7f246c0cf990 msgr2=0x7f246c0b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 shutdown_connections 2023-11-04T01:40:51.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.275+0000 7f2474235640 1 -- 172.21.15.40:0/3880455659 wait complete. 2023-11-04T01:40:51.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:40:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a7251640 1 Processor -- start 2023-11-04T01:40:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a7251640 1 -- start start 2023-11-04T01:40:51.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a7251640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f13a00aea30 0x7f13a00ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a7251640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00cc6b0 con 0x7f13a0072350 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a7251640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00cf4c0 con 0x7f13a00ae650 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a7251640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a00cd700 con 0x7f13a00aea30 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f13a0072350 0x7f13a00cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45076/0 (socket says 172.21.15.40:45076) 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139ffff640 1 -- 172.21.15.40:0/4005288237 learned_addr learned my addr 172.21.15.40:0/4005288237 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 --2- 172.21.15.40:0/4005288237 >> v2:172.21.15.91:3300/0 conn(0x7f13a00aea30 0x7f13a00ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412251378 0 0) 0x7f13a00cc6b0 con 0x7f13a0072350 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1388003530 con 0x7f13a0072350 2023-11-04T01:40:51.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412002245 0 0) 0x7f1388003530 con 0x7f13a0072350 2023-11-04T01:40:51.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 >> v2:172.21.15.91:3300/0 conn(0x7f13a00aea30 msgr2=0x7f13a00ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 --2- 172.21.15.40:0/4005288237 >> v2:172.21.15.91:3300/0 conn(0x7f13a00aea30 0x7f13a00ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 >> v1:172.21.15.91:6789/0 conn(0x7f13a00ae650 legacy=0x7f13a00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00cc900 con 0x7f13a0072350 2023-11-04T01:40:51.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1394001680 con 0x7f13a0072350 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 >> v1:172.21.15.40:6789/0 conn(0x7f13a0072350 legacy=0x7f13a00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13880039d0 0x7f1388003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880047d0 0x7f1388004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f138800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00cd700 con 0x7f13880052b0 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138800c1b0 con 0x7f13880039d0 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138800c370 con 0x7f13880047d0 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f138800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a4fed640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13880039d0 0x7f1388003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 -- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880047d0 msgr2=0x7f1388004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880047d0 0x7f1388004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 -- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13880039d0 msgr2=0x7f1388003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13880039d0 0x7f1388003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.411+0000 7f13a57ee640 1 -- 172.21.15.40:0/4005288237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388003530 con 0x7f13880052b0 2023-11-04T01:40:51.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a57ee640 1 -- 172.21.15.40:0/4005288237 reap_dead start 2023-11-04T01:40:51.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a57ee640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f138800b990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1390009f90 tx=0x7f139001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb9fc196dc54339 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390003ba0 con 0x7f13880052b0 2023-11-04T01:40:51.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000f040 con 0x7f13880052b0 2023-11-04T01:40:51.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f139f7fe640 1 -- 172.21.15.40:0/4005288237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13900a5900 con 0x7f13880052b0 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 -- 172.21.15.40:0/4005288237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 msgr2=0x7f138800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f138800b990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1390009f90 tx=0x7f139001cc30 comp rx=0 tx=0).stop 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 -- 172.21.15.40:0/4005288237 shutdown_connections 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 --2- 172.21.15.40:0/4005288237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f138800b990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 -- 172.21.15.40:0/4005288237 >> 172.21.15.40:0/4005288237 conn(0x7f13a00716a0 msgr2=0x7f13a0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 -- 172.21.15.40:0/4005288237 shutdown_connections 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 -- 172.21.15.40:0/4005288237 wait complete. 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 Processor -- start 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.415+0000 7f13a7251640 1 -- start start 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f13a0144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a01446c0 0x7f13a014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a014c7b0 0x7f13a0147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a014cc40 con 0x7f13880052b0 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00ac9e0 con 0x7f13a014c7b0 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00ace70 con 0x7f13a01446c0 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f13a0144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f13a0144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34698/0 (socket says 172.21.15.40:34698) 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 -- 172.21.15.40:0/1163231561 learned_addr learned my addr 172.21.15.40:0/1163231561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 -- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a01446c0 msgr2=0x7f13a014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a01446c0 0x7f13a014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 -- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a014c7b0 msgr2=0x7f13a0147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a014c7b0 0x7f13a0147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 -- 172.21.15.40:0/1163231561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00ac0b0 con 0x7f13880052b0 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a4fed640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f13a0144180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f139800e4d0 tx=0x7f139800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980052e0 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398005440 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a00ac390 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398003820 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a0148420 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a00675f0 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1398003980 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139d7fa640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f138c0664a0 0x7f138c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1398084730 con 0x7f13880052b0 2023-11-04T01:40:51.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.419+0000 7f139ffff640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f138c0664a0 0x7f138c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.423+0000 7f139ffff640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f138c0664a0 0x7f138c068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1394001000 tx=0x7f13940078a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.423+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1398051c10 con 0x7f13880052b0 2023-11-04T01:40:51.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.603+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13a00adf80 con 0x7f13880052b0 2023-11-04T01:40:51.610 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:40:51.607+0000 7fde30135640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:40:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f139d7fa640 1 -- 172.21.15.40:0/1163231561 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1398055230 con 0x7f13880052b0 2023-11-04T01:40:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f138c0664a0 msgr2=0x7f138c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f138c0664a0 0x7f138c068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1394001000 tx=0x7f13940078a0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 msgr2=0x7f13a0144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f13a0144180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f139800e4d0 tx=0x7f139800e990 comp rx=0 tx=0).stop 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 shutdown_connections 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f138c0664a0 0x7f138c068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a014c7b0 0x7f13a0147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a01446c0 0x7f13a014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 --2- 172.21.15.40:0/1163231561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880052b0 0x7f13a0144180 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 >> 172.21.15.40:0/1163231561 conn(0x7f13a00716a0 msgr2=0x7f13a006c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 shutdown_connections 2023-11-04T01:40:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.611+0000 7f13a7251640 1 -- 172.21.15.40:0/1163231561 wait complete. 2023-11-04T01:40:51.621 INFO:tasks.ceph.mds.a.smithi040.stderr: -3335> 2023-11-04T01:40:02.044+0000 7f373a33d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:51.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:40:51.660 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:40:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 Processor -- start 2023-11-04T01:40:51.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 -- start start 2023-11-04T01:40:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f115015ad90 0x7f11500b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f115015b170 0x7f11500b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115015f990 con 0x7f11500ca590 2023-11-04T01:40:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115015f570 con 0x7f115015ad90 2023-11-04T01:40:51.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1156f8a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500cb0d0 con 0x7f115015b170 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f115015ad90 0x7f11500b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f115015ad90 0x7f11500b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34728/0 (socket says 172.21.15.40:34728) 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 -- 172.21.15.40:0/138341089 learned_addr learned my addr 172.21.15.40:0/138341089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f114ffff640 1 --2- 172.21.15.40:0/138341089 >> v2:172.21.15.91:3300/0 conn(0x7f115015b170 0x7f11500b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 -- 172.21.15.40:0/138341089 >> v2:172.21.15.91:3300/0 conn(0x7f115015b170 msgr2=0x7f11500b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 --2- 172.21.15.40:0/138341089 >> v2:172.21.15.91:3300/0 conn(0x7f115015b170 0x7f11500b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 -- 172.21.15.40:0/138341089 >> v1:172.21.15.91:6789/0 conn(0x7f11500ca590 legacy=0x7f11500ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f1154d26640 1 -- 172.21.15.40:0/138341089 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115015ec10 con 0x7f115015ad90 2023-11-04T01:40:51.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.739+0000 7f114ffff640 1 --2- 172.21.15.40:0/138341089 >> v2:172.21.15.91:3300/0 conn(0x7f115015b170 0x7f11500b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:51.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1154d26640 1 --2- 172.21.15.40:0/138341089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015ad90 0x7f11500b0510 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f11500ca330 tx=0x7f114001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90037218e464257e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f114f7fe640 1 -- 172.21.15.40:0/138341089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11400ad660 con 0x7f115015ad90 2023-11-04T01:40:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f114f7fe640 1 -- 172.21.15.40:0/138341089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11400ad7c0 con 0x7f115015ad90 2023-11-04T01:40:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f114f7fe640 1 -- 172.21.15.40:0/138341089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11400adb50 con 0x7f115015ad90 2023-11-04T01:40:51.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 -- 172.21.15.40:0/138341089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015ad90 msgr2=0x7f11500b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 --2- 172.21.15.40:0/138341089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015ad90 0x7f11500b0510 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f11500ca330 tx=0x7f114001c470 comp rx=0 tx=0).stop 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 -- 172.21.15.40:0/138341089 shutdown_connections 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 --2- 172.21.15.40:0/138341089 >> v2:172.21.15.91:3300/0 conn(0x7f115015b170 0x7f11500b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 --2- 172.21.15.40:0/138341089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015ad90 0x7f11500b0510 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 -- 172.21.15.40:0/138341089 >> 172.21.15.40:0/138341089 conn(0x7f11500cb510 msgr2=0x7f11500cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 -- 172.21.15.40:0/138341089 shutdown_connections 2023-11-04T01:40:51.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.743+0000 7f1156f8a640 1 -- 172.21.15.40:0/138341089 wait complete. 2023-11-04T01:40:51.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 Processor -- start 2023-11-04T01:40:51.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- start start 2023-11-04T01:40:51.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11500ca590 0x7f11500c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f115015ad90 0x7f115014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 0x7f11501501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150155520 con 0x7f115015b170 2023-11-04T01:40:51.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115015bea0 con 0x7f11500ca590 2023-11-04T01:40:51.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115015c180 con 0x7f115015ad90 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 0x7f11501501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 0x7f11501501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34742/0 (socket says 172.21.15.40:34742) 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 -- 172.21.15.40:0/3324696086 learned_addr learned my addr 172.21.15.40:0/3324696086 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1154d26640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11500ca590 0x7f11500c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f114ffff640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f115015ad90 0x7f115014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 -- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f115015ad90 msgr2=0x7f115014fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f115015ad90 0x7f115014fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 -- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11500ca590 msgr2=0x7f11500c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11500ca590 0x7f11500c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 -- 172.21.15.40:0/3324696086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400094d0 con 0x7f115015b170 2023-11-04T01:40:51.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1155527640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 0x7f11501501f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f114800c730 tx=0x7f114800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148003b80 con 0x7f115015b170 2023-11-04T01:40:51.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1148003ce0 con 0x7f115015b170 2023-11-04T01:40:51.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115015c460 con 0x7f115015b170 2023-11-04T01:40:51.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800aa30 con 0x7f115015b170 2023-11-04T01:40:51.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11500c9860 con 0x7f115015b170 2023-11-04T01:40:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11500744a0 con 0x7f115015b170 2023-11-04T01:40:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.747+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f114800ab90 con 0x7f115015b170 2023-11-04T01:40:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.751+0000 7f114d7fa640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f113c0664a0 0x7f113c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.751+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f1148083a10 con 0x7f115015b170 2023-11-04T01:40:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.751+0000 7f1154d26640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f113c0664a0 0x7f113c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.751+0000 7f1154d26640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f113c0664a0 0x7f113c068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f11400af000 tx=0x7f1140008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.755+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1148050e50 con 0x7f115015b170 2023-11-04T01:40:51.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:51.939+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f115015f990 con 0x7f115015b170 2023-11-04T01:40:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.619+0000 7f114d7fa640 1 -- 172.21.15.40:0/3324696086 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f115015f990 con 0x7f115015b170 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f113c0664a0 msgr2=0x7f113c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f113c0664a0 0x7f113c068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f11400af000 tx=0x7f1140008040 comp rx=0 tx=0).stop 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 msgr2=0x7f11501501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 0x7f11501501f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f114800c730 tx=0x7f114800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 shutdown_connections 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f113c0664a0 0x7f113c068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115015b170 0x7f11501501f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f115015ad90 0x7f115014fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 --2- 172.21.15.40:0/3324696086 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11500ca590 0x7f11500c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 >> 172.21.15.40:0/3324696086 conn(0x7f11500cb510 msgr2=0x7f1150158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 shutdown_connections 2023-11-04T01:40:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.623+0000 7f1156f8a640 1 -- 172.21.15.40:0/3324696086 wait complete. 2023-11-04T01:40:52.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:40:52.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 Processor -- start 2023-11-04T01:40:52.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 -- start start 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f66b415ce30 0x7f66b40ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66b40cc630 0x7f66b41614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b40cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b4161010 con 0x7f66b40cc630 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b40cbdd0 con 0x7f66b415ce30 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66baae2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40cd340 con 0x7f66b40cb440 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66b40cc630 0x7f66b41614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66b40cc630 0x7f66b41614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34752/0 (socket says 172.21.15.40:34752) 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 -- 172.21.15.40:0/1562921392 learned_addr learned my addr 172.21.15.40:0/1562921392 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b907f640 1 --2- 172.21.15.40:0/1562921392 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b40cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b887e640 1 --2- 172.21.15.40:0/1562921392 >> v2:172.21.15.91:3300/0 conn(0x7f66b415ce30 0x7f66b40ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 -- 172.21.15.40:0/1562921392 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 msgr2=0x7f66b40cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 --2- 172.21.15.40:0/1562921392 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b40cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 -- 172.21.15.40:0/1562921392 >> v2:172.21.15.91:3300/0 conn(0x7f66b415ce30 msgr2=0x7f66b40ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 --2- 172.21.15.40:0/1562921392 >> v2:172.21.15.91:3300/0 conn(0x7f66b415ce30 0x7f66b40ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.819+0000 7f66b3fff640 1 -- 172.21.15.40:0/1562921392 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b40ccac0 con 0x7f66b40cc630 2023-11-04T01:40:52.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66b3fff640 1 --2- 172.21.15.40:0/1562921392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b41614a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cccb0 tx=0x7f669c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc66b4e044429cf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66b37fe640 1 -- 172.21.15.40:0/1562921392 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0aa5f0 con 0x7f66b40cc630 2023-11-04T01:40:52.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66b37fe640 1 -- 172.21.15.40:0/1562921392 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c0aa750 con 0x7f66b40cc630 2023-11-04T01:40:52.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66b37fe640 1 -- 172.21.15.40:0/1562921392 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0aaae0 con 0x7f66b40cc630 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 -- 172.21.15.40:0/1562921392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 msgr2=0x7f66b41614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 --2- 172.21.15.40:0/1562921392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b41614a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f66b40cccb0 tx=0x7f669c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 -- 172.21.15.40:0/1562921392 shutdown_connections 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 --2- 172.21.15.40:0/1562921392 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b40cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 --2- 172.21.15.40:0/1562921392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b41614a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 --2- 172.21.15.40:0/1562921392 >> v2:172.21.15.91:3300/0 conn(0x7f66b415ce30 0x7f66b40ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 -- 172.21.15.40:0/1562921392 >> 172.21.15.40:0/1562921392 conn(0x7f66b40b0630 msgr2=0x7f66b40b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 -- 172.21.15.40:0/1562921392 shutdown_connections 2023-11-04T01:40:52.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.823+0000 7f66baae2640 1 -- 172.21.15.40:0/1562921392 wait complete. 2023-11-04T01:40:52.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 Processor -- start 2023-11-04T01:40:52.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- start start 2023-11-04T01:40:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b4154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66b415ce30 0x7f66b415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b4155360 con 0x7f66b40cc630 2023-11-04T01:40:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b25d0 con 0x7f66b415ce30 2023-11-04T01:40:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b28b0 con 0x7f66b40cb440 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b40ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34764/0 (socket says 172.21.15.40:34764) 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 -- 172.21.15.40:0/932089288 learned_addr learned my addr 172.21.15.40:0/932089288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b887e640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b4154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b907f640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66b415ce30 0x7f66b415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 -- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 msgr2=0x7f66b4154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b4154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 -- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66b415ce30 msgr2=0x7f66b415f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66b415ce30 0x7f66b415f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 -- 172.21.15.40:0/932089288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0094d0 con 0x7f66b40cc630 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b887e640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b4154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b3fff640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b40ca660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f669c01ab80 tx=0x7f669c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0bd5f0 con 0x7f66b40cc630 2023-11-04T01:40:52.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c0bd750 con 0x7f66b40cc630 2023-11-04T01:40:52.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b40b2b90 con 0x7f66b40cc630 2023-11-04T01:40:52.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0bdac0 con 0x7f66b40cc630 2023-11-04T01:40:52.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b40b3150 con 0x7f66b40cc630 2023-11-04T01:40:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.827+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b40744a0 con 0x7f66b40cc630 2023-11-04T01:40:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.831+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f669c0b33f0 con 0x7f66b40cc630 2023-11-04T01:40:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.831+0000 7f66b17fa640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66940664a0 0x7f6694068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.831+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f669c0a7070 con 0x7f66b40cc630 2023-11-04T01:40:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.831+0000 7f66b887e640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66940664a0 0x7f6694068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.831+0000 7f66b887e640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66940664a0 0x7f6694068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009fd0 tx=0x7f66a400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.835+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f669c0ec450 con 0x7f66b40cc630 2023-11-04T01:40:52.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:52.991+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66b40cf3c0 con 0x7f66b40cc630 2023-11-04T01:40:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.875+0000 7f66b17fa640 1 -- 172.21.15.40:0/932089288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f669c0efa70 con 0x7f66b40cc630 2023-11-04T01:40:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:40:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66940664a0 msgr2=0x7f6694068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66940664a0 0x7f6694068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009fd0 tx=0x7f66a400b040 comp rx=0 tx=0).stop 2023-11-04T01:40:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 msgr2=0x7f66b40ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b40ca660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f669c01ab80 tx=0x7f669c01ad10 comp rx=0 tx=0).stop 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 shutdown_connections 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66940664a0 0x7f6694068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66b415ce30 0x7f66b415f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40cc630 0x7f66b40ca660 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 --2- 172.21.15.40:0/932089288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66b40cb440 0x7f66b4154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 >> 172.21.15.40:0/932089288 conn(0x7f66b40b0630 msgr2=0x7f66b40712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 shutdown_connections 2023-11-04T01:40:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:53.879+0000 7f66baae2640 1 -- 172.21.15.40:0/932089288 wait complete. 2023-11-04T01:40:53.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:40:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb23d2fa640 1 Processor -- start 2023-11-04T01:40:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb23d2fa640 1 -- start start 2023-11-04T01:40:54.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb23d2fa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb23815ae60 0x7fb2380cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb23d2fa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23815f8a0 con 0x7fb23806b320 2023-11-04T01:40:54.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb23d2fa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23815ea00 con 0x7fb2380ca440 2023-11-04T01:40:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb23d2fa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23815b240 con 0x7fb23815ae60 2023-11-04T01:40:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb236ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb23815ae60 0x7fb2380cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb236ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb23815ae60 0x7fb2380cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34776/0 (socket says 172.21.15.40:34776) 2023-11-04T01:40:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.043+0000 7fb236ffd640 1 -- 172.21.15.40:0/549150414 learned_addr learned my addr 172.21.15.40:0/549150414 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb236ffd640 1 -- 172.21.15.40:0/549150414 >> v1:172.21.15.91:6789/0 conn(0x7fb2380ca440 legacy=0x7fb23815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb236ffd640 1 -- 172.21.15.40:0/549150414 >> v1:172.21.15.40:6789/0 conn(0x7fb23806b320 legacy=0x7fb23806b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb236ffd640 1 -- 172.21.15.40:0/549150414 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23806cda0 con 0x7fb23815ae60 2023-11-04T01:40:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb236ffd640 1 --2- 172.21.15.40:0/549150414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380cab10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb228009870 tx=0x7fb22801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4b3ee702f22d90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb2367fc640 1 -- 172.21.15.40:0/549150414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280aa430 con 0x7fb23815ae60 2023-11-04T01:40:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb2367fc640 1 -- 172.21.15.40:0/549150414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2280aa590 con 0x7fb23815ae60 2023-11-04T01:40:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb2367fc640 1 -- 172.21.15.40:0/549150414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280aa920 con 0x7fb23815ae60 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 -- 172.21.15.40:0/549150414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 msgr2=0x7fb2380cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/549150414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380cab10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb228009870 tx=0x7fb22801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 -- 172.21.15.40:0/549150414 shutdown_connections 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/549150414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380cab10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 -- 172.21.15.40:0/549150414 >> 172.21.15.40:0/549150414 conn(0x7fb2380b0630 msgr2=0x7fb2380b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 -- 172.21.15.40:0/549150414 shutdown_connections 2023-11-04T01:40:54.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.047+0000 7fb23d2fa640 1 -- 172.21.15.40:0/549150414 wait complete. 2023-11-04T01:40:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 Processor -- start 2023-11-04T01:40:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- start start 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23806b320 0x7fb238151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2380ca440 0x7fb238146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23815c4c0 con 0x7fb23815ae60 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb238149d20 con 0x7fb2380ca440 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23815c1e0 con 0x7fb23806b320 2023-11-04T01:40:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34782/0 (socket says 172.21.15.40:34782) 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 -- 172.21.15.40:0/2567582745 learned_addr learned my addr 172.21.15.40:0/2567582745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 -- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23806b320 msgr2=0x7fb238151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23806b320 0x7fb238151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 -- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2380ca440 msgr2=0x7fb238146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2380ca440 0x7fb238146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 -- 172.21.15.40:0/2567582745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094d0 con 0x7fb23815ae60 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb2377fe640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380c3c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c770 tx=0x7fb23000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230003b80 con 0x7fb23815ae60 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230003ce0 con 0x7fb23815ae60 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb238156f80 con 0x7fb23815ae60 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000aa90 con 0x7fb23815ae60 2023-11-04T01:40:54.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb238157540 con 0x7fb23815ae60 2023-11-04T01:40:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb238156de0 con 0x7fb23815ae60 2023-11-04T01:40:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb23000abf0 con 0x7fb23815ae60 2023-11-04T01:40:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb22ffff640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2180664a0 0x7fb218068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.051+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fb230083b60 con 0x7fb23815ae60 2023-11-04T01:40:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.055+0000 7fb236ffd640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2180664a0 0x7fb218068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.055+0000 7fb236ffd640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2180664a0 0x7fb218068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ae000 tx=0x7fb228008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.059+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb238156de0 con 0x7fb23815ae60 2023-11-04T01:40:54.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.215+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb238156de0 con 0x7fb23815ae60 2023-11-04T01:40:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.879+0000 7fb22ffff640 1 -- 172.21.15.40:0/2567582745 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb238156de0 con 0x7fb23815ae60 2023-11-04T01:40:54.883 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2180664a0 msgr2=0x7fb218068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2180664a0 0x7fb218068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ae000 tx=0x7fb228008040 comp rx=0 tx=0).stop 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 msgr2=0x7fb2380c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380c3c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c770 tx=0x7fb23000cc30 comp rx=0 tx=0).stop 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 shutdown_connections 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2180664a0 0x7fb218068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23815ae60 0x7fb2380c3c10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2380ca440 0x7fb238146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 --2- 172.21.15.40:0/2567582745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23806b320 0x7fb238151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 >> 172.21.15.40:0/2567582745 conn(0x7fb2380b0630 msgr2=0x7fb23814cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 shutdown_connections 2023-11-04T01:40:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:54.883+0000 7fb23d2fa640 1 -- 172.21.15.40:0/2567582745 wait complete. 2023-11-04T01:40:54.917 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:40:54.917 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:40:54.917 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:40:54.918 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:54.918 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:40:54.918 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:40:54.918 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:40:54.918 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:54.918 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:40:54.918 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:40:54.919 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:40:54.919 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:54.919 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:40:54.919 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:40:54.919 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:40:54.919 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:54.931 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:40:54.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:40:54.934 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:40:54.934 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:40:54.935 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:40:54.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:40:54.940 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:40:54.940 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:40:54.979 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:40:54.979 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:54.980 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:40:54.980 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:54.982 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:40:54.982 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:54.984 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:40:54.984 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:54.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:40:55.043 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:40:55.047 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:40:55.050 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:40:55.055 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:40:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 Processor -- start 2023-11-04T01:40:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 -- start start 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbbe40cdea0 0x7fbbe40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40ccee0 con 0x7fbbe40ca400 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe415a5d0 con 0x7fbbe40cdea0 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbebd60640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40ca900 con 0x7fbbe415a1f0 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbe92fb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbbe40cdea0 0x7fbbe40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbea2fd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbbe40ca400 0x7fbbe40704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45098/0 (socket says 172.21.15.40:45098) 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbea2fd640 1 -- 172.21.15.40:0/267057955 learned_addr learned my addr 172.21.15.40:0/267057955 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.099+0000 7fbbe9afc640 1 --2- 172.21.15.40:0/267057955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe92fb640 1 -- 172.21.15.40:0/267057955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 msgr2=0x7fbbe40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe92fb640 1 --2- 172.21.15.40:0/267057955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe92fb640 1 -- 172.21.15.40:0/267057955 >> v1:172.21.15.40:6789/0 conn(0x7fbbe40ca400 legacy=0x7fbbe40704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe92fb640 1 -- 172.21.15.40:0/267057955 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40cabe0 con 0x7fbbe40cdea0 2023-11-04T01:40:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe8afa640 1 -- 172.21.15.40:0/267057955 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761209309 0 0) 0x7fbbe40ccee0 con 0x7fbbe40ca400 2023-11-04T01:40:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe92fb640 1 --2- 172.21.15.40:0/267057955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe40b0630 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40097c0 tx=0x7fbbd401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7391fce81c9f91da server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe8afa640 1 -- 172.21.15.40:0/267057955 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40ab650 con 0x7fbbe40cdea0 2023-11-04T01:40:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe8afa640 1 -- 172.21.15.40:0/267057955 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40ab7b0 con 0x7fbbe40cdea0 2023-11-04T01:40:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbe8afa640 1 -- 172.21.15.40:0/267057955 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40abb40 con 0x7fbbe40cdea0 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 -- 172.21.15.40:0/267057955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 msgr2=0x7fbbe40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 --2- 172.21.15.40:0/267057955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe40b0630 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40097c0 tx=0x7fbbd401c450 comp rx=0 tx=0).stop 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 -- 172.21.15.40:0/267057955 shutdown_connections 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 --2- 172.21.15.40:0/267057955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe40b0630 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 --2- 172.21.15.40:0/267057955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 -- 172.21.15.40:0/267057955 >> 172.21.15.40:0/267057955 conn(0x7fbbe40cebb0 msgr2=0x7fbbe40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 -- 172.21.15.40:0/267057955 shutdown_connections 2023-11-04T01:40:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.103+0000 7fbbebd60640 1 -- 172.21.15.40:0/267057955 wait complete. 2023-11-04T01:40:55.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 Processor -- start 2023-11-04T01:40:55.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- start start 2023-11-04T01:40:55.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe40ca400 0x7fbbe414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe41649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41635c0 con 0x7fbbe40cdea0 2023-11-04T01:40:55.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4153790 con 0x7fbbe40ca400 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4162d20 con 0x7fbbe415a1f0 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe41649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe41649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34842/0 (socket says 172.21.15.40:34842) 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 -- 172.21.15.40:0/2812457329 learned_addr learned my addr 172.21.15.40:0/2812457329 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbea2fd640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 -- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 msgr2=0x7fbbe415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe415c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 -- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe40ca400 msgr2=0x7fbbe414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe40ca400 0x7fbbe414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 -- 172.21.15.40:0/2812457329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4009420 con 0x7fbbe40cdea0 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbe92fb640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe41649b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40ad040 tx=0x7fbbd401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40b5810 con 0x7fbbe40cdea0 2023-11-04T01:40:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40b5990 con 0x7fbbe40cdea0 2023-11-04T01:40:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe4163000 con 0x7fbbe40cdea0 2023-11-04T01:40:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40b5d40 con 0x7fbbe40cdea0 2023-11-04T01:40:55.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe41531d0 con 0x7fbbe40cdea0 2023-11-04T01:40:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4153560 con 0x7fbbe40cdea0 2023-11-04T01:40:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.107+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbd40bf410 con 0x7fbbe40cdea0 2023-11-04T01:40:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.111+0000 7fbbda7fc640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbc80664a0 0x7fbbc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.111+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbbd411e6c0 con 0x7fbbe40cdea0 2023-11-04T01:40:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.111+0000 7fbbe9afc640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbc80664a0 0x7fbbc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.111+0000 7fbbe9afc640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbc80664a0 0x7fbbc8068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b850 tx=0x7fbbe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.115+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbe4153560 con 0x7fbbe40cdea0 2023-11-04T01:40:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.283+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbbe4153560 con 0x7fbbe40cdea0 2023-11-04T01:40:55.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.911+0000 7fbbda7fc640 1 -- 172.21.15.40:0/2812457329 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbbe4153560 con 0x7fbbe40cdea0 2023-11-04T01:40:55.918 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-11-04T01:40:55.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbc80664a0 msgr2=0x7fbbc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbc80664a0 0x7fbbc8068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b850 tx=0x7fbbe0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:55.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 msgr2=0x7fbbe41649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe41649b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40ad040 tx=0x7fbbd401ac90 comp rx=0 tx=0).stop 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 shutdown_connections 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbc80664a0 0x7fbbc8068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe415a1f0 0x7fbbe415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe40cdea0 0x7fbbe41649b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 --2- 172.21.15.40:0/2812457329 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe40ca400 0x7fbbe414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 >> 172.21.15.40:0/2812457329 conn(0x7fbbe40cebb0 msgr2=0x7fbbe415a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 shutdown_connections 2023-11-04T01:40:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:55.915+0000 7fbbebd60640 1 -- 172.21.15.40:0/2812457329 wait complete. 2023-11-04T01:40:55.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:40:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.067+0000 7f49a97b9640 1 Processor -- start 2023-11-04T01:40:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a97b9640 1 -- start start 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a97b9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49a40ccf50 0x7f49a40cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a97b9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49a40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a97b9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a40cddb0 con 0x7f49a4065e70 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a97b9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40cb530 con 0x7f49a40ccf50 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a97b9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40cb7b0 con 0x7f49a415d2f0 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f49a4065e70 0x7f49a4160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45110/0 (socket says 172.21.15.40:45110) 2023-11-04T01:40:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 -- 172.21.15.40:0/1877604691 learned_addr learned my addr 172.21.15.40:0/1877604691 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a2ffd640 1 --2- 172.21.15.40:0/1877604691 >> v2:172.21.15.91:3300/0 conn(0x7f49a40ccf50 0x7f49a40cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a27fc640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49a40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954717720 0 0) 0x7f49a40cddb0 con 0x7f49a4065e70 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4990003530 con 0x7f49a4065e70 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087038187 0 0) 0x7f4990003530 con 0x7f49a4065e70 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 msgr2=0x7f49a40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49a40cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 >> v2:172.21.15.91:3300/0 conn(0x7f49a40ccf50 msgr2=0x7f49a40cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 --2- 172.21.15.40:0/1877604691 >> v2:172.21.15.91:3300/0 conn(0x7f49a40ccf50 0x7f49a40cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40cba90 con 0x7f49a4065e70 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f499c001680 con 0x7f49a4065e70 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 >> v1:172.21.15.40:6789/0 conn(0x7f49a4065e70 legacy=0x7f49a4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4990003980 0x7f4990003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4990004d10 0x7f4990005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40cb530 con 0x7f4990004d10 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40cb7b0 con 0x7f4990003980 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499000b990 con 0x7f49a415d2f0 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4990004d10 0x7f4990005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a2ffd640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4990003980 0x7f4990003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a27fc640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 -- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 msgr2=0x7f49900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 -- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4990003980 msgr2=0x7f4990003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4990003980 0x7f4990003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a37fe640 1 -- 172.21.15.40:0/1877604691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990003530 con 0x7f4990004d10 2023-11-04T01:40:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.071+0000 7f49a27fc640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415d2f0 0x7f49900047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4990004d10 0x7f4990005190 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c2c0 tx=0x7f499c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd06c3e05a33f39a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5930 con 0x7f4990004d10 2023-11-04T01:40:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c0a5a90 con 0x7f4990004d10 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a1ffb640 1 -- 172.21.15.40:0/1877604691 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5e40 con 0x7f4990004d10 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- 172.21.15.40:0/1877604691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4990004d10 msgr2=0x7f4990005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 --2- 172.21.15.40:0/1877604691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4990004d10 0x7f4990005190 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c2c0 tx=0x7f499c01ccc0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 -- 172.21.15.40:0/1877604691 reap_dead start 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- 172.21.15.40:0/1877604691 shutdown_connections 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- 172.21.15.40:0/1877604691 >> 172.21.15.40:0/1877604691 conn(0x7f49a40b0e70 msgr2=0x7f49a40b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- 172.21.15.40:0/1877604691 shutdown_connections 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- 172.21.15.40:0/1877604691 wait complete. 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 Processor -- start 2023-11-04T01:40:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- start start 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49a415e320 0x7f49a40c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415e700 0x7f49a40c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 0x7f49a41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40c7ec0 con 0x7f49a41f5fd0 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41f6d00 con 0x7f49a415e320 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a97b9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41f36f0 con 0x7f49a415e700 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 0x7f49a41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 0x7f49a41f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34860/0 (socket says 172.21.15.40:34860) 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 -- 172.21.15.40:0/496379769 learned_addr learned my addr 172.21.15.40:0/496379769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a2ffd640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49a415e320 0x7f49a40c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a27fc640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415e700 0x7f49a40c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 -- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415e700 msgr2=0x7f49a40c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415e700 0x7f49a40c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 -- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49a415e320 msgr2=0x7f49a40c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49a415e320 0x7f49a40c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.075+0000 7f49a37fe640 1 -- 172.21.15.40:0/496379769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a41f2930 con 0x7f49a41f5fd0 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f49a37fe640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 0x7f49a41f6460 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f499c0ab040 tx=0x7f4990005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5930 con 0x7f49a41f5fd0 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c0072d0 con 0x7f49a41f5fd0 2023-11-04T01:40:56.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a41f2c10 con 0x7f49a41f5fd0 2023-11-04T01:40:56.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c000e90 con 0x7f49a41f5fd0 2023-11-04T01:40:56.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a41f31d0 con 0x7f49a41f5fd0 2023-11-04T01:40:56.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a41f33c0 con 0x7f49a41f5fd0 2023-11-04T01:40:56.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f499c0ae430 con 0x7f49a41f5fd0 2023-11-04T01:40:56.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f499b7fe640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49840664a0 0x7f4984068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f499c0b4070 con 0x7f49a41f5fd0 2023-11-04T01:40:56.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f49a2ffd640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49840664a0 0x7f4984068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.079+0000 7f49a2ffd640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49840664a0 0x7f4984068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ab0 tx=0x7f4994008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.083+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f499c0ea530 con 0x7f49a41f5fd0 2023-11-04T01:40:56.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.295+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f49a40744a0 con 0x7f49a41f5fd0 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.295+0000 7f499b7fe640 1 -- 172.21.15.40:0/496379769 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f499c001c90 con 0x7f49a41f5fd0 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg==", 2023-11-04T01:40:56.300 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ==", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:40:56.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw==", 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ==", 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-11-04T01:40:56.303 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg==", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg==", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.304 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w==", 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-11-04T01:40:56.305 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g==", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA==", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.306 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg==", 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.307 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w==", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA==", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:40:56.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q==", 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.309 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ==", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg==", 2023-11-04T01:40:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw==", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:40:56.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlYH5cAhAAAtiBIRwfeOo/LLvHf3APaQ==", 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDVoEVlBDPdCBAAa6cSnekrecwC+aEtle/PiA==", 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDVoEVl0U7dCBAA3ZfZnSF89J7lo35wtwFfTA==", 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDVoEVl5mXdCBAAt2IaocuAsOg6LSAbFvwpAA==", 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDVoEVlwnvdCBAAK1xM2mCpym3p5njtOAHtgQ==", 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-04T01:40:56.314 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDVoEVlwZLdCBAAcljxKPdztprMJN9JBR/Fpg==", 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDVoEVlX6rdCBAA0OzXuGfMvKfxgwqae6ElHA==", 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.315 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ==", 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-11-04T01:40:56.316 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ==", 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-11-04T01:40:56.317 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49840664a0 msgr2=0x7f4984068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49840664a0 0x7f4984068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ab0 tx=0x7f4994008040 comp rx=0 tx=0).stop 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 msgr2=0x7f49a41f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 0x7f49a41f6460 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f499c0ab040 tx=0x7f4990005800 comp rx=0 tx=0).stop 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 shutdown_connections 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49840664a0 0x7f4984068960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a41f5fd0 0x7f49a41f6460 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49a415e700 0x7f49a40c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 --2- 172.21.15.40:0/496379769 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49a415e320 0x7f49a40c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 >> 172.21.15.40:0/496379769 conn(0x7f49a40b0e70 msgr2=0x7f49a406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 shutdown_connections 2023-11-04T01:40:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.299+0000 7f49a97b9640 1 -- 172.21.15.40:0/496379769 wait complete. 2023-11-04T01:40:56.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-04T01:40:56.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 Processor -- start 2023-11-04T01:40:56.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 -- start start 2023-11-04T01:40:56.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7ad0159fc0 0x7f7ad00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ad00ca990 0x7f7ad00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad00b0fa0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad00ca030 con 0x7f7ad00ca990 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ad5513640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad006cfd0 con 0x7f7ad0159fc0 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ace7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ad00ca990 0x7f7ad00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7acf7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ad00b0b70 0x7f7ad015dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45126/0 (socket says 172.21.15.40:45126) 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7acf7fe640 1 -- 172.21.15.40:0/3749395448 learned_addr learned my addr 172.21.15.40:0/3749395448 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7aceffd640 1 --2- 172.21.15.40:0/3749395448 >> v2:172.21.15.91:3300/0 conn(0x7f7ad0159fc0 0x7f7ad00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ace7fc640 1 -- 172.21.15.40:0/3749395448 >> v2:172.21.15.91:3300/0 conn(0x7f7ad0159fc0 msgr2=0x7f7ad00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ace7fc640 1 --2- 172.21.15.40:0/3749395448 >> v2:172.21.15.91:3300/0 conn(0x7f7ad0159fc0 0x7f7ad00ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ace7fc640 1 -- 172.21.15.40:0/3749395448 >> v1:172.21.15.40:6789/0 conn(0x7f7ad00b0b70 legacy=0x7f7ad015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7ace7fc640 1 -- 172.21.15.40:0/3749395448 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad015e830 con 0x7f7ad00ca990 2023-11-04T01:40:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7aceffd640 1 --2- 172.21.15.40:0/3749395448 >> v2:172.21.15.91:3300/0 conn(0x7f7ad0159fc0 0x7f7ad00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:56.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.435+0000 7f7acdffb640 1 -- 172.21.15.40:0/3749395448 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823067615 0 0) 0x7f7ad00b0fa0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ace7fc640 1 --2- 172.21.15.40:0/3749395448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00ca990 0x7f7ad00b0630 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7ad006de50 tx=0x7f7ac401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b78fc01da1dad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7acdffb640 1 -- 172.21.15.40:0/3749395448 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40a7070 con 0x7f7ad00ca990 2023-11-04T01:40:56.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7acdffb640 1 -- 172.21.15.40:0/3749395448 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40ab430 con 0x7f7ad00ca990 2023-11-04T01:40:56.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7acdffb640 1 -- 172.21.15.40:0/3749395448 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40ab7c0 con 0x7f7ad00ca990 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- 172.21.15.40:0/3749395448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00ca990 msgr2=0x7f7ad00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 --2- 172.21.15.40:0/3749395448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00ca990 0x7f7ad00b0630 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7ad006de50 tx=0x7f7ac401c430 comp rx=0 tx=0).stop 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- 172.21.15.40:0/3749395448 shutdown_connections 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 --2- 172.21.15.40:0/3749395448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00ca990 0x7f7ad00b0630 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 --2- 172.21.15.40:0/3749395448 >> v2:172.21.15.91:3300/0 conn(0x7f7ad0159fc0 0x7f7ad00ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- 172.21.15.40:0/3749395448 >> 172.21.15.40:0/3749395448 conn(0x7f7ad00cebb0 msgr2=0x7f7ad00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- 172.21.15.40:0/3749395448 shutdown_connections 2023-11-04T01:40:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- 172.21.15.40:0/3749395448 wait complete. 2023-11-04T01:40:56.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 Processor -- start 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- start start 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 0x7f7ad01451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ad00ca990 0x7f7ad015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ad0159fc0 0x7f7ad00b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad015cff0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00b47f0 con 0x7f7ad00ca990 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.439+0000 7f7ad5513640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00b3940 con 0x7f7ad0159fc0 2023-11-04T01:40:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 0x7f7ad01451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 0x7f7ad01451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34878/0 (socket says 172.21.15.40:34878) 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 -- 172.21.15.40:0/929744021 learned_addr learned my addr 172.21.15.40:0/929744021 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ace7fc640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ad00ca990 0x7f7ad015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7acf7fe640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ad0159fc0 0x7f7ad00b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 -- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ad0159fc0 msgr2=0x7f7ad00b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ad0159fc0 0x7f7ad00b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 -- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ad00ca990 msgr2=0x7f7ad015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ad00ca990 0x7f7ad015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 -- 172.21.15.40:0/929744021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009420 con 0x7f7ad00b0b70 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7aceffd640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 0x7f7ad01451c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000cf60 tx=0x7f7ac000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000d840 con 0x7f7ad00b0b70 2023-11-04T01:40:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000d9a0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000dd30 con 0x7f7ad00b0b70 2023-11-04T01:40:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad00b3be0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad00b41a0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.449 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad00744a0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ac0015440 con 0x7f7ad00b0b70 2023-11-04T01:40:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ab77fe640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7abc0664a0 0x7f7abc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ac00845a0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.443+0000 7f7ace7fc640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7abc0664a0 0x7f7abc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.447+0000 7f7ace7fc640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7abc0664a0 0x7f7abc068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40af000 tx=0x7f7ac40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.447+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ac0051d80 con 0x7f7ad00b0b70 2023-11-04T01:40:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.659+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7ad00b4b30 con 0x7f7ad00b0b70 2023-11-04T01:40:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.659+0000 7f7ab77fe640 1 -- 172.21.15.40:0/929744021 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7ac001a0a0 con 0x7f7ad00b0b70 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7abc0664a0 msgr2=0x7f7abc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7abc0664a0 0x7f7abc068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40af000 tx=0x7f7ac40a7000 comp rx=0 tx=0).stop 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 msgr2=0x7f7ad01451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 0x7f7ad01451c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7ac000cf60 tx=0x7f7ac000cf90 comp rx=0 tx=0).stop 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 shutdown_connections 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7abc0664a0 0x7f7abc068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ad0159fc0 0x7f7ad00b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ad00ca990 0x7f7ad015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 --2- 172.21.15.40:0/929744021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ad00b0b70 0x7f7ad01451c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 >> 172.21.15.40:0/929744021 conn(0x7f7ad00cebb0 msgr2=0x7f7ad00cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 shutdown_connections 2023-11-04T01:40:56.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.667+0000 7f7ad5513640 1 -- 172.21.15.40:0/929744021 wait complete. 2023-11-04T01:40:56.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-04T01:40:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f700e3bf640 1 Processor -- start 2023-11-04T01:40:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f700e3bf640 1 -- start start 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f700e3bf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 0x7f70080b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f700e3bf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70080b6070 con 0x7f70080b4990 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f700e3bf640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70080b8ed0 con 0x7f70080d0690 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f700e3bf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080d1ce0 con 0x7f70080d0ae0 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f7007fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70080b4990 0x7f70080b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45130/0 (socket says 172.21.15.40:45130) 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.799+0000 7f7007fff640 1 -- 172.21.15.40:0/3952559840 learned_addr learned my addr 172.21.15.40:0/3952559840 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f700c95c640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 0x7f70080b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120963699 0 0) 0x7f70080b6070 con 0x7f70080b4990 2023-11-04T01:40:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0003530 con 0x7f70080b4990 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022098339 0 0) 0x7f6ff0003530 con 0x7f70080b4990 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 msgr2=0x7f70080b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 0x7f70080b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 >> v1:172.21.15.91:6789/0 conn(0x7f70080d0690 legacy=0x7f70080b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080d1fc0 con 0x7f70080b4990 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f6ff8001a00 con 0x7f70080b4990 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 >> v1:172.21.15.40:6789/0 conn(0x7f70080b4990 legacy=0x7f70080b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff00039b0 0x7f6ff0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff00047d0 0x7f6ff0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 0x7f6ff0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080d1ce0 con 0x7f6ff00047d0 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000bb00 con 0x7f6ff00039b0 2023-11-04T01:40:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000bcc0 con 0x7f70080d0ae0 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff00047d0 0x7f6ff0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7007fff640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff00039b0 0x7f6ff0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f700c95c640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 0x7f6ff0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 -- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 msgr2=0x7f6ff0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70080d0ae0 0x7f6ff0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 -- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff00039b0 msgr2=0x7f6ff0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff00039b0 0x7f6ff0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 -- 172.21.15.40:0/3952559840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0003530 con 0x7f6ff00047d0 2023-11-04T01:40:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f70077fe640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff00047d0 0x7f6ff0004c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7008067650 tx=0x7f6ffc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6baddead195dd7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0052d0 con 0x7f6ff00047d0 2023-11-04T01:40:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc0a7050 con 0x7f6ff00047d0 2023-11-04T01:40:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.803+0000 7f7006ffd640 1 -- 172.21.15.40:0/3952559840 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc003600 con 0x7f6ff00047d0 2023-11-04T01:40:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/3952559840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff00047d0 msgr2=0x7f6ff0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 --2- 172.21.15.40:0/3952559840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff00047d0 0x7f6ff0004c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7008067650 tx=0x7f6ffc01c380 comp rx=0 tx=0).stop 2023-11-04T01:40:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700c95c640 1 -- 172.21.15.40:0/3952559840 reap_dead start 2023-11-04T01:40:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/3952559840 shutdown_connections 2023-11-04T01:40:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/3952559840 >> 172.21.15.40:0/3952559840 conn(0x7f70080cf990 msgr2=0x7f70080cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/3952559840 shutdown_connections 2023-11-04T01:40:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/3952559840 wait complete. 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 Processor -- start 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- start start 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff00047d0 0x7f700814c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 0x7f700815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70080b3b80 0x7f70080b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700814c900 con 0x7f7008160490 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080b4550 con 0x7f70080b3b80 2023-11-04T01:40:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700815ed50 con 0x7f6ff00047d0 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 0x7f700815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 0x7f700815e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34902/0 (socket says 172.21.15.40:34902) 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 -- 172.21.15.40:0/2858483527 learned_addr learned my addr 172.21.15.40:0/2858483527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f7007fff640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff00047d0 0x7f700814c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700c95c640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70080b3b80 0x7f70080b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 -- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff00047d0 msgr2=0x7f700814c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff00047d0 0x7f700814c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 -- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70080b3b80 msgr2=0x7f70080b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70080b3b80 0x7f70080b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 -- 172.21.15.40:0/2858483527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700815f030 con 0x7f7008160490 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f70077fe640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 0x7f700815e3e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc01c860 tx=0x7f6ff0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc007a40 con 0x7f7008160490 2023-11-04T01:40:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc007680 con 0x7f7008160490 2023-11-04T01:40:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc006a20 con 0x7f7008160490 2023-11-04T01:40:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700815f310 con 0x7f7008160490 2023-11-04T01:40:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.807+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700815f8d0 con 0x7f7008160490 2023-11-04T01:40:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.811+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700815fa60 con 0x7f7008160490 2023-11-04T01:40:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.811+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ffc006b80 con 0x7f7008160490 2023-11-04T01:40:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.811+0000 7f7004ff9640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ff40664d0 0x7f6ff4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.811+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ffc11e190 con 0x7f7008160490 2023-11-04T01:40:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.811+0000 7f7007fff640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ff40664d0 0x7f6ff4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.811+0000 7f7007fff640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ff40664d0 0x7f6ff4068990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004d30 tx=0x7f6ff8006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:56.815+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ffc0ebad0 con 0x7f7008160490 2023-11-04T01:40:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.031+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f70080744a0 con 0x7f7008160490 2023-11-04T01:40:57.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f7004ff9640 1 -- 172.21.15.40:0/2858483527 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6ffc0ef0f0 con 0x7f7008160490 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ff40664d0 msgr2=0x7f6ff4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ff40664d0 0x7f6ff4068990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004d30 tx=0x7f6ff8006040 comp rx=0 tx=0).stop 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 msgr2=0x7f700815e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 0x7f700815e3e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc01c860 tx=0x7f6ff0005800 comp rx=0 tx=0).stop 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 shutdown_connections 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ff40664d0 0x7f6ff4068990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70080b3b80 0x7f70080b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008160490 0x7f700815e3e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 --2- 172.21.15.40:0/2858483527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff00047d0 0x7f700814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 >> 172.21.15.40:0/2858483527 conn(0x7f70080cf990 msgr2=0x7f70080d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 shutdown_connections 2023-11-04T01:40:57.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.035+0000 7f700e3bf640 1 -- 172.21.15.40:0/2858483527 wait complete. 2023-11-04T01:40:57.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-04T01:40:57.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 Processor -- start 2023-11-04T01:40:57.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 -- start start 2023-11-04T01:40:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56b815b290 0x7f56b806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b80b0d40 0x7f56b815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b806c740 con 0x7f56b80c2670 2023-11-04T01:40:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b815b670 con 0x7f56b815b290 2023-11-04T01:40:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56bd458640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b806bb30 con 0x7f56b80b0d40 2023-11-04T01:40:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b67fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56b80c2670 0x7f56b80b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45142/0 (socket says 172.21.15.40:45142) 2023-11-04T01:40:57.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b67fc640 1 -- 172.21.15.40:0/1152185372 learned_addr learned my addr 172.21.15.40:0/1152185372 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:57.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b77fe640 1 --2- 172.21.15.40:0/1152185372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b80b0d40 0x7f56b815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b6ffd640 1 --2- 172.21.15.40:0/1152185372 >> v2:172.21.15.91:3300/0 conn(0x7f56b815b290 0x7f56b806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b5ffb640 1 -- 172.21.15.40:0/1152185372 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197432259 0 0) 0x7f56b806c740 con 0x7f56b80c2670 2023-11-04T01:40:57.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b5ffb640 1 -- 172.21.15.40:0/1152185372 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a0003530 con 0x7f56b80c2670 2023-11-04T01:40:57.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b77fe640 1 -- 172.21.15.40:0/1152185372 >> v2:172.21.15.91:3300/0 conn(0x7f56b815b290 msgr2=0x7f56b806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b77fe640 1 --2- 172.21.15.40:0/1152185372 >> v2:172.21.15.91:3300/0 conn(0x7f56b815b290 0x7f56b806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b5ffb640 1 -- 172.21.15.40:0/1152185372 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886169702 0 0) 0x7f56a0003530 con 0x7f56b80c2670 2023-11-04T01:40:57.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b77fe640 1 -- 172.21.15.40:0/1152185372 >> v1:172.21.15.40:6789/0 conn(0x7f56b80c2670 legacy=0x7f56b80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b77fe640 1 -- 172.21.15.40:0/1152185372 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b806be10 con 0x7f56b80b0d40 2023-11-04T01:40:57.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.163+0000 7f56b6ffd640 1 --2- 172.21.15.40:0/1152185372 >> v2:172.21.15.91:3300/0 conn(0x7f56b815b290 0x7f56b806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:57.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56b77fe640 1 --2- 172.21.15.40:0/1152185372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b80b0d40 0x7f56b815eee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009d90 tx=0x7f56b001c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8012815bfd8d85dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56b5ffb640 1 -- 172.21.15.40:0/1152185372 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac001680 con 0x7f56b80b0d40 2023-11-04T01:40:57.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56b5ffb640 1 -- 172.21.15.40:0/1152185372 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00a64d0 con 0x7f56b80b0d40 2023-11-04T01:40:57.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56b5ffb640 1 -- 172.21.15.40:0/1152185372 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00a6840 con 0x7f56b80b0d40 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 -- 172.21.15.40:0/1152185372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b80b0d40 msgr2=0x7f56b815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 --2- 172.21.15.40:0/1152185372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b80b0d40 0x7f56b815eee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009d90 tx=0x7f56b001c7b0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 -- 172.21.15.40:0/1152185372 shutdown_connections 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 --2- 172.21.15.40:0/1152185372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b80b0d40 0x7f56b815eee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 --2- 172.21.15.40:0/1152185372 >> v2:172.21.15.91:3300/0 conn(0x7f56b815b290 0x7f56b806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 -- 172.21.15.40:0/1152185372 >> 172.21.15.40:0/1152185372 conn(0x7f56b80cebb0 msgr2=0x7f56b80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 -- 172.21.15.40:0/1152185372 shutdown_connections 2023-11-04T01:40:57.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 -- 172.21.15.40:0/1152185372 wait complete. 2023-11-04T01:40:57.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.167+0000 7f56bd458640 1 Processor -- start 2023-11-04T01:40:57.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- start start 2023-11-04T01:40:57.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b80b0d40 0x7f56b80ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 0x7f56b80ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b815b290 0x7f56b80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8158d60 con 0x7f56b80c2670 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80ce750 con 0x7f56b80b0d40 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80cd3c0 con 0x7f56b815b290 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 0x7f56b80ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 0x7f56b80ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34910/0 (socket says 172.21.15.40:34910) 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 -- 172.21.15.40:0/1513615815 learned_addr learned my addr 172.21.15.40:0/1513615815 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b77fe640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b815b290 0x7f56b80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b6ffd640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b80b0d40 0x7f56b80ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 -- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b815b290 msgr2=0x7f56b80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b815b290 0x7f56b80b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 -- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b80b0d40 msgr2=0x7f56b80ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b80b0d40 0x7f56b80ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 -- 172.21.15.40:0/1513615815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8009420 con 0x7f56b80c2670 2023-11-04T01:40:57.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56b67fc640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 0x7f56b80ce210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c780 tx=0x7f56ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac005ae0 con 0x7f56b80c2670 2023-11-04T01:40:57.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac005c40 con 0x7f56b80c2670 2023-11-04T01:40:57.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac007070 con 0x7f56b80c2670 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b0009a70 con 0x7f56b80c2670 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b8158710 con 0x7f56b80c2670 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b80744a0 con 0x7f56b80c2670 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.171+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56ac0071f0 con 0x7f56b80c2670 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.175+0000 7f569f7fe640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56a40664a0 0x7f56a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.175+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f56ac083920 con 0x7f56b80c2670 2023-11-04T01:40:57.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.175+0000 7f56b6ffd640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56a40664a0 0x7f56a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.175+0000 7f56b6ffd640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56a40664a0 0x7f56a4068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56b80b4bd0 tx=0x7f56a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.179+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56ac051180 con 0x7f56b80c2670 2023-11-04T01:40:57.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.395+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f56b814aac0 con 0x7f56b80c2670 2023-11-04T01:40:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f569f7fe640 1 -- 172.21.15.40:0/1513615815 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f56ac0547a0 con 0x7f56b80c2670 2023-11-04T01:40:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56a40664a0 msgr2=0x7f56a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56a40664a0 0x7f56a4068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56b80b4bd0 tx=0x7f56a8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 msgr2=0x7f56b80ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 0x7f56b80ce210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c780 tx=0x7f56ac00cc40 comp rx=0 tx=0).stop 2023-11-04T01:40:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 shutdown_connections 2023-11-04T01:40:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56a40664a0 0x7f56a4068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b815b290 0x7f56b80b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b80c2670 0x7f56b80ce210 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 --2- 172.21.15.40:0/1513615815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b80b0d40 0x7f56b80ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 >> 172.21.15.40:0/1513615815 conn(0x7f56b80cebb0 msgr2=0x7f56b815ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 shutdown_connections 2023-11-04T01:40:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.399+0000 7f56bd458640 1 -- 172.21.15.40:0/1513615815 wait complete. 2023-11-04T01:40:57.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-04T01:40:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb6e06640 1 Processor -- start 2023-11-04T01:40:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb6e06640 1 -- start start 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb6e06640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5bb015b470 0x7f5bb015f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb6e06640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00cbe40 con 0x7f5bb006a870 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb6e06640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00cc120 con 0x7f5bb015b090 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb6e06640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb015fca0 con 0x7f5bb015b470 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb53a3640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5bb006a870 0x7f5bb00b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51596/0 (socket says 172.21.15.40:51596) 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb53a3640 1 -- 172.21.15.40:0/2393813989 learned_addr learned my addr 172.21.15.40:0/2393813989 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baffff640 1 --2- 172.21.15.40:0/2393813989 >> v2:172.21.15.91:3300/0 conn(0x7f5bb015b470 0x7f5bb015f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389574148 0 0) 0x7f5bb00cbe40 con 0x7f5bb006a870 2023-11-04T01:40:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003530 con 0x7f5bb006a870 2023-11-04T01:40:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294898188 0 0) 0x7f5b9c003530 con 0x7f5bb006a870 2023-11-04T01:40:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 >> v2:172.21.15.91:3300/0 conn(0x7f5bb015b470 msgr2=0x7f5bb015f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 --2- 172.21.15.40:0/2393813989 >> v2:172.21.15.91:3300/0 conn(0x7f5bb015b470 0x7f5bb015f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 >> v1:172.21.15.91:6789/0 conn(0x7f5bb015b090 legacy=0x7f5bb006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00cc400 con 0x7f5bb006a870 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f5b98001680 con 0x7f5bb006a870 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 >> v1:172.21.15.40:6789/0 conn(0x7f5bb006a870 legacy=0x7f5bb00b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b9c003980 0x7f5b9c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5b9c0047d0 0x7f5b9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c005190 0x7f5b9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb015fca0 con 0x7f5b9c003980 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00c030 con 0x7f5b9c005190 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00c1f0 con 0x7f5b9c0047d0 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b9c003980 0x7f5b9c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baffff640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5b9c0047d0 0x7f5b9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb53a3640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c005190 0x7f5b9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb4ba2640 1 -- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5b9c0047d0 msgr2=0x7f5b9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5b9c0047d0 0x7f5b9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb4ba2640 1 -- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c005190 msgr2=0x7f5b9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c005190 0x7f5b9c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb53a3640 1 -- 172.21.15.40:0/2393813989 reap_dead start 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5bb4ba2640 1 -- 172.21.15.40:0/2393813989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c003530 con 0x7f5b9c003980 2023-11-04T01:40:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.527+0000 7f5baffff640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5b9c0047d0 0x7f5b9c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b9c003980 0x7f5b9c003da0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0001780 tx=0x7f5ba001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856fc38c43617ee2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00052d0 con 0x7f5b9c003980 2023-11-04T01:40:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba00a7050 con 0x7f5b9c003980 2023-11-04T01:40:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5baf7fe640 1 -- 172.21.15.40:0/2393813989 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0003600 con 0x7f5b9c003980 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 -- 172.21.15.40:0/2393813989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b9c003980 msgr2=0x7f5b9c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b9c003980 0x7f5b9c003da0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0001780 tx=0x7f5ba001c3b0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 -- 172.21.15.40:0/2393813989 shutdown_connections 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/2393813989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b9c003980 0x7f5b9c003da0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 -- 172.21.15.40:0/2393813989 >> 172.21.15.40:0/2393813989 conn(0x7f5bb00716a0 msgr2=0x7f5bb0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 -- 172.21.15.40:0/2393813989 shutdown_connections 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 -- 172.21.15.40:0/2393813989 wait complete. 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 Processor -- start 2023-11-04T01:40:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.531+0000 7f5bb6e06640 1 -- start start 2023-11-04T01:40:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c003980 0x7f5bb00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 0x7f5bb006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bb006d7b0 0x7f5bb00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb006dc30 con 0x7f5bb00b0470 2023-11-04T01:40:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00af1a0 con 0x7f5b9c003980 2023-11-04T01:40:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00affe0 con 0x7f5bb006d7b0 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 0x7f5bb006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 0x7f5bb006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38440/0 (socket says 172.21.15.40:38440) 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 -- 172.21.15.40:0/869576246 learned_addr learned my addr 172.21.15.40:0/869576246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c003980 0x7f5bb00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb53a3640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bb006d7b0 0x7f5bb00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 -- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bb006d7b0 msgr2=0x7f5bb00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bb006d7b0 0x7f5bb00c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 -- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c003980 msgr2=0x7f5bb00aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c003980 0x7f5bb00aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 -- 172.21.15.40:0/869576246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00af3d0 con 0x7f5bb00b0470 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c003980 0x7f5bb00aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5baffff640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 0x7f5bb006d270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8007f30 tx=0x7f5ba800f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba801a070 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba80039a0 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb00af6b0 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8003d30 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb00afc70 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb006c600 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ba8004020 con 0x7f5bb00b0470 2023-11-04T01:40:57.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bad7fa640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5b900664d0 0x7f5b90068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ba8084340 con 0x7f5bb00b0470 2023-11-04T01:40:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5b900664d0 0x7f5b90068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.535+0000 7f5bb4ba2640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5b900664d0 0x7f5b90068990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0001750 tx=0x7f5ba00011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.539+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ba8051b10 con 0x7f5bb00b0470 2023-11-04T01:40:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.743+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5bb00675f0 con 0x7f5bb00b0470 2023-11-04T01:40:57.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.747+0000 7f5bad7fa640 1 -- 172.21.15.40:0/869576246 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5ba8055130 con 0x7f5bb00b0470 2023-11-04T01:40:57.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5b900664d0 msgr2=0x7f5b90068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5b900664d0 0x7f5b90068990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0001750 tx=0x7f5ba00011a0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 msgr2=0x7f5bb006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 0x7f5bb006d270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8007f30 tx=0x7f5ba800f5e0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 shutdown_connections 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5b900664d0 0x7f5b90068990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5bb006d7b0 0x7f5bb00c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb00b0470 0x7f5bb006d270 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 --2- 172.21.15.40:0/869576246 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5b9c003980 0x7f5bb00aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 >> 172.21.15.40:0/869576246 conn(0x7f5bb00716a0 msgr2=0x7f5bb00c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 shutdown_connections 2023-11-04T01:40:57.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.751+0000 7f5bb6e06640 1 -- 172.21.15.40:0/869576246 wait complete. 2023-11-04T01:40:57.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-04T01:40:57.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.875+0000 7f4115277640 1 Processor -- start 2023-11-04T01:40:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.875+0000 7f4115277640 1 -- start start 2023-11-04T01:40:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f4115277640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4110158f00 0x7f4110071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f4115277640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 0x7f41100c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f4115277640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4110070360 con 0x7f41100ca6c0 2023-11-04T01:40:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f4115277640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41100ca4b0 con 0x7f4110158f00 2023-11-04T01:40:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f4115277640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41100705d0 con 0x7f41100c9ae0 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4110158f00 0x7f4110071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 0x7f41100c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 0x7f41100c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:57822/0 (socket says 172.21.15.40:57822) 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4110158f00 0x7f4110071ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:34796/0 (socket says 172.21.15.40:34796) 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 -- 172.21.15.40:0/1080058177 learned_addr learned my addr 172.21.15.40:0/1080058177 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f4107fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f41100ca6c0 0x7f411006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:52278/0 (socket says 172.21.15.40:52278) 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 -- 172.21.15.40:0/1080058177 >> v2:172.21.15.91:3300/0 conn(0x7f4110158f00 msgr2=0x7f4110071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 --2- 172.21.15.40:0/1080058177 >> v2:172.21.15.91:3300/0 conn(0x7f4110158f00 0x7f4110071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 -- 172.21.15.40:0/1080058177 >> v1:172.21.15.91:6789/0 conn(0x7f41100ca6c0 legacy=0x7f411006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.879+0000 7f410f7fe640 1 -- 172.21.15.40:0/1080058177 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100708b0 con 0x7f41100c9ae0 2023-11-04T01:40:57.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410f7fe640 1 --2- 172.21.15.40:0/1080058177 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 0x7f41100c9f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4108009e50 tx=0x7f410801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3d5799438f3c77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410e7fc640 1 -- 172.21.15.40:0/1080058177 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080a58d0 con 0x7f41100c9ae0 2023-11-04T01:40:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410e7fc640 1 -- 172.21.15.40:0/1080058177 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080a5a30 con 0x7f41100c9ae0 2023-11-04T01:40:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410e7fc640 1 -- 172.21.15.40:0/1080058177 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080a5dc0 con 0x7f41100c9ae0 2023-11-04T01:40:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- 172.21.15.40:0/1080058177 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 msgr2=0x7f41100c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 --2- 172.21.15.40:0/1080058177 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 0x7f41100c9f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4108009e50 tx=0x7f410801c9e0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- 172.21.15.40:0/1080058177 shutdown_connections 2023-11-04T01:40:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 --2- 172.21.15.40:0/1080058177 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f41100c9ae0 0x7f41100c9f70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 --2- 172.21.15.40:0/1080058177 >> v2:172.21.15.91:3300/0 conn(0x7f4110158f00 0x7f4110071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- 172.21.15.40:0/1080058177 >> 172.21.15.40:0/1080058177 conn(0x7f41100b0f80 msgr2=0x7f41100b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- 172.21.15.40:0/1080058177 shutdown_connections 2023-11-04T01:40:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- 172.21.15.40:0/1080058177 wait complete. 2023-11-04T01:40:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 Processor -- start 2023-11-04T01:40:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- start start 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 0x7f4110146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41100ca6c0 0x7f4110159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4110158f00 0x7f4110157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41101472b0 con 0x7f41100c9ae0 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b4d40 con 0x7f41100ca6c0 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4115277640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411014e0b0 con 0x7f4110158f00 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 0x7f4110146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 0x7f4110146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38452/0 (socket says 172.21.15.40:38452) 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 -- 172.21.15.40:0/2765600938 learned_addr learned my addr 172.21.15.40:0/2765600938 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410f7fe640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4110158f00 0x7f4110157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f4107fff640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41100ca6c0 0x7f4110159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 -- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4110158f00 msgr2=0x7f4110157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4110158f00 0x7f4110157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 -- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41100ca6c0 msgr2=0x7f4110159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41100ca6c0 0x7f4110159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 -- 172.21.15.40:0/2765600938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009b30 con 0x7f41100c9ae0 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.883+0000 7f410effd640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 0x7f4110146d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f410000e870 tx=0x7f410000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100009510 con 0x7f41100c9ae0 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410000eec0 con 0x7f41100c9ae0 2023-11-04T01:40:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41100b44a0 con 0x7f41100c9ae0 2023-11-04T01:40:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410000cb40 con 0x7f41100c9ae0 2023-11-04T01:40:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41100b4a60 con 0x7f41100c9ae0 2023-11-04T01:40:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41100675f0 con 0x7f41100c9ae0 2023-11-04T01:40:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f410000cca0 con 0x7f41100c9ae0 2023-11-04T01:40:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f41077fe640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f40f00664d0 0x7f40f0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4100083bb0 con 0x7f41100c9ae0 2023-11-04T01:40:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f4107fff640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f40f00664d0 0x7f40f0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.887+0000 7f4107fff640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f40f00664d0 0x7f40f0068990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41100b31b0 tx=0x7f40f8007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:57.891+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4100051420 con 0x7f41100c9ae0 2023-11-04T01:40:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.099+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f411006d450 con 0x7f41100c9ae0 2023-11-04T01:40:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f41077fe640 1 -- 172.21.15.40:0/2765600938 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4100054a40 con 0x7f41100c9ae0 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f40f00664d0 msgr2=0x7f40f0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f40f00664d0 0x7f40f0068990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41100b31b0 tx=0x7f40f8007e50 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 msgr2=0x7f4110146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 0x7f4110146d70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f410000e870 tx=0x7f410000ec70 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 shutdown_connections 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f40f00664d0 0x7f40f0068990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4110158f00 0x7f4110157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f41100ca6c0 0x7f4110159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 --2- 172.21.15.40:0/2765600938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41100c9ae0 0x7f4110146d70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.107+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 >> 172.21.15.40:0/2765600938 conn(0x7f41100b0f80 msgr2=0x7f4110073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.111+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 shutdown_connections 2023-11-04T01:40:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.111+0000 7f4115277640 1 -- 172.21.15.40:0/2765600938 wait complete. 2023-11-04T01:40:58.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-04T01:40:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 Processor -- start 2023-11-04T01:40:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 -- start start 2023-11-04T01:40:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac161510 0x7f48ac1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48ac06ba90 0x7f48ac0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac0cc6f0 con 0x7f48ac06f8f0 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac0b10d0 con 0x7f48ac06ba90 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48b1c00640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac06bf90 con 0x7f48ac161510 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48ac06ba90 0x7f48ac0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48ac06ba90 0x7f48ac0c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38462/0 (socket says 172.21.15.40:38462) 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 -- 172.21.15.40:0/3394439806 learned_addr learned my addr 172.21.15.40:0/3394439806 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48aaffd640 1 --1- 172.21.15.40:0/3394439806 >> v1:172.21.15.40:6789/0 conn(0x7f48ac06f8f0 0x7f48ac0b09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51604/0 (socket says 172.21.15.40:51604) 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48ab7fe640 1 --2- 172.21.15.40:0/3394439806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac161510 0x7f48ac1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 -- 172.21.15.40:0/3394439806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac161510 msgr2=0x7f48ac1618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 --2- 172.21.15.40:0/3394439806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac161510 0x7f48ac1618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 -- 172.21.15.40:0/3394439806 >> v1:172.21.15.40:6789/0 conn(0x7f48ac06f8f0 legacy=0x7f48ac0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.247+0000 7f48abfff640 1 -- 172.21.15.40:0/3394439806 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac06c270 con 0x7f48ac06ba90 2023-11-04T01:40:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48abfff640 1 --2- 172.21.15.40:0/3394439806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac06ba90 0x7f48ac0c9170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009e80 tx=0x7f48a401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daa495836c1dd2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48aa7fc640 1 -- 172.21.15.40:0/3394439806 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40a56e0 con 0x7f48ac06ba90 2023-11-04T01:40:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48aa7fc640 1 -- 172.21.15.40:0/3394439806 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a40a5840 con 0x7f48ac06ba90 2023-11-04T01:40:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48aa7fc640 1 -- 172.21.15.40:0/3394439806 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40a5bd0 con 0x7f48ac06ba90 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 -- 172.21.15.40:0/3394439806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac06ba90 msgr2=0x7f48ac0c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 --2- 172.21.15.40:0/3394439806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac06ba90 0x7f48ac0c9170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009e80 tx=0x7f48a401c880 comp rx=0 tx=0).stop 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 -- 172.21.15.40:0/3394439806 shutdown_connections 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 --2- 172.21.15.40:0/3394439806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac06ba90 0x7f48ac0c9170 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 --2- 172.21.15.40:0/3394439806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac161510 0x7f48ac1618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 -- 172.21.15.40:0/3394439806 >> 172.21.15.40:0/3394439806 conn(0x7f48ac0cebb0 msgr2=0x7f48ac0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 -- 172.21.15.40:0/3394439806 shutdown_connections 2023-11-04T01:40:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.251+0000 7f48b1c00640 1 -- 172.21.15.40:0/3394439806 wait complete. 2023-11-04T01:40:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 Processor -- start 2023-11-04T01:40:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- start start 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac06ba90 0x7f48ac0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48ac06f8f0 0x7f48ac163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 0x7f48ac1fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac155f50 con 0x7f48ac161510 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac1647b0 con 0x7f48ac06f8f0 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac155620 con 0x7f48ac06ba90 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 0x7f48ac1fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 0x7f48ac1fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38470/0 (socket says 172.21.15.40:38470) 2023-11-04T01:40:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 -- 172.21.15.40:0/2661663192 learned_addr learned my addr 172.21.15.40:0/2661663192 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48ab7fe640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac06ba90 0x7f48ac0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48aaffd640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48ac06f8f0 0x7f48ac163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 -- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac06ba90 msgr2=0x7f48ac0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac06ba90 0x7f48ac0b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 -- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48ac06f8f0 msgr2=0x7f48ac163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48ac06f8f0 0x7f48ac163f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 -- 172.21.15.40:0/2661663192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4009b30 con 0x7f48ac161510 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48abfff640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 0x7f48ac1fb560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f48a401af30 tx=0x7f48a4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40a56e0 con 0x7f48ac161510 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4007b30 con 0x7f48ac161510 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4009510 con 0x7f48ac161510 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac155900 con 0x7f48ac161510 2023-11-04T01:40:58.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac1644a0 con 0x7f48ac161510 2023-11-04T01:40:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac1560c0 con 0x7f48ac161510 2023-11-04T01:40:58.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.255+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48a40b8470 con 0x7f48ac161510 2023-11-04T01:40:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.259+0000 7f48a3fff640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f488c0664d0 0x7f488c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.259+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f48a411ed70 con 0x7f48ac161510 2023-11-04T01:40:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.259+0000 7f48ab7fe640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f488c0664d0 0x7f488c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.259+0000 7f48ab7fe640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f488c0664d0 0x7f488c068990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f489c009a50 tx=0x7f489c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.263+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48a40ec520 con 0x7f48ac161510 2023-11-04T01:40:58.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.467+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f48ac156090 con 0x7f48ac161510 2023-11-04T01:40:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.475+0000 7f48a3fff640 1 -- 172.21.15.40:0/2661663192 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f48a40efb40 con 0x7f48ac161510 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.475+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f488c0664d0 msgr2=0x7f488c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.475+0000 7f48b1c00640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f488c0664d0 0x7f488c068990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f489c009a50 tx=0x7f489c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.475+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 msgr2=0x7f48ac1fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.475+0000 7f48b1c00640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 0x7f48ac1fb560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f48a401af30 tx=0x7f48a4019620 comp rx=0 tx=0).stop 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 shutdown_connections 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f488c0664d0 0x7f488c068990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac161510 0x7f48ac1fb560 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48ac06f8f0 0x7f48ac163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 --2- 172.21.15.40:0/2661663192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48ac06ba90 0x7f48ac0b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 >> 172.21.15.40:0/2661663192 conn(0x7f48ac0cebb0 msgr2=0x7f48ac15fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 shutdown_connections 2023-11-04T01:40:58.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.479+0000 7f48b1c00640 1 -- 172.21.15.40:0/2661663192 wait complete. 2023-11-04T01:40:58.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.611+0000 7fbe0eac9640 1 Processor -- start 2023-11-04T01:40:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.611+0000 7fbe0eac9640 1 -- start start 2023-11-04T01:40:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0eac9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbe0815afd0 0x7fbe080715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0eac9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe080b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0eac9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe080b0b70 0x7fbe080c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0eac9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe08070140 con 0x7fbe080b0b70 2023-11-04T01:40:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0eac9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080b1000 con 0x7fbe0815afd0 2023-11-04T01:40:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0eac9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0806c9f0 con 0x7fbe0806f8f0 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe080b0b70 0x7fbe080c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe080b0b70 0x7fbe080c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38476/0 (socket says 172.21.15.40:38476) 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 -- 172.21.15.40:0/133733926 learned_addr learned my addr 172.21.15.40:0/133733926 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe07fff640 1 --2- 172.21.15.40:0/133733926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe080b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0c865640 1 --2- 172.21.15.40:0/133733926 >> v2:172.21.15.91:3300/0 conn(0x7fbe0815afd0 0x7fbe080715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 -- 172.21.15.40:0/133733926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 msgr2=0x7fbe080b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 --2- 172.21.15.40:0/133733926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe080b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 -- 172.21.15.40:0/133733926 >> v2:172.21.15.91:3300/0 conn(0x7fbe0815afd0 msgr2=0x7fbe080715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 --2- 172.21.15.40:0/133733926 >> v2:172.21.15.91:3300/0 conn(0x7fbe0815afd0 0x7fbe080715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 -- 172.21.15.40:0/133733926 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080c2670 con 0x7fbe080b0b70 2023-11-04T01:40:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe0d066640 1 --2- 172.21.15.40:0/133733926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe080b0b70 0x7fbe080c9170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe080ce980 tx=0x7fbe0001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7844535bbddbd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.615+0000 7fbe077fe640 1 -- 172.21.15.40:0/133733926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000a5560 con 0x7fbe080b0b70 2023-11-04T01:40:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe077fe640 1 -- 172.21.15.40:0/133733926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe000a56c0 con 0x7fbe080b0b70 2023-11-04T01:40:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe077fe640 1 -- 172.21.15.40:0/133733926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000a5a50 con 0x7fbe080b0b70 2023-11-04T01:40:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/133733926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe080b0b70 msgr2=0x7fbe080c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/133733926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe080b0b70 0x7fbe080c9170 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe080ce980 tx=0x7fbe0001c6e0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/133733926 shutdown_connections 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/133733926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe080b0b70 0x7fbe080c9170 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/133733926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe080b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/133733926 >> v2:172.21.15.91:3300/0 conn(0x7fbe0815afd0 0x7fbe080715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/133733926 >> 172.21.15.40:0/133733926 conn(0x7fbe080cebb0 msgr2=0x7fbe080cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/133733926 shutdown_connections 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/133733926 wait complete. 2023-11-04T01:40:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 Processor -- start 2023-11-04T01:40:58.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- start start 2023-11-04T01:40:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe08156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe080b0b70 0x7fbe0815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 0x7fbe080c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08156660 con 0x7fbe0815afd0 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815a880 con 0x7fbe080b0b70 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080b2f80 con 0x7fbe0806f8f0 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 0x7fbe080c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 0x7fbe080c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38484/0 (socket says 172.21.15.40:38484) 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 -- 172.21.15.40:0/510605039 learned_addr learned my addr 172.21.15.40:0/510605039 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe07fff640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe080b0b70 0x7fbe0815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0c865640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe08156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 -- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 msgr2=0x7fbe08156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe08156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 -- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe080b0b70 msgr2=0x7fbe0815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe080b0b70 0x7fbe0815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 -- 172.21.15.40:0/510605039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00009b30 con 0x7fbe0815afd0 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0d066640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 0x7fbe080c5bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe000af040 tx=0x7fbe00019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000bd070 con 0x7fbe0815afd0 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00009510 con 0x7fbe0815afd0 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe080b3260 con 0x7fbe0815afd0 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000b86b0 con 0x7fbe0815afd0 2023-11-04T01:40:58.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.619+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe080b3820 con 0x7fbe0815afd0 2023-11-04T01:40:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.623+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe080744a0 con 0x7fbe0815afd0 2023-11-04T01:40:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.623+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe000b8810 con 0x7fbe0815afd0 2023-11-04T01:40:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.623+0000 7fbe057fa640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbdf40664a0 0x7fbdf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.623+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe0011ead0 con 0x7fbe0815afd0 2023-11-04T01:40:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.623+0000 7fbe0c865640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbdf40664a0 0x7fbdf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.623+0000 7fbe0c865640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbdf40664a0 0x7fbdf4068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c7970 tx=0x7fbdf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.627+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe000ec3c0 con 0x7fbe0815afd0 2023-11-04T01:40:58.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.783+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe0806cba0 con 0x7fbe0815afd0 2023-11-04T01:40:58.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.783+0000 7fbe057fa640 1 -- 172.21.15.40:0/510605039 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fbe000ace80 con 0x7fbe0815afd0 2023-11-04T01:40:58.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:58.790 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:40:55.935245+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbdf40664a0 msgr2=0x7fbdf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbdf40664a0 0x7fbdf4068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c7970 tx=0x7fbdf8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 msgr2=0x7fbe080c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 0x7fbe080c5bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe000af040 tx=0x7fbe00019480 comp rx=0 tx=0).stop 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 shutdown_connections 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbdf40664a0 0x7fbdf4068960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0815afd0 0x7fbe080c5bf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe080b0b70 0x7fbe0815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 --2- 172.21.15.40:0/510605039 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe0806f8f0 0x7fbe08156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 >> 172.21.15.40:0/510605039 conn(0x7fbe080cebb0 msgr2=0x7fbe080c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 shutdown_connections 2023-11-04T01:40:58.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.787+0000 7fbe0eac9640 1 -- 172.21.15.40:0/510605039 wait complete. 2023-11-04T01:40:58.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:58.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:58.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 Processor -- start 2023-11-04T01:40:58.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 -- start start 2023-11-04T01:40:58.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effa406b840 0x7effa4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa406c010 con 0x7effa415d290 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa40c90e0 con 0x7effa406b840 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa8896640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40ac960 con 0x7effa40b0c20 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effa406b840 0x7effa4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effa406b840 0x7effa4160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38494/0 (socket says 172.21.15.40:38494) 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 -- 172.21.15.40:0/1946447702 learned_addr learned my addr 172.21.15.40:0/1946447702 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa1d9b640 1 --2- 172.21.15.40:0/1946447702 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 -- 172.21.15.40:0/1946447702 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 msgr2=0x7effa406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 --2- 172.21.15.40:0/1946447702 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 -- 172.21.15.40:0/1946447702 >> v1:172.21.15.91:6789/0 conn(0x7effa415d290 legacy=0x7effa40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 -- 172.21.15.40:0/1946447702 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40acc40 con 0x7effa406b840 2023-11-04T01:40:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.935+0000 7effa2d9d640 1 --2- 172.21.15.40:0/1946447702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa406b840 0x7effa4160cb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009870 tx=0x7eff9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7671837c5357819 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa159a640 1 -- 172.21.15.40:0/1946447702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0aa5f0 con 0x7effa406b840 2023-11-04T01:40:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa159a640 1 -- 172.21.15.40:0/1946447702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c0aa750 con 0x7effa406b840 2023-11-04T01:40:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa159a640 1 -- 172.21.15.40:0/1946447702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0aaae0 con 0x7effa406b840 2023-11-04T01:40:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/1946447702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa406b840 msgr2=0x7effa4160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 --2- 172.21.15.40:0/1946447702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa406b840 0x7effa4160cb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009870 tx=0x7eff9c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/1946447702 shutdown_connections 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 --2- 172.21.15.40:0/1946447702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa406b840 0x7effa4160cb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 --2- 172.21.15.40:0/1946447702 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/1946447702 >> 172.21.15.40:0/1946447702 conn(0x7effa40cb510 msgr2=0x7effa40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/1946447702 shutdown_connections 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/1946447702 wait complete. 2023-11-04T01:40:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 Processor -- start 2023-11-04T01:40:58.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- start start 2023-11-04T01:40:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effa406b840 0x7effa414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 0x7effa4158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa41515f0 con 0x7effa415d290 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa4159410 con 0x7effa406b840 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40b4620 con 0x7effa40b0c20 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 0x7effa4158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 0x7effa4158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38496/0 (socket says 172.21.15.40:38496) 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 -- 172.21.15.40:0/917013130 learned_addr learned my addr 172.21.15.40:0/917013130 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa1d9b640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa259c640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effa406b840 0x7effa414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 -- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 msgr2=0x7effa4158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa4158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 -- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effa406b840 msgr2=0x7effa414f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effa406b840 0x7effa414f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 -- 172.21.15.40:0/917013130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0094d0 con 0x7effa415d290 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa2d9d640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 0x7effa4158660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff9c01ab80 tx=0x7eff9c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0b3800 con 0x7effa415d290 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c0b3960 con 0x7effa415d290 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa4151220 con 0x7effa415d290 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0b3d10 con 0x7effa415d290 2023-11-04T01:40:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.939+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa414f710 con 0x7effa415d290 2023-11-04T01:40:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.943+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa40744a0 con 0x7effa415d290 2023-11-04T01:40:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.943+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff9c0c6440 con 0x7effa415d290 2023-11-04T01:40:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.943+0000 7eff92ffd640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff840664d0 0x7eff84068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.943+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff9c0a7070 con 0x7effa415d290 2023-11-04T01:40:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.943+0000 7effa259c640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff840664d0 0x7eff84068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.943+0000 7effa259c640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff840664d0 0x7eff84068990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7effa40ca4b0 tx=0x7eff94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:58.947+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff9c0ebe40 con 0x7effa415d290 2023-11-04T01:40:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.103+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effa40ade30 con 0x7effa415d290 2023-11-04T01:40:59.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.103+0000 7eff92ffd640 1 -- 172.21.15.40:0/917013130 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff9c0ef460 con 0x7effa415d290 2023-11-04T01:40:59.108 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:40:59.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff840664d0 msgr2=0x7eff84068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff840664d0 0x7eff84068990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7effa40ca4b0 tx=0x7eff94008040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 msgr2=0x7effa4158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 0x7effa4158660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff9c01ab80 tx=0x7eff9c01ad10 comp rx=0 tx=0).stop 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 shutdown_connections 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff840664d0 0x7eff84068990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effa415d290 0x7effa4158660 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effa40b0c20 0x7effa4158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 --2- 172.21.15.40:0/917013130 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effa406b840 0x7effa414f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 >> 172.21.15.40:0/917013130 conn(0x7effa40cb510 msgr2=0x7effa40cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 shutdown_connections 2023-11-04T01:40:59.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.107+0000 7effa8896640 1 -- 172.21.15.40:0/917013130 wait complete. 2023-11-04T01:40:59.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:40:59.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 Processor -- start 2023-11-04T01:40:59.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 -- start start 2023-11-04T01:40:59.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbac00ccac0 0x7fbac00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00cdd20 0x7fbac01617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac006ccf0 con 0x7fbac00ccea0 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac0161d30 con 0x7fbac00ccac0 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbac51db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac006d220 con 0x7fbac00cdd20 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbac00ccac0 0x7fbac00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbac00ccac0 0x7fbac00d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38508/0 (socket says 172.21.15.40:38508) 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabe59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbac00ccea0 0x7fbac00cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51608/0 (socket says 172.21.15.40:51608) 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 -- 172.21.15.40:0/3909734008 learned_addr learned my addr 172.21.15.40:0/3909734008 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabf59e640 1 --2- 172.21.15.40:0/3909734008 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00cdd20 0x7fbac01617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 -- 172.21.15.40:0/3909734008 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00cdd20 msgr2=0x7fbac01617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 --2- 172.21.15.40:0/3909734008 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00cdd20 0x7fbac01617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 -- 172.21.15.40:0/3909734008 >> v1:172.21.15.40:6789/0 conn(0x7fbac00ccea0 legacy=0x7fbac00cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabed9d640 1 -- 172.21.15.40:0/3909734008 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac006c630 con 0x7fbac00ccac0 2023-11-04T01:40:59.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.239+0000 7fbabdd9b640 1 -- 172.21.15.40:0/3909734008 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378109706 0 0) 0x7fbac006ccf0 con 0x7fbac00ccea0 2023-11-04T01:40:59.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabed9d640 1 --2- 172.21.15.40:0/3909734008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00ccac0 0x7fbac00d06a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009870 tx=0x7fbab001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e02ab522a712e32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabdd9b640 1 -- 172.21.15.40:0/3909734008 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab00aa670 con 0x7fbac00ccac0 2023-11-04T01:40:59.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabdd9b640 1 -- 172.21.15.40:0/3909734008 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab00aa7d0 con 0x7fbac00ccac0 2023-11-04T01:40:59.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabdd9b640 1 -- 172.21.15.40:0/3909734008 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab00aab60 con 0x7fbac00ccac0 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/3909734008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00ccac0 msgr2=0x7fbac00d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 --2- 172.21.15.40:0/3909734008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00ccac0 0x7fbac00d06a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009870 tx=0x7fbab001c510 comp rx=0 tx=0).stop 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/3909734008 shutdown_connections 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 --2- 172.21.15.40:0/3909734008 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00cdd20 0x7fbac01617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 --2- 172.21.15.40:0/3909734008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00ccac0 0x7fbac00d06a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/3909734008 >> 172.21.15.40:0/3909734008 conn(0x7fbac0065dc0 msgr2=0x7fbac00661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/3909734008 shutdown_connections 2023-11-04T01:40:59.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/3909734008 wait complete. 2023-11-04T01:40:59.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 Processor -- start 2023-11-04T01:40:59.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- start start 2023-11-04T01:40:59.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac00ccac0 0x7fbac015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00ccea0 0x7fbac00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 0x7fbac015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00ae1a0 con 0x7fbac00cdd20 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00af3f0 con 0x7fbac00ccac0 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac015c960 con 0x7fbac00ccea0 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 0x7fbac015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 0x7fbac015c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38510/0 (socket says 172.21.15.40:38510) 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 -- 172.21.15.40:0/1073870843 learned_addr learned my addr 172.21.15.40:0/1073870843 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabed9d640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac00ccac0 0x7fbac015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 -- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00ccea0 msgr2=0x7fbac00aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabe59c640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00ccea0 0x7fbac00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00ccea0 0x7fbac00aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 -- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac00ccac0 msgr2=0x7fbac015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac00ccac0 0x7fbac015b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 -- 172.21.15.40:0/1073870843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab00094d0 con 0x7fbac00cdd20 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabe59c640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00ccea0 0x7fbac00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbabf59e640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 0x7fbac015c130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007d40 tx=0x7fbab800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8014420 con 0x7fbac00cdd20 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab80145a0 con 0x7fbac00cdd20 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00ae3f0 con 0x7fbac00cdd20 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8014950 con 0x7fbac00cdd20 2023-11-04T01:40:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.243+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac00ae9b0 con 0x7fbac00cdd20 2023-11-04T01:40:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.247+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac00c41a0 con 0x7fbac00cdd20 2023-11-04T01:40:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.247+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbab8014ab0 con 0x7fbac00cdd20 2023-11-04T01:40:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.247+0000 7fbab77fe640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbaa00664a0 0x7fbaa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.247+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbab80844a0 con 0x7fbac00cdd20 2023-11-04T01:40:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.247+0000 7fbabed9d640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbaa00664a0 0x7fbaa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.247+0000 7fbabed9d640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbaa00664a0 0x7fbaa0068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ae000 tx=0x7fbab0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.251+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbab8051bf0 con 0x7fbac00cdd20 2023-11-04T01:40:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.399+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbac00675f0 con 0x7fbac00cdd20 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.399+0000 7fbab77fe640 1 -- 172.21.15.40:0/1073870843 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbab8055210 con 0x7fbac00cdd20 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-11-04T01:40:59.406 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:40:59.407 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-11-04T01:40:59.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbaa00664a0 msgr2=0x7fbaa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbaa00664a0 0x7fbaa0068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ae000 tx=0x7fbab0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 msgr2=0x7fbac015c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 0x7fbac015c130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007d40 tx=0x7fbab800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 shutdown_connections 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbaa00664a0 0x7fbaa0068960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac00cdd20 0x7fbac015c130 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac00ccea0 0x7fbac00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 --2- 172.21.15.40:0/1073870843 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac00ccac0 0x7fbac015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 >> 172.21.15.40:0/1073870843 conn(0x7fbac0065dc0 msgr2=0x7fbac00b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 shutdown_connections 2023-11-04T01:40:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.403+0000 7fbac51db640 1 -- 172.21.15.40:0/1073870843 wait complete. 2023-11-04T01:40:59.424 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:40:59.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:40:59.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.535+0000 7ff39b807640 1 Processor -- start 2023-11-04T01:40:59.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.535+0000 7ff39b807640 1 -- start start 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff39b807640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 0x7ff3940cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff39b807640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940ce830 con 0x7ff3940cb660 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff39b807640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39415d9d0 con 0x7ff394159e00 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff39b807640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415e650 con 0x7ff394070180 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3940cb660 0x7ff3940ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51610/0 (socket says 172.21.15.40:51610) 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 -- 172.21.15.40:0/3989827551 learned_addr learned my addr 172.21.15.40:0/3989827551 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:40:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff398da2640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 0x7ff3940cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386328499 0 0) 0x7ff3940ce830 con 0x7ff3940cb660 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff380003530 con 0x7ff3940cb660 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929410724 0 0) 0x7ff380003530 con 0x7ff3940cb660 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 msgr2=0x7ff3940cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 0x7ff3940cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 >> v1:172.21.15.91:6789/0 conn(0x7ff394159e00 legacy=0x7ff3940ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39415dcb0 con 0x7ff3940cb660 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff38c001680 con 0x7ff3940cb660 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 >> v1:172.21.15.40:6789/0 conn(0x7ff3940cb660 legacy=0x7ff3940ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 0x7ff3800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff380003f30 0x7ff3800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff380004d10 0x7ff380005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415e650 con 0x7ff380004d10 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38000dd30 con 0x7ff380003f30 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38000def0 con 0x7ff394070180 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff380004d10 0x7ff380005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff3995a3640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 0x7ff3800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff398da2640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff380003f30 0x7ff3800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 -- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 msgr2=0x7ff3800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff394070180 0x7ff3800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 -- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff380003f30 msgr2=0x7ff3800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff380003f30 0x7ff3800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 -- 172.21.15.40:0/3989827551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380003530 con 0x7ff380004d10 2023-11-04T01:40:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff398da2640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff380003f30 0x7ff3800047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.539+0000 7ff399da4640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff380004d10 0x7ff380005190 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c240 tx=0x7ff38c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9185c7ab05da993e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c005ae0 con 0x7ff380004d10 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c0ab070 con 0x7ff380004d10 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff38bfff640 1 -- 172.21.15.40:0/3989827551 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c007070 con 0x7ff380004d10 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/3989827551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff380004d10 msgr2=0x7ff380005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 --2- 172.21.15.40:0/3989827551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff380004d10 0x7ff380005190 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c240 tx=0x7ff38c01f3b0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff399da4640 1 -- 172.21.15.40:0/3989827551 reap_dead start 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/3989827551 shutdown_connections 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/3989827551 >> 172.21.15.40:0/3989827551 conn(0x7ff3940b0630 msgr2=0x7ff3940b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/3989827551 shutdown_connections 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/3989827551 wait complete. 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 Processor -- start 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- start start 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff380004d10 0x7ff3940c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 0x7ff39414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3940aecd0 0x7ff3940af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940af690 con 0x7ff3940c6390 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39414d630 con 0x7ff3940aecd0 2023-11-04T01:40:59.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940c6810 con 0x7ff380004d10 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 0x7ff39414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 0x7ff39414d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38524/0 (socket says 172.21.15.40:38524) 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 -- 172.21.15.40:0/4003589888 learned_addr learned my addr 172.21.15.40:0/4003589888 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff3995a3640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff380004d10 0x7ff3940c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff399da4640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3940aecd0 0x7ff3940af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 -- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff380004d10 msgr2=0x7ff3940c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff380004d10 0x7ff3940c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 -- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3940aecd0 msgr2=0x7ff3940af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3940aecd0 0x7ff3940af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 -- 172.21.15.40:0/4003589888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940c6ae0 con 0x7ff3940c6390 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff398da2640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 0x7ff39414d0f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff384010890 tx=0x7ff384010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384004220 con 0x7ff3940c6390 2023-11-04T01:40:59.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff384004380 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3940c6dc0 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400eb80 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.543+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39415bc00 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.547+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3940744a0 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.547+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff38400ece0 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.547+0000 7ff389ffb640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3780664d0 0x7ff378068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.547+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff384083cb0 con 0x7ff3940c6390 2023-11-04T01:40:59.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.547+0000 7ff3995a3640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3780664d0 0x7ff378068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.547+0000 7ff3995a3640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3780664d0 0x7ff378068990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff390005210 tx=0x7ff390009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.551+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff384051510 con 0x7ff3940c6390 2023-11-04T01:40:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.707+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff394159240 con 0x7ff3940c6390 2023-11-04T01:40:59.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.935+0000 7ff389ffb640 1 -- 172.21.15.40:0/4003589888 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff3840044f0 con 0x7ff3940c6390 2023-11-04T01:40:59.939 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-11-04T01:40:59.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3780664d0 msgr2=0x7ff378068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3780664d0 0x7ff378068990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff390005210 tx=0x7ff390009040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 msgr2=0x7ff39414d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 0x7ff39414d0f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff384010890 tx=0x7ff384010d50 comp rx=0 tx=0).stop 2023-11-04T01:40:59.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 shutdown_connections 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3780664d0 0x7ff378068990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3940aecd0 0x7ff3940af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3940c6390 0x7ff39414d0f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 --2- 172.21.15.40:0/4003589888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff380004d10 0x7ff3940c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 >> 172.21.15.40:0/4003589888 conn(0x7ff3940b0630 msgr2=0x7ff39406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 shutdown_connections 2023-11-04T01:40:59.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:40:59.939+0000 7ff39b807640 1 -- 172.21.15.40:0/4003589888 wait complete. 2023-11-04T01:40:59.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:41:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.099+0000 7f7abbf5a640 1 Processor -- start 2023-11-04T01:41:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.099+0000 7f7abbf5a640 1 -- start start 2023-11-04T01:41:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7abbf5a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ab415d390 0x7f7ab40cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7abbf5a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d17a0 0x7f7ab40d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7abbf5a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab415d770 con 0x7f7ab40cf800 2023-11-04T01:41:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7abbf5a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab40d2140 con 0x7f7ab415d390 2023-11-04T01:41:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7abbf5a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40cecd0 con 0x7f7ab40d17a0 2023-11-04T01:41:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab9cf6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ab415d390 0x7f7ab40cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7aba4f7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ab40cf800 0x7f7ab40b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51616/0 (socket says 172.21.15.40:51616) 2023-11-04T01:41:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7aba4f7640 1 -- 172.21.15.40:0/613425928 learned_addr learned my addr 172.21.15.40:0/613425928 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab94f5640 1 --2- 172.21.15.40:0/613425928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d17a0 0x7f7ab40d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/613425928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d17a0 msgr2=0x7f7ab40d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab9cf6640 1 --2- 172.21.15.40:0/613425928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d17a0 0x7f7ab40d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/613425928 >> v1:172.21.15.40:6789/0 conn(0x7f7ab40cf800 legacy=0x7f7ab40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/613425928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40ce0c0 con 0x7f7ab415d390 2023-11-04T01:41:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab9cf6640 1 --2- 172.21.15.40:0/613425928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab415d390 0x7f7ab40cf160 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00097b0 tx=0x7f7ab001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d6d8d55910a4a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab8cf4640 1 -- 172.21.15.40:0/613425928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00ac620 con 0x7f7ab415d390 2023-11-04T01:41:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab8cf4640 1 -- 172.21.15.40:0/613425928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab00ac780 con 0x7f7ab415d390 2023-11-04T01:41:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.103+0000 7f7ab8cf4640 1 -- 172.21.15.40:0/613425928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00acb10 con 0x7f7ab415d390 2023-11-04T01:41:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/613425928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab415d390 msgr2=0x7f7ab40cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/613425928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab415d390 0x7f7ab40cf160 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00097b0 tx=0x7f7ab001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/613425928 shutdown_connections 2023-11-04T01:41:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/613425928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d17a0 0x7f7ab40d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/613425928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab415d390 0x7f7ab40cf160 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/613425928 >> 172.21.15.40:0/613425928 conn(0x7f7ab40d2e60 msgr2=0x7f7ab40d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/613425928 shutdown_connections 2023-11-04T01:41:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/613425928 wait complete. 2023-11-04T01:41:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 Processor -- start 2023-11-04T01:41:00.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- start start 2023-11-04T01:41:00.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 0x7f7ab40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ab40d17a0 0x7f7ab40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d0a10 0x7f7ab40d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40cb6b0 con 0x7f7ab40cf800 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40d13e0 con 0x7f7ab40d17a0 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ca0d0 con 0x7f7ab40d0a10 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 0x7f7ab40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 0x7f7ab40cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38550/0 (socket says 172.21.15.40:38550) 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/3047825855 learned_addr learned my addr 172.21.15.40:0/3047825855 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7aba4f7640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d0a10 0x7f7ab40d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab94f5640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ab40d17a0 0x7f7ab40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d0a10 msgr2=0x7f7ab40d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d0a10 0x7f7ab40d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ab40d17a0 msgr2=0x7f7ab40cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ab40d17a0 0x7f7ab40cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 -- 172.21.15.40:0/3047825855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00093c0 con 0x7f7ab40cf800 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab94f5640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ab40d17a0 0x7f7ab40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7ab9cf6640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 0x7f7ab40cc970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7ab001aa70 tx=0x7f7ab0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00ac620 con 0x7f7ab40cf800 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab00b5400 con 0x7f7ab40cf800 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00b57d0 con 0x7f7ab40cf800 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40d01a0 con 0x7f7ab40cf800 2023-11-04T01:41:00.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.107+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40ca690 con 0x7f7ab40cf800 2023-11-04T01:41:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.111+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40744a0 con 0x7f7ab40cf800 2023-11-04T01:41:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.111+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ab00b3040 con 0x7f7ab40cf800 2023-11-04T01:41:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.111+0000 7f7aaa7fc640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a980664a0 0x7f7a98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.111+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7ab011e620 con 0x7f7ab40cf800 2023-11-04T01:41:00.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.111+0000 7f7ab94f5640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a980664a0 0x7f7a98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.111+0000 7f7ab94f5640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a980664a0 0x7f7a98068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40b7cb0 tx=0x7f7aa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.115+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ab00ebd60 con 0x7f7ab40cf800 2023-11-04T01:41:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.263+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ab4066ab0 con 0x7f7ab40cf800 2023-11-04T01:41:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.939+0000 7f7aaa7fc640 1 -- 172.21.15.40:0/3047825855 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ab00b10d0 con 0x7f7ab40cf800 2023-11-04T01:41:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-11-04T01:41:01.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a980664a0 msgr2=0x7f7a98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a980664a0 0x7f7a98068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40b7cb0 tx=0x7f7aa4008040 comp rx=0 tx=0).stop 2023-11-04T01:41:01.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 msgr2=0x7f7ab40cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 0x7f7ab40cc970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7ab001aa70 tx=0x7f7ab0019160 comp rx=0 tx=0).stop 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 shutdown_connections 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a980664a0 0x7f7a98068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7ab40d0a10 0x7f7ab40d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7ab40d17a0 0x7f7ab40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 --2- 172.21.15.40:0/3047825855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ab40cf800 0x7f7ab40cc970 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 >> 172.21.15.40:0/3047825855 conn(0x7f7ab40d2e60 msgr2=0x7f7ab406bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 shutdown_connections 2023-11-04T01:41:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:00.943+0000 7f7abbf5a640 1 -- 172.21.15.40:0/3047825855 wait complete. 2023-11-04T01:41:01.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:41:01.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.135+0000 7f8115695640 1 Processor -- start 2023-11-04T01:41:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.135+0000 7f8115695640 1 -- start start 2023-11-04T01:41:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f8115695640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8110144840 0x7f811015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f8115695640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110070b40 0x7f81100b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f8115695640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811006cc10 con 0x7f81100b54d0 2023-11-04T01:41:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f8115695640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100b5960 con 0x7f8110144840 2023-11-04T01:41:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f8115695640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110071d10 con 0x7f8110070b40 2023-11-04T01:41:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8110144840 0x7f811015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f81100b54d0 0x7f811006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51632/0 (socket says 172.21.15.40:51632) 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810f7fe640 1 -- 172.21.15.40:0/702557760 learned_addr learned my addr 172.21.15.40:0/702557760 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f8107fff640 1 --2- 172.21.15.40:0/702557760 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110070b40 0x7f81100b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810effd640 1 -- 172.21.15.40:0/702557760 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110070b40 msgr2=0x7f81100b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810effd640 1 --2- 172.21.15.40:0/702557760 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110070b40 0x7f81100b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810effd640 1 -- 172.21.15.40:0/702557760 >> v1:172.21.15.40:6789/0 conn(0x7f81100b54d0 legacy=0x7f811006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810effd640 1 -- 172.21.15.40:0/702557760 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811015fb20 con 0x7f8110144840 2023-11-04T01:41:01.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.139+0000 7f810e7fc640 1 -- 172.21.15.40:0/702557760 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675048316 0 0) 0x7f811006cc10 con 0x7f81100b54d0 2023-11-04T01:41:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f810effd640 1 --2- 172.21.15.40:0/702557760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8110144840 0x7f811015f5e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f81000097c0 tx=0x7f810001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6322f2b78a840dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f810e7fc640 1 -- 172.21.15.40:0/702557760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000ab600 con 0x7f8110144840 2023-11-04T01:41:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f810e7fc640 1 -- 172.21.15.40:0/702557760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000a7050 con 0x7f8110144840 2023-11-04T01:41:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f810e7fc640 1 -- 172.21.15.40:0/702557760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000ab980 con 0x7f8110144840 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- 172.21.15.40:0/702557760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8110144840 msgr2=0x7f811015f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 --2- 172.21.15.40:0/702557760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8110144840 0x7f811015f5e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f81000097c0 tx=0x7f810001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- 172.21.15.40:0/702557760 shutdown_connections 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 --2- 172.21.15.40:0/702557760 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110070b40 0x7f81100b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 --2- 172.21.15.40:0/702557760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8110144840 0x7f811015f5e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- 172.21.15.40:0/702557760 >> 172.21.15.40:0/702557760 conn(0x7f81100cfc70 msgr2=0x7f81100d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- 172.21.15.40:0/702557760 shutdown_connections 2023-11-04T01:41:01.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- 172.21.15.40:0/702557760 wait complete. 2023-11-04T01:41:01.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 Processor -- start 2023-11-04T01:41:01.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- start start 2023-11-04T01:41:01.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8110070b40 0x7f8110135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 0x7f8110159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110144840 0x7f8110152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015aa70 con 0x7f81100b54d0 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015ad50 con 0x7f8110070b40 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8115695640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811015b030 con 0x7f8110144840 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 0x7f8110159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 0x7f8110159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38572/0 (socket says 172.21.15.40:38572) 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 -- 172.21.15.40:0/1680516861 learned_addr learned my addr 172.21.15.40:0/1680516861 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f810f7fe640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110144840 0x7f8110152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f810effd640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8110070b40 0x7f8110135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 -- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110144840 msgr2=0x7f8110152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110144840 0x7f8110152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 -- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8110070b40 msgr2=0x7f8110135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8110070b40 0x7f8110135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 -- 172.21.15.40:0/1680516861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100009420 con 0x7f81100b54d0 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.143+0000 7f8107fff640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 0x7f8110159fb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f80f800d5f0 tx=0x7f80f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80125f0 con 0x7f81100b54d0 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8012750 con 0x7f81100b54d0 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8012ae0 con 0x7f81100b54d0 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811015b310 con 0x7f81100b54d0 2023-11-04T01:41:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110135640 con 0x7f81100b54d0 2023-11-04T01:41:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4005260 con 0x7f81100b54d0 2023-11-04T01:41:01.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80f8012c40 con 0x7f81100b54d0 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f81077fe640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80f00664a0 0x7f80f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f80f8084240 con 0x7f81100b54d0 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f810effd640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80f00664a0 0x7f80f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.147+0000 7f810effd640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80f00664a0 0x7f80f0068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81000ad000 tx=0x7f81000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.151+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80f80517b0 con 0x7f81100b54d0 2023-11-04T01:41:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:01.343+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f80f40057e0 con 0x7f81100b54d0 2023-11-04T01:41:02.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.027+0000 7f81077fe640 1 -- 172.21.15.40:0/1680516861 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f80f8007380 con 0x7f81100b54d0 2023-11-04T01:41:02.037 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 4 and data pool 5 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80f00664a0 msgr2=0x7f80f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80f00664a0 0x7f80f0068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81000ad000 tx=0x7f81000a6000 comp rx=0 tx=0).stop 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 msgr2=0x7f8110159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 0x7f8110159fb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f80f800d5f0 tx=0x7f80f800dab0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 shutdown_connections 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80f00664a0 0x7f80f0068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8110144840 0x7f8110152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81100b54d0 0x7f8110159fb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 --2- 172.21.15.40:0/1680516861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8110070b40 0x7f8110135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 >> 172.21.15.40:0/1680516861 conn(0x7f81100cfc70 msgr2=0x7f81100b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 shutdown_connections 2023-11-04T01:41:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.043+0000 7f8115695640 1 -- 172.21.15.40:0/1680516861 wait complete. 2023-11-04T01:41:02.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:02.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 Processor -- start 2023-11-04T01:41:02.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 -- start start 2023-11-04T01:41:02.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f695c159fc0 0x7f695c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f695c0b0d40 0x7f695c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c06cfd0 con 0x7f695c0ca990 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0ca030 con 0x7f695c0b0d40 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6963ee2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c15e830 con 0x7f695c159fc0 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f695c0b0d40 0x7f695c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f695c0b0d40 0x7f695c15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38584/0 (socket says 172.21.15.40:38584) 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 -- 172.21.15.40:0/3994769571 learned_addr learned my addr 172.21.15.40:0/3994769571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6961c7e640 1 --2- 172.21.15.40:0/3994769571 >> v2:172.21.15.91:3300/0 conn(0x7f695c159fc0 0x7f695c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 -- 172.21.15.40:0/3994769571 >> v2:172.21.15.91:3300/0 conn(0x7f695c159fc0 msgr2=0x7f695c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 --2- 172.21.15.40:0/3994769571 >> v2:172.21.15.91:3300/0 conn(0x7f695c159fc0 0x7f695c0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 -- 172.21.15.40:0/3994769571 >> v1:172.21.15.91:6789/0 conn(0x7f695c0ca990 legacy=0x7f695c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f696247f640 1 -- 172.21.15.40:0/3994769571 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c15eb10 con 0x7f695c0b0d40 2023-11-04T01:41:02.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.183+0000 7f6961c7e640 1 --2- 172.21.15.40:0/3994769571 >> v2:172.21.15.91:3300/0 conn(0x7f695c159fc0 0x7f695c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:02.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f696247f640 1 --2- 172.21.15.40:0/3994769571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c0b0d40 0x7f695c15dc50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f695c06de50 tx=0x7f694c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e548dd0c1030c6cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6960c7c640 1 -- 172.21.15.40:0/3994769571 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0ac600 con 0x7f695c0b0d40 2023-11-04T01:41:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6960c7c640 1 -- 172.21.15.40:0/3994769571 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c0a8050 con 0x7f695c0b0d40 2023-11-04T01:41:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6960c7c640 1 -- 172.21.15.40:0/3994769571 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0ac980 con 0x7f695c0b0d40 2023-11-04T01:41:02.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- 172.21.15.40:0/3994769571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c0b0d40 msgr2=0x7f695c15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3994769571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c0b0d40 0x7f695c15dc50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f695c06de50 tx=0x7f694c01c490 comp rx=0 tx=0).stop 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- 172.21.15.40:0/3994769571 shutdown_connections 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3994769571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c0b0d40 0x7f695c15dc50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3994769571 >> v2:172.21.15.91:3300/0 conn(0x7f695c159fc0 0x7f695c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- 172.21.15.40:0/3994769571 >> 172.21.15.40:0/3994769571 conn(0x7f695c0cebb0 msgr2=0x7f695c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- 172.21.15.40:0/3994769571 shutdown_connections 2023-11-04T01:41:02.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- 172.21.15.40:0/3994769571 wait complete. 2023-11-04T01:41:02.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 Processor -- start 2023-11-04T01:41:02.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- start start 2023-11-04T01:41:02.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f695c0b0d40 0x7f695c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f695c0ca990 0x7f695c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 0x7f695c070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c157df0 con 0x7f695c159fc0 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c1580d0 con 0x7f695c0b0d40 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f6963ee2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c1583b0 con 0x7f695c0ca990 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f696247f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 0x7f695c070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f696247f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 0x7f695c070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38588/0 (socket says 172.21.15.40:38588) 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.187+0000 7f696247f640 1 -- 172.21.15.40:0/3796640238 learned_addr learned my addr 172.21.15.40:0/3796640238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696147d640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f695c0ca990 0x7f695c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6961c7e640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f695c0b0d40 0x7f695c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696247f640 1 -- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f695c0ca990 msgr2=0x7f695c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696247f640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f695c0ca990 0x7f695c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696247f640 1 -- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f695c0b0d40 msgr2=0x7f695c154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696247f640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f695c0b0d40 0x7f695c154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696247f640 1 -- 172.21.15.40:0/3796640238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0094d0 con 0x7f695c159fc0 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6961c7e640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f695c0b0d40 0x7f695c154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f696247f640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 0x7f695c070d40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f694c01a0c0 tx=0x7f694c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0b7650 con 0x7f695c159fc0 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c0ace90 con 0x7f695c159fc0 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c158690 con 0x7f695c159fc0 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0b79f0 con 0x7f695c159fc0 2023-11-04T01:41:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c154660 con 0x7f695c159fc0 2023-11-04T01:41:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c158bb0 con 0x7f695c159fc0 2023-11-04T01:41:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f694c0b3070 con 0x7f695c159fc0 2023-11-04T01:41:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f695a7fc640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69480664a0 0x7f6948068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f694c11e470 con 0x7f695c159fc0 2023-11-04T01:41:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6961c7e640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69480664a0 0x7f6948068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.191+0000 7f6961c7e640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69480664a0 0x7f6948068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6950006fd0 tx=0x7f6950008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.195+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f694c0eb8f0 con 0x7f695c159fc0 2023-11-04T01:41:02.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.351+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f695c0744a0 con 0x7f695c159fc0 2023-11-04T01:41:02.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.355+0000 7f695a7fc640 1 -- 172.21.15.40:0/3796640238 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f694c0eef10 con 0x7f695c159fc0 2023-11-04T01:41:02.360 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:02.360 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":32,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:01.346023+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:02.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69480664a0 msgr2=0x7f6948068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69480664a0 0x7f6948068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6950006fd0 tx=0x7f6950008040 comp rx=0 tx=0).stop 2023-11-04T01:41:02.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 msgr2=0x7f695c070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 0x7f695c070d40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f694c01a0c0 tx=0x7f694c01acd0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 shutdown_connections 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69480664a0 0x7f6948068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f695c159fc0 0x7f695c070d40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f695c0ca990 0x7f695c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 --2- 172.21.15.40:0/3796640238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f695c0b0d40 0x7f695c154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 >> 172.21.15.40:0/3796640238 conn(0x7f695c0cebb0 msgr2=0x7f695c06ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 shutdown_connections 2023-11-04T01:41:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.359+0000 7f6963ee2640 1 -- 172.21.15.40:0/3796640238 wait complete. 2023-11-04T01:41:02.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 Processor -- start 2023-11-04T01:41:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 -- start start 2023-11-04T01:41:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ec806d780 0x7f8ec806c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8ec806c970 0x7f8ec80b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec806bc50 con 0x7f8ec8071be0 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec806c010 con 0x7f8ec806d780 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ecdd6f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec815bd50 con 0x7f8ec806c970 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8ec8071be0 0x7f8ec815b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51646/0 (socket says 172.21.15.40:51646) 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec77fe640 1 -- 172.21.15.40:0/4152675527 learned_addr learned my addr 172.21.15.40:0/4152675527 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/4152675527 >> v2:172.21.15.40:3300/0 conn(0x7f8ec806d780 0x7f8ec806c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec7fff640 1 --2- 172.21.15.40:0/4152675527 >> v2:172.21.15.91:3300/0 conn(0x7f8ec806c970 0x7f8ec80b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec67fc640 1 -- 172.21.15.40:0/4152675527 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339202249 0 0) 0x7f8ec806bc50 con 0x7f8ec8071be0 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec67fc640 1 -- 172.21.15.40:0/4152675527 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea8003530 con 0x7f8ec8071be0 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec6ffd640 1 -- 172.21.15.40:0/4152675527 >> v2:172.21.15.91:3300/0 conn(0x7f8ec806c970 msgr2=0x7f8ec80b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/4152675527 >> v2:172.21.15.91:3300/0 conn(0x7f8ec806c970 0x7f8ec80b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec6ffd640 1 -- 172.21.15.40:0/4152675527 >> v1:172.21.15.40:6789/0 conn(0x7f8ec8071be0 legacy=0x7f8ec815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec6ffd640 1 -- 172.21.15.40:0/4152675527 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec815c030 con 0x7f8ec806d780 2023-11-04T01:41:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.503+0000 7f8ec7fff640 1 --2- 172.21.15.40:0/4152675527 >> v2:172.21.15.91:3300/0 conn(0x7f8ec806c970 0x7f8ec80b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/4152675527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec806c430 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80cef30 tx=0x7f8eb001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35d66576461c517 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec67fc640 1 -- 172.21.15.40:0/4152675527 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00a66c0 con 0x7f8ec806d780 2023-11-04T01:41:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec67fc640 1 -- 172.21.15.40:0/4152675527 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb00a6820 con 0x7f8ec806d780 2023-11-04T01:41:02.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec67fc640 1 -- 172.21.15.40:0/4152675527 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00a6bb0 con 0x7f8ec806d780 2023-11-04T01:41:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/4152675527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 msgr2=0x7f8ec806c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/4152675527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec806c430 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80cef30 tx=0x7f8eb001c7f0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/4152675527 shutdown_connections 2023-11-04T01:41:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/4152675527 >> v2:172.21.15.91:3300/0 conn(0x7f8ec806c970 0x7f8ec80b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/4152675527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec806c430 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/4152675527 >> 172.21.15.40:0/4152675527 conn(0x7f8ec80cefa0 msgr2=0x7f8ec80cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/4152675527 shutdown_connections 2023-11-04T01:41:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/4152675527 wait complete. 2023-11-04T01:41:02.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 Processor -- start 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- start start 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec80c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ec8071be0 0x7f8ec81658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ec8158630 0x7f8ec81640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81645e0 con 0x7f8ec806d780 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8158ac0 con 0x7f8ec8071be0 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ecdd6f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8164810 con 0x7f8ec8158630 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec80c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec80c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38610/0 (socket says 172.21.15.40:38610) 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 -- 172.21.15.40:0/2708035183 learned_addr learned my addr 172.21.15.40:0/2708035183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec7fff640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ec8158630 0x7f8ec81640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ec8071be0 0x7f8ec81658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 -- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ec8158630 msgr2=0x7f8ec81640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ec8158630 0x7f8ec81640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 -- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ec8071be0 msgr2=0x7f8ec81658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ec8071be0 0x7f8ec81658b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 -- 172.21.15.40:0/2708035183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009a70 con 0x7f8ec806d780 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ec8071be0 0x7f8ec81658b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ec77fe640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec80c7270 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c4d0 tx=0x7f8eb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.507+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8005cf0 con 0x7f8ec806d780 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8005e50 con 0x7f8ec806d780 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec8164af0 con 0x7f8ec806d780 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8007270 con 0x7f8ec806d780 2023-11-04T01:41:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec81650b0 con 0x7f8ec806d780 2023-11-04T01:41:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec80744a0 con 0x7f8ec806d780 2023-11-04T01:41:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8eb80073d0 con 0x7f8ec806d780 2023-11-04T01:41:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ebffff640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8eac0664a0 0x7f8eac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8eb80832a0 con 0x7f8ec806d780 2023-11-04T01:41:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8eac0664a0 0x7f8eac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.511+0000 7f8ec6ffd640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8eac0664a0 0x7f8eac068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00af000 tx=0x7f8eb00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.515+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8eb8050860 con 0x7f8ec806d780 2023-11-04T01:41:02.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.671+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ec80cf590 con 0x7f8ec806d780 2023-11-04T01:41:02.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.675+0000 7f8ebffff640 1 -- 172.21.15.40:0/2708035183 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f8eb8053e80 con 0x7f8ec806d780 2023-11-04T01:41:02.681 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:02.681 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":32,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:01.346023+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:02.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8eac0664a0 msgr2=0x7f8eac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8eac0664a0 0x7f8eac068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00af000 tx=0x7f8eb00a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:02.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 msgr2=0x7f8ec80c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec80c7270 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c4d0 tx=0x7f8eb800c990 comp rx=0 tx=0).stop 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 shutdown_connections 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8eac0664a0 0x7f8eac068960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ec8158630 0x7f8ec81640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ec8071be0 0x7f8ec81658b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 --2- 172.21.15.40:0/2708035183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec806d780 0x7f8ec80c7270 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 >> 172.21.15.40:0/2708035183 conn(0x7f8ec80cefa0 msgr2=0x7f8ec815d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 shutdown_connections 2023-11-04T01:41:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.679+0000 7f8ecdd6f640 1 -- 172.21.15.40:0/2708035183 wait complete. 2023-11-04T01:41:02.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:41:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.815+0000 7fcbb0754640 1 Processor -- start 2023-11-04T01:41:02.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.815+0000 7fcbb0754640 1 -- start start 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbb0754640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcba815af70 0x7fcba80cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbb0754640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba815e890 con 0x7fcba815e490 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbb0754640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba806c0c0 con 0x7fcba806d160 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbb0754640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba806c3a0 con 0x7fcba815af70 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbaecf1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcba815e490 0x7fcba80701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51656/0 (socket says 172.21.15.40:51656) 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbaecf1640 1 -- 172.21.15.40:0/4069130882 learned_addr learned my addr 172.21.15.40:0/4069130882 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/4069130882 >> v2:172.21.15.91:3300/0 conn(0x7fcba815af70 0x7fcba80cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630385836 0 0) 0x7fcb98001120 con 0x7fcba815e490 2023-11-04T01:41:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb90003530 con 0x7fcba815e490 2023-11-04T01:41:02.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1859775686 0 0) 0x7fcb90003530 con 0x7fcba815e490 2023-11-04T01:41:02.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 >> v2:172.21.15.91:3300/0 conn(0x7fcba815af70 msgr2=0x7fcba80cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 --2- 172.21.15.40:0/4069130882 >> v2:172.21.15.91:3300/0 conn(0x7fcba815af70 0x7fcba80cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 >> v1:172.21.15.91:6789/0 conn(0x7fcba806d160 legacy=0x7fcba815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba806c680 con 0x7fcba815e490 2023-11-04T01:41:02.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fcb98001810 con 0x7fcba815e490 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 >> v1:172.21.15.40:6789/0 conn(0x7fcba815e490 legacy=0x7fcba80701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcb90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb900047d0 0x7fcb90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcb90005190 0x7fcb9000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba806c3a0 con 0x7fcb90003980 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9000e240 con 0x7fcb900047d0 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9000e400 con 0x7fcb90005190 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcb90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbadcef640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb900047d0 0x7fcb90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbaecf1640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcb90005190 0x7fcb9000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 -- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcb90005190 msgr2=0x7fcb9000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcb90005190 0x7fcb9000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 -- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb900047d0 msgr2=0x7fcb90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcb900047d0 0x7fcb90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbae4f0640 1 -- 172.21.15.40:0/4069130882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90003530 con 0x7fcb90003980 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.819+0000 7fcbaecf1640 1 -- 172.21.15.40:0/4069130882 reap_dead start 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcb90003da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009fc0 tx=0x7fcba001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a76d94f178eecb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00a5bf0 con 0x7fcb90003980 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba000f040 con 0x7fcb90003980 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbad4ee640 1 -- 172.21.15.40:0/4069130882 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00ad440 con 0x7fcb90003980 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- 172.21.15.40:0/4069130882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 msgr2=0x7fcb90003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcb90003da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009fc0 tx=0x7fcba001cc60 comp rx=0 tx=0).stop 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- 172.21.15.40:0/4069130882 shutdown_connections 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 --2- 172.21.15.40:0/4069130882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcb90003da0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- 172.21.15.40:0/4069130882 >> 172.21.15.40:0/4069130882 conn(0x7fcba80cb510 msgr2=0x7fcba80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- 172.21.15.40:0/4069130882 shutdown_connections 2023-11-04T01:41:02.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- 172.21.15.40:0/4069130882 wait complete. 2023-11-04T01:41:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 Processor -- start 2023-11-04T01:41:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- start start 2023-11-04T01:41:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcba814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcba80c42c0 0x7fcba80c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcba80aff10 0x7fcba80b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80b08d0 con 0x7fcb90003980 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba80c2fd0 con 0x7fcba80c42c0 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbb0754640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba814f680 con 0x7fcba80aff10 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbae4f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcba814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbae4f0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcba814f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38630/0 (socket says 172.21.15.40:38630) 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbae4f0640 1 -- 172.21.15.40:0/2367659041 learned_addr learned my addr 172.21.15.40:0/2367659041 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.823+0000 7fcbadcef640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcba80c42c0 0x7fcba80c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbaecf1640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcba80aff10 0x7fcba80b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbae4f0640 1 -- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcba80aff10 msgr2=0x7fcba80b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcba80aff10 0x7fcba80b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbae4f0640 1 -- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcba80c42c0 msgr2=0x7fcba80c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcba80c42c0 0x7fcba80c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbae4f0640 1 -- 172.21.15.40:0/2367659041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80c3220 con 0x7fcb90003980 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbae4f0640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcba814f140 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcba001c6d0 tx=0x7fcba0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0003ba0 con 0x7fcb90003980 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0003d00 con 0x7fcb90003980 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba80c3500 con 0x7fcb90003980 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00ad930 con 0x7fcb90003980 2023-11-04T01:41:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba80c3ac0 con 0x7fcb90003980 2023-11-04T01:41:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcba00b4040 con 0x7fcb90003980 2023-11-04T01:41:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba80744a0 con 0x7fcb90003980 2023-11-04T01:41:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcba6ffd640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcb940664d0 0x7fcb94068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcba011e7d0 con 0x7fcb90003980 2023-11-04T01:41:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbadcef640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcb940664d0 0x7fcb94068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.827+0000 7fcbadcef640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcb940664d0 0x7fcb94068990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c007fd0 tx=0x7fcb9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:02.831+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcba00ebe30 con 0x7fcb90003980 2023-11-04T01:41:03.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.023+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcba815cf20 con 0x7fcb90003980 2023-11-04T01:41:04.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.995+0000 7fcba6ffd640 1 -- 172.21.15.40:0/2367659041 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcba00b20b0 con 0x7fcb90003980 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcb940664d0 msgr2=0x7fcb94068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcb940664d0 0x7fcb94068990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c007fd0 tx=0x7fcb9c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 msgr2=0x7fcba814f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcba814f140 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcba001c6d0 tx=0x7fcba0009750 comp rx=0 tx=0).stop 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 shutdown_connections 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcb940664d0 0x7fcb94068990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcba80aff10 0x7fcba80b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcba80c42c0 0x7fcba80c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 --2- 172.21.15.40:0/2367659041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb90003980 0x7fcba814f140 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 >> 172.21.15.40:0/2367659041 conn(0x7fcba80cb510 msgr2=0x7fcba80cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 shutdown_connections 2023-11-04T01:41:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:03.999+0000 7fcbb0754640 1 -- 172.21.15.40:0/2367659041 wait complete. 2023-11-04T01:41:04.024 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:41:04.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:41:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 Processor -- start 2023-11-04T01:41:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 -- start start 2023-11-04T01:41:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d815acb0 0x7f79d815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f79d815c160 0x7f79d80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d80cb130 con 0x7f79d80b0a50 2023-11-04T01:41:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d815bd40 con 0x7f79d815acb0 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79df224640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d806fd80 con 0x7f79d815c160 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dd7c1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f79d80b0a50 0x7f79d80ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51664/0 (socket says 172.21.15.40:51664) 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dd7c1640 1 -- 172.21.15.40:0/1480020493 learned_addr learned my addr 172.21.15.40:0/1480020493 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dcfc0640 1 --2- 172.21.15.40:0/1480020493 >> v2:172.21.15.40:3300/0 conn(0x7f79d815acb0 0x7f79d815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79d77fe640 1 -- 172.21.15.40:0/1480020493 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555594999 0 0) 0x7f79d80cb130 con 0x7f79d80b0a50 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79d77fe640 1 -- 172.21.15.40:0/1480020493 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c0003530 con 0x7f79d80b0a50 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79d7fff640 1 --2- 172.21.15.40:0/1480020493 >> v2:172.21.15.91:3300/0 conn(0x7f79d815c160 0x7f79d80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dcfc0640 1 -- 172.21.15.40:0/1480020493 >> v2:172.21.15.91:3300/0 conn(0x7f79d815c160 msgr2=0x7f79d80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dcfc0640 1 --2- 172.21.15.40:0/1480020493 >> v2:172.21.15.91:3300/0 conn(0x7f79d815c160 0x7f79d80b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dcfc0640 1 -- 172.21.15.40:0/1480020493 >> v1:172.21.15.40:6789/0 conn(0x7f79d80b0a50 legacy=0x7f79d80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dcfc0640 1 -- 172.21.15.40:0/1480020493 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d815b680 con 0x7f79d815acb0 2023-11-04T01:41:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.155+0000 7f79dcfc0640 1 --2- 172.21.15.40:0/1480020493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d815b090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f79d80ce4b0 tx=0x7f79d001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8604283ede086a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d77fe640 1 -- 172.21.15.40:0/1480020493 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a58e0 con 0x7f79d815acb0 2023-11-04T01:41:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d77fe640 1 -- 172.21.15.40:0/1480020493 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00a5a40 con 0x7f79d815acb0 2023-11-04T01:41:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d77fe640 1 -- 172.21.15.40:0/1480020493 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a5dd0 con 0x7f79d815acb0 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/1480020493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 msgr2=0x7f79d815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 --2- 172.21.15.40:0/1480020493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d815b090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f79d80ce4b0 tx=0x7f79d001c910 comp rx=0 tx=0).stop 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/1480020493 shutdown_connections 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 --2- 172.21.15.40:0/1480020493 >> v2:172.21.15.91:3300/0 conn(0x7f79d815c160 0x7f79d80b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 --2- 172.21.15.40:0/1480020493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d815b090 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/1480020493 >> 172.21.15.40:0/1480020493 conn(0x7f79d80cb510 msgr2=0x7f79d80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/1480020493 shutdown_connections 2023-11-04T01:41:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/1480020493 wait complete. 2023-11-04T01:41:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 Processor -- start 2023-11-04T01:41:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- start start 2023-11-04T01:41:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d80b0a50 0x7f79d80b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d80b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79d815c160 0x7f79d80afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80b1f10 con 0x7f79d815acb0 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80b18e0 con 0x7f79d80b0a50 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80b0470 con 0x7f79d815c160 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d80b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d80b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38642/0 (socket says 172.21.15.40:38642) 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 -- 172.21.15.40:0/4106984527 learned_addr learned my addr 172.21.15.40:0/4106984527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79dd7c1640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79d815c160 0x7f79d80afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79dcfc0640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d80b0a50 0x7f79d80b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 -- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79d815c160 msgr2=0x7f79d80afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79d815c160 0x7f79d80afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 -- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d80b0a50 msgr2=0x7f79d80b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d80b0a50 0x7f79d80b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 -- 172.21.15.40:0/4106984527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0009a70 con 0x7f79d815acb0 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d7fff640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d80b3500 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00d800 tx=0x7f79cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00b6c0 con 0x7f79d815acb0 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00b820 con 0x7f79d815acb0 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80b0750 con 0x7f79d815acb0 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00bb90 con 0x7f79d815acb0 2023-11-04T01:41:04.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.159+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d80b3a40 con 0x7f79d815acb0 2023-11-04T01:41:04.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.163+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d80b20c0 con 0x7f79d815acb0 2023-11-04T01:41:04.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.163+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79cc00bcf0 con 0x7f79d815acb0 2023-11-04T01:41:04.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.163+0000 7f79d57fa640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79c40664d0 0x7f79c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.163+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79cc084370 con 0x7f79d815acb0 2023-11-04T01:41:04.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.163+0000 7f79dcfc0640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79c40664d0 0x7f79c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.163+0000 7f79dcfc0640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79c40664d0 0x7f79c4068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79d00af000 tx=0x7f79d00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.167+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79cc0517f0 con 0x7f79d815acb0 2023-11-04T01:41:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:04.359+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f79d80744a0 con 0x7f79d815acb0 2023-11-04T01:41:05.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.007+0000 7f79d57fa640 1 -- 172.21.15.40:0/4106984527 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f79cc054e10 con 0x7f79d815acb0 2023-11-04T01:41:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79c40664d0 msgr2=0x7f79c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79c40664d0 0x7f79c4068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79d00af000 tx=0x7f79d00a7070 comp rx=0 tx=0).stop 2023-11-04T01:41:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 msgr2=0x7f79d80b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d80b3500 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00d800 tx=0x7f79cc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 shutdown_connections 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79c40664d0 0x7f79c4068990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79d815c160 0x7f79d80afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d815acb0 0x7f79d80b3500 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 --2- 172.21.15.40:0/4106984527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f79d80b0a50 0x7f79d80b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 >> 172.21.15.40:0/4106984527 conn(0x7f79d80cb510 msgr2=0x7f79d815c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 shutdown_connections 2023-11-04T01:41:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.011+0000 7f79df224640 1 -- 172.21.15.40:0/4106984527 wait complete. 2023-11-04T01:41:05.035 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:41:05.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.155+0000 7f85362a5640 1 Processor -- start 2023-11-04T01:41:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f85362a5640 1 -- start start 2023-11-04T01:41:05.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f85362a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f85300b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f85362a5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85300ca400 0x7f85300b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f85362a5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300ccee0 con 0x7f853015a1f0 2023-11-04T01:41:05.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f85362a5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853015a5d0 con 0x7f85300ca400 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f85362a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300ca900 con 0x7f85300cdea0 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85300ca400 0x7f85300b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85300ca400 0x7f85300b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38648/0 (socket says 172.21.15.40:38648) 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 -- 172.21.15.40:0/944654653 learned_addr learned my addr 172.21.15.40:0/944654653 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f852f7fe640 1 --2- 172.21.15.40:0/944654653 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f85300b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 -- 172.21.15.40:0/944654653 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 msgr2=0x7f85300b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 --2- 172.21.15.40:0/944654653 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f85300b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 -- 172.21.15.40:0/944654653 >> v1:172.21.15.91:6789/0 conn(0x7f853015a1f0 legacy=0x7f85300cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 -- 172.21.15.40:0/944654653 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300cabe0 con 0x7f85300ca400 2023-11-04T01:41:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f8534842640 1 --2- 172.21.15.40:0/944654653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f85300b0b70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8528009e50 tx=0x7f852801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae2e8240265497a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f852effd640 1 -- 172.21.15.40:0/944654653 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280a5740 con 0x7f85300ca400 2023-11-04T01:41:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f852effd640 1 -- 172.21.15.40:0/944654653 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85280a58a0 con 0x7f85300ca400 2023-11-04T01:41:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.159+0000 7f852effd640 1 -- 172.21.15.40:0/944654653 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280a5c30 con 0x7f85300ca400 2023-11-04T01:41:05.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- 172.21.15.40:0/944654653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 msgr2=0x7f85300b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 --2- 172.21.15.40:0/944654653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f85300b0b70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8528009e50 tx=0x7f852801c9d0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- 172.21.15.40:0/944654653 shutdown_connections 2023-11-04T01:41:05.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 --2- 172.21.15.40:0/944654653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f85300b0b70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 --2- 172.21.15.40:0/944654653 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f85300b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- 172.21.15.40:0/944654653 >> 172.21.15.40:0/944654653 conn(0x7f85300cebb0 msgr2=0x7f85300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- 172.21.15.40:0/944654653 shutdown_connections 2023-11-04T01:41:05.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- 172.21.15.40:0/944654653 wait complete. 2023-11-04T01:41:05.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 Processor -- start 2023-11-04T01:41:05.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- start start 2023-11-04T01:41:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f853015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f8530155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f853015a1f0 0x7f85300c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853014f8e0 con 0x7f85300ca400 2023-11-04T01:41:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530151f10 con 0x7f853015a1f0 2023-11-04T01:41:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f85362a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8530150160 con 0x7f85300cdea0 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f853015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f853015cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38664/0 (socket says 172.21.15.40:38664) 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 -- 172.21.15.40:0/1476388552 learned_addr learned my addr 172.21.15.40:0/1476388552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 -- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 msgr2=0x7f8530155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f8530155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 -- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f853015a1f0 msgr2=0x7f85300c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f8534842640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f853015a1f0 0x7f85300c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f853015a1f0 0x7f85300c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f852ffff640 1 -- 172.21.15.40:0/1476388552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009b30 con 0x7f85300ca400 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.163+0000 7f8534842640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f853015a1f0 0x7f85300c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852ffff640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f853015cc10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f852000b410 tx=0x7f852000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520004020 con 0x7f85300ca400 2023-11-04T01:41:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520004180 con 0x7f85300ca400 2023-11-04T01:41:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011630 con 0x7f85300ca400 2023-11-04T01:41:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8530151950 con 0x7f85300ca400 2023-11-04T01:41:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853014fdf0 con 0x7f85300ca400 2023-11-04T01:41:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85300744a0 con 0x7f85300ca400 2023-11-04T01:41:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8520011790 con 0x7f85300ca400 2023-11-04T01:41:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852cff9640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85100664a0 0x7f8510068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8520083b90 con 0x7f85300ca400 2023-11-04T01:41:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852f7fe640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85100664a0 0x7f8510068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.167+0000 7f852f7fe640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85100664a0 0x7f8510068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85301520e0 tx=0x7f8518008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.171+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f85200510a0 con 0x7f85300ca400 2023-11-04T01:41:05.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.359+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f853006cfb0 con 0x7f85300ca400 2023-11-04T01:41:05.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f852cff9640 1 -- 172.21.15.40:0/1476388552 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f85200546c0 con 0x7f85300ca400 2023-11-04T01:41:05.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:05.367 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:01.346773+0000","modified":"2023-11-04T01:41:04.362535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3716931542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3716931542},{"type":"v1","addr":"172.21.15.40:6835","nonce":3716931542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:05.367 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 14 2023-11-04T01:41:05.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85100664a0 msgr2=0x7f8510068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85100664a0 0x7f8510068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85301520e0 tx=0x7f8518008040 comp rx=0 tx=0).stop 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 msgr2=0x7f853015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f853015cc10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f852000b410 tx=0x7f852000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 shutdown_connections 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85100664a0 0x7f8510068960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f853015a1f0 0x7f85300c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85300cdea0 0x7f8530155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 --2- 172.21.15.40:0/1476388552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85300ca400 0x7f853015cc10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 >> 172.21.15.40:0/1476388552 conn(0x7f85300cebb0 msgr2=0x7f85300b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 shutdown_connections 2023-11-04T01:41:05.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.363+0000 7f85362a5640 1 -- 172.21.15.40:0/1476388552 wait complete. 2023-11-04T01:41:05.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:05.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 Processor -- start 2023-11-04T01:41:05.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 -- start start 2023-11-04T01:41:05.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52a40cb400 0x7f52a40cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f52a40cd6d0 0x7f52a40cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a415b390 con 0x7f52a40cb400 2023-11-04T01:41:05.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40d0a60 con 0x7f52a40cd6d0 2023-11-04T01:41:05.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a8885640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40d04a0 con 0x7f52a415afb0 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52a40cb400 0x7f52a40cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52a40cb400 0x7f52a40cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38666/0 (socket says 172.21.15.40:38666) 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 -- 172.21.15.40:0/2907406991 learned_addr learned my addr 172.21.15.40:0/2907406991 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a2d9d640 1 --2- 172.21.15.40:0/2907406991 >> v2:172.21.15.91:3300/0 conn(0x7f52a40cd6d0 0x7f52a40cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a259c640 1 --2- 172.21.15.40:0/2907406991 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 -- 172.21.15.40:0/2907406991 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 msgr2=0x7f52a40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 --2- 172.21.15.40:0/2907406991 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a40b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 -- 172.21.15.40:0/2907406991 >> v2:172.21.15.91:3300/0 conn(0x7f52a40cd6d0 msgr2=0x7f52a40cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 --2- 172.21.15.40:0/2907406991 >> v2:172.21.15.91:3300/0 conn(0x7f52a40cd6d0 0x7f52a40cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.499+0000 7f52a1d9b640 1 -- 172.21.15.40:0/2907406991 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40d0780 con 0x7f52a40cb400 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a1d9b640 1 --2- 172.21.15.40:0/2907406991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cb400 0x7f52a40cf190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52a40b0730 tx=0x7f529801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3df1aff295216ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a159a640 1 -- 172.21.15.40:0/2907406991 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980ab600 con 0x7f52a40cb400 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a159a640 1 -- 172.21.15.40:0/2907406991 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52980ab760 con 0x7f52a40cb400 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a159a640 1 -- 172.21.15.40:0/2907406991 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980abaf0 con 0x7f52a40cb400 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 -- 172.21.15.40:0/2907406991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cb400 msgr2=0x7f52a40cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 --2- 172.21.15.40:0/2907406991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cb400 0x7f52a40cf190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52a40b0730 tx=0x7f529801c440 comp rx=0 tx=0).stop 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 -- 172.21.15.40:0/2907406991 shutdown_connections 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 --2- 172.21.15.40:0/2907406991 >> v2:172.21.15.91:3300/0 conn(0x7f52a40cd6d0 0x7f52a40cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 --2- 172.21.15.40:0/2907406991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cb400 0x7f52a40cf190 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 --2- 172.21.15.40:0/2907406991 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 -- 172.21.15.40:0/2907406991 >> 172.21.15.40:0/2907406991 conn(0x7f52a4065dc0 msgr2=0x7f52a40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 -- 172.21.15.40:0/2907406991 shutdown_connections 2023-11-04T01:41:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 -- 172.21.15.40:0/2907406991 wait complete. 2023-11-04T01:41:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 Processor -- start 2023-11-04T01:41:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.503+0000 7f52a8885640 1 -- start start 2023-11-04T01:41:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a40cb400 0x7f52a4154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 0x7f52a415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415dbd0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415e370 con 0x7f52a40cb400 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40b5c90 con 0x7f52a415afb0 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 0x7f52a415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 0x7f52a415d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38668/0 (socket says 172.21.15.40:38668) 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 -- 172.21.15.40:0/208224141 learned_addr learned my addr 172.21.15.40:0/208224141 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a2d9d640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a259c640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a40cb400 0x7f52a4154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 -- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 msgr2=0x7f52a415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 -- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a40cb400 msgr2=0x7f52a4154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a40cb400 0x7f52a4154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 -- 172.21.15.40:0/208224141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980094d0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a1d9b640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 0x7f52a415d150 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f529801aaf0 tx=0x7f529801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980b4800 con 0x7f52a40cd6d0 2023-11-04T01:41:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52980b4960 con 0x7f52a40cd6d0 2023-11-04T01:41:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a415ddb0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980b4cd0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a41553a0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a40675f0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52980b3380 con 0x7f52a40cd6d0 2023-11-04T01:41:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.507+0000 7f5292ffd640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52840664a0 0x7f5284068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.511+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f529811e480 con 0x7f52a40cd6d0 2023-11-04T01:41:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.511+0000 7f52a259c640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52840664a0 0x7f5284068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.511+0000 7f52a259c640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52840664a0 0x7f5284068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52940096f0 tx=0x7f5294008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.511+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52980eb8e0 con 0x7f52a40cd6d0 2023-11-04T01:41:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.663+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52a40b2c00 con 0x7f52a40cd6d0 2023-11-04T01:41:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f5292ffd640 1 -- 172.21.15.40:0/208224141 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f52980eef00 con 0x7f52a40cd6d0 2023-11-04T01:41:05.671 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:05.671 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":33,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:02.983846+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52840664a0 msgr2=0x7f5284068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52840664a0 0x7f5284068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52940096f0 tx=0x7f5294008040 comp rx=0 tx=0).stop 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 msgr2=0x7f52a415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 0x7f52a415d150 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f529801aaf0 tx=0x7f529801ac80 comp rx=0 tx=0).stop 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 shutdown_connections 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52840664a0 0x7f5284068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52a415afb0 0x7f52a415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52a40cd6d0 0x7f52a415d150 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 --2- 172.21.15.40:0/208224141 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a40cb400 0x7f52a4154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 >> 172.21.15.40:0/208224141 conn(0x7f52a4065dc0 msgr2=0x7f52a40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 shutdown_connections 2023-11-04T01:41:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.667+0000 7f52a8885640 1 -- 172.21.15.40:0/208224141 wait complete. 2023-11-04T01:41:05.689 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:41:05.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:05.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.807+0000 7f2c550bd640 1 Processor -- start 2023-11-04T01:41:05.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.807+0000 7f2c550bd640 1 -- start start 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.807+0000 7f2c550bd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c5015d2b0 0x7f2c5006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.807+0000 7f2c550bd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c500cd400 con 0x7f2c5006f8f0 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.807+0000 7f2c550bd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c500cd6e0 con 0x7f2c5015d690 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.807+0000 7f2c550bd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500ad450 con 0x7f2c5015d2b0 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4f59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c5006f8f0 0x7f2c500b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51674/0 (socket says 172.21.15.40:51674) 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c5015d2b0 0x7f2c5006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4f59e640 1 -- 172.21.15.40:0/1377809613 learned_addr learned my addr 172.21.15.40:0/1377809613 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:05.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4dd9b640 1 -- 172.21.15.40:0/1377809613 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851895538 0 0) 0x7f2c500cd400 con 0x7f2c5006f8f0 2023-11-04T01:41:05.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4dd9b640 1 -- 172.21.15.40:0/1377809613 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c38003530 con 0x7f2c5006f8f0 2023-11-04T01:41:05.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/1377809613 >> v1:172.21.15.91:6789/0 conn(0x7f2c5015d690 legacy=0x7f2c500ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/1377809613 >> v1:172.21.15.40:6789/0 conn(0x7f2c5006f8f0 legacy=0x7f2c500b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/1377809613 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c500ad070 con 0x7f2c5015d2b0 2023-11-04T01:41:05.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4ed9d640 1 --2- 172.21.15.40:0/1377809613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5015d2b0 0x7f2c5006c630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097c0 tx=0x7f2c4001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39594d1bc6465c38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4dd9b640 1 -- 172.21.15.40:0/1377809613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5006ff10 con 0x7f2c5015d2b0 2023-11-04T01:41:05.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4dd9b640 1 -- 172.21.15.40:0/1377809613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400ab610 con 0x7f2c5015d2b0 2023-11-04T01:41:05.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c4dd9b640 1 -- 172.21.15.40:0/1377809613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400ab980 con 0x7f2c5015d2b0 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 -- 172.21.15.40:0/1377809613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5015d2b0 msgr2=0x7f2c5006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 --2- 172.21.15.40:0/1377809613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5015d2b0 0x7f2c5006c630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097c0 tx=0x7f2c4001c3f0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 -- 172.21.15.40:0/1377809613 shutdown_connections 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 --2- 172.21.15.40:0/1377809613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5015d2b0 0x7f2c5006c630 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 -- 172.21.15.40:0/1377809613 >> 172.21.15.40:0/1377809613 conn(0x7f2c500cebb0 msgr2=0x7f2c500cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 -- 172.21.15.40:0/1377809613 shutdown_connections 2023-11-04T01:41:05.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.811+0000 7f2c550bd640 1 -- 172.21.15.40:0/1377809613 wait complete. 2023-11-04T01:41:05.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 Processor -- start 2023-11-04T01:41:05.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- start start 2023-11-04T01:41:05.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 0x7f2c5015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2c5015d2b0 0x7f2c501530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2c5015d690 0x7f2c50145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50147340 con 0x7f2c5006f8f0 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50146750 con 0x7f2c5015d690 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c501469a0 con 0x7f2c5015d2b0 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 0x7f2c5015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 0x7f2c5015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38700/0 (socket says 172.21.15.40:38700) 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/2143673634 learned_addr learned my addr 172.21.15.40:0/2143673634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4f59e640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2c5015d690 0x7f2c50145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2c5015d2b0 msgr2=0x7f2c501530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2c5015d2b0 0x7f2c501530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2c5015d690 msgr2=0x7f2c50145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2c5015d690 0x7f2c50145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 -- 172.21.15.40:0/2143673634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009420 con 0x7f2c5006f8f0 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c4ed9d640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 0x7f2c5015a440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c40019000 tx=0x7f2c4001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40006e20 con 0x7f2c5006f8f0 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400b9070 con 0x7f2c5006f8f0 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40004220 con 0x7f2c5006f8f0 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c50146c80 con 0x7f2c5006f8f0 2023-11-04T01:41:05.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c501463c0 con 0x7f2c5006f8f0 2023-11-04T01:41:05.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.815+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c500744a0 con 0x7f2c5006f8f0 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.819+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c40004380 con 0x7f2c5006f8f0 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.819+0000 7f2c377fe640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2c3c0664d0 0x7f2c3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.819+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c400bb070 con 0x7f2c5006f8f0 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.819+0000 7f2c4e59c640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2c3c0664d0 0x7f2c3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.819+0000 7f2c4e59c640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2c3c0664d0 0x7f2c3c068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c44000f70 tx=0x7f2c440079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.823+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c400ebc40 con 0x7f2c5006f8f0 2023-11-04T01:41:05.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.971+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c500ae080 con 0x7f2c3c0664d0 2023-11-04T01:41:06.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.995+0000 7f2c377fe640 1 -- 172.21.15.40:0/2143673634 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287591 (secure 0 0 0) 0x7f2c44005080 con 0x7f2c3c0664d0 2023-11-04T01:41:06.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:06.005 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:41:06.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2c3c0664d0 msgr2=0x7f2c3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2c3c0664d0 0x7f2c3c068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c44000f70 tx=0x7f2c440079e0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 msgr2=0x7f2c5015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 0x7f2c5015a440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c40019000 tx=0x7f2c4001ac30 comp rx=0 tx=0).stop 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 shutdown_connections 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2c3c0664d0 0x7f2c3c068990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2c5015d690 0x7f2c50145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2c5015d2b0 0x7f2c501530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 --2- 172.21.15.40:0/2143673634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c5006f8f0 0x7f2c5015a440 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 >> 172.21.15.40:0/2143673634 conn(0x7f2c500cebb0 msgr2=0x7f2c500afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 shutdown_connections 2023-11-04T01:41:06.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:05.999+0000 7f2c550bd640 1 -- 172.21.15.40:0/2143673634 wait complete. 2023-11-04T01:41:06.021 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-04T01:41:05.770416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220356,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754364,"statfs":{"total":773094113280,"available":772868468736,"internally_reserved":0,"allocated":4235264,"data_stored":2358292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829433"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225045+0000","last_change":"2023-11-04T01:41:02.050387+0000","last_active":"2023-11-04T01:41:03.225045+0000","last_peered":"2023-11-04T01:41:03.225045+0000","last_clean":"2023-11-04T01:41:03.225045+0000","last_became_active":"2023-11-04T01:41:02.049813+0000","last_became_peered":"2023-11-04T01:41:02.049813+0000","last_unstale":"2023-11-04T01:41:03.225045+0000","last_undegraded":"2023-11-04T01:41:03.225045+0000","last_fullsized":"2023-11-04T01:41:03.225045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:57.348549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223479+0000","last_change":"2023-11-04T01:41:02.034081+0000","last_active":"2023-11-04T01:41:03.223479+0000","last_peered":"2023-11-04T01:41:03.223479+0000","last_clean":"2023-11-04T01:41:03.223479+0000","last_became_active":"2023-11-04T01:41:02.033734+0000","last_became_peered":"2023-11-04T01:41:02.033734+0000","last_unstale":"2023-11-04T01:41:03.223479+0000","last_undegraded":"2023-11-04T01:41:03.223479+0000","last_fullsized":"2023-11-04T01:41:03.223479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:06.788843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003948+0000","last_change":"2023-11-04T01:41:02.034574+0000","last_active":"2023-11-04T01:41:03.003948+0000","last_peered":"2023-11-04T01:41:03.003948+0000","last_clean":"2023-11-04T01:41:03.003948+0000","last_became_active":"2023-11-04T01:41:02.033781+0000","last_became_peered":"2023-11-04T01:41:02.033781+0000","last_unstale":"2023-11-04T01:41:03.003948+0000","last_undegraded":"2023-11-04T01:41:03.003948+0000","last_fullsized":"2023-11-04T01:41:03.003948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:05.116353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222001+0000","last_change":"2023-11-04T01:41:02.015182+0000","last_active":"2023-11-04T01:41:03.222001+0000","last_peered":"2023-11-04T01:41:03.222001+0000","last_clean":"2023-11-04T01:41:03.222001+0000","last_became_active":"2023-11-04T01:41:02.014426+0000","last_became_peered":"2023-11-04T01:41:02.014426+0000","last_unstale":"2023-11-04T01:41:03.222001+0000","last_undegraded":"2023-11-04T01:41:03.222001+0000","last_fullsized":"2023-11-04T01:41:03.222001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:36.990997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222039+0000","last_change":"2023-11-04T01:41:02.007374+0000","last_active":"2023-11-04T01:41:03.222039+0000","last_peered":"2023-11-04T01:41:03.222039+0000","last_clean":"2023-11-04T01:41:03.222039+0000","last_became_active":"2023-11-04T01:41:02.006644+0000","last_became_peered":"2023-11-04T01:41:02.006644+0000","last_unstale":"2023-11-04T01:41:03.222039+0000","last_undegraded":"2023-11-04T01:41:03.222039+0000","last_fullsized":"2023-11-04T01:41:03.222039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:50:47.307289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223181+0000","last_change":"2023-11-04T01:41:02.011601+0000","last_active":"2023-11-04T01:41:03.223181+0000","last_peered":"2023-11-04T01:41:03.223181+0000","last_clean":"2023-11-04T01:41:03.223181+0000","last_became_active":"2023-11-04T01:41:02.010343+0000","last_became_peered":"2023-11-04T01:41:02.010343+0000","last_unstale":"2023-11-04T01:41:03.223181+0000","last_undegraded":"2023-11-04T01:41:03.223181+0000","last_fullsized":"2023-11-04T01:41:03.223181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:59:38.428981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223221+0000","last_change":"2023-11-04T01:41:02.056371+0000","last_active":"2023-11-04T01:41:03.223221+0000","last_peered":"2023-11-04T01:41:03.223221+0000","last_clean":"2023-11-04T01:41:03.223221+0000","last_became_active":"2023-11-04T01:41:02.055303+0000","last_became_peered":"2023-11-04T01:41:02.055303+0000","last_unstale":"2023-11-04T01:41:03.223221+0000","last_undegraded":"2023-11-04T01:41:03.223221+0000","last_fullsized":"2023-11-04T01:41:03.223221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:26.079231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222535+0000","last_change":"2023-11-04T01:41:02.034297+0000","last_active":"2023-11-04T01:41:03.222535+0000","last_peered":"2023-11-04T01:41:03.222535+0000","last_clean":"2023-11-04T01:41:03.222535+0000","last_became_active":"2023-11-04T01:41:02.033492+0000","last_became_peered":"2023-11-04T01:41:02.033492+0000","last_unstale":"2023-11-04T01:41:03.222535+0000","last_undegraded":"2023-11-04T01:41:03.222535+0000","last_fullsized":"2023-11-04T01:41:03.222535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:18.439903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.005939+0000","last_change":"2023-11-04T01:41:02.025517+0000","last_active":"2023-11-04T01:41:03.005939+0000","last_peered":"2023-11-04T01:41:03.005939+0000","last_clean":"2023-11-04T01:41:03.005939+0000","last_became_active":"2023-11-04T01:41:02.021284+0000","last_became_peered":"2023-11-04T01:41:02.021284+0000","last_unstale":"2023-11-04T01:41:03.005939+0000","last_undegraded":"2023-11-04T01:41:03.005939+0000","last_fullsized":"2023-11-04T01:41:03.005939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:30:26.154895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224821+0000","last_change":"2023-11-04T01:41:02.019675+0000","last_active":"2023-11-04T01:41:03.224821+0000","last_peered":"2023-11-04T01:41:03.224821+0000","last_clean":"2023-11-04T01:41:03.224821+0000","last_became_active":"2023-11-04T01:41:02.016916+0000","last_became_peered":"2023-11-04T01:41:02.016916+0000","last_unstale":"2023-11-04T01:41:03.224821+0000","last_undegraded":"2023-11-04T01:41:03.224821+0000","last_fullsized":"2023-11-04T01:41:03.224821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:03.007213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223859+0000","last_change":"2023-11-04T01:41:02.036905+0000","last_active":"2023-11-04T01:41:03.223859+0000","last_peered":"2023-11-04T01:41:03.223859+0000","last_clean":"2023-11-04T01:41:03.223859+0000","last_became_active":"2023-11-04T01:41:02.036068+0000","last_became_peered":"2023-11-04T01:41:02.036068+0000","last_unstale":"2023-11-04T01:41:03.223859+0000","last_undegraded":"2023-11-04T01:41:03.223859+0000","last_fullsized":"2023-11-04T01:41:03.223859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:21.452706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003382+0000","last_change":"2023-11-04T01:41:02.022273+0000","last_active":"2023-11-04T01:41:03.003382+0000","last_peered":"2023-11-04T01:41:03.003382+0000","last_clean":"2023-11-04T01:41:03.003382+0000","last_became_active":"2023-11-04T01:41:02.021454+0000","last_became_peered":"2023-11-04T01:41:02.021454+0000","last_unstale":"2023-11-04T01:41:03.003382+0000","last_undegraded":"2023-11-04T01:41:03.003382+0000","last_fullsized":"2023-11-04T01:41:03.003382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.056990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222375+0000","last_change":"2023-11-04T01:41:02.026025+0000","last_active":"2023-11-04T01:41:03.222375+0000","last_peered":"2023-11-04T01:41:03.222375+0000","last_clean":"2023-11-04T01:41:03.222375+0000","last_became_active":"2023-11-04T01:41:02.024806+0000","last_became_peered":"2023-11-04T01:41:02.024806+0000","last_unstale":"2023-11-04T01:41:03.222375+0000","last_undegraded":"2023-11-04T01:41:03.222375+0000","last_fullsized":"2023-11-04T01:41:03.222375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:30.363181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223543+0000","last_change":"2023-11-04T01:41:02.011101+0000","last_active":"2023-11-04T01:41:03.223543+0000","last_peered":"2023-11-04T01:41:03.223543+0000","last_clean":"2023-11-04T01:41:03.223543+0000","last_became_active":"2023-11-04T01:41:02.009392+0000","last_became_peered":"2023-11-04T01:41:02.009392+0000","last_unstale":"2023-11-04T01:41:03.223543+0000","last_undegraded":"2023-11-04T01:41:03.223543+0000","last_fullsized":"2023-11-04T01:41:03.223543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:43.924403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.002992+0000","last_change":"2023-11-04T01:41:02.059741+0000","last_active":"2023-11-04T01:41:03.002992+0000","last_peered":"2023-11-04T01:41:03.002992+0000","last_clean":"2023-11-04T01:41:03.002992+0000","last_became_active":"2023-11-04T01:41:02.058996+0000","last_became_peered":"2023-11-04T01:41:02.058996+0000","last_unstale":"2023-11-04T01:41:03.002992+0000","last_undegraded":"2023-11-04T01:41:03.002992+0000","last_fullsized":"2023-11-04T01:41:03.002992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:46.089159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223421+0000","last_change":"2023-11-04T01:41:02.043064+0000","last_active":"2023-11-04T01:41:03.223421+0000","last_peered":"2023-11-04T01:41:03.223421+0000","last_clean":"2023-11-04T01:41:03.223421+0000","last_became_active":"2023-11-04T01:41:02.042297+0000","last_became_peered":"2023-11-04T01:41:02.042297+0000","last_unstale":"2023-11-04T01:41:03.223421+0000","last_undegraded":"2023-11-04T01:41:03.223421+0000","last_fullsized":"2023-11-04T01:41:03.223421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:55.505066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225017+0000","last_change":"2023-11-04T01:41:02.055972+0000","last_active":"2023-11-04T01:41:03.225017+0000","last_peered":"2023-11-04T01:41:03.225017+0000","last_clean":"2023-11-04T01:41:03.225017+0000","last_became_active":"2023-11-04T01:41:02.055212+0000","last_became_peered":"2023-11-04T01:41:02.055212+0000","last_unstale":"2023-11-04T01:41:03.225017+0000","last_undegraded":"2023-11-04T01:41:03.225017+0000","last_fullsized":"2023-11-04T01:41:03.225017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:59:38.428981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223688+0000","last_change":"2023-11-04T01:41:02.022385+0000","last_active":"2023-11-04T01:41:03.223688+0000","last_peered":"2023-11-04T01:41:03.223688+0000","last_clean":"2023-11-04T01:41:03.223688+0000","last_became_active":"2023-11-04T01:41:02.021451+0000","last_became_peered":"2023-11-04T01:41:02.021451+0000","last_unstale":"2023-11-04T01:41:03.223688+0000","last_undegraded":"2023-11-04T01:41:03.223688+0000","last_fullsized":"2023-11-04T01:41:03.223688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:53.907155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.226462+0000","last_change":"2023-11-04T01:41:02.020064+0000","last_active":"2023-11-04T01:41:03.226462+0000","last_peered":"2023-11-04T01:41:03.226462+0000","last_clean":"2023-11-04T01:41:03.226462+0000","last_became_active":"2023-11-04T01:41:02.019190+0000","last_became_peered":"2023-11-04T01:41:02.019190+0000","last_unstale":"2023-11-04T01:41:03.226462+0000","last_undegraded":"2023-11-04T01:41:03.226462+0000","last_fullsized":"2023-11-04T01:41:03.226462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:41:57.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224112+0000","last_change":"2023-11-04T01:41:02.030172+0000","last_active":"2023-11-04T01:41:03.224112+0000","last_peered":"2023-11-04T01:41:03.224112+0000","last_clean":"2023-11-04T01:41:03.224112+0000","last_became_active":"2023-11-04T01:41:02.029740+0000","last_became_peered":"2023-11-04T01:41:02.029740+0000","last_unstale":"2023-11-04T01:41:03.224112+0000","last_undegraded":"2023-11-04T01:41:03.224112+0000","last_fullsized":"2023-11-04T01:41:03.224112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:17.273658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003054+0000","last_change":"2023-11-04T01:41:02.040778+0000","last_active":"2023-11-04T01:41:03.003054+0000","last_peered":"2023-11-04T01:41:03.003054+0000","last_clean":"2023-11-04T01:41:03.003054+0000","last_became_active":"2023-11-04T01:41:02.039939+0000","last_became_peered":"2023-11-04T01:41:02.039939+0000","last_unstale":"2023-11-04T01:41:03.003054+0000","last_undegraded":"2023-11-04T01:41:03.003054+0000","last_fullsized":"2023-11-04T01:41:03.003054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:05.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004323+0000","last_change":"2023-11-04T01:41:02.029177+0000","last_active":"2023-11-04T01:41:03.004323+0000","last_peered":"2023-11-04T01:41:03.004323+0000","last_clean":"2023-11-04T01:41:03.004323+0000","last_became_active":"2023-11-04T01:41:02.028452+0000","last_became_peered":"2023-11-04T01:41:02.028452+0000","last_unstale":"2023-11-04T01:41:03.004323+0000","last_undegraded":"2023-11-04T01:41:03.004323+0000","last_fullsized":"2023-11-04T01:41:03.004323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:39.945412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000149+0000","last_change":"2023-11-04T01:41:02.025421+0000","last_active":"2023-11-04T01:41:03.000149+0000","last_peered":"2023-11-04T01:41:03.000149+0000","last_clean":"2023-11-04T01:41:03.000149+0000","last_became_active":"2023-11-04T01:41:02.024554+0000","last_became_peered":"2023-11-04T01:41:02.024554+0000","last_unstale":"2023-11-04T01:41:03.000149+0000","last_undegraded":"2023-11-04T01:41:03.000149+0000","last_fullsized":"2023-11-04T01:41:03.000149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:57.348549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.002646+0000","last_change":"2023-11-04T01:41:02.011763+0000","last_active":"2023-11-04T01:41:03.002646+0000","last_peered":"2023-11-04T01:41:03.002646+0000","last_clean":"2023-11-04T01:41:03.002646+0000","last_became_active":"2023-11-04T01:41:02.011023+0000","last_became_peered":"2023-11-04T01:41:02.011023+0000","last_unstale":"2023-11-04T01:41:03.002646+0000","last_undegraded":"2023-11-04T01:41:03.002646+0000","last_fullsized":"2023-11-04T01:41:03.002646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:18.439903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225037+0000","last_change":"2023-11-04T01:41:02.025125+0000","last_active":"2023-11-04T01:41:03.225037+0000","last_peered":"2023-11-04T01:41:03.225037+0000","last_clean":"2023-11-04T01:41:03.225037+0000","last_became_active":"2023-11-04T01:41:02.024715+0000","last_became_peered":"2023-11-04T01:41:02.024715+0000","last_unstale":"2023-11-04T01:41:03.225037+0000","last_undegraded":"2023-11-04T01:41:03.225037+0000","last_fullsized":"2023-11-04T01:41:03.225037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:47:06.704172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223914+0000","last_change":"2023-11-04T01:41:02.031580+0000","last_active":"2023-11-04T01:41:03.223914+0000","last_peered":"2023-11-04T01:41:03.223914+0000","last_clean":"2023-11-04T01:41:03.223914+0000","last_became_active":"2023-11-04T01:41:02.031183+0000","last_became_peered":"2023-11-04T01:41:02.031183+0000","last_unstale":"2023-11-04T01:41:03.223914+0000","last_undegraded":"2023-11-04T01:41:03.223914+0000","last_fullsized":"2023-11-04T01:41:03.223914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:01.550039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225022+0000","last_change":"2023-11-04T01:41:02.019163+0000","last_active":"2023-11-04T01:41:03.225022+0000","last_peered":"2023-11-04T01:41:03.225022+0000","last_clean":"2023-11-04T01:41:03.225022+0000","last_became_active":"2023-11-04T01:41:02.018356+0000","last_became_peered":"2023-11-04T01:41:02.018356+0000","last_unstale":"2023-11-04T01:41:03.225022+0000","last_undegraded":"2023-11-04T01:41:03.225022+0000","last_fullsized":"2023-11-04T01:41:03.225022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:01.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003578+0000","last_change":"2023-11-04T01:41:02.025390+0000","last_active":"2023-11-04T01:41:03.003578+0000","last_peered":"2023-11-04T01:41:03.003578+0000","last_clean":"2023-11-04T01:41:03.003578+0000","last_became_active":"2023-11-04T01:41:02.024569+0000","last_became_peered":"2023-11-04T01:41:02.024569+0000","last_unstale":"2023-11-04T01:41:03.003578+0000","last_undegraded":"2023-11-04T01:41:03.003578+0000","last_fullsized":"2023-11-04T01:41:03.003578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:26.079231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003395+0000","last_change":"2023-11-04T01:41:02.026456+0000","last_active":"2023-11-04T01:41:03.003395+0000","last_peered":"2023-11-04T01:41:03.003395+0000","last_clean":"2023-11-04T01:41:03.003395+0000","last_became_active":"2023-11-04T01:41:02.025700+0000","last_became_peered":"2023-11-04T01:41:02.025700+0000","last_unstale":"2023-11-04T01:41:03.003395+0000","last_undegraded":"2023-11-04T01:41:03.003395+0000","last_fullsized":"2023-11-04T01:41:03.003395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:06.588034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223308+0000","last_change":"2023-11-04T01:41:02.040855+0000","last_active":"2023-11-04T01:41:03.223308+0000","last_peered":"2023-11-04T01:41:03.223308+0000","last_clean":"2023-11-04T01:41:03.223308+0000","last_became_active":"2023-11-04T01:41:02.040281+0000","last_became_peered":"2023-11-04T01:41:02.040281+0000","last_unstale":"2023-11-04T01:41:03.223308+0000","last_undegraded":"2023-11-04T01:41:03.223308+0000","last_fullsized":"2023-11-04T01:41:03.223308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:05.116353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223933+0000","last_change":"2023-11-04T01:41:02.034725+0000","last_active":"2023-11-04T01:41:03.223933+0000","last_peered":"2023-11-04T01:41:03.223933+0000","last_clean":"2023-11-04T01:41:03.223933+0000","last_became_active":"2023-11-04T01:41:02.034015+0000","last_became_peered":"2023-11-04T01:41:02.034015+0000","last_unstale":"2023-11-04T01:41:03.223933+0000","last_undegraded":"2023-11-04T01:41:03.223933+0000","last_fullsized":"2023-11-04T01:41:03.223933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:44.033386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222596+0000","last_change":"2023-11-04T01:41:02.032700+0000","last_active":"2023-11-04T01:41:03.222596+0000","last_peered":"2023-11-04T01:41:03.222596+0000","last_clean":"2023-11-04T01:41:03.222596+0000","last_became_active":"2023-11-04T01:41:02.031752+0000","last_became_peered":"2023-11-04T01:41:02.031752+0000","last_unstale":"2023-11-04T01:41:03.222596+0000","last_undegraded":"2023-11-04T01:41:03.222596+0000","last_fullsized":"2023-11-04T01:41:03.222596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:46.089159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000817+0000","last_change":"2023-11-04T01:41:02.033357+0000","last_active":"2023-11-04T01:41:03.000817+0000","last_peered":"2023-11-04T01:41:03.000817+0000","last_clean":"2023-11-04T01:41:03.000817+0000","last_became_active":"2023-11-04T01:41:02.032546+0000","last_became_peered":"2023-11-04T01:41:02.032546+0000","last_unstale":"2023-11-04T01:41:03.000817+0000","last_undegraded":"2023-11-04T01:41:03.000817+0000","last_fullsized":"2023-11-04T01:41:03.000817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:06.588034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.061473+0000","last_change":"2023-11-04T01:41:00.975005+0000","last_active":"2023-11-04T01:41:02.061473+0000","last_peered":"2023-11-04T01:41:02.061473+0000","last_clean":"2023-11-04T01:41:02.061473+0000","last_became_active":"2023-11-04T01:41:00.974249+0000","last_became_peered":"2023-11-04T01:41:00.974249+0000","last_unstale":"2023-11-04T01:41:02.061473+0000","last_undegraded":"2023-11-04T01:41:02.061473+0000","last_fullsized":"2023-11-04T01:41:02.061473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:05.421042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225103+0000","last_change":"2023-11-04T01:41:02.045083+0000","last_active":"2023-11-04T01:41:03.225103+0000","last_peered":"2023-11-04T01:41:03.225103+0000","last_clean":"2023-11-04T01:41:03.225103+0000","last_became_active":"2023-11-04T01:41:02.044323+0000","last_became_peered":"2023-11-04T01:41:02.044323+0000","last_unstale":"2023-11-04T01:41:03.225103+0000","last_undegraded":"2023-11-04T01:41:03.225103+0000","last_fullsized":"2023-11-04T01:41:03.225103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:05.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.055566+0000","last_change":"2023-11-04T01:41:00.975456+0000","last_active":"2023-11-04T01:41:02.055566+0000","last_peered":"2023-11-04T01:41:02.055566+0000","last_clean":"2023-11-04T01:41:02.055566+0000","last_became_active":"2023-11-04T01:41:00.974888+0000","last_became_peered":"2023-11-04T01:41:00.974888+0000","last_unstale":"2023-11-04T01:41:02.055566+0000","last_undegraded":"2023-11-04T01:41:02.055566+0000","last_fullsized":"2023-11-04T01:41:02.055566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:56.926892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.005612+0000","last_change":"2023-11-04T01:41:02.028158+0000","last_active":"2023-11-04T01:41:03.005612+0000","last_peered":"2023-11-04T01:41:03.005612+0000","last_clean":"2023-11-04T01:41:03.005612+0000","last_became_active":"2023-11-04T01:41:02.027173+0000","last_became_peered":"2023-11-04T01:41:02.027173+0000","last_unstale":"2023-11-04T01:41:03.005612+0000","last_undegraded":"2023-11-04T01:41:03.005612+0000","last_fullsized":"2023-11-04T01:41:03.005612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:36.990997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.050936+0000","last_change":"2023-11-04T01:41:00.984436+0000","last_active":"2023-11-04T01:41:02.050936+0000","last_peered":"2023-11-04T01:41:02.050936+0000","last_clean":"2023-11-04T01:41:02.050936+0000","last_became_active":"2023-11-04T01:41:00.982430+0000","last_became_peered":"2023-11-04T01:41:00.982430+0000","last_unstale":"2023-11-04T01:41:02.050936+0000","last_undegraded":"2023-11-04T01:41:02.050936+0000","last_fullsized":"2023-11-04T01:41:02.050936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:54.493341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225235+0000","last_change":"2023-11-04T01:41:02.020307+0000","last_active":"2023-11-04T01:41:03.225235+0000","last_peered":"2023-11-04T01:41:03.225235+0000","last_clean":"2023-11-04T01:41:03.225235+0000","last_became_active":"2023-11-04T01:41:02.018725+0000","last_became_peered":"2023-11-04T01:41:02.018725+0000","last_unstale":"2023-11-04T01:41:03.225235+0000","last_undegraded":"2023-11-04T01:41:03.225235+0000","last_fullsized":"2023-11-04T01:41:03.225235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:22.405765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.050400+0000","last_change":"2023-11-04T01:41:00.980583+0000","last_active":"2023-11-04T01:41:02.050400+0000","last_peered":"2023-11-04T01:41:02.050400+0000","last_clean":"2023-11-04T01:41:02.050400+0000","last_became_active":"2023-11-04T01:41:00.980232+0000","last_became_peered":"2023-11-04T01:41:00.980232+0000","last_unstale":"2023-11-04T01:41:02.050400+0000","last_undegraded":"2023-11-04T01:41:02.050400+0000","last_fullsized":"2023-11-04T01:41:02.050400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:46:17.067862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223293+0000","last_change":"2023-11-04T01:41:02.049203+0000","last_active":"2023-11-04T01:41:03.223293+0000","last_peered":"2023-11-04T01:41:03.223293+0000","last_clean":"2023-11-04T01:41:03.223293+0000","last_became_active":"2023-11-04T01:41:02.045109+0000","last_became_peered":"2023-11-04T01:41:02.045109+0000","last_unstale":"2023-11-04T01:41:03.223293+0000","last_undegraded":"2023-11-04T01:41:03.223293+0000","last_fullsized":"2023-11-04T01:41:03.223293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:09.064314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.058281+0000","last_change":"2023-11-04T01:41:00.992918+0000","last_active":"2023-11-04T01:41:02.058281+0000","last_peered":"2023-11-04T01:41:02.058281+0000","last_clean":"2023-11-04T01:41:02.058281+0000","last_became_active":"2023-11-04T01:41:00.992371+0000","last_became_peered":"2023-11-04T01:41:00.992371+0000","last_unstale":"2023-11-04T01:41:02.058281+0000","last_undegraded":"2023-11-04T01:41:02.058281+0000","last_fullsized":"2023-11-04T01:41:02.058281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:48.499842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003355+0000","last_change":"2023-11-04T01:41:02.036415+0000","last_active":"2023-11-04T01:41:03.003355+0000","last_peered":"2023-11-04T01:41:03.003355+0000","last_clean":"2023-11-04T01:41:03.003355+0000","last_became_active":"2023-11-04T01:41:02.035679+0000","last_became_peered":"2023-11-04T01:41:02.035679+0000","last_unstale":"2023-11-04T01:41:03.003355+0000","last_undegraded":"2023-11-04T01:41:03.003355+0000","last_fullsized":"2023-11-04T01:41:03.003355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:22.694350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.060317+0000","last_change":"2023-11-04T01:41:00.989321+0000","last_active":"2023-11-04T01:41:02.060317+0000","last_peered":"2023-11-04T01:41:02.060317+0000","last_clean":"2023-11-04T01:41:02.060317+0000","last_became_active":"2023-11-04T01:41:00.988208+0000","last_became_peered":"2023-11-04T01:41:00.988208+0000","last_unstale":"2023-11-04T01:41:02.060317+0000","last_undegraded":"2023-11-04T01:41:02.060317+0000","last_fullsized":"2023-11-04T01:41:02.060317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:39.915672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003811+0000","last_change":"2023-11-04T01:41:02.025339+0000","last_active":"2023-11-04T01:41:03.003811+0000","last_peered":"2023-11-04T01:41:03.003811+0000","last_clean":"2023-11-04T01:41:03.003811+0000","last_became_active":"2023-11-04T01:41:02.024527+0000","last_became_peered":"2023-11-04T01:41:02.024527+0000","last_unstale":"2023-11-04T01:41:03.003811+0000","last_undegraded":"2023-11-04T01:41:03.003811+0000","last_fullsized":"2023-11-04T01:41:03.003811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:23.091930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.988153+0000","last_change":"2023-11-04T01:41:00.989240+0000","last_active":"2023-11-04T01:41:01.988153+0000","last_peered":"2023-11-04T01:41:01.988153+0000","last_clean":"2023-11-04T01:41:01.988153+0000","last_became_active":"2023-11-04T01:41:00.988371+0000","last_became_peered":"2023-11-04T01:41:00.988371+0000","last_unstale":"2023-11-04T01:41:01.988153+0000","last_undegraded":"2023-11-04T01:41:01.988153+0000","last_fullsized":"2023-11-04T01:41:01.988153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:35.979272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.221925+0000","last_change":"2023-11-04T01:41:02.017764+0000","last_active":"2023-11-04T01:41:03.221925+0000","last_peered":"2023-11-04T01:41:03.221925+0000","last_clean":"2023-11-04T01:41:03.221925+0000","last_became_active":"2023-11-04T01:41:02.016995+0000","last_became_peered":"2023-11-04T01:41:02.016995+0000","last_unstale":"2023-11-04T01:41:03.221925+0000","last_undegraded":"2023-11-04T01:41:03.221925+0000","last_fullsized":"2023-11-04T01:41:03.221925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:39.945412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.001821+0000","last_change":"2023-11-04T01:41:00.989691+0000","last_active":"2023-11-04T01:41:02.001821+0000","last_peered":"2023-11-04T01:41:02.001821+0000","last_clean":"2023-11-04T01:41:02.001821+0000","last_became_active":"2023-11-04T01:41:00.987864+0000","last_became_peered":"2023-11-04T01:41:00.987864+0000","last_unstale":"2023-11-04T01:41:02.001821+0000","last_undegraded":"2023-11-04T01:41:02.001821+0000","last_fullsized":"2023-11-04T01:41:02.001821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:05.421042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004450+0000","last_change":"2023-11-04T01:41:02.027879+0000","last_active":"2023-11-04T01:41:03.004450+0000","last_peered":"2023-11-04T01:41:03.004450+0000","last_clean":"2023-11-04T01:41:03.004450+0000","last_became_active":"2023-11-04T01:41:02.027104+0000","last_became_peered":"2023-11-04T01:41:02.027104+0000","last_unstale":"2023-11-04T01:41:03.004450+0000","last_undegraded":"2023-11-04T01:41:03.004450+0000","last_fullsized":"2023-11-04T01:41:03.004450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:55.505066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.990036+0000","last_change":"2023-11-04T01:41:00.988649+0000","last_active":"2023-11-04T01:41:01.990036+0000","last_peered":"2023-11-04T01:41:01.990036+0000","last_clean":"2023-11-04T01:41:01.990036+0000","last_became_active":"2023-11-04T01:41:00.987342+0000","last_became_peered":"2023-11-04T01:41:00.987342+0000","last_unstale":"2023-11-04T01:41:01.990036+0000","last_undegraded":"2023-11-04T01:41:01.990036+0000","last_fullsized":"2023-11-04T01:41:01.990036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:04.104628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223923+0000","last_change":"2023-11-04T01:41:02.022139+0000","last_active":"2023-11-04T01:41:03.223923+0000","last_peered":"2023-11-04T01:41:03.223923+0000","last_clean":"2023-11-04T01:41:03.223923+0000","last_became_active":"2023-11-04T01:41:02.021325+0000","last_became_peered":"2023-11-04T01:41:02.021325+0000","last_unstale":"2023-11-04T01:41:03.223923+0000","last_undegraded":"2023-11-04T01:41:03.223923+0000","last_fullsized":"2023-11-04T01:41:03.223923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:00.838255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.014646+0000","last_change":"2023-11-04T01:41:00.982703+0000","last_active":"2023-11-04T01:41:02.014646+0000","last_peered":"2023-11-04T01:41:02.014646+0000","last_clean":"2023-11-04T01:41:02.014646+0000","last_became_active":"2023-11-04T01:41:00.982412+0000","last_became_peered":"2023-11-04T01:41:00.982412+0000","last_unstale":"2023-11-04T01:41:02.014646+0000","last_undegraded":"2023-11-04T01:41:02.014646+0000","last_fullsized":"2023-11-04T01:41:02.014646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:05.421042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223956+0000","last_change":"2023-11-04T01:41:02.031572+0000","last_active":"2023-11-04T01:41:03.223956+0000","last_peered":"2023-11-04T01:41:03.223956+0000","last_clean":"2023-11-04T01:41:03.223956+0000","last_became_active":"2023-11-04T01:41:02.031205+0000","last_became_peered":"2023-11-04T01:41:02.031205+0000","last_unstale":"2023-11-04T01:41:03.223956+0000","last_undegraded":"2023-11-04T01:41:03.223956+0000","last_fullsized":"2023-11-04T01:41:03.223956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:50:36.698244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.057804+0000","last_change":"2023-11-04T01:41:00.972403+0000","last_active":"2023-11-04T01:41:02.057804+0000","last_peered":"2023-11-04T01:41:02.057804+0000","last_clean":"2023-11-04T01:41:02.057804+0000","last_became_active":"2023-11-04T01:41:00.971900+0000","last_became_peered":"2023-11-04T01:41:00.971900+0000","last_unstale":"2023-11-04T01:41:02.057804+0000","last_undegraded":"2023-11-04T01:41:02.057804+0000","last_fullsized":"2023-11-04T01:41:02.057804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:57.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003780+0000","last_change":"2023-11-04T01:41:02.034376+0000","last_active":"2023-11-04T01:41:03.003780+0000","last_peered":"2023-11-04T01:41:03.003780+0000","last_clean":"2023-11-04T01:41:03.003780+0000","last_became_active":"2023-11-04T01:41:02.033596+0000","last_became_peered":"2023-11-04T01:41:02.033596+0000","last_unstale":"2023-11-04T01:41:03.003780+0000","last_undegraded":"2023-11-04T01:41:03.003780+0000","last_fullsized":"2023-11-04T01:41:03.003780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:09.064314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.061035+0000","last_change":"2023-11-04T01:41:00.986194+0000","last_active":"2023-11-04T01:41:02.061035+0000","last_peered":"2023-11-04T01:41:02.061035+0000","last_clean":"2023-11-04T01:41:02.061035+0000","last_became_active":"2023-11-04T01:41:00.985924+0000","last_became_peered":"2023-11-04T01:41:00.985924+0000","last_unstale":"2023-11-04T01:41:02.061035+0000","last_undegraded":"2023-11-04T01:41:02.061035+0000","last_fullsized":"2023-11-04T01:41:02.061035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:25.067506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222656+0000","last_change":"2023-11-04T01:41:02.017355+0000","last_active":"2023-11-04T01:41:03.222656+0000","last_peered":"2023-11-04T01:41:03.222656+0000","last_clean":"2023-11-04T01:41:03.222656+0000","last_became_active":"2023-11-04T01:41:02.016532+0000","last_became_peered":"2023-11-04T01:41:02.016532+0000","last_unstale":"2023-11-04T01:41:03.222656+0000","last_undegraded":"2023-11-04T01:41:03.222656+0000","last_fullsized":"2023-11-04T01:41:03.222656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:58.779669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.062817+0000","last_change":"2023-11-04T01:41:00.982259+0000","last_active":"2023-11-04T01:41:02.062817+0000","last_peered":"2023-11-04T01:41:02.062817+0000","last_clean":"2023-11-04T01:41:02.062817+0000","last_became_active":"2023-11-04T01:41:00.981685+0000","last_became_peered":"2023-11-04T01:41:00.981685+0000","last_unstale":"2023-11-04T01:41:02.062817+0000","last_undegraded":"2023-11-04T01:41:02.062817+0000","last_fullsized":"2023-11-04T01:41:02.062817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:16.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223517+0000","last_change":"2023-11-04T01:41:02.034767+0000","last_active":"2023-11-04T01:41:03.223517+0000","last_peered":"2023-11-04T01:41:03.223517+0000","last_clean":"2023-11-04T01:41:03.223517+0000","last_became_active":"2023-11-04T01:41:02.034432+0000","last_became_peered":"2023-11-04T01:41:02.034432+0000","last_unstale":"2023-11-04T01:41:03.223517+0000","last_undegraded":"2023-11-04T01:41:03.223517+0000","last_fullsized":"2023-11-04T01:41:03.223517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:29:18.453978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.009953+0000","last_change":"2023-11-04T01:41:00.979628+0000","last_active":"2023-11-04T01:41:02.009953+0000","last_peered":"2023-11-04T01:41:02.009953+0000","last_clean":"2023-11-04T01:41:02.009953+0000","last_became_active":"2023-11-04T01:41:00.979251+0000","last_became_peered":"2023-11-04T01:41:00.979251+0000","last_unstale":"2023-11-04T01:41:02.009953+0000","last_undegraded":"2023-11-04T01:41:02.009953+0000","last_fullsized":"2023-11-04T01:41:02.009953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:42.716689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222874+0000","last_change":"2023-11-04T01:41:02.053085+0000","last_active":"2023-11-04T01:41:03.222874+0000","last_peered":"2023-11-04T01:41:03.222874+0000","last_clean":"2023-11-04T01:41:03.222874+0000","last_became_active":"2023-11-04T01:41:02.052349+0000","last_became_peered":"2023-11-04T01:41:02.052349+0000","last_unstale":"2023-11-04T01:41:03.222874+0000","last_undegraded":"2023-11-04T01:41:03.222874+0000","last_fullsized":"2023-11-04T01:41:03.222874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:22.694350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.988207+0000","last_change":"2023-11-04T01:41:00.979412+0000","last_active":"2023-11-04T01:41:01.988207+0000","last_peered":"2023-11-04T01:41:01.988207+0000","last_clean":"2023-11-04T01:41:01.988207+0000","last_became_active":"2023-11-04T01:41:00.978807+0000","last_became_peered":"2023-11-04T01:41:00.978807+0000","last_unstale":"2023-11-04T01:41:01.988207+0000","last_undegraded":"2023-11-04T01:41:01.988207+0000","last_fullsized":"2023-11-04T01:41:01.988207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:57.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224264+0000","last_change":"2023-11-04T01:41:02.045099+0000","last_active":"2023-11-04T01:41:03.224264+0000","last_peered":"2023-11-04T01:41:03.224264+0000","last_clean":"2023-11-04T01:41:03.224264+0000","last_became_active":"2023-11-04T01:41:02.044351+0000","last_became_peered":"2023-11-04T01:41:02.044351+0000","last_unstale":"2023-11-04T01:41:03.224264+0000","last_undegraded":"2023-11-04T01:41:03.224264+0000","last_fullsized":"2023-11-04T01:41:03.224264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:17.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.051444+0000","last_change":"2023-11-04T01:41:00.985697+0000","last_active":"2023-11-04T01:41:02.051444+0000","last_peered":"2023-11-04T01:41:02.051444+0000","last_clean":"2023-11-04T01:41:02.051444+0000","last_became_active":"2023-11-04T01:41:00.985419+0000","last_became_peered":"2023-11-04T01:41:00.985419+0000","last_unstale":"2023-11-04T01:41:02.051444+0000","last_undegraded":"2023-11-04T01:41:02.051444+0000","last_fullsized":"2023-11-04T01:41:02.051444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:38.933687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.005772+0000","last_change":"2023-11-04T01:41:02.011396+0000","last_active":"2023-11-04T01:41:03.005772+0000","last_peered":"2023-11-04T01:41:03.005772+0000","last_clean":"2023-11-04T01:41:03.005772+0000","last_became_active":"2023-11-04T01:41:02.010544+0000","last_became_peered":"2023-11-04T01:41:02.010544+0000","last_unstale":"2023-11-04T01:41:03.005772+0000","last_undegraded":"2023-11-04T01:41:03.005772+0000","last_fullsized":"2023-11-04T01:41:03.005772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:58.779669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.051155+0000","last_change":"2023-11-04T01:41:00.984539+0000","last_active":"2023-11-04T01:41:02.051155+0000","last_peered":"2023-11-04T01:41:02.051155+0000","last_clean":"2023-11-04T01:41:02.051155+0000","last_became_active":"2023-11-04T01:41:00.984222+0000","last_became_peered":"2023-11-04T01:41:00.984222+0000","last_unstale":"2023-11-04T01:41:02.051155+0000","last_undegraded":"2023-11-04T01:41:02.051155+0000","last_fullsized":"2023-11-04T01:41:02.051155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:05.576309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004692+0000","last_change":"2023-11-04T01:41:02.019591+0000","last_active":"2023-11-04T01:41:03.004692+0000","last_peered":"2023-11-04T01:41:03.004692+0000","last_clean":"2023-11-04T01:41:03.004692+0000","last_became_active":"2023-11-04T01:41:02.018694+0000","last_became_peered":"2023-11-04T01:41:02.018694+0000","last_unstale":"2023-11-04T01:41:03.004692+0000","last_undegraded":"2023-11-04T01:41:03.004692+0000","last_fullsized":"2023-11-04T01:41:03.004692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:57.638556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.062385+0000","last_change":"2023-11-04T01:41:00.988103+0000","last_active":"2023-11-04T01:41:02.062385+0000","last_peered":"2023-11-04T01:41:02.062385+0000","last_clean":"2023-11-04T01:41:02.062385+0000","last_became_active":"2023-11-04T01:41:00.987426+0000","last_became_peered":"2023-11-04T01:41:00.987426+0000","last_unstale":"2023-11-04T01:41:02.062385+0000","last_undegraded":"2023-11-04T01:41:02.062385+0000","last_fullsized":"2023-11-04T01:41:02.062385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:42.716689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224457+0000","last_change":"2023-11-04T01:41:02.007760+0000","last_active":"2023-11-04T01:41:03.224457+0000","last_peered":"2023-11-04T01:41:03.224457+0000","last_clean":"2023-11-04T01:41:03.224457+0000","last_became_active":"2023-11-04T01:41:02.006992+0000","last_became_peered":"2023-11-04T01:41:02.006992+0000","last_unstale":"2023-11-04T01:41:03.224457+0000","last_undegraded":"2023-11-04T01:41:03.224457+0000","last_fullsized":"2023-11-04T01:41:03.224457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:30:26.154895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.060562+0000","last_change":"2023-11-04T01:41:00.987514+0000","last_active":"2023-11-04T01:41:02.060562+0000","last_peered":"2023-11-04T01:41:02.060562+0000","last_clean":"2023-11-04T01:41:02.060562+0000","last_became_active":"2023-11-04T01:41:00.986944+0000","last_became_peered":"2023-11-04T01:41:00.986944+0000","last_unstale":"2023-11-04T01:41:02.060562+0000","last_undegraded":"2023-11-04T01:41:02.060562+0000","last_fullsized":"2023-11-04T01:41:02.060562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:56.336824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225601+0000","last_change":"2023-11-04T01:41:02.029102+0000","last_active":"2023-11-04T01:41:03.225601+0000","last_peered":"2023-11-04T01:41:03.225601+0000","last_clean":"2023-11-04T01:41:03.225601+0000","last_became_active":"2023-11-04T01:41:02.028192+0000","last_became_peered":"2023-11-04T01:41:02.028192+0000","last_unstale":"2023-11-04T01:41:03.225601+0000","last_undegraded":"2023-11-04T01:41:03.225601+0000","last_fullsized":"2023-11-04T01:41:03.225601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:43.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.996308+0000","last_change":"2023-11-04T01:41:00.989962+0000","last_active":"2023-11-04T01:41:01.996308+0000","last_peered":"2023-11-04T01:41:01.996308+0000","last_clean":"2023-11-04T01:41:01.996308+0000","last_became_active":"2023-11-04T01:41:00.988247+0000","last_became_peered":"2023-11-04T01:41:00.988247+0000","last_unstale":"2023-11-04T01:41:01.996308+0000","last_undegraded":"2023-11-04T01:41:01.996308+0000","last_fullsized":"2023-11-04T01:41:01.996308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:50:46.295564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222176+0000","last_change":"2023-11-04T01:41:02.025830+0000","last_active":"2023-11-04T01:41:03.222176+0000","last_peered":"2023-11-04T01:41:03.222176+0000","last_clean":"2023-11-04T01:41:03.222176+0000","last_became_active":"2023-11-04T01:41:02.025039+0000","last_became_peered":"2023-11-04T01:41:02.025039+0000","last_unstale":"2023-11-04T01:41:03.222176+0000","last_undegraded":"2023-11-04T01:41:03.222176+0000","last_fullsized":"2023-11-04T01:41:03.222176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:13.996689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.049871+0000","last_change":"2023-11-04T01:41:00.963465+0000","last_active":"2023-11-04T01:41:02.049871+0000","last_peered":"2023-11-04T01:41:02.049871+0000","last_clean":"2023-11-04T01:41:02.049871+0000","last_became_active":"2023-11-04T01:41:00.962430+0000","last_became_peered":"2023-11-04T01:41:00.962430+0000","last_unstale":"2023-11-04T01:41:02.049871+0000","last_undegraded":"2023-11-04T01:41:02.049871+0000","last_fullsized":"2023-11-04T01:41:02.049871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:16.839452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222728+0000","last_change":"2023-11-04T01:41:02.037780+0000","last_active":"2023-11-04T01:41:03.222728+0000","last_peered":"2023-11-04T01:41:03.222728+0000","last_clean":"2023-11-04T01:41:03.222728+0000","last_became_active":"2023-11-04T01:41:02.037422+0000","last_became_peered":"2023-11-04T01:41:02.037422+0000","last_unstale":"2023-11-04T01:41:03.222728+0000","last_undegraded":"2023-11-04T01:41:03.222728+0000","last_fullsized":"2023-11-04T01:41:03.222728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:49.511567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.020080+0000","last_change":"2023-11-04T01:41:00.985286+0000","last_active":"2023-11-04T01:41:02.020080+0000","last_peered":"2023-11-04T01:41:02.020080+0000","last_clean":"2023-11-04T01:41:02.020080+0000","last_became_active":"2023-11-04T01:41:00.984355+0000","last_became_peered":"2023-11-04T01:41:00.984355+0000","last_unstale":"2023-11-04T01:41:02.020080+0000","last_undegraded":"2023-11-04T01:41:02.020080+0000","last_fullsized":"2023-11-04T01:41:02.020080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:47.043912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.221683+0000","last_change":"2023-11-04T01:41:02.034410+0000","last_active":"2023-11-04T01:41:03.221683+0000","last_peered":"2023-11-04T01:41:03.221683+0000","last_clean":"2023-11-04T01:41:03.221683+0000","last_became_active":"2023-11-04T01:41:02.034052+0000","last_became_peered":"2023-11-04T01:41:02.034052+0000","last_unstale":"2023-11-04T01:41:03.221683+0000","last_undegraded":"2023-11-04T01:41:03.221683+0000","last_fullsized":"2023-11-04T01:41:03.221683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:40.927397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.002972+0000","last_change":"2023-11-04T01:41:00.993775+0000","last_active":"2023-11-04T01:41:02.002972+0000","last_peered":"2023-11-04T01:41:02.002972+0000","last_clean":"2023-11-04T01:41:02.002972+0000","last_became_active":"2023-11-04T01:41:00.993007+0000","last_became_peered":"2023-11-04T01:41:00.993007+0000","last_unstale":"2023-11-04T01:41:02.002972+0000","last_undegraded":"2023-11-04T01:41:02.002972+0000","last_fullsized":"2023-11-04T01:41:02.002972+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:43.021661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222884+0000","last_change":"2023-11-04T01:41:02.040696+0000","last_active":"2023-11-04T01:41:03.222884+0000","last_peered":"2023-11-04T01:41:03.222884+0000","last_clean":"2023-11-04T01:41:03.222884+0000","last_became_active":"2023-11-04T01:41:02.039976+0000","last_became_peered":"2023-11-04T01:41:02.039976+0000","last_unstale":"2023-11-04T01:41:03.222884+0000","last_undegraded":"2023-11-04T01:41:03.222884+0000","last_fullsized":"2023-11-04T01:41:03.222884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.056990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.994919+0000","last_change":"2023-11-04T01:41:00.975887+0000","last_active":"2023-11-04T01:41:01.994919+0000","last_peered":"2023-11-04T01:41:01.994919+0000","last_clean":"2023-11-04T01:41:01.994919+0000","last_became_active":"2023-11-04T01:41:00.972668+0000","last_became_peered":"2023-11-04T01:41:00.972668+0000","last_unstale":"2023-11-04T01:41:01.994919+0000","last_undegraded":"2023-11-04T01:41:01.994919+0000","last_fullsized":"2023-11-04T01:41:01.994919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:05.576309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225841+0000","last_change":"2023-11-04T01:41:02.030194+0000","last_active":"2023-11-04T01:41:03.225841+0000","last_peered":"2023-11-04T01:41:03.225841+0000","last_clean":"2023-11-04T01:41:03.225841+0000","last_became_active":"2023-11-04T01:41:02.029784+0000","last_became_peered":"2023-11-04T01:41:02.029784+0000","last_unstale":"2023-11-04T01:41:03.225841+0000","last_undegraded":"2023-11-04T01:41:03.225841+0000","last_fullsized":"2023-11-04T01:41:03.225841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:10.087633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.053987+0000","last_change":"2023-11-04T01:41:00.980968+0000","last_active":"2023-11-04T01:41:02.053987+0000","last_peered":"2023-11-04T01:41:02.053987+0000","last_clean":"2023-11-04T01:41:02.053987+0000","last_became_active":"2023-11-04T01:41:00.980188+0000","last_became_peered":"2023-11-04T01:41:00.980188+0000","last_unstale":"2023-11-04T01:41:02.053987+0000","last_undegraded":"2023-11-04T01:41:02.053987+0000","last_fullsized":"2023-11-04T01:41:02.053987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:37.295146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004924+0000","last_change":"2023-11-04T01:41:02.035870+0000","last_active":"2023-11-04T01:41:03.004924+0000","last_peered":"2023-11-04T01:41:03.004924+0000","last_clean":"2023-11-04T01:41:03.004924+0000","last_became_active":"2023-11-04T01:41:02.035119+0000","last_became_peered":"2023-11-04T01:41:02.035119+0000","last_unstale":"2023-11-04T01:41:03.004924+0000","last_undegraded":"2023-11-04T01:41:03.004924+0000","last_fullsized":"2023-11-04T01:41:03.004924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:21.452706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.001099+0000","last_change":"2023-11-04T01:41:00.982493+0000","last_active":"2023-11-04T01:41:03.001099+0000","last_peered":"2023-11-04T01:41:03.001099+0000","last_clean":"2023-11-04T01:41:03.001099+0000","last_became_active":"2023-11-04T01:41:00.982158+0000","last_became_peered":"2023-11-04T01:41:00.982158+0000","last_unstale":"2023-11-04T01:41:03.001099+0000","last_undegraded":"2023-11-04T01:41:03.001099+0000","last_fullsized":"2023-11-04T01:41:03.001099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:47.043912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000626+0000","last_change":"2023-11-04T01:41:02.032869+0000","last_active":"2023-11-04T01:41:03.000626+0000","last_peered":"2023-11-04T01:41:03.000626+0000","last_clean":"2023-11-04T01:41:03.000626+0000","last_became_active":"2023-11-04T01:41:02.032532+0000","last_became_peered":"2023-11-04T01:41:02.032532+0000","last_unstale":"2023-11-04T01:41:03.000626+0000","last_undegraded":"2023-11-04T01:41:03.000626+0000","last_fullsized":"2023-11-04T01:41:03.000626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:38.306871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.011088+0000","last_change":"2023-11-04T01:41:00.979700+0000","last_active":"2023-11-04T01:41:02.011088+0000","last_peered":"2023-11-04T01:41:02.011088+0000","last_clean":"2023-11-04T01:41:02.011088+0000","last_became_active":"2023-11-04T01:41:00.979401+0000","last_became_peered":"2023-11-04T01:41:00.979401+0000","last_unstale":"2023-11-04T01:41:02.011088+0000","last_undegraded":"2023-11-04T01:41:02.011088+0000","last_fullsized":"2023-11-04T01:41:02.011088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:04.734195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224429+0000","last_change":"2023-11-04T01:41:02.040113+0000","last_active":"2023-11-04T01:41:03.224429+0000","last_peered":"2023-11-04T01:41:03.224429+0000","last_clean":"2023-11-04T01:41:03.224429+0000","last_became_active":"2023-11-04T01:41:02.039343+0000","last_became_peered":"2023-11-04T01:41:02.039343+0000","last_unstale":"2023-11-04T01:41:03.224429+0000","last_undegraded":"2023-11-04T01:41:03.224429+0000","last_fullsized":"2023-11-04T01:41:03.224429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:43.728414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.017590+0000","last_change":"2023-11-04T01:41:00.969677+0000","last_active":"2023-11-04T01:41:02.017590+0000","last_peered":"2023-11-04T01:41:02.017590+0000","last_clean":"2023-11-04T01:41:02.017590+0000","last_became_active":"2023-11-04T01:41:00.969246+0000","last_became_peered":"2023-11-04T01:41:00.969246+0000","last_unstale":"2023-11-04T01:41:02.017590+0000","last_undegraded":"2023-11-04T01:41:02.017590+0000","last_fullsized":"2023-11-04T01:41:02.017590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:42.716689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000512+0000","last_change":"2023-11-04T01:41:02.054125+0000","last_active":"2023-11-04T01:41:03.000512+0000","last_peered":"2023-11-04T01:41:03.000512+0000","last_clean":"2023-11-04T01:41:03.000512+0000","last_became_active":"2023-11-04T01:41:02.053793+0000","last_became_peered":"2023-11-04T01:41:02.053793+0000","last_unstale":"2023-11-04T01:41:03.000512+0000","last_undegraded":"2023-11-04T01:41:03.000512+0000","last_fullsized":"2023-11-04T01:41:03.000512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:05.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.010041+0000","last_change":"2023-11-04T01:41:00.981259+0000","last_active":"2023-11-04T01:41:02.010041+0000","last_peered":"2023-11-04T01:41:02.010041+0000","last_clean":"2023-11-04T01:41:02.010041+0000","last_became_active":"2023-11-04T01:41:00.979863+0000","last_became_peered":"2023-11-04T01:41:00.979863+0000","last_unstale":"2023-11-04T01:41:02.010041+0000","last_undegraded":"2023-11-04T01:41:02.010041+0000","last_fullsized":"2023-11-04T01:41:02.010041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:56.336824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222753+0000","last_change":"2023-11-04T01:41:02.023679+0000","last_active":"2023-11-04T01:41:03.222753+0000","last_peered":"2023-11-04T01:41:03.222753+0000","last_clean":"2023-11-04T01:41:03.222753+0000","last_became_active":"2023-11-04T01:41:02.021240+0000","last_became_peered":"2023-11-04T01:41:02.021240+0000","last_unstale":"2023-11-04T01:41:03.222753+0000","last_undegraded":"2023-11-04T01:41:03.222753+0000","last_fullsized":"2023-11-04T01:41:03.222753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:21.452706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.003328+0000","last_change":"2023-11-04T01:41:00.992915+0000","last_active":"2023-11-04T01:41:02.003328+0000","last_peered":"2023-11-04T01:41:02.003328+0000","last_clean":"2023-11-04T01:41:02.003328+0000","last_became_active":"2023-11-04T01:41:00.992197+0000","last_became_peered":"2023-11-04T01:41:00.992197+0000","last_unstale":"2023-11-04T01:41:02.003328+0000","last_undegraded":"2023-11-04T01:41:02.003328+0000","last_fullsized":"2023-11-04T01:41:02.003328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:16.839452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003233+0000","last_change":"2023-11-04T01:41:02.026067+0000","last_active":"2023-11-04T01:41:03.003233+0000","last_peered":"2023-11-04T01:41:03.003233+0000","last_clean":"2023-11-04T01:41:03.003233+0000","last_became_active":"2023-11-04T01:41:02.022311+0000","last_became_peered":"2023-11-04T01:41:02.022311+0000","last_unstale":"2023-11-04T01:41:03.003233+0000","last_undegraded":"2023-11-04T01:41:03.003233+0000","last_fullsized":"2023-11-04T01:41:03.003233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:38.306871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.988412+0000","last_change":"2023-11-04T01:41:00.978842+0000","last_active":"2023-11-04T01:41:01.988412+0000","last_peered":"2023-11-04T01:41:01.988412+0000","last_clean":"2023-11-04T01:41:01.988412+0000","last_became_active":"2023-11-04T01:41:00.976839+0000","last_became_peered":"2023-11-04T01:41:00.976839+0000","last_unstale":"2023-11-04T01:41:01.988412+0000","last_undegraded":"2023-11-04T01:41:01.988412+0000","last_fullsized":"2023-11-04T01:41:01.988412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:01.995488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223783+0000","last_change":"2023-11-04T01:41:02.034216+0000","last_active":"2023-11-04T01:41:03.223783+0000","last_peered":"2023-11-04T01:41:03.223783+0000","last_clean":"2023-11-04T01:41:03.223783+0000","last_became_active":"2023-11-04T01:41:02.032952+0000","last_became_peered":"2023-11-04T01:41:02.032952+0000","last_unstale":"2023-11-04T01:41:03.223783+0000","last_undegraded":"2023-11-04T01:41:03.223783+0000","last_fullsized":"2023-11-04T01:41:03.223783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:57.638556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.018529+0000","last_change":"2023-11-04T01:41:00.990195+0000","last_active":"2023-11-04T01:41:02.018529+0000","last_peered":"2023-11-04T01:41:02.018529+0000","last_clean":"2023-11-04T01:41:02.018529+0000","last_became_active":"2023-11-04T01:41:00.989708+0000","last_became_peered":"2023-11-04T01:41:00.989708+0000","last_unstale":"2023-11-04T01:41:02.018529+0000","last_undegraded":"2023-11-04T01:41:02.018529+0000","last_fullsized":"2023-11-04T01:41:02.018529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:56.926892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.020385+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:41:02.020385+0000","last_peered":"2023-11-04T01:41:02.020385+0000","last_clean":"2023-11-04T01:41:02.020385+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:41:02.020385+0000","last_undegraded":"2023-11-04T01:41:02.020385+0000","last_fullsized":"2023-11-04T01:41:02.020385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.92800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.151},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.874}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.995}]},{"osd":6,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.107},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.234}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.212}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0780000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.044}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0169999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.177},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.137}]},{"osd":7,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.298},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.331}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.874}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.107},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.145}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1850000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.234}]},{"osd":1,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1160000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.147}]},{"osd":5,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.98999999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.0429999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.753}]},{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.89500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.173},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.91800000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.224}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.101},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.0640000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.873}]},{"osd":5,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.98099999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2989999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.248},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90900000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.0409999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.3799999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.9379999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.6339999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.7809999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.532},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.716}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":736960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.335}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.97399999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.5369999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.5920000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4410000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.254},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.903}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.796},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.653}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:06.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:06.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.167+0000 7f369b559640 1 Processor -- start 2023-11-04T01:41:06.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.167+0000 7f369b559640 1 -- start start 2023-11-04T01:41:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f369b559640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 0x7f36940715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f369b559640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36940c2670 con 0x7f369406f8f0 2023-11-04T01:41:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f369b559640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369406bc30 con 0x7f36940b0d40 2023-11-04T01:41:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f369b559640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3694070140 con 0x7f369415afd0 2023-11-04T01:41:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f3698af4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f369406f8f0 0x7f36940b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51680/0 (socket says 172.21.15.40:51680) 2023-11-04T01:41:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f3698af4640 1 -- 172.21.15.40:0/2598397129 learned_addr learned my addr 172.21.15.40:0/2598397129 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 0x7f36940715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330702606 0 0) 0x7f36940c2670 con 0x7f369406f8f0 2023-11-04T01:41:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3680003530 con 0x7f369406f8f0 2023-11-04T01:41:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2655886650 0 0) 0x7f3680003530 con 0x7f369406f8f0 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 msgr2=0x7f36940715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 0x7f36940715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 >> v1:172.21.15.91:6789/0 conn(0x7f36940b0d40 legacy=0x7f369415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369406bf10 con 0x7f369406f8f0 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3690001680 con 0x7f369406f8f0 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 >> v1:172.21.15.40:6789/0 conn(0x7f369406f8f0 legacy=0x7f36940b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36800039b0 0x7f3680003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 0x7f36800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3680004d10 0x7f3680005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694070140 con 0x7f36800039b0 2023-11-04T01:41:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368000ba40 con 0x7f3680004d10 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368000bc00 con 0x7f369415afd0 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36800039b0 0x7f3680003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 -- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 msgr2=0x7f36800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f369415afd0 0x7f36800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 -- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3680004d10 msgr2=0x7f3680005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f3699af6640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3680004d10 0x7f3680005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3680004d10 0x7f3680005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 -- 172.21.15.40:0/2598397129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680003530 con 0x7f36800039b0 2023-11-04T01:41:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f36992f5640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36800039b0 0x7f3680003dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3684009ab0 tx=0x7f368401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d87a9e2d528a156 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840a6450 con 0x7f36800039b0 2023-11-04T01:41:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840a65b0 con 0x7f36800039b0 2023-11-04T01:41:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.171+0000 7f368bfff640 1 -- 172.21.15.40:0/2598397129 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840a6960 con 0x7f36800039b0 2023-11-04T01:41:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/2598397129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36800039b0 msgr2=0x7f3680003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 --2- 172.21.15.40:0/2598397129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36800039b0 0x7f3680003dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3684009ab0 tx=0x7f368401ca70 comp rx=0 tx=0).stop 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3699af6640 1 -- 172.21.15.40:0/2598397129 reap_dead start 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/2598397129 shutdown_connections 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/2598397129 >> 172.21.15.40:0/2598397129 conn(0x7f36940cebb0 msgr2=0x7f36940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/2598397129 shutdown_connections 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/2598397129 wait complete. 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 Processor -- start 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- start start 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36800039b0 0x7f36941f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 0x7f369415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36940ad1f0 0x7f36940ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369415e520 con 0x7f3694149050 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369415df60 con 0x7f36940ad1f0 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369415e240 con 0x7f36800039b0 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 0x7f369415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 0x7f369415d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38712/0 (socket says 172.21.15.40:38712) 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 -- 172.21.15.40:0/3300759200 learned_addr learned my addr 172.21.15.40:0/3300759200 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f36992f5640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36800039b0 0x7f36941f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3699af6640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36940ad1f0 0x7f36940ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 -- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36800039b0 msgr2=0x7f36941f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36800039b0 0x7f36941f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 -- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36940ad1f0 msgr2=0x7f36940ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36940ad1f0 0x7f36940ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 -- 172.21.15.40:0/3300759200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940ac9f0 con 0x7f3694149050 2023-11-04T01:41:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3698af4640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 0x7f369415d6e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f369000c680 tx=0x7f369000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900072d0 con 0x7f3694149050 2023-11-04T01:41:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690007450 con 0x7f3694149050 2023-11-04T01:41:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940accd0 con 0x7f3694149050 2023-11-04T01:41:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900047f0 con 0x7f3694149050 2023-11-04T01:41:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369415dc20 con 0x7f3694149050 2023-11-04T01:41:06.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.175+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36940acf10 con 0x7f3694149050 2023-11-04T01:41:06.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.179+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3690004950 con 0x7f3694149050 2023-11-04T01:41:06.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.179+0000 7f3689ffb640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36780664a0 0x7f3678068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.179+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36900834d0 con 0x7f3694149050 2023-11-04T01:41:06.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.179+0000 7f36992f5640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36780664a0 0x7f3678068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.179+0000 7f36992f5640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36780664a0 0x7f3678068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f36840ad000 tx=0x7f36840b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.183+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36940acf10 con 0x7f3694149050 2023-11-04T01:41:06.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.331+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f369406fcf0 con 0x7f36780664a0 2023-11-04T01:41:06.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.351+0000 7f3689ffb640 1 -- 172.21.15.40:0/3300759200 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287591 (secure 0 0 0) 0x7f36840a6720 con 0x7f36780664a0 2023-11-04T01:41:06.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:41:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36780664a0 msgr2=0x7f3678068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36780664a0 0x7f3678068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f36840ad000 tx=0x7f36840b2040 comp rx=0 tx=0).stop 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 msgr2=0x7f369415d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 0x7f369415d6e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f369000c680 tx=0x7f369000cb40 comp rx=0 tx=0).stop 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 shutdown_connections 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f36780664a0 0x7f3678068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36940ad1f0 0x7f36940ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3694149050 0x7f369415d6e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 --2- 172.21.15.40:0/3300759200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36800039b0 0x7f36941f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 >> 172.21.15.40:0/3300759200 conn(0x7f36940cebb0 msgr2=0x7f36940c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 shutdown_connections 2023-11-04T01:41:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.355+0000 7f369b559640 1 -- 172.21.15.40:0/3300759200 wait complete. 2023-11-04T01:41:06.377 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-04T01:41:05.770416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220356,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754364,"statfs":{"total":773094113280,"available":772868468736,"internally_reserved":0,"allocated":4235264,"data_stored":2358292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829433"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225045+0000","last_change":"2023-11-04T01:41:02.050387+0000","last_active":"2023-11-04T01:41:03.225045+0000","last_peered":"2023-11-04T01:41:03.225045+0000","last_clean":"2023-11-04T01:41:03.225045+0000","last_became_active":"2023-11-04T01:41:02.049813+0000","last_became_peered":"2023-11-04T01:41:02.049813+0000","last_unstale":"2023-11-04T01:41:03.225045+0000","last_undegraded":"2023-11-04T01:41:03.225045+0000","last_fullsized":"2023-11-04T01:41:03.225045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:57.348549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223479+0000","last_change":"2023-11-04T01:41:02.034081+0000","last_active":"2023-11-04T01:41:03.223479+0000","last_peered":"2023-11-04T01:41:03.223479+0000","last_clean":"2023-11-04T01:41:03.223479+0000","last_became_active":"2023-11-04T01:41:02.033734+0000","last_became_peered":"2023-11-04T01:41:02.033734+0000","last_unstale":"2023-11-04T01:41:03.223479+0000","last_undegraded":"2023-11-04T01:41:03.223479+0000","last_fullsized":"2023-11-04T01:41:03.223479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:06.788843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003948+0000","last_change":"2023-11-04T01:41:02.034574+0000","last_active":"2023-11-04T01:41:03.003948+0000","last_peered":"2023-11-04T01:41:03.003948+0000","last_clean":"2023-11-04T01:41:03.003948+0000","last_became_active":"2023-11-04T01:41:02.033781+0000","last_became_peered":"2023-11-04T01:41:02.033781+0000","last_unstale":"2023-11-04T01:41:03.003948+0000","last_undegraded":"2023-11-04T01:41:03.003948+0000","last_fullsized":"2023-11-04T01:41:03.003948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:05.116353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222001+0000","last_change":"2023-11-04T01:41:02.015182+0000","last_active":"2023-11-04T01:41:03.222001+0000","last_peered":"2023-11-04T01:41:03.222001+0000","last_clean":"2023-11-04T01:41:03.222001+0000","last_became_active":"2023-11-04T01:41:02.014426+0000","last_became_peered":"2023-11-04T01:41:02.014426+0000","last_unstale":"2023-11-04T01:41:03.222001+0000","last_undegraded":"2023-11-04T01:41:03.222001+0000","last_fullsized":"2023-11-04T01:41:03.222001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:36.990997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222039+0000","last_change":"2023-11-04T01:41:02.007374+0000","last_active":"2023-11-04T01:41:03.222039+0000","last_peered":"2023-11-04T01:41:03.222039+0000","last_clean":"2023-11-04T01:41:03.222039+0000","last_became_active":"2023-11-04T01:41:02.006644+0000","last_became_peered":"2023-11-04T01:41:02.006644+0000","last_unstale":"2023-11-04T01:41:03.222039+0000","last_undegraded":"2023-11-04T01:41:03.222039+0000","last_fullsized":"2023-11-04T01:41:03.222039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:50:47.307289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223181+0000","last_change":"2023-11-04T01:41:02.011601+0000","last_active":"2023-11-04T01:41:03.223181+0000","last_peered":"2023-11-04T01:41:03.223181+0000","last_clean":"2023-11-04T01:41:03.223181+0000","last_became_active":"2023-11-04T01:41:02.010343+0000","last_became_peered":"2023-11-04T01:41:02.010343+0000","last_unstale":"2023-11-04T01:41:03.223181+0000","last_undegraded":"2023-11-04T01:41:03.223181+0000","last_fullsized":"2023-11-04T01:41:03.223181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:59:38.428981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223221+0000","last_change":"2023-11-04T01:41:02.056371+0000","last_active":"2023-11-04T01:41:03.223221+0000","last_peered":"2023-11-04T01:41:03.223221+0000","last_clean":"2023-11-04T01:41:03.223221+0000","last_became_active":"2023-11-04T01:41:02.055303+0000","last_became_peered":"2023-11-04T01:41:02.055303+0000","last_unstale":"2023-11-04T01:41:03.223221+0000","last_undegraded":"2023-11-04T01:41:03.223221+0000","last_fullsized":"2023-11-04T01:41:03.223221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:26.079231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222535+0000","last_change":"2023-11-04T01:41:02.034297+0000","last_active":"2023-11-04T01:41:03.222535+0000","last_peered":"2023-11-04T01:41:03.222535+0000","last_clean":"2023-11-04T01:41:03.222535+0000","last_became_active":"2023-11-04T01:41:02.033492+0000","last_became_peered":"2023-11-04T01:41:02.033492+0000","last_unstale":"2023-11-04T01:41:03.222535+0000","last_undegraded":"2023-11-04T01:41:03.222535+0000","last_fullsized":"2023-11-04T01:41:03.222535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:18.439903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.005939+0000","last_change":"2023-11-04T01:41:02.025517+0000","last_active":"2023-11-04T01:41:03.005939+0000","last_peered":"2023-11-04T01:41:03.005939+0000","last_clean":"2023-11-04T01:41:03.005939+0000","last_became_active":"2023-11-04T01:41:02.021284+0000","last_became_peered":"2023-11-04T01:41:02.021284+0000","last_unstale":"2023-11-04T01:41:03.005939+0000","last_undegraded":"2023-11-04T01:41:03.005939+0000","last_fullsized":"2023-11-04T01:41:03.005939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:30:26.154895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224821+0000","last_change":"2023-11-04T01:41:02.019675+0000","last_active":"2023-11-04T01:41:03.224821+0000","last_peered":"2023-11-04T01:41:03.224821+0000","last_clean":"2023-11-04T01:41:03.224821+0000","last_became_active":"2023-11-04T01:41:02.016916+0000","last_became_peered":"2023-11-04T01:41:02.016916+0000","last_unstale":"2023-11-04T01:41:03.224821+0000","last_undegraded":"2023-11-04T01:41:03.224821+0000","last_fullsized":"2023-11-04T01:41:03.224821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:03.007213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223859+0000","last_change":"2023-11-04T01:41:02.036905+0000","last_active":"2023-11-04T01:41:03.223859+0000","last_peered":"2023-11-04T01:41:03.223859+0000","last_clean":"2023-11-04T01:41:03.223859+0000","last_became_active":"2023-11-04T01:41:02.036068+0000","last_became_peered":"2023-11-04T01:41:02.036068+0000","last_unstale":"2023-11-04T01:41:03.223859+0000","last_undegraded":"2023-11-04T01:41:03.223859+0000","last_fullsized":"2023-11-04T01:41:03.223859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:21.452706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003382+0000","last_change":"2023-11-04T01:41:02.022273+0000","last_active":"2023-11-04T01:41:03.003382+0000","last_peered":"2023-11-04T01:41:03.003382+0000","last_clean":"2023-11-04T01:41:03.003382+0000","last_became_active":"2023-11-04T01:41:02.021454+0000","last_became_peered":"2023-11-04T01:41:02.021454+0000","last_unstale":"2023-11-04T01:41:03.003382+0000","last_undegraded":"2023-11-04T01:41:03.003382+0000","last_fullsized":"2023-11-04T01:41:03.003382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.056990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222375+0000","last_change":"2023-11-04T01:41:02.026025+0000","last_active":"2023-11-04T01:41:03.222375+0000","last_peered":"2023-11-04T01:41:03.222375+0000","last_clean":"2023-11-04T01:41:03.222375+0000","last_became_active":"2023-11-04T01:41:02.024806+0000","last_became_peered":"2023-11-04T01:41:02.024806+0000","last_unstale":"2023-11-04T01:41:03.222375+0000","last_undegraded":"2023-11-04T01:41:03.222375+0000","last_fullsized":"2023-11-04T01:41:03.222375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:30.363181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223543+0000","last_change":"2023-11-04T01:41:02.011101+0000","last_active":"2023-11-04T01:41:03.223543+0000","last_peered":"2023-11-04T01:41:03.223543+0000","last_clean":"2023-11-04T01:41:03.223543+0000","last_became_active":"2023-11-04T01:41:02.009392+0000","last_became_peered":"2023-11-04T01:41:02.009392+0000","last_unstale":"2023-11-04T01:41:03.223543+0000","last_undegraded":"2023-11-04T01:41:03.223543+0000","last_fullsized":"2023-11-04T01:41:03.223543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:43.924403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.002992+0000","last_change":"2023-11-04T01:41:02.059741+0000","last_active":"2023-11-04T01:41:03.002992+0000","last_peered":"2023-11-04T01:41:03.002992+0000","last_clean":"2023-11-04T01:41:03.002992+0000","last_became_active":"2023-11-04T01:41:02.058996+0000","last_became_peered":"2023-11-04T01:41:02.058996+0000","last_unstale":"2023-11-04T01:41:03.002992+0000","last_undegraded":"2023-11-04T01:41:03.002992+0000","last_fullsized":"2023-11-04T01:41:03.002992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:46.089159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223421+0000","last_change":"2023-11-04T01:41:02.043064+0000","last_active":"2023-11-04T01:41:03.223421+0000","last_peered":"2023-11-04T01:41:03.223421+0000","last_clean":"2023-11-04T01:41:03.223421+0000","last_became_active":"2023-11-04T01:41:02.042297+0000","last_became_peered":"2023-11-04T01:41:02.042297+0000","last_unstale":"2023-11-04T01:41:03.223421+0000","last_undegraded":"2023-11-04T01:41:03.223421+0000","last_fullsized":"2023-11-04T01:41:03.223421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:55.505066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225017+0000","last_change":"2023-11-04T01:41:02.055972+0000","last_active":"2023-11-04T01:41:03.225017+0000","last_peered":"2023-11-04T01:41:03.225017+0000","last_clean":"2023-11-04T01:41:03.225017+0000","last_became_active":"2023-11-04T01:41:02.055212+0000","last_became_peered":"2023-11-04T01:41:02.055212+0000","last_unstale":"2023-11-04T01:41:03.225017+0000","last_undegraded":"2023-11-04T01:41:03.225017+0000","last_fullsized":"2023-11-04T01:41:03.225017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:59:38.428981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223688+0000","last_change":"2023-11-04T01:41:02.022385+0000","last_active":"2023-11-04T01:41:03.223688+0000","last_peered":"2023-11-04T01:41:03.223688+0000","last_clean":"2023-11-04T01:41:03.223688+0000","last_became_active":"2023-11-04T01:41:02.021451+0000","last_became_peered":"2023-11-04T01:41:02.021451+0000","last_unstale":"2023-11-04T01:41:03.223688+0000","last_undegraded":"2023-11-04T01:41:03.223688+0000","last_fullsized":"2023-11-04T01:41:03.223688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:53.907155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.226462+0000","last_change":"2023-11-04T01:41:02.020064+0000","last_active":"2023-11-04T01:41:03.226462+0000","last_peered":"2023-11-04T01:41:03.226462+0000","last_clean":"2023-11-04T01:41:03.226462+0000","last_became_active":"2023-11-04T01:41:02.019190+0000","last_became_peered":"2023-11-04T01:41:02.019190+0000","last_unstale":"2023-11-04T01:41:03.226462+0000","last_undegraded":"2023-11-04T01:41:03.226462+0000","last_fullsized":"2023-11-04T01:41:03.226462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:41:57.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224112+0000","last_change":"2023-11-04T01:41:02.030172+0000","last_active":"2023-11-04T01:41:03.224112+0000","last_peered":"2023-11-04T01:41:03.224112+0000","last_clean":"2023-11-04T01:41:03.224112+0000","last_became_active":"2023-11-04T01:41:02.029740+0000","last_became_peered":"2023-11-04T01:41:02.029740+0000","last_unstale":"2023-11-04T01:41:03.224112+0000","last_undegraded":"2023-11-04T01:41:03.224112+0000","last_fullsized":"2023-11-04T01:41:03.224112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:17.273658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003054+0000","last_change":"2023-11-04T01:41:02.040778+0000","last_active":"2023-11-04T01:41:03.003054+0000","last_peered":"2023-11-04T01:41:03.003054+0000","last_clean":"2023-11-04T01:41:03.003054+0000","last_became_active":"2023-11-04T01:41:02.039939+0000","last_became_peered":"2023-11-04T01:41:02.039939+0000","last_unstale":"2023-11-04T01:41:03.003054+0000","last_undegraded":"2023-11-04T01:41:03.003054+0000","last_fullsized":"2023-11-04T01:41:03.003054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:05.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004323+0000","last_change":"2023-11-04T01:41:02.029177+0000","last_active":"2023-11-04T01:41:03.004323+0000","last_peered":"2023-11-04T01:41:03.004323+0000","last_clean":"2023-11-04T01:41:03.004323+0000","last_became_active":"2023-11-04T01:41:02.028452+0000","last_became_peered":"2023-11-04T01:41:02.028452+0000","last_unstale":"2023-11-04T01:41:03.004323+0000","last_undegraded":"2023-11-04T01:41:03.004323+0000","last_fullsized":"2023-11-04T01:41:03.004323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:39.945412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000149+0000","last_change":"2023-11-04T01:41:02.025421+0000","last_active":"2023-11-04T01:41:03.000149+0000","last_peered":"2023-11-04T01:41:03.000149+0000","last_clean":"2023-11-04T01:41:03.000149+0000","last_became_active":"2023-11-04T01:41:02.024554+0000","last_became_peered":"2023-11-04T01:41:02.024554+0000","last_unstale":"2023-11-04T01:41:03.000149+0000","last_undegraded":"2023-11-04T01:41:03.000149+0000","last_fullsized":"2023-11-04T01:41:03.000149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:57.348549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.002646+0000","last_change":"2023-11-04T01:41:02.011763+0000","last_active":"2023-11-04T01:41:03.002646+0000","last_peered":"2023-11-04T01:41:03.002646+0000","last_clean":"2023-11-04T01:41:03.002646+0000","last_became_active":"2023-11-04T01:41:02.011023+0000","last_became_peered":"2023-11-04T01:41:02.011023+0000","last_unstale":"2023-11-04T01:41:03.002646+0000","last_undegraded":"2023-11-04T01:41:03.002646+0000","last_fullsized":"2023-11-04T01:41:03.002646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:18.439903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225037+0000","last_change":"2023-11-04T01:41:02.025125+0000","last_active":"2023-11-04T01:41:03.225037+0000","last_peered":"2023-11-04T01:41:03.225037+0000","last_clean":"2023-11-04T01:41:03.225037+0000","last_became_active":"2023-11-04T01:41:02.024715+0000","last_became_peered":"2023-11-04T01:41:02.024715+0000","last_unstale":"2023-11-04T01:41:03.225037+0000","last_undegraded":"2023-11-04T01:41:03.225037+0000","last_fullsized":"2023-11-04T01:41:03.225037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:47:06.704172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223914+0000","last_change":"2023-11-04T01:41:02.031580+0000","last_active":"2023-11-04T01:41:03.223914+0000","last_peered":"2023-11-04T01:41:03.223914+0000","last_clean":"2023-11-04T01:41:03.223914+0000","last_became_active":"2023-11-04T01:41:02.031183+0000","last_became_peered":"2023-11-04T01:41:02.031183+0000","last_unstale":"2023-11-04T01:41:03.223914+0000","last_undegraded":"2023-11-04T01:41:03.223914+0000","last_fullsized":"2023-11-04T01:41:03.223914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:01.550039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225022+0000","last_change":"2023-11-04T01:41:02.019163+0000","last_active":"2023-11-04T01:41:03.225022+0000","last_peered":"2023-11-04T01:41:03.225022+0000","last_clean":"2023-11-04T01:41:03.225022+0000","last_became_active":"2023-11-04T01:41:02.018356+0000","last_became_peered":"2023-11-04T01:41:02.018356+0000","last_unstale":"2023-11-04T01:41:03.225022+0000","last_undegraded":"2023-11-04T01:41:03.225022+0000","last_fullsized":"2023-11-04T01:41:03.225022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:01.297642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003578+0000","last_change":"2023-11-04T01:41:02.025390+0000","last_active":"2023-11-04T01:41:03.003578+0000","last_peered":"2023-11-04T01:41:03.003578+0000","last_clean":"2023-11-04T01:41:03.003578+0000","last_became_active":"2023-11-04T01:41:02.024569+0000","last_became_peered":"2023-11-04T01:41:02.024569+0000","last_unstale":"2023-11-04T01:41:03.003578+0000","last_undegraded":"2023-11-04T01:41:03.003578+0000","last_fullsized":"2023-11-04T01:41:03.003578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:26.079231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003395+0000","last_change":"2023-11-04T01:41:02.026456+0000","last_active":"2023-11-04T01:41:03.003395+0000","last_peered":"2023-11-04T01:41:03.003395+0000","last_clean":"2023-11-04T01:41:03.003395+0000","last_became_active":"2023-11-04T01:41:02.025700+0000","last_became_peered":"2023-11-04T01:41:02.025700+0000","last_unstale":"2023-11-04T01:41:03.003395+0000","last_undegraded":"2023-11-04T01:41:03.003395+0000","last_fullsized":"2023-11-04T01:41:03.003395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:06.588034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223308+0000","last_change":"2023-11-04T01:41:02.040855+0000","last_active":"2023-11-04T01:41:03.223308+0000","last_peered":"2023-11-04T01:41:03.223308+0000","last_clean":"2023-11-04T01:41:03.223308+0000","last_became_active":"2023-11-04T01:41:02.040281+0000","last_became_peered":"2023-11-04T01:41:02.040281+0000","last_unstale":"2023-11-04T01:41:03.223308+0000","last_undegraded":"2023-11-04T01:41:03.223308+0000","last_fullsized":"2023-11-04T01:41:03.223308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:05.116353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223933+0000","last_change":"2023-11-04T01:41:02.034725+0000","last_active":"2023-11-04T01:41:03.223933+0000","last_peered":"2023-11-04T01:41:03.223933+0000","last_clean":"2023-11-04T01:41:03.223933+0000","last_became_active":"2023-11-04T01:41:02.034015+0000","last_became_peered":"2023-11-04T01:41:02.034015+0000","last_unstale":"2023-11-04T01:41:03.223933+0000","last_undegraded":"2023-11-04T01:41:03.223933+0000","last_fullsized":"2023-11-04T01:41:03.223933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:44.033386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222596+0000","last_change":"2023-11-04T01:41:02.032700+0000","last_active":"2023-11-04T01:41:03.222596+0000","last_peered":"2023-11-04T01:41:03.222596+0000","last_clean":"2023-11-04T01:41:03.222596+0000","last_became_active":"2023-11-04T01:41:02.031752+0000","last_became_peered":"2023-11-04T01:41:02.031752+0000","last_unstale":"2023-11-04T01:41:03.222596+0000","last_undegraded":"2023-11-04T01:41:03.222596+0000","last_fullsized":"2023-11-04T01:41:03.222596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:46.089159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000817+0000","last_change":"2023-11-04T01:41:02.033357+0000","last_active":"2023-11-04T01:41:03.000817+0000","last_peered":"2023-11-04T01:41:03.000817+0000","last_clean":"2023-11-04T01:41:03.000817+0000","last_became_active":"2023-11-04T01:41:02.032546+0000","last_became_peered":"2023-11-04T01:41:02.032546+0000","last_unstale":"2023-11-04T01:41:03.000817+0000","last_undegraded":"2023-11-04T01:41:03.000817+0000","last_fullsized":"2023-11-04T01:41:03.000817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:06.588034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.061473+0000","last_change":"2023-11-04T01:41:00.975005+0000","last_active":"2023-11-04T01:41:02.061473+0000","last_peered":"2023-11-04T01:41:02.061473+0000","last_clean":"2023-11-04T01:41:02.061473+0000","last_became_active":"2023-11-04T01:41:00.974249+0000","last_became_peered":"2023-11-04T01:41:00.974249+0000","last_unstale":"2023-11-04T01:41:02.061473+0000","last_undegraded":"2023-11-04T01:41:02.061473+0000","last_fullsized":"2023-11-04T01:41:02.061473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:05.421042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225103+0000","last_change":"2023-11-04T01:41:02.045083+0000","last_active":"2023-11-04T01:41:03.225103+0000","last_peered":"2023-11-04T01:41:03.225103+0000","last_clean":"2023-11-04T01:41:03.225103+0000","last_became_active":"2023-11-04T01:41:02.044323+0000","last_became_peered":"2023-11-04T01:41:02.044323+0000","last_unstale":"2023-11-04T01:41:03.225103+0000","last_undegraded":"2023-11-04T01:41:03.225103+0000","last_fullsized":"2023-11-04T01:41:03.225103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:05.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.055566+0000","last_change":"2023-11-04T01:41:00.975456+0000","last_active":"2023-11-04T01:41:02.055566+0000","last_peered":"2023-11-04T01:41:02.055566+0000","last_clean":"2023-11-04T01:41:02.055566+0000","last_became_active":"2023-11-04T01:41:00.974888+0000","last_became_peered":"2023-11-04T01:41:00.974888+0000","last_unstale":"2023-11-04T01:41:02.055566+0000","last_undegraded":"2023-11-04T01:41:02.055566+0000","last_fullsized":"2023-11-04T01:41:02.055566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:56.926892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.005612+0000","last_change":"2023-11-04T01:41:02.028158+0000","last_active":"2023-11-04T01:41:03.005612+0000","last_peered":"2023-11-04T01:41:03.005612+0000","last_clean":"2023-11-04T01:41:03.005612+0000","last_became_active":"2023-11-04T01:41:02.027173+0000","last_became_peered":"2023-11-04T01:41:02.027173+0000","last_unstale":"2023-11-04T01:41:03.005612+0000","last_undegraded":"2023-11-04T01:41:03.005612+0000","last_fullsized":"2023-11-04T01:41:03.005612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:36.990997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.050936+0000","last_change":"2023-11-04T01:41:00.984436+0000","last_active":"2023-11-04T01:41:02.050936+0000","last_peered":"2023-11-04T01:41:02.050936+0000","last_clean":"2023-11-04T01:41:02.050936+0000","last_became_active":"2023-11-04T01:41:00.982430+0000","last_became_peered":"2023-11-04T01:41:00.982430+0000","last_unstale":"2023-11-04T01:41:02.050936+0000","last_undegraded":"2023-11-04T01:41:02.050936+0000","last_fullsized":"2023-11-04T01:41:02.050936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:54.493341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225235+0000","last_change":"2023-11-04T01:41:02.020307+0000","last_active":"2023-11-04T01:41:03.225235+0000","last_peered":"2023-11-04T01:41:03.225235+0000","last_clean":"2023-11-04T01:41:03.225235+0000","last_became_active":"2023-11-04T01:41:02.018725+0000","last_became_peered":"2023-11-04T01:41:02.018725+0000","last_unstale":"2023-11-04T01:41:03.225235+0000","last_undegraded":"2023-11-04T01:41:03.225235+0000","last_fullsized":"2023-11-04T01:41:03.225235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:22.405765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.050400+0000","last_change":"2023-11-04T01:41:00.980583+0000","last_active":"2023-11-04T01:41:02.050400+0000","last_peered":"2023-11-04T01:41:02.050400+0000","last_clean":"2023-11-04T01:41:02.050400+0000","last_became_active":"2023-11-04T01:41:00.980232+0000","last_became_peered":"2023-11-04T01:41:00.980232+0000","last_unstale":"2023-11-04T01:41:02.050400+0000","last_undegraded":"2023-11-04T01:41:02.050400+0000","last_fullsized":"2023-11-04T01:41:02.050400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:46:17.067862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223293+0000","last_change":"2023-11-04T01:41:02.049203+0000","last_active":"2023-11-04T01:41:03.223293+0000","last_peered":"2023-11-04T01:41:03.223293+0000","last_clean":"2023-11-04T01:41:03.223293+0000","last_became_active":"2023-11-04T01:41:02.045109+0000","last_became_peered":"2023-11-04T01:41:02.045109+0000","last_unstale":"2023-11-04T01:41:03.223293+0000","last_undegraded":"2023-11-04T01:41:03.223293+0000","last_fullsized":"2023-11-04T01:41:03.223293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:09.064314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.058281+0000","last_change":"2023-11-04T01:41:00.992918+0000","last_active":"2023-11-04T01:41:02.058281+0000","last_peered":"2023-11-04T01:41:02.058281+0000","last_clean":"2023-11-04T01:41:02.058281+0000","last_became_active":"2023-11-04T01:41:00.992371+0000","last_became_peered":"2023-11-04T01:41:00.992371+0000","last_unstale":"2023-11-04T01:41:02.058281+0000","last_undegraded":"2023-11-04T01:41:02.058281+0000","last_fullsized":"2023-11-04T01:41:02.058281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:48.499842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003355+0000","last_change":"2023-11-04T01:41:02.036415+0000","last_active":"2023-11-04T01:41:03.003355+0000","last_peered":"2023-11-04T01:41:03.003355+0000","last_clean":"2023-11-04T01:41:03.003355+0000","last_became_active":"2023-11-04T01:41:02.035679+0000","last_became_peered":"2023-11-04T01:41:02.035679+0000","last_unstale":"2023-11-04T01:41:03.003355+0000","last_undegraded":"2023-11-04T01:41:03.003355+0000","last_fullsized":"2023-11-04T01:41:03.003355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:22.694350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.060317+0000","last_change":"2023-11-04T01:41:00.989321+0000","last_active":"2023-11-04T01:41:02.060317+0000","last_peered":"2023-11-04T01:41:02.060317+0000","last_clean":"2023-11-04T01:41:02.060317+0000","last_became_active":"2023-11-04T01:41:00.988208+0000","last_became_peered":"2023-11-04T01:41:00.988208+0000","last_unstale":"2023-11-04T01:41:02.060317+0000","last_undegraded":"2023-11-04T01:41:02.060317+0000","last_fullsized":"2023-11-04T01:41:02.060317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:39.915672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003811+0000","last_change":"2023-11-04T01:41:02.025339+0000","last_active":"2023-11-04T01:41:03.003811+0000","last_peered":"2023-11-04T01:41:03.003811+0000","last_clean":"2023-11-04T01:41:03.003811+0000","last_became_active":"2023-11-04T01:41:02.024527+0000","last_became_peered":"2023-11-04T01:41:02.024527+0000","last_unstale":"2023-11-04T01:41:03.003811+0000","last_undegraded":"2023-11-04T01:41:03.003811+0000","last_fullsized":"2023-11-04T01:41:03.003811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:23.091930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.988153+0000","last_change":"2023-11-04T01:41:00.989240+0000","last_active":"2023-11-04T01:41:01.988153+0000","last_peered":"2023-11-04T01:41:01.988153+0000","last_clean":"2023-11-04T01:41:01.988153+0000","last_became_active":"2023-11-04T01:41:00.988371+0000","last_became_peered":"2023-11-04T01:41:00.988371+0000","last_unstale":"2023-11-04T01:41:01.988153+0000","last_undegraded":"2023-11-04T01:41:01.988153+0000","last_fullsized":"2023-11-04T01:41:01.988153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:35.979272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.221925+0000","last_change":"2023-11-04T01:41:02.017764+0000","last_active":"2023-11-04T01:41:03.221925+0000","last_peered":"2023-11-04T01:41:03.221925+0000","last_clean":"2023-11-04T01:41:03.221925+0000","last_became_active":"2023-11-04T01:41:02.016995+0000","last_became_peered":"2023-11-04T01:41:02.016995+0000","last_unstale":"2023-11-04T01:41:03.221925+0000","last_undegraded":"2023-11-04T01:41:03.221925+0000","last_fullsized":"2023-11-04T01:41:03.221925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:39.945412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.001821+0000","last_change":"2023-11-04T01:41:00.989691+0000","last_active":"2023-11-04T01:41:02.001821+0000","last_peered":"2023-11-04T01:41:02.001821+0000","last_clean":"2023-11-04T01:41:02.001821+0000","last_became_active":"2023-11-04T01:41:00.987864+0000","last_became_peered":"2023-11-04T01:41:00.987864+0000","last_unstale":"2023-11-04T01:41:02.001821+0000","last_undegraded":"2023-11-04T01:41:02.001821+0000","last_fullsized":"2023-11-04T01:41:02.001821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:05.421042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004450+0000","last_change":"2023-11-04T01:41:02.027879+0000","last_active":"2023-11-04T01:41:03.004450+0000","last_peered":"2023-11-04T01:41:03.004450+0000","last_clean":"2023-11-04T01:41:03.004450+0000","last_became_active":"2023-11-04T01:41:02.027104+0000","last_became_peered":"2023-11-04T01:41:02.027104+0000","last_unstale":"2023-11-04T01:41:03.004450+0000","last_undegraded":"2023-11-04T01:41:03.004450+0000","last_fullsized":"2023-11-04T01:41:03.004450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:55.505066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.990036+0000","last_change":"2023-11-04T01:41:00.988649+0000","last_active":"2023-11-04T01:41:01.990036+0000","last_peered":"2023-11-04T01:41:01.990036+0000","last_clean":"2023-11-04T01:41:01.990036+0000","last_became_active":"2023-11-04T01:41:00.987342+0000","last_became_peered":"2023-11-04T01:41:00.987342+0000","last_unstale":"2023-11-04T01:41:01.990036+0000","last_undegraded":"2023-11-04T01:41:01.990036+0000","last_fullsized":"2023-11-04T01:41:01.990036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:04.104628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223923+0000","last_change":"2023-11-04T01:41:02.022139+0000","last_active":"2023-11-04T01:41:03.223923+0000","last_peered":"2023-11-04T01:41:03.223923+0000","last_clean":"2023-11-04T01:41:03.223923+0000","last_became_active":"2023-11-04T01:41:02.021325+0000","last_became_peered":"2023-11-04T01:41:02.021325+0000","last_unstale":"2023-11-04T01:41:03.223923+0000","last_undegraded":"2023-11-04T01:41:03.223923+0000","last_fullsized":"2023-11-04T01:41:03.223923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:00.838255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.014646+0000","last_change":"2023-11-04T01:41:00.982703+0000","last_active":"2023-11-04T01:41:02.014646+0000","last_peered":"2023-11-04T01:41:02.014646+0000","last_clean":"2023-11-04T01:41:02.014646+0000","last_became_active":"2023-11-04T01:41:00.982412+0000","last_became_peered":"2023-11-04T01:41:00.982412+0000","last_unstale":"2023-11-04T01:41:02.014646+0000","last_undegraded":"2023-11-04T01:41:02.014646+0000","last_fullsized":"2023-11-04T01:41:02.014646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:05.421042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223956+0000","last_change":"2023-11-04T01:41:02.031572+0000","last_active":"2023-11-04T01:41:03.223956+0000","last_peered":"2023-11-04T01:41:03.223956+0000","last_clean":"2023-11-04T01:41:03.223956+0000","last_became_active":"2023-11-04T01:41:02.031205+0000","last_became_peered":"2023-11-04T01:41:02.031205+0000","last_unstale":"2023-11-04T01:41:03.223956+0000","last_undegraded":"2023-11-04T01:41:03.223956+0000","last_fullsized":"2023-11-04T01:41:03.223956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:50:36.698244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.057804+0000","last_change":"2023-11-04T01:41:00.972403+0000","last_active":"2023-11-04T01:41:02.057804+0000","last_peered":"2023-11-04T01:41:02.057804+0000","last_clean":"2023-11-04T01:41:02.057804+0000","last_became_active":"2023-11-04T01:41:00.971900+0000","last_became_peered":"2023-11-04T01:41:00.971900+0000","last_unstale":"2023-11-04T01:41:02.057804+0000","last_undegraded":"2023-11-04T01:41:02.057804+0000","last_fullsized":"2023-11-04T01:41:02.057804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:57.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003780+0000","last_change":"2023-11-04T01:41:02.034376+0000","last_active":"2023-11-04T01:41:03.003780+0000","last_peered":"2023-11-04T01:41:03.003780+0000","last_clean":"2023-11-04T01:41:03.003780+0000","last_became_active":"2023-11-04T01:41:02.033596+0000","last_became_peered":"2023-11-04T01:41:02.033596+0000","last_unstale":"2023-11-04T01:41:03.003780+0000","last_undegraded":"2023-11-04T01:41:03.003780+0000","last_fullsized":"2023-11-04T01:41:03.003780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:09.064314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.061035+0000","last_change":"2023-11-04T01:41:00.986194+0000","last_active":"2023-11-04T01:41:02.061035+0000","last_peered":"2023-11-04T01:41:02.061035+0000","last_clean":"2023-11-04T01:41:02.061035+0000","last_became_active":"2023-11-04T01:41:00.985924+0000","last_became_peered":"2023-11-04T01:41:00.985924+0000","last_unstale":"2023-11-04T01:41:02.061035+0000","last_undegraded":"2023-11-04T01:41:02.061035+0000","last_fullsized":"2023-11-04T01:41:02.061035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:25.067506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222656+0000","last_change":"2023-11-04T01:41:02.017355+0000","last_active":"2023-11-04T01:41:03.222656+0000","last_peered":"2023-11-04T01:41:03.222656+0000","last_clean":"2023-11-04T01:41:03.222656+0000","last_became_active":"2023-11-04T01:41:02.016532+0000","last_became_peered":"2023-11-04T01:41:02.016532+0000","last_unstale":"2023-11-04T01:41:03.222656+0000","last_undegraded":"2023-11-04T01:41:03.222656+0000","last_fullsized":"2023-11-04T01:41:03.222656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:58.779669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.062817+0000","last_change":"2023-11-04T01:41:00.982259+0000","last_active":"2023-11-04T01:41:02.062817+0000","last_peered":"2023-11-04T01:41:02.062817+0000","last_clean":"2023-11-04T01:41:02.062817+0000","last_became_active":"2023-11-04T01:41:00.981685+0000","last_became_peered":"2023-11-04T01:41:00.981685+0000","last_unstale":"2023-11-04T01:41:02.062817+0000","last_undegraded":"2023-11-04T01:41:02.062817+0000","last_fullsized":"2023-11-04T01:41:02.062817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:16.261933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223517+0000","last_change":"2023-11-04T01:41:02.034767+0000","last_active":"2023-11-04T01:41:03.223517+0000","last_peered":"2023-11-04T01:41:03.223517+0000","last_clean":"2023-11-04T01:41:03.223517+0000","last_became_active":"2023-11-04T01:41:02.034432+0000","last_became_peered":"2023-11-04T01:41:02.034432+0000","last_unstale":"2023-11-04T01:41:03.223517+0000","last_undegraded":"2023-11-04T01:41:03.223517+0000","last_fullsized":"2023-11-04T01:41:03.223517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:29:18.453978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.009953+0000","last_change":"2023-11-04T01:41:00.979628+0000","last_active":"2023-11-04T01:41:02.009953+0000","last_peered":"2023-11-04T01:41:02.009953+0000","last_clean":"2023-11-04T01:41:02.009953+0000","last_became_active":"2023-11-04T01:41:00.979251+0000","last_became_peered":"2023-11-04T01:41:00.979251+0000","last_unstale":"2023-11-04T01:41:02.009953+0000","last_undegraded":"2023-11-04T01:41:02.009953+0000","last_fullsized":"2023-11-04T01:41:02.009953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:42.716689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222874+0000","last_change":"2023-11-04T01:41:02.053085+0000","last_active":"2023-11-04T01:41:03.222874+0000","last_peered":"2023-11-04T01:41:03.222874+0000","last_clean":"2023-11-04T01:41:03.222874+0000","last_became_active":"2023-11-04T01:41:02.052349+0000","last_became_peered":"2023-11-04T01:41:02.052349+0000","last_unstale":"2023-11-04T01:41:03.222874+0000","last_undegraded":"2023-11-04T01:41:03.222874+0000","last_fullsized":"2023-11-04T01:41:03.222874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:22.694350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.988207+0000","last_change":"2023-11-04T01:41:00.979412+0000","last_active":"2023-11-04T01:41:01.988207+0000","last_peered":"2023-11-04T01:41:01.988207+0000","last_clean":"2023-11-04T01:41:01.988207+0000","last_became_active":"2023-11-04T01:41:00.978807+0000","last_became_peered":"2023-11-04T01:41:00.978807+0000","last_unstale":"2023-11-04T01:41:01.988207+0000","last_undegraded":"2023-11-04T01:41:01.988207+0000","last_fullsized":"2023-11-04T01:41:01.988207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:57.767944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224264+0000","last_change":"2023-11-04T01:41:02.045099+0000","last_active":"2023-11-04T01:41:03.224264+0000","last_peered":"2023-11-04T01:41:03.224264+0000","last_clean":"2023-11-04T01:41:03.224264+0000","last_became_active":"2023-11-04T01:41:02.044351+0000","last_became_peered":"2023-11-04T01:41:02.044351+0000","last_unstale":"2023-11-04T01:41:03.224264+0000","last_undegraded":"2023-11-04T01:41:03.224264+0000","last_fullsized":"2023-11-04T01:41:03.224264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:17.851177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.051444+0000","last_change":"2023-11-04T01:41:00.985697+0000","last_active":"2023-11-04T01:41:02.051444+0000","last_peered":"2023-11-04T01:41:02.051444+0000","last_clean":"2023-11-04T01:41:02.051444+0000","last_became_active":"2023-11-04T01:41:00.985419+0000","last_became_peered":"2023-11-04T01:41:00.985419+0000","last_unstale":"2023-11-04T01:41:02.051444+0000","last_undegraded":"2023-11-04T01:41:02.051444+0000","last_fullsized":"2023-11-04T01:41:02.051444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:38.933687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.005772+0000","last_change":"2023-11-04T01:41:02.011396+0000","last_active":"2023-11-04T01:41:03.005772+0000","last_peered":"2023-11-04T01:41:03.005772+0000","last_clean":"2023-11-04T01:41:03.005772+0000","last_became_active":"2023-11-04T01:41:02.010544+0000","last_became_peered":"2023-11-04T01:41:02.010544+0000","last_unstale":"2023-11-04T01:41:03.005772+0000","last_undegraded":"2023-11-04T01:41:03.005772+0000","last_fullsized":"2023-11-04T01:41:03.005772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:04:58.779669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.051155+0000","last_change":"2023-11-04T01:41:00.984539+0000","last_active":"2023-11-04T01:41:02.051155+0000","last_peered":"2023-11-04T01:41:02.051155+0000","last_clean":"2023-11-04T01:41:02.051155+0000","last_became_active":"2023-11-04T01:41:00.984222+0000","last_became_peered":"2023-11-04T01:41:00.984222+0000","last_unstale":"2023-11-04T01:41:02.051155+0000","last_undegraded":"2023-11-04T01:41:02.051155+0000","last_fullsized":"2023-11-04T01:41:02.051155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:05.576309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004692+0000","last_change":"2023-11-04T01:41:02.019591+0000","last_active":"2023-11-04T01:41:03.004692+0000","last_peered":"2023-11-04T01:41:03.004692+0000","last_clean":"2023-11-04T01:41:03.004692+0000","last_became_active":"2023-11-04T01:41:02.018694+0000","last_became_peered":"2023-11-04T01:41:02.018694+0000","last_unstale":"2023-11-04T01:41:03.004692+0000","last_undegraded":"2023-11-04T01:41:03.004692+0000","last_fullsized":"2023-11-04T01:41:03.004692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:57.638556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.062385+0000","last_change":"2023-11-04T01:41:00.988103+0000","last_active":"2023-11-04T01:41:02.062385+0000","last_peered":"2023-11-04T01:41:02.062385+0000","last_clean":"2023-11-04T01:41:02.062385+0000","last_became_active":"2023-11-04T01:41:00.987426+0000","last_became_peered":"2023-11-04T01:41:00.987426+0000","last_unstale":"2023-11-04T01:41:02.062385+0000","last_undegraded":"2023-11-04T01:41:02.062385+0000","last_fullsized":"2023-11-04T01:41:02.062385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:42.716689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224457+0000","last_change":"2023-11-04T01:41:02.007760+0000","last_active":"2023-11-04T01:41:03.224457+0000","last_peered":"2023-11-04T01:41:03.224457+0000","last_clean":"2023-11-04T01:41:03.224457+0000","last_became_active":"2023-11-04T01:41:02.006992+0000","last_became_peered":"2023-11-04T01:41:02.006992+0000","last_unstale":"2023-11-04T01:41:03.224457+0000","last_undegraded":"2023-11-04T01:41:03.224457+0000","last_fullsized":"2023-11-04T01:41:03.224457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:30:26.154895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.060562+0000","last_change":"2023-11-04T01:41:00.987514+0000","last_active":"2023-11-04T01:41:02.060562+0000","last_peered":"2023-11-04T01:41:02.060562+0000","last_clean":"2023-11-04T01:41:02.060562+0000","last_became_active":"2023-11-04T01:41:00.986944+0000","last_became_peered":"2023-11-04T01:41:00.986944+0000","last_unstale":"2023-11-04T01:41:02.060562+0000","last_undegraded":"2023-11-04T01:41:02.060562+0000","last_fullsized":"2023-11-04T01:41:02.060562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:56.336824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225601+0000","last_change":"2023-11-04T01:41:02.029102+0000","last_active":"2023-11-04T01:41:03.225601+0000","last_peered":"2023-11-04T01:41:03.225601+0000","last_clean":"2023-11-04T01:41:03.225601+0000","last_became_active":"2023-11-04T01:41:02.028192+0000","last_became_peered":"2023-11-04T01:41:02.028192+0000","last_unstale":"2023-11-04T01:41:03.225601+0000","last_undegraded":"2023-11-04T01:41:03.225601+0000","last_fullsized":"2023-11-04T01:41:03.225601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:43.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.996308+0000","last_change":"2023-11-04T01:41:00.989962+0000","last_active":"2023-11-04T01:41:01.996308+0000","last_peered":"2023-11-04T01:41:01.996308+0000","last_clean":"2023-11-04T01:41:01.996308+0000","last_became_active":"2023-11-04T01:41:00.988247+0000","last_became_peered":"2023-11-04T01:41:00.988247+0000","last_unstale":"2023-11-04T01:41:01.996308+0000","last_undegraded":"2023-11-04T01:41:01.996308+0000","last_fullsized":"2023-11-04T01:41:01.996308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:50:46.295564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222176+0000","last_change":"2023-11-04T01:41:02.025830+0000","last_active":"2023-11-04T01:41:03.222176+0000","last_peered":"2023-11-04T01:41:03.222176+0000","last_clean":"2023-11-04T01:41:03.222176+0000","last_became_active":"2023-11-04T01:41:02.025039+0000","last_became_peered":"2023-11-04T01:41:02.025039+0000","last_unstale":"2023-11-04T01:41:03.222176+0000","last_undegraded":"2023-11-04T01:41:03.222176+0000","last_fullsized":"2023-11-04T01:41:03.222176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:13.996689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.049871+0000","last_change":"2023-11-04T01:41:00.963465+0000","last_active":"2023-11-04T01:41:02.049871+0000","last_peered":"2023-11-04T01:41:02.049871+0000","last_clean":"2023-11-04T01:41:02.049871+0000","last_became_active":"2023-11-04T01:41:00.962430+0000","last_became_peered":"2023-11-04T01:41:00.962430+0000","last_unstale":"2023-11-04T01:41:02.049871+0000","last_undegraded":"2023-11-04T01:41:02.049871+0000","last_fullsized":"2023-11-04T01:41:02.049871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:16.839452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222728+0000","last_change":"2023-11-04T01:41:02.037780+0000","last_active":"2023-11-04T01:41:03.222728+0000","last_peered":"2023-11-04T01:41:03.222728+0000","last_clean":"2023-11-04T01:41:03.222728+0000","last_became_active":"2023-11-04T01:41:02.037422+0000","last_became_peered":"2023-11-04T01:41:02.037422+0000","last_unstale":"2023-11-04T01:41:03.222728+0000","last_undegraded":"2023-11-04T01:41:03.222728+0000","last_fullsized":"2023-11-04T01:41:03.222728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:49.511567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.020080+0000","last_change":"2023-11-04T01:41:00.985286+0000","last_active":"2023-11-04T01:41:02.020080+0000","last_peered":"2023-11-04T01:41:02.020080+0000","last_clean":"2023-11-04T01:41:02.020080+0000","last_became_active":"2023-11-04T01:41:00.984355+0000","last_became_peered":"2023-11-04T01:41:00.984355+0000","last_unstale":"2023-11-04T01:41:02.020080+0000","last_undegraded":"2023-11-04T01:41:02.020080+0000","last_fullsized":"2023-11-04T01:41:02.020080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:47.043912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.221683+0000","last_change":"2023-11-04T01:41:02.034410+0000","last_active":"2023-11-04T01:41:03.221683+0000","last_peered":"2023-11-04T01:41:03.221683+0000","last_clean":"2023-11-04T01:41:03.221683+0000","last_became_active":"2023-11-04T01:41:02.034052+0000","last_became_peered":"2023-11-04T01:41:02.034052+0000","last_unstale":"2023-11-04T01:41:03.221683+0000","last_undegraded":"2023-11-04T01:41:03.221683+0000","last_fullsized":"2023-11-04T01:41:03.221683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:40.927397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.002972+0000","last_change":"2023-11-04T01:41:00.993775+0000","last_active":"2023-11-04T01:41:02.002972+0000","last_peered":"2023-11-04T01:41:02.002972+0000","last_clean":"2023-11-04T01:41:02.002972+0000","last_became_active":"2023-11-04T01:41:00.993007+0000","last_became_peered":"2023-11-04T01:41:00.993007+0000","last_unstale":"2023-11-04T01:41:02.002972+0000","last_undegraded":"2023-11-04T01:41:02.002972+0000","last_fullsized":"2023-11-04T01:41:02.002972+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:43.021661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222884+0000","last_change":"2023-11-04T01:41:02.040696+0000","last_active":"2023-11-04T01:41:03.222884+0000","last_peered":"2023-11-04T01:41:03.222884+0000","last_clean":"2023-11-04T01:41:03.222884+0000","last_became_active":"2023-11-04T01:41:02.039976+0000","last_became_peered":"2023-11-04T01:41:02.039976+0000","last_unstale":"2023-11-04T01:41:03.222884+0000","last_undegraded":"2023-11-04T01:41:03.222884+0000","last_fullsized":"2023-11-04T01:41:03.222884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.056990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.994919+0000","last_change":"2023-11-04T01:41:00.975887+0000","last_active":"2023-11-04T01:41:01.994919+0000","last_peered":"2023-11-04T01:41:01.994919+0000","last_clean":"2023-11-04T01:41:01.994919+0000","last_became_active":"2023-11-04T01:41:00.972668+0000","last_became_peered":"2023-11-04T01:41:00.972668+0000","last_unstale":"2023-11-04T01:41:01.994919+0000","last_undegraded":"2023-11-04T01:41:01.994919+0000","last_fullsized":"2023-11-04T01:41:01.994919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:05.576309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.225841+0000","last_change":"2023-11-04T01:41:02.030194+0000","last_active":"2023-11-04T01:41:03.225841+0000","last_peered":"2023-11-04T01:41:03.225841+0000","last_clean":"2023-11-04T01:41:03.225841+0000","last_became_active":"2023-11-04T01:41:02.029784+0000","last_became_peered":"2023-11-04T01:41:02.029784+0000","last_unstale":"2023-11-04T01:41:03.225841+0000","last_undegraded":"2023-11-04T01:41:03.225841+0000","last_fullsized":"2023-11-04T01:41:03.225841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:10.087633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.053987+0000","last_change":"2023-11-04T01:41:00.980968+0000","last_active":"2023-11-04T01:41:02.053987+0000","last_peered":"2023-11-04T01:41:02.053987+0000","last_clean":"2023-11-04T01:41:02.053987+0000","last_became_active":"2023-11-04T01:41:00.980188+0000","last_became_peered":"2023-11-04T01:41:00.980188+0000","last_unstale":"2023-11-04T01:41:02.053987+0000","last_undegraded":"2023-11-04T01:41:02.053987+0000","last_fullsized":"2023-11-04T01:41:02.053987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:37.295146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.004924+0000","last_change":"2023-11-04T01:41:02.035870+0000","last_active":"2023-11-04T01:41:03.004924+0000","last_peered":"2023-11-04T01:41:03.004924+0000","last_clean":"2023-11-04T01:41:03.004924+0000","last_became_active":"2023-11-04T01:41:02.035119+0000","last_became_peered":"2023-11-04T01:41:02.035119+0000","last_unstale":"2023-11-04T01:41:03.004924+0000","last_undegraded":"2023-11-04T01:41:03.004924+0000","last_fullsized":"2023-11-04T01:41:03.004924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:21.452706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.001099+0000","last_change":"2023-11-04T01:41:00.982493+0000","last_active":"2023-11-04T01:41:03.001099+0000","last_peered":"2023-11-04T01:41:03.001099+0000","last_clean":"2023-11-04T01:41:03.001099+0000","last_became_active":"2023-11-04T01:41:00.982158+0000","last_became_peered":"2023-11-04T01:41:00.982158+0000","last_unstale":"2023-11-04T01:41:03.001099+0000","last_undegraded":"2023-11-04T01:41:03.001099+0000","last_fullsized":"2023-11-04T01:41:03.001099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:47.043912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000626+0000","last_change":"2023-11-04T01:41:02.032869+0000","last_active":"2023-11-04T01:41:03.000626+0000","last_peered":"2023-11-04T01:41:03.000626+0000","last_clean":"2023-11-04T01:41:03.000626+0000","last_became_active":"2023-11-04T01:41:02.032532+0000","last_became_peered":"2023-11-04T01:41:02.032532+0000","last_unstale":"2023-11-04T01:41:03.000626+0000","last_undegraded":"2023-11-04T01:41:03.000626+0000","last_fullsized":"2023-11-04T01:41:03.000626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:38.306871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.011088+0000","last_change":"2023-11-04T01:41:00.979700+0000","last_active":"2023-11-04T01:41:02.011088+0000","last_peered":"2023-11-04T01:41:02.011088+0000","last_clean":"2023-11-04T01:41:02.011088+0000","last_became_active":"2023-11-04T01:41:00.979401+0000","last_became_peered":"2023-11-04T01:41:00.979401+0000","last_unstale":"2023-11-04T01:41:02.011088+0000","last_undegraded":"2023-11-04T01:41:02.011088+0000","last_fullsized":"2023-11-04T01:41:02.011088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:04.734195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.224429+0000","last_change":"2023-11-04T01:41:02.040113+0000","last_active":"2023-11-04T01:41:03.224429+0000","last_peered":"2023-11-04T01:41:03.224429+0000","last_clean":"2023-11-04T01:41:03.224429+0000","last_became_active":"2023-11-04T01:41:02.039343+0000","last_became_peered":"2023-11-04T01:41:02.039343+0000","last_unstale":"2023-11-04T01:41:03.224429+0000","last_undegraded":"2023-11-04T01:41:03.224429+0000","last_fullsized":"2023-11-04T01:41:03.224429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:43.728414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.017590+0000","last_change":"2023-11-04T01:41:00.969677+0000","last_active":"2023-11-04T01:41:02.017590+0000","last_peered":"2023-11-04T01:41:02.017590+0000","last_clean":"2023-11-04T01:41:02.017590+0000","last_became_active":"2023-11-04T01:41:00.969246+0000","last_became_peered":"2023-11-04T01:41:00.969246+0000","last_unstale":"2023-11-04T01:41:02.017590+0000","last_undegraded":"2023-11-04T01:41:02.017590+0000","last_fullsized":"2023-11-04T01:41:02.017590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:42.716689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.000512+0000","last_change":"2023-11-04T01:41:02.054125+0000","last_active":"2023-11-04T01:41:03.000512+0000","last_peered":"2023-11-04T01:41:03.000512+0000","last_clean":"2023-11-04T01:41:03.000512+0000","last_became_active":"2023-11-04T01:41:02.053793+0000","last_became_peered":"2023-11-04T01:41:02.053793+0000","last_unstale":"2023-11-04T01:41:03.000512+0000","last_undegraded":"2023-11-04T01:41:03.000512+0000","last_fullsized":"2023-11-04T01:41:03.000512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:05.745920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.010041+0000","last_change":"2023-11-04T01:41:00.981259+0000","last_active":"2023-11-04T01:41:02.010041+0000","last_peered":"2023-11-04T01:41:02.010041+0000","last_clean":"2023-11-04T01:41:02.010041+0000","last_became_active":"2023-11-04T01:41:00.979863+0000","last_became_peered":"2023-11-04T01:41:00.979863+0000","last_unstale":"2023-11-04T01:41:02.010041+0000","last_undegraded":"2023-11-04T01:41:02.010041+0000","last_fullsized":"2023-11-04T01:41:02.010041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:56.336824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.222753+0000","last_change":"2023-11-04T01:41:02.023679+0000","last_active":"2023-11-04T01:41:03.222753+0000","last_peered":"2023-11-04T01:41:03.222753+0000","last_clean":"2023-11-04T01:41:03.222753+0000","last_became_active":"2023-11-04T01:41:02.021240+0000","last_became_peered":"2023-11-04T01:41:02.021240+0000","last_unstale":"2023-11-04T01:41:03.222753+0000","last_undegraded":"2023-11-04T01:41:03.222753+0000","last_fullsized":"2023-11-04T01:41:03.222753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:21.452706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.003328+0000","last_change":"2023-11-04T01:41:00.992915+0000","last_active":"2023-11-04T01:41:02.003328+0000","last_peered":"2023-11-04T01:41:02.003328+0000","last_clean":"2023-11-04T01:41:02.003328+0000","last_became_active":"2023-11-04T01:41:00.992197+0000","last_became_peered":"2023-11-04T01:41:00.992197+0000","last_unstale":"2023-11-04T01:41:02.003328+0000","last_undegraded":"2023-11-04T01:41:02.003328+0000","last_fullsized":"2023-11-04T01:41:02.003328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:16.839452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.003233+0000","last_change":"2023-11-04T01:41:02.026067+0000","last_active":"2023-11-04T01:41:03.003233+0000","last_peered":"2023-11-04T01:41:03.003233+0000","last_clean":"2023-11-04T01:41:03.003233+0000","last_became_active":"2023-11-04T01:41:02.022311+0000","last_became_peered":"2023-11-04T01:41:02.022311+0000","last_unstale":"2023-11-04T01:41:03.003233+0000","last_undegraded":"2023-11-04T01:41:03.003233+0000","last_fullsized":"2023-11-04T01:41:03.003233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:38.306871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:01.988412+0000","last_change":"2023-11-04T01:41:00.978842+0000","last_active":"2023-11-04T01:41:01.988412+0000","last_peered":"2023-11-04T01:41:01.988412+0000","last_clean":"2023-11-04T01:41:01.988412+0000","last_became_active":"2023-11-04T01:41:00.976839+0000","last_became_peered":"2023-11-04T01:41:00.976839+0000","last_unstale":"2023-11-04T01:41:01.988412+0000","last_undegraded":"2023-11-04T01:41:01.988412+0000","last_fullsized":"2023-11-04T01:41:01.988412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:01.995488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:41:03.223783+0000","last_change":"2023-11-04T01:41:02.034216+0000","last_active":"2023-11-04T01:41:03.223783+0000","last_peered":"2023-11-04T01:41:03.223783+0000","last_clean":"2023-11-04T01:41:03.223783+0000","last_became_active":"2023-11-04T01:41:02.032952+0000","last_became_peered":"2023-11-04T01:41:02.032952+0000","last_unstale":"2023-11-04T01:41:03.223783+0000","last_undegraded":"2023-11-04T01:41:03.223783+0000","last_fullsized":"2023-11-04T01:41:03.223783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:00.937325+0000","last_clean_scrub_stamp":"2023-11-04T01:41:00.937325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:10:57.638556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.018529+0000","last_change":"2023-11-04T01:41:00.990195+0000","last_active":"2023-11-04T01:41:02.018529+0000","last_peered":"2023-11-04T01:41:02.018529+0000","last_clean":"2023-11-04T01:41:02.018529+0000","last_became_active":"2023-11-04T01:41:00.989708+0000","last_became_peered":"2023-11-04T01:41:00.989708+0000","last_unstale":"2023-11-04T01:41:02.018529+0000","last_undegraded":"2023-11-04T01:41:02.018529+0000","last_fullsized":"2023-11-04T01:41:02.018529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:59.925600+0000","last_clean_scrub_stamp":"2023-11-04T01:40:59.925600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:56.926892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-04T01:41:02.020385+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:41:02.020385+0000","last_peered":"2023-11-04T01:41:02.020385+0000","last_clean":"2023-11-04T01:41:02.020385+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:41:02.020385+0000","last_undegraded":"2023-11-04T01:41:02.020385+0000","last_fullsized":"2023-11-04T01:41:02.020385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.92800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.151},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.874}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.995}]},{"osd":6,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.107},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.234}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.212}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0780000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.044}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0169999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.177},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.137}]},{"osd":7,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.298},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.331}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.874}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.107},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.145}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1850000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.234}]},{"osd":1,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1160000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.147}]},{"osd":5,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.98999999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.0429999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.753}]},{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.89500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.173},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.91800000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.224}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.101},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.0640000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.74099999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.873}]},{"osd":5,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.98099999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.107}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2989999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.248},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90900000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.0409999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.3799999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.4710000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.9379999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.6339999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.7809999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.532},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.716}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":736960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.335}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.97399999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.5369999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.5920000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.4410000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.254},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.903}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.796},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.653}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:06.382 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:41:06.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:41:06.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc3302e8640 1 Processor -- start 2023-11-04T01:41:06.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc3302e8640 1 -- start start 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc3302e8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3280cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc3302e8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32815d770 con 0x7fc32815d390 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc3302e8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280cecd0 con 0x7fc3280cf800 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc3302e8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280ce0c0 con 0x7fc3280d1eb0 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc32e084640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc32815d390 0x7fc3280d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51682/0 (socket says 172.21.15.40:51682) 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc32e084640 1 -- 172.21.15.40:0/2933275888 learned_addr learned my addr 172.21.15.40:0/2933275888 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc32d883640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3280cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.543+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525579164 0 0) 0x7fc32815d770 con 0x7fc32815d390 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc314003530 con 0x7fc32815d390 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991926139 0 0) 0x7fc314003530 con 0x7fc32815d390 2023-11-04T01:41:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 msgr2=0x7fc3280cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3280cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 >> v1:172.21.15.91:6789/0 conn(0x7fc3280cf800 legacy=0x7fc3280b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280ce3a0 con 0x7fc32815d390 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fc324001800 con 0x7fc32815d390 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 >> v1:172.21.15.40:6789/0 conn(0x7fc32815d390 legacy=0x7fc3280d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc314003f30 0x7fc3140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314004d10 0x7fc314005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280ce0c0 con 0x7fc314003f30 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400bb20 con 0x7fc314004d10 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400bce0 con 0x7fc3280d1eb0 2023-11-04T01:41:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc314003f30 0x7fc3140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32e084640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32e885640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314004d10 0x7fc314005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 -- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 msgr2=0x7fc3140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 -- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314004d10 msgr2=0x7fc314005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314004d10 0x7fc314005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 -- 172.21.15.40:0/2933275888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314003530 con 0x7fc314003f30 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32e885640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314004d10 0x7fc314005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32e084640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3280d1eb0 0x7fc3140039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d883640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc314003f30 0x7fc3140047d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc318009ae0 tx=0x7fc31801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30750711e47586c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180a6510 con 0x7fc314003f30 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3180a6670 con 0x7fc314003f30 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32d082640 1 -- 172.21.15.40:0/2933275888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180a6a20 con 0x7fc314003f30 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc3302e8640 1 -- 172.21.15.40:0/2933275888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc314003f30 msgr2=0x7fc3140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc3302e8640 1 --2- 172.21.15.40:0/2933275888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc314003f30 0x7fc3140047d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc318009ae0 tx=0x7fc31801ca20 comp rx=0 tx=0).stop 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc32e885640 1 -- 172.21.15.40:0/2933275888 reap_dead start 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc3302e8640 1 -- 172.21.15.40:0/2933275888 shutdown_connections 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc3302e8640 1 -- 172.21.15.40:0/2933275888 >> 172.21.15.40:0/2933275888 conn(0x7fc3280d2e60 msgr2=0x7fc3280d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc3302e8640 1 -- 172.21.15.40:0/2933275888 shutdown_connections 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.547+0000 7fc3302e8640 1 -- 172.21.15.40:0/2933275888 wait complete. 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 Processor -- start 2023-11-04T01:41:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- start start 2023-11-04T01:41:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314003f30 0x7fc328166140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc32814c580 0x7fc32814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 0x7fc328162e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328155f30 con 0x7fc328162a00 2023-11-04T01:41:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281633c0 con 0x7fc314003f30 2023-11-04T01:41:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328157890 con 0x7fc32814c580 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 0x7fc328162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 0x7fc328162e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38738/0 (socket says 172.21.15.40:38738) 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 -- 172.21.15.40:0/1196251224 learned_addr learned my addr 172.21.15.40:0/1196251224 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e084640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314003f30 0x7fc328166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32d883640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc32814c580 0x7fc32814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 -- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc32814c580 msgr2=0x7fc32814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc32814c580 0x7fc32814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 -- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314003f30 msgr2=0x7fc328166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314003f30 0x7fc328166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 -- 172.21.15.40:0/1196251224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280d01a0 con 0x7fc328162a00 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc32e885640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 0x7fc328162e80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc3280c68e0 tx=0x7fc32000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320003b80 con 0x7fc328162a00 2023-11-04T01:41:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320003ce0 con 0x7fc328162a00 2023-11-04T01:41:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc328157b30 con 0x7fc328162a00 2023-11-04T01:41:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200052b0 con 0x7fc328162a00 2023-11-04T01:41:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280c7860 con 0x7fc328162a00 2023-11-04T01:41:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc328158050 con 0x7fc328162a00 2023-11-04T01:41:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.551+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc320005410 con 0x7fc328162a00 2023-11-04T01:41:06.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.555+0000 7fc31effd640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc30c0664d0 0x7fc30c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.555+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3200838e0 con 0x7fc328162a00 2023-11-04T01:41:06.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.555+0000 7fc32e084640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc30c0664d0 0x7fc30c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.555+0000 7fc32e084640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc30c0664d0 0x7fc30c068990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc324001930 tx=0x7fc324009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.559+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc320050cc0 con 0x7fc328162a00 2023-11-04T01:41:06.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.767+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc3280744a0 con 0x7fc328162a00 2023-11-04T01:41:06.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc31effd640 1 -- 172.21.15.40:0/1196251224 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc320018070 con 0x7fc328162a00 2023-11-04T01:41:06.779 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-11-04T01:41:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:41:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2023-11-04T01:41:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2023-11-04T01:41:06.780 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:41:06.780 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-11-04T01:41:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc30c0664d0 msgr2=0x7fc30c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc30c0664d0 0x7fc30c068990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc324001930 tx=0x7fc324009040 comp rx=0 tx=0).stop 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 msgr2=0x7fc328162e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 0x7fc328162e80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc3280c68e0 tx=0x7fc32000dc00 comp rx=0 tx=0).stop 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 shutdown_connections 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc30c0664d0 0x7fc30c068990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328162a00 0x7fc328162e80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc32814c580 0x7fc32814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 --2- 172.21.15.40:0/1196251224 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc314003f30 0x7fc328166140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 >> 172.21.15.40:0/1196251224 conn(0x7fc3280d2e60 msgr2=0x7fc3281687d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 shutdown_connections 2023-11-04T01:41:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.775+0000 7fc3302e8640 1 -- 172.21.15.40:0/1196251224 wait complete. 2023-11-04T01:41:06.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.915+0000 7f198933b640 1 Processor -- start 2023-11-04T01:41:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.915+0000 7f198933b640 1 -- start start 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f198933b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f198415afd0 0x7f19840715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f198933b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f198406f8f0 0x7f19840b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f198933b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840c2670 con 0x7f19840b0b70 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f198933b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1984070140 con 0x7f198415afd0 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f198933b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198415fc90 con 0x7f198406f8f0 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f198415afd0 0x7f19840715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f198415afd0 0x7f19840715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38748/0 (socket says 172.21.15.40:38748) 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 -- 172.21.15.40:0/3768720541 learned_addr learned my addr 172.21.15.40:0/3768720541 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f19827fc640 1 --2- 172.21.15.40:0/3768720541 >> v2:172.21.15.91:3300/0 conn(0x7f198406f8f0 0x7f19840b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 -- 172.21.15.40:0/3768720541 >> v2:172.21.15.91:3300/0 conn(0x7f198406f8f0 msgr2=0x7f19840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 --2- 172.21.15.40:0/3768720541 >> v2:172.21.15.91:3300/0 conn(0x7f198406f8f0 0x7f19840b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 -- 172.21.15.40:0/3768720541 >> v1:172.21.15.91:6789/0 conn(0x7f19840b0b70 legacy=0x7f19840c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.919+0000 7f1982ffd640 1 -- 172.21.15.40:0/3768720541 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198406bc30 con 0x7f198415afd0 2023-11-04T01:41:06.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f1982ffd640 1 --2- 172.21.15.40:0/3768720541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f198415afd0 0x7f19840715d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f19840ce900 tx=0x7f197401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fc409d0ffcb53d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f1981ffb640 1 -- 172.21.15.40:0/3768720541 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740ab600 con 0x7f198415afd0 2023-11-04T01:41:06.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f1981ffb640 1 -- 172.21.15.40:0/3768720541 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19740a7050 con 0x7f198415afd0 2023-11-04T01:41:06.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f1981ffb640 1 -- 172.21.15.40:0/3768720541 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740ab980 con 0x7f198415afd0 2023-11-04T01:41:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 -- 172.21.15.40:0/3768720541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f198415afd0 msgr2=0x7f19840715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 --2- 172.21.15.40:0/3768720541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f198415afd0 0x7f19840715d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f19840ce900 tx=0x7f197401c500 comp rx=0 tx=0).stop 2023-11-04T01:41:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 -- 172.21.15.40:0/3768720541 shutdown_connections 2023-11-04T01:41:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 --2- 172.21.15.40:0/3768720541 >> v2:172.21.15.91:3300/0 conn(0x7f198406f8f0 0x7f19840b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 --2- 172.21.15.40:0/3768720541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f198415afd0 0x7f19840715d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 -- 172.21.15.40:0/3768720541 >> 172.21.15.40:0/3768720541 conn(0x7f19840cebb0 msgr2=0x7f19840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 -- 172.21.15.40:0/3768720541 shutdown_connections 2023-11-04T01:41:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 -- 172.21.15.40:0/3768720541 wait complete. 2023-11-04T01:41:06.929 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:41:06.923+0000 7efec756d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 Processor -- start 2023-11-04T01:41:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.923+0000 7f198933b640 1 -- start start 2023-11-04T01:41:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f198406f8f0 0x7f19841526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 0x7f19840ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198415afd0 0x7f19840c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841588e0 con 0x7f19840b0b70 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984159420 con 0x7f198415afd0 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1984158af0 con 0x7f198406f8f0 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 0x7f19840ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 0x7f19840ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38758/0 (socket says 172.21.15.40:38758) 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 -- 172.21.15.40:0/1337718341 learned_addr learned my addr 172.21.15.40:0/1337718341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f1982ffd640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f198406f8f0 0x7f19841526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19837fe640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198415afd0 0x7f19840c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 -- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f198406f8f0 msgr2=0x7f19841526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f198406f8f0 0x7f19841526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 -- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198415afd0 msgr2=0x7f19840c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198415afd0 0x7f19840c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 -- 172.21.15.40:0/1337718341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19740094d0 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19837fe640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198415afd0 0x7f19840c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f1982ffd640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f198406f8f0 0x7f19841526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f19827fc640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 0x7f19840ccfc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f197800d5f0 tx=0x7f197800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780125f0 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978012750 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1984158dd0 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978012ae0 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1984152c00 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984159590 con 0x7f19840b0b70 2023-11-04T01:41:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1978012c40 con 0x7f19840b0b70 2023-11-04T01:41:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f196b7fe640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19700664a0 0x7f1970068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1978084350 con 0x7f19840b0b70 2023-11-04T01:41:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.927+0000 7f1982ffd640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19700664a0 0x7f1970068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.931+0000 7f1982ffd640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19700664a0 0x7f1970068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19740ad000 tx=0x7f1974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:06.931+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19780517d0 con 0x7f19840b0b70 2023-11-04T01:41:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.127+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19840744a0 con 0x7f19840b0b70 2023-11-04T01:41:07.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.127+0000 7f196b7fe640 1 -- 172.21.15.40:0/1337718341 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f1978007380 con 0x7f19840b0b70 2023-11-04T01:41:07.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:07.132 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:01.346773+0000","modified":"2023-11-04T01:41:04.362535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3716931542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3716931542},{"type":"v1","addr":"172.21.15.40:6835","nonce":3716931542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:07.132 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 14 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19700664a0 msgr2=0x7f1970068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19700664a0 0x7f1970068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19740ad000 tx=0x7f1974008040 comp rx=0 tx=0).stop 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 msgr2=0x7f19840ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 0x7f19840ccfc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f197800d5f0 tx=0x7f197800dab0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 shutdown_connections 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f19700664a0 0x7f1970068960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f198415afd0 0x7f19840c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19840b0b70 0x7f19840ccfc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 --2- 172.21.15.40:0/1337718341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f198406f8f0 0x7f19841526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 >> 172.21.15.40:0/1337718341 conn(0x7f19840cebb0 msgr2=0x7f1984156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 shutdown_connections 2023-11-04T01:41:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.131+0000 7f198933b640 1 -- 172.21.15.40:0/1337718341 wait complete. 2023-11-04T01:41:07.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:41:01.346773+0000', 'modified': '2023-11-04T01:41:04.362535+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5262}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5262': {'gid': 5262, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/3716931542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 3716931542}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 3716931542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:07.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:41:07.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:07.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.683+0000 7f76888ac640 1 Processor -- start 2023-11-04T01:41:07.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f76888ac640 1 -- start start 2023-11-04T01:41:07.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f76888ac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f768415b290 0x7f768406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f76888ac640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768406c740 con 0x7f76840c2670 2023-11-04T01:41:07.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f76888ac640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768415b670 con 0x7f76840b0d40 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f76888ac640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768406bb30 con 0x7f768415b290 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f768415b290 0x7f768406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f768415b290 0x7f768406f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42842/0 (socket says 172.21.15.40:42842) 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f7681d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f76840c2670 0x7f76840b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33570/0 (socket says 172.21.15.40:33570) 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 -- 172.21.15.40:0/4102624607 learned_addr learned my addr 172.21.15.40:0/4102624607 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 -- 172.21.15.40:0/4102624607 >> v1:172.21.15.91:6789/0 conn(0x7f76840b0d40 legacy=0x7f768415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 -- 172.21.15.40:0/4102624607 >> v1:172.21.15.40:6789/0 conn(0x7f76840c2670 legacy=0x7f76840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768159a640 1 -- 172.21.15.40:0/4102624607 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091579144 0 0) 0x7f768406c740 con 0x7f76840c2670 2023-11-04T01:41:07.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 -- 172.21.15.40:0/4102624607 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768406be10 con 0x7f768415b290 2023-11-04T01:41:07.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768259c640 1 --2- 172.21.15.40:0/4102624607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f768415b290 0x7f768406f8f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f766c009870 tx=0x7f766c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9afb48d1634fc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.687+0000 7f768159a640 1 -- 172.21.15.40:0/4102624607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab600 con 0x7f768415b290 2023-11-04T01:41:07.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f768159a640 1 -- 172.21.15.40:0/4102624607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0a7050 con 0x7f768415b290 2023-11-04T01:41:07.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f768159a640 1 -- 172.21.15.40:0/4102624607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab980 con 0x7f768415b290 2023-11-04T01:41:07.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/4102624607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f768415b290 msgr2=0x7f768406f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 --2- 172.21.15.40:0/4102624607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f768415b290 0x7f768406f8f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f766c009870 tx=0x7f766c01c440 comp rx=0 tx=0).stop 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/4102624607 shutdown_connections 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 --2- 172.21.15.40:0/4102624607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f768415b290 0x7f768406f8f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/4102624607 >> 172.21.15.40:0/4102624607 conn(0x7f76840cebb0 msgr2=0x7f76840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/4102624607 shutdown_connections 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/4102624607 wait complete. 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 Processor -- start 2023-11-04T01:41:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- start start 2023-11-04T01:41:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76840b0d40 0x7f768414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 0x7f768415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f768415b290 0x7f7684159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768414f830 con 0x7f76840c2670 2023-11-04T01:41:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768415c310 con 0x7f768415b290 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768415c5f0 con 0x7f76840b0d40 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 0x7f768415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 0x7f768415d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42856/0 (socket says 172.21.15.40:42856) 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 -- 172.21.15.40:0/3759579452 learned_addr learned my addr 172.21.15.40:0/3759579452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7682d9d640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f768415b290 0x7f7684159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f768259c640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76840b0d40 0x7f768414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 -- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76840b0d40 msgr2=0x7f768414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76840b0d40 0x7f768414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 -- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f768415b290 msgr2=0x7f7684159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f768415b290 0x7f7684159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 -- 172.21.15.40:0/3759579452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0094d0 con 0x7f76840c2670 2023-11-04T01:41:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f7681d9b640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 0x7f768415d3b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f767c001570 tx=0x7f767c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f767affd640 1 -- 172.21.15.40:0/3759579452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00a640 con 0x7f76840c2670 2023-11-04T01:41:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f767affd640 1 -- 172.21.15.40:0/3759579452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c00a7c0 con 0x7f76840c2670 2023-11-04T01:41:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768415c8d0 con 0x7f76840c2670 2023-11-04T01:41:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f767affd640 1 -- 172.21.15.40:0/3759579452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00ab70 con 0x7f76840c2670 2023-11-04T01:41:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.691+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768415ce90 con 0x7f76840c2670 2023-11-04T01:41:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f767affd640 1 -- 172.21.15.40:0/3759579452 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f767c00acd0 con 0x7f76840c2670 2023-11-04T01:41:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f767affd640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76640664d0 0x7f7664068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f767affd640 1 -- 172.21.15.40:0/3759579452 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f767c0834d0 con 0x7f76840c2670 2023-11-04T01:41:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76640664d0 0x7f7664068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 Processor -- start 2023-11-04T01:41:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 -- start start 2023-11-04T01:41:07.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76640664d0 0x7f7664068990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ad000 tx=0x7f766c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715ed5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715ed6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715d9c460 con 0x555715f221f0 2023-11-04T01:41:07.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715d2d690 con 0x555715ed5f50 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x555715d2abc0 con 0x555715f22b10 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42870/0 (socket says 172.21.15.40:42870) 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 -- 172.21.15.40:0/723996166 learned_addr learned my addr 172.21.15.40:0/723996166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f7682d9d640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715ed6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f7681d9b640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715ed5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 -- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 msgr2=0x555715ed5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715ed5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 -- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 msgr2=0x555715ed6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715ed6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f768259c640 1 -- 172.21.15.40:0/723996166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555715a1e890 con 0x555715f221f0 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f7682d9d640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715ed6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.695+0000 7f7681d9b640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715ed5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f225d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f766c019050 tx=0x7f766c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f275be4c573c20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f7663fff640 1 -- 172.21.15.40:0/723996166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b5670 con 0x555715f221f0 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f7663fff640 1 -- 172.21.15.40:0/723996166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0b57d0 con 0x555715f221f0 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f7663fff640 1 -- 172.21.15.40:0/723996166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b5b40 con 0x555715f221f0 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/723996166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 msgr2=0x555715f225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f225d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f766c019050 tx=0x7f766c004740 comp rx=0 tx=0).stop 2023-11-04T01:41:07.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/723996166 shutdown_connections 2023-11-04T01:41:07.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715ed6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715ed5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- 172.21.15.40:0/723996166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f225d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/723996166 >> 172.21.15.40:0/723996166 conn(0x555715efed40 msgr2=0x555715f01130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/723996166 shutdown_connections 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/723996166 wait complete. 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- start start 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 Processor -- start 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 0x555715f03d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715f221f0 0x555715f04250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f04790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715d264b0 con 0x555715ed5f50 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715cdeaa0 con 0x555715f221f0 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x555715ce4940 con 0x555715f22b10 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 10 client.0 _ll_register_callbacks cb 0x555715ebf460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:07.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 0x555715f03d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 0x555715f03d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42880/0 (socket says 172.21.15.40:42880) 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 -- 172.21.15.40:0/3650559532 learned_addr learned my addr 172.21.15.40:0/3650559532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f7682d9d640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f04790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f7681d9b640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715f221f0 0x555715f04250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 -- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 msgr2=0x555715f04790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f04790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 -- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715f221f0 msgr2=0x555715f04250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715f221f0 0x555715f04250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 -- 172.21.15.40:0/3650559532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768406be10 con 0x555715ed5f50 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768259c640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 0x555715f03d10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f766c019050 tx=0x7f766c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e98205db089d635 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f76617fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:41:07.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f76617fa640 1 -- 172.21.15.40:0/3650559532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b5ce0 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f76617fa640 1 -- 172.21.15.40:0/3650559532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f766c0b5e40 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555715ce3e10 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f76617fa640 1 -- 172.21.15.40:0/3650559532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f766c0d4410 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 10 client.5448 fetch_fsmap learned FSMap version 14 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x555715ce71a0 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f76617fa640 1 -- 172.21.15.40:0/3650559532 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555715ce3e10 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f76617fa640 1 -- 172.21.15.40:0/3650559532 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f766c0d4570 con 0x555715ed5f50 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 10 client.5448 fetch_fsmap finished waiting for FSMap version 14 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 10 client.5448 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 20 client.5448 populate_metadata read hostname 'smithi040' 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f324a0 0x555715f34890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 4 client.5448 mds_command: new command op to 5262 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.699+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 --> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555715d24e00 con 0x555715f324a0 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f7681d9b640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f324a0 0x555715f34890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f7681d9b640 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f324a0 0x555715f34890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c1289f57a40fa server_cookie=20201f613958594a in_seq=0 out_seq=0 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f76617fa640 10 client.5448 ms_handle_connect on v2:172.21.15.40:6834/3716931542 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f76617fa640 1 -- 172.21.15.40:0/3650559532 <== mds.0 v2:172.21.15.40:6834/3716931542 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555715d24e00 con 0x555715f324a0 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f76617fa640 10 client.5448 handle_command_reply: tid=0 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 client.5448 shutdown 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 msgr2=0x555715f03d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 0x555715f03d10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f766c019050 tx=0x7f766c01ac80 comp rx=0 tx=0).stop 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 shutdown_connections 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f324a0 0x555715f34890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f04790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715f221f0 0x555715f04250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 --2- 172.21.15.40:0/3650559532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715ed5f50 0x555715f03d10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 >> 172.21.15.40:0/3650559532 conn(0x555715efed40 msgr2=0x555715ed0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f76617fa640 0 client.5448 ms_handle_reset on v2:172.21.15.40:6834/3716931542 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 shutdown_connections 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 1 -- 172.21.15.40:0/3650559532 wait complete. 2023-11-04T01:41:07.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.703+0000 7f768b9d9000 20 client.5448 trim_cache size 0 max 16384 2023-11-04T01:41:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 Processor -- start 2023-11-04T01:41:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- start start 2023-11-04T01:41:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f7f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557159df940 con 0x555715f221f0 2023-11-04T01:41:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715ce4460 con 0x555715ed5f50 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x555715ed98b0 con 0x555715f22b10 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f7ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42890/0 (socket says 172.21.15.40:42890) 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 -- 172.21.15.40:0/1591784492 learned_addr learned my addr 172.21.15.40:0/1591784492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7682d9d640 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f7f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 -- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 msgr2=0x555715f7f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f7f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 -- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 msgr2=0x555715f7e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 -- 172.21.15.40:0/1591784492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555715ccd4a0 con 0x555715f221f0 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7681d9b640 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f7ec50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f767c00a430 tx=0x7f767c081830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a059da86581fc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7678ff9640 1 -- 172.21.15.40:0/1591784492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c05c870 con 0x555715f221f0 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7678ff9640 1 -- 172.21.15.40:0/1591784492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c081a70 con 0x555715f221f0 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f7678ff9640 1 -- 172.21.15.40:0/1591784492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c050c80 con 0x555715f221f0 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- 172.21.15.40:0/1591784492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 msgr2=0x555715f7ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f7ec50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f767c00a430 tx=0x7f767c081830 comp rx=0 tx=0).stop 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- 172.21.15.40:0/1591784492 shutdown_connections 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f22b10 0x555715f7f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f221f0 0x555715f7ec50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 --2- 172.21.15.40:0/1591784492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- 172.21.15.40:0/1591784492 >> 172.21.15.40:0/1591784492 conn(0x555715efed40 msgr2=0x555715ed0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- 172.21.15.40:0/1591784492 shutdown_connections 2023-11-04T01:41:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.719+0000 7f768b9d9000 1 -- 172.21.15.40:0/1591784492 wait complete. 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- start start 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 Processor -- start 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f221f0 0x555715f7e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 0x555715f7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715eda080 con 0x555715f22b10 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x555715d66830 con 0x555715ed5f50 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x555715d29010 con 0x555715f221f0 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 10 client.0 _ll_register_callbacks cb 0x7f766c0ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 0x555715f7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 0x555715f7ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42900/0 (socket says 172.21.15.40:42900) 2023-11-04T01:41:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 -- 172.21.15.40:0/2977838423 learned_addr learned my addr 172.21.15.40:0/2977838423 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7681d9b640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f221f0 0x555715f7e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768259c640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 -- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f221f0 msgr2=0x555715f7e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f221f0 0x555715f7e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 -- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 msgr2=0x555715f7dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 -- 172.21.15.40:0/2977838423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768415ce90 con 0x555715f22b10 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7681d9b640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f221f0 0x555715f7e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f7682d9d640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 0x555715f7ee60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7674005500 tx=0x7f76740055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59f42efdf4da566 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 1 -- 172.21.15.40:0/2977838423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674003a70 con 0x555715f22b10 2023-11-04T01:41:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 1 -- 172.21.15.40:0/2977838423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7674003bd0 con 0x555715f22b10 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555715cf0d10 con 0x555715f22b10 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 1 -- 172.21.15.40:0/2977838423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7674003df0 con 0x555715f22b10 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 10 client.5454 fetch_fsmap learned FSMap version 14 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x555715a1ecc0 con 0x555715f22b10 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 1 -- 172.21.15.40:0/2977838423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555715cf0d10 con 0x555715f22b10 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 1 -- 172.21.15.40:0/2977838423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7674004050 con 0x555715f22b10 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 10 client.5454 fetch_fsmap finished waiting for FSMap version 14 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 10 client.5454 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 20 client.5454 populate_metadata read hostname 'smithi040' 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f89c20 0x555715f8c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 4 client.5454 mds_command: new command op to 5262 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 --> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555715d1f490 con 0x555715f89c20 2023-11-04T01:41:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768259c640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f89c20 0x555715f8c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768259c640 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f89c20 0x555715f8c010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c730c70f8a978c server_cookie=97a4a2e594f4edee in_seq=0 out_seq=0 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 10 client.5454 ms_handle_connect on v2:172.21.15.40:6834/3716931542 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 1 -- 172.21.15.40:0/2977838423 <== mds.0 v2:172.21.15.40:6834/3716931542 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555715d1f490 con 0x555715f89c20 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 10 client.5454 handle_command_reply: tid=0 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 client.5454 shutdown 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 msgr2=0x555715f7ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 0x555715f7ee60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7674005500 tx=0x7f76740055f0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 shutdown_connections 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:6834/3716931542,v1:172.21.15.40:6835/3716931542] conn(0x555715f89c20 0x555715f8c010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555715f22b10 0x555715f7ee60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x555715f221f0 0x555715f7e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76617fa640 0 client.5454 ms_handle_reset on v2:172.21.15.40:6834/3716931542 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 --2- 172.21.15.40:0/2977838423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x555715ed5f50 0x555715f7dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 >> 172.21.15.40:0/2977838423 conn(0x555715efed40 msgr2=0x555715f2ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 shutdown_connections 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 1 -- 172.21.15.40:0/2977838423 wait complete. 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f768b9d9000 20 client.5454 trim_cache size 0 max 16384 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5262, 2023-11-04T01:41:07.735 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 5.6983739350000002, 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 14, 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 33, 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 33, 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 12.677374183 2023-11-04T01:41:07.736 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76640664d0 msgr2=0x7f7664068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76640664d0 0x7f7664068990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ad000 tx=0x7f766c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 msgr2=0x7f768415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 0x7f768415d3b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f767c001570 tx=0x7f767c00cd20 comp rx=0 tx=0).stop 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 shutdown_connections 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76640664d0 0x7f7664068990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f768415b290 0x7f7684159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76840c2670 0x7f768415d3b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 --2- 172.21.15.40:0/3759579452 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76840b0d40 0x7f768414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.723+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 >> 172.21.15.40:0/3759579452 conn(0x7f76840cebb0 msgr2=0x7f76840c2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.727+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 shutdown_connections 2023-11-04T01:41:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.727+0000 7f76888ac640 1 -- 172.21.15.40:0/3759579452 wait complete. 2023-11-04T01:41:07.747 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:41:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 Processor -- start 2023-11-04T01:41:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 -- start start 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31f815b470 0x7f31f815f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f80b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f80cbe40 con 0x7f31f815b090 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f815fca0 con 0x7f31f815b470 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31fdf30640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80cc120 con 0x7f31f806a870 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31f815b470 0x7f31f815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31f815b470 0x7f31f815f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42902/0 (socket says 172.21.15.40:42902) 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 -- 172.21.15.40:0/3184414777 learned_addr learned my addr 172.21.15.40:0/3184414777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31f815b090 0x7f31f806a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33572/0 (socket says 172.21.15.40:33572) 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f7fff640 1 --2- 172.21.15.40:0/3184414777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f80b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 -- 172.21.15.40:0/3184414777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 msgr2=0x7f31f80b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 --2- 172.21.15.40:0/3184414777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f80b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 -- 172.21.15.40:0/3184414777 >> v1:172.21.15.40:6789/0 conn(0x7f31f815b090 legacy=0x7f31f806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f67fc640 1 -- 172.21.15.40:0/3184414777 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553696142 0 0) 0x7f31f80cbe40 con 0x7f31f815b090 2023-11-04T01:41:07.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.855+0000 7f31f6ffd640 1 -- 172.21.15.40:0/3184414777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80cc400 con 0x7f31f815b470 2023-11-04T01:41:07.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31f6ffd640 1 --2- 172.21.15.40:0/3184414777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b470 0x7f31f815f760 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009870 tx=0x7f31ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e07f018de29eb56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31f67fc640 1 -- 172.21.15.40:0/3184414777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0aa670 con 0x7f31f815b470 2023-11-04T01:41:07.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31f67fc640 1 -- 172.21.15.40:0/3184414777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0aa7d0 con 0x7f31f815b470 2023-11-04T01:41:07.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31f67fc640 1 -- 172.21.15.40:0/3184414777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0aab60 con 0x7f31f815b470 2023-11-04T01:41:07.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 -- 172.21.15.40:0/3184414777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b470 msgr2=0x7f31f815f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 --2- 172.21.15.40:0/3184414777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b470 0x7f31f815f760 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009870 tx=0x7f31ec01c510 comp rx=0 tx=0).stop 2023-11-04T01:41:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 -- 172.21.15.40:0/3184414777 shutdown_connections 2023-11-04T01:41:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 --2- 172.21.15.40:0/3184414777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f80b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 --2- 172.21.15.40:0/3184414777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b470 0x7f31f815f760 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 -- 172.21.15.40:0/3184414777 >> 172.21.15.40:0/3184414777 conn(0x7f31f80716a0 msgr2=0x7f31f8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 -- 172.21.15.40:0/3184414777 shutdown_connections 2023-11-04T01:41:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.859+0000 7f31fdf30640 1 -- 172.21.15.40:0/3184414777 wait complete. 2023-11-04T01:41:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 Processor -- start 2023-11-04T01:41:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- start start 2023-11-04T01:41:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f8154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 0x7f31f80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31f815b470 0x7f31f80cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f81f5c90 con 0x7f31f815b090 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f81f5f70 con 0x7f31f815b470 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f81f6250 con 0x7f31f806a870 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 0x7f31f80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 0x7f31f80ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42906/0 (socket says 172.21.15.40:42906) 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 -- 172.21.15.40:0/667639611 learned_addr learned my addr 172.21.15.40:0/667639611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f77fe640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f8154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f7fff640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31f815b470 0x7f31f80cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 -- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 msgr2=0x7f31f8154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f8154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 -- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31f815b470 msgr2=0x7f31f80cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31f815b470 0x7f31f80cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 -- 172.21.15.40:0/667639611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0094d0 con 0x7f31f815b090 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f77fe640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f8154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31f6ffd640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 0x7f31f80ca900 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0ac040 tx=0x7f31ec0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0b4810 con 0x7f31f815b090 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0b4990 con 0x7f31f815b090 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f81f6530 con 0x7f31f815b090 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0b4d40 con 0x7f31f815b090 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f80c4310 con 0x7f31f815b090 2023-11-04T01:41:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f81f6390 con 0x7f31f815b090 2023-11-04T01:41:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.863+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31ec0c73f0 con 0x7f31f815b090 2023-11-04T01:41:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.867+0000 7f31dffff640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664a0 0x7f31e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.867+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31ec11eec0 con 0x7f31f815b090 2023-11-04T01:41:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.867+0000 7f31f77fe640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664a0 0x7f31e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.867+0000 7f31f77fe640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664a0 0x7f31e4068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31e8000f70 tx=0x7f31e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:07.871+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31f81f6390 con 0x7f31f815b090 2023-11-04T01:41:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.059+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31f81f6390 con 0x7f31f815b090 2023-11-04T01:41:08.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.059+0000 7f31dffff640 1 -- 172.21.15.40:0/667639611 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31f81f6390 con 0x7f31f815b090 2023-11-04T01:41:08.064 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:41:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664a0 msgr2=0x7f31e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664a0 0x7f31e4068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31e8000f70 tx=0x7f31e8009040 comp rx=0 tx=0).stop 2023-11-04T01:41:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 msgr2=0x7f31f80ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 0x7f31f80ca900 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0ac040 tx=0x7f31ec0192b0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 shutdown_connections 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664a0 0x7f31e4068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31f815b470 0x7f31f80cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f815b090 0x7f31f80ca900 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 --2- 172.21.15.40:0/667639611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31f806a870 0x7f31f8154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 >> 172.21.15.40:0/667639611 conn(0x7f31f80716a0 msgr2=0x7f31f8071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 shutdown_connections 2023-11-04T01:41:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:08.063+0000 7f31fdf30640 1 -- 172.21.15.40:0/667639611 wait complete. 2023-11-04T01:41:08.081 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:41:08.081 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:41:08.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:41:08.082 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:41:08.082 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:08.082 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:41:08.082 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:41:08.082 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:41:08.082 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:08.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.082 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:41:08.088 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:41:08.088 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:41:08.088 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:41:08.089 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:41:08.090 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:41:08.091 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:08.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.092 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:41:08.140 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:41:08.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.142 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:41:08.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.192 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:41:08.193 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:41:08.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:41:08.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:41:08.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:41:08.193 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:41:08.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.264 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:41:08.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:41:08.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:41:08.311 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:08.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:41:08.366 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:41:08.366 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:08.366 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:08.415 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:08.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:08.415 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:08.462 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:41:08.513 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:08.515 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:08.516 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:08.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.517 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:41:08.563 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:41:08.563 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:41:08.607 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:41:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:41:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:41:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:41:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:41:08.615 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:08.616 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:08.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:08.618 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:41:08.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:41:08.687+0000 7f6fc7bd9580 -1 init, newargv = 0x55a025535b90 newargc=15 2023-11-04T01:41:08.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[48764]: starting ceph client 2023-11-04T01:41:08.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[48764]: starting fuse 2023-11-04T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:09.775 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:41:09.775 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:41:09.775 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:09.776 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:09.777 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:09.778 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:09.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:09.779 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:41:09.827 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:41:09.827 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:41:09.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:41:09.827 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:41:09.827 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:41:09.827 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:41:09.828 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:41:09.829 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:41:09.954 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.48764.asok 2023-11-04T01:41:09.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:09.967 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48764.asok 2023-11-04T01:41:09.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:09.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.48764.asok status 2023-11-04T01:41:10.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:10.163 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:41:10.163 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:41:10.163 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:41:10.163 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:41:10.164 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:41:10.164 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:41:10.164 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:41:10.164 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "48764", 2023-11-04T01:41:10.164 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5469, 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:41:10.166 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:41:10.166 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:41:10.166 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 5469 2023-11-04T01:41:10.166 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:10.166 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:41:10.166 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2292169869 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2292169869 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.5469 192.168.0.1:0/2292169869", 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2292169869", 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 14, 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 33, 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:41:10.170 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:41:10.170 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:41:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:10.183 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:10.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:41:10.184 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:10.229 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:41:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:10.236 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:10.236 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:10.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:10.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-04T01:41:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 Processor -- start 2023-11-04T01:41:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 -- start start 2023-11-04T01:41:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f65580b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f655806ba10 0x7f6558160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65580b0eb0 con 0x7f65580b0a50 2023-11-04T01:41:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65580c90e0 con 0x7f655806ba10 2023-11-04T01:41:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655d16b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655806c010 con 0x7f655815d290 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6556d9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f65580b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655759e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f655806ba10 0x7f6558160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655659c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f65580b0a50 0x7f655806b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:60872/0 (socket says 172.21.15.40:60872) 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655659c640 1 -- 172.21.15.40:0/1459906714 learned_addr learned my addr 172.21.15.40:0/1459906714 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6555d9b640 1 -- 172.21.15.40:0/1459906714 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850008456 0 0) 0x7f65580b0eb0 con 0x7f65580b0a50 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6555d9b640 1 -- 172.21.15.40:0/1459906714 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6544003530 con 0x7f65580b0a50 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6556d9d640 1 -- 172.21.15.40:0/1459906714 >> v2:172.21.15.91:3300/0 conn(0x7f655806ba10 msgr2=0x7f6558160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6556d9d640 1 --2- 172.21.15.40:0/1459906714 >> v2:172.21.15.91:3300/0 conn(0x7f655806ba10 0x7f6558160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6556d9d640 1 -- 172.21.15.40:0/1459906714 >> v1:172.21.15.91:6789/0 conn(0x7f65580b0a50 legacy=0x7f655806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f6556d9d640 1 -- 172.21.15.40:0/1459906714 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580ac960 con 0x7f655815d290 2023-11-04T01:41:10.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.503+0000 7f655759e640 1 --2- 172.21.15.40:0/1459906714 >> v2:172.21.15.91:3300/0 conn(0x7f655806ba10 0x7f6558160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:10.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f6556d9d640 1 --2- 172.21.15.40:0/1459906714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f65580b0510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65480097c0 tx=0x7f654801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59e0e96e12a4422 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f6555d9b640 1 -- 172.21.15.40:0/1459906714 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480ad660 con 0x7f655815d290 2023-11-04T01:41:10.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f6555d9b640 1 -- 172.21.15.40:0/1459906714 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65480ad7c0 con 0x7f655815d290 2023-11-04T01:41:10.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f6555d9b640 1 -- 172.21.15.40:0/1459906714 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65480adb30 con 0x7f655815d290 2023-11-04T01:41:10.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 -- 172.21.15.40:0/1459906714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 msgr2=0x7f65580b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 --2- 172.21.15.40:0/1459906714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f65580b0510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65480097c0 tx=0x7f654801c450 comp rx=0 tx=0).stop 2023-11-04T01:41:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 -- 172.21.15.40:0/1459906714 shutdown_connections 2023-11-04T01:41:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 --2- 172.21.15.40:0/1459906714 >> v2:172.21.15.91:3300/0 conn(0x7f655806ba10 0x7f6558160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 --2- 172.21.15.40:0/1459906714 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f65580b0510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 -- 172.21.15.40:0/1459906714 >> 172.21.15.40:0/1459906714 conn(0x7f65580cb510 msgr2=0x7f65580cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 -- 172.21.15.40:0/1459906714 shutdown_connections 2023-11-04T01:41:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.507+0000 7f655d16b640 1 -- 172.21.15.40:0/1459906714 wait complete. 2023-11-04T01:41:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 Processor -- start 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- start start 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f655806ba10 0x7f655814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 0x7f6558153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f6558153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580ae9d0 con 0x7f65580b0a50 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580ae3a0 con 0x7f655806ba10 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65580b3a10 con 0x7f655815d290 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 0x7f6558153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 0x7f6558153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42912/0 (socket says 172.21.15.40:42912) 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 -- 172.21.15.40:0/919526125 learned_addr learned my addr 172.21.15.40:0/919526125 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:10.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655759e640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f6558153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f6556d9d640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f655806ba10 0x7f655814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 -- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 msgr2=0x7f6558153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f6558153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 -- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f655806ba10 msgr2=0x7f655814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f655806ba10 0x7f655814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 -- 172.21.15.40:0/919526125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550009a70 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f6556d9d640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f655806ba10 0x7f655814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655659c640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 0x7f6558153970 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f654000c450 tx=0x7f654000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540005cf0 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540005e50 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6548009420 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400072f0 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65580ae660 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65580aeb80 con 0x7f65580b0a50 2023-11-04T01:41:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6540007450 con 0x7f65580b0a50 2023-11-04T01:41:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.511+0000 7f654f7fe640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f65380664a0 0x7f6538068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.515+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6540083520 con 0x7f65580b0a50 2023-11-04T01:41:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.515+0000 7f6556d9d640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f65380664a0 0x7f6538068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.515+0000 7f6556d9d640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f65380664a0 0x7f6538068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65480af000 tx=0x7f65480a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.519+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65580aeb80 con 0x7f65580b0a50 2023-11-04T01:41:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:10.675+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f65580744a0 con 0x7f65580b0a50 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.059+0000 7f654f7fe640 1 -- 172.21.15.40:0/919526125 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65400170a0 con 0x7f65580b0a50 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'snap-test-pool' created 2023-11-04T01:41:11.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f65380664a0 msgr2=0x7f6538068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f65380664a0 0x7f6538068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65480af000 tx=0x7f65480a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 msgr2=0x7f6558153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 0x7f6558153970 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f654000c450 tx=0x7f654000c850 comp rx=0 tx=0).stop 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 shutdown_connections 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f65380664a0 0x7f6538068960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f655815d290 0x7f6558153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65580b0a50 0x7f6558153970 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 --2- 172.21.15.40:0/919526125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f655806ba10 0x7f655814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 >> 172.21.15.40:0/919526125 conn(0x7f65580cb510 msgr2=0x7f6558070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 shutdown_connections 2023-11-04T01:41:11.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.063+0000 7f655d16b640 1 -- 172.21.15.40:0/919526125 wait complete. 2023-11-04T01:41:11.097 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-04T01:41:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 Processor -- start 2023-11-04T01:41:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- start start 2023-11-04T01:41:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b694a8e50 0x562b6953a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b695395e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 0x562b6953be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b6942f8a0 con 0x562b69537580 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b6942b190 con 0x562b694a9230 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b693e2fc0 con 0x562b694a8e50 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 0x562b6953be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 0x562b6953be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42936/0 (socket says 172.21.15.40:42936) 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 -- 172.21.15.40:0/3165186285 learned_addr learned my addr 172.21.15.40:0/3165186285 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb4335fe640 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b694a8e50 0x562b6953a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb432dfd640 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b695395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 -- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b694a8e50 msgr2=0x562b6953a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b694a8e50 0x562b6953a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 -- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 msgr2=0x562b695395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b695395e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 -- 172.21.15.40:0/3165186285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428005d30 con 0x562b69537580 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb433dff640 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 0x562b6953be10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006fb0 tx=0x7fb42c0018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5e370947662713 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb431dfb640 1 -- 172.21.15.40:0/3165186285 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c004070 con 0x562b69537580 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb431dfb640 1 -- 172.21.15.40:0/3165186285 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00f710 con 0x562b69537580 2023-11-04T01:41:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb431dfb640 1 -- 172.21.15.40:0/3165186285 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00fac0 con 0x562b69537580 2023-11-04T01:41:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- 172.21.15.40:0/3165186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 msgr2=0x562b6953be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 0x562b6953be10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006fb0 tx=0x7fb42c0018a0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- 172.21.15.40:0/3165186285 shutdown_connections 2023-11-04T01:41:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b69537580 0x562b6953be10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b695395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 --2- 172.21.15.40:0/3165186285 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b694a8e50 0x562b6953a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- 172.21.15.40:0/3165186285 >> 172.21.15.40:0/3165186285 conn(0x562b694a77c0 msgr2=0x562b69537990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- 172.21.15.40:0/3165186285 shutdown_connections 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- 172.21.15.40:0/3165186285 wait complete. 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 Processor -- start 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.131+0000 7fb435adf080 1 -- start start 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 0x562b694c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b6953cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b69537580 0x562b6953ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b693e2cc0 con 0x562b694a8e50 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b693b92c0 con 0x562b694a9230 2023-11-04T01:41:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b6953d720 con 0x562b69537580 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 0x562b694c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 0x562b694c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42942/0 (socket says 172.21.15.40:42942) 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 -- 172.21.15.40:0/3521621266 learned_addr learned my addr 172.21.15.40:0/3521621266 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb433dff640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b69537580 0x562b6953ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb432dfd640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b6953cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 -- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b69537580 msgr2=0x562b6953ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b69537580 0x562b6953ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 -- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 msgr2=0x562b6953cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b6953cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 -- 172.21.15.40:0/3521621266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b693eb410 con 0x562b694a8e50 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb433dff640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b69537580 0x562b6953ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb4335fe640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 0x562b694c5d50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb42400dd70 tx=0x7fb42400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424017670 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4240177d0 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b693c45d0 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424017b60 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b693c4030 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb424014070 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb430df9640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb420064e50 0x7fb420067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4240830d0 con 0x562b694a8e50 2023-11-04T01:41:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.135+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- pool_op(create snap pool 6 tid 1 name snap3 v0) v4 -- 0x562b69435110 con 0x562b694a8e50 2023-11-04T01:41:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.139+0000 7fb432dfd640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb420064e50 0x7fb420067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:11.139+0000 7fb432dfd640 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb420064e50 0x7fb420067310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4280b1000 tx=0x7fb4280a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.083+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v35) v1 ==== 43+0+0 (secure 0 0 0) 0x7fb4240504a0 con 0x562b694a8e50 2023-11-04T01:41:12.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.083+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=35}) v3 -- 0x7fb42006d690 con 0x562b694a8e50 2023-11-04T01:41:12.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.083+0000 7fb430df9640 1 -- 172.21.15.40:0/3521621266 <== mon.0 v2:172.21.15.40:3300/0 7 ==== osd_map(35..35 src has 1..35) v4 ==== 710+0+0 (secure 0 0 0) 0x7fb424009e40 con 0x562b694a8e50 2023-11-04T01:41:12.087 INFO:teuthology.orchestra.run.smithi040.stdout:created pool snap-test-pool snap snap3 2023-11-04T01:41:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb420064e50 msgr2=0x7fb420067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb420064e50 0x7fb420067310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4280b1000 tx=0x7fb4280a9070 comp rx=0 tx=0).stop 2023-11-04T01:41:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 msgr2=0x562b694c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 0x562b694c5d50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb42400dd70 tx=0x7fb42400b6d0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 shutdown_connections 2023-11-04T01:41:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb420064e50 0x7fb420067310 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x562b69537580 0x562b6953ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x562b694a9230 0x562b6953cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 --2- 172.21.15.40:0/3521621266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x562b694a8e50 0x562b694c5d50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 >> 172.21.15.40:0/3521621266 conn(0x562b694a77c0 msgr2=0x562b69538c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 shutdown_connections 2023-11-04T01:41:12.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.091+0000 7fb435adf080 1 -- 172.21.15.40:0/3521621266 wait complete. 2023-11-04T01:41:12.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-04T01:41:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.275+0000 7f4b1e533640 1 Processor -- start 2023-11-04T01:41:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.275+0000 7f4b1e533640 1 -- start start 2023-11-04T01:41:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1e533640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4b180adf30 0x7f4b180cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1e533640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180cd020 con 0x7f4b180c9a00 2023-11-04T01:41:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1e533640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180cd300 con 0x7f4b180adb50 2023-11-04T01:41:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1e533640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180ae3a0 con 0x7f4b180adf30 2023-11-04T01:41:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4b180c9a00 0x7f4b1806f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33592/0 (socket says 172.21.15.40:33592) 2023-11-04T01:41:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 -- 172.21.15.40:0/502204406 learned_addr learned my addr 172.21.15.40:0/502204406 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1cad0640 1 --2- 172.21.15.40:0/502204406 >> v2:172.21.15.91:3300/0 conn(0x7f4b180adf30 0x7f4b180cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540187503 0 0) 0x7f4b180cd020 con 0x7f4b180c9a00 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b00003530 con 0x7f4b180c9a00 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455643818 0 0) 0x7f4b00003530 con 0x7f4b180c9a00 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 >> v2:172.21.15.91:3300/0 conn(0x7f4b180adf30 msgr2=0x7f4b180cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 --2- 172.21.15.40:0/502204406 >> v2:172.21.15.91:3300/0 conn(0x7f4b180adf30 0x7f4b180cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 >> v1:172.21.15.91:6789/0 conn(0x7f4b180adb50 legacy=0x7f4b180c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180cd5e0 con 0x7f4b180c9a00 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f4b0c001680 con 0x7f4b180c9a00 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 >> v1:172.21.15.40:6789/0 conn(0x7f4b180c9a00 legacy=0x7f4b1806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b00003980 0x7f4b00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b000047d0 0x7f4b00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b00005190 0x7f4b0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0000c000 con 0x7f4b000047d0 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0000c170 con 0x7f4b00003980 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0000c330 con 0x7f4b00005190 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b000047d0 0x7f4b00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1cad0640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b00005190 0x7f4b0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b17fff640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b00003980 0x7f4b00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 -- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b00005190 msgr2=0x7f4b0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b00005190 0x7f4b0000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 -- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b00003980 msgr2=0x7f4b00003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b00003980 0x7f4b00003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b177fe640 1 -- 172.21.15.40:0/502204406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b00003530 con 0x7f4b000047d0 2023-11-04T01:41:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.279+0000 7f4b1cad0640 1 -- 172.21.15.40:0/502204406 reap_dead start 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b177fe640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b000047d0 0x7f4b00004c50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c210 tx=0x7f4b0c01f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264a897135e1383d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c005ae0 con 0x7f4b000047d0 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0ab070 con 0x7f4b000047d0 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b16ffd640 1 -- 172.21.15.40:0/502204406 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c005ea0 con 0x7f4b000047d0 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- 172.21.15.40:0/502204406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b000047d0 msgr2=0x7f4b00004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b000047d0 0x7f4b00004c50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c210 tx=0x7f4b0c01f2f0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- 172.21.15.40:0/502204406 shutdown_connections 2023-11-04T01:41:12.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 --2- 172.21.15.40:0/502204406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b000047d0 0x7f4b00004c50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- 172.21.15.40:0/502204406 >> 172.21.15.40:0/502204406 conn(0x7f4b180cb510 msgr2=0x7f4b180cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- 172.21.15.40:0/502204406 shutdown_connections 2023-11-04T01:41:12.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- 172.21.15.40:0/502204406 wait complete. 2023-11-04T01:41:12.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 Processor -- start 2023-11-04T01:41:12.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- start start 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b000047d0 0x7f4b180a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b18157210 0x7f4b181e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18157690 0x7f4b181e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180a97b0 con 0x7f4b18157690 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180a8de0 con 0x7f4b18157210 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1e533640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180c8920 con 0x7f4b000047d0 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18157690 0x7f4b181e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18157690 0x7f4b181e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42960/0 (socket says 172.21.15.40:42960) 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 -- 172.21.15.40:0/3156292763 learned_addr learned my addr 172.21.15.40:0/3156292763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:12.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b17fff640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b000047d0 0x7f4b180a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b177fe640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b18157210 0x7f4b181e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 -- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b000047d0 msgr2=0x7f4b180a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b000047d0 0x7f4b180a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 -- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b18157210 msgr2=0x7f4b181e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b18157210 0x7f4b181e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.283+0000 7f4b1cad0640 1 -- 172.21.15.40:0/3156292763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180a84b0 con 0x7f4b18157690 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b1cad0640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18157690 0x7f4b181e3340 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4b180ca6e0 tx=0x7f4b1000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000d8f0 con 0x7f4b18157690 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000da70 con 0x7f4b18157690 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b1e533640 1 -- 172.21.15.40:0/3156292763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b180a8790 con 0x7f4b18157690 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000de20 con 0x7f4b18157690 2023-11-04T01:41:12.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b1e533640 1 -- 172.21.15.40:0/3156292763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b180c7b80 con 0x7f4b18157690 2023-11-04T01:41:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b1e533640 1 -- 172.21.15.40:0/3156292763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b180a8f50 con 0x7f4b18157690 2023-11-04T01:41:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b10012460 con 0x7f4b18157690 2023-11-04T01:41:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b14ff9640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b040664a0 0x7f4b04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4b10083dd0 con 0x7f4b18157690 2023-11-04T01:41:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b17fff640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b040664a0 0x7f4b04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.287+0000 7f4b17fff640 1 --2- 172.21.15.40:0/3156292763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b040664a0 0x7f4b04068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b08007fd0 tx=0x7f4b08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.291+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b10051130 con 0x7f4b18157690 2023-11-04T01:41:12.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.483+0000 7f4b1e533640 1 -- 172.21.15.40:0/3156292763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7f4b180744a0 con 0x7f4b18157690 2023-11-04T01:41:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.483+0000 7f4b14ff9640 1 -- 172.21.15.40:0/3156292763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(6) already has mon-managed snaps; can't attach pool to fs v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4b10054750 con 0x7f4b18157690 2023-11-04T01:41:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:Error ENOTSUP: pool(6) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:41:12.493 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:41:12.494 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-04T01:41:12.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 Processor -- start 2023-11-04T01:41:12.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 -- start start 2023-11-04T01:41:12.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d50d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d597d40 0x56352d5a3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d511f60 0x56352d5a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d47e8a0 con 0x7f5efc0022c0 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d47a190 con 0x56352d511f60 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f155b3080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x56352d431fc0 con 0x56352d597d40 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d50d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d50d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42978/0 (socket says 172.21.15.40:42978) 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 -- 172.21.15.40:0/1410552142 learned_addr learned my addr 172.21.15.40:0/1410552142 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f128d1640 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d597d40 0x56352d5a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f138d3640 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d511f60 0x56352d5a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 -- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d597d40 msgr2=0x56352d5a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d597d40 0x56352d5a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 -- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d511f60 msgr2=0x56352d5a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d511f60 0x56352d5a39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.527+0000 7f5f130d2640 1 -- 172.21.15.40:0/1410552142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56352d4135d0 con 0x7f5efc0022c0 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f130d2640 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d50d730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5f0401bfc0 tx=0x7f5f04001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7abdfa96b5dc90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f118cf640 1 -- 172.21.15.40:0/1410552142 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04001680 con 0x7f5efc0022c0 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f118cf640 1 -- 172.21.15.40:0/1410552142 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f040a4aa0 con 0x7f5efc0022c0 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f118cf640 1 -- 172.21.15.40:0/1410552142 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040a4e70 con 0x7f5efc0022c0 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/1410552142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 msgr2=0x56352d50d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d50d730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5f0401bfc0 tx=0x7f5f04001940 comp rx=0 tx=0).stop 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/1410552142 shutdown_connections 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d511f60 0x56352d5a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d597d40 0x56352d5a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- 172.21.15.40:0/1410552142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d50d730 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/1410552142 >> 172.21.15.40:0/1410552142 conn(0x56352d4f67c0 msgr2=0x56352d50c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/1410552142 shutdown_connections 2023-11-04T01:41:12.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/1410552142 wait complete. 2023-11-04T01:41:12.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 Processor -- start 2023-11-04T01:41:12.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- start start 2023-11-04T01:41:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d511f60 0x56352d594800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d597d40 0x56352d511050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d4cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d431cc0 con 0x7f5efc0022c0 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352d4082c0 con 0x56352d597d40 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x56352d57ff00 con 0x56352d511f60 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d4cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d4cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42984/0 (socket says 172.21.15.40:42984) 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 -- 172.21.15.40:0/3417688999 learned_addr learned my addr 172.21.15.40:0/3417688999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f130d2640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d511f60 0x56352d594800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f128d1640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d597d40 0x56352d511050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 -- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d511f60 msgr2=0x56352d594800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d511f60 0x56352d594800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 -- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d597d40 msgr2=0x56352d511050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d597d40 0x56352d511050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 -- 172.21.15.40:0/3417688999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc001e20 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f138d3640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d4cdfb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x56352d4f6770 tx=0x7f5f0c00d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0032d0 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00c040 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56352d413030 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c004150 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.531+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56352d598740 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.535+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f0c001620 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.535+0000 7f5f108cd640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f00064e50 0x7f5f00067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.535+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5f0c082770 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.535+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- pool_op(delete snap pool 6 tid 1 name snap3 v0) v4 -- 0x56352d484110 con 0x7f5efc0022c0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.535+0000 7f5f130d2640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f00064e50 0x7f5f00067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:12.535+0000 7f5f130d2640 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f00064e50 0x7f5f00067310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f040b7000 tx=0x7f5f040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v36) v1 ==== 43+0+0 (secure 0 0 0) 0x7f5f0c04fa50 con 0x7f5efc0022c0 2023-11-04T01:41:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=36}) v3 -- 0x7f5f0006d6f0 con 0x7f5efc0022c0 2023-11-04T01:41:13.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f108cd640 1 -- 172.21.15.40:0/3417688999 <== mon.0 v2:172.21.15.40:3300/0 7 ==== osd_map(36..36 src has 1..36) v4 ==== 643+0+0 (secure 0 0 0) 0x7f5f0c00de80 con 0x7f5efc0022c0 2023-11-04T01:41:13.089 INFO:teuthology.orchestra.run.smithi040.stdout:removed pool snap-test-pool snap snap3 2023-11-04T01:41:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f00064e50 msgr2=0x7f5f00067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f00064e50 0x7f5f00067310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f040b7000 tx=0x7f5f040a6000 comp rx=0 tx=0).stop 2023-11-04T01:41:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 msgr2=0x56352d4cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d4cdfb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x56352d4f6770 tx=0x7f5f0c00d590 comp rx=0 tx=0).stop 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 shutdown_connections 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f00064e50 0x7f5f00067310 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5efc0022c0 0x56352d4cdfb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x56352d597d40 0x56352d511050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.083+0000 7f5f155b3080 1 --2- 172.21.15.40:0/3417688999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x56352d511f60 0x56352d594800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.087+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 >> 172.21.15.40:0/3417688999 conn(0x56352d4f67c0 msgr2=0x56352d50c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.087+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 shutdown_connections 2023-11-04T01:41:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.087+0000 7f5f155b3080 1 -- 172.21.15.40:0/3417688999 wait complete. 2023-11-04T01:41:13.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-04T01:41:13.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.271+0000 7f2a82de4640 1 Processor -- start 2023-11-04T01:41:13.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.271+0000 7f2a82de4640 1 -- start start 2023-11-04T01:41:13.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.271+0000 7f2a82de4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c15af70 0x7f2a7c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.271+0000 7f2a82de4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a7c06d160 0x7f2a7c0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.271+0000 7f2a82de4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a7c15dd80 0x7f2a7c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c06c0c0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c06c3a0 con 0x7f2a7c06d160 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c06c680 con 0x7f2a7c15af70 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a7c15dd80 0x7f2a7c15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a7c15dd80 0x7f2a7c15e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42990/0 (socket says 172.21.15.40:42990) 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 -- 172.21.15.40:0/2812950387 learned_addr learned my addr 172.21.15.40:0/2812950387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a80b80640 1 --2- 172.21.15.40:0/2812950387 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c15af70 0x7f2a7c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a73fff640 1 --2- 172.21.15.40:0/2812950387 >> v2:172.21.15.91:3300/0 conn(0x7f2a7c06d160 0x7f2a7c0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 -- 172.21.15.40:0/2812950387 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c15af70 msgr2=0x7f2a7c0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 --2- 172.21.15.40:0/2812950387 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c15af70 0x7f2a7c0cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 -- 172.21.15.40:0/2812950387 >> v2:172.21.15.91:3300/0 conn(0x7f2a7c06d160 msgr2=0x7f2a7c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 --2- 172.21.15.40:0/2812950387 >> v2:172.21.15.91:3300/0 conn(0x7f2a7c06d160 0x7f2a7c0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 -- 172.21.15.40:0/2812950387 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c06c960 con 0x7f2a7c15dd80 2023-11-04T01:41:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a81381640 1 --2- 172.21.15.40:0/2812950387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c15e1f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0b1650 tx=0x7f2a7401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4d59ec0f611508 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a737fe640 1 -- 172.21.15.40:0/2812950387 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740a5760 con 0x7f2a7c15dd80 2023-11-04T01:41:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a737fe640 1 -- 172.21.15.40:0/2812950387 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740a58c0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a737fe640 1 -- 172.21.15.40:0/2812950387 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740a5c50 con 0x7f2a7c15dd80 2023-11-04T01:41:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- 172.21.15.40:0/2812950387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 msgr2=0x7f2a7c15e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 --2- 172.21.15.40:0/2812950387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c15e1f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0b1650 tx=0x7f2a7401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- 172.21.15.40:0/2812950387 shutdown_connections 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 --2- 172.21.15.40:0/2812950387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c15e1f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 --2- 172.21.15.40:0/2812950387 >> v2:172.21.15.91:3300/0 conn(0x7f2a7c06d160 0x7f2a7c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 --2- 172.21.15.40:0/2812950387 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c15af70 0x7f2a7c0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- 172.21.15.40:0/2812950387 >> 172.21.15.40:0/2812950387 conn(0x7f2a7c0cb510 msgr2=0x7f2a7c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- 172.21.15.40:0/2812950387 shutdown_connections 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.275+0000 7f2a82de4640 1 -- 172.21.15.40:0/2812950387 wait complete. 2023-11-04T01:41:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 Processor -- start 2023-11-04T01:41:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- start start 2023-11-04T01:41:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c06d160 0x7f2a7c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a7c15af70 0x7f2a7c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0c5470 con 0x7f2a7c15dd80 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0c3740 con 0x7f2a7c15af70 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0c4eb0 con 0x7f2a7c06d160 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c0ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43006/0 (socket says 172.21.15.40:43006) 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 -- 172.21.15.40:0/4196497605 learned_addr learned my addr 172.21.15.40:0/4196497605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a73fff640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a7c15af70 0x7f2a7c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a80b80640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c06d160 0x7f2a7c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 -- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c06d160 msgr2=0x7f2a7c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c06d160 0x7f2a7c0c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 -- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a7c15af70 msgr2=0x7f2a7c0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a7c15af70 0x7f2a7c0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 -- 172.21.15.40:0/4196497605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009b30 con 0x7f2a7c15dd80 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a80b80640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a7c06d160 0x7f2a7c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a81381640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c15dd80 0x7f2a7c0ace00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2a7401b080 tx=0x7f2a74019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740b8670 con 0x7f2a7c15dd80 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740b87d0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- 172.21.15.40:0/4196497605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c0c5190 con 0x7f2a7c15dd80 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740b8b60 con 0x7f2a7c15dd80 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- 172.21.15.40:0/4196497605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c0c66b0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.279+0000 7f2a82de4640 1 -- 172.21.15.40:0/4196497605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c0744a0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.283+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a740b8cc0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.283+0000 7f2a717fa640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a680664a0 0x7f2a68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.283+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f2a7411f3a0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.283+0000 7f2a80b80640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a680664a0 0x7f2a68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.283+0000 7f2a80b80640 1 --2- 172.21.15.40:0/4196497605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a680664a0 0x7f2a68068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0caad0 tx=0x7f2a78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.287+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a740ec830 con 0x7f2a7c15dd80 2023-11-04T01:41:13.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.447+0000 7f2a82de4640 1 -- 172.21.15.40:0/4196497605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7f2a7c0c3bb0 con 0x7f2a7c15dd80 2023-11-04T01:41:13.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.447+0000 7f2a717fa640 1 -- 172.21.15.40:0/4196497605 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v36) v1 ==== 296+0+0 (secure 0 0 0) 0x7f2a74009510 con 0x7f2a7c15dd80 2023-11-04T01:41:13.452 INFO:teuthology.orchestra.run.smithi040.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:41:13.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:13.460 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:41:13.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:13.507 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:13.555 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:41:13.556 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:13.556 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:13.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:13.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef30619640 1 Processor -- start 2023-11-04T01:41:13.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef30619640 1 -- start start 2023-11-04T01:41:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef30619640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef280d0ae0 0x7fef280b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef30619640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef280b6070 con 0x7fef280d0690 2023-11-04T01:41:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef30619640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef280b8ed0 con 0x7fef280b4990 2023-11-04T01:41:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef30619640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef280d1ce0 con 0x7fef280d0ae0 2023-11-04T01:41:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2dbb4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fef280d0690 0x7fef280b64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33614/0 (socket says 172.21.15.40:33614) 2023-11-04T01:41:13.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2dbb4640 1 -- 172.21.15.40:0/2166351051 learned_addr learned my addr 172.21.15.40:0/2166351051 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2ebb6640 1 --2- 172.21.15.40:0/2166351051 >> v2:172.21.15.91:3300/0 conn(0x7fef280d0ae0 0x7fef280b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363884285 0 0) 0x7fef280b6070 con 0x7fef280d0690 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef14003530 con 0x7fef280d0690 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894129055 0 0) 0x7fef14003530 con 0x7fef280d0690 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 >> v2:172.21.15.91:3300/0 conn(0x7fef280d0ae0 msgr2=0x7fef280b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 --2- 172.21.15.40:0/2166351051 >> v2:172.21.15.91:3300/0 conn(0x7fef280d0ae0 0x7fef280b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 >> v1:172.21.15.91:6789/0 conn(0x7fef280b4990 legacy=0x7fef280b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280d1fc0 con 0x7fef280d0690 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fef24001680 con 0x7fef280d0690 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 >> v1:172.21.15.40:6789/0 conn(0x7fef280d0690 legacy=0x7fef280b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef14003980 0x7fef14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef140047d0 0x7fef14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef14005190 0x7fef1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280d1ce0 con 0x7fef14003980 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1400c040 con 0x7fef14005190 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1400c200 con 0x7fef140047d0 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef14003980 0x7fef14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2ebb6640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef14005190 0x7fef1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2dbb4640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef140047d0 0x7fef14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2e3b5640 1 -- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef140047d0 msgr2=0x7fef14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef140047d0 0x7fef14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2e3b5640 1 -- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef14005190 msgr2=0x7fef1400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef14005190 0x7fef1400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2ebb6640 1 -- 172.21.15.40:0/2166351051 reap_dead start 2023-11-04T01:41:13.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.727+0000 7fef2e3b5640 1 -- 172.21.15.40:0/2166351051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14003530 con 0x7fef14003980 2023-11-04T01:41:13.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef14003980 0x7fef14003da0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fef18001780 tx=0x7fef1801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bad4aa20d793f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180a4ea0 con 0x7fef14003980 2023-11-04T01:41:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef180a7050 con 0x7fef14003980 2023-11-04T01:41:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef2d3b3640 1 -- 172.21.15.40:0/2166351051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18003600 con 0x7fef14003980 2023-11-04T01:41:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef30619640 1 -- 172.21.15.40:0/2166351051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef14003980 msgr2=0x7fef14003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef30619640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef14003980 0x7fef14003da0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fef18001780 tx=0x7fef1801c3e0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.731+0000 7fef30619640 1 -- 172.21.15.40:0/2166351051 shutdown_connections 2023-11-04T01:41:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 --2- 172.21.15.40:0/2166351051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef14003980 0x7fef14003da0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- 172.21.15.40:0/2166351051 >> 172.21.15.40:0/2166351051 conn(0x7fef280cf990 msgr2=0x7fef280cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- 172.21.15.40:0/2166351051 shutdown_connections 2023-11-04T01:41:13.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- 172.21.15.40:0/2166351051 wait complete. 2023-11-04T01:41:13.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 Processor -- start 2023-11-04T01:41:13.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- start start 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef14003980 0x7fef281584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 0x7fef2815f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef28158a20 0x7fef2815fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280a9900 con 0x7fef280b1970 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28156d20 con 0x7fef28158a20 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef28158fa0 con 0x7fef14003980 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 0x7fef2815f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 0x7fef2815f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43034/0 (socket says 172.21.15.40:43034) 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 -- 172.21.15.40:0/3316410607 learned_addr learned my addr 172.21.15.40:0/3316410607 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2ebb6640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef28158a20 0x7fef2815fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef14003980 0x7fef281584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 -- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef14003980 msgr2=0x7fef281584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef14003980 0x7fef281584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 -- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef28158a20 msgr2=0x7fef2815fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef28158a20 0x7fef2815fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 -- 172.21.15.40:0/3316410607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef281f3710 con 0x7fef280b1970 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2ebb6640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef28158a20 0x7fef2815fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef2dbb4640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 0x7fef2815f4d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef240118d0 tx=0x7fef24011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400fb00 con 0x7fef280b1970 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400fc80 con 0x7fef280b1970 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef281f3ba0 con 0x7fef280b1970 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24015410 con 0x7fef280b1970 2023-11-04T01:41:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef281f30c0 con 0x7fef280b1970 2023-11-04T01:41:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.735+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef281f38a0 con 0x7fef280b1970 2023-11-04T01:41:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.739+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef24015570 con 0x7fef280b1970 2023-11-04T01:41:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.739+0000 7fef1effd640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef0c0664d0 0x7fef0c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.739+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fef24087e20 con 0x7fef280b1970 2023-11-04T01:41:13.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.739+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef0c0664d0 0x7fef0c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.739+0000 7fef2e3b5640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef0c0664d0 0x7fef0c068990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef18001750 tx=0x7fef180011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.743+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef24055190 con 0x7fef280b1970 2023-11-04T01:41:13.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.899+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef280744a0 con 0x7fef280b1970 2023-11-04T01:41:13.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.903+0000 7fef1effd640 1 -- 172.21.15.40:0/3316410607 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18348 (secure 0 0 0) 0x7fef240587b0 con 0x7fef280b1970 2023-11-04T01:41:13.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:13.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":36,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:13.075337+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.903+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef0c0664d0 msgr2=0x7fef0c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.903+0000 7fef30619640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef0c0664d0 0x7fef0c068990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef18001750 tx=0x7fef180011a0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.903+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 msgr2=0x7fef2815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.903+0000 7fef30619640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 0x7fef2815f4d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef240118d0 tx=0x7fef24011d90 comp rx=0 tx=0).stop 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 shutdown_connections 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef0c0664d0 0x7fef0c068990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef28158a20 0x7fef2815fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef280b1970 0x7fef2815f4d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 --2- 172.21.15.40:0/3316410607 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef14003980 0x7fef281584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 >> 172.21.15.40:0/3316410607 conn(0x7fef280cf990 msgr2=0x7fef280d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 shutdown_connections 2023-11-04T01:41:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:13.907+0000 7fef30619640 1 -- 172.21.15.40:0/3316410607 wait complete. 2023-11-04T01:41:13.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:59.749221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:00.308826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:13.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:14.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 Processor -- start 2023-11-04T01:41:14.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 -- start start 2023-11-04T01:41:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6c40b3d90 0x7ff6c40ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b4170 0x7ff6c40cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40caa40 con 0x7ff6c40b0510 2023-11-04T01:41:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40cb3d0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c9ea1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40cae10 con 0x7ff6c40b4170 2023-11-04T01:41:14.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6c40b3d90 0x7ff6c40ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c2ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b4170 0x7ff6c40cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6c40b3d90 0x7ff6c40ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43038/0 (socket says 172.21.15.40:43038) 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 -- 172.21.15.40:0/2106969999 learned_addr learned my addr 172.21.15.40:0/2106969999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 -- 172.21.15.40:0/2106969999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b4170 msgr2=0x7ff6c40cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 --2- 172.21.15.40:0/2106969999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b4170 0x7ff6c40cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 -- 172.21.15.40:0/2106969999 >> v1:172.21.15.91:6789/0 conn(0x7ff6c40b0510 legacy=0x7ff6c40c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.047+0000 7ff6c37fe640 1 -- 172.21.15.40:0/2106969999 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40cb0f0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c37fe640 1 --2- 172.21.15.40:0/2106969999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c40ca500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009870 tx=0x7ff6b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9872bc22c7aadc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c27fc640 1 -- 172.21.15.40:0/2106969999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40ab620 con 0x7ff6c40b3d90 2023-11-04T01:41:14.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c27fc640 1 -- 172.21.15.40:0/2106969999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40ab780 con 0x7ff6c40b3d90 2023-11-04T01:41:14.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c27fc640 1 -- 172.21.15.40:0/2106969999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40abb10 con 0x7ff6c40b3d90 2023-11-04T01:41:14.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/2106969999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 msgr2=0x7ff6c40ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/2106969999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c40ca500 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009870 tx=0x7ff6b401c510 comp rx=0 tx=0).stop 2023-11-04T01:41:14.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/2106969999 shutdown_connections 2023-11-04T01:41:14.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/2106969999 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b4170 0x7ff6c40cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/2106969999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c40ca500 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/2106969999 >> 172.21.15.40:0/2106969999 conn(0x7ff6c40cb510 msgr2=0x7ff6c40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/2106969999 shutdown_connections 2023-11-04T01:41:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/2106969999 wait complete. 2023-11-04T01:41:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 Processor -- start 2023-11-04T01:41:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.051+0000 7ff6c9ea1640 1 -- start start 2023-11-04T01:41:14.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b0510 0x7ff6c414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c4153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6c40b4170 0x7ff6c40af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41536a0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4154070 con 0x7ff6c40b4170 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41527f0 con 0x7ff6c40b0510 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c4153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c4153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43046/0 (socket says 172.21.15.40:43046) 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 -- 172.21.15.40:0/1321956588 learned_addr learned my addr 172.21.15.40:0/1321956588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c37fe640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b0510 0x7ff6c414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c3fff640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6c40b4170 0x7ff6c40af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 -- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b0510 msgr2=0x7ff6c414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b0510 0x7ff6c414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 -- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6c40b4170 msgr2=0x7ff6c40af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6c40b4170 0x7ff6c40af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 -- 172.21.15.40:0/1321956588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40094d0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c3fff640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6c40b4170 0x7ff6c40af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c2ffd640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c4153b30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800e870 tx=0x7ff6b800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8009510 con 0x7ff6c40b3d90 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800eec0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c40b0eb0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800cb40 con 0x7ff6c40b3d90 2023-11-04T01:41:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c4152d70 con 0x7ff6c40b3d90 2023-11-04T01:41:14.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c40b46a0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6b800ccc0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6abfff640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6b00664a0 0x7ff6b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7ff6b8084100 con 0x7ff6c40b3d90 2023-11-04T01:41:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.055+0000 7ff6c37fe640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6b00664a0 0x7ff6b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.059+0000 7ff6c37fe640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6b00664a0 0x7ff6b0068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40af000 tx=0x7ff6b40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.059+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6b80513e0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6c40cd7f0 con 0x7ff6c40b3d90 2023-11-04T01:41:14.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6abfff640 1 -- 172.21.15.40:0/1321956588 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6b8054a00 con 0x7ff6c40b3d90 2023-11-04T01:41:14.224 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6b00664a0 msgr2=0x7ff6b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6b00664a0 0x7ff6b0068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40af000 tx=0x7ff6b40a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 msgr2=0x7ff6c4153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c4153b30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800e870 tx=0x7ff6b800ec70 comp rx=0 tx=0).stop 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.219+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 shutdown_connections 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6b00664a0 0x7ff6b0068960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff6c40b4170 0x7ff6c40af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6c40b3d90 0x7ff6c4153b30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 --2- 172.21.15.40:0/1321956588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff6c40b0510 0x7ff6c414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 >> 172.21.15.40:0/1321956588 conn(0x7ff6c40cb510 msgr2=0x7ff6c40b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 shutdown_connections 2023-11-04T01:41:14.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.223+0000 7ff6c9ea1640 1 -- 172.21.15.40:0/1321956588 wait complete. 2023-11-04T01:41:14.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 Processor -- start 2023-11-04T01:41:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 -- start start 2023-11-04T01:41:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdad00adb50 0x7fdad00adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdad00cc990 0x7fdad00ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad00cd020 con 0x7fdad006c3d0 2023-11-04T01:41:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad00cce40 con 0x7fdad00cc990 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdad5a72640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad00cd300 con 0x7fdad00adb50 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdaceffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdad00cc990 0x7fdad00ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdacffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdad006c3d0 0x7fdad00c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33616/0 (socket says 172.21.15.40:33616) 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdacffff640 1 -- 172.21.15.40:0/2167114290 learned_addr learned my addr 172.21.15.40:0/2167114290 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdacf7fe640 1 --2- 172.21.15.40:0/2167114290 >> v2:172.21.15.91:3300/0 conn(0x7fdad00adb50 0x7fdad00adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdaceffd640 1 -- 172.21.15.40:0/2167114290 >> v2:172.21.15.91:3300/0 conn(0x7fdad00adb50 msgr2=0x7fdad00adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdaceffd640 1 --2- 172.21.15.40:0/2167114290 >> v2:172.21.15.91:3300/0 conn(0x7fdad00adb50 0x7fdad00adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdaceffd640 1 -- 172.21.15.40:0/2167114290 >> v1:172.21.15.40:6789/0 conn(0x7fdad006c3d0 legacy=0x7fdad00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.359+0000 7fdaceffd640 1 -- 172.21.15.40:0/2167114290 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00cd5e0 con 0x7fdad00cc990 2023-11-04T01:41:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdaceffd640 1 --2- 172.21.15.40:0/2167114290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00cc990 0x7fdad00ce0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdad00b0fa0 tx=0x7fdac401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9434fd6574fe9368 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdace7fc640 1 -- 172.21.15.40:0/2167114290 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40a7070 con 0x7fdad00cc990 2023-11-04T01:41:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdace7fc640 1 -- 172.21.15.40:0/2167114290 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40ab430 con 0x7fdad00cc990 2023-11-04T01:41:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdace7fc640 1 -- 172.21.15.40:0/2167114290 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40ab7c0 con 0x7fdad00cc990 2023-11-04T01:41:14.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 -- 172.21.15.40:0/2167114290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00cc990 msgr2=0x7fdad00ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 --2- 172.21.15.40:0/2167114290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00cc990 0x7fdad00ce0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdad00b0fa0 tx=0x7fdac401c430 comp rx=0 tx=0).stop 2023-11-04T01:41:14.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 -- 172.21.15.40:0/2167114290 shutdown_connections 2023-11-04T01:41:14.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 --2- 172.21.15.40:0/2167114290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00cc990 0x7fdad00ce0c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 --2- 172.21.15.40:0/2167114290 >> v2:172.21.15.91:3300/0 conn(0x7fdad00adb50 0x7fdad00adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 -- 172.21.15.40:0/2167114290 >> 172.21.15.40:0/2167114290 conn(0x7fdad00cb510 msgr2=0x7fdad00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 -- 172.21.15.40:0/2167114290 shutdown_connections 2023-11-04T01:41:14.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 -- 172.21.15.40:0/2167114290 wait complete. 2023-11-04T01:41:14.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.363+0000 7fdad5a72640 1 Processor -- start 2023-11-04T01:41:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- start start 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdad006c3d0 0x7fdad0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 0x7fdad006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdad00cc990 0x7fdad0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad01564b0 con 0x7fdad00adb50 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0159480 con 0x7fdad00cc990 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00b18e0 con 0x7fdad006c3d0 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 0x7fdad006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 0x7fdad006ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43068/0 (socket says 172.21.15.40:43068) 2023-11-04T01:41:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 -- 172.21.15.40:0/3391510043 learned_addr learned my addr 172.21.15.40:0/3391510043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdacf7fe640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdad006c3d0 0x7fdad0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdacffff640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdad00cc990 0x7fdad0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 -- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdad006c3d0 msgr2=0x7fdad0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdad006c3d0 0x7fdad0158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 -- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdad00cc990 msgr2=0x7fdad0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdad00cc990 0x7fdad0155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 -- 172.21.15.40:0/3391510043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009420 con 0x7fdad00adb50 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdaceffd640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 0x7fdad006ff00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdac4019040 tx=0x7fdac401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40b5810 con 0x7fdad00adb50 2023-11-04T01:41:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40b5990 con 0x7fdad00adb50 2023-11-04T01:41:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad00b1bc0 con 0x7fdad00adb50 2023-11-04T01:41:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40b5d40 con 0x7fdad00adb50 2023-11-04T01:41:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad00b2180 con 0x7fdad00adb50 2023-11-04T01:41:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad00b2370 con 0x7fdad00adb50 2023-11-04T01:41:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdac40b4390 con 0x7fdad00adb50 2023-11-04T01:41:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdab7fff640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdabc0664a0 0x7fdabc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.367+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fdac411e840 con 0x7fdad00adb50 2023-11-04T01:41:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.371+0000 7fdacf7fe640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdabc0664a0 0x7fdabc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.371+0000 7fdacf7fe640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdabc0664a0 0x7fdabc068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b9d0 tx=0x7fdac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.375+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdac40ebd80 con 0x7fdad00adb50 2023-11-04T01:41:14.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdad00744a0 con 0x7fdad00adb50 2023-11-04T01:41:14.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdab7fff640 1 -- 172.21.15.40:0/3391510043 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdac4006e20 con 0x7fdad00adb50 2023-11-04T01:41:14.534 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:14.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdabc0664a0 msgr2=0x7fdabc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdabc0664a0 0x7fdabc068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdac000b9d0 tx=0x7fdac0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 msgr2=0x7fdad006ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 0x7fdad006ff00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdac4019040 tx=0x7fdac401ac70 comp rx=0 tx=0).stop 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 shutdown_connections 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdabc0664a0 0x7fdabc068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdad00cc990 0x7fdad0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdad00adb50 0x7fdad006ff00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 --2- 172.21.15.40:0/3391510043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdad006c3d0 0x7fdad0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 >> 172.21.15.40:0/3391510043 conn(0x7fdad00cb510 msgr2=0x7fdad00cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 shutdown_connections 2023-11-04T01:41:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.531+0000 7fdad5a72640 1 -- 172.21.15.40:0/3391510043 wait complete. 2023-11-04T01:41:14.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:14.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 Processor -- start 2023-11-04T01:41:14.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 -- start start 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefa0159ec0 0x7fefa00c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa015da30 0x7fefa00cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fefa006c5c0 0x7fefa006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa006cf90 con 0x7fefa0159ec0 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa015e260 con 0x7fefa006c5c0 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa811a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa015e540 con 0x7fefa015da30 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefa0159ec0 0x7fefa00c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefa0159ec0 0x7fefa00c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43074/0 (socket says 172.21.15.40:43074) 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 -- 172.21.15.40:0/130092777 learned_addr learned my addr 172.21.15.40:0/130092777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa56b5640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa015da30 0x7fefa00cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa66b7640 1 --2- 172.21.15.40:0/130092777 >> v2:172.21.15.91:3300/0 conn(0x7fefa006c5c0 0x7fefa006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 -- 172.21.15.40:0/130092777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa015da30 msgr2=0x7fefa00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa015da30 0x7fefa00cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 -- 172.21.15.40:0/130092777 >> v2:172.21.15.91:3300/0 conn(0x7fefa006c5c0 msgr2=0x7fefa006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 --2- 172.21.15.40:0/130092777 >> v2:172.21.15.91:3300/0 conn(0x7fefa006c5c0 0x7fefa006ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 -- 172.21.15.40:0/130092777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa015e820 con 0x7fefa0159ec0 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa56b5640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa015da30 0x7fefa00cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa66b7640 1 --2- 172.21.15.40:0/130092777 >> v2:172.21.15.91:3300/0 conn(0x7fefa006c5c0 0x7fefa006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:14.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.679+0000 7fefa5eb6640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa0159ec0 0x7fefa00c93b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fefa00c24a0 tx=0x7fef9c01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0be3c05afdb35e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa4eb4640 1 -- 172.21.15.40:0/130092777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0a7b40 con 0x7fefa0159ec0 2023-11-04T01:41:14.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa4eb4640 1 -- 172.21.15.40:0/130092777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c0a7ca0 con 0x7fefa0159ec0 2023-11-04T01:41:14.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa4eb4640 1 -- 172.21.15.40:0/130092777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0af660 con 0x7fefa0159ec0 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- 172.21.15.40:0/130092777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa0159ec0 msgr2=0x7fefa00c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa0159ec0 0x7fefa00c93b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fefa00c24a0 tx=0x7fef9c01eb10 comp rx=0 tx=0).stop 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- 172.21.15.40:0/130092777 shutdown_connections 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- 172.21.15.40:0/130092777 >> v2:172.21.15.91:3300/0 conn(0x7fefa006c5c0 0x7fefa006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa015da30 0x7fefa00cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- 172.21.15.40:0/130092777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa0159ec0 0x7fefa00c93b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- 172.21.15.40:0/130092777 >> 172.21.15.40:0/130092777 conn(0x7fefa00cb420 msgr2=0x7fefa00cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- 172.21.15.40:0/130092777 shutdown_connections 2023-11-04T01:41:14.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- 172.21.15.40:0/130092777 wait complete. 2023-11-04T01:41:14.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 Processor -- start 2023-11-04T01:41:14.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- start start 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 0x7fefa00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa0159ec0 0x7fefa00c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa015da30 0x7fefa01f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa014a780 con 0x7fefa006c5c0 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00c4ea0 con 0x7fefa015da30 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00c5180 con 0x7fefa0159ec0 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 0x7fefa00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 0x7fefa00c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43090/0 (socket says 172.21.15.40:43090) 2023-11-04T01:41:14.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 -- 172.21.15.40:0/1889535889 learned_addr learned my addr 172.21.15.40:0/1889535889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa56b5640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa0159ec0 0x7fefa00c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa66b7640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa015da30 0x7fefa01f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 -- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa0159ec0 msgr2=0x7fefa00c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa0159ec0 0x7fefa00c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 -- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa015da30 msgr2=0x7fefa01f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa015da30 0x7fefa01f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 -- 172.21.15.40:0/1889535889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c00b770 con 0x7fefa006c5c0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa5eb6640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 0x7fefa00c2700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fef9c01d1c0 tx=0x7fef9c01b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0ba640 con 0x7fefa006c5c0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c0ba7c0 con 0x7fefa006c5c0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.683+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa014a9d0 con 0x7fefa006c5c0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0bab70 con 0x7fefa006c5c0 2023-11-04T01:41:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa00c2c40 con 0x7fefa006c5c0 2023-11-04T01:41:14.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa00744a0 con 0x7fefa006c5c0 2023-11-04T01:41:14.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef9c0b6040 con 0x7fefa006c5c0 2023-11-04T01:41:14.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fef927fc640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef840664a0 0x7fef84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fef9c121650 con 0x7fefa006c5c0 2023-11-04T01:41:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fefa56b5640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef840664a0 0x7fef84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.687+0000 7fefa56b5640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef840664a0 0x7fef84068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef940075b0 tx=0x7fef94007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.691+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef9c0eeae0 con 0x7fefa006c5c0 2023-11-04T01:41:14.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefa00c1d10 con 0x7fefa006c5c0 2023-11-04T01:41:14.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fef927fc640 1 -- 172.21.15.40:0/1889535889 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef9c0f2100 con 0x7fefa006c5c0 2023-11-04T01:41:14.855 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef840664a0 msgr2=0x7fef84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef840664a0 0x7fef84068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fef940075b0 tx=0x7fef94007540 comp rx=0 tx=0).stop 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 msgr2=0x7fefa00c2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 0x7fefa00c2700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fef9c01d1c0 tx=0x7fef9c01b8b0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 shutdown_connections 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fef840664a0 0x7fef84068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefa015da30 0x7fefa01f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefa0159ec0 0x7fefa00c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 --2- 172.21.15.40:0/1889535889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa006c5c0 0x7fefa00c2700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 >> 172.21.15.40:0/1889535889 conn(0x7fefa00cb420 msgr2=0x7fefa00ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 shutdown_connections 2023-11-04T01:41:14.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:14.851+0000 7fefa811a640 1 -- 172.21.15.40:0/1889535889 wait complete. 2023-11-04T01:41:14.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:15.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86cbbd640 1 Processor -- start 2023-11-04T01:41:15.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86cbbd640 1 -- start start 2023-11-04T01:41:15.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86cbbd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd86815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86cbbd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8680cb130 con 0x7fd86815acb0 2023-11-04T01:41:15.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86cbbd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86815b680 con 0x7fd86815c160 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86cbbd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815bd40 con 0x7fd8680b0c20 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd86815acb0 0x7fd8680b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33626/0 (socket says 172.21.15.40:33626) 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86659c640 1 -- 172.21.15.40:0/3921591247 learned_addr learned my addr 172.21.15.40:0/3921591247 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd86815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893983317 0 0) 0x7fd8680cb130 con 0x7fd86815acb0 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd850003530 con 0x7fd86815acb0 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2615545250 0 0) 0x7fd850003530 con 0x7fd86815acb0 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 msgr2=0x7fd86815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd86815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 >> v1:172.21.15.91:6789/0 conn(0x7fd86815c160 legacy=0x7fd8680ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86815b960 con 0x7fd86815acb0 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd858001680 con 0x7fd86815acb0 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 >> v1:172.21.15.40:6789/0 conn(0x7fd86815acb0 legacy=0x7fd8680b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd8500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd850003f30 0x7fd8500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815bd40 con 0x7fd850003f30 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85000ba70 con 0x7fd850004d10 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85000bc30 con 0x7fd8680b0c20 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd850003f30 0x7fd8500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86659c640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd8500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd866d9d640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 -- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 msgr2=0x7fd8500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd8500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 -- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd850004d10 msgr2=0x7fd850005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd865d9b640 1 -- 172.21.15.40:0/3921591247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850003530 con 0x7fd850003f30 2023-11-04T01:41:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.003+0000 7fd86659c640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8680b0c20 0x7fd8500039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd850003f30 0x7fd8500047d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009ae0 tx=0x7fd85c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b99ca334cee425b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0a5530 con 0x7fd850003f30 2023-11-04T01:41:15.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0a5690 con 0x7fd850003f30 2023-11-04T01:41:15.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86559a640 1 -- 172.21.15.40:0/3921591247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0a5a40 con 0x7fd850003f30 2023-11-04T01:41:15.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3921591247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd850003f30 msgr2=0x7fd8500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3921591247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd850003f30 0x7fd8500047d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009ae0 tx=0x7fd85c01ca50 comp rx=0 tx=0).stop 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd866d9d640 1 -- 172.21.15.40:0/3921591247 reap_dead start 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3921591247 shutdown_connections 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3921591247 >> 172.21.15.40:0/3921591247 conn(0x7fd8680cb510 msgr2=0x7fd8680cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3921591247 shutdown_connections 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3921591247 wait complete. 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 Processor -- start 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.007+0000 7fd86cbbd640 1 -- start start 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 0x7fd8681f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8681499e0 0x7fd868158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd868158fc0 0x7fd8680b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868159420 con 0x7fd8681ee030 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868147990 con 0x7fd8681499e0 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd868147c70 con 0x7fd868158fc0 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 0x7fd8681f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 0x7fd8681f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43106/0 (socket says 172.21.15.40:43106) 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 -- 172.21.15.40:0/3520570228 learned_addr learned my addr 172.21.15.40:0/3520570228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd866d9d640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd868158fc0 0x7fd8680b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8681499e0 0x7fd868158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 -- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd868158fc0 msgr2=0x7fd8680b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd868158fc0 0x7fd8680b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 -- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8681499e0 msgr2=0x7fd868158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8681499e0 0x7fd868158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 -- 172.21.15.40:0/3520570228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86814a1c0 con 0x7fd8681ee030 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86659c640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 0x7fd8681f15f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd8580119d0 tx=0x7fd858011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800fc80 con 0x7fd8681ee030 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800fe00 con 0x7fd8681ee030 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86814a4a0 con 0x7fd8681ee030 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858015650 con 0x7fd8681ee030 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8681ee410 con 0x7fd8681ee030 2023-11-04T01:41:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8680744a0 con 0x7fd8681ee030 2023-11-04T01:41:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8580157b0 con 0x7fd8681ee030 2023-11-04T01:41:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd856ffd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8480664a0 0x7fd848068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd858087420 con 0x7fd8681ee030 2023-11-04T01:41:15.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.011+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8480664a0 0x7fd848068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.015+0000 7fd865d9b640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8480664a0 0x7fd848068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0af000 tx=0x7fd85c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.015+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8580546f0 con 0x7fd8681ee030 2023-11-04T01:41:15.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fd8680cde30 con 0x7fd8681ee030 2023-11-04T01:41:15.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd856ffd640 1 -- 172.21.15.40:0/3520570228 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v36) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd858057d10 con 0x7fd8681ee030 2023-11-04T01:41:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8480664a0 msgr2=0x7fd848068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8480664a0 0x7fd848068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0af000 tx=0x7fd85c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 msgr2=0x7fd8681f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 0x7fd8681f15f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd8580119d0 tx=0x7fd858011e90 comp rx=0 tx=0).stop 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 shutdown_connections 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8480664a0 0x7fd848068960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd868158fc0 0x7fd8680b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8681499e0 0x7fd868158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 --2- 172.21.15.40:0/3520570228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8681ee030 0x7fd8681f15f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.175+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 >> 172.21.15.40:0/3520570228 conn(0x7fd8680cb510 msgr2=0x7fd8680cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.179+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 shutdown_connections 2023-11-04T01:41:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.179+0000 7fd86cbbd640 1 -- 172.21.15.40:0/3520570228 wait complete. 2023-11-04T01:41:15.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:15.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56abf8a640 1 Processor -- start 2023-11-04T01:41:15.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56abf8a640 1 -- start start 2023-11-04T01:41:15.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56abf8a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56a40b0890 0x7f56a40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56abf8a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a40ce320 con 0x7f56a40b0c70 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56abf8a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a40ce600 con 0x7f56a40c9960 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56abf8a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a406d2f0 con 0x7f56a40b0890 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56a9d26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56a40b0890 0x7f56a40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56aa527640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56a40b0c70 0x7f56a40ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33640/0 (socket says 172.21.15.40:33640) 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56aa527640 1 -- 172.21.15.40:0/669447313 learned_addr learned my addr 172.21.15.40:0/669447313 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56a9d26640 1 -- 172.21.15.40:0/669447313 >> v1:172.21.15.91:6789/0 conn(0x7f56a40c9960 legacy=0x7f56a40704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56a9d26640 1 -- 172.21.15.40:0/669447313 >> v1:172.21.15.40:6789/0 conn(0x7f56a40b0c70 legacy=0x7f56a40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56a9d26640 1 -- 172.21.15.40:0/669447313 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a40ce8e0 con 0x7f56a40b0890 2023-11-04T01:41:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.307+0000 7f56a8d24640 1 -- 172.21.15.40:0/669447313 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709674343 0 0) 0x7f56a40ce320 con 0x7f56a40b0c70 2023-11-04T01:41:15.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56a9d26640 1 --2- 172.21.15.40:0/669447313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40b0890 0x7f56a40cdbd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f56a00097c0 tx=0x7f56a001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae728c410b07f17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56a8d24640 1 -- 172.21.15.40:0/669447313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a00ab600 con 0x7f56a40b0890 2023-11-04T01:41:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56a8d24640 1 -- 172.21.15.40:0/669447313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a00a7050 con 0x7f56a40b0890 2023-11-04T01:41:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56a8d24640 1 -- 172.21.15.40:0/669447313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a00ab980 con 0x7f56a40b0890 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- 172.21.15.40:0/669447313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40b0890 msgr2=0x7f56a40cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 --2- 172.21.15.40:0/669447313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40b0890 0x7f56a40cdbd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f56a00097c0 tx=0x7f56a001c440 comp rx=0 tx=0).stop 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- 172.21.15.40:0/669447313 shutdown_connections 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 --2- 172.21.15.40:0/669447313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40b0890 0x7f56a40cdbd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- 172.21.15.40:0/669447313 >> 172.21.15.40:0/669447313 conn(0x7f56a40cebb0 msgr2=0x7f56a40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- 172.21.15.40:0/669447313 shutdown_connections 2023-11-04T01:41:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- 172.21.15.40:0/669447313 wait complete. 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 Processor -- start 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- start start 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56a40b0890 0x7f56a4158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56a40b0c70 0x7f56a4157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 0x7f56a40c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40c4ad0 con 0x7f56a40c9960 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a41577a0 con 0x7f56a40b0890 2023-11-04T01:41:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56abf8a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a4157a80 con 0x7f56a40b0c70 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56aa527640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 0x7f56a40c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56aa527640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 0x7f56a40c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43116/0 (socket says 172.21.15.40:43116) 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56aa527640 1 -- 172.21.15.40:0/2406800059 learned_addr learned my addr 172.21.15.40:0/2406800059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.311+0000 7f56a9525640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56a40b0c70 0x7f56a4157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56a9d26640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56a40b0890 0x7f56a4158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56aa527640 1 -- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56a40b0c70 msgr2=0x7f56a4157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56aa527640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56a40b0c70 0x7f56a4157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56aa527640 1 -- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56a40b0890 msgr2=0x7f56a4158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56aa527640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56a40b0890 0x7f56a4158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56aa527640 1 -- 172.21.15.40:0/2406800059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0009420 con 0x7f56a40c9960 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56aa527640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 0x7f56a40c2e20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f569c001570 tx=0x7f569c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00a640 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c00a7c0 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a4157d60 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00ab70 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a4158320 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a40744a0 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f569c00acd0 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f569a7fc640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56880664a0 0x7f5688068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f569c083580 con 0x7f56a40c9960 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56a9d26640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56880664a0 0x7f5688068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.315+0000 7f56a9d26640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56880664a0 0x7f5688068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f56a00ad000 tx=0x7f56a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.319+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f569c0508f0 con 0x7f56a40c9960 2023-11-04T01:41:15.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f56a40b4b30 con 0x7f56a40c9960 2023-11-04T01:41:15.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f569a7fc640 1 -- 172.21.15.40:0/2406800059 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f569c018080 con 0x7f56a40c9960 2023-11-04T01:41:15.487 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:41:15.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56880664a0 msgr2=0x7f5688068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56880664a0 0x7f5688068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f56a00ad000 tx=0x7f56a0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 msgr2=0x7f56a40c2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 0x7f56a40c2e20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f569c001570 tx=0x7f569c00cca0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 shutdown_connections 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56880664a0 0x7f5688068960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a40c9960 0x7f56a40c2e20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56a40b0c70 0x7f56a4157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 --2- 172.21.15.40:0/2406800059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56a40b0890 0x7f56a4158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 >> 172.21.15.40:0/2406800059 conn(0x7f56a40cebb0 msgr2=0x7f56a4152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 shutdown_connections 2023-11-04T01:41:15.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.483+0000 7f56abf8a640 1 -- 172.21.15.40:0/2406800059 wait complete. 2023-11-04T01:41:15.505 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:41:15.505 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:15.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:15.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[48764]: fuse finished with error 0 and tester_r 0 2023-11-04T01:41:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:15.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:15.563 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:41:15.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:15.563 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:41:15.569 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:15.569 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:15.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:15.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:41:15.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:15.576 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:41:15.622 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:41:15.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:15.623 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:15.623 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:15.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:15.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:41:15.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:15.628 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:41:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:41:15.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:15.679 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:15.679 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:15.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:15.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:41:15.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:15.686 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:41:15.734 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:41:15.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:15.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 Processor -- start 2023-11-04T01:41:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 -- start start 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 0x7eff380715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7eff3806f8f0 0x7eff380b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380c2670 con 0x7eff380b0b70 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff38070140 con 0x7eff3806f8f0 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3f560640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3815fc90 con 0x7eff3815afd0 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3dafd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7eff380b0b70 0x7eff380c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33644/0 (socket says 172.21.15.40:33644) 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3dafd640 1 -- 172.21.15.40:0/3278918322 learned_addr learned my addr 172.21.15.40:0/3278918322 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:15.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3d2fc640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 0x7eff380715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3278918322 >> v2:172.21.15.91:3300/0 conn(0x7eff3806f8f0 0x7eff380b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129995523 0 0) 0x7eff380c2670 con 0x7eff380b0b70 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff24003530 con 0x7eff380b0b70 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198280680 0 0) 0x7eff24003530 con 0x7eff380b0b70 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 msgr2=0x7eff380715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 0x7eff380715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 >> v2:172.21.15.91:3300/0 conn(0x7eff3806f8f0 msgr2=0x7eff380b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 --2- 172.21.15.40:0/3278918322 >> v2:172.21.15.91:3300/0 conn(0x7eff3806f8f0 0x7eff380b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3806bc30 con 0x7eff380b0b70 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7eff30001a00 con 0x7eff380b0b70 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 >> v1:172.21.15.40:6789/0 conn(0x7eff380b0b70 legacy=0x7eff380c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 0x7eff24003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff24003f00 0x7eff240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24004d10 0x7eff24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38070140 con 0x7eff24003f00 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3815fc90 con 0x7eff24004d10 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2400b990 con 0x7eff3815afd0 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff24003f00 0x7eff240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3d2fc640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 0x7eff24003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3dafd640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24004d10 0x7eff24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 -- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 msgr2=0x7eff24003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff3815afd0 0x7eff24003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 -- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24004d10 msgr2=0x7eff24005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24004d10 0x7eff24005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3cafb640 1 -- 172.21.15.40:0/3278918322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24003530 con 0x7eff24003f00 2023-11-04T01:41:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.859+0000 7eff3dafd640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24004d10 0x7eff24005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff24003f00 0x7eff240047d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff28009ae0 tx=0x7eff2801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1318f7274be8614 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280a5680 con 0x7eff24003f00 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff280a57e0 con 0x7eff24003f00 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff2ffff640 1 -- 172.21.15.40:0/3278918322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280a5b90 con 0x7eff24003f00 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- 172.21.15.40:0/3278918322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff24003f00 msgr2=0x7eff240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 --2- 172.21.15.40:0/3278918322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff24003f00 0x7eff240047d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff28009ae0 tx=0x7eff2801ca30 comp rx=0 tx=0).stop 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3dafd640 1 -- 172.21.15.40:0/3278918322 reap_dead start 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- 172.21.15.40:0/3278918322 shutdown_connections 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- 172.21.15.40:0/3278918322 >> 172.21.15.40:0/3278918322 conn(0x7eff380cebb0 msgr2=0x7eff380cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- 172.21.15.40:0/3278918322 shutdown_connections 2023-11-04T01:41:15.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- 172.21.15.40:0/3278918322 wait complete. 2023-11-04T01:41:15.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 Processor -- start 2023-11-04T01:41:15.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- start start 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24003f00 0x7eff38153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff381559e0 0x7eff38155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 0x7eff38157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38154310 con 0x7eff38156df0 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38155550 con 0x7eff24003f00 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.863+0000 7eff3f560640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff38154980 con 0x7eff381559e0 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 0x7eff38157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 0x7eff38157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43136/0 (socket says 172.21.15.40:43136) 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 -- 172.21.15.40:0/3939234831 learned_addr learned my addr 172.21.15.40:0/3939234831 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3d2fc640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24003f00 0x7eff38153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff381559e0 0x7eff38155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 -- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff381559e0 msgr2=0x7eff38155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff381559e0 0x7eff38155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 -- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24003f00 msgr2=0x7eff38153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24003f00 0x7eff38153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 -- 172.21.15.40:0/3939234831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38154c20 con 0x7eff38156df0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3cafb640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff381559e0 0x7eff38155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3dafd640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 0x7eff38157270 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff38070e60 tx=0x7eff30010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000eb80 con 0x7eff38156df0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000ece0 con 0x7eff38156df0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff38154f00 con 0x7eff38156df0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30015620 con 0x7eff38156df0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff381577b0 con 0x7eff38156df0 2023-11-04T01:41:15.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff380744a0 con 0x7eff38156df0 2023-11-04T01:41:15.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff3001e3b0 con 0x7eff38156df0 2023-11-04T01:41:15.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff2dffb640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff1c0664d0 0x7eff1c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7eff30086b60 con 0x7eff38156df0 2023-11-04T01:41:15.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3d2fc640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff1c0664d0 0x7eff1c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.867+0000 7eff3d2fc640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff1c0664d0 0x7eff1c068990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff34009a00 tx=0x7eff34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:15.871+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff30053ee0 con 0x7eff38156df0 2023-11-04T01:41:16.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.063+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff38155690 con 0x7eff38156df0 2023-11-04T01:41:16.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff2dffb640 1 -- 172.21.15.40:0/3939234831 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4912 (secure 0 0 0) 0x7eff3001a070 con 0x7eff38156df0 2023-11-04T01:41:16.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:16.071 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:01.346773+0000","modified":"2023-11-04T01:41:04.362535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3716931542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3716931542},{"type":"v1","addr":"172.21.15.40:6835","nonce":3716931542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:16.071 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 14 2023-11-04T01:41:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff1c0664d0 msgr2=0x7eff1c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff1c0664d0 0x7eff1c068990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff34009a00 tx=0x7eff34008040 comp rx=0 tx=0).stop 2023-11-04T01:41:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 msgr2=0x7eff38157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 0x7eff38157270 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff38070e60 tx=0x7eff30010d90 comp rx=0 tx=0).stop 2023-11-04T01:41:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 shutdown_connections 2023-11-04T01:41:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7eff1c0664d0 0x7eff1c068990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff38156df0 0x7eff38157270 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7eff381559e0 0x7eff38155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 --2- 172.21.15.40:0/3939234831 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7eff24003f00 0x7eff38153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 >> 172.21.15.40:0/3939234831 conn(0x7eff380cebb0 msgr2=0x7eff380c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 shutdown_connections 2023-11-04T01:41:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.067+0000 7eff3f560640 1 -- 172.21.15.40:0/3939234831 wait complete. 2023-11-04T01:41:16.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:16.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.203+0000 7fd587096640 1 Processor -- start 2023-11-04T01:41:16.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.203+0000 7fd587096640 1 -- start start 2023-11-04T01:41:16.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd587096640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd5800d0690 0x7fd5800b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd587096640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800b6070 con 0x7fd5800b4990 2023-11-04T01:41:16.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd587096640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800b8ed0 con 0x7fd5800d0ae0 2023-11-04T01:41:16.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd587096640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5800d1ce0 con 0x7fd5800d0690 2023-11-04T01:41:16.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd5800b4990 0x7fd5800b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33656/0 (socket says 172.21.15.40:33656) 2023-11-04T01:41:16.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 -- 172.21.15.40:0/4230999049 learned_addr learned my addr 172.21.15.40:0/4230999049 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57ffff640 1 --2- 172.21.15.40:0/4230999049 >> v2:172.21.15.91:3300/0 conn(0x7fd5800d0690 0x7fd5800b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546335949 0 0) 0x7fd5800b6070 con 0x7fd5800b4990 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd568003530 con 0x7fd5800b4990 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652524579 0 0) 0x7fd568003530 con 0x7fd5800b4990 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 >> v2:172.21.15.91:3300/0 conn(0x7fd5800d0690 msgr2=0x7fd5800b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 --2- 172.21.15.40:0/4230999049 >> v2:172.21.15.91:3300/0 conn(0x7fd5800d0690 0x7fd5800b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 >> v1:172.21.15.91:6789/0 conn(0x7fd5800d0ae0 legacy=0x7fd5800b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800d1fc0 con 0x7fd5800b4990 2023-11-04T01:41:16.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd570001680 con 0x7fd5800b4990 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 >> v1:172.21.15.40:6789/0 conn(0x7fd5800b4990 legacy=0x7fd5800b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd568003980 0x7fd568003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680047d0 0x7fd568004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568005190 0x7fd56800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800d1ce0 con 0x7fd568003980 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56800c040 con 0x7fd5680047d0 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56800c200 con 0x7fd568005190 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd568003980 0x7fd568003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd585633640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568005190 0x7fd56800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd57ffff640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680047d0 0x7fd568004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 -- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568005190 msgr2=0x7fd56800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568005190 0x7fd56800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 -- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680047d0 msgr2=0x7fd568004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5680047d0 0x7fd568004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd584e32640 1 -- 172.21.15.40:0/4230999049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568003530 con 0x7fd568003980 2023-11-04T01:41:16.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd585633640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568005190 0x7fd56800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:16.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.207+0000 7fd585633640 1 -- 172.21.15.40:0/4230999049 reap_dead start 2023-11-04T01:41:16.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd584e32640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd568003980 0x7fd568003da0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c240 tx=0x7fd57001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97202384a179785c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570005ae0 con 0x7fd568003980 2023-11-04T01:41:16.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5700ab070 con 0x7fd568003980 2023-11-04T01:41:16.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57f7fe640 1 -- 172.21.15.40:0/4230999049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570007070 con 0x7fd568003980 2023-11-04T01:41:16.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- 172.21.15.40:0/4230999049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd568003980 msgr2=0x7fd568003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd568003980 0x7fd568003da0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c240 tx=0x7fd57001f3b0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- 172.21.15.40:0/4230999049 shutdown_connections 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 --2- 172.21.15.40:0/4230999049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd568003980 0x7fd568003da0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- 172.21.15.40:0/4230999049 >> 172.21.15.40:0/4230999049 conn(0x7fd5800cf990 msgr2=0x7fd5800cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- 172.21.15.40:0/4230999049 shutdown_connections 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- 172.21.15.40:0/4230999049 wait complete. 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 Processor -- start 2023-11-04T01:41:16.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- start start 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568003980 0x7fd580157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 0x7fd5800cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd580158600 0x7fd580158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580157be0 con 0x7fd5800cbd30 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580158fc0 con 0x7fd580158600 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd587096640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580157680 con 0x7fd568003980 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 0x7fd5800cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 0x7fd5800cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43152/0 (socket says 172.21.15.40:43152) 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 -- 172.21.15.40:0/2775503104 learned_addr learned my addr 172.21.15.40:0/2775503104 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:16.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd584e32640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568003980 0x7fd580157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd585633640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd580158600 0x7fd580158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 -- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568003980 msgr2=0x7fd580157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568003980 0x7fd580157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 -- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd580158600 msgr2=0x7fd580158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd580158600 0x7fd580158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.211+0000 7fd57ffff640 1 -- 172.21.15.40:0/2775503104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58015e520 con 0x7fd5800cbd30 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57ffff640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 0x7fd5800cc1b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd574010900 tx=0x7fd574010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574009650 con 0x7fd5800cbd30 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57400ebc0 con 0x7fd5800cbd30 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58015f380 con 0x7fd5800cbd30 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57401c400 con 0x7fd5800cbd30 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58015ea50 con 0x7fd5800cbd30 2023-11-04T01:41:16.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58015f510 con 0x7fd5800cbd30 2023-11-04T01:41:16.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd57401c560 con 0x7fd5800cbd30 2023-11-04T01:41:16.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57d7fa640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd56c0664d0 0x7fd56c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd5740847b0 con 0x7fd5800cbd30 2023-11-04T01:41:16.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.215+0000 7fd584e32640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd56c0664d0 0x7fd56c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.219+0000 7fd584e32640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd56c0664d0 0x7fd56c068990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5700af000 tx=0x7fd5700aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.219+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd574051c00 con 0x7fd5800cbd30 2023-11-04T01:41:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.375+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5800744a0 con 0x7fd5800cbd30 2023-11-04T01:41:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.379+0000 7fd57d7fa640 1 -- 172.21.15.40:0/2775503104 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18348 (secure 0 0 0) 0x7fd574055220 con 0x7fd5800cbd30 2023-11-04T01:41:16.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:16.385 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":36,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:13.075337+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd56c0664d0 msgr2=0x7fd56c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd56c0664d0 0x7fd56c068990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5700af000 tx=0x7fd5700aa000 comp rx=0 tx=0).stop 2023-11-04T01:41:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 msgr2=0x7fd5800cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 0x7fd5800cc1b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd574010900 tx=0x7fd574010dc0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 shutdown_connections 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd56c0664d0 0x7fd56c068990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd580158600 0x7fd580158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5800cbd30 0x7fd5800cc1b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 --2- 172.21.15.40:0/2775503104 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd568003980 0x7fd580157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 >> 172.21.15.40:0/2775503104 conn(0x7fd5800cf990 msgr2=0x7fd5800b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 shutdown_connections 2023-11-04T01:41:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.383+0000 7fd587096640 1 -- 172.21.15.40:0/2775503104 wait complete. 2023-11-04T01:41:16.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:59.749221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:00.308826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:16.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:16.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.531+0000 7fd10dec6640 1 Processor -- start 2023-11-04T01:41:16.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.531+0000 7fd10dec6640 1 -- start start 2023-11-04T01:41:16.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd10dec6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd10815af50 0x7fd1080cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd10dec6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd1080cf4c0 0x7fd1080d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd10dec6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080cd830 con 0x7fd1080b32f0 2023-11-04T01:41:16.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd10dec6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080b3780 con 0x7fd10815af50 2023-11-04T01:41:16.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd10dec6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080cdad0 con 0x7fd1080cf4c0 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd10815af50 0x7fd1080cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd10815af50 0x7fd1080cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43158/0 (socket says 172.21.15.40:43158) 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 -- 172.21.15.40:0/234024241 learned_addr learned my addr 172.21.15.40:0/234024241 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd107fff640 1 --2- 172.21.15.40:0/234024241 >> v2:172.21.15.91:3300/0 conn(0x7fd1080cf4c0 0x7fd1080d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 -- 172.21.15.40:0/234024241 >> v2:172.21.15.91:3300/0 conn(0x7fd1080cf4c0 msgr2=0x7fd1080d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 --2- 172.21.15.40:0/234024241 >> v2:172.21.15.91:3300/0 conn(0x7fd1080cf4c0 0x7fd1080d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 -- 172.21.15.40:0/234024241 >> v1:172.21.15.40:6789/0 conn(0x7fd1080b32f0 legacy=0x7fd1080ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.535+0000 7fd1077fe640 1 -- 172.21.15.40:0/234024241 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080cddb0 con 0x7fd10815af50 2023-11-04T01:41:16.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd1077fe640 1 --2- 172.21.15.40:0/234024241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080cb330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd108066a00 tx=0x7fd0f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab832ab0b2c565a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd1067fc640 1 -- 172.21.15.40:0/234024241 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80aa5f0 con 0x7fd10815af50 2023-11-04T01:41:16.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd1067fc640 1 -- 172.21.15.40:0/234024241 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f80aa750 con 0x7fd10815af50 2023-11-04T01:41:16.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd1067fc640 1 -- 172.21.15.40:0/234024241 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80aaae0 con 0x7fd10815af50 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- 172.21.15.40:0/234024241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 msgr2=0x7fd1080cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 --2- 172.21.15.40:0/234024241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080cb330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd108066a00 tx=0x7fd0f801c470 comp rx=0 tx=0).stop 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- 172.21.15.40:0/234024241 shutdown_connections 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 --2- 172.21.15.40:0/234024241 >> v2:172.21.15.91:3300/0 conn(0x7fd1080cf4c0 0x7fd1080d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 --2- 172.21.15.40:0/234024241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080cb330 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- 172.21.15.40:0/234024241 >> 172.21.15.40:0/234024241 conn(0x7fd108065dc0 msgr2=0x7fd1080661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- 172.21.15.40:0/234024241 shutdown_connections 2023-11-04T01:41:16.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- 172.21.15.40:0/234024241 wait complete. 2023-11-04T01:41:16.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 Processor -- start 2023-11-04T01:41:16.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- start start 2023-11-04T01:41:16.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1080cf4c0 0x7fd108155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1080c8770 0x7fd108151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1081510f0 con 0x7fd10815af50 2023-11-04T01:41:16.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080c8ff0 con 0x7fd1080c8770 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd10dec6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080c8d10 con 0x7fd1080cf4c0 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43160/0 (socket says 172.21.15.40:43160) 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 -- 172.21.15.40:0/3244938986 learned_addr learned my addr 172.21.15.40:0/3244938986 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd1077fe640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1080cf4c0 0x7fd108155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd107fff640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1080c8770 0x7fd108151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 -- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1080cf4c0 msgr2=0x7fd108155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1080cf4c0 0x7fd108155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 -- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1080c8770 msgr2=0x7fd108151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1080c8770 0x7fd108151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd106ffd640 1 -- 172.21.15.40:0/3244938986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009480 con 0x7fd10815af50 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.539+0000 7fd107fff640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1080c8770 0x7fd108151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:16.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd106ffd640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080c98c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c7f0 tx=0x7fd10000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100003b80 con 0x7fd10815af50 2023-11-04T01:41:16.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100003ce0 con 0x7fd10815af50 2023-11-04T01:41:16.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd108150aa0 con 0x7fd10815af50 2023-11-04T01:41:16.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10000aa90 con 0x7fd10815af50 2023-11-04T01:41:16.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1081521c0 con 0x7fd10815af50 2023-11-04T01:41:16.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd108151260 con 0x7fd10815af50 2023-11-04T01:41:16.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd10000abf0 con 0x7fd10815af50 2023-11-04T01:41:16.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd0fffff640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0e80664a0 0x7fd0e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd100083fd0 con 0x7fd10815af50 2023-11-04T01:41:16.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd1077fe640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0e80664a0 0x7fd0e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.543+0000 7fd1077fe640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0e80664a0 0x7fd0e8068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80ae000 tx=0x7fd0f80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.547+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd100051210 con 0x7fd10815af50 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.703+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1080675f0 con 0x7fd10815af50 2023-11-04T01:41:16.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.703+0000 7fd0fffff640 1 -- 172.21.15.40:0/3244938986 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd100054830 con 0x7fd10815af50 2023-11-04T01:41:16.709 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0e80664a0 msgr2=0x7fd0e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0e80664a0 0x7fd0e8068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80ae000 tx=0x7fd0f80a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 msgr2=0x7fd1080c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080c98c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd10000c7f0 tx=0x7fd10000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 shutdown_connections 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0e80664a0 0x7fd0e8068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1080c8770 0x7fd108151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd10815af50 0x7fd1080c98c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 --2- 172.21.15.40:0/3244938986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd1080cf4c0 0x7fd108155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 >> 172.21.15.40:0/3244938986 conn(0x7fd108065dc0 msgr2=0x7fd1080b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 shutdown_connections 2023-11-04T01:41:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.707+0000 7fd10dec6640 1 -- 172.21.15.40:0/3244938986 wait complete. 2023-11-04T01:41:16.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:16.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.851+0000 7f623c022640 1 Processor -- start 2023-11-04T01:41:16.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.851+0000 7f623c022640 1 -- start start 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623c022640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f62340ae000 0x7f6234070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623c022640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 0x7f623406c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623c022640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6234070850 con 0x7f623406bf20 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623c022640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623406c8d0 con 0x7f62340ae000 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623c022640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623406f9c0 con 0x7f62340c9a00 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f62395bd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f623406bf20 0x7f62340c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33670/0 (socket says 172.21.15.40:33670) 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f62395bd640 1 -- 172.21.15.40:0/3583325144 learned_addr learned my addr 172.21.15.40:0/3583325144 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623a5bf640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 0x7f623406c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 --2- 172.21.15.40:0/3583325144 >> v2:172.21.15.91:3300/0 conn(0x7f62340ae000 0x7f6234070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015436171 0 0) 0x7f6234070850 con 0x7f623406bf20 2023-11-04T01:41:16.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6220003530 con 0x7f623406bf20 2023-11-04T01:41:16.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 420173398 0 0) 0x7f6220003530 con 0x7f623406bf20 2023-11-04T01:41:16.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 msgr2=0x7f623406c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 0x7f623406c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 >> v2:172.21.15.91:3300/0 conn(0x7f62340ae000 msgr2=0x7f6234070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 --2- 172.21.15.40:0/3583325144 >> v2:172.21.15.91:3300/0 conn(0x7f62340ae000 0x7f6234070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234159ab0 con 0x7f623406bf20 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f6230001680 con 0x7f623406bf20 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 >> v1:172.21.15.40:6789/0 conn(0x7f623406bf20 legacy=0x7f62340c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f6220003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 0x7f6220005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623406c8d0 con 0x7f6220003980 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623406f9c0 con 0x7f62200047d0 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622000b990 con 0x7f62340c9a00 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f6220003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f623a5bf640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 0x7f6220005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f62395bd640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 -- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 msgr2=0x7f6220005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62340c9a00 0x7f6220005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 -- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62200047d0 msgr2=0x7f6220004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:16.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f6239dbe640 1 -- 172.21.15.40:0/3583325144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6220003530 con 0x7f6220003980 2023-11-04T01:41:16.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.855+0000 7f62395bd640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62200047d0 0x7f6220004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:16.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f6220003da0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6224009b10 tx=0x7f622401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b209cdccfb282812 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240a8450 con 0x7f6220003980 2023-11-04T01:41:16.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62240a85b0 con 0x7f6220003980 2023-11-04T01:41:16.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6238dbc640 1 -- 172.21.15.40:0/3583325144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240a8960 con 0x7f6220003980 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- 172.21.15.40:0/3583325144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 msgr2=0x7f6220003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 --2- 172.21.15.40:0/3583325144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f6220003da0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6224009b10 tx=0x7f622401ca90 comp rx=0 tx=0).stop 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623a5bf640 1 -- 172.21.15.40:0/3583325144 reap_dead start 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- 172.21.15.40:0/3583325144 shutdown_connections 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- 172.21.15.40:0/3583325144 >> 172.21.15.40:0/3583325144 conn(0x7f62340cb510 msgr2=0x7f62340cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- 172.21.15.40:0/3583325144 shutdown_connections 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- 172.21.15.40:0/3583325144 wait complete. 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 Processor -- start 2023-11-04T01:41:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- start start 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f62341f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6234146670 0x7f62341425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6234155460 0x7f62340a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62340c4fe0 con 0x7f6220003980 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6234143520 con 0x7f6234146670 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623c022640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6234142f60 con 0x7f6234155460 2023-11-04T01:41:16.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f62341f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f62341f7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43164/0 (socket says 172.21.15.40:43164) 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 -- 172.21.15.40:0/1872602908 learned_addr learned my addr 172.21.15.40:0/1872602908 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f62395bd640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6234146670 0x7f62341425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f623a5bf640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6234155460 0x7f62340a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 -- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6234155460 msgr2=0x7f62340a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6234155460 0x7f62340a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 -- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6234146670 msgr2=0x7f62341425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6234146670 0x7f62341425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 -- 172.21.15.40:0/1872602908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623406c740 con 0x7f6220003980 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.859+0000 7f6239dbe640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f62341f7e10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6224009b10 tx=0x7f6224019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240a8d20 con 0x7f6220003980 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62240a8e80 con 0x7f6220003980 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240bc670 con 0x7f6220003980 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6234143240 con 0x7f6220003980 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62341f78f0 con 0x7f6220003980 2023-11-04T01:41:16.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62340744a0 con 0x7f6220003980 2023-11-04T01:41:16.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62240b0400 con 0x7f6220003980 2023-11-04T01:41:16.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f622a7fc640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62180664a0 0x7f6218068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f622411e3f0 con 0x7f6220003980 2023-11-04T01:41:16.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f62395bd640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62180664a0 0x7f6218068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.863+0000 7f62395bd640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62180664a0 0x7f6218068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6234146a90 tx=0x7f6230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:16.867+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62240eb810 con 0x7f6220003980 2023-11-04T01:41:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.023+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62340b13d0 con 0x7f6220003980 2023-11-04T01:41:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.023+0000 7f622a7fc640 1 -- 172.21.15.40:0/1872602908 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62240eee30 con 0x7f6220003980 2023-11-04T01:41:17.030 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62180664a0 msgr2=0x7f6218068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62180664a0 0x7f6218068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6234146a90 tx=0x7f6230009040 comp rx=0 tx=0).stop 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 msgr2=0x7f62341f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f62341f7e10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6224009b10 tx=0x7f6224019830 comp rx=0 tx=0).stop 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 shutdown_connections 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62180664a0 0x7f6218068960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6234155460 0x7f62340a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6234146670 0x7f62341425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 --2- 172.21.15.40:0/1872602908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6220003980 0x7f62341f7e10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 >> 172.21.15.40:0/1872602908 conn(0x7f62340cb510 msgr2=0x7f6234157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 shutdown_connections 2023-11-04T01:41:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.027+0000 7f623c022640 1 -- 172.21.15.40:0/1872602908 wait complete. 2023-11-04T01:41:17.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:17.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 Processor -- start 2023-11-04T01:41:17.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 -- start start 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37d815ae20 0x7f37d80ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f37d80cecc0 0x7f37d806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d80cbb30 con 0x7f37d80d18a0 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d80cbe10 con 0x7f37d815ae20 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37dddb1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d80cc0f0 con 0x7f37d80cecc0 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37d815ae20 0x7f37d80ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37d815ae20 0x7f37d80ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43174/0 (socket says 172.21.15.40:43174) 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 -- 172.21.15.40:0/3158720901 learned_addr learned my addr 172.21.15.40:0/3158720901 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d7fff640 1 --2- 172.21.15.40:0/3158720901 >> v2:172.21.15.91:3300/0 conn(0x7f37d80cecc0 0x7f37d806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 -- 172.21.15.40:0/3158720901 >> v2:172.21.15.91:3300/0 conn(0x7f37d80cecc0 msgr2=0x7f37d806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 --2- 172.21.15.40:0/3158720901 >> v2:172.21.15.91:3300/0 conn(0x7f37d80cecc0 0x7f37d806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 -- 172.21.15.40:0/3158720901 >> v1:172.21.15.91:6789/0 conn(0x7f37d80d18a0 legacy=0x7f37d80b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d77fe640 1 -- 172.21.15.40:0/3158720901 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d80cc3d0 con 0x7f37d815ae20 2023-11-04T01:41:17.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.159+0000 7f37d7fff640 1 --2- 172.21.15.40:0/3158720901 >> v2:172.21.15.91:3300/0 conn(0x7f37d80cecc0 0x7f37d806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37d77fe640 1 --2- 172.21.15.40:0/3158720901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80ce780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f37d80d0bd0 tx=0x7f37c801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba188759d85cfa18 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37d6ffd640 1 -- 172.21.15.40:0/3158720901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c80a89b0 con 0x7f37d815ae20 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37d6ffd640 1 -- 172.21.15.40:0/3158720901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c80a8b10 con 0x7f37d815ae20 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37d6ffd640 1 -- 172.21.15.40:0/3158720901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c80a8ea0 con 0x7f37d815ae20 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 -- 172.21.15.40:0/3158720901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 msgr2=0x7f37d80ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 --2- 172.21.15.40:0/3158720901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80ce780 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f37d80d0bd0 tx=0x7f37c801ecb0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 -- 172.21.15.40:0/3158720901 shutdown_connections 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 --2- 172.21.15.40:0/3158720901 >> v2:172.21.15.91:3300/0 conn(0x7f37d80cecc0 0x7f37d806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 --2- 172.21.15.40:0/3158720901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80ce780 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 -- 172.21.15.40:0/3158720901 >> 172.21.15.40:0/3158720901 conn(0x7f37d809a030 msgr2=0x7f37d80d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 -- 172.21.15.40:0/3158720901 shutdown_connections 2023-11-04T01:41:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 -- 172.21.15.40:0/3158720901 wait complete. 2023-11-04T01:41:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 Processor -- start 2023-11-04T01:41:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.163+0000 7f37dddb1640 1 -- start start 2023-11-04T01:41:17.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37d80cecc0 0x7f37d8158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37d80c5ac0 0x7f37d815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80c72c0 con 0x7f37d815ae20 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80b37d0 con 0x7f37d80cecc0 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80b3ab0 con 0x7f37d80c5ac0 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43178/0 (socket says 172.21.15.40:43178) 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 -- 172.21.15.40:0/1696964825 learned_addr learned my addr 172.21.15.40:0/1696964825 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d7fff640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37d80c5ac0 0x7f37d815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d77fe640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37d80cecc0 0x7f37d8158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 -- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37d80c5ac0 msgr2=0x7f37d815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37d80c5ac0 0x7f37d815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 -- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37d80cecc0 msgr2=0x7f37d8158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37d80cecc0 0x7f37d8158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 -- 172.21.15.40:0/1696964825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8009480 con 0x7f37d815ae20 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d7fff640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37d80c5ac0 0x7f37d815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37cffff640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80c6920 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f37c000c450 tx=0x7f37c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0012830 con 0x7f37d815ae20 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c00129b0 con 0x7f37d815ae20 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d80b3d90 con 0x7f37d815ae20 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0012d60 con 0x7f37d815ae20 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d8159240 con 0x7f37d815ae20 2023-11-04T01:41:17.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d80744a0 con 0x7f37d815ae20 2023-11-04T01:41:17.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37c001c460 con 0x7f37d815ae20 2023-11-04T01:41:17.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d4ff9640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f37b80664a0 0x7f37b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f37c0083db0 con 0x7f37d815ae20 2023-11-04T01:41:17.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.167+0000 7f37d77fe640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f37b80664a0 0x7f37b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.171+0000 7f37d77fe640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f37b80664a0 0x7f37b8068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f37c80b2000 tx=0x7f37c80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.171+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37c0051120 con 0x7f37d815ae20 2023-11-04T01:41:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37d8071ed0 con 0x7f37d815ae20 2023-11-04T01:41:17.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37d4ff9640 1 -- 172.21.15.40:0/1696964825 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37c0054740 con 0x7f37d815ae20 2023-11-04T01:41:17.327 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:41:17.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f37b80664a0 msgr2=0x7f37b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f37b80664a0 0x7f37b8068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f37c80b2000 tx=0x7f37c80aa070 comp rx=0 tx=0).stop 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 msgr2=0x7f37d80c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80c6920 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f37c000c450 tx=0x7f37c000c910 comp rx=0 tx=0).stop 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 shutdown_connections 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f37b80664a0 0x7f37b8068960 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37d80c5ac0 0x7f37d815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37d815ae20 0x7f37d80c6920 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 --2- 172.21.15.40:0/1696964825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37d80cecc0 0x7f37d8158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 >> 172.21.15.40:0/1696964825 conn(0x7f37d809a030 msgr2=0x7f37d80ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 shutdown_connections 2023-11-04T01:41:17.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.323+0000 7f37dddb1640 1 -- 172.21.15.40:0/1696964825 wait complete. 2023-11-04T01:41:17.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.455+0000 7fdeee06f640 1 Processor -- start 2023-11-04T01:41:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.455+0000 7fdeee06f640 1 -- start start 2023-11-04T01:41:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdeee06f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdee815af70 0x7fdee80cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdeee06f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 0x7fdee80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdeee06f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee806c0c0 con 0x7fdee806d160 2023-11-04T01:41:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdeee06f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee815e8e0 con 0x7fdee815af70 2023-11-04T01:41:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdeee06f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8071200 con 0x7fdee815e490 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdee806d160 0x7fdee815dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50374/0 (socket says 172.21.15.40:50374) 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee6ffd640 1 -- 172.21.15.40:0/1698930137 learned_addr learned my addr 172.21.15.40:0/1698930137 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 0x7fdee80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536273559 0 0) 0x7fdee806c0c0 con 0x7fdee806d160 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded4003530 con 0x7fdee806d160 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee77fe640 1 --2- 172.21.15.40:0/1698930137 >> v2:172.21.15.91:3300/0 conn(0x7fdee815af70 0x7fdee80cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4192757189 0 0) 0x7fded4003530 con 0x7fdee806d160 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 msgr2=0x7fdee80cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 0x7fdee80cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 >> v2:172.21.15.91:3300/0 conn(0x7fdee815af70 msgr2=0x7fdee80cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 --2- 172.21.15.40:0/1698930137 >> v2:172.21.15.91:3300/0 conn(0x7fdee815af70 0x7fdee80cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee806c3a0 con 0x7fdee806d160 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fded80016a0 con 0x7fdee806d160 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee77fe640 1 --2- 172.21.15.40:0/1698930137 >> v2:172.21.15.91:3300/0 conn(0x7fdee815af70 0x7fdee80cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 >> v1:172.21.15.40:6789/0 conn(0x7fdee806d160 legacy=0x7fdee815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 0x7fded40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4003f30 0x7fded40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded4004d10 0x7fded4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8071200 con 0x7fded4004d10 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded400b990 con 0x7fded4003f30 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded400bb50 con 0x7fdee815e490 2023-11-04T01:41:17.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded4004d10 0x7fded4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee77fe640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 0x7fded40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee6ffd640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4003f30 0x7fded40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 -- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 msgr2=0x7fded40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee815e490 0x7fded40039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 -- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4003f30 msgr2=0x7fded40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4003f30 0x7fded40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.459+0000 7fdee7fff640 1 -- 172.21.15.40:0/1698930137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4003530 con 0x7fded4004d10 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded4004d10 0x7fded4005190 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009fc0 tx=0x7fdee001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40257ab0389ecf45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a5c70 con 0x7fded4004d10 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee000f040 con 0x7fded4004d10 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee67fc640 1 -- 172.21.15.40:0/1698930137 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00ad440 con 0x7fded4004d10 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/1698930137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded4004d10 msgr2=0x7fded4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 --2- 172.21.15.40:0/1698930137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fded4004d10 0x7fded4005190 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009fc0 tx=0x7fdee001cc60 comp rx=0 tx=0).stop 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 -- 172.21.15.40:0/1698930137 reap_dead start 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/1698930137 shutdown_connections 2023-11-04T01:41:17.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/1698930137 >> 172.21.15.40:0/1698930137 conn(0x7fdee80cb510 msgr2=0x7fdee80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/1698930137 shutdown_connections 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/1698930137 wait complete. 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 Processor -- start 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- start start 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4004d10 0x7fdee80c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee80c2ed0 0x7fdee80c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 0x7fdee81f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80ce330 con 0x7fdee81efe80 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80cd7b0 con 0x7fded4004d10 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80cda90 con 0x7fdee80c2ed0 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 0x7fdee81f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 0x7fdee81f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55620/0 (socket says 172.21.15.40:55620) 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 -- 172.21.15.40:0/3393526043 learned_addr learned my addr 172.21.15.40:0/3393526043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee6ffd640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee80c2ed0 0x7fdee80c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 -- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee80c2ed0 msgr2=0x7fdee80c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee77fe640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4004d10 0x7fdee80c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee80c2ed0 0x7fdee80c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 -- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4004d10 msgr2=0x7fdee80c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4004d10 0x7fdee80c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 -- 172.21.15.40:0/3393526043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80cdd70 con 0x7fdee81efe80 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee6ffd640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee80c2ed0 0x7fdee80c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee77fe640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4004d10 0x7fdee80c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdee7fff640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 0x7fdee81f0300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b0040 tx=0x7fdee0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00bc070 con 0x7fdee81efe80 2023-11-04T01:41:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00039a0 con 0x7fdee81efe80 2023-11-04T01:41:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0003b30 con 0x7fdee81efe80 2023-11-04T01:41:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee80ce050 con 0x7fdee81efe80 2023-11-04T01:41:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.463+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee80cd430 con 0x7fdee81efe80 2023-11-04T01:41:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.467+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee80744a0 con 0x7fdee81efe80 2023-11-04T01:41:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.467+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdee00b4040 con 0x7fdee81efe80 2023-11-04T01:41:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.467+0000 7fdedffff640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdec80664a0 0x7fdec8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.467+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fdee011e1f0 con 0x7fdee81efe80 2023-11-04T01:41:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.467+0000 7fdee77fe640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdec80664a0 0x7fdec8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.467+0000 7fdee77fe640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdec80664a0 0x7fdec8068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fded000b9c0 tx=0x7fded0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.471+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdee00eb4f0 con 0x7fdee81efe80 2023-11-04T01:41:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.619+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fdee806b950 con 0x7fdee81efe80 2023-11-04T01:41:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.619+0000 7fdedffff640 1 -- 172.21.15.40:0/3393526043 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v36) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdee00b20a0 con 0x7fdee81efe80 2023-11-04T01:41:17.625 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:17.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdec80664a0 msgr2=0x7fdec8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdec80664a0 0x7fdec8068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fded000b9c0 tx=0x7fded0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:17.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 msgr2=0x7fdee81f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 0x7fdee81f0300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b0040 tx=0x7fdee0009750 comp rx=0 tx=0).stop 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 shutdown_connections 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdec80664a0 0x7fdec8068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdee81efe80 0x7fdee81f0300 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdee80c2ed0 0x7fdee80c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 --2- 172.21.15.40:0/3393526043 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fded4004d10 0x7fdee80c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 >> 172.21.15.40:0/3393526043 conn(0x7fdee80cb510 msgr2=0x7fdee81597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 shutdown_connections 2023-11-04T01:41:17.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.623+0000 7fdeee06f640 1 -- 172.21.15.40:0/3393526043 wait complete. 2023-11-04T01:41:17.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:17.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 Processor -- start 2023-11-04T01:41:17.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 -- start start 2023-11-04T01:41:17.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff12c0cdea0 0x7ff12c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff12c0ca400 0x7ff12c0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c0ccee0 con 0x7ff12c15a1f0 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c15a5d0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff130e69640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0ca900 con 0x7ff12c0ca400 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff12c0cdea0 0x7ff12c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff12c0cdea0 0x7ff12c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55622/0 (socket says 172.21.15.40:55622) 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 -- 172.21.15.40:0/3141709556 learned_addr learned my addr 172.21.15.40:0/3141709556 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff12ad9d640 1 --2- 172.21.15.40:0/3141709556 >> v2:172.21.15.91:3300/0 conn(0x7ff12c0ca400 0x7ff12c0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 -- 172.21.15.40:0/3141709556 >> v2:172.21.15.91:3300/0 conn(0x7ff12c0ca400 msgr2=0x7ff12c0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 --2- 172.21.15.40:0/3141709556 >> v2:172.21.15.91:3300/0 conn(0x7ff12c0ca400 0x7ff12c0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 -- 172.21.15.40:0/3141709556 >> v1:172.21.15.40:6789/0 conn(0x7ff12c15a1f0 legacy=0x7ff12c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 -- 172.21.15.40:0/3141709556 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0cabe0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff12ad9d640 1 --2- 172.21.15.40:0/3141709556 >> v2:172.21.15.91:3300/0 conn(0x7ff12c0ca400 0x7ff12c0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:17.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff129d9b640 1 --2- 172.21.15.40:0/3141709556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c0b0630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff12c06b820 tx=0x7ff12001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374e93aeb249f99e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff12959a640 1 -- 172.21.15.40:0/3141709556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200ab5f0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff12959a640 1 -- 172.21.15.40:0/3141709556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200ab750 con 0x7ff12c0cdea0 2023-11-04T01:41:17.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.751+0000 7ff12959a640 1 -- 172.21.15.40:0/3141709556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200abae0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/3141709556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 msgr2=0x7ff12c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 --2- 172.21.15.40:0/3141709556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c0b0630 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff12c06b820 tx=0x7ff12001c500 comp rx=0 tx=0).stop 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/3141709556 shutdown_connections 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 --2- 172.21.15.40:0/3141709556 >> v2:172.21.15.91:3300/0 conn(0x7ff12c0ca400 0x7ff12c0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 --2- 172.21.15.40:0/3141709556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c0b0630 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/3141709556 >> 172.21.15.40:0/3141709556 conn(0x7ff12c0cebb0 msgr2=0x7ff12c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/3141709556 shutdown_connections 2023-11-04T01:41:17.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/3141709556 wait complete. 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 Processor -- start 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- start start 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff12c0ca400 0x7ff12c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff12c15a1f0 0x7ff12c0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c1485a0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c2b90 con 0x7ff12c15a1f0 2023-11-04T01:41:17.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c39d0 con 0x7ff12c0ca400 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55628/0 (socket says 172.21.15.40:55628) 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 -- 172.21.15.40:0/2657147930 learned_addr learned my addr 172.21.15.40:0/2657147930 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 -- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff12c0ca400 msgr2=0x7ff12c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff12c0ca400 0x7ff12c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 -- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff12c15a1f0 msgr2=0x7ff12c0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff12c15a1f0 0x7ff12c0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 -- 172.21.15.40:0/2657147930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200094d0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff129d9b640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c148060 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ad040 tx=0x7ff12001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200b4800 con 0x7ff12c0cdea0 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200b4960 con 0x7ff12c0cdea0 2023-11-04T01:41:17.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200b4cf0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c0c3e60 con 0x7ff12c0cdea0 2023-11-04T01:41:17.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.755+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c0c30a0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.759+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c0744a0 con 0x7ff12c0cdea0 2023-11-04T01:41:17.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.759+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1200c7380 con 0x7ff12c0cdea0 2023-11-04T01:41:17.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.759+0000 7ff11affd640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff10c0664a0 0x7ff10c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.759+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6118+0+0 (secure 0 0 0) 0x7ff1200a8050 con 0x7ff12c0cdea0 2023-11-04T01:41:17.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.759+0000 7ff12a59c640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff10c0664a0 0x7ff10c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.759+0000 7ff12a59c640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff10c0664a0 0x7ff10c068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff11c007fd0 tx=0x7ff11c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.763+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff1200ebb10 con 0x7ff12c0cdea0 2023-11-04T01:41:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.943+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12c0c3b10 con 0x7ff12c0cdea0 2023-11-04T01:41:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff11affd640 1 -- 172.21.15.40:0/2657147930 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4912 (secure 0 0 0) 0x7ff1200ef130 con 0x7ff12c0cdea0 2023-11-04T01:41:17.951 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:17.951 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:01.346773+0000","modified":"2023-11-04T01:41:04.362535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3716931542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3716931542},{"type":"v1","addr":"172.21.15.40:6835","nonce":3716931542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 14 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff10c0664a0 msgr2=0x7ff10c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff10c0664a0 0x7ff10c068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff11c007fd0 tx=0x7ff11c007d40 comp rx=0 tx=0).stop 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 msgr2=0x7ff12c148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c148060 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ad040 tx=0x7ff12001ad40 comp rx=0 tx=0).stop 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 shutdown_connections 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff10c0664a0 0x7ff10c068960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff12c15a1f0 0x7ff12c0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c0cdea0 0x7ff12c148060 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 --2- 172.21.15.40:0/2657147930 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff12c0ca400 0x7ff12c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 >> 172.21.15.40:0/2657147930 conn(0x7ff12c0cebb0 msgr2=0x7ff12c0b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 shutdown_connections 2023-11-04T01:41:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:17.947+0000 7ff130e69640 1 -- 172.21.15.40:0/2657147930 wait complete. 2023-11-04T01:41:17.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:18.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 Processor -- start 2023-11-04T01:41:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 -- start start 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efdf80b0890 0x7efdf80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdf80c9960 0x7efdf80704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf80ce320 con 0x7efdf80b0c70 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf806d2f0 con 0x7efdf80c9960 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdff87a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf80ce110 con 0x7efdf80b0890 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdf80c9960 0x7efdf80704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdf80c9960 0x7efdf80704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55634/0 (socket says 172.21.15.40:55634) 2023-11-04T01:41:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfde17640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efdf80b0c70 0x7efdf80ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50390/0 (socket says 172.21.15.40:50390) 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 -- 172.21.15.40:0/377916463 learned_addr learned my addr 172.21.15.40:0/377916463 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfd616640 1 --2- 172.21.15.40:0/377916463 >> v2:172.21.15.91:3300/0 conn(0x7efdf80b0890 0x7efdf80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 -- 172.21.15.40:0/377916463 >> v2:172.21.15.91:3300/0 conn(0x7efdf80b0890 msgr2=0x7efdf80cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 --2- 172.21.15.40:0/377916463 >> v2:172.21.15.91:3300/0 conn(0x7efdf80b0890 0x7efdf80cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 -- 172.21.15.40:0/377916463 >> v1:172.21.15.40:6789/0 conn(0x7efdf80b0c70 legacy=0x7efdf80ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdeffff640 1 -- 172.21.15.40:0/377916463 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436245757 0 0) 0x7efdf80ce320 con 0x7efdf80b0c70 2023-11-04T01:41:18.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.087+0000 7efdfce15640 1 -- 172.21.15.40:0/377916463 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80ce600 con 0x7efdf80c9960 2023-11-04T01:41:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfce15640 1 --2- 172.21.15.40:0/377916463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80c9960 0x7efdf80704e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efdf806df00 tx=0x7efde801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241ddb7cb7f2cfd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdeffff640 1 -- 172.21.15.40:0/377916463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80aa430 con 0x7efdf80c9960 2023-11-04T01:41:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdeffff640 1 -- 172.21.15.40:0/377916463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80aa590 con 0x7efdf80c9960 2023-11-04T01:41:18.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdeffff640 1 -- 172.21.15.40:0/377916463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80aa920 con 0x7efdf80c9960 2023-11-04T01:41:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/377916463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80c9960 msgr2=0x7efdf80704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 --2- 172.21.15.40:0/377916463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80c9960 0x7efdf80704e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efdf806df00 tx=0x7efde801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/377916463 shutdown_connections 2023-11-04T01:41:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 --2- 172.21.15.40:0/377916463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80c9960 0x7efdf80704e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 --2- 172.21.15.40:0/377916463 >> v2:172.21.15.91:3300/0 conn(0x7efdf80b0890 0x7efdf80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/377916463 >> 172.21.15.40:0/377916463 conn(0x7efdf80cebb0 msgr2=0x7efdf80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/377916463 shutdown_connections 2023-11-04T01:41:18.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/377916463 wait complete. 2023-11-04T01:41:18.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 Processor -- start 2023-11-04T01:41:18.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- start start 2023-11-04T01:41:18.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 0x7efdf8151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdf80b0c70 0x7efdf8155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efdf80c9960 0x7efdf80c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8154de0 con 0x7efdf80b0890 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8153a70 con 0x7efdf80b0c70 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf81544b0 con 0x7efdf80c9960 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 0x7efdf8151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 0x7efdf8151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55650/0 (socket says 172.21.15.40:55650) 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 -- 172.21.15.40:0/3234855430 learned_addr learned my addr 172.21.15.40:0/3234855430 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfde17640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efdf80c9960 0x7efdf80c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfce15640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdf80b0c70 0x7efdf8155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 -- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efdf80c9960 msgr2=0x7efdf80c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efdf80c9960 0x7efdf80c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 -- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdf80b0c70 msgr2=0x7efdf8155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdf80b0c70 0x7efdf8155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 -- 172.21.15.40:0/3234855430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80094d0 con 0x7efdf80b0890 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdfd616640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 0x7efdf8151360 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efdf400d800 tx=0x7efdf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400b6c0 con 0x7efdf80b0890 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400b820 con 0x7efdf80b0890 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf8154790 con 0x7efdf80b0890 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400bb90 con 0x7efdf80b0890 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.091+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf8153700 con 0x7efdf80b0890 2023-11-04T01:41:18.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.095+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf80744a0 con 0x7efdf80b0890 2023-11-04T01:41:18.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.095+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efdf400bcf0 con 0x7efdf80b0890 2023-11-04T01:41:18.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.095+0000 7efdedffb640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efddc0664d0 0x7efddc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.095+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6090+0+0 (secure 0 0 0) 0x7efdf4084540 con 0x7efdf80b0890 2023-11-04T01:41:18.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.095+0000 7efdfce15640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efddc0664d0 0x7efddc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.095+0000 7efdfce15640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efddc0664d0 0x7efddc068990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efde80ae000 tx=0x7efde8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.099+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efdf4051830 con 0x7efdf80b0890 2023-11-04T01:41:18.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.255+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf80b4b30 con 0x7efdf80b0890 2023-11-04T01:41:18.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.259+0000 7efdedffb640 1 -- 172.21.15.40:0/3234855430 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18305 (secure 0 0 0) 0x7efdf4054e50 con 0x7efdf80b0890 2023-11-04T01:41:18.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:18.265 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":37,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:17.881918+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efddc0664d0 msgr2=0x7efddc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efddc0664d0 0x7efddc068990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efde80ae000 tx=0x7efde8008040 comp rx=0 tx=0).stop 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 msgr2=0x7efdf8151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 0x7efdf8151360 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efdf400d800 tx=0x7efdf400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 shutdown_connections 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efddc0664d0 0x7efddc068990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efdf80c9960 0x7efdf80c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efdf80b0c70 0x7efdf8155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 --2- 172.21.15.40:0/3234855430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf80b0890 0x7efdf8151360 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 >> 172.21.15.40:0/3234855430 conn(0x7efdf80cebb0 msgr2=0x7efdf815e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 shutdown_connections 2023-11-04T01:41:18.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.263+0000 7efdff87a640 1 -- 172.21.15.40:0/3234855430 wait complete. 2023-11-04T01:41:18.285 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:41:18.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:18.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.403+0000 7f05ba596640 1 Processor -- start 2023-11-04T01:41:18.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05ba596640 1 -- start start 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05ba596640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05b415afd0 0x7f05b40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05ba596640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b406f8f0 0x7f05b40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05ba596640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b40c2670 con 0x7f05b40b0b70 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05ba596640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b4070140 con 0x7f05b415afd0 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05ba596640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415fc90 con 0x7f05b406f8f0 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05b415afd0 0x7f05b40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05b415afd0 0x7f05b40715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55652/0 (socket says 172.21.15.40:55652) 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 -- 172.21.15.40:0/973444430 learned_addr learned my addr 172.21.15.40:0/973444430 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:18.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 -- 172.21.15.40:0/973444430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b406f8f0 msgr2=0x7f05b40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b37fe640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b406f8f0 0x7f05b40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b406f8f0 0x7f05b40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 -- 172.21.15.40:0/973444430 >> v1:172.21.15.91:6789/0 conn(0x7f05b40b0b70 legacy=0x7f05b40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 -- 172.21.15.40:0/973444430 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b406bc30 con 0x7f05b415afd0 2023-11-04T01:41:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b37fe640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b406f8f0 0x7f05b40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.407+0000 7f05b3fff640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b415afd0 0x7f05b40715d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009870 tx=0x7f05a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473a7df4855dd5d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b2ffd640 1 -- 172.21.15.40:0/973444430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40ab600 con 0x7f05b415afd0 2023-11-04T01:41:18.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b2ffd640 1 -- 172.21.15.40:0/973444430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a40a7050 con 0x7f05b415afd0 2023-11-04T01:41:18.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b2ffd640 1 -- 172.21.15.40:0/973444430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40ab980 con 0x7f05b415afd0 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/973444430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b415afd0 msgr2=0x7f05b40715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b415afd0 0x7f05b40715d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009870 tx=0x7f05a401c500 comp rx=0 tx=0).stop 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/973444430 shutdown_connections 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b406f8f0 0x7f05b40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 --2- 172.21.15.40:0/973444430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b415afd0 0x7f05b40715d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/973444430 >> 172.21.15.40:0/973444430 conn(0x7f05b40cebb0 msgr2=0x7f05b40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/973444430 shutdown_connections 2023-11-04T01:41:18.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/973444430 wait complete. 2023-11-04T01:41:18.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 Processor -- start 2023-11-04T01:41:18.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- start start 2023-11-04T01:41:18.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05b406f8f0 0x7f05b40c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 0x7f05b40b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b415afd0 0x7f05b4150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c40e0 con 0x7f05b40b0b70 2023-11-04T01:41:18.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40b3cf0 con 0x7f05b406f8f0 2023-11-04T01:41:18.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c34d0 con 0x7f05b415afd0 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 0x7f05b40b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 0x7f05b40b37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55664/0 (socket says 172.21.15.40:55664) 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 -- 172.21.15.40:0/839846199 learned_addr learned my addr 172.21.15.40:0/839846199 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b3fff640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05b406f8f0 0x7f05b40c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b8b33640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b415afd0 0x7f05b4150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 -- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b415afd0 msgr2=0x7f05b4150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b415afd0 0x7f05b4150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 -- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05b406f8f0 msgr2=0x7f05b40c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05b406f8f0 0x7f05b40c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 -- 172.21.15.40:0/839846199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40094d0 con 0x7f05b40b0b70 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b3fff640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05b406f8f0 0x7f05b40c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b37fe640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 0x7f05b40b37b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c7f0 tx=0x7f05a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8007820 con 0x7f05b40b0b70 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8007980 con 0x7f05b40b0b70 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b40c37b0 con 0x7f05b40b0b70 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8007d30 con 0x7f05b40b0b70 2023-11-04T01:41:18.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.411+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b40c3d70 con 0x7f05b40b0b70 2023-11-04T01:41:18.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.415+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b40744a0 con 0x7f05b40b0b70 2023-11-04T01:41:18.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.415+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05a80113f0 con 0x7f05b40b0b70 2023-11-04T01:41:18.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.415+0000 7f05b0ff9640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f05a00664d0 0x7f05a0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.415+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f05a80842a0 con 0x7f05b40b0b70 2023-11-04T01:41:18.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.415+0000 7f05b3fff640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f05a00664d0 0x7f05a0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.415+0000 7f05b3fff640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f05a00664d0 0x7f05a0068990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f05a40ad000 tx=0x7f05a40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.419+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05a80515b0 con 0x7f05b40b0b70 2023-11-04T01:41:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.607+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05b406cba0 con 0x7f05b40b0b70 2023-11-04T01:41:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05b0ff9640 1 -- 172.21.15.40:0/839846199 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f05a8054bd0 con 0x7f05b40b0b70 2023-11-04T01:41:18.615 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:18.615 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:01.346773+0000","modified":"2023-11-04T01:41:04.362535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3716931542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3716931542},{"type":"v1","addr":"172.21.15.40:6835","nonce":3716931542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 14 2023-11-04T01:41:18.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f05a00664d0 msgr2=0x7f05a0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f05a00664d0 0x7f05a0068990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f05a40ad000 tx=0x7f05a40a6000 comp rx=0 tx=0).stop 2023-11-04T01:41:18.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 msgr2=0x7f05b40b37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 0x7f05b40b37b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c7f0 tx=0x7f05a800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 shutdown_connections 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f05a00664d0 0x7f05a0068990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f05b415afd0 0x7f05b4150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05b40b0b70 0x7f05b40b37b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 --2- 172.21.15.40:0/839846199 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f05b406f8f0 0x7f05b40c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 >> 172.21.15.40:0/839846199 conn(0x7f05b40cebb0 msgr2=0x7f05b40cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 shutdown_connections 2023-11-04T01:41:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.611+0000 7f05ba596640 1 -- 172.21.15.40:0/839846199 wait complete. 2023-11-04T01:41:18.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.747+0000 7efd39a9b640 1 Processor -- start 2023-11-04T01:41:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.747+0000 7efd39a9b640 1 -- start start 2023-11-04T01:41:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd39a9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efd3415afd0 0x7efd340715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd39a9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd3406f8f0 0x7efd340b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd39a9b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340c2670 con 0x7efd340b0b70 2023-11-04T01:41:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd39a9b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd34070140 con 0x7efd3406f8f0 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd39a9b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3415fc90 con 0x7efd3415afd0 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd3406f8f0 0x7efd340b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd3406f8f0 0x7efd340b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55670/0 (socket says 172.21.15.40:55670) 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 -- 172.21.15.40:0/2946907929 learned_addr learned my addr 172.21.15.40:0/2946907929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd337fe640 1 --2- 172.21.15.40:0/2946907929 >> v2:172.21.15.91:3300/0 conn(0x7efd3415afd0 0x7efd340715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 -- 172.21.15.40:0/2946907929 >> v2:172.21.15.91:3300/0 conn(0x7efd3415afd0 msgr2=0x7efd340715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 --2- 172.21.15.40:0/2946907929 >> v2:172.21.15.91:3300/0 conn(0x7efd3415afd0 0x7efd340715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 -- 172.21.15.40:0/2946907929 >> v1:172.21.15.40:6789/0 conn(0x7efd340b0b70 legacy=0x7efd340c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 -- 172.21.15.40:0/2946907929 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3406bc30 con 0x7efd3406f8f0 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd327fc640 1 -- 172.21.15.40:0/2946907929 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174325032 0 0) 0x7efd340c2670 con 0x7efd340b0b70 2023-11-04T01:41:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd337fe640 1 --2- 172.21.15.40:0/2946907929 >> v2:172.21.15.91:3300/0 conn(0x7efd3415afd0 0x7efd340715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:18.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd32ffd640 1 --2- 172.21.15.40:0/2946907929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd3406f8f0 0x7efd340b0630 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efd340ce980 tx=0x7efd1c020910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc3fcb718f96631 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd327fc640 1 -- 172.21.15.40:0/2946907929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0ac460 con 0x7efd3406f8f0 2023-11-04T01:41:18.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd327fc640 1 -- 172.21.15.40:0/2946907929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c0ac5c0 con 0x7efd3406f8f0 2023-11-04T01:41:18.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.751+0000 7efd327fc640 1 -- 172.21.15.40:0/2946907929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0ac950 con 0x7efd3406f8f0 2023-11-04T01:41:18.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/2946907929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd3406f8f0 msgr2=0x7efd340b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 --2- 172.21.15.40:0/2946907929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd3406f8f0 0x7efd340b0630 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efd340ce980 tx=0x7efd1c020910 comp rx=0 tx=0).stop 2023-11-04T01:41:18.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/2946907929 shutdown_connections 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 --2- 172.21.15.40:0/2946907929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd3406f8f0 0x7efd340b0630 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 --2- 172.21.15.40:0/2946907929 >> v2:172.21.15.91:3300/0 conn(0x7efd3415afd0 0x7efd340715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/2946907929 >> 172.21.15.40:0/2946907929 conn(0x7efd340cebb0 msgr2=0x7efd340cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/2946907929 shutdown_connections 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/2946907929 wait complete. 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 Processor -- start 2023-11-04T01:41:18.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- start start 2023-11-04T01:41:18.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd3406f8f0 0x7efd340b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 0x7efd340cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd3415afd0 0x7efd34148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3415cd00 con 0x7efd340b0b70 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340b3fd0 con 0x7efd3415afd0 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3415b9c0 con 0x7efd3406f8f0 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 0x7efd340cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 0x7efd340cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55676/0 (socket says 172.21.15.40:55676) 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 -- 172.21.15.40:0/1845729042 learned_addr learned my addr 172.21.15.40:0/1845729042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd337fe640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd3406f8f0 0x7efd340b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd33fff640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd3415afd0 0x7efd34148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 -- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd3406f8f0 msgr2=0x7efd340b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd3406f8f0 0x7efd340b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 -- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd3415afd0 msgr2=0x7efd34148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd3415afd0 0x7efd34148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 -- 172.21.15.40:0/1845729042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c0094d0 con 0x7efd340b0b70 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd337fe640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd3406f8f0 0x7efd340b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd32ffd640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 0x7efd340cb7f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efd1c01e540 tx=0x7efd1c01d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0b48d0 con 0x7efd340b0b70 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c0b4a30 con 0x7efd340b0b70 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd340cbd30 con 0x7efd340b0b70 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0b4dc0 con 0x7efd340b0b70 2023-11-04T01:41:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.755+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3415b6e0 con 0x7efd340b0b70 2023-11-04T01:41:18.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.759+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd340744a0 con 0x7efd340b0b70 2023-11-04T01:41:18.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.759+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd1c0c9430 con 0x7efd340b0b70 2023-11-04T01:41:18.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.759+0000 7efd2bfff640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd180664a0 0x7efd18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.759+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6090+0+0 (secure 0 0 0) 0x7efd1c122bd0 con 0x7efd340b0b70 2023-11-04T01:41:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.759+0000 7efd337fe640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd180664a0 0x7efd18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.759+0000 7efd337fe640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd180664a0 0x7efd18068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00e550 tx=0x7efd2c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.763+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd1c122e60 con 0x7efd340b0b70 2023-11-04T01:41:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd3406cba0 con 0x7efd340b0b70 2023-11-04T01:41:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd2bfff640 1 -- 172.21.15.40:0/1845729042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4912 (secure 0 0 0) 0x7efd1c0f0070 con 0x7efd340b0b70 2023-11-04T01:41:18.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:18.947 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:01.346773+0000","modified":"2023-11-04T01:41:04.362535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5262":{"gid":5262,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3716931542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3716931542},{"type":"v1","addr":"172.21.15.40:6835","nonce":3716931542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:18.948 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 14 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd180664a0 msgr2=0x7efd18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd180664a0 0x7efd18068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00e550 tx=0x7efd2c007ab0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 msgr2=0x7efd340cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 0x7efd340cb7f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efd1c01e540 tx=0x7efd1c01d6b0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 shutdown_connections 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd180664a0 0x7efd18068960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd3415afd0 0x7efd34148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd340b0b70 0x7efd340cb7f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 --2- 172.21.15.40:0/1845729042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd3406f8f0 0x7efd340b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 >> 172.21.15.40:0/1845729042 conn(0x7efd340cebb0 msgr2=0x7efd34159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 shutdown_connections 2023-11-04T01:41:18.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:18.943+0000 7efd39a9b640 1 -- 172.21.15.40:0/1845729042 wait complete. 2023-11-04T01:41:18.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:19.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.079+0000 7ff8ec1b8640 1 Processor -- start 2023-11-04T01:41:19.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.079+0000 7ff8ec1b8640 1 -- start start 2023-11-04T01:41:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ec1b8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8e40b0890 0x7ff8e40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ec1b8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e40c9960 0x7ff8e40704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ec1b8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ec1b8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e406d2f0 con 0x7ff8e40c9960 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ec1b8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e40ce110 con 0x7ff8e40b0890 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ec1b8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40ce320 con 0x7ff8e40b0c70 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e40c9960 0x7ff8e40704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e40c9960 0x7ff8e40704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55688/0 (socket says 172.21.15.40:55688) 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 -- 172.21.15.40:0/2509028266 learned_addr learned my addr 172.21.15.40:0/2509028266 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8ea755640 1 --2- 172.21.15.40:0/2509028266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9f54640 1 --2- 172.21.15.40:0/2509028266 >> v2:172.21.15.91:3300/0 conn(0x7ff8e40b0890 0x7ff8e40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 -- 172.21.15.40:0/2509028266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 msgr2=0x7ff8e40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 --2- 172.21.15.40:0/2509028266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e40ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 -- 172.21.15.40:0/2509028266 >> v2:172.21.15.91:3300/0 conn(0x7ff8e40b0890 msgr2=0x7ff8e40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 --2- 172.21.15.40:0/2509028266 >> v2:172.21.15.91:3300/0 conn(0x7ff8e40b0890 0x7ff8e40cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 -- 172.21.15.40:0/2509028266 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40ce600 con 0x7ff8e40c9960 2023-11-04T01:41:19.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e9753640 1 --2- 172.21.15.40:0/2509028266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40c9960 0x7ff8e40704e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8e406df00 tx=0x7ff8d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90dfd8a26ccfb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.083+0000 7ff8e8f52640 1 -- 172.21.15.40:0/2509028266 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40aa610 con 0x7ff8e40c9960 2023-11-04T01:41:19.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e8f52640 1 -- 172.21.15.40:0/2509028266 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d40a6040 con 0x7ff8e40c9960 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e8f52640 1 -- 172.21.15.40:0/2509028266 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40aa990 con 0x7ff8e40c9960 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/2509028266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40c9960 msgr2=0x7ff8e40704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/2509028266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40c9960 0x7ff8e40704e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8e406df00 tx=0x7ff8d401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/2509028266 shutdown_connections 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/2509028266 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e40ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/2509028266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40c9960 0x7ff8e40704e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/2509028266 >> v2:172.21.15.91:3300/0 conn(0x7ff8e40b0890 0x7ff8e40cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/2509028266 >> 172.21.15.40:0/2509028266 conn(0x7ff8e40cebb0 msgr2=0x7ff8e40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/2509028266 shutdown_connections 2023-11-04T01:41:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/2509028266 wait complete. 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 Processor -- start 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- start start 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 0x7ff8e414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e40c9960 0x7ff8e40b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e4152ef0 con 0x7ff8e40b0890 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e414d6f0 con 0x7ff8e40c9960 2023-11-04T01:41:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e41522e0 con 0x7ff8e40b0c70 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 0x7ff8e414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 0x7ff8e414d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55696/0 (socket says 172.21.15.40:55696) 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 -- 172.21.15.40:0/130050677 learned_addr learned my addr 172.21.15.40:0/130050677 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9753640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ea755640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e40c9960 0x7ff8e40b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 -- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 msgr2=0x7ff8e4151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e4151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 -- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e40c9960 msgr2=0x7ff8e40b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e40c9960 0x7ff8e40b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 -- 172.21.15.40:0/130050677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40094d0 con 0x7ff8e40b0890 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8e9f54640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 0x7ff8e414d1b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000d800 tx=0x7ff8e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00096a0 con 0x7ff8e40b0890 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0009800 con 0x7ff8e40b0890 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e41525c0 con 0x7ff8e40b0890 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0009b70 con 0x7ff8e40b0890 2023-11-04T01:41:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.087+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e4152b80 con 0x7ff8e40b0890 2023-11-04T01:41:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.091+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e40caf40 con 0x7ff8e40b0890 2023-11-04T01:41:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.091+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8e0009cd0 con 0x7ff8e40b0890 2023-11-04T01:41:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.091+0000 7ff8da7fc640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c80664a0 0x7ff8c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.091+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff8e00846d0 con 0x7ff8e40b0890 2023-11-04T01:41:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.091+0000 7ff8e9753640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c80664a0 0x7ff8c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.091+0000 7ff8e9753640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c80664a0 0x7ff8c8068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40ae000 tx=0x7ff8d40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.095+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8e0051a60 con 0x7ff8e40b0890 2023-11-04T01:41:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.255+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e40744a0 con 0x7ff8e40b0890 2023-11-04T01:41:19.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.259+0000 7ff8da7fc640 1 -- 172.21.15.40:0/130050677 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18305 (secure 0 0 0) 0x7ff8e0055080 con 0x7ff8e40b0890 2023-11-04T01:41:19.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:19.264 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":37,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:17.881918+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:59.749221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:00.308826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:19.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c80664a0 msgr2=0x7ff8c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c80664a0 0x7ff8c8068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40ae000 tx=0x7ff8d40a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:19.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 msgr2=0x7ff8e414d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 0x7ff8e414d1b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000d800 tx=0x7ff8e000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 shutdown_connections 2023-11-04T01:41:19.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c80664a0 0x7ff8c8068960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e40c9960 0x7ff8e40b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e40b0c70 0x7ff8e4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 --2- 172.21.15.40:0/130050677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e40b0890 0x7ff8e414d1b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 >> 172.21.15.40:0/130050677 conn(0x7ff8e40cebb0 msgr2=0x7ff8e40cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 shutdown_connections 2023-11-04T01:41:19.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.263+0000 7ff8ec1b8640 1 -- 172.21.15.40:0/130050677 wait complete. 2023-11-04T01:41:19.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 Processor -- start 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 -- start start 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f149c159e70 0x7f149c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f149c0b1700 0x7f149c0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c070d90 con 0x7f149c06cd30 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c06dd90 con 0x7f149c0b1700 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.399+0000 7f14a08ff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0cefe0 con 0x7f149c159e70 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f149c0b1700 0x7f149c0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f149c0b1700 0x7f149c0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55704/0 (socket says 172.21.15.40:55704) 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 -- 172.21.15.40:0/2157214706 learned_addr learned my addr 172.21.15.40:0/2157214706 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149a59c640 1 --2- 172.21.15.40:0/2157214706 >> v2:172.21.15.91:3300/0 conn(0x7f149c159e70 0x7f149c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 -- 172.21.15.40:0/2157214706 >> v2:172.21.15.91:3300/0 conn(0x7f149c159e70 msgr2=0x7f149c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 --2- 172.21.15.40:0/2157214706 >> v2:172.21.15.91:3300/0 conn(0x7f149c159e70 0x7f149c0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 -- 172.21.15.40:0/2157214706 >> v1:172.21.15.91:6789/0 conn(0x7f149c06cd30 legacy=0x7f149c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 -- 172.21.15.40:0/2157214706 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c06d4f0 con 0x7f149c0b1700 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f149ad9d640 1 --2- 172.21.15.40:0/2157214706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c0b1b90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f149c0b2830 tx=0x7f149401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459fe5b7f2c6dd34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f1499d9b640 1 -- 172.21.15.40:0/2157214706 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14940a5780 con 0x7f149c0b1700 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f1499d9b640 1 -- 172.21.15.40:0/2157214706 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14940a58e0 con 0x7f149c0b1700 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f1499d9b640 1 -- 172.21.15.40:0/2157214706 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14940a5c70 con 0x7f149c0b1700 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 -- 172.21.15.40:0/2157214706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 msgr2=0x7f149c0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 --2- 172.21.15.40:0/2157214706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c0b1b90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f149c0b2830 tx=0x7f149401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 -- 172.21.15.40:0/2157214706 shutdown_connections 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 --2- 172.21.15.40:0/2157214706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c0b1b90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 --2- 172.21.15.40:0/2157214706 >> v2:172.21.15.91:3300/0 conn(0x7f149c159e70 0x7f149c0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 -- 172.21.15.40:0/2157214706 >> 172.21.15.40:0/2157214706 conn(0x7f149c06e760 msgr2=0x7f149c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 -- 172.21.15.40:0/2157214706 shutdown_connections 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.403+0000 7f14a08ff640 1 -- 172.21.15.40:0/2157214706 wait complete. 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 Processor -- start 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- start start 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f149c06cd30 0x7f149c164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c1f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f149c159e70 0x7f149c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0c5b80 con 0x7f149c0b1700 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c1f3f90 con 0x7f149c06cd30 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0c7d30 con 0x7f149c159e70 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c1f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c1f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55718/0 (socket says 172.21.15.40:55718) 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 -- 172.21.15.40:0/3086711286 learned_addr learned my addr 172.21.15.40:0/3086711286 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f149ad9d640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f149c159e70 0x7f149c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f149a59c640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f149c06cd30 0x7f149c164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 -- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f149c159e70 msgr2=0x7f149c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f149c159e70 0x7f149c14b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 -- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f149c06cd30 msgr2=0x7f149c164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f149c06cd30 0x7f149c164460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 -- 172.21.15.40:0/3086711286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494009b30 con 0x7f149c0b1700 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f1491d9b640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c1f3a50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f148400c3a0 tx=0x7f148400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840052d0 con 0x7f149c0b1700 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484005430 con 0x7f149c0b1700 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c0c8010 con 0x7f149c0b1700 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484007260 con 0x7f149c0b1700 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c0c85d0 con 0x7f149c0b1700 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.407+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c0675f0 con 0x7f149c0b1700 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.411+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f14840073c0 con 0x7f149c0b1700 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.411+0000 7f14937fe640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f147c0664a0 0x7f147c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.411+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f14840833d0 con 0x7f149c0b1700 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.411+0000 7f149a59c640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f147c0664a0 0x7f147c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.411+0000 7f149a59c640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f147c0664a0 0x7f147c068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b9d0 tx=0x7f148c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.415+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14840506d0 con 0x7f149c0b1700 2023-11-04T01:41:19.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.603+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f149c0b2350 con 0x7f149c0b1700 2023-11-04T01:41:19.609 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:41:19.603+0000 7fde30135640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:41:19.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.607+0000 7f14937fe640 1 -- 172.21.15.40:0/3086711286 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1484053cf0 con 0x7f149c0b1700 2023-11-04T01:41:19.613 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:41:19.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f147c0664a0 msgr2=0x7f147c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f147c0664a0 0x7f147c068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b9d0 tx=0x7f148c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:19.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 msgr2=0x7f149c1f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c1f3a50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f148400c3a0 tx=0x7f148400c860 comp rx=0 tx=0).stop 2023-11-04T01:41:19.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 shutdown_connections 2023-11-04T01:41:19.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f147c0664a0 0x7f147c068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f149c159e70 0x7f149c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149c0b1700 0x7f149c1f3a50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 --2- 172.21.15.40:0/3086711286 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f149c06cd30 0x7f149c164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 >> 172.21.15.40:0/3086711286 conn(0x7f149c06e760 msgr2=0x7f149c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 shutdown_connections 2023-11-04T01:41:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.611+0000 7f14a08ff640 1 -- 172.21.15.40:0/3086711286 wait complete. 2023-11-04T01:41:19.622 INFO:tasks.ceph.mds.c.smithi040.stderr: -678> 2023-11-04T01:41:06.923+0000 7efec756d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:19.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:41:19.660 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:41:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc73803f640 1 Processor -- start 2023-11-04T01:41:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc73803f640 1 -- start start 2023-11-04T01:41:19.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc73803f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc73006de30 0x7fc7300719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc73803f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300cdb70 con 0x7fc730159f00 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc73803f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300cde50 con 0x7fc730071250 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc73803f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73015a2e0 con 0x7fc73006de30 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc735ddb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc730159f00 0x7fc730070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50404/0 (socket says 172.21.15.40:50404) 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc735ddb640 1 -- 172.21.15.40:0/1461020928 learned_addr learned my addr 172.21.15.40:0/1461020928 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc7355da640 1 --2- 172.21.15.40:0/1461020928 >> v2:172.21.15.40:3300/0 conn(0x7fc73006de30 0x7fc7300719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc734dd9640 1 -- 172.21.15.40:0/1461020928 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639148128 0 0) 0x7fc7300cdb70 con 0x7fc730159f00 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc734dd9640 1 -- 172.21.15.40:0/1461020928 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc71c003530 con 0x7fc730159f00 2023-11-04T01:41:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc7355da640 1 -- 172.21.15.40:0/1461020928 >> v1:172.21.15.91:6789/0 conn(0x7fc730071250 legacy=0x7fc7300ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc7355da640 1 -- 172.21.15.40:0/1461020928 >> v1:172.21.15.40:6789/0 conn(0x7fc730159f00 legacy=0x7fc730070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.751+0000 7fc7355da640 1 -- 172.21.15.40:0/1461020928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73015e4f0 con 0x7fc73006de30 2023-11-04T01:41:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc7355da640 1 --2- 172.21.15.40:0/1461020928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc73006de30 0x7fc7300719e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc7200097c0 tx=0x7fc72001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6cafa02b4b5aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc734dd9640 1 -- 172.21.15.40:0/1461020928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200ab600 con 0x7fc73006de30 2023-11-04T01:41:19.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc734dd9640 1 -- 172.21.15.40:0/1461020928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7200a7050 con 0x7fc73006de30 2023-11-04T01:41:19.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc734dd9640 1 -- 172.21.15.40:0/1461020928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200ab960 con 0x7fc73006de30 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 -- 172.21.15.40:0/1461020928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc73006de30 msgr2=0x7fc7300719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 --2- 172.21.15.40:0/1461020928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc73006de30 0x7fc7300719e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc7200097c0 tx=0x7fc72001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 -- 172.21.15.40:0/1461020928 shutdown_connections 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 --2- 172.21.15.40:0/1461020928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc73006de30 0x7fc7300719e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 -- 172.21.15.40:0/1461020928 >> 172.21.15.40:0/1461020928 conn(0x7fc7300cfc70 msgr2=0x7fc7300d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 -- 172.21.15.40:0/1461020928 shutdown_connections 2023-11-04T01:41:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 -- 172.21.15.40:0/1461020928 wait complete. 2023-11-04T01:41:19.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 Processor -- start 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.755+0000 7fc73803f640 1 -- start start 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc730071250 0x7fc7300b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc730159f00 0x7fc730158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 0x7fc7300b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300b0970 con 0x7fc7300affa0 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301594e0 con 0x7fc730159f00 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301f68b0 con 0x7fc730071250 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 0x7fc7300b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 0x7fc7300b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55752/0 (socket says 172.21.15.40:55752) 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 -- 172.21.15.40:0/791661710 learned_addr learned my addr 172.21.15.40:0/791661710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc735ddb640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc730071250 0x7fc7300b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7355da640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc730159f00 0x7fc730158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 -- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc730071250 msgr2=0x7fc7300b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc730071250 0x7fc7300b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 -- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc730159f00 msgr2=0x7fc730158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc730159f00 0x7fc730158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 -- 172.21.15.40:0/791661710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720009420 con 0x7fc7300affa0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7365dc640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 0x7fc7300b0430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c430 tx=0x7fc72c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0052d0 con 0x7fc7300affa0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c005430 con 0x7fc7300affa0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c003800 con 0x7fc7300affa0 2023-11-04T01:41:19.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7300b4010 con 0x7fc7300affa0 2023-11-04T01:41:19.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7300b45d0 con 0x7fc7300affa0 2023-11-04T01:41:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7300675f0 con 0x7fc7300affa0 2023-11-04T01:41:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc72c003960 con 0x7fc7300affa0 2023-11-04T01:41:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7267fc640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7140664d0 0x7fc714068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc72c0834c0 con 0x7fc7300affa0 2023-11-04T01:41:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.759+0000 7fc735ddb640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7140664d0 0x7fc714068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.763+0000 7fc735ddb640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7140664d0 0x7fc714068990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc728001570 tx=0x7fc728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.763+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc72c050790 con 0x7fc7300affa0 2023-11-04T01:41:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:19.951+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc7300d0790 con 0x7fc7300affa0 2023-11-04T01:41:20.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.619+0000 7fc7267fc640 1 -- 172.21.15.40:0/791661710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc72c053db0 con 0x7fc7300affa0 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7140664d0 msgr2=0x7fc714068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7140664d0 0x7fc714068990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc728001570 tx=0x7fc728009040 comp rx=0 tx=0).stop 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 msgr2=0x7fc7300b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 0x7fc7300b0430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c430 tx=0x7fc72c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 shutdown_connections 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7140664d0 0x7fc714068990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300affa0 0x7fc7300b0430 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc730159f00 0x7fc730158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 --2- 172.21.15.40:0/791661710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc730071250 0x7fc7300b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 >> 172.21.15.40:0/791661710 conn(0x7fc7300cfc70 msgr2=0x7fc7300b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 shutdown_connections 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.623+0000 7fc73803f640 1 -- 172.21.15.40:0/791661710 wait complete. 2023-11-04T01:41:20.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:41:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 Processor -- start 2023-11-04T01:41:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 -- start start 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87f015ae60 0x7f87f00cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f015ea00 con 0x7f87f006b320 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f015b240 con 0x7f87f015ae60 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87f5005640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f006cda0 con 0x7f87f00ca440 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87eed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87f015ae60 0x7f87f00cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87ef59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f87f006b320 0x7f87f006b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50414/0 (socket says 172.21.15.40:50414) 2023-11-04T01:41:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87ef59e640 1 -- 172.21.15.40:0/3889619997 learned_addr learned my addr 172.21.15.40:0/3889619997 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87ee59c640 1 --2- 172.21.15.40:0/3889619997 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87eed9d640 1 -- 172.21.15.40:0/3889619997 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 msgr2=0x7f87f015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87eed9d640 1 --2- 172.21.15.40:0/3889619997 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87eed9d640 1 -- 172.21.15.40:0/3889619997 >> v1:172.21.15.40:6789/0 conn(0x7f87f006b320 legacy=0x7f87f006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87edd9b640 1 -- 172.21.15.40:0/3889619997 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240371864 0 0) 0x7f87f015ea00 con 0x7f87f006b320 2023-11-04T01:41:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.823+0000 7f87eed9d640 1 -- 172.21.15.40:0/3889619997 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f006d080 con 0x7f87f015ae60 2023-11-04T01:41:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87eed9d640 1 --2- 172.21.15.40:0/3889619997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cab10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f87e00097c0 tx=0x7f87e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbca55fa12b61b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87edd9b640 1 -- 172.21.15.40:0/3889619997 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00ab670 con 0x7f87f015ae60 2023-11-04T01:41:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87edd9b640 1 -- 172.21.15.40:0/3889619997 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00ab7d0 con 0x7f87f015ae60 2023-11-04T01:41:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87edd9b640 1 -- 172.21.15.40:0/3889619997 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00abb60 con 0x7f87f015ae60 2023-11-04T01:41:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 -- 172.21.15.40:0/3889619997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 msgr2=0x7f87f00cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 --2- 172.21.15.40:0/3889619997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cab10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f87e00097c0 tx=0x7f87e001c450 comp rx=0 tx=0).stop 2023-11-04T01:41:20.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 -- 172.21.15.40:0/3889619997 shutdown_connections 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 --2- 172.21.15.40:0/3889619997 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 --2- 172.21.15.40:0/3889619997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cab10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 -- 172.21.15.40:0/3889619997 >> 172.21.15.40:0/3889619997 conn(0x7f87f00b0630 msgr2=0x7f87f00b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 -- 172.21.15.40:0/3889619997 shutdown_connections 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 -- 172.21.15.40:0/3889619997 wait complete. 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.827+0000 7f87f5005640 1 Processor -- start 2023-11-04T01:41:20.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- start start 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87f006b320 0x7f87f014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f01f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0163e60 con 0x7f87f015ae60 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f014ec20 con 0x7f87f006b320 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01f6110 con 0x7f87f00ca440 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55766/0 (socket says 172.21.15.40:55766) 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 -- 172.21.15.40:0/2109183952 learned_addr learned my addr 172.21.15.40:0/2109183952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ee59c640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f01f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87eed9d640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87f006b320 0x7f87f014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 -- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 msgr2=0x7f87f01f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f01f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 -- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87f006b320 msgr2=0x7f87f014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87f006b320 0x7f87f014e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 -- 172.21.15.40:0/2109183952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0009420 con 0x7f87f015ae60 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87eed9d640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87f006b320 0x7f87f014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87ef59e640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cd7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c4a0 tx=0x7f87e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80074e0 con 0x7f87f015ae60 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8007640 con 0x7f87f015ae60 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8004a30 con 0x7f87f015ae60 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f00cce20 con 0x7f87f015ae60 2023-11-04T01:41:20.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f00cd3a0 con 0x7f87f015ae60 2023-11-04T01:41:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00cd590 con 0x7f87f015ae60 2023-11-04T01:41:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87e8004b90 con 0x7f87f015ae60 2023-11-04T01:41:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87d77fe640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87dc0664a0 0x7f87dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.831+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f87e8083150 con 0x7f87f015ae60 2023-11-04T01:41:20.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.835+0000 7f87eed9d640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87dc0664a0 0x7f87dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.835+0000 7f87eed9d640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87dc0664a0 0x7f87dc068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f87e00af000 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.839+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87e80504a0 con 0x7f87f015ae60 2023-11-04T01:41:21.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:20.995+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87f0074500 con 0x7f87f015ae60 2023-11-04T01:41:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.623+0000 7f87d77fe640 1 -- 172.21.15.40:0/2109183952 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f87e8053ac0 con 0x7f87f015ae60 2023-11-04T01:41:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:41:21.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87dc0664a0 msgr2=0x7f87dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87dc0664a0 0x7f87dc068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f87e00af000 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 msgr2=0x7f87f00cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cd7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c4a0 tx=0x7f87e800c960 comp rx=0 tx=0).stop 2023-11-04T01:41:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 shutdown_connections 2023-11-04T01:41:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87dc0664a0 0x7f87dc068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f015ae60 0x7f87f00cd7b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87f00ca440 0x7f87f01f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 --2- 172.21.15.40:0/2109183952 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87f006b320 0x7f87f014e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 >> 172.21.15.40:0/2109183952 conn(0x7f87f00b0630 msgr2=0x7f87f00c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 shutdown_connections 2023-11-04T01:41:21.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.627+0000 7f87f5005640 1 -- 172.21.15.40:0/2109183952 wait complete. 2023-11-04T01:41:21.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:41:21.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aaff78640 1 Processor -- start 2023-11-04T01:41:21.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aaff78640 1 -- start start 2023-11-04T01:41:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aaff78640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 0x7f8aa81617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aaff78640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa8161d20 con 0x7f8aa80ce420 2023-11-04T01:41:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aaff78640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa815dbc0 con 0x7f8aa815e050 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aaff78640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80cba40 con 0x7f8aa80cb5c0 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aadd14640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8aa80ce420 0x7f8aa80ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50418/0 (socket says 172.21.15.40:50418) 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aadd14640 1 -- 172.21.15.40:0/4103153080 learned_addr learned my addr 172.21.15.40:0/4103153080 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059333593 0 0) 0x7f8aa8161d20 con 0x7f8aa80ce420 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 0x7f8aa81617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a94003530 con 0x7f8aa80ce420 2023-11-04T01:41:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 524656474 0 0) 0x7f8a94003530 con 0x7f8aa80ce420 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 msgr2=0x7f8aa81617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 0x7f8aa81617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 >> v1:172.21.15.91:6789/0 conn(0x7f8aa815e050 legacy=0x7f8aa806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80c99f0 con 0x7f8aa80ce420 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8aa0001680 con 0x7f8aa80ce420 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 >> v1:172.21.15.40:6789/0 conn(0x7f8aa80ce420 legacy=0x7f8aa80ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940039b0 0x7f8a94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a940047d0 0x7f8a94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 0x7f8a94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80cba40 con 0x7f8a940047d0 2023-11-04T01:41:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9400baa0 con 0x7f8a940039b0 2023-11-04T01:41:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9400bc60 con 0x7f8aa80cb5c0 2023-11-04T01:41:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a940047d0 0x7f8a94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aadd14640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940039b0 0x7f8a94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 -- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 msgr2=0x7f8a94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aae515640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 0x7f8a94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80cb5c0 0x7f8a94005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 -- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940039b0 msgr2=0x7f8a94003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940039b0 0x7f8a94003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aad513640 1 -- 172.21.15.40:0/4103153080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94003530 con 0x7f8a940047d0 2023-11-04T01:41:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.779+0000 7f8aadd14640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940039b0 0x7f8a94003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aad513640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a940047d0 0x7f8a94004c50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009ab0 tx=0x7f8a9801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8004b3ece97056b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a980a5600 con 0x7f8a940047d0 2023-11-04T01:41:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a980a5760 con 0x7f8a940047d0 2023-11-04T01:41:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aacd12640 1 -- 172.21.15.40:0/4103153080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a980a5b10 con 0x7f8a940047d0 2023-11-04T01:41:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 -- 172.21.15.40:0/4103153080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a940047d0 msgr2=0x7f8a94004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 --2- 172.21.15.40:0/4103153080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a940047d0 0x7f8a94004c50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009ab0 tx=0x7f8a9801ca10 comp rx=0 tx=0).stop 2023-11-04T01:41:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aae515640 1 -- 172.21.15.40:0/4103153080 reap_dead start 2023-11-04T01:41:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 -- 172.21.15.40:0/4103153080 shutdown_connections 2023-11-04T01:41:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 -- 172.21.15.40:0/4103153080 >> 172.21.15.40:0/4103153080 conn(0x7f8aa80cbd80 msgr2=0x7f8aa80cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 -- 172.21.15.40:0/4103153080 shutdown_connections 2023-11-04T01:41:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 -- 172.21.15.40:0/4103153080 wait complete. 2023-11-04T01:41:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.783+0000 7f8aaff78640 1 Processor -- start 2023-11-04T01:41:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- start start 2023-11-04T01:41:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940047d0 0x7f8aa80b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80b4ad0 0x7f8aa80c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 0x7f8aa8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80b4f50 con 0x7f8aa80c8df0 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8071e00 con 0x7f8a940047d0 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80b4020 con 0x7f8aa80b4ad0 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 0x7f8aa8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 0x7f8aa8070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55784/0 (socket says 172.21.15.40:55784) 2023-11-04T01:41:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 -- 172.21.15.40:0/537716504 learned_addr learned my addr 172.21.15.40:0/537716504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aad513640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80b4ad0 0x7f8aa80c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aadd14640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940047d0 0x7f8aa80b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 -- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80b4ad0 msgr2=0x7f8aa80c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80b4ad0 0x7f8aa80c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 -- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940047d0 msgr2=0x7f8aa80b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940047d0 0x7f8aa80b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 -- 172.21.15.40:0/537716504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80711f0 con 0x7f8aa80c8df0 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aadd14640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940047d0 0x7f8aa80b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aad513640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80b4ad0 0x7f8aa80c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aae515640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 0x7f8aa8070480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8aa815e430 tx=0x7f8aa400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003b80 con 0x7f8aa80c8df0 2023-11-04T01:41:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4003ce0 con 0x7f8aa80c8df0 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa80714d0 con 0x7f8aa80c8df0 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4005270 con 0x7f8aa80c8df0 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa8071a90 con 0x7f8aa80c8df0 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa80b2a90 con 0x7f8aa80c8df0 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8aa40053d0 con 0x7f8aa80c8df0 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8a9e7fc640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8a8c0664a0 0x7f8a8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f8aa4083690 con 0x7f8aa80c8df0 2023-11-04T01:41:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.787+0000 7f8aadd14640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8a8c0664a0 0x7f8a8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.791+0000 7f8aadd14640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8a8c0664a0 0x7f8a8c068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0004880 tx=0x7f8aa00051b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.791+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8aa80b2a90 con 0x7f8aa80c8df0 2023-11-04T01:41:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:21.951+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8aa80b2a90 con 0x7f8aa80c8df0 2023-11-04T01:41:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.635+0000 7f8a9e7fc640 1 -- 172.21.15.40:0/537716504 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8aa80b2a90 con 0x7f8aa80c8df0 2023-11-04T01:41:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-11-04T01:41:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8a8c0664a0 msgr2=0x7f8a8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8a8c0664a0 0x7f8a8c068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0004880 tx=0x7f8aa00051b0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 msgr2=0x7f8aa8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 0x7f8aa8070480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8aa815e430 tx=0x7f8aa400dc00 comp rx=0 tx=0).stop 2023-11-04T01:41:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 shutdown_connections 2023-11-04T01:41:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8a8c0664a0 0x7f8a8c068960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8df0 0x7f8aa8070480 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8aa80b4ad0 0x7f8aa80c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 --2- 172.21.15.40:0/537716504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8a940047d0 0x7f8aa80b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 >> 172.21.15.40:0/537716504 conn(0x7f8aa80cbd80 msgr2=0x7f8aa81e3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 shutdown_connections 2023-11-04T01:41:22.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.639+0000 7f8aaff78640 1 -- 172.21.15.40:0/537716504 wait complete. 2023-11-04T01:41:22.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:41:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6af265640 1 Processor -- start 2023-11-04T01:41:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6af265640 1 -- start start 2023-11-04T01:41:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6af265640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe6a80ca0a0 0x7fe6a806a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6af265640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a80cba30 con 0x7fe6a80ca550 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6af265640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a8071e90 con 0x7fe6a815ae60 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6af265640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a8072170 con 0x7fe6a80ca0a0 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6ad802640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe6a80ca550 0x7fe6a806ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50428/0 (socket says 172.21.15.40:50428) 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6ad802640 1 -- 172.21.15.40:0/3983002454 learned_addr learned my addr 172.21.15.40:0/3983002454 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416833456 0 0) 0x7fe6a80cba30 con 0x7fe6a80ca550 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe694003530 con 0x7fe6a80ca550 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6ac800640 1 --2- 172.21.15.40:0/3983002454 >> v2:172.21.15.91:3300/0 conn(0x7fe6a80ca0a0 0x7fe6a806a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270715337 0 0) 0x7fe694003530 con 0x7fe6a80ca550 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 >> v2:172.21.15.91:3300/0 conn(0x7fe6a80ca0a0 msgr2=0x7fe6a806a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 --2- 172.21.15.40:0/3983002454 >> v2:172.21.15.91:3300/0 conn(0x7fe6a80ca0a0 0x7fe6a806a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 >> v1:172.21.15.91:6789/0 conn(0x7fe6a815ae60 legacy=0x7fe6a80c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8072450 con 0x7fe6a80ca550 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fe6a4001680 con 0x7fe6a80ca550 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 >> v1:172.21.15.40:6789/0 conn(0x7fe6a80ca550 legacy=0x7fe6a806ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6940039d0 0x7fe694003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe694004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6940051e0 0x7fe69400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8072170 con 0x7fe6940047d0 2023-11-04T01:41:22.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69400c130 con 0x7fe6940039d0 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69400c2f0 con 0x7fe6940051e0 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6ac800640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe694004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.787+0000 7fe6ad001640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6940039d0 0x7fe694003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ad802640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6940051e0 0x7fe69400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ac800640 1 -- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6940051e0 msgr2=0x7fe69400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ac800640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6940051e0 0x7fe69400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ac800640 1 -- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6940039d0 msgr2=0x7fe694003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ac800640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6940039d0 0x7fe694003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ad802640 1 -- 172.21.15.40:0/3983002454 reap_dead start 2023-11-04T01:41:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ac800640 1 -- 172.21.15.40:0/3983002454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694003530 con 0x7fe6940047d0 2023-11-04T01:41:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ad001640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6940039d0 0x7fe694003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6ac800640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe694004c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe69800ba30 tx=0x7fe69801c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c7efee5193c401 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6980ab630 con 0x7fe6940047d0 2023-11-04T01:41:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6980ab790 con 0x7fe6940047d0 2023-11-04T01:41:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe69ffff640 1 -- 172.21.15.40:0/3983002454 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6980abb40 con 0x7fe6940047d0 2023-11-04T01:41:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 -- 172.21.15.40:0/3983002454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 msgr2=0x7fe694004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe694004c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe69800ba30 tx=0x7fe69801c620 comp rx=0 tx=0).stop 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 -- 172.21.15.40:0/3983002454 shutdown_connections 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 --2- 172.21.15.40:0/3983002454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe694004c50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 -- 172.21.15.40:0/3983002454 >> 172.21.15.40:0/3983002454 conn(0x7fe6a80b0e30 msgr2=0x7fe6a80b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 -- 172.21.15.40:0/3983002454 shutdown_connections 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.791+0000 7fe6af265640 1 -- 172.21.15.40:0/3983002454 wait complete. 2023-11-04T01:41:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 Processor -- start 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- start start 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe6a80c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6a81552e0 0x7fe6a815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6a81f42a0 0x7fe6a81f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80c6780 con 0x7fe6940047d0 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8155040 con 0x7fe6a81552e0 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a80c2cd0 con 0x7fe6a81f42a0 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe6a80c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe6a80c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55802/0 (socket says 172.21.15.40:55802) 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 -- 172.21.15.40:0/2104112000 learned_addr learned my addr 172.21.15.40:0/2104112000 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad802640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6a81f42a0 0x7fe6a81f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ac800640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6a81552e0 0x7fe6a815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 -- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6a81f42a0 msgr2=0x7fe6a81f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6a81f42a0 0x7fe6a81f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 -- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6a81552e0 msgr2=0x7fe6a815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6a81552e0 0x7fe6a815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 -- 172.21.15.40:0/2104112000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80c2fb0 con 0x7fe6940047d0 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad802640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6a81f42a0 0x7fe6a81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6ad001640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe6a80c8f60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000e7b0 tx=0x7fe6a000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0003b90 con 0x7fe6940047d0 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a0003cf0 con 0x7fe6940047d0 2023-11-04T01:41:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a80c3290 con 0x7fe6940047d0 2023-11-04T01:41:22.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00052f0 con 0x7fe6940047d0 2023-11-04T01:41:22.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a815cfd0 con 0x7fe6940047d0 2023-11-04T01:41:22.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.795+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a81556c0 con 0x7fe6940047d0 2023-11-04T01:41:22.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.799+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6a0005450 con 0x7fe6940047d0 2023-11-04T01:41:22.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.799+0000 7fe69dffb640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe68c0664a0 0x7fe68c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.799+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe6a0084570 con 0x7fe6940047d0 2023-11-04T01:41:22.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.799+0000 7fe6ac800640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe68c0664a0 0x7fe68c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.799+0000 7fe6ac800640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe68c0664a0 0x7fe68c068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe6980af000 tx=0x7fe6980b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.803+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6a0051c90 con 0x7fe6940047d0 2023-11-04T01:41:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.959+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe6a81556c0 con 0x7fe6940047d0 2023-11-04T01:41:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe69dffb640 1 -- 172.21.15.40:0/2104112000 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe6a81556c0 con 0x7fe6940047d0 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe68c0664a0 msgr2=0x7fe68c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe68c0664a0 0x7fe68c068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe6980af000 tx=0x7fe6980b6040 comp rx=0 tx=0).stop 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 msgr2=0x7fe6a80c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe6a80c8f60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000e7b0 tx=0x7fe6a000ec70 comp rx=0 tx=0).stop 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 shutdown_connections 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe68c0664a0 0x7fe68c068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe6a81f42a0 0x7fe6a81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe6a81552e0 0x7fe6a815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 --2- 172.21.15.40:0/2104112000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6940047d0 0x7fe6a80c8f60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 >> 172.21.15.40:0/2104112000 conn(0x7fe6a80b0e30 msgr2=0x7fe6a8159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 shutdown_connections 2023-11-04T01:41:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:22.967+0000 7fe6af265640 1 -- 172.21.15.40:0/2104112000 wait complete. 2023-11-04T01:41:22.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:41:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 Processor -- start 2023-11-04T01:41:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 -- start start 2023-11-04T01:41:23.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8ac15d100 0x7fa8ac0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8ac06bbc0 0x7fa8ac160c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac15d4e0 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c9bd0 con 0x7fa8ac15d100 2023-11-04T01:41:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8b247e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0ca5a0 con 0x7fa8ac06bbc0 2023-11-04T01:41:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.115+0000 7fa8abfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8ac15d100 0x7fa8ac0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8ac15d100 0x7fa8ac0ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55816/0 (socket says 172.21.15.40:55816) 2023-11-04T01:41:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 -- 172.21.15.40:0/3336734374 learned_addr learned my addr 172.21.15.40:0/3336734374 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8a3fff640 1 --1- 172.21.15.40:0/3336734374 >> v1:172.21.15.40:6789/0 conn(0x7fa8ac0ad2d0 0x7fa8ac06b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50440/0 (socket says 172.21.15.40:50440) 2023-11-04T01:41:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8b0a1b640 1 --2- 172.21.15.40:0/3336734374 >> v2:172.21.15.91:3300/0 conn(0x7fa8ac06bbc0 0x7fa8ac160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 -- 172.21.15.40:0/3336734374 >> v2:172.21.15.91:3300/0 conn(0x7fa8ac06bbc0 msgr2=0x7fa8ac160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 --2- 172.21.15.40:0/3336734374 >> v2:172.21.15.91:3300/0 conn(0x7fa8ac06bbc0 0x7fa8ac160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 -- 172.21.15.40:0/3336734374 >> v1:172.21.15.40:6789/0 conn(0x7fa8ac0ad2d0 legacy=0x7fa8ac06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 -- 172.21.15.40:0/3336734374 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac06c050 con 0x7fa8ac15d100 2023-11-04T01:41:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8abfff640 1 --2- 172.21.15.40:0/3336734374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15d100 0x7fa8ac0ca060 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0ad740 tx=0x7fa89c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c51ddef3451f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8ab7fe640 1 -- 172.21.15.40:0/3336734374 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0aa430 con 0x7fa8ac15d100 2023-11-04T01:41:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8ab7fe640 1 -- 172.21.15.40:0/3336734374 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c0aa590 con 0x7fa8ac15d100 2023-11-04T01:41:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.119+0000 7fa8ab7fe640 1 -- 172.21.15.40:0/3336734374 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0aa920 con 0x7fa8ac15d100 2023-11-04T01:41:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- 172.21.15.40:0/3336734374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15d100 msgr2=0x7fa8ac0ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 --2- 172.21.15.40:0/3336734374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15d100 0x7fa8ac0ca060 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0ad740 tx=0x7fa89c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- 172.21.15.40:0/3336734374 shutdown_connections 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 --2- 172.21.15.40:0/3336734374 >> v2:172.21.15.91:3300/0 conn(0x7fa8ac06bbc0 0x7fa8ac160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 --2- 172.21.15.40:0/3336734374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15d100 0x7fa8ac0ca060 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- 172.21.15.40:0/3336734374 >> 172.21.15.40:0/3336734374 conn(0x7fa8ac0cea00 msgr2=0x7fa8ac0cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- 172.21.15.40:0/3336734374 shutdown_connections 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- 172.21.15.40:0/3336734374 wait complete. 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 Processor -- start 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- start start 2023-11-04T01:41:23.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ac06bbc0 0x7fa8ac0717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 0x7fa8ac15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d100 0x7fa8ac0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c8790 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c89c0 con 0x7fa8ac06bbc0 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b247e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c5c70 con 0x7fa8ac15d100 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 0x7fa8ac15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 0x7fa8ac15a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55824/0 (socket says 172.21.15.40:55824) 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8a3fff640 1 -- 172.21.15.40:0/979843639 learned_addr learned my addr 172.21.15.40:0/979843639 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8abfff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ac06bbc0 0x7fa8ac0717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.123+0000 7fa8b0a1b640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d100 0x7fa8ac0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a3fff640 1 -- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d100 msgr2=0x7fa8ac0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a3fff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d100 0x7fa8ac0c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a3fff640 1 -- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ac06bbc0 msgr2=0x7fa8ac0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a3fff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ac06bbc0 0x7fa8ac0717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a3fff640 1 -- 172.21.15.40:0/979843639 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0094d0 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8abfff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ac06bbc0 0x7fa8ac0717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a3fff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 0x7fa8ac15a3b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa89400c430 tx=0x7fa89400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940074e0 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894007640 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0c5f50 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894004a10 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac151590 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0744a0 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa894004b70 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a97fa640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa88c0664a0 0x7fa88c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa894083580 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8abfff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa88c0664a0 0x7fa88c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.127+0000 7fa8abfff640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa88c0664a0 0x7fa88c068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0ae000 tx=0x7fa89c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.131+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa894050b20 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.359+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7fa8ac15d4e0 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.639+0000 7fa8a97fa640 1 -- 172.21.15.40:0/979843639 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v101) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa8ac15d4e0 con 0x7fa8ac0ad2d0 2023-11-04T01:41:23.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa88c0664a0 msgr2=0x7fa88c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa88c0664a0 0x7fa88c068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0ae000 tx=0x7fa89c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:23.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 msgr2=0x7fa8ac15a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 0x7fa8ac15a3b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa89400c430 tx=0x7fa89400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 shutdown_connections 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa88c0664a0 0x7fa88c068960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d100 0x7fa8ac0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac0ad2d0 0x7fa8ac15a3b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 --2- 172.21.15.40:0/979843639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8ac06bbc0 0x7fa8ac0717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 >> 172.21.15.40:0/979843639 conn(0x7fa8ac0cea00 msgr2=0x7fa8ac15da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 shutdown_connections 2023-11-04T01:41:23.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.643+0000 7fa8b247e640 1 -- 172.21.15.40:0/979843639 wait complete. 2023-11-04T01:41:23.668 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-04T01:41:23.669 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-04T01:41:23.669 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:41:23.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.791+0000 7f5c364d1640 1 Processor -- start 2023-11-04T01:41:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.791+0000 7f5c364d1640 1 -- start start 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c364d1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5c3006c630 0x7f5c300b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c364d1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300cd400 con 0x7f5c3015d2b0 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c364d1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300cd6e0 con 0x7f5c3015d690 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c364d1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c300ad450 con 0x7f5c3006c630 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5c3015d2b0 0x7f5c300ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50456/0 (socket says 172.21.15.40:50456) 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2ffff640 1 -- 172.21.15.40:0/2438746556 learned_addr learned my addr 172.21.15.40:0/2438746556 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c34a6e640 1 --2- 172.21.15.40:0/2438746556 >> v2:172.21.15.91:3300/0 conn(0x7f5c3006c630 0x7f5c300b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025435837 0 0) 0x7f5c300cd400 con 0x7f5c3015d2b0 2023-11-04T01:41:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c18003530 con 0x7f5c3015d2b0 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1323545670 0 0) 0x7f5c18003530 con 0x7f5c3015d2b0 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 >> v2:172.21.15.91:3300/0 conn(0x7f5c3006c630 msgr2=0x7f5c300b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 --2- 172.21.15.40:0/2438746556 >> v2:172.21.15.91:3300/0 conn(0x7f5c3006c630 0x7f5c300b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 >> v1:172.21.15.91:6789/0 conn(0x7f5c3015d690 legacy=0x7f5c3006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300ad070 con 0x7f5c3015d2b0 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f5c20001a00 con 0x7f5c3015d2b0 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 >> v1:172.21.15.40:6789/0 conn(0x7f5c3015d2b0 legacy=0x7f5c300ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180039d0 0x7f5c18003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c180047d0 0x7f5c18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c180051e0 0x7f5c1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300ad450 con 0x7f5c180047d0 2023-11-04T01:41:23.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1800c130 con 0x7f5c180051e0 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1800c2f0 con 0x7f5c180039d0 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c180047d0 0x7f5c18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2ffff640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180039d0 0x7f5c18003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c34a6e640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c180051e0 0x7f5c1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180039d0 msgr2=0x7f5c18003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180039d0 0x7f5c18003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c180051e0 msgr2=0x7f5c1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c180051e0 0x7f5c1800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/2438746556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c18003530 con 0x7f5c180047d0 2023-11-04T01:41:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c34a6e640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c180051e0 0x7f5c1800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.795+0000 7f5c34a6e640 1 -- 172.21.15.40:0/2438746556 reap_dead start 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c180047d0 0x7f5c18004c50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c24001750 tx=0x7f5c2401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23785f42d98b3867 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240052d0 con 0x7f5c180047d0 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c240a7050 con 0x7f5c180047d0 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2effd640 1 -- 172.21.15.40:0/2438746556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24003600 con 0x7f5c180047d0 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- 172.21.15.40:0/2438746556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c180047d0 msgr2=0x7f5c18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c180047d0 0x7f5c18004c50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c24001750 tx=0x7f5c2401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- 172.21.15.40:0/2438746556 shutdown_connections 2023-11-04T01:41:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 --2- 172.21.15.40:0/2438746556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c180047d0 0x7f5c18004c50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- 172.21.15.40:0/2438746556 >> 172.21.15.40:0/2438746556 conn(0x7f5c300cebb0 msgr2=0x7f5c300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- 172.21.15.40:0/2438746556 shutdown_connections 2023-11-04T01:41:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- 172.21.15.40:0/2438746556 wait complete. 2023-11-04T01:41:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 Processor -- start 2023-11-04T01:41:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- start start 2023-11-04T01:41:23.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180047d0 0x7f5c300c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 0x7f5c301f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c3015b690 0x7f5c3015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3015c050 con 0x7f5c3014ef30 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300cbff0 con 0x7f5c3015b690 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c364d1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300cb6e0 con 0x7f5c180047d0 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 0x7f5c301f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 0x7f5c301f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55844/0 (socket says 172.21.15.40:55844) 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/1996774788 learned_addr learned my addr 172.21.15.40:0/1996774788 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2ffff640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180047d0 0x7f5c300c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180047d0 msgr2=0x7f5c300c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180047d0 0x7f5c300c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c3015b690 msgr2=0x7f5c3015bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c3015b690 0x7f5c3015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.799+0000 7f5c2f7fe640 1 -- 172.21.15.40:0/1996774788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300c8a40 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2f7fe640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 0x7f5c301f6110 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5c24001750 tx=0x7f5c18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240070c0 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c24007220 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c300cb9a0 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24007590 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c301f6650 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c300744a0 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c240067e0 con 0x7f5c3014ef30 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2cff9640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c1c0664d0 0x7f5c1c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5c2411dd20 con 0x7f5c3014ef30 2023-11-04T01:41:23.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2ffff640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c1c0664d0 0x7f5c1c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.803+0000 7f5c2ffff640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c1c0664d0 0x7f5c1c068990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c20002240 tx=0x7f5c20006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.807+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c240eb340 con 0x7f5c3014ef30 2023-11-04T01:41:23.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.963+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c300cc130 con 0x7f5c3014ef30 2023-11-04T01:41:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c2cff9640 1 -- 172.21.15.40:0/1996774788 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14679 (secure 0 0 0) 0x7f5c240ee960 con 0x7f5c3014ef30 2023-11-04T01:41:23.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:23.970 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":40,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:22.626205+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6835/3716931542":"2023-11-05T01:41:19.607938+0000","172.21.15.40:6834/3716931542":"2023-11-05T01:41:19.607938+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c1c0664d0 msgr2=0x7f5c1c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c1c0664d0 0x7f5c1c068990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c20002240 tx=0x7f5c20006040 comp rx=0 tx=0).stop 2023-11-04T01:41:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 msgr2=0x7f5c301f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 0x7f5c301f6110 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5c24001750 tx=0x7f5c18005800 comp rx=0 tx=0).stop 2023-11-04T01:41:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 shutdown_connections 2023-11-04T01:41:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5c1c0664d0 0x7f5c1c068990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c3015b690 0x7f5c3015bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3014ef30 0x7f5c301f6110 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 --2- 172.21.15.40:0/1996774788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5c180047d0 0x7f5c300c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 >> 172.21.15.40:0/1996774788 conn(0x7f5c300cebb0 msgr2=0x7f5c300ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 shutdown_connections 2023-11-04T01:41:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:23.967+0000 7f5c364d1640 1 -- 172.21.15.40:0/1996774788 wait complete. 2023-11-04T01:41:23.990 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:23.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 Processor -- start 2023-11-04T01:41:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 -- start start 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb280b5090 0x7feb280d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feb280d0ad0 0x7feb280b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280d08e0 con 0x7feb2815d6c0 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280d2080 con 0x7feb280b5090 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2f70f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280d2360 con 0x7feb280d0ad0 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2ccaa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb280b5090 0x7feb280d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2d4ab640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feb2815d6c0 0x7feb280b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50460/0 (socket says 172.21.15.40:50460) 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2ccaa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb280b5090 0x7feb280d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55848/0 (socket says 172.21.15.40:55848) 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2d4ab640 1 -- 172.21.15.40:0/1942738051 learned_addr learned my addr 172.21.15.40:0/1942738051 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2dcac640 1 --2- 172.21.15.40:0/1942738051 >> v2:172.21.15.91:3300/0 conn(0x7feb280d0ad0 0x7feb280b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2ccaa640 1 -- 172.21.15.40:0/1942738051 >> v2:172.21.15.91:3300/0 conn(0x7feb280d0ad0 msgr2=0x7feb280b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2ccaa640 1 --2- 172.21.15.40:0/1942738051 >> v2:172.21.15.91:3300/0 conn(0x7feb280d0ad0 0x7feb280b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2ccaa640 1 -- 172.21.15.40:0/1942738051 >> v1:172.21.15.40:6789/0 conn(0x7feb2815d6c0 legacy=0x7feb280b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb1ffff640 1 -- 172.21.15.40:0/1942738051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931378156 0 0) 0x7feb280d08e0 con 0x7feb2815d6c0 2023-11-04T01:41:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2ccaa640 1 -- 172.21.15.40:0/1942738051 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280d2640 con 0x7feb280b5090 2023-11-04T01:41:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.119+0000 7feb2dcac640 1 --2- 172.21.15.40:0/1942738051 >> v2:172.21.15.91:3300/0 conn(0x7feb280d0ad0 0x7feb280b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:24.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2ccaa640 1 --2- 172.21.15.40:0/1942738051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb280b5090 0x7feb280d19c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feb280b5f00 tx=0x7feb1801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4e4f2a8b2956ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb1ffff640 1 -- 172.21.15.40:0/1942738051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180a8950 con 0x7feb280b5090 2023-11-04T01:41:24.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb1ffff640 1 -- 172.21.15.40:0/1942738051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180a8ab0 con 0x7feb280b5090 2023-11-04T01:41:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb1ffff640 1 -- 172.21.15.40:0/1942738051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180a8e40 con 0x7feb280b5090 2023-11-04T01:41:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- 172.21.15.40:0/1942738051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb280b5090 msgr2=0x7feb280d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 --2- 172.21.15.40:0/1942738051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb280b5090 0x7feb280d19c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feb280b5f00 tx=0x7feb1801ec50 comp rx=0 tx=0).stop 2023-11-04T01:41:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- 172.21.15.40:0/1942738051 shutdown_connections 2023-11-04T01:41:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 --2- 172.21.15.40:0/1942738051 >> v2:172.21.15.91:3300/0 conn(0x7feb280d0ad0 0x7feb280b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 --2- 172.21.15.40:0/1942738051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb280b5090 0x7feb280d19c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- 172.21.15.40:0/1942738051 >> 172.21.15.40:0/1942738051 conn(0x7feb280cf980 msgr2=0x7feb280cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- 172.21.15.40:0/1942738051 shutdown_connections 2023-11-04T01:41:24.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- 172.21.15.40:0/1942738051 wait complete. 2023-11-04T01:41:24.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 Processor -- start 2023-11-04T01:41:24.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- start start 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb280b5090 0x7feb28151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb280d0ad0 0x7feb281559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 0x7feb280cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280cac80 con 0x7feb2815d6c0 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280ca070 con 0x7feb280d0ad0 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2f70f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb280ca350 con 0x7feb280b5090 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.123+0000 7feb2dcac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 0x7feb280cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 0x7feb280cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55862/0 (socket says 172.21.15.40:55862) 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 -- 172.21.15.40:0/2684716401 learned_addr learned my addr 172.21.15.40:0/2684716401 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2d4ab640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb280b5090 0x7feb28151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2ccaa640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb280d0ad0 0x7feb281559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 -- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb280b5090 msgr2=0x7feb28151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb280b5090 0x7feb28151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 -- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb280d0ad0 msgr2=0x7feb281559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb280d0ad0 0x7feb281559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 -- 172.21.15.40:0/2684716401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18009420 con 0x7feb2815d6c0 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2d4ab640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb280b5090 0x7feb28151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2ccaa640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb280d0ad0 0x7feb281559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2dcac640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 0x7feb280cb110 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c7f0 tx=0x7feb2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20007820 con 0x7feb2815d6c0 2023-11-04T01:41:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb200079c0 con 0x7feb2815d6c0 2023-11-04T01:41:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb280ca630 con 0x7feb2815d6c0 2023-11-04T01:41:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20007d70 con 0x7feb2815d6c0 2023-11-04T01:41:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb28151760 con 0x7feb2815d6c0 2023-11-04T01:41:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb280cadf0 con 0x7feb2815d6c0 2023-11-04T01:41:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb200113f0 con 0x7feb2815d6c0 2023-11-04T01:41:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb1dffb640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb0c0664a0 0x7feb0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7feb20084040 con 0x7feb2815d6c0 2023-11-04T01:41:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2d4ab640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb0c0664a0 0x7feb0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.127+0000 7feb2d4ab640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb0c0664a0 0x7feb0c068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb24007fd0 tx=0x7feb24005b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.131+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb20051660 con 0x7feb2815d6c0 2023-11-04T01:41:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.283+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb280675f0 con 0x7feb2815d6c0 2023-11-04T01:41:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.283+0000 7feb1dffb640 1 -- 172.21.15.40:0/2684716401 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb20054c80 con 0x7feb2815d6c0 2023-11-04T01:41:24.289 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb0c0664a0 msgr2=0x7feb0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb0c0664a0 0x7feb0c068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb24007fd0 tx=0x7feb24005b80 comp rx=0 tx=0).stop 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 msgr2=0x7feb280cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 0x7feb280cb110 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c7f0 tx=0x7feb2000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 shutdown_connections 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb0c0664a0 0x7feb0c068960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb2815d6c0 0x7feb280cb110 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb280d0ad0 0x7feb281559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 --2- 172.21.15.40:0/2684716401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb280b5090 0x7feb28151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 >> 172.21.15.40:0/2684716401 conn(0x7feb280cf980 msgr2=0x7feb280cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 shutdown_connections 2023-11-04T01:41:24.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.287+0000 7feb2f70f640 1 -- 172.21.15.40:0/2684716401 wait complete. 2023-11-04T01:41:24.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:24.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 Processor -- start 2023-11-04T01:41:24.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 -- start start 2023-11-04T01:41:24.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b40b26c0 0x7fb7b40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7b406b580 0x7fb7b406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b4160cb0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40b2fe0 con 0x7fb7b406b580 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7bb8a6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4160f50 con 0x7fb7b40b26c0 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7b8e41640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7b406b580 0x7fb7b406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7b8e41640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7b406b580 0x7fb7b406bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55876/0 (socket says 172.21.15.40:55876) 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7b9e43640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb7b406c1c0 0x7fb7b40ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50472/0 (socket says 172.21.15.40:50472) 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.427+0000 7fb7b8e41640 1 -- 172.21.15.40:0/1724076610 learned_addr learned my addr 172.21.15.40:0/1724076610 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7b9642640 1 --2- 172.21.15.40:0/1724076610 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b40b26c0 0x7fb7b40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7b8e41640 1 -- 172.21.15.40:0/1724076610 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b40b26c0 msgr2=0x7fb7b40b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7b8e41640 1 --2- 172.21.15.40:0/1724076610 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b40b26c0 0x7fb7b40b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7b8e41640 1 -- 172.21.15.40:0/1724076610 >> v1:172.21.15.40:6789/0 conn(0x7fb7b406c1c0 legacy=0x7fb7b40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7b8e41640 1 -- 172.21.15.40:0/1724076610 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4161230 con 0x7fb7b406b580 2023-11-04T01:41:24.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7a7fff640 1 -- 172.21.15.40:0/1724076610 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782636397 0 0) 0x7fb7b4160cb0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7b8e41640 1 --2- 172.21.15.40:0/1724076610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406b580 0x7fb7b406bc80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009870 tx=0x7fb7a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6b322aa7a993be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7a7fff640 1 -- 172.21.15.40:0/1724076610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80aa610 con 0x7fb7b406b580 2023-11-04T01:41:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7a7fff640 1 -- 172.21.15.40:0/1724076610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a80a6040 con 0x7fb7b406b580 2023-11-04T01:41:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7a7fff640 1 -- 172.21.15.40:0/1724076610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80aa990 con 0x7fb7b406b580 2023-11-04T01:41:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/1724076610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406b580 msgr2=0x7fb7b406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/1724076610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406b580 0x7fb7b406bc80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009870 tx=0x7fb7a801c510 comp rx=0 tx=0).stop 2023-11-04T01:41:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/1724076610 shutdown_connections 2023-11-04T01:41:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/1724076610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406b580 0x7fb7b406bc80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/1724076610 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b40b26c0 0x7fb7b40b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/1724076610 >> 172.21.15.40:0/1724076610 conn(0x7fb7b409a030 msgr2=0x7fb7b40d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/1724076610 shutdown_connections 2023-11-04T01:41:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.431+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/1724076610 wait complete. 2023-11-04T01:41:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 Processor -- start 2023-11-04T01:41:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- start start 2023-11-04T01:41:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b406b580 0x7fb7b4155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 0x7fb7b4153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7b40b26c0 0x7fb7b4151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40b4780 con 0x7fb7b406c1c0 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40b3860 con 0x7fb7b40b26c0 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40b3b00 con 0x7fb7b406b580 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 0x7fb7b4153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 0x7fb7b4153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55880/0 (socket says 172.21.15.40:55880) 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 -- 172.21.15.40:0/3288019533 learned_addr learned my addr 172.21.15.40:0/3288019533 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b9642640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b406b580 0x7fb7b4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 -- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b406b580 msgr2=0x7fb7b4155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b9e43640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7b40b26c0 0x7fb7b4151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b406b580 0x7fb7b4155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 -- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7b40b26c0 msgr2=0x7fb7b4151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7b40b26c0 0x7fb7b4151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 -- 172.21.15.40:0/3288019533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80094d0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7b8e41640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 0x7fb7b4153ff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb7a801a140 tx=0x7fb7a801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80bd5f0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a80bd750 con 0x7fb7b406c1c0 2023-11-04T01:41:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40b3de0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80bdb00 con 0x7fb7b406c1c0 2023-11-04T01:41:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b40b43a0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40b48c0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.435+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7a80b33f0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.439+0000 7fb7a5ffb640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7980664d0 0x7fb798068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.439+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb7a811e750 con 0x7fb7b406c1c0 2023-11-04T01:41:24.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.439+0000 7fb7b9642640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7980664d0 0x7fb798068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.439+0000 7fb7b9642640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7980664d0 0x7fb798068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0006fd0 tx=0x7fb7b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.439+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7a80ebeb0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb7b40b48c0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7a5ffb640 1 -- 172.21.15.40:0/3288019533 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v40) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb7b40b48c0 con 0x7fb7b406c1c0 2023-11-04T01:41:24.599 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7980664d0 msgr2=0x7fb798068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7980664d0 0x7fb798068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0006fd0 tx=0x7fb7b0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 msgr2=0x7fb7b4153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 0x7fb7b4153ff0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb7a801a140 tx=0x7fb7a801ad50 comp rx=0 tx=0).stop 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 shutdown_connections 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7980664d0 0x7fb798068990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7b40b26c0 0x7fb7b4151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b406c1c0 0x7fb7b4153ff0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 --2- 172.21.15.40:0/3288019533 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7b406b580 0x7fb7b4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 >> 172.21.15.40:0/3288019533 conn(0x7fb7b409a030 msgr2=0x7fb7b40d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 shutdown_connections 2023-11-04T01:41:24.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.595+0000 7fb7bb8a6640 1 -- 172.21.15.40:0/3288019533 wait complete. 2023-11-04T01:41:24.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:41:24.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 Processor -- start 2023-11-04T01:41:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 -- start start 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e04161510 0x7f8e041618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e0406ba90 0x7f8e040c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e040cc6f0 con 0x7f8e0406f8f0 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040b10d0 con 0x7f8e04161510 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e09898640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0406bf90 con 0x7f8e0406ba90 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e04161510 0x7f8e041618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e04161510 0x7f8e041618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55884/0 (socket says 172.21.15.40:55884) 2023-11-04T01:41:24.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 -- 172.21.15.40:0/815615307 learned_addr learned my addr 172.21.15.40:0/815615307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e037fe640 1 --2- 172.21.15.40:0/815615307 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e0406ba90 0x7f8e040c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 -- 172.21.15.40:0/815615307 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e0406ba90 msgr2=0x7f8e040c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 --2- 172.21.15.40:0/815615307 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e0406ba90 0x7f8e040c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 -- 172.21.15.40:0/815615307 >> v1:172.21.15.91:6789/0 conn(0x7f8e0406f8f0 legacy=0x7f8e040b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.739+0000 7f8e02ffd640 1 -- 172.21.15.40:0/815615307 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0406c270 con 0x7f8e04161510 2023-11-04T01:41:24.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e02ffd640 1 --2- 172.21.15.40:0/815615307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e04161510 0x7f8e041618f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009e50 tx=0x7f8df401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f60d0617cc8c22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e01ffb640 1 -- 172.21.15.40:0/815615307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df40a56f0 con 0x7f8e04161510 2023-11-04T01:41:24.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e01ffb640 1 -- 172.21.15.40:0/815615307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df40a5850 con 0x7f8e04161510 2023-11-04T01:41:24.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e01ffb640 1 -- 172.21.15.40:0/815615307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df40a5be0 con 0x7f8e04161510 2023-11-04T01:41:24.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- 172.21.15.40:0/815615307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e04161510 msgr2=0x7f8e041618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 --2- 172.21.15.40:0/815615307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e04161510 0x7f8e041618f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009e50 tx=0x7f8df401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- 172.21.15.40:0/815615307 shutdown_connections 2023-11-04T01:41:24.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 --2- 172.21.15.40:0/815615307 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e0406ba90 0x7f8e040c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 --2- 172.21.15.40:0/815615307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e04161510 0x7f8e041618f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- 172.21.15.40:0/815615307 >> 172.21.15.40:0/815615307 conn(0x7f8e040cebb0 msgr2=0x7f8e040cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- 172.21.15.40:0/815615307 shutdown_connections 2023-11-04T01:41:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- 172.21.15.40:0/815615307 wait complete. 2023-11-04T01:41:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 Processor -- start 2023-11-04T01:41:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- start start 2023-11-04T01:41:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e0406ba90 0x7f8e04146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 0x7f8e0415da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e04161510 0x7f8e0415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e040b1c20 con 0x7f8e0406f8f0 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04155df0 con 0x7f8e0406ba90 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e09898640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041560d0 con 0x7f8e04161510 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 0x7f8e0415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 0x7f8e0415da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55900/0 (socket says 172.21.15.40:55900) 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 -- 172.21.15.40:0/69767540 learned_addr learned my addr 172.21.15.40:0/69767540 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e037fe640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e04161510 0x7f8e0415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e02ffd640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e0406ba90 0x7f8e04146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 -- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e04161510 msgr2=0x7f8e0415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e04161510 0x7f8e0415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 -- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e0406ba90 msgr2=0x7f8e04146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e0406ba90 0x7f8e04146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e027fc640 1 -- 172.21.15.40:0/69767540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009b30 con 0x7f8e0406f8f0 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.743+0000 7f8e037fe640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e04161510 0x7f8e0415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8e027fc640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 0x7f8e0415da10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00c410 tx=0x7f8dec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec011790 con 0x7f8e0406f8f0 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec0118f0 con 0x7f8e0406f8f0 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e041563b0 con 0x7f8e0406f8f0 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec011ca0 con 0x7f8e0406f8f0 2023-11-04T01:41:24.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e041473d0 con 0x7f8e0406f8f0 2023-11-04T01:41:24.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e040b1d60 con 0x7f8e0406f8f0 2023-11-04T01:41:24.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8dec01c460 con 0x7f8e0406f8f0 2023-11-04T01:41:24.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8dfbfff640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de40664a0 0x7f8de4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8dec083b20 con 0x7f8e0406f8f0 2023-11-04T01:41:24.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8e02ffd640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de40664a0 0x7f8de4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.747+0000 7f8e02ffd640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de40664a0 0x7f8de4068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8df40ae000 tx=0x7f8df40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.751+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e040b1d60 con 0x7f8e0406f8f0 2023-11-04T01:41:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:24.959+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f8e040b1d60 con 0x7f8e0406f8f0 2023-11-04T01:41:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.651+0000 7f8dfbfff640 1 -- 172.21.15.40:0/69767540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e040b1d60 con 0x7f8e0406f8f0 2023-11-04T01:41:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de40664a0 msgr2=0x7f8de4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de40664a0 0x7f8de4068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8df40ae000 tx=0x7f8df40a7070 comp rx=0 tx=0).stop 2023-11-04T01:41:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 msgr2=0x7f8e0415da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 0x7f8e0415da10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00c410 tx=0x7f8dec00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 shutdown_connections 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de40664a0 0x7f8de4068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8e04161510 0x7f8e0415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e0406f8f0 0x7f8e0415da10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 --2- 172.21.15.40:0/69767540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8e0406ba90 0x7f8e04146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 >> 172.21.15.40:0/69767540 conn(0x7f8e040cebb0 msgr2=0x7f8e0415fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 shutdown_connections 2023-11-04T01:41:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.655+0000 7f8e09898640 1 -- 172.21.15.40:0/69767540 wait complete. 2023-11-04T01:41:25.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:41:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 Processor -- start 2023-11-04T01:41:25.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 -- start start 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ffc15ae20 0x7f3ffc0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc0d18a0 0x7f3ffc0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0cbb30 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cbe10 con 0x7f3ffc15ae20 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f40030e3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cc0f0 con 0x7f3ffc0d18a0 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ffc15ae20 0x7f3ffc0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ffc15ae20 0x7f3ffc0ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55912/0 (socket says 172.21.15.40:55912) 2023-11-04T01:41:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 -- 172.21.15.40:0/3635634678 learned_addr learned my addr 172.21.15.40:0/3635634678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4001680640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3ffc0cecc0 0x7f3ffc06d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50484/0 (socket says 172.21.15.40:50484) 2023-11-04T01:41:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f3ff3fff640 1 --2- 172.21.15.40:0/3635634678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc0d18a0 0x7f3ffc0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 -- 172.21.15.40:0/3635634678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc0d18a0 msgr2=0x7f3ffc0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 --2- 172.21.15.40:0/3635634678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc0d18a0 0x7f3ffc0b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 -- 172.21.15.40:0/3635634678 >> v1:172.21.15.40:6789/0 conn(0x7f3ffc0cecc0 legacy=0x7f3ffc06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.815+0000 7f4000e7f640 1 -- 172.21.15.40:0/3635634678 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0cc3d0 con 0x7f3ffc15ae20 2023-11-04T01:41:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 --2- 172.21.15.40:0/3635634678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc15ae20 0x7f3ffc0ce780 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8006fd0 tx=0x7f3ff801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949c06a74c8406e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f3ff37fe640 1 -- 172.21.15.40:0/3635634678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80a8a10 con 0x7f3ffc15ae20 2023-11-04T01:41:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f3ff37fe640 1 -- 172.21.15.40:0/3635634678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80a8b70 con 0x7f3ffc15ae20 2023-11-04T01:41:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f3ff37fe640 1 -- 172.21.15.40:0/3635634678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80b0440 con 0x7f3ffc15ae20 2023-11-04T01:41:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- 172.21.15.40:0/3635634678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc15ae20 msgr2=0x7f3ffc0ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 --2- 172.21.15.40:0/3635634678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc15ae20 0x7f3ffc0ce780 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8006fd0 tx=0x7f3ff801ed10 comp rx=0 tx=0).stop 2023-11-04T01:41:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- 172.21.15.40:0/3635634678 shutdown_connections 2023-11-04T01:41:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 --2- 172.21.15.40:0/3635634678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc0d18a0 0x7f3ffc0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 --2- 172.21.15.40:0/3635634678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc15ae20 0x7f3ffc0ce780 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- 172.21.15.40:0/3635634678 >> 172.21.15.40:0/3635634678 conn(0x7f3ffc09a030 msgr2=0x7f3ffc0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- 172.21.15.40:0/3635634678 shutdown_connections 2023-11-04T01:41:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- 172.21.15.40:0/3635634678 wait complete. 2023-11-04T01:41:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 Processor -- start 2023-11-04T01:41:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- start start 2023-11-04T01:41:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 0x7f3ffc0c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc15ae20 0x7f3ffc151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ffc0c5fa0 0x7f3ffc158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15b560 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc1521d0 con 0x7f3ffc0c5fa0 2023-11-04T01:41:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f40030e3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0c49d0 con 0x7f3ffc15ae20 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 0x7f3ffc0c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 0x7f3ffc0c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55920/0 (socket says 172.21.15.40:55920) 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 -- 172.21.15.40:0/4218492456 learned_addr learned my addr 172.21.15.40:0/4218492456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f3ff3fff640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc15ae20 0x7f3ffc151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4001680640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ffc0c5fa0 0x7f3ffc158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 -- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc15ae20 msgr2=0x7f3ffc151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc15ae20 0x7f3ffc151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 -- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ffc0c5fa0 msgr2=0x7f3ffc158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ffc0c5fa0 0x7f3ffc158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 -- 172.21.15.40:0/4218492456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009480 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f3ff3fff640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc15ae20 0x7f3ffc151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4001680640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ffc0c5fa0 0x7f3ffc158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.819+0000 7f4000e7f640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 0x7f3ffc0c43f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3ff801c940 tx=0x7f3ff801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8003820 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80039a0 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc0c4cb0 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8003d50 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc0c5270 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc0744a0 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ff80b9450 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff17fa640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe80664d0 0x7f3fe8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3ff8120ab0 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff3fff640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe80664d0 0x7f3fe8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.823+0000 7f3ff3fff640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe80664d0 0x7f3fe8068990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc159700 tx=0x7f3fec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:25.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.827+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ff80ee190 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.983+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3ffc071ed0 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f3ff17fa640 1 -- 172.21.15.40:0/4218492456 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ff80f17b0 con 0x7f3ffc0cecc0 2023-11-04T01:41:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe80664d0 msgr2=0x7f3fe8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe80664d0 0x7f3fe8068990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc159700 tx=0x7f3fec008040 comp rx=0 tx=0).stop 2023-11-04T01:41:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 msgr2=0x7f3ffc0c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 0x7f3ffc0c43f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3ff801c940 tx=0x7f3ff801bab0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 shutdown_connections 2023-11-04T01:41:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3fe80664d0 0x7f3fe8068990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3ffc0c5fa0 0x7f3ffc158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3ffc15ae20 0x7f3ffc151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 --2- 172.21.15.40:0/4218492456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc0cecc0 0x7f3ffc0c43f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 >> 172.21.15.40:0/4218492456 conn(0x7f3ffc09a030 msgr2=0x7f3ffc0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 shutdown_connections 2023-11-04T01:41:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:25.991+0000 7f40030e3640 1 -- 172.21.15.40:0/4218492456 wait complete. 2023-11-04T01:41:26.013 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:41:26.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:26.043 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:26.083 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:41:26.084 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:26.084 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:26.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:26.090 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:26.090 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:26.130 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:26.130 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:26.130 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:26.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:26.138 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:26.138 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:26.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:26.179 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:41:26.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 Processor -- start 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 -- start start 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80d40715d0 0x7f80d40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 0x7f80d415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d40c2670 con 0x7f80d415afd0 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d4070140 con 0x7f80d40715d0 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80da464640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4071a60 con 0x7f80d40b0b70 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80d3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f80d415afd0 0x7f80d406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50496/0 (socket says 172.21.15.40:50496) 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80d3fff640 1 -- 172.21.15.40:0/3789731070 learned_addr learned my addr 172.21.15.40:0/3789731070 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80d8a01640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 0x7f80d415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80d37fe640 1 --2- 172.21.15.40:0/3789731070 >> v2:172.21.15.91:3300/0 conn(0x7f80d40715d0 0x7f80d40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617399291 0 0) 0x7f80d40c2670 con 0x7f80d415afd0 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.307+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c0003530 con 0x7f80d415afd0 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621523044 0 0) 0x7f80c0003530 con 0x7f80d415afd0 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 msgr2=0x7f80d415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 0x7f80d415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 >> v2:172.21.15.91:3300/0 conn(0x7f80d40715d0 msgr2=0x7f80d40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 --2- 172.21.15.40:0/3789731070 >> v2:172.21.15.91:3300/0 conn(0x7f80d40715d0 0x7f80d40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d406bc30 con 0x7f80d415afd0 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f80c4001a00 con 0x7f80d415afd0 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 >> v1:172.21.15.40:6789/0 conn(0x7f80d415afd0 legacy=0x7f80d406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 0x7f80c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c0003f00 0x7f80c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0004d10 0x7f80c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4070140 con 0x7f80c0003f00 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c000b990 con 0x7f80c0004d10 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c000bad0 con 0x7f80d40b0b70 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c0003f00 0x7f80c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d3fff640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 0x7f80c0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d8a01640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0004d10 0x7f80c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 -- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 msgr2=0x7f80c0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80d40b0b70 0x7f80c0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 -- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0004d10 msgr2=0x7f80c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0004d10 0x7f80c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 -- 172.21.15.40:0/3789731070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0003530 con 0x7f80c0003f00 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d37fe640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c0003f00 0x7f80c00047d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009ae0 tx=0x7f80bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c486d0244b7df07b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0a5680 con 0x7f80c0003f00 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc0a57e0 con 0x7f80c0003f00 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d2ffd640 1 -- 172.21.15.40:0/3789731070 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0a5b90 con 0x7f80c0003f00 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80da464640 1 -- 172.21.15.40:0/3789731070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c0003f00 msgr2=0x7f80c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80da464640 1 --2- 172.21.15.40:0/3789731070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c0003f00 0x7f80c00047d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009ae0 tx=0x7f80bc01ca30 comp rx=0 tx=0).stop 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80d8a01640 1 -- 172.21.15.40:0/3789731070 reap_dead start 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80da464640 1 -- 172.21.15.40:0/3789731070 shutdown_connections 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80da464640 1 -- 172.21.15.40:0/3789731070 >> 172.21.15.40:0/3789731070 conn(0x7f80d40cebb0 msgr2=0x7f80d40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80da464640 1 -- 172.21.15.40:0/3789731070 shutdown_connections 2023-11-04T01:41:26.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.311+0000 7f80da464640 1 -- 172.21.15.40:0/3789731070 wait complete. 2023-11-04T01:41:26.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 Processor -- start 2023-11-04T01:41:26.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- start start 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0003f00 0x7f80d4152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d41f5fa0 0x7f80d41f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 0x7f80d40ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40ae270 con 0x7f80d40ad4d0 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d41f6940 con 0x7f80d41f5fa0 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d41527d0 con 0x7f80c0003f00 2023-11-04T01:41:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 0x7f80d40ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 0x7f80d40ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55940/0 (socket says 172.21.15.40:55940) 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 -- 172.21.15.40:0/1864487137 learned_addr learned my addr 172.21.15.40:0/1864487137 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d3fff640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0003f00 0x7f80d4152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d37fe640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d41f5fa0 0x7f80d41f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 -- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0003f00 msgr2=0x7f80d4152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0003f00 0x7f80d4152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 -- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d41f5fa0 msgr2=0x7f80d41f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d41f5fa0 0x7f80d41f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 -- 172.21.15.40:0/1864487137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d40c5d90 con 0x7f80d40ad4d0 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d37fe640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d41f5fa0 0x7f80d41f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d8a01640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 0x7f80d40ad950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80d40b1410 tx=0x7f80cc011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc004030 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc004190 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d40c6070 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc00f770 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d40c6630 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.315+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d40c6850 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.319+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80cc00f8d0 con 0x7f80d40ad4d0 2023-11-04T01:41:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.319+0000 7f80d0ff9640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80b40664a0 0x7f80b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.319+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f80cc084090 con 0x7f80d40ad4d0 2023-11-04T01:41:26.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.319+0000 7f80d3fff640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80b40664a0 0x7f80b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.319+0000 7f80d3fff640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80b40664a0 0x7f80b4068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f80c4002240 tx=0x7f80c400a060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.323+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80cc051740 con 0x7f80d40ad4d0 2023-11-04T01:41:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80d406bee0 con 0x7f80d40ad4d0 2023-11-04T01:41:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80d0ff9640 1 -- 172.21.15.40:0/1864487137 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3698 (secure 0 0 0) 0x7f80cc019e90 con 0x7f80d40ad4d0 2023-11-04T01:41:26.508 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:26.508 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3189799608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3189799608},{"type":"v1","addr":"172.21.15.40:6833","nonce":3189799608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4814,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2139139838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2139139838},{"type":"v1","addr":"172.21.15.91:6837","nonce":2139139838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1279219504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1279219504},{"type":"v1","addr":"172.21.15.91:6835","nonce":1279219504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2522672936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2522672936},{"type":"v1","addr":"172.21.15.40:6835","nonce":2522672936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2023-11-04T01:41:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80b40664a0 msgr2=0x7f80b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80b40664a0 0x7f80b4068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f80c4002240 tx=0x7f80c400a060 comp rx=0 tx=0).stop 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 msgr2=0x7f80d40ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 0x7f80d40ad950 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80d40b1410 tx=0x7f80cc011cf0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 shutdown_connections 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80b40664a0 0x7f80b4068960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d40ad4d0 0x7f80d40ad950 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d41f5fa0 0x7f80d41f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 --2- 172.21.15.40:0/1864487137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0003f00 0x7f80d4152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 >> 172.21.15.40:0/1864487137 conn(0x7f80d40cebb0 msgr2=0x7f80d40ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.503+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 shutdown_connections 2023-11-04T01:41:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.507+0000 7f80da464640 1 -- 172.21.15.40:0/1864487137 wait complete. 2023-11-04T01:41:26.525 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:41:26.525 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:41:26.526 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:41:26.526 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:26.526 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:41:26.526 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:41:26.526 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:41:26.526 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:26.527 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:41:26.527 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:41:26.527 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:41:26.527 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:26.527 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:26.527 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:26.527 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:26.527 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:26.535 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:41:26.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:41:26.537 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:41:26.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:41:26.541 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:26.542 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:26.546 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:41:26.546 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:41:26.583 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:41:26.583 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:26.584 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:41:26.584 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:26.591 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:26.591 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:26.593 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:41:26.593 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:26.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:41:26.641 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:41:26.653 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:41:26.665 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:41:26.669 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:41:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 Processor -- start 2023-11-04T01:41:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 -- start start 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f6c15d540 0x7f5f6c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5f6c0722e0 0x7f5f6c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c06a370 0x7f5f6c06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c06ad60 con 0x7f5f6c15d540 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0b4270 con 0x7f5f6c0722e0 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f7351c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c06cb40 con 0x7f5f6c06a370 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f6c15d540 0x7f5f6c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f6c15d540 0x7f5f6c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55978/0 (socket says 172.21.15.40:55978) 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 -- 172.21.15.40:0/1993260787 learned_addr learned my addr 172.21.15.40:0/1993260787 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f71ab9640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c06a370 0x7f5f6c06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f70ab7640 1 --2- 172.21.15.40:0/1993260787 >> v2:172.21.15.91:3300/0 conn(0x7f5f6c0722e0 0x7f5f6c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 -- 172.21.15.40:0/1993260787 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c06a370 msgr2=0x7f5f6c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c06a370 0x7f5f6c06a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 -- 172.21.15.40:0/1993260787 >> v2:172.21.15.91:3300/0 conn(0x7f5f6c0722e0 msgr2=0x7f5f6c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 --2- 172.21.15.40:0/1993260787 >> v2:172.21.15.91:3300/0 conn(0x7f5f6c0722e0 0x7f5f6c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 -- 172.21.15.40:0/1993260787 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c06ce20 con 0x7f5f6c15d540 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f70ab7640 1 --2- 172.21.15.40:0/1993260787 >> v2:172.21.15.91:3300/0 conn(0x7f5f6c0722e0 0x7f5f6c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f71ab9640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c06a370 0x7f5f6c06a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:26.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f712b8640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c15d540 0x7f5f6c0b4f10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c070780 tx=0x7f5f6401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9482158b7ea300b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f6bfff640 1 -- 172.21.15.40:0/1993260787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640ad640 con 0x7f5f6c15d540 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f6bfff640 1 -- 172.21.15.40:0/1993260787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f640ad7a0 con 0x7f5f6c15d540 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.703+0000 7f5f6bfff640 1 -- 172.21.15.40:0/1993260787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640adb30 con 0x7f5f6c15d540 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1993260787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c15d540 msgr2=0x7f5f6c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c15d540 0x7f5f6c0b4f10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c070780 tx=0x7f5f6401c3b0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1993260787 shutdown_connections 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c06a370 0x7f5f6c06a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1993260787 >> v2:172.21.15.91:3300/0 conn(0x7f5f6c0722e0 0x7f5f6c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1993260787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c15d540 0x7f5f6c0b4f10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1993260787 >> 172.21.15.40:0/1993260787 conn(0x7f5f6c0716a0 msgr2=0x7f5f6c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1993260787 shutdown_connections 2023-11-04T01:41:26.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1993260787 wait complete. 2023-11-04T01:41:26.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 Processor -- start 2023-11-04T01:41:26.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- start start 2023-11-04T01:41:26.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f6c06a370 0x7f5f6c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 0x7f5f6c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c15d540 0x7f5f6c0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c8a10 con 0x7f5f6c0722e0 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c5c70 con 0x7f5f6c06a370 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c7d90 con 0x7f5f6c15d540 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 0x7f5f6c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 0x7f5f6c0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55994/0 (socket says 172.21.15.40:55994) 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 -- 172.21.15.40:0/1912598851 learned_addr learned my addr 172.21.15.40:0/1912598851 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f71ab9640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c15d540 0x7f5f6c0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f712b8640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f6c06a370 0x7f5f6c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 -- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c15d540 msgr2=0x7f5f6c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c15d540 0x7f5f6c0c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 -- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f6c06a370 msgr2=0x7f5f6c0c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f6c06a370 0x7f5f6c0c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 -- 172.21.15.40:0/1912598851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640094d0 con 0x7f5f6c0722e0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f70ab7640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 0x7f5f6c0c7540 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d830 tx=0x7f5f6000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600096c0 con 0x7f5f6c0722e0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60009820 con 0x7f5f6c0722e0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c0c8070 con 0x7f5f6c0722e0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60009bd0 con 0x7f5f6c0722e0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.707+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c0c8630 con 0x7f5f6c0722e0 2023-11-04T01:41:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.711+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c0c8c80 con 0x7f5f6c0722e0 2023-11-04T01:41:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.711+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f60009d30 con 0x7f5f6c0722e0 2023-11-04T01:41:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.711+0000 7f5f69ffb640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f580664a0 0x7f5f58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.711+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5f600841f0 con 0x7f5f6c0722e0 2023-11-04T01:41:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.711+0000 7f5f712b8640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f580664a0 0x7f5f58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.711+0000 7f5f712b8640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f580664a0 0x7f5f58068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5f640af000 tx=0x7f5f64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.715+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5f60051950 con 0x7f5f6c0722e0 2023-11-04T01:41:26.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:26.759 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:26.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:26.883+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5f6c0675f0 con 0x7f5f6c0722e0 2023-11-04T01:41:27.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f69ffb640 1 -- 172.21.15.40:0/1912598851 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5f60054f70 con 0x7f5f6c0722e0 2023-11-04T01:41:27.691 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f580664a0 msgr2=0x7f5f58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f580664a0 0x7f5f58068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5f640af000 tx=0x7f5f64009040 comp rx=0 tx=0).stop 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 msgr2=0x7f5f6c0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 0x7f5f6c0c7540 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d830 tx=0x7f5f6000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 shutdown_connections 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f580664a0 0x7f5f58068960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f6c15d540 0x7f5f6c0c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f6c0722e0 0x7f5f6c0c7540 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 --2- 172.21.15.40:0/1912598851 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f6c06a370 0x7f5f6c0c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.687+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 >> 172.21.15.40:0/1912598851 conn(0x7f5f6c0716a0 msgr2=0x7f5f6c0731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:27.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.691+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 shutdown_connections 2023-11-04T01:41:27.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.691+0000 7f5f7351c640 1 -- 172.21.15.40:0/1912598851 wait complete. 2023-11-04T01:41:27.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:41:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 Processor -- start 2023-11-04T01:41:27.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 -- start start 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f179815aec0 0x7f179806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f179815d840 0x7f179806e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17980ce9b0 con 0x7f17980cd7d0 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179815e8a0 con 0x7f179815d840 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f179d310640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179806ea40 con 0x7f179815aec0 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f179815d840 0x7f179806e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f179815d840 0x7f179806e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58260/0 (socket says 172.21.15.40:58260) 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 -- 172.21.15.40:0/3043474506 learned_addr learned my addr 172.21.15.40:0/3043474506 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f1796ffd640 1 --2- 172.21.15.40:0/3043474506 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f179815aec0 0x7f179806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 -- 172.21.15.40:0/3043474506 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f179815aec0 msgr2=0x7f179806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 --2- 172.21.15.40:0/3043474506 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f179815aec0 0x7f179806c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 -- 172.21.15.40:0/3043474506 >> v1:172.21.15.91:6789/0 conn(0x7f17980cd7d0 legacy=0x7f17980cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.835+0000 7f17967fc640 1 -- 172.21.15.40:0/3043474506 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980d0940 con 0x7f179815d840 2023-11-04T01:41:27.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f17967fc640 1 --2- 172.21.15.40:0/3043474506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815d840 0x7f179806e500 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f178c009870 tx=0x7f178c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91125471d0851f4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:27.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f1795ffb640 1 -- 172.21.15.40:0/3043474506 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0ac600 con 0x7f179815d840 2023-11-04T01:41:27.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f1795ffb640 1 -- 172.21.15.40:0/3043474506 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0a8050 con 0x7f179815d840 2023-11-04T01:41:27.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f1795ffb640 1 -- 172.21.15.40:0/3043474506 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0ac980 con 0x7f179815d840 2023-11-04T01:41:27.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- 172.21.15.40:0/3043474506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815d840 msgr2=0x7f179806e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 --2- 172.21.15.40:0/3043474506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815d840 0x7f179806e500 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f178c009870 tx=0x7f178c01c4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- 172.21.15.40:0/3043474506 shutdown_connections 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 --2- 172.21.15.40:0/3043474506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815d840 0x7f179806e500 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 --2- 172.21.15.40:0/3043474506 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f179815aec0 0x7f179806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- 172.21.15.40:0/3043474506 >> 172.21.15.40:0/3043474506 conn(0x7f17980b28f0 msgr2=0x7f17980b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- 172.21.15.40:0/3043474506 shutdown_connections 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- 172.21.15.40:0/3043474506 wait complete. 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 Processor -- start 2023-11-04T01:41:27.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- start start 2023-11-04T01:41:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17980cd7d0 0x7f1798150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 0x7f179815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f179815d840 0x7f1798155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798150cd0 con 0x7f179815aec0 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17981600b0 con 0x7f179815d840 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f179d310640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179815f4a0 con 0x7f17980cd7d0 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f17967fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 0x7f179815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f17967fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 0x7f179815e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58268/0 (socket says 172.21.15.40:58268) 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f17967fc640 1 -- 172.21.15.40:0/1213151079 learned_addr learned my addr 172.21.15.40:0/1213151079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f17977fe640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f179815d840 0x7f1798155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.839+0000 7f1796ffd640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17980cd7d0 0x7f1798150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17967fc640 1 -- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17980cd7d0 msgr2=0x7f1798150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17967fc640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17980cd7d0 0x7f1798150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17967fc640 1 -- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f179815d840 msgr2=0x7f1798155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17967fc640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f179815d840 0x7f1798155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17967fc640 1 -- 172.21.15.40:0/1213151079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0094d0 con 0x7f179815aec0 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17977fe640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f179815d840 0x7f1798155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f17967fc640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 0x7f179815e9e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f178c01ab60 tx=0x7f178c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0bb070 con 0x7f179815aec0 2023-11-04T01:41:27.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0b5630 con 0x7f179815aec0 2023-11-04T01:41:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0b59c0 con 0x7f179815aec0 2023-11-04T01:41:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179815f780 con 0x7f179815aec0 2023-11-04T01:41:27.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179815fd40 con 0x7f179815aec0 2023-11-04T01:41:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17980ce610 con 0x7f179815aec0 2023-11-04T01:41:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f178c0b3070 con 0x7f179815aec0 2023-11-04T01:41:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f177f7fe640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f178c11dfc0 con 0x7f179815aec0 2023-11-04T01:41:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.843+0000 7f1796ffd640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.847+0000 7f1796ffd640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17840664a0 0x7f1784068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f178800b9d0 tx=0x7f1788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:27.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:27.847+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f178c0eb710 con 0x7f179815aec0 2023-11-04T01:41:28.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f17981601f0 con 0x7f179815aec0 2023-11-04T01:41:28.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f177f7fe640 1 -- 172.21.15.40:0/1213151079 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f178c0eed30 con 0x7f179815aec0 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg==", 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ==", 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:41:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw==", 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:41:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:41:28.071 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.071 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.071 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.071 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.071 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-11-04T01:41:28.071 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ==", 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg==", 2023-11-04T01:41:28.072 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg==", 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.074 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.074 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.074 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.074 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.074 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.074 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w==", 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g==", 2023-11-04T01:41:28.075 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA==", 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.076 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg==", 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.077 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w==", 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA==", 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.079 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q==", 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow r", 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-11-04T01:41:28.080 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ==", 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg==", 2023-11-04T01:41:28.081 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw==", 2023-11-04T01:41:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlYH5cAhAAAtiBIRwfeOo/LLvHf3APaQ==", 2023-11-04T01:41:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ==", 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.084 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ==", 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:41:28.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:41:28.086 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.086 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:28.086 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-11-04T01:41:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17840664a0 msgr2=0x7f1784068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17840664a0 0x7f1784068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f178800b9d0 tx=0x7f1788008040 comp rx=0 tx=0).stop 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 msgr2=0x7f179815e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 0x7f179815e9e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f178c01ab60 tx=0x7f178c019250 comp rx=0 tx=0).stop 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 shutdown_connections 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f179815d840 0x7f1798155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f179815aec0 0x7f179815e9e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 --2- 172.21.15.40:0/1213151079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17980cd7d0 0x7f1798150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 >> 172.21.15.40:0/1213151079 conn(0x7f17980b28f0 msgr2=0x7f17980cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.063+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 shutdown_connections 2023-11-04T01:41:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.067+0000 7f179d310640 1 -- 172.21.15.40:0/1213151079 wait complete. 2023-11-04T01:41:28.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:28.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1c0210640 1 Processor -- start 2023-11-04T01:41:28.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1c0210640 1 -- start start 2023-11-04T01:41:28.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1c0210640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 0x7fa1b80ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1c0210640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b8070d90 con 0x7fa1b80b1700 2023-11-04T01:41:28.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1c0210640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b806d4f0 con 0x7fa1b806cd30 2023-11-04T01:41:28.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1c0210640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b806dd90 con 0x7fa1b8159e70 2023-11-04T01:41:28.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1be7ad640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa1b80b1700 0x7fa1b8071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33978/0 (socket says 172.21.15.40:33978) 2023-11-04T01:41:28.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1be7ad640 1 -- 172.21.15.40:0/637059250 learned_addr learned my addr 172.21.15.40:0/637059250 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bdfac640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 0x7fa1b80ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96736613 0 0) 0x7fa1b8070d90 con 0x7fa1b80b1700 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a4003530 con 0x7fa1b80b1700 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629410284 0 0) 0x7fa1a4003530 con 0x7fa1b80b1700 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 msgr2=0x7fa1b80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 0x7fa1b80ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 >> v1:172.21.15.91:6789/0 conn(0x7fa1b806cd30 legacy=0x7fa1b80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b806d7d0 con 0x7fa1b80b1700 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fa1b0001a00 con 0x7fa1b80b1700 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 >> v1:172.21.15.40:6789/0 conn(0x7fa1b80b1700 legacy=0x7fa1b8071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 0x7fa1a40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1a4004d10 0x7fa1a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b806dd90 con 0x7fa1a4003f30 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a400ba70 con 0x7fa1a4004d10 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a400bc30 con 0x7fa1b8159e70 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1be7ad640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1a4004d10 0x7fa1a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bdfac640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 0x7fa1a40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bd7ab640 1 -- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 msgr2=0x7fa1a40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b8159e70 0x7fa1a40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bd7ab640 1 -- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1a4004d10 msgr2=0x7fa1a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1a4004d10 0x7fa1a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.207+0000 7fa1bd7ab640 1 -- 172.21.15.40:0/637059250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4003530 con 0x7fa1a4003f30 2023-11-04T01:41:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1a40047d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001780 tx=0x7fa1a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3dc2d72e921ca2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80052d0 con 0x7fa1a4003f30 2023-11-04T01:41:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a80a7050 con 0x7fa1a4003f30 2023-11-04T01:41:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1bcfaa640 1 -- 172.21.15.40:0/637059250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8003600 con 0x7fa1a4003f30 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1c0210640 1 -- 172.21.15.40:0/637059250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 msgr2=0x7fa1a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1c0210640 1 --2- 172.21.15.40:0/637059250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1a40047d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001780 tx=0x7fa1a801c400 comp rx=0 tx=0).stop 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1be7ad640 1 -- 172.21.15.40:0/637059250 reap_dead start 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1c0210640 1 -- 172.21.15.40:0/637059250 shutdown_connections 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1c0210640 1 -- 172.21.15.40:0/637059250 >> 172.21.15.40:0/637059250 conn(0x7fa1b806e760 msgr2=0x7fa1b806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1c0210640 1 -- 172.21.15.40:0/637059250 shutdown_connections 2023-11-04T01:41:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.211+0000 7fa1c0210640 1 -- 172.21.15.40:0/637059250 wait complete. 2023-11-04T01:41:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 Processor -- start 2023-11-04T01:41:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- start start 2023-11-04T01:41:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1b815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1b80c3580 0x7fa1b80c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b80c5120 0x7fa1b814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80cefe0 con 0x7fa1a4003f30 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8149f60 con 0x7fa1b80c3580 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80c55a0 con 0x7fa1b80c5120 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1b815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1b815a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58292/0 (socket says 172.21.15.40:58292) 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 -- 172.21.15.40:0/2786409433 learned_addr learned my addr 172.21.15.40:0/2786409433 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1be7ad640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b80c5120 0x7fa1b814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1b80c3580 0x7fa1b80c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 -- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b80c5120 msgr2=0x7fa1b814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b80c5120 0x7fa1b814c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 -- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1b80c3580 msgr2=0x7fa1b80c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1b80c3580 0x7fa1b80c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 -- 172.21.15.40:0/2786409433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b814a390 con 0x7fa1a4003f30 2023-11-04T01:41:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1b80c3580 0x7fa1b80c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1be7ad640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b80c5120 0x7fa1b814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1bdfac640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1b815a4b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4011640 tx=0x7fa1b4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400f920 con 0x7fa1a4003f30 2023-11-04T01:41:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400fa80 con 0x7fa1a4003f30 2023-11-04T01:41:28.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400fdf0 con 0x7fa1a4003f30 2023-11-04T01:41:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b814a670 con 0x7fa1a4003f30 2023-11-04T01:41:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b814ac30 con 0x7fa1a4003f30 2023-11-04T01:41:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b80675f0 con 0x7fa1a4003f30 2023-11-04T01:41:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.215+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1b4015460 con 0x7fa1a4003f30 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.219+0000 7fa1ae7fc640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa19c0664d0 0x7fa19c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.219+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa1b4084230 con 0x7fa1a4003f30 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.219+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa19c0664d0 0x7fa19c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.219+0000 7fa1bd7ab640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa19c0664d0 0x7fa19c068990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001750 tx=0x7fa1a80011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.223+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1b4051800 con 0x7fa1a4003f30 2023-11-04T01:41:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.379+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b80726b0 con 0x7fa1a4003f30 2023-11-04T01:41:28.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.379+0000 7fa1ae7fc640 1 -- 172.21.15.40:0/2786409433 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14550 (secure 0 0 0) 0x7fa1b4054e20 con 0x7fa1a4003f30 2023-11-04T01:41:28.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":44,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:27.705354+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:28.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa19c0664d0 msgr2=0x7fa19c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa19c0664d0 0x7fa19c068990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001750 tx=0x7fa1a80011a0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 msgr2=0x7fa1b815a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1b815a4b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4011640 tx=0x7fa1b4011b00 comp rx=0 tx=0).stop 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 shutdown_connections 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa19c0664d0 0x7fa19c068990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1b80c5120 0x7fa1b814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1b80c3580 0x7fa1b80c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 --2- 172.21.15.40:0/2786409433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1a4003f30 0x7fa1b815a4b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 >> 172.21.15.40:0/2786409433 conn(0x7fa1b806e760 msgr2=0x7fa1b80cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 shutdown_connections 2023-11-04T01:41:28.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.383+0000 7fa1c0210640 1 -- 172.21.15.40:0/2786409433 wait complete. 2023-11-04T01:41:28.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:28.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 Processor -- start 2023-11-04T01:41:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 -- start start 2023-11-04T01:41:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1b440b0c20 0x7f1b4415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b4415c160 0x7f1b440ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b440cb130 con 0x7f1b4415acb0 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4415bd40 con 0x7f1b4415c160 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b4a1e7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4406fd80 con 0x7f1b440b0c20 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b437fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1b4415acb0 0x7f1b440b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33994/0 (socket says 172.21.15.40:33994) 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b43fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b4415c160 0x7f1b440ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b437fe640 1 -- 172.21.15.40:0/2055861417 learned_addr learned my addr 172.21.15.40:0/2055861417 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b42ffd640 1 --2- 172.21.15.40:0/2055861417 >> v2:172.21.15.91:3300/0 conn(0x7f1b440b0c20 0x7f1b4415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b43fff640 1 -- 172.21.15.40:0/2055861417 >> v2:172.21.15.91:3300/0 conn(0x7f1b440b0c20 msgr2=0x7f1b4415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b43fff640 1 --2- 172.21.15.40:0/2055861417 >> v2:172.21.15.91:3300/0 conn(0x7f1b440b0c20 0x7f1b4415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b43fff640 1 -- 172.21.15.40:0/2055861417 >> v1:172.21.15.40:6789/0 conn(0x7f1b4415acb0 legacy=0x7f1b440b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.527+0000 7f1b43fff640 1 -- 172.21.15.40:0/2055861417 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4415b680 con 0x7f1b4415c160 2023-11-04T01:41:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b43fff640 1 --2- 172.21.15.40:0/2055861417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b4415c160 0x7f1b440ca490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1b440ce4b0 tx=0x7f1b3c01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7f9deeb4b60888 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b427fc640 1 -- 172.21.15.40:0/2055861417 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0a57d0 con 0x7f1b4415c160 2023-11-04T01:41:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b427fc640 1 -- 172.21.15.40:0/2055861417 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c0a5930 con 0x7f1b4415c160 2023-11-04T01:41:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b427fc640 1 -- 172.21.15.40:0/2055861417 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0a5cc0 con 0x7f1b4415c160 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/2055861417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b4415c160 msgr2=0x7f1b440ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/2055861417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b4415c160 0x7f1b440ca490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1b440ce4b0 tx=0x7f1b3c01c770 comp rx=0 tx=0).stop 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/2055861417 shutdown_connections 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/2055861417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b4415c160 0x7f1b440ca490 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/2055861417 >> v2:172.21.15.91:3300/0 conn(0x7f1b440b0c20 0x7f1b4415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/2055861417 >> 172.21.15.40:0/2055861417 conn(0x7f1b440cb510 msgr2=0x7f1b440cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/2055861417 shutdown_connections 2023-11-04T01:41:28.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/2055861417 wait complete. 2023-11-04T01:41:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 Processor -- start 2023-11-04T01:41:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.531+0000 7f1b4a1e7640 1 -- start start 2023-11-04T01:41:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 0x7f1b44151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4415acb0 0x7f1b4406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1b4415c160 0x7f1b440b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44152370 con 0x7f1b440b0c20 2023-11-04T01:41:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4406bc40 con 0x7f1b4415acb0 2023-11-04T01:41:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4406bf20 con 0x7f1b4415c160 2023-11-04T01:41:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 0x7f1b44151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 0x7f1b44151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58314/0 (socket says 172.21.15.40:58314) 2023-11-04T01:41:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 -- 172.21.15.40:0/1818898528 learned_addr learned my addr 172.21.15.40:0/1818898528 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 -- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1b4415c160 msgr2=0x7f1b440b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1b4415c160 0x7f1b440b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 -- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4415acb0 msgr2=0x7f1b4406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4415acb0 0x7f1b4406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 -- 172.21.15.40:0/1818898528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c009a70 con 0x7f1b440b0c20 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b437fe640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 0x7f1b44151a70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c780 tx=0x7f1b3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340074e0 con 0x7f1b440b0c20 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34007640 con 0x7f1b440b0c20 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4406c200 con 0x7f1b440b0c20 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34004a30 con 0x7f1b440b0c20 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4406c7c0 con 0x7f1b440b0c20 2023-11-04T01:41:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4406c9e0 con 0x7f1b440b0c20 2023-11-04T01:41:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b34004b90 con 0x7f1b440b0c20 2023-11-04T01:41:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b2bfff640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1b300664a0 0x7f1b30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1b340832f0 con 0x7f1b440b0c20 2023-11-04T01:41:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.535+0000 7f1b42ffd640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1b300664a0 0x7f1b30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.539+0000 7f1b42ffd640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1b300664a0 0x7f1b30068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1b440ad4d0 tx=0x7f1b38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.539+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b340509f0 con 0x7f1b440b0c20 2023-11-04T01:41:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.699+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b440744a0 con 0x7f1b440b0c20 2023-11-04T01:41:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.699+0000 7f1b2bfff640 1 -- 172.21.15.40:0/1818898528 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b34018020 con 0x7f1b440b0c20 2023-11-04T01:41:28.705 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:28.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1b300664a0 msgr2=0x7f1b30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1b300664a0 0x7f1b30068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1b440ad4d0 tx=0x7f1b38008040 comp rx=0 tx=0).stop 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 msgr2=0x7f1b44151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 0x7f1b44151a70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c780 tx=0x7f1b3400cc40 comp rx=0 tx=0).stop 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 shutdown_connections 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1b300664a0 0x7f1b30068960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1b4415c160 0x7f1b440b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1b4415acb0 0x7f1b4406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 --2- 172.21.15.40:0/1818898528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b440b0c20 0x7f1b44151a70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 >> 172.21.15.40:0/1818898528 conn(0x7f1b440cb510 msgr2=0x7f1b44152e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 shutdown_connections 2023-11-04T01:41:28.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.703+0000 7f1b4a1e7640 1 -- 172.21.15.40:0/1818898528 wait complete. 2023-11-04T01:41:28.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31b4bdb640 1 Processor -- start 2023-11-04T01:41:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31b4bdb640 1 -- start start 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31b4bdb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31b015c160 0x7f31b015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31b4bdb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b00cb130 con 0x7f31b015acb0 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31b4bdb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b015b680 con 0x7f31b00b0c20 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31b4bdb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b015bd40 con 0x7f31b015c160 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31aed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31b015c160 0x7f31b015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31ae59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31b015acb0 0x7f31b00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34010/0 (socket says 172.21.15.40:34010) 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31ae59c640 1 -- 172.21.15.40:0/2848842487 learned_addr learned my addr 172.21.15.40:0/2848842487 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31aed9d640 1 -- 172.21.15.40:0/2848842487 >> v1:172.21.15.91:6789/0 conn(0x7f31b00b0c20 legacy=0x7f31b00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31aed9d640 1 -- 172.21.15.40:0/2848842487 >> v1:172.21.15.40:6789/0 conn(0x7f31b015acb0 legacy=0x7f31b00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.851+0000 7f31aed9d640 1 -- 172.21.15.40:0/2848842487 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b015b960 con 0x7f31b015c160 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 --2- 172.21.15.40:0/2848842487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b015b090 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009d90 tx=0x7f31a801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bff2df56c9286 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31ad59a640 1 -- 172.21.15.40:0/2848842487 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80a58e0 con 0x7f31b015c160 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31ad59a640 1 -- 172.21.15.40:0/2848842487 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a80a5a40 con 0x7f31b015c160 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31ad59a640 1 -- 172.21.15.40:0/2848842487 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80a5dd0 con 0x7f31b015c160 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- 172.21.15.40:0/2848842487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 msgr2=0x7f31b015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/2848842487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b015b090 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009d90 tx=0x7f31a801c910 comp rx=0 tx=0).stop 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- 172.21.15.40:0/2848842487 shutdown_connections 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/2848842487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b015b090 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- 172.21.15.40:0/2848842487 >> 172.21.15.40:0/2848842487 conn(0x7f31b00cb510 msgr2=0x7f31b00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- 172.21.15.40:0/2848842487 shutdown_connections 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- 172.21.15.40:0/2848842487 wait complete. 2023-11-04T01:41:28.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 Processor -- start 2023-11-04T01:41:28.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- start start 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31b00b0c20 0x7f31b014c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31b015acb0 0x7f31b00c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b00c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00c8ae0 con 0x7f31b015c160 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0152270 con 0x7f31b00b0c20 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31b4bdb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0152530 con 0x7f31b015acb0 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b00c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b00c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58322/0 (socket says 172.21.15.40:58322) 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 -- 172.21.15.40:0/4063109811 learned_addr learned my addr 172.21.15.40:0/4063109811 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31ae59c640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31b00b0c20 0x7f31b014c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31add9b640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31b015acb0 0x7f31b00c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 -- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31b015acb0 msgr2=0x7f31b00c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31b015acb0 0x7f31b00c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 -- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31b00b0c20 msgr2=0x7f31b014c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31b00b0c20 0x7f31b014c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31aed9d640 1 -- 172.21.15.40:0/4063109811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8009a70 con 0x7f31b015c160 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.855+0000 7f31ae59c640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31b00b0c20 0x7f31b014c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f31aed9d640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b00c85a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f31a801a540 tx=0x7f31a80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80adb80 con 0x7f31b015c160 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a80adce0 con 0x7f31b015c160 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80b7610 con 0x7f31b015c160 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b0152810 con 0x7f31b015c160 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b0152dd0 con 0x7f31b015c160 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b0152fc0 con 0x7f31b015c160 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31a80b4050 con 0x7f31b015c160 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f319effd640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31900664a0 0x7f3190068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f31a811ee50 con 0x7f31b015c160 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f31ae59c640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31900664a0 0x7f3190068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.859+0000 7f31ae59c640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31900664a0 0x7f3190068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f31a0005890 tx=0x7f31a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:28.863+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31a80ec5e0 con 0x7f31b015c160 2023-11-04T01:41:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.019+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f31b0152fc0 con 0x7f31b015c160 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f319effd640 1 -- 172.21.15.40:0/4063109811 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v44) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31a80efc00 con 0x7f31b015c160 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31900664a0 msgr2=0x7f3190068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31900664a0 0x7f3190068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f31a0005890 tx=0x7f31a0009040 comp rx=0 tx=0).stop 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 msgr2=0x7f31b00c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b00c85a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f31a801a540 tx=0x7f31a80196b0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 shutdown_connections 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31900664a0 0x7f3190068960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b015c160 0x7f31b00c85a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31b015acb0 0x7f31b00c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 --2- 172.21.15.40:0/4063109811 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31b00b0c20 0x7f31b014c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 >> 172.21.15.40:0/4063109811 conn(0x7f31b00cb510 msgr2=0x7f31b015c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 shutdown_connections 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.023+0000 7f31b4bdb640 1 -- 172.21.15.40:0/4063109811 wait complete. 2023-11-04T01:41:29.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:41:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 Processor -- start 2023-11-04T01:41:29.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 -- start start 2023-11-04T01:41:29.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67800b4990 0x7f67800b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f67800d0690 0x7f67800cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800b6070 con 0x7f67800d0ae0 2023-11-04T01:41:29.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800b8ed0 con 0x7f67800b4990 2023-11-04T01:41:29.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f678567e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800b52b0 con 0x7f67800d0690 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67800b4990 0x7f67800b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67800b4990 0x7f67800b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58328/0 (socket says 172.21.15.40:58328) 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 -- 172.21.15.40:0/3105029488 learned_addr learned my addr 172.21.15.40:0/3105029488 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677f7fe640 1 --1- 172.21.15.40:0/3105029488 >> v1:172.21.15.40:6789/0 conn(0x7f67800d0ae0 0x7f67800cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34018/0 (socket says 172.21.15.40:34018) 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677e7fc640 1 --2- 172.21.15.40:0/3105029488 >> v2:172.21.15.91:3300/0 conn(0x7f67800d0690 0x7f67800cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 -- 172.21.15.40:0/3105029488 >> v2:172.21.15.91:3300/0 conn(0x7f67800d0690 msgr2=0x7f67800cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 --2- 172.21.15.40:0/3105029488 >> v2:172.21.15.91:3300/0 conn(0x7f67800d0690 0x7f67800cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 -- 172.21.15.40:0/3105029488 >> v1:172.21.15.40:6789/0 conn(0x7f67800d0ae0 legacy=0x7f67800cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677effd640 1 -- 172.21.15.40:0/3105029488 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800d1ce0 con 0x7f67800b4990 2023-11-04T01:41:29.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.163+0000 7f677e7fc640 1 --2- 172.21.15.40:0/3105029488 >> v2:172.21.15.91:3300/0 conn(0x7f67800d0690 0x7f67800cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 --2- 172.21.15.40:0/3105029488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f67800b4d70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f678008c090 tx=0x7f677001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b12691b3f2489f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677dffb640 1 -- 172.21.15.40:0/3105029488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700a89f0 con 0x7f67800b4990 2023-11-04T01:41:29.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677dffb640 1 -- 172.21.15.40:0/3105029488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700a8b50 con 0x7f67800b4990 2023-11-04T01:41:29.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677dffb640 1 -- 172.21.15.40:0/3105029488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700b0440 con 0x7f67800b4990 2023-11-04T01:41:29.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- 172.21.15.40:0/3105029488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 msgr2=0x7f67800b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 --2- 172.21.15.40:0/3105029488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f67800b4d70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f678008c090 tx=0x7f677001ecf0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- 172.21.15.40:0/3105029488 shutdown_connections 2023-11-04T01:41:29.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 --2- 172.21.15.40:0/3105029488 >> v2:172.21.15.91:3300/0 conn(0x7f67800d0690 0x7f67800cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 --2- 172.21.15.40:0/3105029488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f67800b4d70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- 172.21.15.40:0/3105029488 >> 172.21.15.40:0/3105029488 conn(0x7f67800cf990 msgr2=0x7f67800cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- 172.21.15.40:0/3105029488 shutdown_connections 2023-11-04T01:41:29.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- 172.21.15.40:0/3105029488 wait complete. 2023-11-04T01:41:29.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 Processor -- start 2023-11-04T01:41:29.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- start start 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f6780157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f67800d0690 0x7f678014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800d0ae0 0x7f67800ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780157ae0 con 0x7f67800b4990 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780157840 con 0x7f67800d0ae0 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f678567e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678014a9e0 con 0x7f67800d0690 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f6780157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f6780157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58334/0 (socket says 172.21.15.40:58334) 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 -- 172.21.15.40:0/797230170 learned_addr learned my addr 172.21.15.40:0/797230170 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:29.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677e7fc640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f67800d0690 0x7f678014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677f7fe640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800d0ae0 0x7f67800ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 -- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f67800d0690 msgr2=0x7f678014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f67800d0690 0x7f678014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 -- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800d0ae0 msgr2=0x7f67800ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800d0ae0 0x7f67800ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677effd640 1 -- 172.21.15.40:0/797230170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700094d0 con 0x7f67800b4990 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.167+0000 7f677f7fe640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800d0ae0 0x7f67800ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f677effd640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f6780157300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f677001b900 tx=0x7f677001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700a89f0 con 0x7f67800b4990 2023-11-04T01:41:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700b9410 con 0x7f67800b4990 2023-11-04T01:41:29.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67800cbda0 con 0x7f67800b4990 2023-11-04T01:41:29.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700b97a0 con 0x7f67800b4990 2023-11-04T01:41:29.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800cc360 con 0x7f67800b4990 2023-11-04T01:41:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67800744a0 con 0x7f67800b4990 2023-11-04T01:41:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67700b7040 con 0x7f67800b4990 2023-11-04T01:41:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f67777fe640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67600664a0 0x7f6760068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f67701224b0 con 0x7f67800b4990 2023-11-04T01:41:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f677e7fc640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67600664a0 0x7f6760068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.171+0000 7f677e7fc640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67600664a0 0x7f6760068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f67800cb740 tx=0x7f6768008430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.175+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f67700efbb0 con 0x7f67800b4990 2023-11-04T01:41:29.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.335+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f67800ce660 con 0x7f67800b4990 2023-11-04T01:41:29.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f67777fe640 1 -- 172.21.15.40:0/797230170 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+137 (secure 0 0 0) 0x7f67700b5070 con 0x7f67800b4990 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 6, 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "snap-test-pool" 2023-11-04T01:41:29.343 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67600664a0 msgr2=0x7f6760068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67600664a0 0x7f6760068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f67800cb740 tx=0x7f6768008430 comp rx=0 tx=0).stop 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 msgr2=0x7f6780157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f6780157300 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f677001b900 tx=0x7f677001ba90 comp rx=0 tx=0).stop 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 shutdown_connections 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67600664a0 0x7f6760068960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67800d0ae0 0x7f67800ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f67800d0690 0x7f678014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 --2- 172.21.15.40:0/797230170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67800b4990 0x7f6780157300 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 >> 172.21.15.40:0/797230170 conn(0x7f67800cf990 msgr2=0x7f67800b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 shutdown_connections 2023-11-04T01:41:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.339+0000 7f678567e640 1 -- 172.21.15.40:0/797230170 wait complete. 2023-11-04T01:41:29.362 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:41:29.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:41:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d29a7640 1 Processor -- start 2023-11-04T01:41:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d29a7640 1 -- start start 2023-11-04T01:41:29.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d29a7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 0x7f11cc06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d29a7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc0cb220 con 0x7f11cc0ca440 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d29a7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc15f8a0 con 0x7f11cc15ae60 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d29a7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc15ea00 con 0x7f11cc06b320 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f11cc0ca440 0x7f11cc15f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34030/0 (socket says 172.21.15.40:34030) 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 -- 172.21.15.40:0/1502050188 learned_addr learned my addr 172.21.15.40:0/1502050188 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d0f44640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 0x7f11cc06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963132142 0 0) 0x7f11c0001120 con 0x7f11cc0ca440 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b4003530 con 0x7f11cc0ca440 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2992338478 0 0) 0x7f11b4003530 con 0x7f11cc0ca440 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 msgr2=0x7f11cc06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 0x7f11cc06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 >> v1:172.21.15.91:6789/0 conn(0x7f11cc15ae60 legacy=0x7f11cc0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc15b240 con 0x7f11cc0ca440 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f11c0001830 con 0x7f11cc0ca440 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 >> v1:172.21.15.40:6789/0 conn(0x7f11cc0ca440 legacy=0x7f11cc15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 0x7f11b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4003f30 0x7f11b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4004d10 0x7f11b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc15ea00 con 0x7f11b4003f30 2023-11-04T01:41:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b400ba70 con 0x7f11b4004d10 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b400bc30 con 0x7f11cc06b320 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4003f30 0x7f11b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cbfff640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 0x7f11b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d0f44640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4004d10 0x7f11b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 -- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 msgr2=0x7f11b40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc06b320 0x7f11b40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 -- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4004d10 msgr2=0x7f11b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4004d10 0x7f11b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11cb7fe640 1 -- 172.21.15.40:0/1502050188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4003530 con 0x7f11b4003f30 2023-11-04T01:41:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.483+0000 7f11d0f44640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4004d10 0x7f11b4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4003f30 0x7f11b40047d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0b4550 tx=0x7f11c001f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94996be576c2be1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0005ae0 con 0x7f11b4003f30 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00ab070 con 0x7f11b4003f30 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11caffd640 1 -- 172.21.15.40:0/1502050188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0005e80 con 0x7f11b4003f30 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 -- 172.21.15.40:0/1502050188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4003f30 msgr2=0x7f11b40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 --2- 172.21.15.40:0/1502050188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b4003f30 0x7f11b40047d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0b4550 tx=0x7f11c001f330 comp rx=0 tx=0).stop 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d0f44640 1 -- 172.21.15.40:0/1502050188 reap_dead start 2023-11-04T01:41:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 -- 172.21.15.40:0/1502050188 shutdown_connections 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 -- 172.21.15.40:0/1502050188 >> 172.21.15.40:0/1502050188 conn(0x7f11cc0b0630 msgr2=0x7f11cc0b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 -- 172.21.15.40:0/1502050188 shutdown_connections 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 -- 172.21.15.40:0/1502050188 wait complete. 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 Processor -- start 2023-11-04T01:41:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.487+0000 7f11d29a7640 1 -- start start 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4003f30 0x7f11cc1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 0x7f11cc0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc14aed0 0x7f11cc159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1f2e60 con 0x7f11cc14b6e0 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0c4670 con 0x7f11b4003f30 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1f21e0 con 0x7f11cc14aed0 2023-11-04T01:41:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 0x7f11cc0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 0x7f11cc0c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58352/0 (socket says 172.21.15.40:58352) 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 -- 172.21.15.40:0/4225416705 learned_addr learned my addr 172.21.15.40:0/4225416705 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cbfff640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4003f30 0x7f11cc1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d0f44640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc14aed0 0x7f11cc159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 -- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc14aed0 msgr2=0x7f11cc159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc14aed0 0x7f11cc159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 -- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4003f30 msgr2=0x7f11cc1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4003f30 0x7f11cc1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 -- 172.21.15.40:0/4225416705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc1f24c0 con 0x7f11cc14b6e0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cb7fe640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 0x7f11cc0c4130 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f11c0025fa0 tx=0x7f11b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00049f0 con 0x7f11cc14b6e0 2023-11-04T01:41:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00b6040 con 0x7f11cc14b6e0 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc1f27a0 con 0x7f11cc14b6e0 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0004d90 con 0x7f11cc14b6e0 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc159fc0 con 0x7f11cc14b6e0 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc0744a0 con 0x7f11cc14b6e0 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11c0007070 con 0x7f11cc14b6e0 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11c8ff9640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11b80664a0 0x7f11b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11c0120900 con 0x7f11cc14b6e0 2023-11-04T01:41:29.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.491+0000 7f11cbfff640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11b80664a0 0x7f11b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.495+0000 7f11cbfff640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11b80664a0 0x7f11b8068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005450 tx=0x7f11bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.495+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11c00eded0 con 0x7f11cc14b6e0 2023-11-04T01:41:29.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.655+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f11cc0cb220 con 0x7f11cc14b6e0 2023-11-04T01:41:29.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.711+0000 7f11c8ff9640 1 -- 172.21.15.40:0/4225416705 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f11cc0cb220 con 0x7f11cc14b6e0 2023-11-04T01:41:29.717 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-11-04T01:41:29.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11b80664a0 msgr2=0x7f11b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11b80664a0 0x7f11b8068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005450 tx=0x7f11bc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:29.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 msgr2=0x7f11cc0c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 0x7f11cc0c4130 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f11c0025fa0 tx=0x7f11b4005800 comp rx=0 tx=0).stop 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 shutdown_connections 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11b80664a0 0x7f11b8068960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11cc14aed0 0x7f11cc159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11cc14b6e0 0x7f11cc0c4130 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 --2- 172.21.15.40:0/4225416705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11b4003f30 0x7f11cc1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 >> 172.21.15.40:0/4225416705 conn(0x7f11cc0b0630 msgr2=0x7f11cc06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 shutdown_connections 2023-11-04T01:41:29.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.715+0000 7f11d29a7640 1 -- 172.21.15.40:0/4225416705 wait complete. 2023-11-04T01:41:29.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:41:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 Processor -- start 2023-11-04T01:41:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 -- start start 2023-11-04T01:41:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f859415af30 0x7f85940ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f85940ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f85940711f0 0x7f8594071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859406fc10 con 0x7f859415af30 2023-11-04T01:41:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85940c8fa0 con 0x7f85940711f0 2023-11-04T01:41:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859bd1e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c9840 con 0x7f85940c9cd0 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f859415af30 0x7f85940ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f859415af30 0x7f85940ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58354/0 (socket says 172.21.15.40:58354) 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 -- 172.21.15.40:0/4122355171 learned_addr learned my addr 172.21.15.40:0/4122355171 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f85992b9640 1 --2- 172.21.15.40:0/4122355171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f85940ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f859a2bb640 1 --2- 172.21.15.40:0/4122355171 >> v2:172.21.15.91:3300/0 conn(0x7f85940711f0 0x7f8594071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 -- 172.21.15.40:0/4122355171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 msgr2=0x7f85940ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 --2- 172.21.15.40:0/4122355171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f85940ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 -- 172.21.15.40:0/4122355171 >> v2:172.21.15.91:3300/0 conn(0x7f85940711f0 msgr2=0x7f8594071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 --2- 172.21.15.40:0/4122355171 >> v2:172.21.15.91:3300/0 conn(0x7f85940711f0 0x7f8594071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.871+0000 7f8599aba640 1 -- 172.21.15.40:0/4122355171 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859415b310 con 0x7f859415af30 2023-11-04T01:41:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f8599aba640 1 --2- 172.21.15.40:0/4122355171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f85940ca3c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85940ce7e0 tx=0x7f859001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c3013992028803 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f8598ab8640 1 -- 172.21.15.40:0/4122355171 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900ab600 con 0x7f859415af30 2023-11-04T01:41:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f8598ab8640 1 -- 172.21.15.40:0/4122355171 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900ab760 con 0x7f859415af30 2023-11-04T01:41:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f8598ab8640 1 -- 172.21.15.40:0/4122355171 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900abaf0 con 0x7f859415af30 2023-11-04T01:41:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- 172.21.15.40:0/4122355171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 msgr2=0x7f85940ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- 172.21.15.40:0/4122355171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f85940ca3c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85940ce7e0 tx=0x7f859001c440 comp rx=0 tx=0).stop 2023-11-04T01:41:29.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- 172.21.15.40:0/4122355171 shutdown_connections 2023-11-04T01:41:29.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- 172.21.15.40:0/4122355171 >> v2:172.21.15.91:3300/0 conn(0x7f85940711f0 0x7f8594071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- 172.21.15.40:0/4122355171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f85940ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- 172.21.15.40:0/4122355171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f85940ca3c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- 172.21.15.40:0/4122355171 >> 172.21.15.40:0/4122355171 conn(0x7f85940ce9e0 msgr2=0x7f85940cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- 172.21.15.40:0/4122355171 shutdown_connections 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- 172.21.15.40:0/4122355171 wait complete. 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 Processor -- start 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- start start 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85940711f0 0x7f85940c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f8594152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f8594150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594148e90 con 0x7f859415af30 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594150d40 con 0x7f85940711f0 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.875+0000 7f859bd1e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c37b0 con 0x7f85940c9cd0 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f8594150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f8594150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58370/0 (socket says 172.21.15.40:58370) 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 -- 172.21.15.40:0/1925388827 learned_addr learned my addr 172.21.15.40:0/1925388827 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f8599aba640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85940711f0 0x7f85940c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f85992b9640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f8594152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 -- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 msgr2=0x7f8594152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f8594152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 -- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85940711f0 msgr2=0x7f85940c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85940711f0 0x7f85940c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 -- 172.21.15.40:0/1925388827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900094d0 con 0x7f859415af30 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859a2bb640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f8594150160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f858c007e40 tx=0x7f858c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c014620 con 0x7f859415af30 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00ee90 con 0x7f859415af30 2023-11-04T01:41:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0149e0 con 0x7f859415af30 2023-11-04T01:41:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940c3a90 con 0x7f859415af30 2023-11-04T01:41:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940c47d0 con 0x7f859415af30 2023-11-04T01:41:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85940c3fb0 con 0x7f859415af30 2023-11-04T01:41:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f858c014b40 con 0x7f859415af30 2023-11-04T01:41:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f858a7fc640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85780664a0 0x7f8578068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f858c085470 con 0x7f859415af30 2023-11-04T01:41:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.879+0000 7f8599aba640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85780664a0 0x7f8578068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.883+0000 7f8599aba640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85780664a0 0x7f8578068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85900af000 tx=0x7f85900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:29.883+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f858c052a50 con 0x7f859415af30 2023-11-04T01:41:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.039+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f85940c3fb0 con 0x7f859415af30 2023-11-04T01:41:30.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.723+0000 7f858a7fc640 1 -- 172.21.15.40:0/1925388827 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f85940c3fb0 con 0x7f859415af30 2023-11-04T01:41:30.729 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-11-04T01:41:30.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85780664a0 msgr2=0x7f8578068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85780664a0 0x7f8578068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85900af000 tx=0x7f85900a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:30.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 msgr2=0x7f8594150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f8594150160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f858c007e40 tx=0x7f858c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 shutdown_connections 2023-11-04T01:41:30.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85780664a0 0x7f8578068960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859415af30 0x7f8594150160 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f85940c9cd0 0x7f8594152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 --2- 172.21.15.40:0/1925388827 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f85940711f0 0x7f85940c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 >> 172.21.15.40:0/1925388827 conn(0x7f85940ce9e0 msgr2=0x7f85941564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 shutdown_connections 2023-11-04T01:41:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.727+0000 7f859bd1e640 1 -- 172.21.15.40:0/1925388827 wait complete. 2023-11-04T01:41:30.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:41:30.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.891+0000 7f228ba5c640 1 Processor -- start 2023-11-04T01:41:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.891+0000 7f228ba5c640 1 -- start start 2023-11-04T01:41:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f228ba5c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22840b32f0 0x7f22840cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f228ba5c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f22840cf4c0 0x7f22840d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f228ba5c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840cd830 con 0x7f228415af50 2023-11-04T01:41:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f228ba5c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22840b3780 con 0x7f22840b32f0 2023-11-04T01:41:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f228ba5c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22840cdad0 con 0x7f22840cf4c0 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2288ff7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22840b32f0 0x7f22840cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f22897f8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f228415af50 0x7f22840ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34042/0 (socket says 172.21.15.40:34042) 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f22897f8640 1 -- 172.21.15.40:0/1284417508 learned_addr learned my addr 172.21.15.40:0/1284417508 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2289ff9640 1 --2- 172.21.15.40:0/1284417508 >> v2:172.21.15.91:3300/0 conn(0x7f22840cf4c0 0x7f22840d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2288ff7640 1 -- 172.21.15.40:0/1284417508 >> v2:172.21.15.91:3300/0 conn(0x7f22840cf4c0 msgr2=0x7f22840d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2288ff7640 1 --2- 172.21.15.40:0/1284417508 >> v2:172.21.15.91:3300/0 conn(0x7f22840cf4c0 0x7f22840d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f227bfff640 1 -- 172.21.15.40:0/1284417508 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889358107 0 0) 0x7f22840cd830 con 0x7f228415af50 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2288ff7640 1 -- 172.21.15.40:0/1284417508 >> v1:172.21.15.40:6789/0 conn(0x7f228415af50 legacy=0x7f22840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2288ff7640 1 -- 172.21.15.40:0/1284417508 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840cddb0 con 0x7f22840b32f0 2023-11-04T01:41:30.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f2288ff7640 1 --2- 172.21.15.40:0/1284417508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22840b32f0 0x7f22840cb330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2284066a00 tx=0x7f227401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f6fde669541753 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f227bfff640 1 -- 172.21.15.40:0/1284417508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740ab5f0 con 0x7f22840b32f0 2023-11-04T01:41:30.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f227bfff640 1 -- 172.21.15.40:0/1284417508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22740ab750 con 0x7f22840b32f0 2023-11-04T01:41:30.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.895+0000 7f227bfff640 1 -- 172.21.15.40:0/1284417508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740abae0 con 0x7f22840b32f0 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/1284417508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22840b32f0 msgr2=0x7f22840cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 --2- 172.21.15.40:0/1284417508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22840b32f0 0x7f22840cb330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2284066a00 tx=0x7f227401c3d0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/1284417508 shutdown_connections 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 --2- 172.21.15.40:0/1284417508 >> v2:172.21.15.91:3300/0 conn(0x7f22840cf4c0 0x7f22840d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 --2- 172.21.15.40:0/1284417508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22840b32f0 0x7f22840cb330 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/1284417508 >> 172.21.15.40:0/1284417508 conn(0x7f2284065dc0 msgr2=0x7f22840661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/1284417508 shutdown_connections 2023-11-04T01:41:30.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/1284417508 wait complete. 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 Processor -- start 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- start start 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22840cf4c0 0x7f2284154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 0x7f2284159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f22840b58a0 0x7f22841521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841531a0 con 0x7f228415af50 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284153480 con 0x7f22840cf4c0 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2284153760 con 0x7f22840b58a0 2023-11-04T01:41:30.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 0x7f2284159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 0x7f2284159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58386/0 (socket says 172.21.15.40:58386) 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 -- 172.21.15.40:0/3122593759 learned_addr learned my addr 172.21.15.40:0/3122593759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f22897f8640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22840cf4c0 0x7f2284154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 -- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f22840b58a0 msgr2=0x7f22841521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2289ff9640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f22840b58a0 0x7f22841521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f22840b58a0 0x7f22841521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 -- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22840cf4c0 msgr2=0x7f2284154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22840cf4c0 0x7f2284154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 -- 172.21.15.40:0/3122593759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009420 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f22897f8640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22840cf4c0 0x7f2284154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2288ff7640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 0x7f2284159830 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2274018fe0 tx=0x7f227401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740bf410 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22740bf570 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2284153a40 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740bf920 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.899+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2284152dc0 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.903+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2284152f50 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.903+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22740b5400 con 0x7f228415af50 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.903+0000 7f2279ffb640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f22680664d0 0x7f2268068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.903+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f22740a8050 con 0x7f228415af50 2023-11-04T01:41:30.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.903+0000 7f22897f8640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f22680664d0 0x7f2268068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.903+0000 7f22897f8640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f22680664d0 0x7f2268068990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f22800016c0 tx=0x7f2280009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:30.907+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22740eb970 con 0x7f228415af50 2023-11-04T01:41:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.099+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f22840675f0 con 0x7f228415af50 2023-11-04T01:41:31.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.747+0000 7f2279ffb640 1 -- 172.21.15.40:0/3122593759 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f22740eef90 con 0x7f228415af50 2023-11-04T01:41:31.754 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 7 and data pool 8 2023-11-04T01:41:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f22680664d0 msgr2=0x7f2268068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f22680664d0 0x7f2268068990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f22800016c0 tx=0x7f2280009040 comp rx=0 tx=0).stop 2023-11-04T01:41:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 msgr2=0x7f2284159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 0x7f2284159830 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2274018fe0 tx=0x7f227401ac10 comp rx=0 tx=0).stop 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 shutdown_connections 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f22680664d0 0x7f2268068990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f22840b58a0 0x7f22841521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f228415af50 0x7f2284159830 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 --2- 172.21.15.40:0/3122593759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f22840cf4c0 0x7f2284154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 >> 172.21.15.40:0/3122593759 conn(0x7f2284065dc0 msgr2=0x7f22840cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 shutdown_connections 2023-11-04T01:41:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.759+0000 7f228ba5c640 1 -- 172.21.15.40:0/3122593759 wait complete. 2023-11-04T01:41:31.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 Processor -- start 2023-11-04T01:41:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 -- start start 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9c040d0690 0x7f9c040b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c040d0ae0 0x7f9c040b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c040b6070 con 0x7f9c040b4990 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040b8ed0 con 0x7f9c040d0ae0 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c0a0e3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040d1ce0 con 0x7f9c040d0690 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c040d0ae0 0x7f9c040b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c040d0ae0 0x7f9c040b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58388/0 (socket says 172.21.15.40:58388) 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 -- 172.21.15.40:0/1812479157 learned_addr learned my addr 172.21.15.40:0/1812479157 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c02ffd640 1 --2- 172.21.15.40:0/1812479157 >> v2:172.21.15.91:3300/0 conn(0x7f9c040d0690 0x7f9c040b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 -- 172.21.15.40:0/1812479157 >> v2:172.21.15.91:3300/0 conn(0x7f9c040d0690 msgr2=0x7f9c040b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 --2- 172.21.15.40:0/1812479157 >> v2:172.21.15.91:3300/0 conn(0x7f9c040d0690 0x7f9c040b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 -- 172.21.15.40:0/1812479157 >> v1:172.21.15.91:6789/0 conn(0x7f9c040b4990 legacy=0x7f9c040b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c03fff640 1 -- 172.21.15.40:0/1812479157 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040d1fc0 con 0x7f9c040d0ae0 2023-11-04T01:41:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.911+0000 7f9c02ffd640 1 --2- 172.21.15.40:0/1812479157 >> v2:172.21.15.91:3300/0 conn(0x7f9c040d0690 0x7f9c040b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c03fff640 1 --2- 172.21.15.40:0/1812479157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040d0ae0 0x7f9c040b6a20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9c0408c090 tx=0x7f9bfc01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded79ed840a02927 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c027fc640 1 -- 172.21.15.40:0/1812479157 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0af400 con 0x7f9c040d0ae0 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c027fc640 1 -- 172.21.15.40:0/1812479157 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc0ab050 con 0x7f9c040d0ae0 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c027fc640 1 -- 172.21.15.40:0/1812479157 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0af780 con 0x7f9c040d0ae0 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1812479157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040d0ae0 msgr2=0x7f9c040b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1812479157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040d0ae0 0x7f9c040b6a20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9c0408c090 tx=0x7f9bfc01f180 comp rx=0 tx=0).stop 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1812479157 shutdown_connections 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1812479157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040d0ae0 0x7f9c040b6a20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1812479157 >> v2:172.21.15.91:3300/0 conn(0x7f9c040d0690 0x7f9c040b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1812479157 >> 172.21.15.40:0/1812479157 conn(0x7f9c040cf990 msgr2=0x7f9c040cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1812479157 shutdown_connections 2023-11-04T01:41:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1812479157 wait complete. 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 Processor -- start 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- start start 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 0x7f9c0415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c040d0690 0x7f9c041f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c040d0ae0 0x7f9c0415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0415e6c0 con 0x7f9c040b4990 2023-11-04T01:41:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c041f38e0 con 0x7f9c040d0690 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c0a0e3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0415f090 con 0x7f9c040d0ae0 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 0x7f9c0415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 0x7f9c0415d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58400/0 (socket says 172.21.15.40:58400) 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 -- 172.21.15.40:0/1853568902 learned_addr learned my addr 172.21.15.40:0/1853568902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c03fff640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c040d0ae0 0x7f9c0415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c02ffd640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c040d0690 0x7f9c041f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 -- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c040d0ae0 msgr2=0x7f9c0415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c040d0ae0 0x7f9c0415eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 -- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c040d0690 msgr2=0x7f9c041f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c040d0690 0x7f9c041f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 -- 172.21.15.40:0/1853568902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009b30 con 0x7f9c040b4990 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9c037fe640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 0x7f9c0415d4d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b440 tx=0x7f9bf400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4011890 con 0x7f9c040b4990 2023-11-04T01:41:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.915+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40119f0 con 0x7f9c040b4990 2023-11-04T01:41:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0415dab0 con 0x7f9c040b4990 2023-11-04T01:41:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4011da0 con 0x7f9c040b4990 2023-11-04T01:41:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0415e070 con 0x7f9c040b4990 2023-11-04T01:41:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c040744a0 con 0x7f9c040b4990 2023-11-04T01:41:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bf401a400 con 0x7f9c040b4990 2023-11-04T01:41:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9bebfff640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bf00664a0 0x7f9bf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9bf4084320 con 0x7f9c040b4990 2023-11-04T01:41:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9c02ffd640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bf00664a0 0x7f9bf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.919+0000 7f9c02ffd640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bf00664a0 0x7f9bf0068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8006fd0 tx=0x7f9bf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:31.923+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9bf40516f0 con 0x7f9c040b4990 2023-11-04T01:41:32.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.079+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c040b8260 con 0x7f9c040b4990 2023-11-04T01:41:32.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9bebfff640 1 -- 172.21.15.40:0/1853568902 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18275 (secure 0 0 0) 0x7f9bf4054d10 con 0x7f9c040b4990 2023-11-04T01:41:32.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:31.104066+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:32.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bf00664a0 msgr2=0x7f9bf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bf00664a0 0x7f9bf0068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8006fd0 tx=0x7f9bf8008040 comp rx=0 tx=0).stop 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 msgr2=0x7f9c0415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 0x7f9c0415d4d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b440 tx=0x7f9bf400b900 comp rx=0 tx=0).stop 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 shutdown_connections 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bf00664a0 0x7f9bf0068960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c040d0ae0 0x7f9c0415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c040d0690 0x7f9c041f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 --2- 172.21.15.40:0/1853568902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c040b4990 0x7f9c0415d4d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 >> 172.21.15.40:0/1853568902 conn(0x7f9c040cf990 msgr2=0x7f9c040b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 shutdown_connections 2023-11-04T01:41:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.083+0000 7f9c0a0e3640 1 -- 172.21.15.40:0/1853568902 wait complete. 2023-11-04T01:41:32.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.227+0000 7f600b7f2640 1 Processor -- start 2023-11-04T01:41:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.227+0000 7f600b7f2640 1 -- start start 2023-11-04T01:41:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600b7f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f600415afb0 0x7f60040b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600b7f2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60040cb400 0x7f60040cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600b7f2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040d0a60 con 0x7f60040cd6d0 2023-11-04T01:41:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600b7f2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600415b390 con 0x7f60040cb400 2023-11-04T01:41:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600b7f2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040d04a0 con 0x7f600415afb0 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600958e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f600415afb0 0x7f60040b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6008d8d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60040cb400 0x7f60040cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6009d8f640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f60040cd6d0 0x7f60040cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:60172/0 (socket says 172.21.15.40:60172) 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6009d8f640 1 -- 172.21.15.40:0/832305423 learned_addr learned my addr 172.21.15.40:0/832305423 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6008d8d640 1 -- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f600415afb0 msgr2=0x7f60040b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6008d8d640 1 --2- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f600415afb0 0x7f60040b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6008d8d640 1 -- 172.21.15.40:0/832305423 >> v1:172.21.15.91:6789/0 conn(0x7f60040cd6d0 legacy=0x7f60040cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f6008d8d640 1 -- 172.21.15.40:0/832305423 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040d0780 con 0x7f60040cb400 2023-11-04T01:41:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.231+0000 7f600958e640 1 --2- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f600415afb0 0x7f60040b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f6008d8d640 1 --2- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60040cb400 0x7f60040cf190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80097c0 tx=0x7f5ff801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbcf89841d9baf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f5ff7fff640 1 -- 172.21.15.40:0/832305423 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80ac620 con 0x7f60040cb400 2023-11-04T01:41:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f5ff7fff640 1 -- 172.21.15.40:0/832305423 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80ac780 con 0x7f60040cb400 2023-11-04T01:41:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f5ff7fff640 1 -- 172.21.15.40:0/832305423 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80acb10 con 0x7f60040cb400 2023-11-04T01:41:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 -- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60040cb400 msgr2=0x7f60040cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 --2- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60040cb400 0x7f60040cf190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80097c0 tx=0x7f5ff801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 -- 172.21.15.40:0/832305423 shutdown_connections 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 --2- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60040cb400 0x7f60040cf190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 --2- 172.21.15.40:0/832305423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f600415afb0 0x7f60040b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 -- 172.21.15.40:0/832305423 >> 172.21.15.40:0/832305423 conn(0x7f6004065dc0 msgr2=0x7f60040661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 -- 172.21.15.40:0/832305423 shutdown_connections 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.235+0000 7f600b7f2640 1 -- 172.21.15.40:0/832305423 wait complete. 2023-11-04T01:41:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 Processor -- start 2023-11-04T01:41:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- start start 2023-11-04T01:41:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60040cb400 0x7f6004154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 0x7f6004156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600415afb0 0x7f6004157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415d6c0 con 0x7f60040cd6d0 2023-11-04T01:41:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600415e300 con 0x7f600415afb0 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6004156210 con 0x7f60040cb400 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 0x7f6004156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 0x7f6004156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58402/0 (socket says 172.21.15.40:58402) 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 -- 172.21.15.40:0/3767835654 learned_addr learned my addr 172.21.15.40:0/3767835654 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600958e640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60040cb400 0x7f6004154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6009d8f640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600415afb0 0x7f6004157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 -- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60040cb400 msgr2=0x7f6004154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60040cb400 0x7f6004154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 -- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600415afb0 msgr2=0x7f6004157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600415afb0 0x7f6004157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 -- 172.21.15.40:0/3767835654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000009420 con 0x7f60040cd6d0 2023-11-04T01:41:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600958e640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60040cb400 0x7f6004154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f6008d8d640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 0x7f6004156dd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5ff801aa70 tx=0x7f5ff8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80bb070 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80ac420 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80b5660 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff8009420 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600415dbb0 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60040675f0 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ff80b3040 con 0x7f60040cd6d0 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.239+0000 7f5ff5ffb640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fe80664d0 0x7f5fe8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.243+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ff811d710 con 0x7f60040cd6d0 2023-11-04T01:41:32.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.243+0000 7f600958e640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fe80664d0 0x7f5fe8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.243+0000 7f600958e640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fe80664d0 0x7f5fe8068990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f60040b0a40 tx=0x7f6000008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.247+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ff80ea990 con 0x7f60040cd6d0 2023-11-04T01:41:32.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.403+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60040b2c00 con 0x7f60040cd6d0 2023-11-04T01:41:32.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.403+0000 7f5ff5ffb640 1 -- 172.21.15.40:0/3767835654 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18275 (secure 0 0 0) 0x7f5ff80edfb0 con 0x7f60040cd6d0 2023-11-04T01:41:32.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:31.104066+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fe80664d0 msgr2=0x7f5fe8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fe80664d0 0x7f5fe8068990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f60040b0a40 tx=0x7f6000008040 comp rx=0 tx=0).stop 2023-11-04T01:41:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 msgr2=0x7f6004156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 0x7f6004156dd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5ff801aa70 tx=0x7f5ff8019160 comp rx=0 tx=0).stop 2023-11-04T01:41:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 shutdown_connections 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fe80664d0 0x7f5fe8068990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f600415afb0 0x7f6004157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60040cd6d0 0x7f6004156dd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 --2- 172.21.15.40:0/3767835654 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60040cb400 0x7f6004154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 >> 172.21.15.40:0/3767835654 conn(0x7f6004065dc0 msgr2=0x7f60040b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 shutdown_connections 2023-11-04T01:41:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.407+0000 7f600b7f2640 1 -- 172.21.15.40:0/3767835654 wait complete. 2023-11-04T01:41:32.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:41:32.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 Processor -- start 2023-11-04T01:41:32.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 -- start start 2023-11-04T01:41:32.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc100ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc1015d290 0x7efc100af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc10160c50 con 0x7efc1006cfc0 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc100cedf0 con 0x7efc1015d290 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc15ae8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc10160ef0 con 0x7efc100cd670 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc1015d290 0x7efc100af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc1015d290 0x7efc100af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58404/0 (socket says 172.21.15.40:58404) 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 -- 172.21.15.40:0/2490437095 learned_addr learned my addr 172.21.15.40:0/2490437095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0f7fe640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc100ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 -- 172.21.15.40:0/2490437095 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 msgr2=0x7efc100ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc100ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 -- 172.21.15.40:0/2490437095 >> v1:172.21.15.91:6789/0 conn(0x7efc1006cfc0 legacy=0x7efc1015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0ffff640 1 -- 172.21.15.40:0/2490437095 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc101611d0 con 0x7efc1015d290 2023-11-04T01:41:32.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.547+0000 7efc0f7fe640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc100ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:32.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc0ffff640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1015d290 0x7efc100af8f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efc08009e50 tx=0x7efc0801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377689e930d71630 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc0e7fc640 1 -- 172.21.15.40:0/2490437095 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080a57a0 con 0x7efc1015d290 2023-11-04T01:41:32.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc0e7fc640 1 -- 172.21.15.40:0/2490437095 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc080a5900 con 0x7efc1015d290 2023-11-04T01:41:32.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc0e7fc640 1 -- 172.21.15.40:0/2490437095 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080a5c90 con 0x7efc1015d290 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 -- 172.21.15.40:0/2490437095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1015d290 msgr2=0x7efc100af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1015d290 0x7efc100af8f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efc08009e50 tx=0x7efc0801c9e0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 -- 172.21.15.40:0/2490437095 shutdown_connections 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1015d290 0x7efc100af8f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 --2- 172.21.15.40:0/2490437095 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc100ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 -- 172.21.15.40:0/2490437095 >> 172.21.15.40:0/2490437095 conn(0x7efc10065dc0 msgr2=0x7efc100661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 -- 172.21.15.40:0/2490437095 shutdown_connections 2023-11-04T01:41:32.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 -- 172.21.15.40:0/2490437095 wait complete. 2023-11-04T01:41:32.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 Processor -- start 2023-11-04T01:41:32.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.551+0000 7efc15ae8640 1 -- start start 2023-11-04T01:41:32.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 0x7efc100c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc10152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc1015d290 0x7efc101533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100c4dc0 con 0x7efc1006cfc0 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10160410 con 0x7efc1015d290 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc101606f0 con 0x7efc100cd670 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 0x7efc100c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 0x7efc100c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58414/0 (socket says 172.21.15.40:58414) 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 -- 172.21.15.40:0/659538631 learned_addr learned my addr 172.21.15.40:0/659538631 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0effd640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc10152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0ffff640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc1015d290 0x7efc101533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 -- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 msgr2=0x7efc10152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc10152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 -- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc1015d290 msgr2=0x7efc101533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc1015d290 0x7efc101533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 -- 172.21.15.40:0/659538631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009b30 con 0x7efc1006cfc0 2023-11-04T01:41:32.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0effd640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc10152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc0f7fe640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 0x7efc100c6cc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c7f0 tx=0x7efc0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00005ba0 con 0x7efc1006cfc0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc00005d00 con 0x7efc1006cfc0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00007a50 con 0x7efc1006cfc0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc100c4770 con 0x7efc1006cfc0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc100c7200 con 0x7efc1006cfc0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc100682a0 con 0x7efc1006cfc0 2023-11-04T01:41:32.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc00007bb0 con 0x7efc1006cfc0 2023-11-04T01:41:32.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efbf7fff640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efbfc0664d0 0x7efbfc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.555+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc00083e40 con 0x7efc1006cfc0 2023-11-04T01:41:32.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.559+0000 7efc0effd640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efbfc0664d0 0x7efbfc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.559+0000 7efc0effd640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efbfc0664d0 0x7efbfc068990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc1015d260 tx=0x7efc04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.563+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc00051210 con 0x7efc1006cfc0 2023-11-04T01:41:32.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:32.755+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc100b6c60 con 0x7efc1006cfc0 2023-11-04T01:41:33.696 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:41:33.691+0000 7f35bda40640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efbf7fff640 1 -- 172.21.15.40:0/659538631 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc0001e0b0 con 0x7efc1006cfc0 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efbfc0664d0 msgr2=0x7efbfc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efbfc0664d0 0x7efbfc068990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc1015d260 tx=0x7efc04009040 comp rx=0 tx=0).stop 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 msgr2=0x7efc100c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 0x7efc100c6cc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c7f0 tx=0x7efc0000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 shutdown_connections 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efbfc0664d0 0x7efbfc068990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc1015d290 0x7efc101533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.759+0000 7efc15ae8640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efc100cd670 0x7efc10152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.763+0000 7efc15ae8640 1 --2- 172.21.15.40:0/659538631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc1006cfc0 0x7efc100c6cc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.763+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 >> 172.21.15.40:0/659538631 conn(0x7efc10065dc0 msgr2=0x7efc100b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.763+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 shutdown_connections 2023-11-04T01:41:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.763+0000 7efc15ae8640 1 -- 172.21.15.40:0/659538631 wait complete. 2023-11-04T01:41:33.786 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:41:33.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:41:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe465bcb640 1 Processor -- start 2023-11-04T01:41:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe465bcb640 1 -- start start 2023-11-04T01:41:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe465bcb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe46015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe465bcb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46006c0c0 con 0x7fe46015af70 2023-11-04T01:41:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe465bcb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46006c3a0 con 0x7fe4600ce1b0 2023-11-04T01:41:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe465bcb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe460071200 con 0x7fe46006d160 2023-11-04T01:41:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe46015af70 0x7fe4600cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34052/0 (socket says 172.21.15.40:34052) 2023-11-04T01:41:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 -- 172.21.15.40:0/647841349 learned_addr learned my addr 172.21.15.40:0/647841349 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45ffff640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe46015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181839927 0 0) 0x7fe46006c0c0 con 0x7fe46015af70 2023-11-04T01:41:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe448003530 con 0x7fe46015af70 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1693006276 0 0) 0x7fe448003530 con 0x7fe46015af70 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 msgr2=0x7fe46015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe46015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 >> v1:172.21.15.91:6789/0 conn(0x7fe4600ce1b0 legacy=0x7fe46015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46006c680 con 0x7fe46015af70 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fe4540016a0 con 0x7fe46015af70 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 >> v1:172.21.15.40:6789/0 conn(0x7fe46015af70 legacy=0x7fe4600cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4480039b0 0x7fe448003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe4480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe448004d10 0x7fe448005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe460071200 con 0x7fe4480039b0 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44800ba70 con 0x7fe448004d10 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44800bc30 con 0x7fe46006d160 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4480039b0 0x7fe448003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45ffff640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe448004d10 0x7fe448005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45effd640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe4480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 -- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 msgr2=0x7fe4480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe4480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 -- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe448004d10 msgr2=0x7fe448005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe448004d10 0x7fe448005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45f7fe640 1 -- 172.21.15.40:0/647841349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe448003530 con 0x7fe4480039b0 2023-11-04T01:41:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.911+0000 7fe45effd640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe46006d160 0x7fe4480047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:33.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4480039b0 0x7fe448003dd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe46006ddd0 tx=0x7fe45401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25717b5fe4f031cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454005ae0 con 0x7fe4480039b0 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe454005c40 con 0x7fe4480039b0 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe45e7fc640 1 -- 172.21.15.40:0/647841349 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454007070 con 0x7fe4480039b0 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 -- 172.21.15.40:0/647841349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4480039b0 msgr2=0x7fe448003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 --2- 172.21.15.40:0/647841349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4480039b0 0x7fe448003dd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe46006ddd0 tx=0x7fe45401cc00 comp rx=0 tx=0).stop 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe45ffff640 1 -- 172.21.15.40:0/647841349 reap_dead start 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 -- 172.21.15.40:0/647841349 shutdown_connections 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 -- 172.21.15.40:0/647841349 >> 172.21.15.40:0/647841349 conn(0x7fe4600cb510 msgr2=0x7fe4600cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 -- 172.21.15.40:0/647841349 shutdown_connections 2023-11-04T01:41:33.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 -- 172.21.15.40:0/647841349 wait complete. 2023-11-04T01:41:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 Processor -- start 2023-11-04T01:41:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.915+0000 7fe465bcb640 1 -- start start 2023-11-04T01:41:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4480039b0 0x7fe460156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4600c87b0 0x7fe460153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 0x7fe4600c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600c5eb0 con 0x7fe4600c3610 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600c8c30 con 0x7fe4480039b0 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600c7d80 con 0x7fe4600c87b0 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 0x7fe4600c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 0x7fe4600c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58436/0 (socket says 172.21.15.40:58436) 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 -- 172.21.15.40:0/3717722242 learned_addr learned my addr 172.21.15.40:0/3717722242 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4480039b0 0x7fe460156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45effd640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4600c87b0 0x7fe460153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 -- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4600c87b0 msgr2=0x7fe460153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4600c87b0 0x7fe460153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 -- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4480039b0 msgr2=0x7fe460156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4480039b0 0x7fe460156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 -- 172.21.15.40:0/3717722242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600b2a70 con 0x7fe4600c3610 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4480039b0 0x7fe460156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45effd640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4600c87b0 0x7fe460153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe45ffff640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 0x7fe4600c3a90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe46006f950 tx=0x7fe4580115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800e070 con 0x7fe4600c3610 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458011e10 con 0x7fe4600c3610 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580039a0 con 0x7fe4600c3610 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4600b2d50 con 0x7fe4600c3610 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4600c82b0 con 0x7fe4600c3610 2023-11-04T01:41:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4600c8470 con 0x7fe4600c3610 2023-11-04T01:41:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe458003b00 con 0x7fe4600c3610 2023-11-04T01:41:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe447fff640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe44c0664a0 0x7fe44c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.919+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe458084490 con 0x7fe4600c3610 2023-11-04T01:41:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.923+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe44c0664a0 0x7fe44c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.923+0000 7fe45f7fe640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe44c0664a0 0x7fe44c068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4540ab000 tx=0x7fe4540a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:33.927+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe458051840 con 0x7fe4600c3610 2023-11-04T01:41:34.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.115+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe4600744a0 con 0x7fe4600c3610 2023-11-04T01:41:34.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.767+0000 7fe447fff640 1 -- 172.21.15.40:0/3717722242 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe458003db0 con 0x7fe4600c3610 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe44c0664a0 msgr2=0x7fe44c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe44c0664a0 0x7fe44c068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4540ab000 tx=0x7fe4540a7070 comp rx=0 tx=0).stop 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 msgr2=0x7fe4600c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 0x7fe4600c3a90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe46006f950 tx=0x7fe4580115a0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 shutdown_connections 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe44c0664a0 0x7fe44c068960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4600c3610 0x7fe4600c3a90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4600c87b0 0x7fe460153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 --2- 172.21.15.40:0/3717722242 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4480039b0 0x7fe460156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 >> 172.21.15.40:0/3717722242 conn(0x7fe4600cb510 msgr2=0x7fe460165ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:34.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 shutdown_connections 2023-11-04T01:41:34.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.771+0000 7fe465bcb640 1 -- 172.21.15.40:0/3717722242 wait complete. 2023-11-04T01:41:34.796 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:41:34.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:34.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.919+0000 7fd0123c1640 1 Processor -- start 2023-11-04T01:41:34.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.919+0000 7fd0123c1640 1 -- start start 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd0123c1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fd00c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd0123c1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c0cd400 con 0x7fd00c15d2b0 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd0123c1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c0cd6e0 con 0x7fd00c15d690 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd0123c1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0ad450 con 0x7fd00c06c630 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd00c15d2b0 0x7fd00c0ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34056/0 (socket says 172.21.15.40:34056) 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00bfff640 1 -- 172.21.15.40:0/401054529 learned_addr learned my addr 172.21.15.40:0/401054529 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fd00c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045504412 0 0) 0x7fd00c0cd400 con 0x7fd00c15d2b0 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff8003530 con 0x7fd00c15d2b0 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953382837 0 0) 0x7fcff8003530 con 0x7fd00c15d2b0 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 msgr2=0x7fd00c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fd00c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 >> v1:172.21.15.91:6789/0 conn(0x7fd00c15d690 legacy=0x7fd00c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0ad070 con 0x7fd00c15d2b0 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fcff40016a0 con 0x7fd00c15d2b0 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 >> v1:172.21.15.40:6789/0 conn(0x7fd00c15d2b0 legacy=0x7fd00c0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fcff80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fcff8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0ad450 con 0x7fcff8004d10 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff800baf0 con 0x7fcff80039b0 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff800bcb0 con 0x7fd00c06c630 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fcff8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00bfff640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00b7fe640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fcff80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 -- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 msgr2=0x7fcff80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fcff80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 -- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcff80039b0 msgr2=0x7fcff8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd01095e640 1 -- 172.21.15.40:0/401054529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8003530 con 0x7fcff8004d10 2023-11-04T01:41:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.923+0000 7fd00b7fe640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c06c630 0x7fcff80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd01095e640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fcff8005190 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd004009ae0 tx=0x7fd00401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03b57a54f04cee5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040a5530 con 0x7fcff8004d10 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0040a5690 con 0x7fcff8004d10 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00affd640 1 -- 172.21.15.40:0/401054529 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040a5a40 con 0x7fcff8004d10 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/401054529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 msgr2=0x7fcff8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 --2- 172.21.15.40:0/401054529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fcff8005190 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd004009ae0 tx=0x7fd00401ca50 comp rx=0 tx=0).stop 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd01095e640 1 -- 172.21.15.40:0/401054529 reap_dead start 2023-11-04T01:41:34.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/401054529 shutdown_connections 2023-11-04T01:41:34.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/401054529 >> 172.21.15.40:0/401054529 conn(0x7fd00c0cebb0 msgr2=0x7fd00c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:34.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/401054529 shutdown_connections 2023-11-04T01:41:34.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/401054529 wait complete. 2023-11-04T01:41:34.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 Processor -- start 2023-11-04T01:41:34.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- start start 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fd00c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd00c15fa90 0x7fd00c160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c15edf0 0x7fd00c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c1f6fd0 con 0x7fcff8004d10 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c15da70 con 0x7fd00c15fa90 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c15dd50 con 0x7fd00c15edf0 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fd00c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fd00c1f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58458/0 (socket says 172.21.15.40:58458) 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 -- 172.21.15.40:0/1942934249 learned_addr learned my addr 172.21.15.40:0/1942934249 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd01095e640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c15edf0 0x7fd00c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00b7fe640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd00c15fa90 0x7fd00c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 -- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c15edf0 msgr2=0x7fd00c0b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c15edf0 0x7fd00c0b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 -- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd00c15fa90 msgr2=0x7fd00c160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd00c15fa90 0x7fd00c160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 -- 172.21.15.40:0/1942934249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c15e030 con 0x7fcff8004d10 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd01095e640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c15edf0 0x7fd00c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd00bfff640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fd00c1f6a90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcff40017d0 tx=0x7fcff4011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400fb60 con 0x7fcff8004d10 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff400fd00 con 0x7fcff8004d10 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c15e310 con 0x7fcff8004d10 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4015650 con 0x7fcff8004d10 2023-11-04T01:41:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.927+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c15e8d0 con 0x7fcff8004d10 2023-11-04T01:41:34.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.931+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c0accf0 con 0x7fcff8004d10 2023-11-04T01:41:34.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.931+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcff40157b0 con 0x7fcff8004d10 2023-11-04T01:41:34.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.931+0000 7fd008ff9640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcfec0664a0 0x7fcfec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.931+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcff4087330 con 0x7fcff8004d10 2023-11-04T01:41:34.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.931+0000 7fd00b7fe640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcfec0664a0 0x7fcfec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.931+0000 7fd00b7fe640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcfec0664a0 0x7fcfec068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd00c15c080 tx=0x7fcffc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:34.935+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcff4054650 con 0x7fcff8004d10 2023-11-04T01:41:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd00c0744a0 con 0x7fcff8004d10 2023-11-04T01:41:35.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd008ff9640 1 -- 172.21.15.40:0/1942934249 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fcff4057c70 con 0x7fcff8004d10 2023-11-04T01:41:35.128 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:35.128 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:31.104506+0000","modified":"2023-11-04T01:41:34.118780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1760510907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1760510907},{"type":"v1","addr":"172.21.15.40:6835","nonce":1760510907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:35.128 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 23 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcfec0664a0 msgr2=0x7fcfec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcfec0664a0 0x7fcfec068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd00c15c080 tx=0x7fcffc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 msgr2=0x7fd00c1f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fd00c1f6a90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcff40017d0 tx=0x7fcff4011c80 comp rx=0 tx=0).stop 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 shutdown_connections 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcfec0664a0 0x7fcfec068960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd00c15edf0 0x7fd00c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd00c15fa90 0x7fd00c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 --2- 172.21.15.40:0/1942934249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcff8004d10 0x7fd00c1f6a90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.123+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 >> 172.21.15.40:0/1942934249 conn(0x7fd00c0cebb0 msgr2=0x7fd00c0cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.127+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 shutdown_connections 2023-11-04T01:41:35.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.127+0000 7fd0123c1640 1 -- 172.21.15.40:0/1942934249 wait complete. 2023-11-04T01:41:35.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:35.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf2448640 1 Processor -- start 2023-11-04T01:41:35.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf2448640 1 -- start start 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf2448640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cec15ccb0 0x7f9cec0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf2448640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0cda70 con 0x7f9cec06c1a0 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf2448640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0cce60 con 0x7f9cec0cdf00 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf2448640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0cd140 con 0x7f9cec15ccb0 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf09e5640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9cec06c1a0 0x7f9cec06fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34068/0 (socket says 172.21.15.40:34068) 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cebfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cec15ccb0 0x7f9cec0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cf09e5640 1 -- 172.21.15.40:0/2039233160 learned_addr learned my addr 172.21.15.40:0/2039233160 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:35.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cebfff640 1 -- 172.21.15.40:0/2039233160 >> v1:172.21.15.91:6789/0 conn(0x7f9cec0cdf00 legacy=0x7f9cec06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cebfff640 1 -- 172.21.15.40:0/2039233160 >> v1:172.21.15.40:6789/0 conn(0x7f9cec06c1a0 legacy=0x7f9cec06fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.263+0000 7f9cebfff640 1 -- 172.21.15.40:0/2039233160 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0cd420 con 0x7f9cec15ccb0 2023-11-04T01:41:35.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cebfff640 1 --2- 172.21.15.40:0/2039233160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec0ce580 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00097c0 tx=0x7f9ce001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de0cee4ecdcc68f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9ceaffd640 1 -- 172.21.15.40:0/2039233160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a8930 con 0x7f9cec15ccb0 2023-11-04T01:41:35.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9ceaffd640 1 -- 172.21.15.40:0/2039233160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce00a8a90 con 0x7f9cec15ccb0 2023-11-04T01:41:35.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9ceaffd640 1 -- 172.21.15.40:0/2039233160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a8e20 con 0x7f9cec15ccb0 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- 172.21.15.40:0/2039233160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 msgr2=0x7f9cec0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2039233160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec0ce580 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00097c0 tx=0x7f9ce001ec30 comp rx=0 tx=0).stop 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- 172.21.15.40:0/2039233160 shutdown_connections 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2039233160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec0ce580 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- 172.21.15.40:0/2039233160 >> 172.21.15.40:0/2039233160 conn(0x7f9cec0cebb0 msgr2=0x7f9cec0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- 172.21.15.40:0/2039233160 shutdown_connections 2023-11-04T01:41:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- 172.21.15.40:0/2039233160 wait complete. 2023-11-04T01:41:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 Processor -- start 2023-11-04T01:41:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- start start 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9cec06c1a0 0x7f9cec14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cec0cdf00 0x7f9cec0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec1f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0b4910 con 0x7f9cec15ccb0 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1f4da0 con 0x7f9cec0cdf00 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf2448640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1f5080 con 0x7f9cec06c1a0 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec1f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec1f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58478/0 (socket says 172.21.15.40:58478) 2023-11-04T01:41:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 -- 172.21.15.40:0/2822053862 learned_addr learned my addr 172.21.15.40:0/2822053862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:35.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9ceb7fe640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cec0cdf00 0x7f9cec0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cebfff640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9cec06c1a0 0x7f9cec14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 -- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9cec06c1a0 msgr2=0x7f9cec14dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9cec06c1a0 0x7f9cec14dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 -- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cec0cdf00 msgr2=0x7f9cec0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cec0cdf00 0x7f9cec0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.267+0000 7f9cf09e5640 1 -- 172.21.15.40:0/2822053862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009420 con 0x7f9cec15ccb0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9cf09e5640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec1f42e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c430 tx=0x7f9ce400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40064e0 con 0x7f9cec15ccb0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4006640 con 0x7f9cec15ccb0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40049f0 con 0x7f9cec15ccb0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec14e5d0 con 0x7f9cec15ccb0 2023-11-04T01:41:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec15a840 con 0x7f9cec15ccb0 2023-11-04T01:41:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec0744a0 con 0x7f9cec15ccb0 2023-11-04T01:41:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ce4004c10 con 0x7f9cec15ccb0 2023-11-04T01:41:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9ce8ff9640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9cd80664a0 0x7f9cd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ce40833e0 con 0x7f9cec15ccb0 2023-11-04T01:41:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9cebfff640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9cd80664a0 0x7f9cd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.271+0000 7f9cebfff640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9cd80664a0 0x7f9cd8068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00b2000 tx=0x7f9ce0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.275+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ce4050840 con 0x7f9cec15ccb0 2023-11-04T01:41:35.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.435+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cec0b4b30 con 0x7f9cec15ccb0 2023-11-04T01:41:35.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9ce8ff9640 1 -- 172.21.15.40:0/2822053862 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f9ce4053e60 con 0x7f9cec15ccb0 2023-11-04T01:41:35.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:35.443 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":48,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:32.707923+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9cd80664a0 msgr2=0x7f9cd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9cd80664a0 0x7f9cd8068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00b2000 tx=0x7f9ce0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 msgr2=0x7f9cec1f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec1f42e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c430 tx=0x7f9ce400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 shutdown_connections 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9cd80664a0 0x7f9cd8068960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cec15ccb0 0x7f9cec1f42e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9cec0cdf00 0x7f9cec0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 --2- 172.21.15.40:0/2822053862 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9cec06c1a0 0x7f9cec14dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 >> 172.21.15.40:0/2822053862 conn(0x7f9cec0cebb0 msgr2=0x7f9cec0c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 shutdown_connections 2023-11-04T01:41:35.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.439+0000 7f9cf2448640 1 -- 172.21.15.40:0/2822053862 wait complete. 2023-11-04T01:41:35.461 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:41:35.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 Processor -- start 2023-11-04T01:41:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 -- start start 2023-11-04T01:41:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fafc815a1f0 0x7fafc80cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafc80cdea0 0x7fafc80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80ca400 0x7fafc80b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80ccee0 con 0x7fafc80cdea0 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc815a5d0 con 0x7fafc815a1f0 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.583+0000 7fafcdc58640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80ca900 con 0x7fafc80ca400 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafc80cdea0 0x7fafc80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafc80cdea0 0x7fafc80b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58486/0 (socket says 172.21.15.40:58486) 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 -- 172.21.15.40:0/785782616 learned_addr learned my addr 172.21.15.40:0/785782616 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc77fe640 1 --2- 172.21.15.40:0/785782616 >> v2:172.21.15.91:3300/0 conn(0x7fafc815a1f0 0x7fafc80cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc7fff640 1 --2- 172.21.15.40:0/785782616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80ca400 0x7fafc80b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 -- 172.21.15.40:0/785782616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80ca400 msgr2=0x7fafc80b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 --2- 172.21.15.40:0/785782616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80ca400 0x7fafc80b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 -- 172.21.15.40:0/785782616 >> v2:172.21.15.91:3300/0 conn(0x7fafc815a1f0 msgr2=0x7fafc80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 --2- 172.21.15.40:0/785782616 >> v2:172.21.15.91:3300/0 conn(0x7fafc815a1f0 0x7fafc80cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 -- 172.21.15.40:0/785782616 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80cabe0 con 0x7fafc80cdea0 2023-11-04T01:41:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc6ffd640 1 --2- 172.21.15.40:0/785782616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc80cdea0 0x7fafc80b0630 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fafc806db60 tx=0x7fafb801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31dfa6f15d148cc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc67fc640 1 -- 172.21.15.40:0/785782616 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80aa5f0 con 0x7fafc80cdea0 2023-11-04T01:41:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc67fc640 1 -- 172.21.15.40:0/785782616 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb80aa750 con 0x7fafc80cdea0 2023-11-04T01:41:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.587+0000 7fafc67fc640 1 -- 172.21.15.40:0/785782616 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80aaae0 con 0x7fafc80cdea0 2023-11-04T01:41:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/785782616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc80cdea0 msgr2=0x7fafc80b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- 172.21.15.40:0/785782616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc80cdea0 0x7fafc80b0630 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fafc806db60 tx=0x7fafb801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/785782616 shutdown_connections 2023-11-04T01:41:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- 172.21.15.40:0/785782616 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80ca400 0x7fafc80b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- 172.21.15.40:0/785782616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc80cdea0 0x7fafc80b0630 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- 172.21.15.40:0/785782616 >> v2:172.21.15.91:3300/0 conn(0x7fafc815a1f0 0x7fafc80cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/785782616 >> 172.21.15.40:0/785782616 conn(0x7fafc80cebb0 msgr2=0x7fafc80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/785782616 shutdown_connections 2023-11-04T01:41:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/785782616 wait complete. 2023-11-04T01:41:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 Processor -- start 2023-11-04T01:41:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- start start 2023-11-04T01:41:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafc80ca400 0x7fafc81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80cdea0 0x7fafc814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 0x7fafc80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8158cd0 con 0x7fafc815a1f0 2023-11-04T01:41:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc81522e0 con 0x7fafc80ca400 2023-11-04T01:41:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8158050 con 0x7fafc80cdea0 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 0x7fafc80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 0x7fafc80b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58494/0 (socket says 172.21.15.40:58494) 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 -- 172.21.15.40:0/2489924744 learned_addr learned my addr 172.21.15.40:0/2489924744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc77fe640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafc80ca400 0x7fafc81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc6ffd640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80cdea0 0x7fafc814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 -- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80cdea0 msgr2=0x7fafc814f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80cdea0 0x7fafc814f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 -- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafc80ca400 msgr2=0x7fafc81579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafc80ca400 0x7fafc81579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 -- 172.21.15.40:0/2489924744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80094d0 con 0x7fafc815a1f0 2023-11-04T01:41:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc6ffd640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80cdea0 0x7fafc814f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafc7fff640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 0x7fafc80b39a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007e30 tx=0x7fafc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0014420 con 0x7fafc815a1f0 2023-11-04T01:41:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0014580 con 0x7fafc815a1f0 2023-11-04T01:41:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc8158330 con 0x7fafc815a1f0 2023-11-04T01:41:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0014930 con 0x7fafc815a1f0 2023-11-04T01:41:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.591+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc81588f0 con 0x7fafc815a1f0 2023-11-04T01:41:35.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.595+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc8158e10 con 0x7fafc815a1f0 2023-11-04T01:41:35.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.595+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fafc0014a90 con 0x7fafc815a1f0 2023-11-04T01:41:35.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.595+0000 7fafbffff640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.595+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafc00848b0 con 0x7fafc815a1f0 2023-11-04T01:41:35.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.595+0000 7fafc77fe640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.595+0000 7fafc77fe640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafa80664a0 0x7fafa8068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b930 tx=0x7fafb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.599+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fafc0051c60 con 0x7fafc815a1f0 2023-11-04T01:41:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.751+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafc8067210 con 0x7fafa80664a0 2023-11-04T01:41:35.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.779+0000 7fafbffff640 1 -- 172.21.15.40:0/2489924744 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356737 (secure 0 0 0) 0x7fafc8067210 con 0x7fafa80664a0 2023-11-04T01:41:35.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafa80664a0 msgr2=0x7fafa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafa80664a0 0x7fafa8068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b930 tx=0x7fafb0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 msgr2=0x7fafc80b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 0x7fafc80b39a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007e30 tx=0x7fafc000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 shutdown_connections 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc815a1f0 0x7fafc80b39a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafc80cdea0 0x7fafc814f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 --2- 172.21.15.40:0/2489924744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafc80ca400 0x7fafc81579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 >> 172.21.15.40:0/2489924744 conn(0x7fafc80cebb0 msgr2=0x7fafc80cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.783+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 shutdown_connections 2023-11-04T01:41:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.787+0000 7fafcdc58640 1 -- 172.21.15.40:0/2489924744 wait complete. 2023-11-04T01:41:35.807 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-11-04T01:41:33.779760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221480,"kb_used_data":5252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753240,"statfs":{"total":773094113280,"available":772867317760,"internally_reserved":0,"allocated":5378048,"data_stored":2919146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.060821"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.727356+0000","last_change":"2023-11-04T01:41:29.727356+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.727356+0000","last_undegraded":"2023-11-04T01:41:29.727356+0000","last_fullsized":"2023-11-04T01:41:29.727356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":185,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761820+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:41:27.761820+0000","last_peered":"2023-11-04T01:41:27.761820+0000","last_clean":"2023-11-04T01:41:27.761820+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:41:27.761820+0000","last_undegraded":"2023-11-04T01:41:27.761820+0000","last_fullsized":"2023-11-04T01:41:27.761820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":25,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.715285+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:41:27.715285+0000","last_peered":"2023-11-04T01:41:27.715285+0000","last_clean":"2023-11-04T01:41:27.715285+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:41:27.715285+0000","last_undegraded":"2023-11-04T01:41:27.715285+0000","last_fullsized":"2023-11-04T01:41:27.715285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.727140+0000","last_change":"2023-11-04T01:41:29.727140+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.727140+0000","last_undegraded":"2023-11-04T01:41:29.727140+0000","last_fullsized":"2023-11-04T01:41:29.727140+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.981590+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:41:28.981590+0000","last_peered":"2023-11-04T01:41:28.981590+0000","last_clean":"2023-11-04T01:41:28.981590+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:41:28.981590+0000","last_undegraded":"2023-11-04T01:41:28.981590+0000","last_fullsized":"2023-11-04T01:41:28.981590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.724752+0000","last_change":"2023-11-04T01:41:29.724752+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.724752+0000","last_undegraded":"2023-11-04T01:41:29.724752+0000","last_fullsized":"2023-11-04T01:41:29.724752+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761976+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:41:27.761976+0000","last_peered":"2023-11-04T01:41:27.761976+0000","last_clean":"2023-11-04T01:41:27.761976+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:41:27.761976+0000","last_undegraded":"2023-11-04T01:41:27.761976+0000","last_fullsized":"2023-11-04T01:41:27.761976+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.722388+0000","last_change":"2023-11-04T01:41:29.722388+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.722388+0000","last_undegraded":"2023-11-04T01:41:29.722388+0000","last_fullsized":"2023-11-04T01:41:29.722388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:29.089792+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:41:29.089792+0000","last_peered":"2023-11-04T01:41:29.089792+0000","last_clean":"2023-11-04T01:41:29.089792+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:41:29.089792+0000","last_undegraded":"2023-11-04T01:41:29.089792+0000","last_fullsized":"2023-11-04T01:41:29.089792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.726518+0000","last_change":"2023-11-04T01:41:29.726518+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.726518+0000","last_undegraded":"2023-11-04T01:41:29.726518+0000","last_fullsized":"2023-11-04T01:41:29.726518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.294275+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:41:28.294275+0000","last_peered":"2023-11-04T01:41:28.294275+0000","last_clean":"2023-11-04T01:41:28.294275+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:41:28.294275+0000","last_undegraded":"2023-11-04T01:41:28.294275+0000","last_fullsized":"2023-11-04T01:41:28.294275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.728162+0000","last_change":"2023-11-04T01:41:29.728162+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.728162+0000","last_undegraded":"2023-11-04T01:41:29.728162+0000","last_fullsized":"2023-11-04T01:41:29.728162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.012986+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:41:28.012986+0000","last_peered":"2023-11-04T01:41:28.012986+0000","last_clean":"2023-11-04T01:41:28.012986+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:41:28.012986+0000","last_undegraded":"2023-11-04T01:41:28.012986+0000","last_fullsized":"2023-11-04T01:41:28.012986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.731769+0000","last_change":"2023-11-04T01:41:29.731769+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.731769+0000","last_undegraded":"2023-11-04T01:41:29.731769+0000","last_fullsized":"2023-11-04T01:41:29.731769+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.294417+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:41:28.294417+0000","last_peered":"2023-11-04T01:41:28.294417+0000","last_clean":"2023-11-04T01:41:28.294417+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:41:28.294417+0000","last_undegraded":"2023-11-04T01:41:28.294417+0000","last_fullsized":"2023-11-04T01:41:28.294417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.730825+0000","last_change":"2023-11-04T01:41:29.730825+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.730825+0000","last_undegraded":"2023-11-04T01:41:29.730825+0000","last_fullsized":"2023-11-04T01:41:29.730825+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761942+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:41:27.761942+0000","last_peered":"2023-11-04T01:41:27.761942+0000","last_clean":"2023-11-04T01:41:27.761942+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:41:27.761942+0000","last_undegraded":"2023-11-04T01:41:27.761942+0000","last_fullsized":"2023-11-04T01:41:27.761942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.730996+0000","last_change":"2023-11-04T01:41:29.730996+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.730996+0000","last_undegraded":"2023-11-04T01:41:29.730996+0000","last_fullsized":"2023-11-04T01:41:29.730996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.715372+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:41:27.715372+0000","last_peered":"2023-11-04T01:41:27.715372+0000","last_clean":"2023-11-04T01:41:27.715372+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:41:27.715372+0000","last_undegraded":"2023-11-04T01:41:27.715372+0000","last_fullsized":"2023-11-04T01:41:27.715372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.726052+0000","last_change":"2023-11-04T01:41:29.726052+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.726052+0000","last_undegraded":"2023-11-04T01:41:29.726052+0000","last_fullsized":"2023-11-04T01:41:29.726052+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.013340+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:41:28.013340+0000","last_peered":"2023-11-04T01:41:28.013340+0000","last_clean":"2023-11-04T01:41:28.013340+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:41:28.013340+0000","last_undegraded":"2023-11-04T01:41:28.013340+0000","last_fullsized":"2023-11-04T01:41:28.013340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.726715+0000","last_change":"2023-11-04T01:41:29.726715+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.726715+0000","last_undegraded":"2023-11-04T01:41:29.726715+0000","last_fullsized":"2023-11-04T01:41:29.726715+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761611+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:41:27.761611+0000","last_peered":"2023-11-04T01:41:27.761611+0000","last_clean":"2023-11-04T01:41:27.761611+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:41:27.761611+0000","last_undegraded":"2023-11-04T01:41:27.761611+0000","last_fullsized":"2023-11-04T01:41:27.761611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.723568+0000","last_change":"2023-11-04T01:41:29.723568+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.723568+0000","last_undegraded":"2023-11-04T01:41:29.723568+0000","last_fullsized":"2023-11-04T01:41:29.723568+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:29.089851+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:41:29.089851+0000","last_peered":"2023-11-04T01:41:29.089851+0000","last_clean":"2023-11-04T01:41:29.089851+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:41:29.089851+0000","last_undegraded":"2023-11-04T01:41:29.089851+0000","last_fullsized":"2023-11-04T01:41:29.089851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.726808+0000","last_change":"2023-11-04T01:41:29.726808+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.726808+0000","last_undegraded":"2023-11-04T01:41:29.726808+0000","last_fullsized":"2023-11-04T01:41:29.726808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.981629+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:41:28.981629+0000","last_peered":"2023-11-04T01:41:28.981629+0000","last_clean":"2023-11-04T01:41:28.981629+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:41:28.981629+0000","last_undegraded":"2023-11-04T01:41:28.981629+0000","last_fullsized":"2023-11-04T01:41:28.981629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.723586+0000","last_change":"2023-11-04T01:41:29.723586+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.723586+0000","last_undegraded":"2023-11-04T01:41:29.723586+0000","last_fullsized":"2023-11-04T01:41:29.723586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.712106+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:41:27.712106+0000","last_peered":"2023-11-04T01:41:27.712106+0000","last_clean":"2023-11-04T01:41:27.712106+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:41:27.712106+0000","last_undegraded":"2023-11-04T01:41:27.712106+0000","last_fullsized":"2023-11-04T01:41:27.712106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.728119+0000","last_change":"2023-11-04T01:41:29.728119+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.728119+0000","last_undegraded":"2023-11-04T01:41:29.728119+0000","last_fullsized":"2023-11-04T01:41:29.728119+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.013045+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:41:28.013045+0000","last_peered":"2023-11-04T01:41:28.013045+0000","last_clean":"2023-11-04T01:41:28.013045+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:41:28.013045+0000","last_undegraded":"2023-11-04T01:41:28.013045+0000","last_fullsized":"2023-11-04T01:41:28.013045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.728090+0000","last_change":"2023-11-04T01:41:29.728090+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.728090+0000","last_undegraded":"2023-11-04T01:41:29.728090+0000","last_fullsized":"2023-11-04T01:41:29.728090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.715447+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:41:27.715447+0000","last_peered":"2023-11-04T01:41:27.715447+0000","last_clean":"2023-11-04T01:41:27.715447+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:41:27.715447+0000","last_undegraded":"2023-11-04T01:41:27.715447+0000","last_fullsized":"2023-11-04T01:41:27.715447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.728654+0000","last_change":"2023-11-04T01:41:29.728654+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.728654+0000","last_undegraded":"2023-11-04T01:41:29.728654+0000","last_fullsized":"2023-11-04T01:41:29.728654+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761679+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:41:27.761679+0000","last_peered":"2023-11-04T01:41:27.761679+0000","last_clean":"2023-11-04T01:41:27.761679+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:41:27.761679+0000","last_undegraded":"2023-11-04T01:41:27.761679+0000","last_fullsized":"2023-11-04T01:41:27.761679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.727720+0000","last_change":"2023-11-04T01:41:29.727720+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.727720+0000","last_undegraded":"2023-11-04T01:41:29.727720+0000","last_fullsized":"2023-11-04T01:41:29.727720+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.013191+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:41:28.013191+0000","last_peered":"2023-11-04T01:41:28.013191+0000","last_clean":"2023-11-04T01:41:28.013191+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:41:28.013191+0000","last_undegraded":"2023-11-04T01:41:28.013191+0000","last_fullsized":"2023-11-04T01:41:28.013191+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.733113+0000","last_change":"2023-11-04T01:41:29.733113+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.733113+0000","last_undegraded":"2023-11-04T01:41:29.733113+0000","last_fullsized":"2023-11-04T01:41:29.733113+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:29.089792+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:41:29.089792+0000","last_peered":"2023-11-04T01:41:29.089792+0000","last_clean":"2023-11-04T01:41:29.089792+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:41:29.089792+0000","last_undegraded":"2023-11-04T01:41:29.089792+0000","last_fullsized":"2023-11-04T01:41:29.089792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.726028+0000","last_change":"2023-11-04T01:41:29.726028+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.726028+0000","last_undegraded":"2023-11-04T01:41:29.726028+0000","last_fullsized":"2023-11-04T01:41:29.726028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.013009+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:41:28.013009+0000","last_peered":"2023-11-04T01:41:28.013009+0000","last_clean":"2023-11-04T01:41:28.013009+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:41:28.013009+0000","last_undegraded":"2023-11-04T01:41:28.013009+0000","last_fullsized":"2023-11-04T01:41:28.013009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.731872+0000","last_change":"2023-11-04T01:41:29.731872+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.731872+0000","last_undegraded":"2023-11-04T01:41:29.731872+0000","last_fullsized":"2023-11-04T01:41:29.731872+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:29.089791+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:41:29.089791+0000","last_peered":"2023-11-04T01:41:29.089791+0000","last_clean":"2023-11-04T01:41:29.089791+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:41:29.089791+0000","last_undegraded":"2023-11-04T01:41:29.089791+0000","last_fullsized":"2023-11-04T01:41:29.089791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.722597+0000","last_change":"2023-11-04T01:41:29.722597+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.722597+0000","last_undegraded":"2023-11-04T01:41:29.722597+0000","last_fullsized":"2023-11-04T01:41:29.722597+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.981605+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:41:28.981605+0000","last_peered":"2023-11-04T01:41:28.981605+0000","last_clean":"2023-11-04T01:41:28.981605+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:41:28.981605+0000","last_undegraded":"2023-11-04T01:41:28.981605+0000","last_fullsized":"2023-11-04T01:41:28.981605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.733013+0000","last_change":"2023-11-04T01:41:29.733013+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.733013+0000","last_undegraded":"2023-11-04T01:41:29.733013+0000","last_fullsized":"2023-11-04T01:41:29.733013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.711983+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:41:27.711983+0000","last_peered":"2023-11-04T01:41:27.711983+0000","last_clean":"2023-11-04T01:41:27.711983+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:41:27.711983+0000","last_undegraded":"2023-11-04T01:41:27.711983+0000","last_fullsized":"2023-11-04T01:41:27.711983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.724647+0000","last_change":"2023-11-04T01:41:29.724647+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.724647+0000","last_undegraded":"2023-11-04T01:41:29.724647+0000","last_fullsized":"2023-11-04T01:41:29.724647+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761912+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:41:27.761912+0000","last_peered":"2023-11-04T01:41:27.761912+0000","last_clean":"2023-11-04T01:41:27.761912+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:41:27.761912+0000","last_undegraded":"2023-11-04T01:41:27.761912+0000","last_fullsized":"2023-11-04T01:41:27.761912+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.729686+0000","last_change":"2023-11-04T01:41:29.729686+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.729686+0000","last_undegraded":"2023-11-04T01:41:29.729686+0000","last_fullsized":"2023-11-04T01:41:29.729686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.981604+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:41:28.981604+0000","last_peered":"2023-11-04T01:41:28.981604+0000","last_clean":"2023-11-04T01:41:28.981604+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:41:28.981604+0000","last_undegraded":"2023-11-04T01:41:28.981604+0000","last_fullsized":"2023-11-04T01:41:28.981604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.722587+0000","last_change":"2023-11-04T01:41:29.722587+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.722587+0000","last_undegraded":"2023-11-04T01:41:29.722587+0000","last_fullsized":"2023-11-04T01:41:29.722587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.013161+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:41:28.013161+0000","last_peered":"2023-11-04T01:41:28.013161+0000","last_clean":"2023-11-04T01:41:28.013161+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:41:28.013161+0000","last_undegraded":"2023-11-04T01:41:28.013161+0000","last_fullsized":"2023-11-04T01:41:28.013161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.727625+0000","last_change":"2023-11-04T01:41:29.727625+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.727625+0000","last_undegraded":"2023-11-04T01:41:29.727625+0000","last_fullsized":"2023-11-04T01:41:29.727625+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:29.089929+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:41:29.089929+0000","last_peered":"2023-11-04T01:41:29.089929+0000","last_clean":"2023-11-04T01:41:29.089929+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:41:29.089929+0000","last_undegraded":"2023-11-04T01:41:29.089929+0000","last_fullsized":"2023-11-04T01:41:29.089929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.727069+0000","last_change":"2023-11-04T01:41:29.727069+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.727069+0000","last_undegraded":"2023-11-04T01:41:29.727069+0000","last_fullsized":"2023-11-04T01:41:29.727069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.715140+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:41:27.715140+0000","last_peered":"2023-11-04T01:41:27.715140+0000","last_clean":"2023-11-04T01:41:27.715140+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:41:27.715140+0000","last_undegraded":"2023-11-04T01:41:27.715140+0000","last_fullsized":"2023-11-04T01:41:27.715140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.729339+0000","last_change":"2023-11-04T01:41:29.729339+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.729339+0000","last_undegraded":"2023-11-04T01:41:29.729339+0000","last_fullsized":"2023-11-04T01:41:29.729339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.981601+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:41:28.981601+0000","last_peered":"2023-11-04T01:41:28.981601+0000","last_clean":"2023-11-04T01:41:28.981601+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:41:28.981601+0000","last_undegraded":"2023-11-04T01:41:28.981601+0000","last_fullsized":"2023-11-04T01:41:28.981601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.730113+0000","last_change":"2023-11-04T01:41:29.730113+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.730113+0000","last_undegraded":"2023-11-04T01:41:29.730113+0000","last_fullsized":"2023-11-04T01:41:29.730113+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.013242+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:41:28.013242+0000","last_peered":"2023-11-04T01:41:28.013242+0000","last_clean":"2023-11-04T01:41:28.013242+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:41:28.013242+0000","last_undegraded":"2023-11-04T01:41:28.013242+0000","last_fullsized":"2023-11-04T01:41:28.013242+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.729504+0000","last_change":"2023-11-04T01:41:29.729504+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.729504+0000","last_undegraded":"2023-11-04T01:41:29.729504+0000","last_fullsized":"2023-11-04T01:41:29.729504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":24,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.761896+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:41:27.761896+0000","last_peered":"2023-11-04T01:41:27.761896+0000","last_clean":"2023-11-04T01:41:27.761896+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:41:27.761896+0000","last_undegraded":"2023-11-04T01:41:27.761896+0000","last_fullsized":"2023-11-04T01:41:27.761896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:30.715847+0000","last_change":"2023-11-04T01:41:30.715847+0000","last_active":"2023-11-04T01:41:30.715847+0000","last_peered":"2023-11-04T01:41:30.715847+0000","last_clean":"2023-11-04T01:41:30.715847+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:30.715847+0000","last_undegraded":"2023-11-04T01:41:30.715847+0000","last_fullsized":"2023-11-04T01:41:30.715847+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-04T01:41:29.725000+0000","last_change":"2023-11-04T01:41:29.725000+0000","last_active":"2023-11-04T01:41:29.711433+0000","last_peered":"2023-11-04T01:41:29.711433+0000","last_clean":"2023-11-04T01:41:29.711433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:29.725000+0000","last_undegraded":"2023-11-04T01:41:29.725000+0000","last_fullsized":"2023-11-04T01:41:29.725000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T01:41:28.294761+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:41:28.294761+0000","last_peered":"2023-11-04T01:41:28.294761+0000","last_clean":"2023-11-04T01:41:28.294761+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:41:28.294761+0000","last_undegraded":"2023-11-04T01:41:28.294761+0000","last_fullsized":"2023-11-04T01:41:28.294761+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1110016,"data_stored":803813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71899999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.752},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.054}]},{"osd":6,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.101}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":213445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.177}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0780000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1479999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.014},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.046},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.89600000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.105},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":528384,"data_stored":219615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.141},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.95499999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.024},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.107}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.252},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.91300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.069}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.98999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.21}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":528384,"data_stored":219615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.66900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.325}]},{"osd":2,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.127}]},{"osd":3,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.226},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.2509999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.423}]},{"osd":6,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.28}]},{"osd":7,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.474}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":528384,"data_stored":219615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.752},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.875}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.381},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.212}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.3009999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.272},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.2410000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":219615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.44}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.79100000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":213445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0309999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.071}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.3440000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.258}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1122304,"data_stored":809983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.88600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0609999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.097}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.01},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.143}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:35.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.971+0000 7f6dd4ab9640 1 Processor -- start 2023-11-04T01:41:35.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.971+0000 7f6dd4ab9640 1 -- start start 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dd4ab9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6dd00cdea0 0x7f6dd00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dd4ab9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00ccee0 con 0x7f6dd015a1f0 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dd4ab9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd015a5d0 con 0x7f6dd00ca400 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dd4ab9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00ca900 con 0x7f6dd00cdea0 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcdd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6dd00cdea0 0x7f6dd00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dce59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6dd015a1f0 0x7f6dd00cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34070/0 (socket says 172.21.15.40:34070) 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dce59c640 1 -- 172.21.15.40:0/1880854686 learned_addr learned my addr 172.21.15.40:0/1880854686 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcdd9b640 1 -- 172.21.15.40:0/1880854686 >> v1:172.21.15.91:6789/0 conn(0x7f6dd00ca400 legacy=0x7f6dd00704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcdd9b640 1 -- 172.21.15.40:0/1880854686 >> v1:172.21.15.40:6789/0 conn(0x7f6dd015a1f0 legacy=0x7f6dd00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcdd9b640 1 -- 172.21.15.40:0/1880854686 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00cabe0 con 0x7f6dd00cdea0 2023-11-04T01:41:35.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcd59a640 1 -- 172.21.15.40:0/1880854686 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387444564 0 0) 0x7f6dd00ccee0 con 0x7f6dd015a1f0 2023-11-04T01:41:35.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcdd9b640 1 --2- 172.21.15.40:0/1880854686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd00cdea0 0x7f6dd00b0630 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40097c0 tx=0x7f6dc401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e7a15afe868a59 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcd59a640 1 -- 172.21.15.40:0/1880854686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40ab600 con 0x7f6dd00cdea0 2023-11-04T01:41:35.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcd59a640 1 -- 172.21.15.40:0/1880854686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc40a7050 con 0x7f6dd00cdea0 2023-11-04T01:41:35.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.975+0000 7f6dcd59a640 1 -- 172.21.15.40:0/1880854686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40ab980 con 0x7f6dd00cdea0 2023-11-04T01:41:35.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/1880854686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd00cdea0 msgr2=0x7f6dd00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/1880854686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd00cdea0 0x7f6dd00b0630 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40097c0 tx=0x7f6dc401c440 comp rx=0 tx=0).stop 2023-11-04T01:41:35.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/1880854686 shutdown_connections 2023-11-04T01:41:35.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/1880854686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd00cdea0 0x7f6dd00b0630 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/1880854686 >> 172.21.15.40:0/1880854686 conn(0x7f6dd00cebb0 msgr2=0x7f6dd00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/1880854686 shutdown_connections 2023-11-04T01:41:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/1880854686 wait complete. 2023-11-04T01:41:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 Processor -- start 2023-11-04T01:41:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- start start 2023-11-04T01:41:35.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd00ca400 0x7f6dd0155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd00cdea0 0x7f6dd0152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 0x7f6dd01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0154c10 con 0x7f6dd015a1f0 2023-11-04T01:41:35.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0154e20 con 0x7f6dd00cdea0 2023-11-04T01:41:35.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0155100 con 0x7f6dd00ca400 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 0x7f6dd01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 0x7f6dd01577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58506/0 (socket says 172.21.15.40:58506) 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 -- 172.21.15.40:0/832454109 learned_addr learned my addr 172.21.15.40:0/832454109 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dcdd9b640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd00cdea0 0x7f6dd0152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dce59c640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd00ca400 0x7f6dd0155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 -- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd00ca400 msgr2=0x7f6dd0155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd00ca400 0x7f6dd0155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 -- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd00cdea0 msgr2=0x7f6dd0152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd00cdea0 0x7f6dd0152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 -- 172.21.15.40:0/832454109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc4009420 con 0x7f6dd015a1f0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dce59c640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd00ca400 0x7f6dd0155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dced9d640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 0x7f6dd01577a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c780 tx=0x7f6dc800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004b70 con 0x7f6dd015a1f0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800ce90 con 0x7f6dd015a1f0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd01553e0 con 0x7f6dd015a1f0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800a850 con 0x7f6dd015a1f0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.979+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd01559a0 con 0x7f6dd015a1f0 2023-11-04T01:41:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.983+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd00744a0 con 0x7f6dd015a1f0 2023-11-04T01:41:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.983+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6dc800a9b0 con 0x7f6dd015a1f0 2023-11-04T01:41:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.983+0000 7f6dbeffd640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6db00664a0 0x7f6db0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.983+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6dc8084130 con 0x7f6dd015a1f0 2023-11-04T01:41:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.983+0000 7f6dce59c640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6db00664a0 0x7f6db0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.983+0000 7f6dce59c640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6db00664a0 0x7f6db0068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0000f70 tx=0x7f6dc0007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:35.987+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6dc8051450 con 0x7f6dd015a1f0 2023-11-04T01:41:36.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.143+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dd00b0f80 con 0x7f6db00664a0 2023-11-04T01:41:36.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.171+0000 7f6dbeffd640 1 -- 172.21.15.40:0/832454109 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368610 (secure 0 0 0) 0x7f6dc00073a0 con 0x7f6db00664a0 2023-11-04T01:41:36.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:36.181 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:41:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6db00664a0 msgr2=0x7f6db0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6db00664a0 0x7f6db0068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0000f70 tx=0x7f6dc0007cd0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 msgr2=0x7f6dd01577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 0x7f6dd01577a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c780 tx=0x7f6dc800cc40 comp rx=0 tx=0).stop 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 shutdown_connections 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6db00664a0 0x7f6db0068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd015a1f0 0x7f6dd01577a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd00cdea0 0x7f6dd0152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 --2- 172.21.15.40:0/832454109 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd00ca400 0x7f6dd0155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 >> 172.21.15.40:0/832454109 conn(0x7f6dd00cebb0 msgr2=0x7f6dd00c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 shutdown_connections 2023-11-04T01:41:36.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.175+0000 7f6dd4ab9640 1 -- 172.21.15.40:0/832454109 wait complete. 2023-11-04T01:41:36.199 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-11-04T01:41:35.783568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221828,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752892,"statfs":{"total":773094113280,"available":772866961408,"internally_reserved":0,"allocated":5775360,"data_stored":3105748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.005161"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716766+0000","last_change":"2023-11-04T01:41:31.740312+0000","last_active":"2023-11-04T01:41:32.716766+0000","last_peered":"2023-11-04T01:41:32.716766+0000","last_clean":"2023-11-04T01:41:32.716766+0000","last_became_active":"2023-11-04T01:41:31.739490+0000","last_became_peered":"2023-11-04T01:41:31.739490+0000","last_unstale":"2023-11-04T01:41:32.716766+0000","last_undegraded":"2023-11-04T01:41:32.716766+0000","last_fullsized":"2023-11-04T01:41:32.716766+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:04.132535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631894+0000","last_change":"2023-11-04T01:41:31.743797+0000","last_active":"2023-11-04T01:41:33.631894+0000","last_peered":"2023-11-04T01:41:33.631894+0000","last_clean":"2023-11-04T01:41:33.631894+0000","last_became_active":"2023-11-04T01:41:31.743051+0000","last_became_peered":"2023-11-04T01:41:31.743051+0000","last_unstale":"2023-11-04T01:41:33.631894+0000","last_undegraded":"2023-11-04T01:41:33.631894+0000","last_fullsized":"2023-11-04T01:41:33.631894+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:56:46.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.634703+0000","last_change":"2023-11-04T01:41:31.760730+0000","last_active":"2023-11-04T01:41:33.634703+0000","last_peered":"2023-11-04T01:41:33.634703+0000","last_clean":"2023-11-04T01:41:33.634703+0000","last_became_active":"2023-11-04T01:41:31.759038+0000","last_became_peered":"2023-11-04T01:41:31.759038+0000","last_unstale":"2023-11-04T01:41:33.634703+0000","last_undegraded":"2023-11-04T01:41:33.634703+0000","last_fullsized":"2023-11-04T01:41:33.634703+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:30:19.079940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631598+0000","last_change":"2023-11-04T01:41:31.738082+0000","last_active":"2023-11-04T01:41:33.631598+0000","last_peered":"2023-11-04T01:41:33.631598+0000","last_clean":"2023-11-04T01:41:33.631598+0000","last_became_active":"2023-11-04T01:41:31.737040+0000","last_became_peered":"2023-11-04T01:41:31.737040+0000","last_unstale":"2023-11-04T01:41:33.631598+0000","last_undegraded":"2023-11-04T01:41:33.631598+0000","last_fullsized":"2023-11-04T01:41:33.631598+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:47.280409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.719112+0000","last_change":"2023-11-04T01:41:31.766499+0000","last_active":"2023-11-04T01:41:32.719112+0000","last_peered":"2023-11-04T01:41:32.719112+0000","last_clean":"2023-11-04T01:41:32.719112+0000","last_became_active":"2023-11-04T01:41:31.765691+0000","last_became_peered":"2023-11-04T01:41:31.765691+0000","last_unstale":"2023-11-04T01:41:32.719112+0000","last_undegraded":"2023-11-04T01:41:32.719112+0000","last_fullsized":"2023-11-04T01:41:32.719112+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:32.982493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716504+0000","last_change":"2023-11-04T01:41:31.764140+0000","last_active":"2023-11-04T01:41:32.716504+0000","last_peered":"2023-11-04T01:41:32.716504+0000","last_clean":"2023-11-04T01:41:32.716504+0000","last_became_active":"2023-11-04T01:41:31.763795+0000","last_became_peered":"2023-11-04T01:41:31.763795+0000","last_unstale":"2023-11-04T01:41:32.716504+0000","last_undegraded":"2023-11-04T01:41:32.716504+0000","last_fullsized":"2023-11-04T01:41:32.716504+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:54.739498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632111+0000","last_change":"2023-11-04T01:41:31.760747+0000","last_active":"2023-11-04T01:41:33.632111+0000","last_peered":"2023-11-04T01:41:33.632111+0000","last_clean":"2023-11-04T01:41:33.632111+0000","last_became_active":"2023-11-04T01:41:31.759145+0000","last_became_peered":"2023-11-04T01:41:31.759145+0000","last_unstale":"2023-11-04T01:41:33.632111+0000","last_undegraded":"2023-11-04T01:41:33.632111+0000","last_fullsized":"2023-11-04T01:41:33.632111+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:29.099229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.629910+0000","last_change":"2023-11-04T01:41:31.749955+0000","last_active":"2023-11-04T01:41:33.629910+0000","last_peered":"2023-11-04T01:41:33.629910+0000","last_clean":"2023-11-04T01:41:33.629910+0000","last_became_active":"2023-11-04T01:41:31.749182+0000","last_became_peered":"2023-11-04T01:41:31.749182+0000","last_unstale":"2023-11-04T01:41:33.629910+0000","last_undegraded":"2023-11-04T01:41:33.629910+0000","last_fullsized":"2023-11-04T01:41:33.629910+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:01.589519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.633790+0000","last_change":"2023-11-04T01:41:31.764549+0000","last_active":"2023-11-04T01:41:33.633790+0000","last_peered":"2023-11-04T01:41:33.633790+0000","last_clean":"2023-11-04T01:41:33.633790+0000","last_became_active":"2023-11-04T01:41:31.764219+0000","last_became_peered":"2023-11-04T01:41:31.764219+0000","last_unstale":"2023-11-04T01:41:33.633790+0000","last_undegraded":"2023-11-04T01:41:33.633790+0000","last_fullsized":"2023-11-04T01:41:33.633790+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:08.449761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716915+0000","last_change":"2023-11-04T01:41:31.757753+0000","last_active":"2023-11-04T01:41:32.716915+0000","last_peered":"2023-11-04T01:41:32.716915+0000","last_clean":"2023-11-04T01:41:32.716915+0000","last_became_active":"2023-11-04T01:41:31.757465+0000","last_became_peered":"2023-11-04T01:41:31.757465+0000","last_unstale":"2023-11-04T01:41:32.716915+0000","last_undegraded":"2023-11-04T01:41:32.716915+0000","last_fullsized":"2023-11-04T01:41:32.716915+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:02:02.866467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.629977+0000","last_change":"2023-11-04T01:41:31.763850+0000","last_active":"2023-11-04T01:41:33.629977+0000","last_peered":"2023-11-04T01:41:33.629977+0000","last_clean":"2023-11-04T01:41:33.629977+0000","last_became_active":"2023-11-04T01:41:31.763551+0000","last_became_peered":"2023-11-04T01:41:31.763551+0000","last_unstale":"2023-11-04T01:41:33.629977+0000","last_undegraded":"2023-11-04T01:41:33.629977+0000","last_fullsized":"2023-11-04T01:41:33.629977+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:52.184287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631806+0000","last_change":"2023-11-04T01:41:31.749578+0000","last_active":"2023-11-04T01:41:33.631806+0000","last_peered":"2023-11-04T01:41:33.631806+0000","last_clean":"2023-11-04T01:41:33.631806+0000","last_became_active":"2023-11-04T01:41:31.748921+0000","last_became_peered":"2023-11-04T01:41:31.748921+0000","last_unstale":"2023-11-04T01:41:33.631806+0000","last_undegraded":"2023-11-04T01:41:33.631806+0000","last_fullsized":"2023-11-04T01:41:33.631806+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:34:29.573948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716433+0000","last_change":"2023-11-04T01:41:31.765245+0000","last_active":"2023-11-04T01:41:32.716433+0000","last_peered":"2023-11-04T01:41:32.716433+0000","last_clean":"2023-11-04T01:41:32.716433+0000","last_became_active":"2023-11-04T01:41:31.764848+0000","last_became_peered":"2023-11-04T01:41:31.764848+0000","last_unstale":"2023-11-04T01:41:32.716433+0000","last_undegraded":"2023-11-04T01:41:32.716433+0000","last_fullsized":"2023-11-04T01:41:32.716433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:38.990649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632496+0000","last_change":"2023-11-04T01:41:31.761315+0000","last_active":"2023-11-04T01:41:33.632496+0000","last_peered":"2023-11-04T01:41:33.632496+0000","last_clean":"2023-11-04T01:41:33.632496+0000","last_became_active":"2023-11-04T01:41:31.759895+0000","last_became_peered":"2023-11-04T01:41:31.759895+0000","last_unstale":"2023-11-04T01:41:33.632496+0000","last_undegraded":"2023-11-04T01:41:33.632496+0000","last_fullsized":"2023-11-04T01:41:33.632496+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:05.419216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.630722+0000","last_change":"2023-11-04T01:41:31.750267+0000","last_active":"2023-11-04T01:41:33.630722+0000","last_peered":"2023-11-04T01:41:33.630722+0000","last_clean":"2023-11-04T01:41:33.630722+0000","last_became_active":"2023-11-04T01:41:31.748073+0000","last_became_peered":"2023-11-04T01:41:31.748073+0000","last_unstale":"2023-11-04T01:41:33.630722+0000","last_undegraded":"2023-11-04T01:41:33.630722+0000","last_fullsized":"2023-11-04T01:41:33.630722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:44.252554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.715909+0000","last_change":"2023-11-04T01:41:31.765010+0000","last_active":"2023-11-04T01:41:32.715909+0000","last_peered":"2023-11-04T01:41:32.715909+0000","last_clean":"2023-11-04T01:41:32.715909+0000","last_became_active":"2023-11-04T01:41:31.764706+0000","last_became_peered":"2023-11-04T01:41:31.764706+0000","last_unstale":"2023-11-04T01:41:32.715909+0000","last_undegraded":"2023-11-04T01:41:32.715909+0000","last_fullsized":"2023-11-04T01:41:32.715909+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:53.838815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.635194+0000","last_change":"2023-11-04T01:41:31.746099+0000","last_active":"2023-11-04T01:41:33.635194+0000","last_peered":"2023-11-04T01:41:33.635194+0000","last_clean":"2023-11-04T01:41:33.635194+0000","last_became_active":"2023-11-04T01:41:31.745428+0000","last_became_peered":"2023-11-04T01:41:31.745428+0000","last_unstale":"2023-11-04T01:41:33.635194+0000","last_undegraded":"2023-11-04T01:41:33.635194+0000","last_fullsized":"2023-11-04T01:41:33.635194+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:56:46.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632207+0000","last_change":"2023-11-04T01:41:31.743984+0000","last_active":"2023-11-04T01:41:33.632207+0000","last_peered":"2023-11-04T01:41:33.632207+0000","last_clean":"2023-11-04T01:41:33.632207+0000","last_became_active":"2023-11-04T01:41:31.743206+0000","last_became_peered":"2023-11-04T01:41:31.743206+0000","last_unstale":"2023-11-04T01:41:33.632207+0000","last_undegraded":"2023-11-04T01:41:33.632207+0000","last_fullsized":"2023-11-04T01:41:33.632207+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:39.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.634611+0000","last_change":"2023-11-04T01:41:31.762110+0000","last_active":"2023-11-04T01:41:33.634611+0000","last_peered":"2023-11-04T01:41:33.634611+0000","last_clean":"2023-11-04T01:41:33.634611+0000","last_became_active":"2023-11-04T01:41:31.761793+0000","last_became_peered":"2023-11-04T01:41:31.761793+0000","last_unstale":"2023-11-04T01:41:33.634611+0000","last_undegraded":"2023-11-04T01:41:33.634611+0000","last_fullsized":"2023-11-04T01:41:33.634611+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:47.228616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632435+0000","last_change":"2023-11-04T01:41:31.763614+0000","last_active":"2023-11-04T01:41:33.632435+0000","last_peered":"2023-11-04T01:41:33.632435+0000","last_clean":"2023-11-04T01:41:33.632435+0000","last_became_active":"2023-11-04T01:41:31.762367+0000","last_became_peered":"2023-11-04T01:41:31.762367+0000","last_unstale":"2023-11-04T01:41:33.632435+0000","last_undegraded":"2023-11-04T01:41:33.632435+0000","last_fullsized":"2023-11-04T01:41:33.632435+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:43.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631107+0000","last_change":"2023-11-04T01:41:31.766366+0000","last_active":"2023-11-04T01:41:33.631107+0000","last_peered":"2023-11-04T01:41:33.631107+0000","last_clean":"2023-11-04T01:41:33.631107+0000","last_became_active":"2023-11-04T01:41:31.765422+0000","last_became_peered":"2023-11-04T01:41:31.765422+0000","last_unstale":"2023-11-04T01:41:33.631107+0000","last_undegraded":"2023-11-04T01:41:33.631107+0000","last_fullsized":"2023-11-04T01:41:33.631107+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:06.476766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.630649+0000","last_change":"2023-11-04T01:41:31.751422+0000","last_active":"2023-11-04T01:41:33.630649+0000","last_peered":"2023-11-04T01:41:33.630649+0000","last_clean":"2023-11-04T01:41:33.630649+0000","last_became_active":"2023-11-04T01:41:31.750741+0000","last_became_peered":"2023-11-04T01:41:31.750741+0000","last_unstale":"2023-11-04T01:41:33.630649+0000","last_undegraded":"2023-11-04T01:41:33.630649+0000","last_fullsized":"2023-11-04T01:41:33.630649+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:34:34.553085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.629056+0000","last_change":"2023-11-04T01:41:31.763742+0000","last_active":"2023-11-04T01:41:33.629056+0000","last_peered":"2023-11-04T01:41:33.629056+0000","last_clean":"2023-11-04T01:41:33.629056+0000","last_became_active":"2023-11-04T01:41:31.763422+0000","last_became_peered":"2023-11-04T01:41:31.763422+0000","last_unstale":"2023-11-04T01:41:33.629056+0000","last_undegraded":"2023-11-04T01:41:33.629056+0000","last_fullsized":"2023-11-04T01:41:33.629056+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:47:36.482694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631564+0000","last_change":"2023-11-04T01:41:31.754190+0000","last_active":"2023-11-04T01:41:33.631564+0000","last_peered":"2023-11-04T01:41:33.631564+0000","last_clean":"2023-11-04T01:41:33.631564+0000","last_became_active":"2023-11-04T01:41:31.746991+0000","last_became_peered":"2023-11-04T01:41:31.746991+0000","last_unstale":"2023-11-04T01:41:33.631564+0000","last_undegraded":"2023-11-04T01:41:33.631564+0000","last_fullsized":"2023-11-04T01:41:33.631564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.567677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.635425+0000","last_change":"2023-11-04T01:41:31.762078+0000","last_active":"2023-11-04T01:41:33.635425+0000","last_peered":"2023-11-04T01:41:33.635425+0000","last_clean":"2023-11-04T01:41:33.635425+0000","last_became_active":"2023-11-04T01:41:31.761482+0000","last_became_peered":"2023-11-04T01:41:31.761482+0000","last_unstale":"2023-11-04T01:41:33.635425+0000","last_undegraded":"2023-11-04T01:41:33.635425+0000","last_fullsized":"2023-11-04T01:41:33.635425+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:10:50.653556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631994+0000","last_change":"2023-11-04T01:41:31.750921+0000","last_active":"2023-11-04T01:41:33.631994+0000","last_peered":"2023-11-04T01:41:33.631994+0000","last_clean":"2023-11-04T01:41:33.631994+0000","last_became_active":"2023-11-04T01:41:31.750527+0000","last_became_peered":"2023-11-04T01:41:31.750527+0000","last_unstale":"2023-11-04T01:41:33.631994+0000","last_undegraded":"2023-11-04T01:41:33.631994+0000","last_fullsized":"2023-11-04T01:41:33.631994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:32.936488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716986+0000","last_change":"2023-11-04T01:41:31.758951+0000","last_active":"2023-11-04T01:41:32.716986+0000","last_peered":"2023-11-04T01:41:32.716986+0000","last_clean":"2023-11-04T01:41:32.716986+0000","last_became_active":"2023-11-04T01:41:31.758389+0000","last_became_peered":"2023-11-04T01:41:31.758389+0000","last_unstale":"2023-11-04T01:41:32.716986+0000","last_undegraded":"2023-11-04T01:41:32.716986+0000","last_fullsized":"2023-11-04T01:41:32.716986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:57:58.700296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632134+0000","last_change":"2023-11-04T01:41:31.760998+0000","last_active":"2023-11-04T01:41:33.632134+0000","last_peered":"2023-11-04T01:41:33.632134+0000","last_clean":"2023-11-04T01:41:33.632134+0000","last_became_active":"2023-11-04T01:41:31.760256+0000","last_became_peered":"2023-11-04T01:41:31.760256+0000","last_unstale":"2023-11-04T01:41:33.632134+0000","last_undegraded":"2023-11-04T01:41:33.632134+0000","last_fullsized":"2023-11-04T01:41:33.632134+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:35.425373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632952+0000","last_change":"2023-11-04T01:41:31.756427+0000","last_active":"2023-11-04T01:41:33.632952+0000","last_peered":"2023-11-04T01:41:33.632952+0000","last_clean":"2023-11-04T01:41:33.632952+0000","last_became_active":"2023-11-04T01:41:31.755641+0000","last_became_peered":"2023-11-04T01:41:31.755641+0000","last_unstale":"2023-11-04T01:41:33.632952+0000","last_undegraded":"2023-11-04T01:41:33.632952+0000","last_fullsized":"2023-11-04T01:41:33.632952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:19.179010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631481+0000","last_change":"2023-11-04T01:41:31.745559+0000","last_active":"2023-11-04T01:41:33.631481+0000","last_peered":"2023-11-04T01:41:33.631481+0000","last_clean":"2023-11-04T01:41:33.631481+0000","last_became_active":"2023-11-04T01:41:31.744782+0000","last_became_peered":"2023-11-04T01:41:31.744782+0000","last_unstale":"2023-11-04T01:41:33.631481+0000","last_undegraded":"2023-11-04T01:41:33.631481+0000","last_fullsized":"2023-11-04T01:41:33.631481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:23.789446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632425+0000","last_change":"2023-11-04T01:41:31.754204+0000","last_active":"2023-11-04T01:41:33.632425+0000","last_peered":"2023-11-04T01:41:33.632425+0000","last_clean":"2023-11-04T01:41:33.632425+0000","last_became_active":"2023-11-04T01:41:31.753678+0000","last_became_peered":"2023-11-04T01:41:31.753678+0000","last_unstale":"2023-11-04T01:41:33.632425+0000","last_undegraded":"2023-11-04T01:41:33.632425+0000","last_fullsized":"2023-11-04T01:41:33.632425+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:36.191932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.719210+0000","last_change":"2023-11-04T01:41:31.764080+0000","last_active":"2023-11-04T01:41:32.719210+0000","last_peered":"2023-11-04T01:41:32.719210+0000","last_clean":"2023-11-04T01:41:32.719210+0000","last_became_active":"2023-11-04T01:41:31.763433+0000","last_became_peered":"2023-11-04T01:41:31.763433+0000","last_unstale":"2023-11-04T01:41:32.719210+0000","last_undegraded":"2023-11-04T01:41:32.719210+0000","last_fullsized":"2023-11-04T01:41:32.719210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:05.419216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.630248+0000","last_change":"2023-11-04T01:41:31.745299+0000","last_active":"2023-11-04T01:41:33.630248+0000","last_peered":"2023-11-04T01:41:33.630248+0000","last_clean":"2023-11-04T01:41:33.630248+0000","last_became_active":"2023-11-04T01:41:31.744516+0000","last_became_peered":"2023-11-04T01:41:31.744516+0000","last_unstale":"2023-11-04T01:41:33.630248+0000","last_undegraded":"2023-11-04T01:41:33.630248+0000","last_fullsized":"2023-11-04T01:41:33.630248+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:31.328561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.738357+0000","last_change":"2023-11-04T01:41:30.777789+0000","last_active":"2023-11-04T01:41:31.738357+0000","last_peered":"2023-11-04T01:41:31.738357+0000","last_clean":"2023-11-04T01:41:31.738357+0000","last_became_active":"2023-11-04T01:41:30.777397+0000","last_became_peered":"2023-11-04T01:41:30.777397+0000","last_unstale":"2023-11-04T01:41:31.738357+0000","last_undegraded":"2023-11-04T01:41:31.738357+0000","last_fullsized":"2023-11-04T01:41:31.738357+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:07.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.716795+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:41:31.716795+0000","last_peered":"2023-11-04T01:41:31.716795+0000","last_clean":"2023-11-04T01:41:31.716795+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:41:31.716795+0000","last_undegraded":"2023-11-04T01:41:31.716795+0000","last_fullsized":"2023-11-04T01:41:31.716795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.726269+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:41:31.726269+0000","last_peered":"2023-11-04T01:41:31.726269+0000","last_clean":"2023-11-04T01:41:31.726269+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:41:31.726269+0000","last_undegraded":"2023-11-04T01:41:31.726269+0000","last_fullsized":"2023-11-04T01:41:31.726269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.633218+0000","last_change":"2023-11-04T01:41:31.761460+0000","last_active":"2023-11-04T01:41:33.633218+0000","last_peered":"2023-11-04T01:41:33.633218+0000","last_clean":"2023-11-04T01:41:33.633218+0000","last_became_active":"2023-11-04T01:41:31.760165+0000","last_became_peered":"2023-11-04T01:41:31.760165+0000","last_unstale":"2023-11-04T01:41:33.633218+0000","last_undegraded":"2023-11-04T01:41:33.633218+0000","last_fullsized":"2023-11-04T01:41:33.633218+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:58.389046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.713796+0000","last_change":"2023-11-04T01:41:30.771425+0000","last_active":"2023-11-04T01:41:31.713796+0000","last_peered":"2023-11-04T01:41:31.713796+0000","last_clean":"2023-11-04T01:41:31.713796+0000","last_became_active":"2023-11-04T01:41:30.770910+0000","last_became_peered":"2023-11-04T01:41:30.770910+0000","last_unstale":"2023-11-04T01:41:31.713796+0000","last_undegraded":"2023-11-04T01:41:31.713796+0000","last_fullsized":"2023-11-04T01:41:31.713796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:22.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.737000+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:41:31.737000+0000","last_peered":"2023-11-04T01:41:31.737000+0000","last_clean":"2023-11-04T01:41:31.737000+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:41:31.737000+0000","last_undegraded":"2023-11-04T01:41:31.737000+0000","last_fullsized":"2023-11-04T01:41:31.737000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.720796+0000","last_change":"2023-11-04T01:41:31.754294+0000","last_active":"2023-11-04T01:41:32.720796+0000","last_peered":"2023-11-04T01:41:32.720796+0000","last_clean":"2023-11-04T01:41:32.720796+0000","last_became_active":"2023-11-04T01:41:31.753428+0000","last_became_peered":"2023-11-04T01:41:31.753428+0000","last_unstale":"2023-11-04T01:41:32.720796+0000","last_undegraded":"2023-11-04T01:41:32.720796+0000","last_fullsized":"2023-11-04T01:41:32.720796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:58.389046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.714256+0000","last_change":"2023-11-04T01:41:30.768768+0000","last_active":"2023-11-04T01:41:31.714256+0000","last_peered":"2023-11-04T01:41:31.714256+0000","last_clean":"2023-11-04T01:41:31.714256+0000","last_became_active":"2023-11-04T01:41:30.768145+0000","last_became_peered":"2023-11-04T01:41:30.768145+0000","last_unstale":"2023-11-04T01:41:31.714256+0000","last_undegraded":"2023-11-04T01:41:31.714256+0000","last_fullsized":"2023-11-04T01:41:31.714256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:38.414566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.719524+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:41:31.719524+0000","last_peered":"2023-11-04T01:41:31.719524+0000","last_clean":"2023-11-04T01:41:31.719524+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:41:31.719524+0000","last_undegraded":"2023-11-04T01:41:31.719524+0000","last_fullsized":"2023-11-04T01:41:31.719524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.634744+0000","last_change":"2023-11-04T01:41:31.760719+0000","last_active":"2023-11-04T01:41:33.634744+0000","last_peered":"2023-11-04T01:41:33.634744+0000","last_clean":"2023-11-04T01:41:33.634744+0000","last_became_active":"2023-11-04T01:41:31.758727+0000","last_became_peered":"2023-11-04T01:41:31.758727+0000","last_unstale":"2023-11-04T01:41:33.634744+0000","last_undegraded":"2023-11-04T01:41:33.634744+0000","last_fullsized":"2023-11-04T01:41:33.634744+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:34.149944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.732515+0000","last_change":"2023-11-04T01:41:30.770850+0000","last_active":"2023-11-04T01:41:31.732515+0000","last_peered":"2023-11-04T01:41:31.732515+0000","last_clean":"2023-11-04T01:41:31.732515+0000","last_became_active":"2023-11-04T01:41:30.769978+0000","last_became_peered":"2023-11-04T01:41:30.769978+0000","last_unstale":"2023-11-04T01:41:31.732515+0000","last_undegraded":"2023-11-04T01:41:31.732515+0000","last_fullsized":"2023-11-04T01:41:31.732515+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:21.849985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.736925+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:41:31.736925+0000","last_peered":"2023-11-04T01:41:31.736925+0000","last_clean":"2023-11-04T01:41:31.736925+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:41:31.736925+0000","last_undegraded":"2023-11-04T01:41:31.736925+0000","last_fullsized":"2023-11-04T01:41:31.736925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.633983+0000","last_change":"2023-11-04T01:41:31.743857+0000","last_active":"2023-11-04T01:41:33.633983+0000","last_peered":"2023-11-04T01:41:33.633983+0000","last_clean":"2023-11-04T01:41:33.633983+0000","last_became_active":"2023-11-04T01:41:31.742513+0000","last_became_peered":"2023-11-04T01:41:31.742513+0000","last_unstale":"2023-11-04T01:41:33.633983+0000","last_undegraded":"2023-11-04T01:41:33.633983+0000","last_fullsized":"2023-11-04T01:41:33.633983+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:48.836503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.721310+0000","last_change":"2023-11-04T01:41:30.756342+0000","last_active":"2023-11-04T01:41:31.721310+0000","last_peered":"2023-11-04T01:41:31.721310+0000","last_clean":"2023-11-04T01:41:31.721310+0000","last_became_active":"2023-11-04T01:41:30.755525+0000","last_became_peered":"2023-11-04T01:41:30.755525+0000","last_unstale":"2023-11-04T01:41:31.721310+0000","last_undegraded":"2023-11-04T01:41:31.721310+0000","last_fullsized":"2023-11-04T01:41:31.721310+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:02:01.862053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.727726+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:41:31.727726+0000","last_peered":"2023-11-04T01:41:31.727726+0000","last_clean":"2023-11-04T01:41:31.727726+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:41:31.727726+0000","last_undegraded":"2023-11-04T01:41:31.727726+0000","last_fullsized":"2023-11-04T01:41:31.727726+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.719538+0000","last_change":"2023-11-04T01:41:31.765006+0000","last_active":"2023-11-04T01:41:32.719538+0000","last_peered":"2023-11-04T01:41:32.719538+0000","last_clean":"2023-11-04T01:41:32.719538+0000","last_became_active":"2023-11-04T01:41:31.764000+0000","last_became_peered":"2023-11-04T01:41:31.764000+0000","last_unstale":"2023-11-04T01:41:32.719538+0000","last_undegraded":"2023-11-04T01:41:32.719538+0000","last_fullsized":"2023-11-04T01:41:32.719538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:46.615882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.780540+0000","last_change":"2023-11-04T01:41:30.766324+0000","last_active":"2023-11-04T01:41:31.780540+0000","last_peered":"2023-11-04T01:41:31.780540+0000","last_clean":"2023-11-04T01:41:31.780540+0000","last_became_active":"2023-11-04T01:41:30.765546+0000","last_became_peered":"2023-11-04T01:41:30.765546+0000","last_unstale":"2023-11-04T01:41:31.780540+0000","last_undegraded":"2023-11-04T01:41:31.780540+0000","last_fullsized":"2023-11-04T01:41:31.780540+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:24.279174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.717280+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:41:31.717280+0000","last_peered":"2023-11-04T01:41:31.717280+0000","last_clean":"2023-11-04T01:41:31.717280+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:41:31.717280+0000","last_undegraded":"2023-11-04T01:41:31.717280+0000","last_fullsized":"2023-11-04T01:41:31.717280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716617+0000","last_change":"2023-11-04T01:41:31.757027+0000","last_active":"2023-11-04T01:41:32.716617+0000","last_peered":"2023-11-04T01:41:32.716617+0000","last_clean":"2023-11-04T01:41:32.716617+0000","last_became_active":"2023-11-04T01:41:31.756615+0000","last_became_peered":"2023-11-04T01:41:31.756615+0000","last_unstale":"2023-11-04T01:41:32.716617+0000","last_undegraded":"2023-11-04T01:41:32.716617+0000","last_fullsized":"2023-11-04T01:41:32.716617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:04.404841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.718528+0000","last_change":"2023-11-04T01:41:30.771407+0000","last_active":"2023-11-04T01:41:31.718528+0000","last_peered":"2023-11-04T01:41:31.718528+0000","last_clean":"2023-11-04T01:41:31.718528+0000","last_became_active":"2023-11-04T01:41:30.770706+0000","last_became_peered":"2023-11-04T01:41:30.770706+0000","last_unstale":"2023-11-04T01:41:31.718528+0000","last_undegraded":"2023-11-04T01:41:31.718528+0000","last_fullsized":"2023-11-04T01:41:31.718528+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:45.611468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.725019+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:41:31.725019+0000","last_peered":"2023-11-04T01:41:31.725019+0000","last_clean":"2023-11-04T01:41:31.725019+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:41:31.725019+0000","last_undegraded":"2023-11-04T01:41:31.725019+0000","last_fullsized":"2023-11-04T01:41:31.725019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.630390+0000","last_change":"2023-11-04T01:41:31.763302+0000","last_active":"2023-11-04T01:41:33.630390+0000","last_peered":"2023-11-04T01:41:33.630390+0000","last_clean":"2023-11-04T01:41:33.630390+0000","last_became_active":"2023-11-04T01:41:31.762913+0000","last_became_peered":"2023-11-04T01:41:31.762913+0000","last_unstale":"2023-11-04T01:41:33.630390+0000","last_undegraded":"2023-11-04T01:41:33.630390+0000","last_fullsized":"2023-11-04T01:41:33.630390+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:04.894582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.737529+0000","last_change":"2023-11-04T01:41:30.774198+0000","last_active":"2023-11-04T01:41:31.737529+0000","last_peered":"2023-11-04T01:41:31.737529+0000","last_clean":"2023-11-04T01:41:31.737529+0000","last_became_active":"2023-11-04T01:41:30.773776+0000","last_became_peered":"2023-11-04T01:41:30.773776+0000","last_unstale":"2023-11-04T01:41:31.737529+0000","last_undegraded":"2023-11-04T01:41:31.737529+0000","last_fullsized":"2023-11-04T01:41:31.737529+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:03.400427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.720963+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:41:31.720963+0000","last_peered":"2023-11-04T01:41:31.720963+0000","last_clean":"2023-11-04T01:41:31.720963+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:41:31.720963+0000","last_undegraded":"2023-11-04T01:41:31.720963+0000","last_fullsized":"2023-11-04T01:41:31.720963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.720221+0000","last_change":"2023-11-04T01:41:31.756896+0000","last_active":"2023-11-04T01:41:32.720221+0000","last_peered":"2023-11-04T01:41:32.720221+0000","last_clean":"2023-11-04T01:41:32.720221+0000","last_became_active":"2023-11-04T01:41:31.756134+0000","last_became_peered":"2023-11-04T01:41:31.756134+0000","last_unstale":"2023-11-04T01:41:32.720221+0000","last_undegraded":"2023-11-04T01:41:32.720221+0000","last_fullsized":"2023-11-04T01:41:32.720221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:19.179010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.776059+0000","last_change":"2023-11-04T01:41:30.756176+0000","last_active":"2023-11-04T01:41:31.776059+0000","last_peered":"2023-11-04T01:41:31.776059+0000","last_clean":"2023-11-04T01:41:31.776059+0000","last_became_active":"2023-11-04T01:41:30.755102+0000","last_became_peered":"2023-11-04T01:41:30.755102+0000","last_unstale":"2023-11-04T01:41:31.776059+0000","last_undegraded":"2023-11-04T01:41:31.776059+0000","last_fullsized":"2023-11-04T01:41:31.776059+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:47.067554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.724705+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:41:31.724705+0000","last_peered":"2023-11-04T01:41:31.724705+0000","last_clean":"2023-11-04T01:41:31.724705+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:41:31.724705+0000","last_undegraded":"2023-11-04T01:41:31.724705+0000","last_fullsized":"2023-11-04T01:41:31.724705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631465+0000","last_change":"2023-11-04T01:41:31.763254+0000","last_active":"2023-11-04T01:41:33.631465+0000","last_peered":"2023-11-04T01:41:33.631465+0000","last_clean":"2023-11-04T01:41:33.631465+0000","last_became_active":"2023-11-04T01:41:31.762273+0000","last_became_peered":"2023-11-04T01:41:31.762273+0000","last_unstale":"2023-11-04T01:41:33.631465+0000","last_undegraded":"2023-11-04T01:41:33.631465+0000","last_fullsized":"2023-11-04T01:41:33.631465+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:27.739805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.713882+0000","last_change":"2023-11-04T01:41:30.770568+0000","last_active":"2023-11-04T01:41:31.713882+0000","last_peered":"2023-11-04T01:41:31.713882+0000","last_clean":"2023-11-04T01:41:31.713882+0000","last_became_active":"2023-11-04T01:41:30.770200+0000","last_became_peered":"2023-11-04T01:41:30.770200+0000","last_unstale":"2023-11-04T01:41:31.713882+0000","last_undegraded":"2023-11-04T01:41:31.713882+0000","last_fullsized":"2023-11-04T01:41:31.713882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:56:45.922787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.715185+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:41:31.715185+0000","last_peered":"2023-11-04T01:41:31.715185+0000","last_clean":"2023-11-04T01:41:31.715185+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:41:31.715185+0000","last_undegraded":"2023-11-04T01:41:31.715185+0000","last_fullsized":"2023-11-04T01:41:31.715185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.634829+0000","last_change":"2023-11-04T01:41:31.746199+0000","last_active":"2023-11-04T01:41:33.634829+0000","last_peered":"2023-11-04T01:41:33.634829+0000","last_clean":"2023-11-04T01:41:33.634829+0000","last_became_active":"2023-11-04T01:41:31.745401+0000","last_became_peered":"2023-11-04T01:41:31.745401+0000","last_unstale":"2023-11-04T01:41:33.634829+0000","last_undegraded":"2023-11-04T01:41:33.634829+0000","last_fullsized":"2023-11-04T01:41:33.634829+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:44.252554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.737959+0000","last_change":"2023-11-04T01:41:30.773724+0000","last_active":"2023-11-04T01:41:31.737959+0000","last_peered":"2023-11-04T01:41:31.737959+0000","last_clean":"2023-11-04T01:41:31.737959+0000","last_became_active":"2023-11-04T01:41:30.773404+0000","last_became_peered":"2023-11-04T01:41:30.773404+0000","last_unstale":"2023-11-04T01:41:31.737959+0000","last_undegraded":"2023-11-04T01:41:31.737959+0000","last_fullsized":"2023-11-04T01:41:31.737959+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:02:01.862053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.716565+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:41:31.716565+0000","last_peered":"2023-11-04T01:41:31.716565+0000","last_clean":"2023-11-04T01:41:31.716565+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:41:31.716565+0000","last_undegraded":"2023-11-04T01:41:31.716565+0000","last_fullsized":"2023-11-04T01:41:31.716565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716912+0000","last_change":"2023-11-04T01:41:31.757940+0000","last_active":"2023-11-04T01:41:32.716912+0000","last_peered":"2023-11-04T01:41:32.716912+0000","last_clean":"2023-11-04T01:41:32.716912+0000","last_became_active":"2023-11-04T01:41:31.757545+0000","last_became_peered":"2023-11-04T01:41:31.757545+0000","last_unstale":"2023-11-04T01:41:32.716912+0000","last_undegraded":"2023-11-04T01:41:32.716912+0000","last_fullsized":"2023-11-04T01:41:32.716912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:08.583869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.747523+0000","last_change":"2023-11-04T01:41:30.767473+0000","last_active":"2023-11-04T01:41:31.747523+0000","last_peered":"2023-11-04T01:41:31.747523+0000","last_clean":"2023-11-04T01:41:31.747523+0000","last_became_active":"2023-11-04T01:41:30.767081+0000","last_became_peered":"2023-11-04T01:41:30.767081+0000","last_unstale":"2023-11-04T01:41:31.747523+0000","last_undegraded":"2023-11-04T01:41:31.747523+0000","last_fullsized":"2023-11-04T01:41:31.747523+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:31.781321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.737607+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:41:31.737607+0000","last_peered":"2023-11-04T01:41:31.737607+0000","last_clean":"2023-11-04T01:41:31.737607+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:41:31.737607+0000","last_undegraded":"2023-11-04T01:41:31.737607+0000","last_fullsized":"2023-11-04T01:41:31.737607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.629869+0000","last_change":"2023-11-04T01:41:31.738260+0000","last_active":"2023-11-04T01:41:33.629869+0000","last_peered":"2023-11-04T01:41:33.629869+0000","last_clean":"2023-11-04T01:41:33.629869+0000","last_became_active":"2023-11-04T01:41:31.737210+0000","last_became_peered":"2023-11-04T01:41:31.737210+0000","last_unstale":"2023-11-04T01:41:33.629869+0000","last_undegraded":"2023-11-04T01:41:33.629869+0000","last_fullsized":"2023-11-04T01:41:33.629869+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:56.685064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.779541+0000","last_change":"2023-11-04T01:41:30.777678+0000","last_active":"2023-11-04T01:41:31.779541+0000","last_peered":"2023-11-04T01:41:31.779541+0000","last_clean":"2023-11-04T01:41:31.779541+0000","last_became_active":"2023-11-04T01:41:30.777284+0000","last_became_peered":"2023-11-04T01:41:30.777284+0000","last_unstale":"2023-11-04T01:41:31.779541+0000","last_undegraded":"2023-11-04T01:41:31.779541+0000","last_fullsized":"2023-11-04T01:41:31.779541+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:57:57.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.729541+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:41:31.729541+0000","last_peered":"2023-11-04T01:41:31.729541+0000","last_clean":"2023-11-04T01:41:31.729541+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:41:31.729541+0000","last_undegraded":"2023-11-04T01:41:31.729541+0000","last_fullsized":"2023-11-04T01:41:31.729541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716219+0000","last_change":"2023-11-04T01:41:31.763751+0000","last_active":"2023-11-04T01:41:32.716219+0000","last_peered":"2023-11-04T01:41:32.716219+0000","last_clean":"2023-11-04T01:41:32.716219+0000","last_became_active":"2023-11-04T01:41:31.760299+0000","last_became_peered":"2023-11-04T01:41:31.760299+0000","last_unstale":"2023-11-04T01:41:32.716219+0000","last_undegraded":"2023-11-04T01:41:32.716219+0000","last_fullsized":"2023-11-04T01:41:32.716219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:32.982493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.782678+0000","last_change":"2023-11-04T01:41:30.761825+0000","last_active":"2023-11-04T01:41:31.782678+0000","last_peered":"2023-11-04T01:41:31.782678+0000","last_clean":"2023-11-04T01:41:31.782678+0000","last_became_active":"2023-11-04T01:41:30.761394+0000","last_became_peered":"2023-11-04T01:41:30.761394+0000","last_unstale":"2023-11-04T01:41:31.782678+0000","last_undegraded":"2023-11-04T01:41:31.782678+0000","last_fullsized":"2023-11-04T01:41:31.782678+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:31:30.071750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.748937+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:41:31.748937+0000","last_peered":"2023-11-04T01:41:31.748937+0000","last_clean":"2023-11-04T01:41:31.748937+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:41:31.748937+0000","last_undegraded":"2023-11-04T01:41:31.748937+0000","last_fullsized":"2023-11-04T01:41:31.748937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.718348+0000","last_change":"2023-11-04T01:41:31.769485+0000","last_active":"2023-11-04T01:41:32.718348+0000","last_peered":"2023-11-04T01:41:32.718348+0000","last_clean":"2023-11-04T01:41:32.718348+0000","last_became_active":"2023-11-04T01:41:31.768856+0000","last_became_peered":"2023-11-04T01:41:31.768856+0000","last_unstale":"2023-11-04T01:41:32.718348+0000","last_undegraded":"2023-11-04T01:41:32.718348+0000","last_fullsized":"2023-11-04T01:41:32.718348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:21:55.782598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.777518+0000","last_change":"2023-11-04T01:41:30.756280+0000","last_active":"2023-11-04T01:41:31.777518+0000","last_peered":"2023-11-04T01:41:31.777518+0000","last_clean":"2023-11-04T01:41:31.777518+0000","last_became_active":"2023-11-04T01:41:30.755482+0000","last_became_peered":"2023-11-04T01:41:30.755482+0000","last_unstale":"2023-11-04T01:41:31.777518+0000","last_undegraded":"2023-11-04T01:41:31.777518+0000","last_fullsized":"2023-11-04T01:41:31.777518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:35.562951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.716966+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:41:31.716966+0000","last_peered":"2023-11-04T01:41:31.716966+0000","last_clean":"2023-11-04T01:41:31.716966+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:41:31.716966+0000","last_undegraded":"2023-11-04T01:41:31.716966+0000","last_fullsized":"2023-11-04T01:41:31.716966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.716298+0000","last_change":"2023-11-04T01:41:31.740618+0000","last_active":"2023-11-04T01:41:32.716298+0000","last_peered":"2023-11-04T01:41:32.716298+0000","last_clean":"2023-11-04T01:41:32.716298+0000","last_became_active":"2023-11-04T01:41:31.739534+0000","last_became_peered":"2023-11-04T01:41:31.739534+0000","last_unstale":"2023-11-04T01:41:32.716298+0000","last_undegraded":"2023-11-04T01:41:32.716298+0000","last_fullsized":"2023-11-04T01:41:32.716298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.285156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.734120+0000","last_change":"2023-11-04T01:41:30.770729+0000","last_active":"2023-11-04T01:41:31.734120+0000","last_peered":"2023-11-04T01:41:31.734120+0000","last_clean":"2023-11-04T01:41:31.734120+0000","last_became_active":"2023-11-04T01:41:30.770000+0000","last_became_peered":"2023-11-04T01:41:30.770000+0000","last_unstale":"2023-11-04T01:41:31.734120+0000","last_undegraded":"2023-11-04T01:41:31.734120+0000","last_fullsized":"2023-11-04T01:41:31.734120+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:29:47.228086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.725585+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:41:31.725585+0000","last_peered":"2023-11-04T01:41:31.725585+0000","last_clean":"2023-11-04T01:41:31.725585+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:41:31.725585+0000","last_undegraded":"2023-11-04T01:41:31.725585+0000","last_fullsized":"2023-11-04T01:41:31.725585+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.718613+0000","last_change":"2023-11-04T01:41:31.735408+0000","last_active":"2023-11-04T01:41:32.718613+0000","last_peered":"2023-11-04T01:41:32.718613+0000","last_clean":"2023-11-04T01:41:32.718613+0000","last_became_active":"2023-11-04T01:41:31.734589+0000","last_became_peered":"2023-11-04T01:41:31.734589+0000","last_unstale":"2023-11-04T01:41:32.718613+0000","last_undegraded":"2023-11-04T01:41:32.718613+0000","last_fullsized":"2023-11-04T01:41:32.718613+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:59.567677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.779001+0000","last_change":"2023-11-04T01:41:30.777462+0000","last_active":"2023-11-04T01:41:31.779001+0000","last_peered":"2023-11-04T01:41:31.779001+0000","last_clean":"2023-11-04T01:41:31.779001+0000","last_became_active":"2023-11-04T01:41:30.777128+0000","last_became_peered":"2023-11-04T01:41:30.777128+0000","last_unstale":"2023-11-04T01:41:31.779001+0000","last_undegraded":"2023-11-04T01:41:31.779001+0000","last_fullsized":"2023-11-04T01:41:31.779001+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:03.128121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.718981+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:41:31.718981+0000","last_peered":"2023-11-04T01:41:31.718981+0000","last_clean":"2023-11-04T01:41:31.718981+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:41:31.718981+0000","last_undegraded":"2023-11-04T01:41:31.718981+0000","last_fullsized":"2023-11-04T01:41:31.718981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.634991+0000","last_change":"2023-11-04T01:41:31.754376+0000","last_active":"2023-11-04T01:41:33.634991+0000","last_peered":"2023-11-04T01:41:33.634991+0000","last_clean":"2023-11-04T01:41:33.634991+0000","last_became_active":"2023-11-04T01:41:31.754057+0000","last_became_peered":"2023-11-04T01:41:31.754057+0000","last_unstale":"2023-11-04T01:41:33.634991+0000","last_undegraded":"2023-11-04T01:41:33.634991+0000","last_fullsized":"2023-11-04T01:41:33.634991+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:23.789446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.731796+0000","last_change":"2023-11-04T01:41:30.768659+0000","last_active":"2023-11-04T01:41:31.731796+0000","last_peered":"2023-11-04T01:41:31.731796+0000","last_clean":"2023-11-04T01:41:31.731796+0000","last_became_active":"2023-11-04T01:41:30.767892+0000","last_became_peered":"2023-11-04T01:41:30.767892+0000","last_unstale":"2023-11-04T01:41:31.731796+0000","last_undegraded":"2023-11-04T01:41:31.731796+0000","last_fullsized":"2023-11-04T01:41:31.731796+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:33.890461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.714958+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:41:31.714958+0000","last_peered":"2023-11-04T01:41:31.714958+0000","last_clean":"2023-11-04T01:41:31.714958+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:41:31.714958+0000","last_undegraded":"2023-11-04T01:41:31.714958+0000","last_fullsized":"2023-11-04T01:41:31.714958+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.631991+0000","last_change":"2023-11-04T01:41:31.733204+0000","last_active":"2023-11-04T01:41:33.631991+0000","last_peered":"2023-11-04T01:41:33.631991+0000","last_clean":"2023-11-04T01:41:33.631991+0000","last_became_active":"2023-11-04T01:41:31.732536+0000","last_became_peered":"2023-11-04T01:41:31.732536+0000","last_unstale":"2023-11-04T01:41:33.631991+0000","last_undegraded":"2023-11-04T01:41:33.631991+0000","last_fullsized":"2023-11-04T01:41:33.631991+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:33.746412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.717060+0000","last_change":"2023-11-04T01:41:30.773510+0000","last_active":"2023-11-04T01:41:31.717060+0000","last_peered":"2023-11-04T01:41:31.717060+0000","last_clean":"2023-11-04T01:41:31.717060+0000","last_became_active":"2023-11-04T01:41:30.772794+0000","last_became_peered":"2023-11-04T01:41:30.772794+0000","last_unstale":"2023-11-04T01:41:31.717060+0000","last_undegraded":"2023-11-04T01:41:31.717060+0000","last_fullsized":"2023-11-04T01:41:31.717060+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:57:57.695882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.736619+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:41:31.736619+0000","last_peered":"2023-11-04T01:41:31.736619+0000","last_clean":"2023-11-04T01:41:31.736619+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:41:31.736619+0000","last_undegraded":"2023-11-04T01:41:31.736619+0000","last_fullsized":"2023-11-04T01:41:31.736619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.635196+0000","last_change":"2023-11-04T01:41:31.761559+0000","last_active":"2023-11-04T01:41:33.635196+0000","last_peered":"2023-11-04T01:41:33.635196+0000","last_clean":"2023-11-04T01:41:33.635196+0000","last_became_active":"2023-11-04T01:41:31.759324+0000","last_became_peered":"2023-11-04T01:41:31.759324+0000","last_unstale":"2023-11-04T01:41:33.635196+0000","last_undegraded":"2023-11-04T01:41:33.635196+0000","last_fullsized":"2023-11-04T01:41:33.635196+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:47.280409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.781079+0000","last_change":"2023-11-04T01:41:30.765945+0000","last_active":"2023-11-04T01:41:31.781079+0000","last_peered":"2023-11-04T01:41:31.781079+0000","last_clean":"2023-11-04T01:41:31.781079+0000","last_became_active":"2023-11-04T01:41:30.765415+0000","last_became_peered":"2023-11-04T01:41:30.765415+0000","last_unstale":"2023-11-04T01:41:31.781079+0000","last_undegraded":"2023-11-04T01:41:31.781079+0000","last_fullsized":"2023-11-04T01:41:31.781079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:39.422347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.713373+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:41:31.713373+0000","last_peered":"2023-11-04T01:41:31.713373+0000","last_clean":"2023-11-04T01:41:31.713373+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:41:31.713373+0000","last_undegraded":"2023-11-04T01:41:31.713373+0000","last_fullsized":"2023-11-04T01:41:31.713373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.718492+0000","last_change":"2023-11-04T01:41:31.767914+0000","last_active":"2023-11-04T01:41:32.718492+0000","last_peered":"2023-11-04T01:41:32.718492+0000","last_clean":"2023-11-04T01:41:32.718492+0000","last_became_active":"2023-11-04T01:41:31.767196+0000","last_became_peered":"2023-11-04T01:41:31.767196+0000","last_unstale":"2023-11-04T01:41:32.718492+0000","last_undegraded":"2023-11-04T01:41:32.718492+0000","last_fullsized":"2023-11-04T01:41:32.718492+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:53.838815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.718952+0000","last_change":"2023-11-04T01:41:30.773282+0000","last_active":"2023-11-04T01:41:31.718952+0000","last_peered":"2023-11-04T01:41:31.718952+0000","last_clean":"2023-11-04T01:41:31.718952+0000","last_became_active":"2023-11-04T01:41:30.772597+0000","last_became_peered":"2023-11-04T01:41:30.772597+0000","last_unstale":"2023-11-04T01:41:31.718952+0000","last_undegraded":"2023-11-04T01:41:31.718952+0000","last_fullsized":"2023-11-04T01:41:31.718952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:18.174596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.738770+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:41:31.738770+0000","last_peered":"2023-11-04T01:41:31.738770+0000","last_clean":"2023-11-04T01:41:31.738770+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:41:31.738770+0000","last_undegraded":"2023-11-04T01:41:31.738770+0000","last_fullsized":"2023-11-04T01:41:31.738770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.718690+0000","last_change":"2023-11-04T01:41:31.757034+0000","last_active":"2023-11-04T01:41:32.718690+0000","last_peered":"2023-11-04T01:41:32.718690+0000","last_clean":"2023-11-04T01:41:32.718690+0000","last_became_active":"2023-11-04T01:41:31.756248+0000","last_became_peered":"2023-11-04T01:41:31.756248+0000","last_unstale":"2023-11-04T01:41:32.718690+0000","last_undegraded":"2023-11-04T01:41:32.718690+0000","last_fullsized":"2023-11-04T01:41:32.718690+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:29.099229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.729182+0000","last_change":"2023-11-04T01:41:30.763101+0000","last_active":"2023-11-04T01:41:31.729182+0000","last_peered":"2023-11-04T01:41:31.729182+0000","last_clean":"2023-11-04T01:41:31.729182+0000","last_became_active":"2023-11-04T01:41:30.762351+0000","last_became_peered":"2023-11-04T01:41:30.762351+0000","last_unstale":"2023-11-04T01:41:31.729182+0000","last_undegraded":"2023-11-04T01:41:31.729182+0000","last_fullsized":"2023-11-04T01:41:31.729182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:56.575564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.731543+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:41:31.731543+0000","last_peered":"2023-11-04T01:41:31.731543+0000","last_clean":"2023-11-04T01:41:31.731543+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:41:31.731543+0000","last_undegraded":"2023-11-04T01:41:31.731543+0000","last_fullsized":"2023-11-04T01:41:31.731543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632765+0000","last_change":"2023-11-04T01:41:31.757896+0000","last_active":"2023-11-04T01:41:33.632765+0000","last_peered":"2023-11-04T01:41:33.632765+0000","last_clean":"2023-11-04T01:41:33.632765+0000","last_became_active":"2023-11-04T01:41:31.756845+0000","last_became_peered":"2023-11-04T01:41:31.756845+0000","last_unstale":"2023-11-04T01:41:33.632765+0000","last_undegraded":"2023-11-04T01:41:33.632765+0000","last_fullsized":"2023-11-04T01:41:33.632765+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:46.615882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.784202+0000","last_change":"2023-11-04T01:41:30.772973+0000","last_active":"2023-11-04T01:41:31.784202+0000","last_peered":"2023-11-04T01:41:31.784202+0000","last_clean":"2023-11-04T01:41:31.784202+0000","last_became_active":"2023-11-04T01:41:30.772225+0000","last_became_peered":"2023-11-04T01:41:30.772225+0000","last_unstale":"2023-11-04T01:41:31.784202+0000","last_undegraded":"2023-11-04T01:41:31.784202+0000","last_fullsized":"2023-11-04T01:41:31.784202+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:31:58.563264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.748780+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:41:31.748780+0000","last_peered":"2023-11-04T01:41:31.748780+0000","last_clean":"2023-11-04T01:41:31.748780+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:41:31.748780+0000","last_undegraded":"2023-11-04T01:41:31.748780+0000","last_fullsized":"2023-11-04T01:41:31.748780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.719339+0000","last_change":"2023-11-04T01:41:31.762460+0000","last_active":"2023-11-04T01:41:32.719339+0000","last_peered":"2023-11-04T01:41:32.719339+0000","last_clean":"2023-11-04T01:41:32.719339+0000","last_became_active":"2023-11-04T01:41:31.761394+0000","last_became_peered":"2023-11-04T01:41:31.761394+0000","last_unstale":"2023-11-04T01:41:32.719339+0000","last_undegraded":"2023-11-04T01:41:32.719339+0000","last_fullsized":"2023-11-04T01:41:32.719339+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:17:13.285156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.782438+0000","last_change":"2023-11-04T01:41:30.770713+0000","last_active":"2023-11-04T01:41:31.782438+0000","last_peered":"2023-11-04T01:41:31.782438+0000","last_clean":"2023-11-04T01:41:31.782438+0000","last_became_active":"2023-11-04T01:41:30.770297+0000","last_became_peered":"2023-11-04T01:41:30.770297+0000","last_unstale":"2023-11-04T01:41:31.782438+0000","last_undegraded":"2023-11-04T01:41:31.782438+0000","last_fullsized":"2023-11-04T01:41:31.782438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:21.991677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.720738+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:41:31.720738+0000","last_peered":"2023-11-04T01:41:31.720738+0000","last_clean":"2023-11-04T01:41:31.720738+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:41:31.720738+0000","last_undegraded":"2023-11-04T01:41:31.720738+0000","last_fullsized":"2023-11-04T01:41:31.720738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.719420+0000","last_change":"2023-11-04T01:41:31.769539+0000","last_active":"2023-11-04T01:41:32.719420+0000","last_peered":"2023-11-04T01:41:32.719420+0000","last_clean":"2023-11-04T01:41:32.719420+0000","last_became_active":"2023-11-04T01:41:31.768799+0000","last_became_peered":"2023-11-04T01:41:31.768799+0000","last_unstale":"2023-11-04T01:41:32.719420+0000","last_undegraded":"2023-11-04T01:41:32.719420+0000","last_fullsized":"2023-11-04T01:41:32.719420+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:38.990649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.777991+0000","last_change":"2023-11-04T01:41:30.774082+0000","last_active":"2023-11-04T01:41:31.777991+0000","last_peered":"2023-11-04T01:41:31.777991+0000","last_clean":"2023-11-04T01:41:31.777991+0000","last_became_active":"2023-11-04T01:41:30.773462+0000","last_became_peered":"2023-11-04T01:41:30.773462+0000","last_unstale":"2023-11-04T01:41:31.777991+0000","last_undegraded":"2023-11-04T01:41:31.777991+0000","last_fullsized":"2023-11-04T01:41:31.777991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:53.735084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.736797+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:41:31.736797+0000","last_peered":"2023-11-04T01:41:31.736797+0000","last_clean":"2023-11-04T01:41:31.736797+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:41:31.736797+0000","last_undegraded":"2023-11-04T01:41:31.736797+0000","last_fullsized":"2023-11-04T01:41:31.736797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632668+0000","last_change":"2023-11-04T01:41:31.743005+0000","last_active":"2023-11-04T01:41:33.632668+0000","last_peered":"2023-11-04T01:41:33.632668+0000","last_clean":"2023-11-04T01:41:33.632668+0000","last_became_active":"2023-11-04T01:41:31.738667+0000","last_became_peered":"2023-11-04T01:41:31.738667+0000","last_unstale":"2023-11-04T01:41:33.632668+0000","last_undegraded":"2023-11-04T01:41:33.632668+0000","last_fullsized":"2023-11-04T01:41:33.632668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:16:25.655519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.780603+0000","last_change":"2023-11-04T01:41:30.759142+0000","last_active":"2023-11-04T01:41:31.780603+0000","last_peered":"2023-11-04T01:41:31.780603+0000","last_clean":"2023-11-04T01:41:31.780603+0000","last_became_active":"2023-11-04T01:41:30.758391+0000","last_became_peered":"2023-11-04T01:41:30.758391+0000","last_unstale":"2023-11-04T01:41:31.780603+0000","last_undegraded":"2023-11-04T01:41:31.780603+0000","last_fullsized":"2023-11-04T01:41:31.780603+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:47.067554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.714636+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:41:31.714636+0000","last_peered":"2023-11-04T01:41:31.714636+0000","last_clean":"2023-11-04T01:41:31.714636+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:41:31.714636+0000","last_undegraded":"2023-11-04T01:41:31.714636+0000","last_fullsized":"2023-11-04T01:41:31.714636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632343+0000","last_change":"2023-11-04T01:41:31.743934+0000","last_active":"2023-11-04T01:41:33.632343+0000","last_peered":"2023-11-04T01:41:33.632343+0000","last_clean":"2023-11-04T01:41:33.632343+0000","last_became_active":"2023-11-04T01:41:31.742447+0000","last_became_peered":"2023-11-04T01:41:31.742447+0000","last_unstale":"2023-11-04T01:41:33.632343+0000","last_undegraded":"2023-11-04T01:41:33.632343+0000","last_fullsized":"2023-11-04T01:41:33.632343+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:35.050033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.735658+0000","last_change":"2023-11-04T01:41:30.766363+0000","last_active":"2023-11-04T01:41:31.735658+0000","last_peered":"2023-11-04T01:41:31.735658+0000","last_clean":"2023-11-04T01:41:31.735658+0000","last_became_active":"2023-11-04T01:41:30.764656+0000","last_became_peered":"2023-11-04T01:41:30.764656+0000","last_unstale":"2023-11-04T01:41:31.735658+0000","last_undegraded":"2023-11-04T01:41:31.735658+0000","last_fullsized":"2023-11-04T01:41:31.735658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:56:22.681263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.736588+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:41:31.736588+0000","last_peered":"2023-11-04T01:41:31.736588+0000","last_clean":"2023-11-04T01:41:31.736588+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:41:31.736588+0000","last_undegraded":"2023-11-04T01:41:31.736588+0000","last_fullsized":"2023-11-04T01:41:31.736588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.632027+0000","last_change":"2023-11-04T01:41:31.765186+0000","last_active":"2023-11-04T01:41:33.632027+0000","last_peered":"2023-11-04T01:41:33.632027+0000","last_clean":"2023-11-04T01:41:33.632027+0000","last_became_active":"2023-11-04T01:41:31.764489+0000","last_became_peered":"2023-11-04T01:41:31.764489+0000","last_unstale":"2023-11-04T01:41:33.632027+0000","last_undegraded":"2023-11-04T01:41:33.632027+0000","last_fullsized":"2023-11-04T01:41:33.632027+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:10:50.653556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.736287+0000","last_change":"2023-11-04T01:41:30.761250+0000","last_active":"2023-11-04T01:41:31.736287+0000","last_peered":"2023-11-04T01:41:31.736287+0000","last_clean":"2023-11-04T01:41:31.736287+0000","last_became_active":"2023-11-04T01:41:30.760771+0000","last_became_peered":"2023-11-04T01:41:30.760771+0000","last_unstale":"2023-11-04T01:41:31.736287+0000","last_undegraded":"2023-11-04T01:41:31.736287+0000","last_fullsized":"2023-11-04T01:41:31.736287+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:37.986235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.719648+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:41:31.719648+0000","last_peered":"2023-11-04T01:41:31.719648+0000","last_clean":"2023-11-04T01:41:31.719648+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:41:31.719648+0000","last_undegraded":"2023-11-04T01:41:31.719648+0000","last_fullsized":"2023-11-04T01:41:31.719648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.630553+0000","last_change":"2023-11-04T01:41:31.735322+0000","last_active":"2023-11-04T01:41:33.630553+0000","last_peered":"2023-11-04T01:41:33.630553+0000","last_clean":"2023-11-04T01:41:33.630553+0000","last_became_active":"2023-11-04T01:41:31.734569+0000","last_became_peered":"2023-11-04T01:41:31.734569+0000","last_unstale":"2023-11-04T01:41:33.630553+0000","last_undegraded":"2023-11-04T01:41:33.630553+0000","last_fullsized":"2023-11-04T01:41:33.630553+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:17:34.149944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.784486+0000","last_change":"2023-11-04T01:41:30.759468+0000","last_active":"2023-11-04T01:41:31.784486+0000","last_peered":"2023-11-04T01:41:31.784486+0000","last_clean":"2023-11-04T01:41:31.784486+0000","last_became_active":"2023-11-04T01:41:30.758618+0000","last_became_peered":"2023-11-04T01:41:30.758618+0000","last_unstale":"2023-11-04T01:41:31.784486+0000","last_undegraded":"2023-11-04T01:41:31.784486+0000","last_fullsized":"2023-11-04T01:41:31.784486+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:26.412664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.729745+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:41:31.729745+0000","last_peered":"2023-11-04T01:41:31.729745+0000","last_clean":"2023-11-04T01:41:31.729745+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:41:31.729745+0000","last_undegraded":"2023-11-04T01:41:31.729745+0000","last_fullsized":"2023-11-04T01:41:31.729745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:32.719019+0000","last_change":"2023-11-04T01:41:31.748252+0000","last_active":"2023-11-04T01:41:32.719019+0000","last_peered":"2023-11-04T01:41:32.719019+0000","last_clean":"2023-11-04T01:41:32.719019+0000","last_became_active":"2023-11-04T01:41:31.747327+0000","last_became_peered":"2023-11-04T01:41:31.747327+0000","last_unstale":"2023-11-04T01:41:32.719019+0000","last_undegraded":"2023-11-04T01:41:32.719019+0000","last_fullsized":"2023-11-04T01:41:32.719019+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:36.191932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.776598+0000","last_change":"2023-11-04T01:41:30.746890+0000","last_active":"2023-11-04T01:41:31.776598+0000","last_peered":"2023-11-04T01:41:31.776598+0000","last_clean":"2023-11-04T01:41:31.776598+0000","last_became_active":"2023-11-04T01:41:30.746345+0000","last_became_peered":"2023-11-04T01:41:30.746345+0000","last_unstale":"2023-11-04T01:41:31.776598+0000","last_undegraded":"2023-11-04T01:41:31.776598+0000","last_fullsized":"2023-11-04T01:41:31.776598+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:10.509619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.715423+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:41:31.715423+0000","last_peered":"2023-11-04T01:41:31.715423+0000","last_clean":"2023-11-04T01:41:31.715423+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:41:31.715423+0000","last_undegraded":"2023-11-04T01:41:31.715423+0000","last_fullsized":"2023-11-04T01:41:31.715423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.630671+0000","last_change":"2023-11-04T01:41:31.753799+0000","last_active":"2023-11-04T01:41:33.630671+0000","last_peered":"2023-11-04T01:41:33.630671+0000","last_clean":"2023-11-04T01:41:33.630671+0000","last_became_active":"2023-11-04T01:41:31.753235+0000","last_became_peered":"2023-11-04T01:41:31.753235+0000","last_unstale":"2023-11-04T01:41:33.630671+0000","last_undegraded":"2023-11-04T01:41:33.630671+0000","last_fullsized":"2023-11-04T01:41:33.630671+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:30.616777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.778895+0000","last_change":"2023-11-04T01:41:30.757066+0000","last_active":"2023-11-04T01:41:31.778895+0000","last_peered":"2023-11-04T01:41:31.778895+0000","last_clean":"2023-11-04T01:41:31.778895+0000","last_became_active":"2023-11-04T01:41:30.756144+0000","last_became_peered":"2023-11-04T01:41:30.756144+0000","last_unstale":"2023-11-04T01:41:31.778895+0000","last_undegraded":"2023-11-04T01:41:31.778895+0000","last_fullsized":"2023-11-04T01:41:31.778895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:21.849985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.718888+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:41:31.718888+0000","last_peered":"2023-11-04T01:41:31.718888+0000","last_clean":"2023-11-04T01:41:31.718888+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:41:31.718888+0000","last_undegraded":"2023-11-04T01:41:31.718888+0000","last_fullsized":"2023-11-04T01:41:31.718888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-04T01:41:33.629781+0000","last_change":"2023-11-04T01:41:31.751271+0000","last_active":"2023-11-04T01:41:33.629781+0000","last_peered":"2023-11-04T01:41:33.629781+0000","last_clean":"2023-11-04T01:41:33.629781+0000","last_became_active":"2023-11-04T01:41:31.750585+0000","last_became_peered":"2023-11-04T01:41:31.750585+0000","last_unstale":"2023-11-04T01:41:33.629781+0000","last_undegraded":"2023-11-04T01:41:33.629781+0000","last_fullsized":"2023-11-04T01:41:33.629781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:30.715847+0000","last_clean_scrub_stamp":"2023-11-04T01:41:30.715847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:35:32.743962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.783753+0000","last_change":"2023-11-04T01:41:30.759000+0000","last_active":"2023-11-04T01:41:31.783753+0000","last_peered":"2023-11-04T01:41:31.783753+0000","last_clean":"2023-11-04T01:41:31.783753+0000","last_became_active":"2023-11-04T01:41:30.758228+0000","last_became_peered":"2023-11-04T01:41:30.758228+0000","last_unstale":"2023-11-04T01:41:31.783753+0000","last_undegraded":"2023-11-04T01:41:31.783753+0000","last_fullsized":"2023-11-04T01:41:31.783753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:29.711433+0000","last_clean_scrub_stamp":"2023-11-04T01:41:29.711433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:07.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:31.725858+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:41:31.725858+0000","last_peered":"2023-11-04T01:41:31.725858+0000","last_clean":"2023-11-04T01:41:31.725858+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:41:31.725858+0000","last_undegraded":"2023-11-04T01:41:31.725858+0000","last_fullsized":"2023-11-04T01:41:31.725858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1167360,"data_stored":830516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":1.02}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.048},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.96199999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.129}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.876},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0740000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.159}]},{"osd":6,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.194},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.22}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":240676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.95999999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.089}]},{"osd":2,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.044},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.628}]},{"osd":5,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.169},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.012}]},{"osd":7,"last update":"Sat Nov 4 01:40:45 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.141},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.79600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":565248,"data_stored":240024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.1080000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1339999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.081}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.624},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.747},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":569344,"data_stored":240606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.86799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91900000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.115},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.046}]},{"osd":3,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.0089999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1579999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2030000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":241658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.754}]},{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.71199999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.032},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.92000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.4570000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.089},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.109}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":241636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.44}]},{"osd":4,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.79100000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:46 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":573440,"data_stored":240184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.83899999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.081},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.4419999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.276},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.387}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.6910000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.514},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.617}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343676,"statfs":{"total":96636764160,"available":96607924224,"internally_reserved":0,"allocated":1167360,"data_stored":830448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.88600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0609999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.097}]},{"osd":7,"last update":"Sat Nov 4 01:40:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.01},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.143}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:36.205 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:41:36.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:41:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 Processor -- start 2023-11-04T01:41:36.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 -- start start 2023-11-04T01:41:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7e00b04e0 0x7fb7e00b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00c91b0 0x7fb7e00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e00c9b80 con 0x7fb7e0159f90 2023-11-04T01:41:36.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00b0eb0 con 0x7fb7e00b04e0 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e832a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00714c0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7e00b04e0 0x7fb7e00b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7e00b04e0 0x7fb7e00b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58522/0 (socket says 172.21.15.40:58522) 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 -- 172.21.15.40:0/4088880463 learned_addr learned my addr 172.21.15.40:0/4088880463 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e68c7640 1 --2- 172.21.15.40:0/4088880463 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00c91b0 0x7fb7e00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 -- 172.21.15.40:0/4088880463 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00c91b0 msgr2=0x7fb7e00c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 --2- 172.21.15.40:0/4088880463 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00c91b0 0x7fb7e00c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 -- 172.21.15.40:0/4088880463 >> v1:172.21.15.40:6789/0 conn(0x7fb7e0159f90 legacy=0x7fb7e00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.371+0000 7fb7e58c5640 1 -- 172.21.15.40:0/4088880463 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00711e0 con 0x7fb7e00b04e0 2023-11-04T01:41:36.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e58c5640 1 --2- 172.21.15.40:0/4088880463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00b04e0 0x7fb7e00b0970 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0098a0 tx=0x7fb7dc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce26ee99838eea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e50c4640 1 -- 172.21.15.40:0/4088880463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0ab660 con 0x7fb7e00b04e0 2023-11-04T01:41:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e50c4640 1 -- 172.21.15.40:0/4088880463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0ab7c0 con 0x7fb7e00b04e0 2023-11-04T01:41:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e50c4640 1 -- 172.21.15.40:0/4088880463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0abb50 con 0x7fb7e00b04e0 2023-11-04T01:41:36.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 -- 172.21.15.40:0/4088880463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00b04e0 msgr2=0x7fb7e00b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 --2- 172.21.15.40:0/4088880463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00b04e0 0x7fb7e00b0970 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0098a0 tx=0x7fb7dc01c460 comp rx=0 tx=0).stop 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 -- 172.21.15.40:0/4088880463 shutdown_connections 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 --2- 172.21.15.40:0/4088880463 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00c91b0 0x7fb7e00c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 --2- 172.21.15.40:0/4088880463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00b04e0 0x7fb7e00b0970 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 -- 172.21.15.40:0/4088880463 >> 172.21.15.40:0/4088880463 conn(0x7fb7e00ce9e0 msgr2=0x7fb7e00cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 -- 172.21.15.40:0/4088880463 shutdown_connections 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.375+0000 7fb7e832a640 1 -- 172.21.15.40:0/4088880463 wait complete. 2023-11-04T01:41:36.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 Processor -- start 2023-11-04T01:41:36.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- start start 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00b04e0 0x7fb7e015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 0x7fb7e0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7e0159f90 0x7fb7e013cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b3050 con 0x7fb7e00c91b0 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b2440 con 0x7fb7e0159f90 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b2720 con 0x7fb7e00b04e0 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 0x7fb7e0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 0x7fb7e0156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58528/0 (socket says 172.21.15.40:58528) 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 -- 172.21.15.40:0/3473015926 learned_addr learned my addr 172.21.15.40:0/3473015926 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e68c7640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7e0159f90 0x7fb7e013cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e60c6640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00b04e0 0x7fb7e015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 -- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00b04e0 msgr2=0x7fb7e015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00b04e0 0x7fb7e015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 -- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7e0159f90 msgr2=0x7fb7e013cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7e0159f90 0x7fb7e013cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 -- 172.21.15.40:0/3473015926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0094d0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e58c5640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 0x7fb7e0156180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0ad040 tx=0x7fb7dc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0b4800 con 0x7fb7e00c91b0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0b49a0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0b4d50 con 0x7fb7e00c91b0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00b2a00 con 0x7fb7e00c91b0 2023-11-04T01:41:36.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e015d150 con 0x7fb7e00c91b0 2023-11-04T01:41:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e00744a0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7dc0a9070 con 0x7fb7e00c91b0 2023-11-04T01:41:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7d2ffd640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7c40664d0 0x7fb7c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.379+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7dc11e5d0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.383+0000 7fb7e60c6640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7c40664d0 0x7fb7c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.383+0000 7fb7e60c6640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7c40664d0 0x7fb7c4068990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb7e015a420 tx=0x7fb7d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.383+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7dc0ebac0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.599+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb7e00ccc00 con 0x7fb7e00c91b0 2023-11-04T01:41:36.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.603+0000 7fb7d2ffd640 1 -- 172.21.15.40:0/3473015926 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb7dc0ef0e0 con 0x7fb7e00c91b0 2023-11-04T01:41:36.608 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-11-04T01:41:36.608 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:41:36.608 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2023-11-04T01:41:36.609 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2023-11-04T01:41:36.609 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:41:36.609 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7c40664d0 msgr2=0x7fb7c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7c40664d0 0x7fb7c4068990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb7e015a420 tx=0x7fb7d4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 msgr2=0x7fb7e0156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 0x7fb7e0156180 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0ad040 tx=0x7fb7dc01aca0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 shutdown_connections 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7c40664d0 0x7fb7c4068990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7e0159f90 0x7fb7e013cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e00c91b0 0x7fb7e0156180 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 --2- 172.21.15.40:0/3473015926 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7e00b04e0 0x7fb7e015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 >> 172.21.15.40:0/3473015926 conn(0x7fb7e00ce9e0 msgr2=0x7fb7e006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 shutdown_connections 2023-11-04T01:41:36.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.607+0000 7fb7e832a640 1 -- 172.21.15.40:0/3473015926 wait complete. 2023-11-04T01:41:36.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.747+0000 7fd6f3c88640 1 Processor -- start 2023-11-04T01:41:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.747+0000 7fd6f3c88640 1 -- start start 2023-11-04T01:41:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f3c88640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6ec0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f3c88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec159e30 con 0x7fd6ec0ce720 2023-11-04T01:41:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f3c88640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec0ccfd0 con 0x7fd6ec06c1a0 2023-11-04T01:41:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f3c88640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0cd2b0 con 0x7fd6ec159a50 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1223640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6ec0ce720 0x7fd6ec06ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34088/0 (socket says 172.21.15.40:34088) 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1223640 1 -- 172.21.15.40:0/3717357983 learned_addr learned my addr 172.21.15.40:0/3717357983 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6ec0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334756673 0 0) 0x7fd6e0001120 con 0x7fd6ec0ce720 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d4003530 con 0x7fd6ec0ce720 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420129212 0 0) 0x7fd6d4003530 con 0x7fd6ec0ce720 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 msgr2=0x7fd6ec0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6ec0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 >> v1:172.21.15.91:6789/0 conn(0x7fd6ec06c1a0 legacy=0x7fd6ec06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0cd590 con 0x7fd6ec0ce720 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd6e0001810 con 0x7fd6ec0ce720 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 >> v1:172.21.15.40:6789/0 conn(0x7fd6ec0ce720 legacy=0x7fd6ec06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d40047d0 0x7fd6d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0cd2b0 con 0x7fd6d40039b0 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d400bad0 con 0x7fd6d40047d0 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d400bc90 con 0x7fd6ec159a50 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1223640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d40047d0 0x7fd6d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f2225640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 -- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 msgr2=0x7fd6d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 -- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d40047d0 msgr2=0x7fd6d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d40047d0 0x7fd6d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1a24640 1 -- 172.21.15.40:0/3717357983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4003530 con 0x7fd6d40039b0 2023-11-04T01:41:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f1223640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d40047d0 0x7fd6d4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.751+0000 7fd6f2225640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec159a50 0x7fd6d4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6d4003dd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009f90 tx=0x7fd6e401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab5fb9c785e4b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40a5c10 con 0x7fd6d40039b0 2023-11-04T01:41:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e400f040 con 0x7fd6d40039b0 2023-11-04T01:41:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f0a22640 1 -- 172.21.15.40:0/3717357983 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40ad440 con 0x7fd6d40039b0 2023-11-04T01:41:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- 172.21.15.40:0/3717357983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 msgr2=0x7fd6d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/3717357983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6d4003dd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009f90 tx=0x7fd6e401cc00 comp rx=0 tx=0).stop 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f2225640 1 -- 172.21.15.40:0/3717357983 reap_dead start 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- 172.21.15.40:0/3717357983 shutdown_connections 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- 172.21.15.40:0/3717357983 >> 172.21.15.40:0/3717357983 conn(0x7fd6ec0cebb0 msgr2=0x7fd6ec0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- 172.21.15.40:0/3717357983 shutdown_connections 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- 172.21.15.40:0/3717357983 wait complete. 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 Processor -- start 2023-11-04T01:41:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- start start 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6ec145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec0a84b0 0x7fd6ec0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6ec0c48b0 0x7fd6ec0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec070a80 con 0x7fd6d40039b0 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0c4d30 con 0x7fd6ec0c48b0 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec070190 con 0x7fd6ec0a84b0 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6ec145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6ec145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58540/0 (socket says 172.21.15.40:58540) 2023-11-04T01:41:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 -- 172.21.15.40:0/937532446 learned_addr learned my addr 172.21.15.40:0/937532446 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1223640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec0a84b0 0x7fd6ec0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f2225640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6ec0c48b0 0x7fd6ec0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 -- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec0a84b0 msgr2=0x7fd6ec0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec0a84b0 0x7fd6ec0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 -- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6ec0c48b0 msgr2=0x7fd6ec0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6ec0c48b0 0x7fd6ec0c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 -- 172.21.15.40:0/937532446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec14c220 con 0x7fd6d40039b0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f1a24640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6ec145d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40b0040 tx=0x7fd6e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40adcc0 con 0x7fd6d40039b0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40ade20 con 0x7fd6d40039b0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec070430 con 0x7fd6d40039b0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.755+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40b6650 con 0x7fd6d40039b0 2023-11-04T01:41:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec0a8930 con 0x7fd6d40039b0 2023-11-04T01:41:36.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec0744a0 con 0x7fd6d40039b0 2023-11-04T01:41:36.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6e40b4040 con 0x7fd6d40039b0 2023-11-04T01:41:36.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6ea7fc640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6d80664d0 0x7fd6d8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6e411eca0 con 0x7fd6d40039b0 2023-11-04T01:41:36.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6f1223640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6d80664d0 0x7fd6d8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.759+0000 7fd6f1223640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6d80664d0 0x7fd6d8068990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00012c0 tx=0x7fd6e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.763+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6e40ec100 con 0x7fd6d40039b0 2023-11-04T01:41:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.946+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6ec0b4b30 con 0x7fd6d40039b0 2023-11-04T01:41:36.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6ea7fc640 1 -- 172.21.15.40:0/937532446 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd6e40ef720 con 0x7fd6d40039b0 2023-11-04T01:41:36.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:36.955 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:31.104506+0000","modified":"2023-11-04T01:41:34.118780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1760510907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1760510907},{"type":"v1","addr":"172.21.15.40:6835","nonce":1760510907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 23 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6d80664d0 msgr2=0x7fd6d8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6d80664d0 0x7fd6d8068990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00012c0 tx=0x7fd6e0009040 comp rx=0 tx=0).stop 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 msgr2=0x7fd6ec145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6ec145d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40b0040 tx=0x7fd6e4009750 comp rx=0 tx=0).stop 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 shutdown_connections 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6d80664d0 0x7fd6d8068990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6ec0c48b0 0x7fd6ec0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6ec0a84b0 0x7fd6ec0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 --2- 172.21.15.40:0/937532446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d40039b0 0x7fd6ec145d90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 >> 172.21.15.40:0/937532446 conn(0x7fd6ec0cebb0 msgr2=0x7fd6ec159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 shutdown_connections 2023-11-04T01:41:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:36.950+0000 7fd6f3c88640 1 -- 172.21.15.40:0/937532446 wait complete. 2023-11-04T01:41:37.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:41:31.104506+0000', 'modified': '2023-11-04T01:41:34.118780+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5727}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5727': {'gid': 5727, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/1760510907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 1760510907}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 1760510907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:37.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:41:37.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:41:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.502+0000 7f7a98f58640 1 Processor -- start 2023-11-04T01:41:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.502+0000 7f7a98f58640 1 -- start start 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a98f58640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a940d0ae0 0x7f7a940b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a98f58640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940b6070 con 0x7f7a940d0690 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a98f58640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940b8ed0 con 0x7f7a940b4990 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a98f58640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a940d1ce0 con 0x7f7a940d0ae0 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a940d0ae0 0x7f7a940b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a940d0ae0 0x7f7a940b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55578/0 (socket says 172.21.15.40:55578) 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 -- 172.21.15.40:0/1466979186 learned_addr learned my addr 172.21.15.40:0/1466979186 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 -- 172.21.15.40:0/1466979186 >> v1:172.21.15.91:6789/0 conn(0x7f7a940b4990 legacy=0x7f7a940b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 -- 172.21.15.40:0/1466979186 >> v1:172.21.15.40:6789/0 conn(0x7f7a940d0690 legacy=0x7f7a940b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 -- 172.21.15.40:0/1466979186 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940d1fc0 con 0x7f7a940d0ae0 2023-11-04T01:41:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a92d9d640 1 --2- 172.21.15.40:0/1466979186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940d0ae0 0x7f7a940b6bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009e50 tx=0x7f7a8c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896ba739cfb31b9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a91d9b640 1 -- 172.21.15.40:0/1466979186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0af400 con 0x7f7a940d0ae0 2023-11-04T01:41:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a91d9b640 1 -- 172.21.15.40:0/1466979186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c0ab050 con 0x7f7a940d0ae0 2023-11-04T01:41:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.506+0000 7f7a91d9b640 1 -- 172.21.15.40:0/1466979186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0af780 con 0x7f7a940d0ae0 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1466979186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940d0ae0 msgr2=0x7f7a940b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1466979186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940d0ae0 0x7f7a940b6bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009e50 tx=0x7f7a8c01f1f0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1466979186 shutdown_connections 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1466979186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940d0ae0 0x7f7a940b6bf0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1466979186 >> 172.21.15.40:0/1466979186 conn(0x7f7a940cf990 msgr2=0x7f7a940cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1466979186 shutdown_connections 2023-11-04T01:41:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1466979186 wait complete. 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 Processor -- start 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- start start 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 0x7f7a9414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a940d0690 0x7f7a9415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a940d0ae0 0x7f7a940cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9414b8f0 con 0x7f7a940b4990 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a94154890 con 0x7f7a940d0ae0 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941602e0 con 0x7f7a940d0690 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 0x7f7a9414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 0x7f7a9414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55594/0 (socket says 172.21.15.40:55594) 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 -- 172.21.15.40:0/1959499523 learned_addr learned my addr 172.21.15.40:0/1959499523 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a92d9d640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a940d0ae0 0x7f7a940cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a940d0690 0x7f7a9415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 -- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a940d0690 msgr2=0x7f7a9415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a940d0690 0x7f7a9415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 -- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a940d0ae0 msgr2=0x7f7a940cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a940d0ae0 0x7f7a940cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 -- 172.21.15.40:0/1959499523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c009b30 con 0x7f7a940b4990 2023-11-04T01:41:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a9259c640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 0x7f7a9414b3b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400c3c0 tx=0x7f7a8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a8b7fe640 1 -- 172.21.15.40:0/1959499523 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840052d0 con 0x7f7a940b4990 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a8b7fe640 1 -- 172.21.15.40:0/1959499523 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a84005430 con 0x7f7a940b4990 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9415e370 con 0x7f7a940b4990 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a8b7fe640 1 -- 172.21.15.40:0/1959499523 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84003840 con 0x7f7a940b4990 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.510+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9415e930 con 0x7f7a940b4990 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a8b7fe640 1 -- 172.21.15.40:0/1959499523 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a840039a0 con 0x7f7a940b4990 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a8b7fe640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a740664a0 0x7f7a74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a8b7fe640 1 -- 172.21.15.40:0/1959499523 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a84083460 con 0x7f7a940b4990 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a740664a0 0x7f7a74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 Processor -- start 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 -- start start 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a740664a0 0x7f7a74068960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7a940b20a0 tx=0x7f7a7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be72380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 0x55d33be25600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be25b40 0x55d33be25f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33bcf0460 con 0x55d33be728c0 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc81690 con 0x55d33be71fa0 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc7ebc0 con 0x55d33be25b40 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 0x55d33be25600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 0x55d33be25600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55600/0 (socket says 172.21.15.40:55600) 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 -- 172.21.15.40:0/239911985 learned_addr learned my addr 172.21.15.40:0/239911985 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a9259c640 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be72380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a92d9d640 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be25b40 0x55d33be25f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 -- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be25b40 msgr2=0x55d33be25f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be25b40 0x55d33be25f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 -- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 msgr2=0x55d33be72380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be72380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 -- 172.21.15.40:0/239911985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d33b972890 con 0x55d33be728c0 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.514+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 0x55d33be25600 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7a94067650 tx=0x7f7a7c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4422579144bdcf66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a73fff640 1 -- 172.21.15.40:0/239911985 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00eee0 con 0x55d33be728c0 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a73fff640 1 -- 172.21.15.40:0/239911985 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c003600 con 0x55d33be728c0 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a73fff640 1 -- 172.21.15.40:0/239911985 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c003970 con 0x55d33be728c0 2023-11-04T01:41:37.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/239911985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 msgr2=0x55d33be25600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 0x55d33be25600 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7a94067650 tx=0x7f7a7c011000 comp rx=0 tx=0).stop 2023-11-04T01:41:37.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/239911985 shutdown_connections 2023-11-04T01:41:37.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be25b40 0x55d33be25f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be728c0 0x55d33be25600 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- 172.21.15.40:0/239911985 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be72380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/239911985 >> 172.21.15.40:0/239911985 conn(0x55d33be52d40 msgr2=0x55d33be55130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/239911985 shutdown_connections 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/239911985 wait complete. 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- start start 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 Processor -- start 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be2e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be2aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be2b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc7a4b0 con 0x55d33be25b40 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc32aa0 con 0x55d33be71fa0 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc38940 con 0x55d33be728c0 2023-11-04T01:41:37.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 10 client.0 _ll_register_callbacks cb 0x55d33be13460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be2e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be2e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55602/0 (socket says 172.21.15.40:55602) 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 -- 172.21.15.40:0/1984118304 learned_addr learned my addr 172.21.15.40:0/1984118304 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be2aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a92d9d640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be2b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 -- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 msgr2=0x55d33be2b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be2b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 -- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 msgr2=0x55d33be2aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be2aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 -- 172.21.15.40:0/1984118304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c00f040 con 0x55d33be25b40 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9259c640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be2e050 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7a84054470 tx=0x7f7a84058640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d6cdce8368d768 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a717fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:41:37.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a717fa640 1 -- 172.21.15.40:0/1984118304 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84058370 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a717fa640 1 -- 172.21.15.40:0/1984118304 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a84052940 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d33bc37e10 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a717fa640 1 -- 172.21.15.40:0/1984118304 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a840539d0 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 10 client.5883 fetch_fsmap learned FSMap version 23 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55d33bc3b1a0 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a717fa640 1 -- 172.21.15.40:0/1984118304 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d33bc37e10 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a717fa640 1 -- 172.21.15.40:0/1984118304 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7a8405c2a0 con 0x55d33be25b40 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 10 client.5883 fetch_fsmap finished waiting for FSMap version 23 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 10 client.5883 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 20 client.5883 populate_metadata read hostname 'smithi040' 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33be2bd90 0x55d33be83250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 4 client.5883 mds_command: new command op to 5727 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:37.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 --> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d33bc78e00 con 0x55d33be2bd90 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.518+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33be2bd90 0x55d33be83250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33be2bd90 0x55d33be83250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=818386603dca4824 server_cookie=fef3d39df7c8dd53 in_seq=0 out_seq=0 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a717fa640 10 client.5883 ms_handle_connect on v2:172.21.15.40:6834/1760510907 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a717fa640 1 -- 172.21.15.40:0/1984118304 <== mds.0 v2:172.21.15.40:6834/1760510907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d33bc78e00 con 0x55d33be2bd90 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a717fa640 10 client.5883 handle_command_reply: tid=0 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 client.5883 shutdown 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 msgr2=0x55d33be2e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be2e050 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7a84054470 tx=0x7f7a84058640 comp rx=0 tx=0).stop 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 shutdown_connections 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33be2bd90 0x55d33be83250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be2b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be2aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a717fa640 0 client.5883 ms_handle_reset on v2:172.21.15.40:6834/1760510907 2023-11-04T01:41:37.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 --2- 172.21.15.40:0/1984118304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be2e050 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 >> 172.21.15.40:0/1984118304 conn(0x55d33be52d40 msgr2=0x55d33be55130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 shutdown_connections 2023-11-04T01:41:37.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 1 -- 172.21.15.40:0/1984118304 wait complete. 2023-11-04T01:41:37.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.522+0000 7f7a9c085000 20 client.5883 trim_cache size 0 max 16384 2023-11-04T01:41:37.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 Processor -- start 2023-11-04T01:41:37.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- start start 2023-11-04T01:41:37.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be25b40 0x55d33be2d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 0x55d33be2d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be70050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33b933940 con 0x55d33be71fa0 2023-11-04T01:41:37.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc847d0 con 0x55d33be25b40 2023-11-04T01:41:37.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc15750 con 0x55d33be728c0 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 0x55d33be2d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 0x55d33be2d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55612/0 (socket says 172.21.15.40:55612) 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 -- 172.21.15.40:0/118808120 learned_addr learned my addr 172.21.15.40:0/118808120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 -- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 msgr2=0x55d33be70050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be70050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 -- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be25b40 msgr2=0x55d33be2d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9259c640 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be25b40 0x55d33be2d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be25b40 0x55d33be2d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 -- 172.21.15.40:0/118808120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d33bc214a0 con 0x55d33be71fa0 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9259c640 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be25b40 0x55d33be2d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 0x55d33be2d6c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55d33bdfaaa0 tx=0x7f7a7c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f535b83f615425 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a88d99640 1 -- 172.21.15.40:0/118808120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00eee0 con 0x55d33be71fa0 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a88d99640 1 -- 172.21.15.40:0/118808120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c019050 con 0x55d33be71fa0 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a88d99640 1 -- 172.21.15.40:0/118808120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c02e6a0 con 0x55d33be71fa0 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- 172.21.15.40:0/118808120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 msgr2=0x55d33be2d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 0x55d33be2d6c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55d33bdfaaa0 tx=0x7f7a7c005000 comp rx=0 tx=0).stop 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- 172.21.15.40:0/118808120 shutdown_connections 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be70050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be71fa0 0x55d33be2d6c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 --2- 172.21.15.40:0/118808120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be25b40 0x55d33be2d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- 172.21.15.40:0/118808120 >> 172.21.15.40:0/118808120 conn(0x55d33be52d40 msgr2=0x55d33be2a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- 172.21.15.40:0/118808120 shutdown_connections 2023-11-04T01:41:37.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.538+0000 7f7a9c085000 1 -- 172.21.15.40:0/118808120 wait complete. 2023-11-04T01:41:37.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- start start 2023-11-04T01:41:37.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 Processor -- start 2023-11-04T01:41:37.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be84690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be8ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be8f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc7d010 con 0x55d33be25b40 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33be55360 con 0x55d33be71fa0 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d33bc77cc0 con 0x55d33be728c0 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 10 client.0 _ll_register_callbacks cb 0x7f7a7c001ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be84690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be84690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55614/0 (socket says 172.21.15.40:55614) 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 -- 172.21.15.40:0/2177461577 learned_addr learned my addr 172.21.15.40:0/2177461577 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a92d9d640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be8f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be8ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 -- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 msgr2=0x55d33be8f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be8f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 -- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 msgr2=0x55d33be8ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be8ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 -- 172.21.15.40:0/2177461577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d33b972890 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be8ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9259c640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be84690 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7a84005010 tx=0x7f7a840816f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a919b7b10a7166cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 1 -- 172.21.15.40:0/2177461577 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400e040 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 1 -- 172.21.15.40:0/2177461577 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a84052940 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d33bc44d10 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 1 -- 172.21.15.40:0/2177461577 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a8405c730 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 10 client.5889 fetch_fsmap learned FSMap version 23 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55d33b972cc0 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 1 -- 172.21.15.40:0/2177461577 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d33bc44d10 con 0x55d33be25b40 2023-11-04T01:41:37.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 1 -- 172.21.15.40:0/2177461577 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7a8405c2a0 con 0x55d33be25b40 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 10 client.5889 fetch_fsmap finished waiting for FSMap version 23 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 10 client.5889 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 20 client.5889 populate_metadata read hostname 'smithi040' 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33bed2a70 0x55d33bed2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 4 client.5889 mds_command: new command op to 5727 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 --> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d33bc73490 con 0x55d33bed2a70 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33bed2a70 0x55d33bed2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a89d9b640 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33bed2a70 0x55d33bed2e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44251506ac7bb3e0 server_cookie=9657733a3541aad in_seq=0 out_seq=0 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 10 client.5889 ms_handle_connect on v2:172.21.15.40:6834/1760510907 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 1 -- 172.21.15.40:0/2177461577 <== mds.0 v2:172.21.15.40:6834/1760510907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d33bc73490 con 0x55d33bed2a70 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 10 client.5889 handle_command_reply: tid=0 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 client.5889 shutdown 2023-11-04T01:41:37.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 msgr2=0x55d33be84690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be84690 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7a84005010 tx=0x7f7a840816f0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 shutdown_connections 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:6834/1760510907,v1:172.21.15.40:6835/1760510907] conn(0x55d33bed2a70 0x55d33bed2e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d33be728c0 0x55d33be8f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d33be71fa0 0x55d33be8ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 --2- 172.21.15.40:0/2177461577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d33be25b40 0x55d33be84690 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a717fa640 0 client.5889 ms_handle_reset on v2:172.21.15.40:6834/1760510907 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 >> 172.21.15.40:0/2177461577 conn(0x55d33be52d40 msgr2=0x55d33be2ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 shutdown_connections 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 1 -- 172.21.15.40:0/2177461577 wait complete. 2023-11-04T01:41:37.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a9c085000 20 client.5889 trim_cache size 0 max 16384 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5727, 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 5.7973019649999999, 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 23, 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 48, 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 48, 2023-11-04T01:41:37.556 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 10.893609121000001 2023-11-04T01:41:37.557 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:41:37.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a740664a0 msgr2=0x7f7a74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a740664a0 0x7f7a74068960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7a940b20a0 tx=0x7f7a7c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 msgr2=0x7f7a9414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 0x7f7a9414b3b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400c3c0 tx=0x7f7a8400c880 comp rx=0 tx=0).stop 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 shutdown_connections 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a740664a0 0x7f7a74068960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a940d0ae0 0x7f7a940cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a940d0690 0x7f7a9415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 --2- 172.21.15.40:0/1959499523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a940b4990 0x7f7a9414b3b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 >> 172.21.15.40:0/1959499523 conn(0x7f7a940cf990 msgr2=0x7f7a940b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 shutdown_connections 2023-11-04T01:41:37.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.542+0000 7f7a98f58640 1 -- 172.21.15.40:0/1959499523 wait complete. 2023-11-04T01:41:37.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.674+0000 7f9e7998a640 1 Processor -- start 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.674+0000 7f9e7998a640 1 -- start start 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.674+0000 7f9e7998a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e7415afd0 0x7f9e740715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.674+0000 7f9e7998a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e740b0d40 0x7f9e7415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.674+0000 7f9e7998a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e740c2670 con 0x7f9e7406f8f0 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e7998a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e74070140 con 0x7f9e740b0d40 2023-11-04T01:41:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e7998a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7406c9f0 con 0x7f9e7415afd0 2023-11-04T01:41:37.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e737fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e740b0d40 0x7f9e7415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e72ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e7415afd0 0x7f9e740715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e737fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e740b0d40 0x7f9e7415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:47688/0 (socket says 172.21.15.40:47688) 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e737fe640 1 -- 172.21.15.40:0/1193562855 learned_addr learned my addr 172.21.15.40:0/1193562855 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e72ffd640 1 -- 172.21.15.40:0/1193562855 >> v2:172.21.15.91:3300/0 conn(0x7f9e740b0d40 msgr2=0x7f9e7415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e72ffd640 1 --2- 172.21.15.40:0/1193562855 >> v2:172.21.15.91:3300/0 conn(0x7f9e740b0d40 0x7f9e7415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e72ffd640 1 -- 172.21.15.40:0/1193562855 >> v1:172.21.15.91:6789/0 conn(0x7f9e7406f8f0 legacy=0x7f9e740b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e72ffd640 1 -- 172.21.15.40:0/1193562855 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7406bc30 con 0x7f9e7415afd0 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e72ffd640 1 --2- 172.21.15.40:0/1193562855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e7415afd0 0x7f9e740715d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e680097c0 tx=0x7f9e6801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333d87ab4c36b1ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e71ffb640 1 -- 172.21.15.40:0/1193562855 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e680ab650 con 0x7f9e7415afd0 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e71ffb640 1 -- 172.21.15.40:0/1193562855 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e680ab7b0 con 0x7f9e7415afd0 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.678+0000 7f9e71ffb640 1 -- 172.21.15.40:0/1193562855 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e680abb40 con 0x7f9e7415afd0 2023-11-04T01:41:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- 172.21.15.40:0/1193562855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e7415afd0 msgr2=0x7f9e740715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 --2- 172.21.15.40:0/1193562855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e7415afd0 0x7f9e740715d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e680097c0 tx=0x7f9e6801c450 comp rx=0 tx=0).stop 2023-11-04T01:41:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- 172.21.15.40:0/1193562855 shutdown_connections 2023-11-04T01:41:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 --2- 172.21.15.40:0/1193562855 >> v2:172.21.15.91:3300/0 conn(0x7f9e740b0d40 0x7f9e7415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 --2- 172.21.15.40:0/1193562855 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e7415afd0 0x7f9e740715d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- 172.21.15.40:0/1193562855 >> 172.21.15.40:0/1193562855 conn(0x7f9e740cebb0 msgr2=0x7f9e740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- 172.21.15.40:0/1193562855 shutdown_connections 2023-11-04T01:41:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- 172.21.15.40:0/1193562855 wait complete. 2023-11-04T01:41:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 Processor -- start 2023-11-04T01:41:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- start start 2023-11-04T01:41:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e7406f8f0 0x7f9e741541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e740b0d40 0x7f9e740c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 0x7f9e74152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740afab0 con 0x7f9e7415afd0 2023-11-04T01:41:37.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740c8c10 con 0x7f9e7406f8f0 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e74154020 con 0x7f9e740b0d40 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 0x7f9e74152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 0x7f9e74152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55616/0 (socket says 172.21.15.40:55616) 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 -- 172.21.15.40:0/2793103531 learned_addr learned my addr 172.21.15.40:0/2793103531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e727fc640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e740b0d40 0x7f9e740c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e72ffd640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e7406f8f0 0x7f9e741541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 -- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e740b0d40 msgr2=0x7f9e740c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e740b0d40 0x7f9e740c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 -- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e7406f8f0 msgr2=0x7f9e741541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e7406f8f0 0x7f9e741541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 -- 172.21.15.40:0/2793103531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009420 con 0x7f9e7415afd0 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e737fe640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 0x7f9e74152420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00efc0 tx=0x7f9e6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c009bd0 con 0x7f9e7415afd0 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c00f040 con 0x7f9e7415afd0 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.682+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e740afca0 con 0x7f9e7415afd0 2023-11-04T01:41:37.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0039a0 con 0x7f9e7415afd0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e740b0540 con 0x7f9e7415afd0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e740744a0 con 0x7f9e7415afd0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e6c003b00 con 0x7f9e7415afd0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e5bfff640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e600664a0 0x7f9e60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e6c0846d0 con 0x7f9e7415afd0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e72ffd640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e600664a0 0x7f9e60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.686+0000 7f9e72ffd640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e600664a0 0x7f9e60068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9e680097c0 tx=0x7f9e680b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.690+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9e6c051950 con 0x7f9e7415afd0 2023-11-04T01:41:37.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.882+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e7406cbf0 con 0x7f9e7415afd0 2023-11-04T01:41:37.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.882+0000 7f9e5bfff640 1 -- 172.21.15.40:0/2793103531 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e6c003db0 con 0x7f9e7415afd0 2023-11-04T01:41:37.887 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.882+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e600664a0 msgr2=0x7f9e60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.882+0000 7f9e7998a640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e600664a0 0x7f9e60068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9e680097c0 tx=0x7f9e680b6040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.882+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 msgr2=0x7f9e74152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.882+0000 7f9e7998a640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 0x7f9e74152420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00efc0 tx=0x7f9e6c00c490 comp rx=0 tx=0).stop 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 shutdown_connections 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e600664a0 0x7f9e60068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7415afd0 0x7f9e74152420 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e740b0d40 0x7f9e740c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 --2- 172.21.15.40:0/2793103531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e7406f8f0 0x7f9e741541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 >> 172.21.15.40:0/2793103531 conn(0x7f9e740cebb0 msgr2=0x7f9e740caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 shutdown_connections 2023-11-04T01:41:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:37.886+0000 7f9e7998a640 1 -- 172.21.15.40:0/2793103531 wait complete. 2023-11-04T01:41:37.907 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:41:37.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:41:37.907 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:41:37.907 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:41:37.907 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:37.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:41:37.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:41:37.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:41:37.908 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:37.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:37.908 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:41:37.913 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:41:37.913 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:41:37.913 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:37.914 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42176sec preferred_lft 42176sec 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:41:37.915 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:41:37.916 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:37.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:37.917 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:41:37.969 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:41:37.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:37.970 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:41:38.020 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:41:38.020 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:41:38.021 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:41:38.021 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:41:38.021 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:41:38.021 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:41:38.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:41:38.022 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:41:38.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:41:38.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:41:38.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:41:38.022 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:41:38.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.099 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:41:38.147 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:38.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:41:38.204 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:41:38.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:38.204 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:38.251 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:38.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:38.252 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:38.299 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:41:38.349 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:41:38.350 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:38.351 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:38.352 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:38.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.353 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:41:38.399 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:41:38.399 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:41:38.443 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:38.451 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:41:38.451 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:41:38.452 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:41:38.452 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:41:38.452 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:41:38.452 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:41:38.452 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:41:38.452 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:41:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:41:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:41:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:41:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:41:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:38.453 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:41:38.454 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:41:38.454 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:41:38.454 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:41:38.454 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:41:38.454 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:38.455 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:38.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.456 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:41:38.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:41:38.522+0000 7f34d707e580 -1 init, newargv = 0x55e950ea4c10 newargc=15 2023-11-04T01:41:38.530 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[50394]: starting ceph client 2023-11-04T01:41:38.534 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[50394]: starting fuse 2023-11-04T01:41:39.599 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:39.607 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:41:39.608 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:41:39.609 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:39.610 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:39.611 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:39.611 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:39.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:39.612 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:41:39.659 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:41:39.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:41:39.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:41:39.659 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:41:39.659 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:41:39.659 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:39.660 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:41:39.661 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:41:39.788 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.50394.asok 2023-11-04T01:41:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:39.800 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50394.asok 2023-11-04T01:41:39.800 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:39.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.50394.asok status 2023-11-04T01:41:39.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:40.003 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:41:40.003 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:41:40.003 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "50394", 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5895, 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:41:40.004 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 5895 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1195493509 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:41:40.005 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1195493509 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.5895 192.168.0.1:0/1195493509", 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/1195493509", 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 23, 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 48, 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:41:40.006 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:41:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:40.024 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:40.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:41:40.025 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:40.071 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:41:40.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:40.079 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:40.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:40.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:40.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:40.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:40.138 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-04T01:41:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 Processor -- start 2023-11-04T01:41:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 -- start start 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 0x5644367c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x56443678f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564436863f30 0x5644367d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443673f190 con 0x7ffba4002270 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644366f6fc0 con 0x564436863f30 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbba45b080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644366f6cc0 con 0x5644367da970 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.170+0000 7ffbb7f7a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 0x5644367c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 0x5644367c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55636/0 (socket says 172.21.15.40:55636) 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 -- 172.21.15.40:0/931343738 learned_addr learned my addr 172.21.15.40:0/931343738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb877b640 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564436863f30 0x5644367d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x56443678f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 -- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 msgr2=0x56443678f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x56443678f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 -- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564436863f30 msgr2=0x5644367d41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564436863f30 0x5644367d41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 -- 172.21.15.40:0/931343738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644366e5420 con 0x7ffba4002270 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb877b640 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564436863f30 0x5644367d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 0x5644367c2df0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ffba80ac040 tx=0x7ffba8019e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3a76fb3dcc388e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb6777640 1 -- 172.21.15.40:0/931343738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8005230 con 0x7ffba4002270 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb6777640 1 -- 172.21.15.40:0/931343738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba80053b0 con 0x7ffba4002270 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb6777640 1 -- 172.21.15.40:0/931343738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba80aa6f0 con 0x7ffba4002270 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- 172.21.15.40:0/931343738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 msgr2=0x5644367c2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 0x5644367c2df0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ffba80ac040 tx=0x7ffba8019e50 comp rx=0 tx=0).stop 2023-11-04T01:41:40.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- 172.21.15.40:0/931343738 shutdown_connections 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x564436863f30 0x5644367d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x56443678f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- 172.21.15.40:0/931343738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffba4002270 0x5644367c2df0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- 172.21.15.40:0/931343738 >> 172.21.15.40:0/931343738 conn(0x5644367beae0 msgr2=0x564436864a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- 172.21.15.40:0/931343738 shutdown_connections 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- 172.21.15.40:0/931343738 wait complete. 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 Processor -- start 2023-11-04T01:41:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- start start 2023-11-04T01:41:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x5644367bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 0x5644368599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffba4002270 0x564436859f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644366cd2c0 con 0x564436863f30 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644367be070 con 0x7ffba4002270 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbba45b080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644368fe310 con 0x5644367da970 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 0x5644368599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 0x5644368599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55654/0 (socket says 172.21.15.40:55654) 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 -- 172.21.15.40:0/1534604637 learned_addr learned my addr 172.21.15.40:0/1534604637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7f7a640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x5644367bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb877b640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffba4002270 0x564436859f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 -- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 msgr2=0x5644367bdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x5644367bdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 -- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffba4002270 msgr2=0x564436859f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffba4002270 0x564436859f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 -- 172.21.15.40:0/1534604637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4001e20 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb7779640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 0x5644368599c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffba0010ec0 tx=0x7ffba000e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.174+0000 7ffbb5775640 1 -- 172.21.15.40:0/1534604637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000c800 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb5775640 1 -- 172.21.15.40:0/1534604637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000c960 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5644366d85d0 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb5775640 1 -- 172.21.15.40:0/1534604637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000cd10 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644366d8030 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb5775640 1 -- 172.21.15.40:0/1534604637 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffba000a040 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb5775640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb98064e80 0x7ffb98067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb5775640 1 -- 172.21.15.40:0/1534604637 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffba0085f80 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- pool_op(create snap pool 8 tid 1 name snap1 v0) v4 -- 0x564436749110 con 0x564436863f30 2023-11-04T01:41:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb7f7a640 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb98064e80 0x7ffb98067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbb5775640 1 -- 172.21.15.40:0/1534604637 <== mon.0 v2:172.21.15.40:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v50) v1 ==== 43+0+0 (secure 0 0 0) 0x7ffba0053250 con 0x564436863f30 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb98064e80 msgr2=0x7ffb98067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb98064e80 0x7ffb98067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 msgr2=0x5644368599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 0x5644368599c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffba0010ec0 tx=0x7ffba000e760 comp rx=0 tx=0).stop 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 shutdown_connections 2023-11-04T01:41:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb98064e80 0x7ffb98067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffba4002270 0x564436859f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564436863f30 0x5644368599c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 --2- 172.21.15.40:0/1534604637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5644367da970 0x5644367bdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 >> 172.21.15.40:0/1534604637 conn(0x5644367beae0 msgr2=0x564436864a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 shutdown_connections 2023-11-04T01:41:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.178+0000 7ffbba45b080 1 -- 172.21.15.40:0/1534604637 wait complete. 2023-11-04T01:41:40.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:40.190 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-04T01:41:40.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 Processor -- start 2023-11-04T01:41:40.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 -- start start 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 0x55f9494a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f94941ffc0 0x55f9493d6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f9494a2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94938a8a0 con 0x55f9493da950 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f949386190 con 0x55f9494203a0 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.262+0000 7fe4c2e25080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f94933dfc0 con 0x55f94941ffc0 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 0x55f9494a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 0x55f9494a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55660/0 (socket says 172.21.15.40:55660) 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 -- 172.21.15.40:0/891676640 learned_addr learned my addr 172.21.15.40:0/891676640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c1145640 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f9494a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f94941ffc0 0x55f9493d6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 -- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f94941ffc0 msgr2=0x55f9493d6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f94941ffc0 0x55f9493d6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 -- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 msgr2=0x55f9494a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f9494a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 -- 172.21.15.40:0/891676640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4005d30 con 0x55f9493da950 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c1145640 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f9494a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 0x55f9494a8ba0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80015b0 tx=0x7fe4b8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6b9261e3043af9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4bf141640 1 -- 172.21.15.40:0/891676640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b800f710 con 0x55f9493da950 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4bf141640 1 -- 172.21.15.40:0/891676640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b800f870 con 0x55f9493da950 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4bf141640 1 -- 172.21.15.40:0/891676640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b800fc00 con 0x55f9493da950 2023-11-04T01:41:40.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/891676640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 msgr2=0x55f9494a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 0x55f9494a8ba0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80015b0 tx=0x7fe4b8001a70 comp rx=0 tx=0).stop 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/891676640 shutdown_connections 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f9494a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f94941ffc0 0x55f9493d6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/891676640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f9493da950 0x55f9494a8ba0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/891676640 >> 172.21.15.40:0/891676640 conn(0x55f949403660 msgr2=0x55f9494a93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/891676640 shutdown_connections 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/891676640 wait complete. 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 Processor -- start 2023-11-04T01:41:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- start start 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f9493da950 0x55f9494a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 0x55f9494a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f949403a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94933dcc0 con 0x55f94941ffc0 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9493142c0 con 0x55f9494203a0 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f94948c2f0 con 0x55f9493da950 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 0x55f9494a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 0x55f9494a3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55678/0 (socket says 172.21.15.40:55678) 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 -- 172.21.15.40:0/2898617621 learned_addr learned my addr 172.21.15.40:0/2898617621 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0944640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f9493da950 0x55f9494a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c1145640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f949403a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 -- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f9493da950 msgr2=0x55f9494a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f9493da950 0x55f9494a39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 -- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 msgr2=0x55f949403a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f949403a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 -- 172.21.15.40:0/2898617621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f949346410 con 0x55f94941ffc0 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c0143640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 0x55f9494a3f00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40ad040 tx=0x7fe4b4018130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4be13f640 1 -- 172.21.15.40:0/2898617621 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40b56f0 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4be13f640 1 -- 172.21.15.40:0/2898617621 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b40b5850 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f94931f5d0 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4be13f640 1 -- 172.21.15.40:0/2898617621 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40b5bc0 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.266+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f94931f030 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4be13f640 1 -- 172.21.15.40:0/2898617621 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4b40b5d20 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4be13f640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe4ac064e80 0x7fe4ac067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4be13f640 1 -- 172.21.15.40:0/2898617621 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe4b411df80 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- pool_op(create snap pool 7 tid 1 name snap2 v0) v4 -- 0x55f949390110 con 0x55f94941ffc0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c0944640 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe4ac064e80 0x7fe4ac067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4be13f640 1 -- 172.21.15.40:0/2898617621 <== mon.0 v2:172.21.15.40:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v50) v1 ==== 43+0+0 (secure 0 0 0) 0x7fe4b40b9080 con 0x55f94941ffc0 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe4ac064e80 msgr2=0x7fe4ac067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe4ac064e80 0x7fe4ac067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 msgr2=0x55f9494a3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 0x55f9494a3f00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40ad040 tx=0x7fe4b4018130 comp rx=0 tx=0).stop 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 shutdown_connections 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe4ac064e80 0x7fe4ac067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f9494203a0 0x55f949403a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55f94941ffc0 0x55f9494a3f00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 --2- 172.21.15.40:0/2898617621 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55f9493da950 0x55f9494a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 >> 172.21.15.40:0/2898617621 conn(0x55f949403660 msgr2=0x55f9494ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 shutdown_connections 2023-11-04T01:41:40.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.270+0000 7fe4c2e25080 1 -- 172.21.15.40:0/2898617621 wait complete. 2023-11-04T01:41:40.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:40.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-04T01:41:40.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.458+0000 7f118ce6b640 1 Processor -- start 2023-11-04T01:41:40.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.458+0000 7f118ce6b640 1 -- start start 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118ce6b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f118815d0b0 0x7f1188160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118ce6b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 0x7f11880d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118ce6b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11880b5e00 con 0x7f11881610f0 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118ce6b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11880d1520 con 0x7f118815d0b0 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118ce6b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118815d490 con 0x7f11880cff20 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f1186d9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 0x7f11880d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f118815d0b0 0x7f1188160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f1186d9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 0x7f11880d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:34598/0 (socket says 172.21.15.40:34598) 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f118815d0b0 0x7f1188160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:47742/0 (socket says 172.21.15.40:47742) 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f1185d9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f11881610f0 0x7f11880cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:54188/0 (socket says 172.21.15.40:54188) 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f1186d9d640 1 -- 172.21.15.40:0/3594130032 learned_addr learned my addr 172.21.15.40:0/3594130032 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 -- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 msgr2=0x7f11880d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 --2- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 0x7f11880d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 -- 172.21.15.40:0/3594130032 >> v1:172.21.15.91:6789/0 conn(0x7f11881610f0 legacy=0x7f11880cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 -- 172.21.15.40:0/3594130032 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11880b8930 con 0x7f118815d0b0 2023-11-04T01:41:40.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f1186d9d640 1 --2- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 0x7f11880d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:40.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118659c640 1 --2- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f118815d0b0 0x7f1188160bb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f11700097c0 tx=0x7f117001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56bce9473dfc64bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118559a640 1 -- 172.21.15.40:0/3594130032 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700ad640 con 0x7f118815d0b0 2023-11-04T01:41:40.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118559a640 1 -- 172.21.15.40:0/3594130032 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700ad7a0 con 0x7f118815d0b0 2023-11-04T01:41:40.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.462+0000 7f118559a640 1 -- 172.21.15.40:0/3594130032 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700adb30 con 0x7f118815d0b0 2023-11-04T01:41:40.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f118815d0b0 msgr2=0x7f1188160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 --2- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f118815d0b0 0x7f1188160bb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f11700097c0 tx=0x7f117001c480 comp rx=0 tx=0).stop 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/3594130032 shutdown_connections 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 --2- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11880cff20 0x7f11880d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 --2- 172.21.15.40:0/3594130032 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f118815d0b0 0x7f1188160bb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/3594130032 >> 172.21.15.40:0/3594130032 conn(0x7f118806a890 msgr2=0x7f118806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/3594130032 shutdown_connections 2023-11-04T01:41:40.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/3594130032 wait complete. 2023-11-04T01:41:40.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 Processor -- start 2023-11-04T01:41:40.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- start start 2023-11-04T01:41:40.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11880cff20 0x7f11880cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f118815d0b0 0x7f1188157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11881610f0 0x7f118815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1188144da0 con 0x7f11881610f0 2023-11-04T01:41:40.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1188157ab0 con 0x7f11880cff20 2023-11-04T01:41:40.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1188144120 con 0x7f118815d0b0 2023-11-04T01:41:40.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11881610f0 0x7f118815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11881610f0 0x7f118815d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55684/0 (socket says 172.21.15.40:55684) 2023-11-04T01:41:40.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 -- 172.21.15.40:0/1231343761 learned_addr learned my addr 172.21.15.40:0/1231343761 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118659c640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11880cff20 0x7f11880cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1185d9b640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f118815d0b0 0x7f1188157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 -- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f118815d0b0 msgr2=0x7f1188157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f118815d0b0 0x7f1188157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 -- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11880cff20 msgr2=0x7f11880cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11880cff20 0x7f11880cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 -- 172.21.15.40:0/1231343761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180009b30 con 0x7f11881610f0 2023-11-04T01:41:40.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1185d9b640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f118815d0b0 0x7f1188157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:40.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f1186d9d640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11881610f0 0x7f118815d890 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f118000efc0 tx=0x7f118000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180018070 con 0x7f11881610f0 2023-11-04T01:41:40.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000f040 con 0x7f11881610f0 2023-11-04T01:41:40.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/1231343761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1170009420 con 0x7f11881610f0 2023-11-04T01:41:40.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000ce00 con 0x7f11881610f0 2023-11-04T01:41:40.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.466+0000 7f118ce6b640 1 -- 172.21.15.40:0/1231343761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11881446e0 con 0x7f11881610f0 2023-11-04T01:41:40.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.470+0000 7f118ce6b640 1 -- 172.21.15.40:0/1231343761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1188144ee0 con 0x7f11881610f0 2023-11-04T01:41:40.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.470+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1180014480 con 0x7f11881610f0 2023-11-04T01:41:40.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.470+0000 7f117effd640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11680664a0 0x7f1168068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.470+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1180084240 con 0x7f11881610f0 2023-11-04T01:41:40.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.470+0000 7f118659c640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11680664a0 0x7f1168068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.470+0000 7f118659c640 1 --2- 172.21.15.40:0/1231343761 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11680664a0 0x7f1168068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f11700af000 tx=0x7f1170008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.474+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1188144ee0 con 0x7f11881610f0 2023-11-04T01:41:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.630+0000 7f118ce6b640 1 -- 172.21.15.40:0/1231343761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f1188144ee0 con 0x7f11881610f0 2023-11-04T01:41:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.630+0000 7f117effd640 1 -- 172.21.15.40:0/1231343761 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v50) v1 ==== 131+0+0 (secure 0 0 0) 0x7f1188144ee0 con 0x7f11881610f0 2023-11-04T01:41:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:41:40.640 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:41:40.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-04T01:41:40.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.762+0000 7f7feed64640 1 Processor -- start 2023-11-04T01:41:40.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7feed64640 1 -- start start 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7feed64640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fe815c160 0x7f7fe815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7feed64640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe80cb130 con 0x7f7fe80b0c20 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7feed64640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe815b680 con 0x7f7fe815acb0 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7feed64640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe815bd40 con 0x7f7fe815c160 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fed301640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fe815c160 0x7f7fe815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fe7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7fe80b0c20 0x7f7fe80ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48968/0 (socket says 172.21.15.40:48968) 2023-11-04T01:41:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fe7fff640 1 -- 172.21.15.40:0/1307650290 learned_addr learned my addr 172.21.15.40:0/1307650290 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fed301640 1 -- 172.21.15.40:0/1307650290 >> v1:172.21.15.91:6789/0 conn(0x7f7fe815acb0 legacy=0x7f7fe80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fed301640 1 -- 172.21.15.40:0/1307650290 >> v1:172.21.15.40:6789/0 conn(0x7f7fe80b0c20 legacy=0x7f7fe80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fed301640 1 -- 172.21.15.40:0/1307650290 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe815b960 con 0x7f7fe815c160 2023-11-04T01:41:40.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fed301640 1 --2- 172.21.15.40:0/1307650290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815c160 0x7f7fe815b090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009d90 tx=0x7f7fe001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e9d40a691a0735 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.766+0000 7f7fe77fe640 1 -- 172.21.15.40:0/1307650290 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a5920 con 0x7f7fe815c160 2023-11-04T01:41:40.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe77fe640 1 -- 172.21.15.40:0/1307650290 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe00a5a80 con 0x7f7fe815c160 2023-11-04T01:41:40.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe77fe640 1 -- 172.21.15.40:0/1307650290 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a5e10 con 0x7f7fe815c160 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/1307650290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815c160 msgr2=0x7f7fe815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 --2- 172.21.15.40:0/1307650290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815c160 0x7f7fe815b090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009d90 tx=0x7f7fe001c950 comp rx=0 tx=0).stop 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/1307650290 shutdown_connections 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 --2- 172.21.15.40:0/1307650290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815c160 0x7f7fe815b090 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/1307650290 >> 172.21.15.40:0/1307650290 conn(0x7f7fe80cb510 msgr2=0x7f7fe80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/1307650290 shutdown_connections 2023-11-04T01:41:40.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/1307650290 wait complete. 2023-11-04T01:41:40.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 Processor -- start 2023-11-04T01:41:40.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- start start 2023-11-04T01:41:40.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fe80b0c20 0x7f7fe8147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815acb0 0x7f7fe80ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fe815c160 0x7f7fe80ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80aef20 con 0x7f7fe815acb0 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80af200 con 0x7f7fe80b0c20 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80af4e0 con 0x7f7fe815c160 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815acb0 0x7f7fe80ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815acb0 0x7f7fe80ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55710/0 (socket says 172.21.15.40:55710) 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 -- 172.21.15.40:0/2808733614 learned_addr learned my addr 172.21.15.40:0/2808733614 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fecb00640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fe80b0c20 0x7f7fe8147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fed301640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fe815c160 0x7f7fe80ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 -- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fe815c160 msgr2=0x7f7fe80ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fe815c160 0x7f7fe80ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 -- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fe80b0c20 msgr2=0x7f7fe8147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fe80b0c20 0x7f7fe8147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 -- 172.21.15.40:0/2808733614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009a70 con 0x7f7fe815acb0 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe7fff640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe815acb0 0x7f7fe80ae4f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00c500 tx=0x7f7fdc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc005cf0 con 0x7f7fe815acb0 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc005e50 con 0x7f7fe815acb0 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/2808733614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe80af7c0 con 0x7f7fe815acb0 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0072f0 con 0x7f7fe815acb0 2023-11-04T01:41:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.770+0000 7f7feed64640 1 -- 172.21.15.40:0/2808733614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81485c0 con 0x7f7fe815acb0 2023-11-04T01:41:40.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.774+0000 7f7feed64640 1 -- 172.21.15.40:0/2808733614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe806b390 con 0x7f7fe815acb0 2023-11-04T01:41:40.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.774+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fdc007450 con 0x7f7fe815acb0 2023-11-04T01:41:40.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.774+0000 7f7fe57fa640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7fd40664a0 0x7f7fd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.774+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7fdc083490 con 0x7f7fe815acb0 2023-11-04T01:41:40.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.774+0000 7f7fecb00640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7fd40664a0 0x7f7fd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.774+0000 7f7fecb00640 1 --2- 172.21.15.40:0/2808733614 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7fd40664a0 0x7f7fd4068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8001650 tx=0x7f7fd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.778+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7fe806b390 con 0x7f7fe815acb0 2023-11-04T01:41:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.934+0000 7f7feed64640 1 -- 172.21.15.40:0/2808733614 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7f7fe806b390 con 0x7f7fe815acb0 2023-11-04T01:41:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:40.934+0000 7f7fe57fa640 1 -- 172.21.15.40:0/2808733614 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v50) v1 ==== 135+0+0 (secure 0 0 0) 0x7f7fe806b390 con 0x7f7fe815acb0 2023-11-04T01:41:40.941 INFO:teuthology.orchestra.run.smithi040.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:41:40.946 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:41:40.947 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:41:40.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:41.004 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:41.071 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:41:41.071 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:41.071 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:41.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:41.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 Processor -- start 2023-11-04T01:41:41.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 -- start start 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f667c15afd0 0x7f667c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c06f8f0 0x7f667c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f667c0b0b70 0x7f667c0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c070140 con 0x7f667c15afd0 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b1000 con 0x7f667c0b0b70 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6680f36640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c06c9f0 con 0x7f667c06f8f0 2023-11-04T01:41:41.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f667c15afd0 0x7f667c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f667c15afd0 0x7f667c0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55724/0 (socket says 172.21.15.40:55724) 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 -- 172.21.15.40:0/2007380892 learned_addr learned my addr 172.21.15.40:0/2007380892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6671d9b640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c06f8f0 0x7f667c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667ad9d640 1 --2- 172.21.15.40:0/2007380892 >> v2:172.21.15.91:3300/0 conn(0x7f667c0b0b70 0x7f667c0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 -- 172.21.15.40:0/2007380892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c06f8f0 msgr2=0x7f667c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c06f8f0 0x7f667c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 -- 172.21.15.40:0/2007380892 >> v2:172.21.15.91:3300/0 conn(0x7f667c0b0b70 msgr2=0x7f667c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 --2- 172.21.15.40:0/2007380892 >> v2:172.21.15.91:3300/0 conn(0x7f667c0b0b70 0x7f667c0c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667a59c640 1 -- 172.21.15.40:0/2007380892 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0c2670 con 0x7f667c15afd0 2023-11-04T01:41:41.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f667ad9d640 1 --2- 172.21.15.40:0/2007380892 >> v2:172.21.15.91:3300/0 conn(0x7f667c0b0b70 0x7f667c0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.242+0000 7f6671d9b640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c06f8f0 0x7f667c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c15afd0 0x7f667c0715d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ae5c0 tx=0x7f666401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745534f2babb66d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6679d9b640 1 -- 172.21.15.40:0/2007380892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640ab600 con 0x7f667c15afd0 2023-11-04T01:41:41.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6679d9b640 1 -- 172.21.15.40:0/2007380892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66640a7050 con 0x7f667c15afd0 2023-11-04T01:41:41.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6679d9b640 1 -- 172.21.15.40:0/2007380892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640ab980 con 0x7f667c15afd0 2023-11-04T01:41:41.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- 172.21.15.40:0/2007380892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c15afd0 msgr2=0x7f667c0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c15afd0 0x7f667c0715d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ae5c0 tx=0x7f666401c210 comp rx=0 tx=0).stop 2023-11-04T01:41:41.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- 172.21.15.40:0/2007380892 shutdown_connections 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- 172.21.15.40:0/2007380892 >> v2:172.21.15.91:3300/0 conn(0x7f667c0b0b70 0x7f667c0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c06f8f0 0x7f667c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- 172.21.15.40:0/2007380892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c15afd0 0x7f667c0715d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- 172.21.15.40:0/2007380892 >> 172.21.15.40:0/2007380892 conn(0x7f667c0cebb0 msgr2=0x7f667c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- 172.21.15.40:0/2007380892 shutdown_connections 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- 172.21.15.40:0/2007380892 wait complete. 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 Processor -- start 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- start start 2023-11-04T01:41:41.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 0x7f667c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f667c0b0b70 0x7f667c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c15afd0 0x7f667c1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c156330 con 0x7f667c06f8f0 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c156050 con 0x7f667c0b0b70 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6680f36640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c15c210 con 0x7f667c15afd0 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 0x7f667c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 0x7f667c0ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55734/0 (socket says 172.21.15.40:55734) 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 -- 172.21.15.40:0/586923308 learned_addr learned my addr 172.21.15.40:0/586923308 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f6671d9b640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f667c0b0b70 0x7f667c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667ad9d640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c15afd0 0x7f667c1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 -- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c15afd0 msgr2=0x7f667c1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c15afd0 0x7f667c1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 -- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f667c0b0b70 msgr2=0x7f667c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f667c0b0b70 0x7f667c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 -- 172.21.15.40:0/586923308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640094d0 con 0x7f667c06f8f0 2023-11-04T01:41:41.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.246+0000 7f667a59c640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 0x7f667c0ca630 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f66640ae040 tx=0x7f6664018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640b4640 con 0x7f667c06f8f0 2023-11-04T01:41:41.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66640b47a0 con 0x7f667c06f8f0 2023-11-04T01:41:41.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640b4b30 con 0x7f667c06f8f0 2023-11-04T01:41:41.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c15c4f0 con 0x7f667c06f8f0 2023-11-04T01:41:41.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c15c7d0 con 0x7f667c06f8f0 2023-11-04T01:41:41.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0744a0 con 0x7f667c06f8f0 2023-11-04T01:41:41.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66640b2070 con 0x7f667c06f8f0 2023-11-04T01:41:41.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f66737fe640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66600664a0 0x7f6660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f666411ded0 con 0x7f667c06f8f0 2023-11-04T01:41:41.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f6671d9b640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66600664a0 0x7f6660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.250+0000 7f6671d9b640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66600664a0 0x7f6660068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f667c0c82a0 tx=0x7f666c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.254+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66640eb1a0 con 0x7f667c06f8f0 2023-11-04T01:41:41.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.414+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f667c06c1c0 con 0x7f667c06f8f0 2023-11-04T01:41:41.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.414+0000 7f66737fe640 1 -- 172.21.15.40:0/586923308 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f666411b7d0 con 0x7f667c06f8f0 2023-11-04T01:41:41.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:41.420 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":50,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:39.896386+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66600664a0 msgr2=0x7f6660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66600664a0 0x7f6660068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f667c0c82a0 tx=0x7f666c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 msgr2=0x7f667c0ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 0x7f667c0ca630 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f66640ae040 tx=0x7f6664018fb0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 shutdown_connections 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66600664a0 0x7f6660068960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f667c15afd0 0x7f667c1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f667c0b0b70 0x7f667c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 --2- 172.21.15.40:0/586923308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f667c06f8f0 0x7f667c0ca630 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 >> 172.21.15.40:0/586923308 conn(0x7f667c0cebb0 msgr2=0x7f667c0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 shutdown_connections 2023-11-04T01:41:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.418+0000 7f6680f36640 1 -- 172.21.15.40:0/586923308 wait complete. 2023-11-04T01:41:41.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:41:29.698144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:30.083422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:41.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:41.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 Processor -- start 2023-11-04T01:41:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 -- start start 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e415d0b0 0x7f33e4160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33e40cff20 0x7f33e40d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e40b5e00 con 0x7f33e41610f0 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40d1520 con 0x7f33e40cff20 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e88a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e415d490 con 0x7f33e415d0b0 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33e40cff20 0x7f33e40d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33e40cff20 0x7f33e40d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55738/0 (socket says 172.21.15.40:55738) 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 -- 172.21.15.40:0/2838103505 learned_addr learned my addr 172.21.15.40:0/2838103505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e259c640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e415d0b0 0x7f33e4160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 -- 172.21.15.40:0/2838103505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e415d0b0 msgr2=0x7f33e4160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e415d0b0 0x7f33e4160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 -- 172.21.15.40:0/2838103505 >> v1:172.21.15.91:6789/0 conn(0x7f33e41610f0 legacy=0x7f33e40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e2d9d640 1 -- 172.21.15.40:0/2838103505 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40b8930 con 0x7f33e40cff20 2023-11-04T01:41:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.558+0000 7f33e259c640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e415d0b0 0x7f33e4160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e2d9d640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e40d1940 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009e50 tx=0x7f33dc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249baaadbd56c780 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e159a640 1 -- 172.21.15.40:0/2838103505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0a5760 con 0x7f33e40cff20 2023-11-04T01:41:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e159a640 1 -- 172.21.15.40:0/2838103505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc0a58c0 con 0x7f33e40cff20 2023-11-04T01:41:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e159a640 1 -- 172.21.15.40:0/2838103505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0a5c50 con 0x7f33e40cff20 2023-11-04T01:41:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- 172.21.15.40:0/2838103505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 msgr2=0x7f33e40d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e40d1940 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009e50 tx=0x7f33dc01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- 172.21.15.40:0/2838103505 shutdown_connections 2023-11-04T01:41:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e40d1940 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 --2- 172.21.15.40:0/2838103505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e415d0b0 0x7f33e4160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- 172.21.15.40:0/2838103505 >> 172.21.15.40:0/2838103505 conn(0x7f33e406a890 msgr2=0x7f33e406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- 172.21.15.40:0/2838103505 shutdown_connections 2023-11-04T01:41:41.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- 172.21.15.40:0/2838103505 wait complete. 2023-11-04T01:41:41.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 Processor -- start 2023-11-04T01:41:41.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- start start 2023-11-04T01:41:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e4157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33e415d0b0 0x7f33e40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e41610f0 0x7f33e40b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4157850 con 0x7f33e40cff20 2023-11-04T01:41:41.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40b3e20 con 0x7f33e415d0b0 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e88a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40b4100 con 0x7f33e41610f0 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e4157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e4157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55748/0 (socket says 172.21.15.40:55748) 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 -- 172.21.15.40:0/635562412 learned_addr learned my addr 172.21.15.40:0/635562412 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e1d9b640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33e415d0b0 0x7f33e40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e2d9d640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e41610f0 0x7f33e40b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 -- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e41610f0 msgr2=0x7f33e40b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e41610f0 0x7f33e40b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 -- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33e415d0b0 msgr2=0x7f33e40b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33e415d0b0 0x7f33e40b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.562+0000 7f33e259c640 1 -- 172.21.15.40:0/635562412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009b30 con 0x7f33e40cff20 2023-11-04T01:41:41.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33e259c640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e4157310 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c7c0 tx=0x7f33d400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4007a30 con 0x7f33e40cff20 2023-11-04T01:41:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4007b90 con 0x7f33e40cff20 2023-11-04T01:41:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e40b43e0 con 0x7f33e40cff20 2023-11-04T01:41:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400ce70 con 0x7f33e40cff20 2023-11-04T01:41:41.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e40b49a0 con 0x7f33e40cff20 2023-11-04T01:41:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e41f5db0 con 0x7f33e40cff20 2023-11-04T01:41:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33d40113f0 con 0x7f33e40cff20 2023-11-04T01:41:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33d2ffd640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33c40664d0 0x7f33c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f33d4084670 con 0x7f33e40cff20 2023-11-04T01:41:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33e1d9b640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33c40664d0 0x7f33c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.566+0000 7f33e1d9b640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33c40664d0 0x7f33c4068990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33e40b1a60 tx=0x7f33d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.570+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33d4051930 con 0x7f33e40cff20 2023-11-04T01:41:41.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.726+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33e40d1110 con 0x7f33e40cff20 2023-11-04T01:41:41.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.726+0000 7f33d2ffd640 1 -- 172.21.15.40:0/635562412 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33d4054f50 con 0x7f33e40cff20 2023-11-04T01:41:41.733 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:41.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33c40664d0 msgr2=0x7f33c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33c40664d0 0x7f33c4068990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33e40b1a60 tx=0x7f33d8008040 comp rx=0 tx=0).stop 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 msgr2=0x7f33e4157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e4157310 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c7c0 tx=0x7f33d400cc80 comp rx=0 tx=0).stop 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 shutdown_connections 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33c40664d0 0x7f33c4068990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33e41610f0 0x7f33e40b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33e415d0b0 0x7f33e40b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 --2- 172.21.15.40:0/635562412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e40cff20 0x7f33e4157310 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 >> 172.21.15.40:0/635562412 conn(0x7f33e406a890 msgr2=0x7f33e40b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 shutdown_connections 2023-11-04T01:41:41.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.730+0000 7f33e88a5640 1 -- 172.21.15.40:0/635562412 wait complete. 2023-11-04T01:41:41.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2ac520640 1 Processor -- start 2023-11-04T01:41:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2ac520640 1 -- start start 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2ac520640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2a40d1670 0x7fb2a40af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2ac520640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4160c50 con 0x7fb2a40cd670 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2ac520640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4160ef0 con 0x7fb2a406cfc0 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2ac520640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a41611d0 con 0x7fb2a40d1670 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2aa2bc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb2a40cd670 0x7fb2a40ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48970/0 (socket says 172.21.15.40:48970) 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2aa2bc640 1 -- 172.21.15.40:0/1434100459 learned_addr learned my addr 172.21.15.40:0/1434100459 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:41.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2aaabd640 1 --2- 172.21.15.40:0/1434100459 >> v2:172.21.15.91:3300/0 conn(0x7fb2a40d1670 0x7fb2a40af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255897802 0 0) 0x7fb2a4160c50 con 0x7fb2a40cd670 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb290003530 con 0x7fb2a40cd670 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2200926179 0 0) 0x7fb290003530 con 0x7fb2a40cd670 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 >> v2:172.21.15.91:3300/0 conn(0x7fb2a40d1670 msgr2=0x7fb2a40af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 --2- 172.21.15.40:0/1434100459 >> v2:172.21.15.91:3300/0 conn(0x7fb2a40d1670 0x7fb2a40af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 >> v1:172.21.15.91:6789/0 conn(0x7fb2a406cfc0 legacy=0x7fb2a415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a41614b0 con 0x7fb2a40cd670 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fb2a0001800 con 0x7fb2a40cd670 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 >> v1:172.21.15.40:6789/0 conn(0x7fb2a40cd670 legacy=0x7fb2a40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb290003980 0x7fb290003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900047d0 0x7fb290004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb290005190 0x7fb29000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a41611d0 con 0x7fb2900047d0 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29000c030 con 0x7fb290003980 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29000c1f0 con 0x7fb290005190 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a9abb640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900047d0 0x7fb290004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2aa2bc640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb290003980 0x7fb290003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2aaabd640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb290005190 0x7fb29000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a9abb640 1 -- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb290005190 msgr2=0x7fb29000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a9abb640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb290005190 0x7fb29000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a9abb640 1 -- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb290003980 msgr2=0x7fb290003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a9abb640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb290003980 0x7fb290003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2a9abb640 1 -- 172.21.15.40:0/1434100459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290003530 con 0x7fb2900047d0 2023-11-04T01:41:41.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.878+0000 7fb2aaabd640 1 -- 172.21.15.40:0/1434100459 reap_dead start 2023-11-04T01:41:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2a9abb640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900047d0 0x7fb290004c50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb294001750 tx=0x7fb29401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e079e7c744edc20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2940052d0 con 0x7fb2900047d0 2023-11-04T01:41:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2940a7050 con 0x7fb2900047d0 2023-11-04T01:41:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2a92ba640 1 -- 172.21.15.40:0/1434100459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294003600 con 0x7fb2900047d0 2023-11-04T01:41:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 -- 172.21.15.40:0/1434100459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900047d0 msgr2=0x7fb290004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900047d0 0x7fb290004c50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb294001750 tx=0x7fb29401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 -- 172.21.15.40:0/1434100459 shutdown_connections 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 --2- 172.21.15.40:0/1434100459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2900047d0 0x7fb290004c50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 -- 172.21.15.40:0/1434100459 >> 172.21.15.40:0/1434100459 conn(0x7fb2a4065dc0 msgr2=0x7fb2a40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 -- 172.21.15.40:0/1434100459 shutdown_connections 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.882+0000 7fb2ac520640 1 -- 172.21.15.40:0/1434100459 wait complete. 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 Processor -- start 2023-11-04T01:41:41.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- start start 2023-11-04T01:41:41.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2900047d0 0x7fb2a40b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2a415b7d0 0x7fb2a40b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 0x7fb2a40b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4157fb0 con 0x7fb2a40b1320 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40c46a0 con 0x7fb2a415b7d0 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40c4980 con 0x7fb2900047d0 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 0x7fb2a40b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 0x7fb2a40b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55770/0 (socket says 172.21.15.40:55770) 2023-11-04T01:41:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 -- 172.21.15.40:0/104496998 learned_addr learned my addr 172.21.15.40:0/104496998 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aa2bc640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2900047d0 0x7fb2a40b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2a9abb640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2a415b7d0 0x7fb2a40b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 -- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2900047d0 msgr2=0x7fb2a40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2900047d0 0x7fb2a40b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 -- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2a415b7d0 msgr2=0x7fb2a40b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2a415b7d0 0x7fb2a40b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 -- 172.21.15.40:0/104496998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40c4c60 con 0x7fb2a40b1320 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2a9abb640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2a415b7d0 0x7fb2a40b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2aaabd640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 0x7fb2a40b5f10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40cb2c0 tx=0x7fb29c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c01a070 con 0x7fb2a40b1320 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c00fe50 con 0x7fb2a40b1320 2023-11-04T01:41:41.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40c4f40 con 0x7fb2a40b1320 2023-11-04T01:41:41.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c003bc0 con 0x7fb2a40b1320 2023-11-04T01:41:41.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40b4850 con 0x7fb2a40b1320 2023-11-04T01:41:41.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.886+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a40675f0 con 0x7fb2a40b1320 2023-11-04T01:41:41.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.890+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb29c016420 con 0x7fb2a40b1320 2023-11-04T01:41:41.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.890+0000 7fb29affd640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2880664a0 0x7fb288068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.890+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb29c0848c0 con 0x7fb2a40b1320 2023-11-04T01:41:41.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.890+0000 7fb2aa2bc640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2880664a0 0x7fb288068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.890+0000 7fb2aa2bc640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2880664a0 0x7fb288068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0001390 tx=0x7fb2a0001540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:41.894+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb29c051c30 con 0x7fb2a40b1320 2023-11-04T01:41:42.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.050+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb2a40c53f0 con 0x7fb2a40b1320 2023-11-04T01:41:42.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb29affd640 1 -- 172.21.15.40:0/104496998 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v50) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb29c055250 con 0x7fb2a40b1320 2023-11-04T01:41:42.058 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:42.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2880664a0 msgr2=0x7fb288068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2880664a0 0x7fb288068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0001390 tx=0x7fb2a0001540 comp rx=0 tx=0).stop 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 msgr2=0x7fb2a40b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 0x7fb2a40b5f10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40cb2c0 tx=0x7fb29c00f520 comp rx=0 tx=0).stop 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 shutdown_connections 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2880664a0 0x7fb288068960 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2a40b1320 0x7fb2a40b5f10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2a415b7d0 0x7fb2a40b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 --2- 172.21.15.40:0/104496998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2900047d0 0x7fb2a40b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 >> 172.21.15.40:0/104496998 conn(0x7fb2a4065dc0 msgr2=0x7fb2a40cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 shutdown_connections 2023-11-04T01:41:42.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.054+0000 7fb2ac520640 1 -- 172.21.15.40:0/104496998 wait complete. 2023-11-04T01:41:42.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80de2b8640 1 Processor -- start 2023-11-04T01:41:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80de2b8640 1 -- start start 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80de2b8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f80d815c160 0x7f80d815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80de2b8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d80cb130 con 0x7f80d80b0c20 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80de2b8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d815b680 con 0x7f80d815acb0 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80de2b8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d815bd40 con 0x7f80d815c160 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f80d80b0c20 0x7f80d80ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48986/0 (socket says 172.21.15.40:48986) 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 -- 172.21.15.40:0/2084584066 learned_addr learned my addr 172.21.15.40:0/2084584066 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80dc855640 1 --2- 172.21.15.40:0/2084584066 >> v2:172.21.15.91:3300/0 conn(0x7f80d815c160 0x7f80d815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113806446 0 0) 0x7f80d80cb130 con 0x7f80d80b0c20 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c0003530 con 0x7f80d80b0c20 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923961158 0 0) 0x7f80c0003530 con 0x7f80d80b0c20 2023-11-04T01:41:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 >> v2:172.21.15.91:3300/0 conn(0x7f80d815c160 msgr2=0x7f80d815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 --2- 172.21.15.40:0/2084584066 >> v2:172.21.15.91:3300/0 conn(0x7f80d815c160 0x7f80d815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 >> v1:172.21.15.91:6789/0 conn(0x7f80d815acb0 legacy=0x7f80d80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d815b960 con 0x7f80d80b0c20 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f80cc001680 con 0x7f80d80b0c20 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 >> v1:172.21.15.40:6789/0 conn(0x7f80d80b0c20 legacy=0x7f80d80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0003980 0x7f80c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c00047d0 0x7f80c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0005190 0x7f80c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815bd40 con 0x7f80c00047d0 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c000c030 con 0x7f80c0003980 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c000c1f0 con 0x7f80c0005190 2023-11-04T01:41:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c00047d0 0x7f80c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80dc855640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0005190 0x7f80c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 -- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0005190 msgr2=0x7f80c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0005190 0x7f80c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 -- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0003980 msgr2=0x7f80c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80c0003980 0x7f80c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80d77fe640 1 -- 172.21.15.40:0/2084584066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0003530 con 0x7f80c00047d0 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80dc855640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c0005190 0x7f80c000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.202+0000 7f80dc855640 1 -- 172.21.15.40:0/2084584066 reap_dead start 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c00047d0 0x7f80c0004c50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c1c0 tx=0x7f80cc01f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442ff800c1c73e2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0058e0 con 0x7f80c00047d0 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc005a40 con 0x7f80c00047d0 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d6ffd640 1 -- 172.21.15.40:0/2084584066 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc005e70 con 0x7f80c00047d0 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- 172.21.15.40:0/2084584066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c00047d0 msgr2=0x7f80c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c00047d0 0x7f80c0004c50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c1c0 tx=0x7f80cc01f290 comp rx=0 tx=0).stop 2023-11-04T01:41:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- 172.21.15.40:0/2084584066 shutdown_connections 2023-11-04T01:41:42.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2084584066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80c00047d0 0x7f80c0004c50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- 172.21.15.40:0/2084584066 >> 172.21.15.40:0/2084584066 conn(0x7f80d80cb510 msgr2=0x7f80d80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- 172.21.15.40:0/2084584066 shutdown_connections 2023-11-04T01:41:42.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- 172.21.15.40:0/2084584066 wait complete. 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 Processor -- start 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- start start 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c00047d0 0x7f80d80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 0x7f80d80acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d815c610 0x7f80d815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d806c650 con 0x7f80d8152120 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d806b9d0 con 0x7f80d815c610 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80de2b8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d806bcb0 con 0x7f80c00047d0 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 0x7f80d80acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 0x7f80d80acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55786/0 (socket says 172.21.15.40:55786) 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.206+0000 7f80d77fe640 1 -- 172.21.15.40:0/2837581315 learned_addr learned my addr 172.21.15.40:0/2837581315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80dc855640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d815c610 0x7f80d815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d7fff640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c00047d0 0x7f80d80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d77fe640 1 -- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c00047d0 msgr2=0x7f80d80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c00047d0 0x7f80d80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d77fe640 1 -- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d815c610 msgr2=0x7f80d815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d815c610 0x7f80d815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d77fe640 1 -- 172.21.15.40:0/2837581315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d806bf90 con 0x7f80d8152120 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d7fff640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c00047d0 0x7f80d80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d77fe640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 0x7f80d80acb20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80cc001940 tx=0x7f80c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0b7070 con 0x7f80d8152120 2023-11-04T01:41:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc000ee0 con 0x7f80d8152120 2023-11-04T01:41:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc005bb0 con 0x7f80d8152120 2023-11-04T01:41:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d806c270 con 0x7f80d8152120 2023-11-04T01:41:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80ad060 con 0x7f80d8152120 2023-11-04T01:41:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d806c790 con 0x7f80d8152120 2023-11-04T01:41:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80cc005d10 con 0x7f80d8152120 2023-11-04T01:41:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d4ff9640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80c40664d0 0x7f80c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f80cc120c10 con 0x7f80d8152120 2023-11-04T01:41:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d7fff640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80c40664d0 0x7f80c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.210+0000 7f80d7fff640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80c40664d0 0x7f80c4068990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80c8007fd0 tx=0x7f80c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.214+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80d806c790 con 0x7f80d8152120 2023-11-04T01:41:42.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.370+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80d806c790 con 0x7f80d8152120 2023-11-04T01:41:42.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.370+0000 7f80d4ff9640 1 -- 172.21.15.40:0/2837581315 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80d806c790 con 0x7f80d8152120 2023-11-04T01:41:42.377 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80c40664d0 msgr2=0x7f80c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80c40664d0 0x7f80c4068990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80c8007fd0 tx=0x7f80c8009040 comp rx=0 tx=0).stop 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 msgr2=0x7f80d80acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 0x7f80d80acb20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80cc001940 tx=0x7f80c0005800 comp rx=0 tx=0).stop 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 shutdown_connections 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f80c40664d0 0x7f80c4068990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f80d815c610 0x7f80d815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80d8152120 0x7f80d80acb20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 --2- 172.21.15.40:0/2837581315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f80c00047d0 0x7f80d80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 >> 172.21.15.40:0/2837581315 conn(0x7f80d80cb510 msgr2=0x7f80d80c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 shutdown_connections 2023-11-04T01:41:42.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.374+0000 7f80de2b8640 1 -- 172.21.15.40:0/2837581315 wait complete. 2023-11-04T01:41:42.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b88bb640 1 Processor -- start 2023-11-04T01:41:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b88bb640 1 -- start start 2023-11-04T01:41:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b88bb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32b406d160 0x7f32b415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b88bb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b406c0c0 con 0x7f32b415af70 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b88bb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b406c3a0 con 0x7f32b40ce1b0 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b88bb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b4071200 con 0x7f32b406d160 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32b415af70 0x7f32b40cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48992/0 (socket says 172.21.15.40:48992) 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b259c640 1 -- 172.21.15.40:0/1085475651 learned_addr learned my addr 172.21.15.40:0/1085475651 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640718055 0 0) 0x7f32b406c0c0 con 0x7f32b415af70 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a0005740 con 0x7f32b415af70 2023-11-04T01:41:42.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b2d9d640 1 --2- 172.21.15.40:0/1085475651 >> v2:172.21.15.91:3300/0 conn(0x7f32b406d160 0x7f32b415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327070170 0 0) 0x7f32a0005740 con 0x7f32b415af70 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 >> v2:172.21.15.91:3300/0 conn(0x7f32b406d160 msgr2=0x7f32b415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 --2- 172.21.15.40:0/1085475651 >> v2:172.21.15.91:3300/0 conn(0x7f32b406d160 0x7f32b415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 >> v1:172.21.15.91:6789/0 conn(0x7f32b40ce1b0 legacy=0x7f32b415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b406c680 con 0x7f32b415af70 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f32a4001a20 con 0x7f32b415af70 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 >> v1:172.21.15.40:6789/0 conn(0x7f32b415af70 legacy=0x7f32b40cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32a0005b90 0x7f32a0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32a00069e0 0x7f32a0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00073a0 0x7f32a000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4071200 con 0x7f32a00069e0 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a000e240 con 0x7f32a00073a0 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a000e400 con 0x7f32a0005b90 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32a00069e0 0x7f32a0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b2d9d640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00073a0 0x7f32a000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b259c640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32a0005b90 0x7f32a0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32a9d9b640 1 -- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32a0005b90 msgr2=0x7f32a0005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32a0005b90 0x7f32a0005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32a9d9b640 1 -- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00073a0 msgr2=0x7f32a000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00073a0 0x7f32a000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32a9d9b640 1 -- 172.21.15.40:0/1085475651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0005740 con 0x7f32a00069e0 2023-11-04T01:41:42.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b2d9d640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00073a0 0x7f32a000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.522+0000 7f32b2d9d640 1 -- 172.21.15.40:0/1085475651 reap_dead start 2023-11-04T01:41:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32a00069e0 0x7f32a0006e60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f329c001780 tx=0x7f329c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc6817845a32a09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c0a4ea0 con 0x7f32a00069e0 2023-11-04T01:41:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c0a7050 con 0x7f32a00069e0 2023-11-04T01:41:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b1d9b640 1 -- 172.21.15.40:0/1085475651 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c003600 con 0x7f32a00069e0 2023-11-04T01:41:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- 172.21.15.40:0/1085475651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32a00069e0 msgr2=0x7f32a0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32a00069e0 0x7f32a0006e60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f329c001780 tx=0x7f329c01c3e0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- 172.21.15.40:0/1085475651 shutdown_connections 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 --2- 172.21.15.40:0/1085475651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32a00069e0 0x7f32a0006e60 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- 172.21.15.40:0/1085475651 >> 172.21.15.40:0/1085475651 conn(0x7f32b40cb510 msgr2=0x7f32b40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- 172.21.15.40:0/1085475651 shutdown_connections 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- 172.21.15.40:0/1085475651 wait complete. 2023-11-04T01:41:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 Processor -- start 2023-11-04T01:41:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- start start 2023-11-04T01:41:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00069e0 0x7f32b41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 0x7f32b40b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32b4154840 0x7f32b4154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4155200 con 0x7f32b40b0c10 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40b11d0 con 0x7f32a00069e0 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.526+0000 7f32b88bb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40c2740 con 0x7f32b4154840 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 0x7f32b40b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 0x7f32b40b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55808/0 (socket says 172.21.15.40:55808) 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 -- 172.21.15.40:0/283629510 learned_addr learned my addr 172.21.15.40:0/283629510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b259c640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00069e0 0x7f32b41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b2d9d640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32b4154840 0x7f32b4154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 -- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32b4154840 msgr2=0x7f32b4154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32b4154840 0x7f32b4154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 -- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00069e0 msgr2=0x7f32b41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00069e0 0x7f32b41553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 -- 172.21.15.40:0/283629510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40c2a20 con 0x7f32b40b0c10 2023-11-04T01:41:42.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b2d9d640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32b4154840 0x7f32b4154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32a9d9b640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 0x7f32b40b3d10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f329c01c210 tx=0x7f32a0007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c003e40 con 0x7f32b40b0c10 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c007a40 con 0x7f32b40b0c10 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b4155b90 con 0x7f32b40b0c10 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c007270 con 0x7f32b40b0c10 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b40b4250 con 0x7f32b40b0c10 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b40cdfe0 con 0x7f32b40b0c10 2023-11-04T01:41:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f329c0073d0 con 0x7f32b40b0c10 2023-11-04T01:41:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32ab7fe640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f32940664a0 0x7f3294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f329c11e400 con 0x7f32b40b0c10 2023-11-04T01:41:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b259c640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f32940664a0 0x7f3294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.530+0000 7f32b259c640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f32940664a0 0x7f3294068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b4c00 tx=0x7f32a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.534+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f329c0eb640 con 0x7f32b40b0c10 2023-11-04T01:41:42.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32b40c2540 con 0x7f32b40b0c10 2023-11-04T01:41:42.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32ab7fe640 1 -- 172.21.15.40:0/283629510 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f329c0eec60 con 0x7f32b40b0c10 2023-11-04T01:41:42.695 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:41:42.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f32940664a0 msgr2=0x7f3294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f32940664a0 0x7f3294068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b4c00 tx=0x7f32a4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 msgr2=0x7f32b40b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 0x7f32b40b3d10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f329c01c210 tx=0x7f32a0007a10 comp rx=0 tx=0).stop 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 shutdown_connections 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f32940664a0 0x7f3294068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f32b4154840 0x7f32b4154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32b40b0c10 0x7f32b40b3d10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 --2- 172.21.15.40:0/283629510 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32a00069e0 0x7f32b41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 >> 172.21.15.40:0/283629510 conn(0x7f32b40cb510 msgr2=0x7f32b40c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 shutdown_connections 2023-11-04T01:41:42.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.690+0000 7f32b88bb640 1 -- 172.21.15.40:0/283629510 wait complete. 2023-11-04T01:41:42.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 Processor -- start 2023-11-04T01:41:42.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 -- start start 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fea100b1960 0x7fea100cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea100b1d40 0x7fea100ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea1015cd60 0x7fea1015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea10071e40 con 0x7fea100b1d40 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea100cdc80 con 0x7fea100b1960 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea15cbd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100ca700 con 0x7fea1015cd60 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea100b1d40 0x7fea100ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea100b1d40 0x7fea100ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55826/0 (socket says 172.21.15.40:55826) 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 -- 172.21.15.40:0/331476820 learned_addr learned my addr 172.21.15.40:0/331476820 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0f7fe640 1 --2- 172.21.15.40:0/331476820 >> v2:172.21.15.91:3300/0 conn(0x7fea100b1960 0x7fea100cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0ffff640 1 --2- 172.21.15.40:0/331476820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea1015cd60 0x7fea1015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 -- 172.21.15.40:0/331476820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea1015cd60 msgr2=0x7fea1015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 --2- 172.21.15.40:0/331476820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea1015cd60 0x7fea1015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 -- 172.21.15.40:0/331476820 >> v2:172.21.15.91:3300/0 conn(0x7fea100b1960 msgr2=0x7fea100cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 --2- 172.21.15.40:0/331476820 >> v2:172.21.15.91:3300/0 conn(0x7fea100b1960 0x7fea100cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.830+0000 7fea0effd640 1 -- 172.21.15.40:0/331476820 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1015d6e0 con 0x7fea100b1d40 2023-11-04T01:41:42.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0effd640 1 --2- 172.21.15.40:0/331476820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100ca1c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fea10066f90 tx=0x7fea0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fadf5264cbc44d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0e7fc640 1 -- 172.21.15.40:0/331476820 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040aa5f0 con 0x7fea100b1d40 2023-11-04T01:41:42.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0e7fc640 1 -- 172.21.15.40:0/331476820 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040aa750 con 0x7fea100b1d40 2023-11-04T01:41:42.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0e7fc640 1 -- 172.21.15.40:0/331476820 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040aaae0 con 0x7fea100b1d40 2023-11-04T01:41:42.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- 172.21.15.40:0/331476820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 msgr2=0x7fea100ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- 172.21.15.40:0/331476820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100ca1c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fea10066f90 tx=0x7fea0401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- 172.21.15.40:0/331476820 shutdown_connections 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- 172.21.15.40:0/331476820 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea1015cd60 0x7fea1015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- 172.21.15.40:0/331476820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100ca1c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- 172.21.15.40:0/331476820 >> v2:172.21.15.91:3300/0 conn(0x7fea100b1960 0x7fea100cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- 172.21.15.40:0/331476820 >> 172.21.15.40:0/331476820 conn(0x7fea1006e760 msgr2=0x7fea1006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- 172.21.15.40:0/331476820 shutdown_connections 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- 172.21.15.40:0/331476820 wait complete. 2023-11-04T01:41:42.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 Processor -- start 2023-11-04T01:41:42.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- start start 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea100b1960 0x7fea10151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1015cd60 0x7fea10152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10153da0 con 0x7fea100b1d40 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10152000 con 0x7fea1015cd60 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea15cbd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100aee40 con 0x7fea100b1960 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55842/0 (socket says 172.21.15.40:55842) 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.834+0000 7fea0effd640 1 -- 172.21.15.40:0/2855935310 learned_addr learned my addr 172.21.15.40:0/2855935310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0f7fe640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea100b1960 0x7fea10151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0ffff640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1015cd60 0x7fea10152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0effd640 1 -- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea100b1960 msgr2=0x7fea10151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0effd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea100b1960 0x7fea10151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0effd640 1 -- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1015cd60 msgr2=0x7fea10152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0effd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1015cd60 0x7fea10152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0effd640 1 -- 172.21.15.40:0/2855935310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040094d0 con 0x7fea100b1d40 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0effd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100b0330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fea0401ab80 tx=0x7fea0401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040aa5f0 con 0x7fea100b1d40 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040b3800 con 0x7fea100b1d40 2023-11-04T01:41:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea100ae270 con 0x7fea100b1d40 2023-11-04T01:41:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040b3b90 con 0x7fea100b1d40 2023-11-04T01:41:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea100ae7f0 con 0x7fea100b1d40 2023-11-04T01:41:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea100675f0 con 0x7fea100b1d40 2023-11-04T01:41:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea040b3cf0 con 0x7fea100b1d40 2023-11-04T01:41:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fe9f7fff640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe9fc0664a0 0x7fe9fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fea040a7070 con 0x7fea100b1d40 2023-11-04T01:41:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.838+0000 7fea0f7fe640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe9fc0664a0 0x7fe9fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.842+0000 7fea0f7fe640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe9fc0664a0 0x7fe9fc068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea10151810 tx=0x7fea00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:42.842+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea040eb830 con 0x7fea100b1d40 2023-11-04T01:41:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fea100ceda0 con 0x7fea100b1d40 2023-11-04T01:41:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fe9f7fff640 1 -- 172.21.15.40:0/2855935310 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7fea040eee50 con 0x7fea100b1d40 2023-11-04T01:41:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe9fc0664a0 msgr2=0x7fe9fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe9fc0664a0 0x7fe9fc068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea10151810 tx=0x7fea00008040 comp rx=0 tx=0).stop 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 msgr2=0x7fea100b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100b0330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fea0401ab80 tx=0x7fea0401ad10 comp rx=0 tx=0).stop 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 shutdown_connections 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe9fc0664a0 0x7fe9fc068960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea1015cd60 0x7fea10152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b1d40 0x7fea100b0330 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 --2- 172.21.15.40:0/2855935310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea100b1960 0x7fea10151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 >> 172.21.15.40:0/2855935310 conn(0x7fea1006e760 msgr2=0x7fea100ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 shutdown_connections 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.006+0000 7fea15cbd640 1 -- 172.21.15.40:0/2855935310 wait complete. 2023-11-04T01:41:43.029 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:41:43.029 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:43.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:43.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:43.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[50394]: fuse finished with error 0 and tester_r 0 2023-11-04T01:41:43.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:43.078 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:43.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:41:43.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:43.080 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:41:43.133 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:43.133 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:43.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:43.140 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:43.140 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:41:43.190 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:41:43.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:43.191 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:43.191 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:43.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:43.196 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:41:43.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:43.196 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:41:43.242 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:41:43.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:43.243 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:43.243 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:43.249 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:43.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:41:43.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:43.250 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:41:43.298 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:41:43.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:43.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:43.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.422+0000 7fa8b10e0640 1 Processor -- start 2023-11-04T01:41:43.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.422+0000 7fa8b10e0640 1 -- start start 2023-11-04T01:41:43.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8b10e0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 0x7fa8ac0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8b10e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac0b4270 con 0x7fa8ac0722e0 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8b10e0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac06cb40 con 0x7fa8ac06a370 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8b10e0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac06ce20 con 0x7fa8ac15d540 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8ac0722e0 0x7fa8ac06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49004/0 (socket says 172.21.15.40:49004) 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 -- 172.21.15.40:0/1847773878 learned_addr learned my addr 172.21.15.40:0/1847773878 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aad9d640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 0x7fa8ac0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881628815 0 0) 0x7fa8ac0b4270 con 0x7fa8ac0722e0 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa894003530 con 0x7fa8ac0722e0 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446659549 0 0) 0x7fa894003530 con 0x7fa8ac0722e0 2023-11-04T01:41:43.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 msgr2=0x7fa8ac0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 0x7fa8ac0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 >> v1:172.21.15.91:6789/0 conn(0x7fa8ac06a370 legacy=0x7fa8ac0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac06d100 con 0x7fa8ac0722e0 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fa8a0001680 con 0x7fa8ac0722e0 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 >> v1:172.21.15.40:6789/0 conn(0x7fa8ac0722e0 legacy=0x7fa8ac06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 0x7fa8940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa894003f30 0x7fa8940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894004d10 0x7fa894005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac06ce20 con 0x7fa894003f30 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400bbd0 con 0x7fa894004d10 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89400bd90 con 0x7fa8ac15d540 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa894003f30 0x7fa8940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aad9d640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 0x7fa8940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8ab59e640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894004d10 0x7fa894005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 -- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 msgr2=0x7fa8940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15d540 0x7fa8940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 -- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894004d10 msgr2=0x7fa894005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894004d10 0x7fa894005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 -- 172.21.15.40:0/1847773878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894003530 con 0x7fa894003f30 2023-11-04T01:41:43.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8ab59e640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894004d10 0x7fa894005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa894003f30 0x7fa8940047d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c240 tx=0x7fa8a001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af03a70f75a7e03 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0005ae0 con 0x7fa894003f30 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00a7070 con 0x7fa894003f30 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.426+0000 7fa8a9d9b640 1 -- 172.21.15.40:0/1847773878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0005ea0 con 0x7fa894003f30 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/1847773878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa894003f30 msgr2=0x7fa8940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/1847773878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa894003f30 0x7fa8940047d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c240 tx=0x7fa8a001c920 comp rx=0 tx=0).stop 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8ab59e640 1 -- 172.21.15.40:0/1847773878 reap_dead start 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/1847773878 shutdown_connections 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/1847773878 >> 172.21.15.40:0/1847773878 conn(0x7fa8ac0716a0 msgr2=0x7fa8ac071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/1847773878 shutdown_connections 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/1847773878 wait complete. 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 Processor -- start 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- start start 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894003f30 0x7fa8ac0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 0x7fa8ac0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15f120 0x7fa8ac15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac15fae0 con 0x7fa8ac15cb10 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac15cf90 con 0x7fa894003f30 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b0960 con 0x7fa8ac15f120 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 0x7fa8ac0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 0x7fa8ac0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55854/0 (socket says 172.21.15.40:55854) 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 -- 172.21.15.40:0/4071895481 learned_addr learned my addr 172.21.15.40:0/4071895481 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aad9d640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894003f30 0x7fa8ac0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8ab59e640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15f120 0x7fa8ac15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 -- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15f120 msgr2=0x7fa8ac15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15f120 0x7fa8ac15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 -- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894003f30 msgr2=0x7fa8ac0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894003f30 0x7fa8ac0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 -- 172.21.15.40:0/4071895481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac06ad10 con 0x7fa8ac15cb10 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aad9d640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894003f30 0x7fa8ac0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8aa59c640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 0x7fa8ac0b0130 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c240 tx=0x7fa894005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0001640 con 0x7fa8ac15cb10 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00047f0 con 0x7fa8ac15cb10 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0b0c40 con 0x7fa8ac15cb10 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0004ba0 con 0x7fa8ac15cb10 2023-11-04T01:41:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.430+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0b1200 con 0x7fa8ac15cb10 2023-11-04T01:41:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.434+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0675f0 con 0x7fa8ac15cb10 2023-11-04T01:41:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.434+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8a0004d00 con 0x7fa8ac15cb10 2023-11-04T01:41:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.434+0000 7fa8937fe640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8980664a0 0x7fa898068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.434+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa8a00b3040 con 0x7fa8ac15cb10 2023-11-04T01:41:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.434+0000 7fa8aad9d640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8980664a0 0x7fa898068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.434+0000 7fa8aad9d640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8980664a0 0x7fa898068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009af0 tx=0x7fa89c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.438+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8a00ea470 con 0x7fa8ac15cb10 2023-11-04T01:41:43.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8ac06b4d0 con 0x7fa8ac15cb10 2023-11-04T01:41:43.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8937fe640 1 -- 172.21.15.40:0/4071895481 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fa8a00eda90 con 0x7fa8ac15cb10 2023-11-04T01:41:43.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:43.628 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:31.104506+0000","modified":"2023-11-04T01:41:34.118780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1760510907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1760510907},{"type":"v1","addr":"172.21.15.40:6835","nonce":1760510907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:43.628 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 23 2023-11-04T01:41:43.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8980664a0 msgr2=0x7fa898068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8980664a0 0x7fa898068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009af0 tx=0x7fa89c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 msgr2=0x7fa8ac0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 0x7fa8ac0b0130 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c240 tx=0x7fa894005800 comp rx=0 tx=0).stop 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 shutdown_connections 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8980664a0 0x7fa898068960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8ac15f120 0x7fa8ac15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8ac15cb10 0x7fa8ac0b0130 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 --2- 172.21.15.40:0/4071895481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa894003f30 0x7fa8ac0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 >> 172.21.15.40:0/4071895481 conn(0x7fa8ac0716a0 msgr2=0x7fa8ac0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 shutdown_connections 2023-11-04T01:41:43.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.622+0000 7fa8b10e0640 1 -- 172.21.15.40:0/4071895481 wait complete. 2023-11-04T01:41:43.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.758+0000 7f9f8a80f640 1 Processor -- start 2023-11-04T01:41:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.758+0000 7f9f8a80f640 1 -- start start 2023-11-04T01:41:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f8a80f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f8415af80 0x7f9f840ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f8a80f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8415b360 con 0x7f9f840b1e10 2023-11-04T01:41:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f8a80f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f84071880 con 0x7f9f8406ace0 2023-11-04T01:41:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f8a80f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f84071b60 con 0x7f9f8415af80 2023-11-04T01:41:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f88dac640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f840b1e10 0x7f9f8415eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49016/0 (socket says 172.21.15.40:49016) 2023-11-04T01:41:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f88dac640 1 -- 172.21.15.40:0/36999056 learned_addr learned my addr 172.21.15.40:0/36999056 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 --2- 172.21.15.40:0/36999056 >> v2:172.21.15.91:3300/0 conn(0x7f9f8415af80 0x7f9f840ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007455503 0 0) 0x7f9f8415b360 con 0x7f9f840b1e10 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f6c003530 con 0x7f9f840b1e10 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2909032922 0 0) 0x7f9f6c003530 con 0x7f9f840b1e10 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 >> v2:172.21.15.91:3300/0 conn(0x7f9f8415af80 msgr2=0x7f9f840ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 --2- 172.21.15.40:0/36999056 >> v2:172.21.15.91:3300/0 conn(0x7f9f8415af80 0x7f9f840ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 >> v1:172.21.15.91:6789/0 conn(0x7f9f8406ace0 legacy=0x7f9f840b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8406a200 con 0x7f9f840b1e10 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9f7c001a00 con 0x7f9f840b1e10 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 >> v1:172.21.15.40:6789/0 conn(0x7f9f840b1e10 legacy=0x7f9f8415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f6c003980 0x7f9f6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c0047d0 0x7f9f6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f6c0052b0 0x7f9f6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84071b60 con 0x7f9f6c003980 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00c180 con 0x7f9f6c0047d0 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00c340 con 0x7f9f6c0052b0 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 --2- 172.21.15.40:0/36999056 >> v2:172.21.15.91:3300/0 conn(0x7f9f8415af80 0x7f9f840ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f6c003980 0x7f9f6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f88dac640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f6c0052b0 0x7f9f6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f837fe640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c0047d0 0x7f9f6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 -- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f6c0052b0 msgr2=0x7f9f6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f6c0052b0 0x7f9f6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 -- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c0047d0 msgr2=0x7f9f6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c0047d0 0x7f9f6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f83fff640 1 -- 172.21.15.40:0/36999056 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c003530 con 0x7f9f6c003980 2023-11-04T01:41:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.762+0000 7f9f88dac640 1 -- 172.21.15.40:0/36999056 reap_dead start 2023-11-04T01:41:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f83fff640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f6c003980 0x7f9f6c003da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009880 tx=0x7f9f7401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c170a3c690e090 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740af070 con 0x7f9f6c003980 2023-11-04T01:41:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74004020 con 0x7f9f6c003980 2023-11-04T01:41:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f82ffd640 1 -- 172.21.15.40:0/36999056 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740043b0 con 0x7f9f6c003980 2023-11-04T01:41:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/36999056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f6c003980 msgr2=0x7f9f6c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f6c003980 0x7f9f6c003da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009880 tx=0x7f9f7401c520 comp rx=0 tx=0).stop 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/36999056 shutdown_connections 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/36999056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f6c003980 0x7f9f6c003da0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/36999056 >> 172.21.15.40:0/36999056 conn(0x7f9f8406e760 msgr2=0x7f9f8406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/36999056 shutdown_connections 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/36999056 wait complete. 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 Processor -- start 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- start start 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c003980 0x7f9f8414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 0x7f9f840c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f8415cad0 0x7f9f8415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840c95d0 con 0x7f9f840c8c50 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8415c5d0 con 0x7f9f6c003980 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840ae310 con 0x7f9f8415cad0 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 0x7f9f840c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 0x7f9f840c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55870/0 (socket says 172.21.15.40:55870) 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 -- 172.21.15.40:0/2305836647 learned_addr learned my addr 172.21.15.40:0/2305836647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f83fff640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c003980 0x7f9f8414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 -- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f8415cad0 msgr2=0x7f9f8415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f88dac640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f8415cad0 0x7f9f8415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f8415cad0 0x7f9f8415cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 -- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c003980 msgr2=0x7f9f8414bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c003980 0x7f9f8414bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 -- 172.21.15.40:0/2305836647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840ae5f0 con 0x7f9f840c8c50 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f83fff640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c003980 0x7f9f8414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f837fe640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 0x7f9f840c9090 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9f78001ec0 tx=0x7f9f7800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780052e0 con 0x7f9f840c8c50 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f78005440 con 0x7f9f840c8c50 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78003820 con 0x7f9f840c8c50 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f840ae8d0 con 0x7f9f840c8c50 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.766+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8414c460 con 0x7f9f840c8c50 2023-11-04T01:41:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.770+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f840675f0 con 0x7f9f840c8c50 2023-11-04T01:41:43.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.770+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f78003980 con 0x7f9f840c8c50 2023-11-04T01:41:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.770+0000 7f9f80ff9640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f700664a0 0x7f9f70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.770+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9f780837d0 con 0x7f9f840c8c50 2023-11-04T01:41:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.770+0000 7f9f83fff640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f700664a0 0x7f9f70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.770+0000 7f9f83fff640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f700664a0 0x7f9f70068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f740ae000 tx=0x7f9f740046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.774+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f78050ad0 con 0x7f9f840c8c50 2023-11-04T01:41:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.926+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f840b25b0 con 0x7f9f840c8c50 2023-11-04T01:41:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.930+0000 7f9f80ff9640 1 -- 172.21.15.40:0/2305836647 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f9f780540f0 con 0x7f9f840c8c50 2023-11-04T01:41:43.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:43.936 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":50,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:39.896386+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f700664a0 msgr2=0x7f9f70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f700664a0 0x7f9f70068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f740ae000 tx=0x7f9f740046d0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 msgr2=0x7f9f840c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 0x7f9f840c9090 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9f78001ec0 tx=0x7f9f7800e8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 shutdown_connections 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f700664a0 0x7f9f70068960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f8415cad0 0x7f9f8415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f840c8c50 0x7f9f840c9090 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 --2- 172.21.15.40:0/2305836647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f6c003980 0x7f9f8414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 >> 172.21.15.40:0/2305836647 conn(0x7f9f8406e760 msgr2=0x7f9f840ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 shutdown_connections 2023-11-04T01:41:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:43.934+0000 7f9f8a80f640 1 -- 172.21.15.40:0/2305836647 wait complete. 2023-11-04T01:41:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:41:29.698144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:30.083422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:43.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 Processor -- start 2023-11-04T01:41:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 -- start start 2023-11-04T01:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c15adb0 0x7f675c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f675c15b190 0x7f675c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0cb220 con 0x7f675c0cced0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c06fcd0 con 0x7f675c15b190 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f6761f42640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cac60 con 0x7f675c15adb0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.074+0000 7f675bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f675c0cced0 0x7f675c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49028/0 (socket says 172.21.15.40:49028) 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 -- 172.21.15.40:0/1936715883 learned_addr learned my addr 172.21.15.40:0/1936715883 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675affd640 1 --2- 172.21.15.40:0/1936715883 >> v2:172.21.15.91:3300/0 conn(0x7f675c15b190 0x7f675c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675b7fe640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c15adb0 0x7f675c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095236342 0 0) 0x7f675c0cb220 con 0x7f675c0cced0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6744003530 con 0x7f675c0cced0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140787612 0 0) 0x7f6744003530 con 0x7f675c0cced0 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c15adb0 msgr2=0x7f675c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c15adb0 0x7f675c0cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 >> v2:172.21.15.91:3300/0 conn(0x7f675c15b190 msgr2=0x7f675c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 --2- 172.21.15.40:0/1936715883 >> v2:172.21.15.91:3300/0 conn(0x7f675c15b190 0x7f675c15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0caf40 con 0x7f675c0cced0 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f6754001a00 con 0x7f675c0cced0 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 >> v1:172.21.15.40:6789/0 conn(0x7f675c0cced0 legacy=0x7f675c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6744003980 0x7f6744003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6744004370 0x7f6744004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6744004ec0 0x7f674400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c06fcd0 con 0x7f6744004ec0 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cac60 con 0x7f6744004370 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674400bed0 con 0x7f6744003980 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6744004ec0 0x7f674400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675affd640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6744004370 0x7f6744004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675b7fe640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6744003980 0x7f6744003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 -- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6744003980 msgr2=0x7f6744003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6744003980 0x7f6744003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 -- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6744004370 msgr2=0x7f6744004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6744004370 0x7f6744004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 -- 172.21.15.40:0/1936715883 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6744003530 con 0x7f6744004ec0 2023-11-04T01:41:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675bfff640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6744004ec0 0x7f674400b990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f675c0cd2d0 tx=0x7f675401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514e8bdeb248a3d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540ad630 con 0x7f6744004ec0 2023-11-04T01:41:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67540a8070 con 0x7f6744004ec0 2023-11-04T01:41:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.078+0000 7f675a7fc640 1 -- 172.21.15.40:0/1936715883 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540ada30 con 0x7f6744004ec0 2023-11-04T01:41:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/1936715883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6744004ec0 msgr2=0x7f674400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 --2- 172.21.15.40:0/1936715883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6744004ec0 0x7f674400b990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f675c0cd2d0 tx=0x7f675401d300 comp rx=0 tx=0).stop 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675bfff640 1 -- 172.21.15.40:0/1936715883 reap_dead start 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/1936715883 shutdown_connections 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/1936715883 >> 172.21.15.40:0/1936715883 conn(0x7f675c0cb510 msgr2=0x7f675c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/1936715883 shutdown_connections 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/1936715883 wait complete. 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 Processor -- start 2023-11-04T01:41:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- start start 2023-11-04T01:41:44.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 0x7f675c0c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f675c0b3380 0x7f675c1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c148d30 0x7f675c15dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c15d690 con 0x7f675c0b2fa0 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c15ca10 con 0x7f675c0b3380 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c15ccf0 con 0x7f675c148d30 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 0x7f675c0c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 0x7f675c0c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55888/0 (socket says 172.21.15.40:55888) 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 -- 172.21.15.40:0/945694778 learned_addr learned my addr 172.21.15.40:0/945694778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675bfff640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c148d30 0x7f675c15dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675affd640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f675c0b3380 0x7f675c1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 -- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c148d30 msgr2=0x7f675c15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c148d30 0x7f675c15dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 -- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f675c0b3380 msgr2=0x7f675c1487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f675c0b3380 0x7f675c1487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 -- 172.21.15.40:0/945694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c15cfd0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675affd640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f675c0b3380 0x7f675c1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f675b7fe640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 0x7f675c0c25c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f674c0114c0 tx=0x7f674c011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c015870 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c0159d0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c15d2b0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c015d80 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.082+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c1554f0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.086+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c0b0ba0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.086+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f674c01d400 con 0x7f675c0b2fa0 2023-11-04T01:41:44.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.086+0000 7f6743fff640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67480664a0 0x7f6748068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.086+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f674c0846c0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.086+0000 7f675affd640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67480664a0 0x7f6748068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.086+0000 7f675affd640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67480664a0 0x7f6748068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b09c0 tx=0x7f6750008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.090+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f674c051a30 con 0x7f675c0b2fa0 2023-11-04T01:41:44.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.246+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f675c0744a0 con 0x7f675c0b2fa0 2023-11-04T01:41:44.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.246+0000 7f6743fff640 1 -- 172.21.15.40:0/945694778 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f674c055050 con 0x7f675c0b2fa0 2023-11-04T01:41:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:44.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67480664a0 msgr2=0x7f6748068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67480664a0 0x7f6748068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b09c0 tx=0x7f6750008040 comp rx=0 tx=0).stop 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 msgr2=0x7f675c0c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 0x7f675c0c25c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f674c0114c0 tx=0x7f674c011980 comp rx=0 tx=0).stop 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 shutdown_connections 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67480664a0 0x7f6748068960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f675c148d30 0x7f675c15dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f675c0b3380 0x7f675c1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 --2- 172.21.15.40:0/945694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c0b2fa0 0x7f675c0c25c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 >> 172.21.15.40:0/945694778 conn(0x7f675c0cb510 msgr2=0x7f675c0cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 shutdown_connections 2023-11-04T01:41:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.250+0000 7f6761f42640 1 -- 172.21.15.40:0/945694778 wait complete. 2023-11-04T01:41:44.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 Processor -- start 2023-11-04T01:41:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 -- start start 2023-11-04T01:41:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fabf40b0c20 0x7fabf40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf40cb130 con 0x7fabf415c160 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf415bd40 con 0x7fabf40b0c20 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabfb6cc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf406fd80 con 0x7fabf415acb0 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fabf40b0c20 0x7fabf40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fabf40b0c20 0x7fabf40ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55904/0 (socket says 172.21.15.40:55904) 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 -- 172.21.15.40:0/3940509427 learned_addr learned my addr 172.21.15.40:0/3940509427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9468640 1 --2- 172.21.15.40:0/3940509427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 -- 172.21.15.40:0/3940509427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 msgr2=0x7fabf415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 --2- 172.21.15.40:0/3940509427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 -- 172.21.15.40:0/3940509427 >> v1:172.21.15.91:6789/0 conn(0x7fabf415c160 legacy=0x7fabf40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.390+0000 7fabf9c69640 1 -- 172.21.15.40:0/3940509427 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf415b680 con 0x7fabf40b0c20 2023-11-04T01:41:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabf9c69640 1 --2- 172.21.15.40:0/3940509427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40ca490 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fabec009e50 tx=0x7fabec01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68860a524e08a529 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabebfff640 1 -- 172.21.15.40:0/3940509427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0a58d0 con 0x7fabf40b0c20 2023-11-04T01:41:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabebfff640 1 -- 172.21.15.40:0/3940509427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec0a5a30 con 0x7fabf40b0c20 2023-11-04T01:41:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabebfff640 1 -- 172.21.15.40:0/3940509427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0a5dc0 con 0x7fabf40b0c20 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 -- 172.21.15.40:0/3940509427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 msgr2=0x7fabf40ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/3940509427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40ca490 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fabec009e50 tx=0x7fabec01c9e0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 -- 172.21.15.40:0/3940509427 shutdown_connections 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/3940509427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40ca490 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/3940509427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 -- 172.21.15.40:0/3940509427 >> 172.21.15.40:0/3940509427 conn(0x7fabf40cb510 msgr2=0x7fabf40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 -- 172.21.15.40:0/3940509427 shutdown_connections 2023-11-04T01:41:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 -- 172.21.15.40:0/3940509427 wait complete. 2023-11-04T01:41:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 Processor -- start 2023-11-04T01:41:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.394+0000 7fabfb6cc640 1 -- start start 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf40c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fabf415c160 0x7fabf40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40b00c0 con 0x7fabf40b0c20 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40c8ab0 con 0x7fabf415c160 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf40af4b0 con 0x7fabf415acb0 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55906/0 (socket says 172.21.15.40:55906) 2023-11-04T01:41:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 -- 172.21.15.40:0/918889652 learned_addr learned my addr 172.21.15.40:0/918889652 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf8c67640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf40c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9c69640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fabf415c160 0x7fabf40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 -- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 msgr2=0x7fabf40c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf40c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 -- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fabf415c160 msgr2=0x7fabf40ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fabf415c160 0x7fabf40ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 -- 172.21.15.40:0/918889652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009b30 con 0x7fabf40b0c20 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9c69640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fabf415c160 0x7fabf40ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf9468640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40aedd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fabf000e930 tx=0x7fabf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0009690 con 0x7fabf40b0c20 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf000ca00 con 0x7fabf40b0c20 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf40af790 con 0x7fabf40b0c20 2023-11-04T01:41:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000cd70 con 0x7fabf40b0c20 2023-11-04T01:41:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf40afd50 con 0x7fabf40b0c20 2023-11-04T01:41:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf40744a0 con 0x7fabf40b0c20 2023-11-04T01:41:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fabf0013470 con 0x7fabf40b0c20 2023-11-04T01:41:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabe9ffb640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fabd80664a0 0x7fabd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fabf00849f0 con 0x7fabf40b0c20 2023-11-04T01:41:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.398+0000 7fabf8c67640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fabd80664a0 0x7fabd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.402+0000 7fabf8c67640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fabd80664a0 0x7fabd8068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fabf40b3c10 tx=0x7fabe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.402+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fabf0051e70 con 0x7fabf40b0c20 2023-11-04T01:41:44.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fabf40cde30 con 0x7fabf40b0c20 2023-11-04T01:41:44.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabe9ffb640 1 -- 172.21.15.40:0/918889652 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v50) v1 ==== 103+0+11 (secure 0 0 0) 0x7fabf0055490 con 0x7fabf40b0c20 2023-11-04T01:41:44.563 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:44.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fabd80664a0 msgr2=0x7fabd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fabd80664a0 0x7fabd8068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fabf40b3c10 tx=0x7fabe4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:44.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 msgr2=0x7fabf40aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40aedd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fabf000e930 tx=0x7fabf000edf0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 shutdown_connections 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fabd80664a0 0x7fabd8068960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fabf415c160 0x7fabf40ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fabf415acb0 0x7fabf40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 --2- 172.21.15.40:0/918889652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabf40b0c20 0x7fabf40aedd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 >> 172.21.15.40:0/918889652 conn(0x7fabf40cb510 msgr2=0x7fabf415d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 shutdown_connections 2023-11-04T01:41:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.558+0000 7fabfb6cc640 1 -- 172.21.15.40:0/918889652 wait complete. 2023-11-04T01:41:44.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:44.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.698+0000 7fc017511640 1 Processor -- start 2023-11-04T01:41:44.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.698+0000 7fc017511640 1 -- start start 2023-11-04T01:41:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc017511640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0100adb50 0x7fc0100adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc017511640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0100cd020 con 0x7fc0100c9a00 2023-11-04T01:41:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc017511640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0100cd300 con 0x7fc0100cc990 2023-11-04T01:41:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc017511640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0100cce40 con 0x7fc0100adb50 2023-11-04T01:41:44.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc0152ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0100adb50 0x7fc0100adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc0152ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0100adb50 0x7fc0100adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55922/0 (socket says 172.21.15.40:55922) 2023-11-04T01:41:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc0152ad640 1 -- 172.21.15.40:0/2734000466 learned_addr learned my addr 172.21.15.40:0/2734000466 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc0152ad640 1 -- 172.21.15.40:0/2734000466 >> v1:172.21.15.91:6789/0 conn(0x7fc0100cc990 legacy=0x7fc0100c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc0152ad640 1 -- 172.21.15.40:0/2734000466 >> v1:172.21.15.40:6789/0 conn(0x7fc0100c9a00 legacy=0x7fc01006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc0152ad640 1 -- 172.21.15.40:0/2734000466 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0100cd5e0 con 0x7fc0100adb50 2023-11-04T01:41:44.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.702+0000 7fc007fff640 1 -- 172.21.15.40:0/2734000466 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347199553 0 0) 0x7fc0100cd020 con 0x7fc0100c9a00 2023-11-04T01:41:44.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc0152ad640 1 --2- 172.21.15.40:0/2734000466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100adb50 0x7fc0100adf30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc000009870 tx=0x7fc00001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e005b6edaeb04c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc007fff640 1 -- 172.21.15.40:0/2734000466 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000aa670 con 0x7fc0100adb50 2023-11-04T01:41:44.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc007fff640 1 -- 172.21.15.40:0/2734000466 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0000aa7d0 con 0x7fc0100adb50 2023-11-04T01:41:44.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc007fff640 1 -- 172.21.15.40:0/2734000466 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000aab60 con 0x7fc0100adb50 2023-11-04T01:41:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- 172.21.15.40:0/2734000466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100adb50 msgr2=0x7fc0100adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 --2- 172.21.15.40:0/2734000466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100adb50 0x7fc0100adf30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc000009870 tx=0x7fc00001c510 comp rx=0 tx=0).stop 2023-11-04T01:41:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- 172.21.15.40:0/2734000466 shutdown_connections 2023-11-04T01:41:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 --2- 172.21.15.40:0/2734000466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100adb50 0x7fc0100adf30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- 172.21.15.40:0/2734000466 >> 172.21.15.40:0/2734000466 conn(0x7fc0100cb510 msgr2=0x7fc0100cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- 172.21.15.40:0/2734000466 shutdown_connections 2023-11-04T01:41:44.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- 172.21.15.40:0/2734000466 wait complete. 2023-11-04T01:41:44.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 Processor -- start 2023-11-04T01:41:44.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- start start 2023-11-04T01:41:44.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc0100adb50 0x7fc0100c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0100c9a00 0x7fc0100aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 0x7fc0100c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010157960 con 0x7fc0100cc990 2023-11-04T01:41:44.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0101581c0 con 0x7fc0100c9a00 2023-11-04T01:41:44.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc017511640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc010155eb0 con 0x7fc0100adb50 2023-11-04T01:41:44.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 0x7fc0100c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 0x7fc0100c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55934/0 (socket says 172.21.15.40:55934) 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 -- 172.21.15.40:0/2926794131 learned_addr learned my addr 172.21.15.40:0/2926794131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc014aac640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0100c9a00 0x7fc0100aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc0152ad640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc0100adb50 0x7fc0100c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 -- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc0100adb50 msgr2=0x7fc0100c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc0100adb50 0x7fc0100c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 -- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0100c9a00 msgr2=0x7fc0100aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0100c9a00 0x7fc0100aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.706+0000 7fc015aae640 1 -- 172.21.15.40:0/2926794131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000094d0 con 0x7fc0100cc990 2023-11-04T01:41:44.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc015aae640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 0x7fc0100c5ea0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc008001570 tx=0x7fc00800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008003db0 con 0x7fc0100cc990 2023-11-04T01:41:44.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008005070 con 0x7fc0100cc990 2023-11-04T01:41:44.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc010156190 con 0x7fc0100cc990 2023-11-04T01:41:44.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008005420 con 0x7fc0100cc990 2023-11-04T01:41:44.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc010157e50 con 0x7fc0100cc990 2023-11-04T01:41:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc010158370 con 0x7fc0100cc990 2023-11-04T01:41:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc008005580 con 0x7fc0100cc990 2023-11-04T01:41:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc005ffb640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff40664a0 0x7fbff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc008083860 con 0x7fc0100cc990 2023-11-04T01:41:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc0152ad640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff40664a0 0x7fbff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.710+0000 7fc0152ad640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff40664a0 0x7fbff4068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc0000ae000 tx=0x7fc0000a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.714+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc010158370 con 0x7fc0100cc990 2023-11-04T01:41:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc010158330 con 0x7fc0100cc990 2023-11-04T01:41:44.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc005ffb640 1 -- 172.21.15.40:0/2926794131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc008017020 con 0x7fc0100cc990 2023-11-04T01:41:44.875 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff40664a0 msgr2=0x7fbff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff40664a0 0x7fbff4068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc0000ae000 tx=0x7fc0000a7000 comp rx=0 tx=0).stop 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 msgr2=0x7fc0100c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 0x7fc0100c5ea0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc008001570 tx=0x7fc00800cd20 comp rx=0 tx=0).stop 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 shutdown_connections 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff40664a0 0x7fbff4068960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0100cc990 0x7fc0100c5ea0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0100c9a00 0x7fc0100aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 --2- 172.21.15.40:0/2926794131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc0100adb50 0x7fc0100c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 >> 172.21.15.40:0/2926794131 conn(0x7fc0100cb510 msgr2=0x7fc010073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 shutdown_connections 2023-11-04T01:41:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:44.870+0000 7fc017511640 1 -- 172.21.15.40:0/2926794131 wait complete. 2023-11-04T01:41:44.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 Processor -- start 2023-11-04T01:41:45.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 -- start start 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f720415acb0 0x7f720415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 0x7f72040b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040cb130 con 0x7f72040b0a50 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720415bd40 con 0x7f720415acb0 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f720a980640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720406fd80 con 0x7f720415c160 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7208f1d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f72040b0a50 0x7f72040ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49054/0 (socket says 172.21.15.40:49054) 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7208f1d640 1 -- 172.21.15.40:0/3824901056 learned_addr learned my addr 172.21.15.40:0/3824901056 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:45.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 --2- 172.21.15.40:0/3824901056 >> v2:172.21.15.91:3300/0 conn(0x7f720415acb0 0x7f720415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f72037fe640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 0x7f72040b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356321130 0 0) 0x7f72040cb130 con 0x7f72040b0a50 2023-11-04T01:41:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f0003530 con 0x7f72040b0a50 2023-11-04T01:41:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159021873 0 0) 0x7f71f0003530 con 0x7f72040b0a50 2023-11-04T01:41:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 msgr2=0x7f72040b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 0x7f72040b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 >> v2:172.21.15.91:3300/0 conn(0x7f720415acb0 msgr2=0x7f720415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 --2- 172.21.15.40:0/3824901056 >> v2:172.21.15.91:3300/0 conn(0x7f720415acb0 0x7f720415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720415b680 con 0x7f72040b0a50 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f71f4001680 con 0x7f72040b0a50 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 >> v1:172.21.15.40:6789/0 conn(0x7f72040b0a50 legacy=0x7f72040ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f0003980 0x7f71f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 0x7f71f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71f0004d10 0x7f71f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720415bd40 con 0x7f71f0003980 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f000b990 con 0x7f71f0004d10 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f000bad0 con 0x7f720415c160 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f0003980 0x7f71f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7208f1d640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71f0004d10 0x7f71f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f72037fe640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 0x7f71f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 -- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 msgr2=0x7f71f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f720415c160 0x7f71f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 -- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71f0004d10 msgr2=0x7f71f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71f0004d10 0x7f71f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7203fff640 1 -- 172.21.15.40:0/3824901056 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0003530 con 0x7f71f0003980 2023-11-04T01:41:45.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.018+0000 7f7208f1d640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71f0004d10 0x7f71f0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f7203fff640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f0003980 0x7f71f0003da0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fc0 tx=0x7f71fc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabd11543a891342 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0a5ba0 con 0x7f71f0003980 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x7f71f0003980 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f7202ffd640 1 -- 172.21.15.40:0/3824901056 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0ad440 con 0x7f71f0003980 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f720a980640 1 -- 172.21.15.40:0/3824901056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f0003980 msgr2=0x7f71f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f720a980640 1 --2- 172.21.15.40:0/3824901056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f0003980 0x7f71f0003da0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fc0 tx=0x7f71fc01cca0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f7208f1d640 1 -- 172.21.15.40:0/3824901056 reap_dead start 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f720a980640 1 -- 172.21.15.40:0/3824901056 shutdown_connections 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f720a980640 1 -- 172.21.15.40:0/3824901056 >> 172.21.15.40:0/3824901056 conn(0x7f72040cb510 msgr2=0x7f72040cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f720a980640 1 -- 172.21.15.40:0/3824901056 shutdown_connections 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.022+0000 7f720a980640 1 -- 172.21.15.40:0/3824901056 wait complete. 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 Processor -- start 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- start start 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71f0003980 0x7f720406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f720414e3f0 0x7f720406b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 0x7f72040ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720414e870 con 0x7f720406b840 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720406ca80 con 0x7f720414e3f0 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72040c6e20 con 0x7f71f0003980 2023-11-04T01:41:45.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 0x7f72040ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 0x7f72040ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55954/0 (socket says 172.21.15.40:55954) 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 -- 172.21.15.40:0/3829833808 learned_addr learned my addr 172.21.15.40:0/3829833808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7203fff640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71f0003980 0x7f720406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f72037fe640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f720414e3f0 0x7f720406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 -- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71f0003980 msgr2=0x7f720406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71f0003980 0x7f720406cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 -- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f720414e3f0 msgr2=0x7f720406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f720414e3f0 0x7f720406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 -- 172.21.15.40:0/3829833808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720406be70 con 0x7f720406b840 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7208f1d640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 0x7f72040ac8c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f72040cdb00 tx=0x7f71f400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400c5b0 con 0x7f720406b840 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f400c710 con 0x7f720406b840 2023-11-04T01:41:45.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720406c150 con 0x7f720406b840 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f400cac0 con 0x7f720406b840 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720406c710 con 0x7f720406b840 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720406c8d0 con 0x7f720406b840 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71f400cc20 con 0x7f720406b840 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7200ff9640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71e40664a0 0x7f71e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.026+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f71f4083620 con 0x7f720406b840 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.030+0000 7f7203fff640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71e40664a0 0x7f71e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.030+0000 7f7203fff640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71e40664a0 0x7f71e4068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0af000 tx=0x7f71fc004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.034+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71f4050a40 con 0x7f720406b840 2023-11-04T01:41:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.190+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72040744a0 con 0x7f720406b840 2023-11-04T01:41:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.190+0000 7f7200ff9640 1 -- 172.21.15.40:0/3829833808 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71f4054060 con 0x7f720406b840 2023-11-04T01:41:45.196 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:41:45.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71e40664a0 msgr2=0x7f71e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71e40664a0 0x7f71e4068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0af000 tx=0x7f71fc004ac0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 msgr2=0x7f72040ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 0x7f72040ac8c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f72040cdb00 tx=0x7f71f400eb90 comp rx=0 tx=0).stop 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 shutdown_connections 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71e40664a0 0x7f71e4068960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f720406b840 0x7f72040ac8c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f720414e3f0 0x7f720406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 --2- 172.21.15.40:0/3829833808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71f0003980 0x7f720406cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 >> 172.21.15.40:0/3829833808 conn(0x7f72040cb510 msgr2=0x7f72040ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 shutdown_connections 2023-11-04T01:41:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.194+0000 7f720a980640 1 -- 172.21.15.40:0/3829833808 wait complete. 2023-11-04T01:41:45.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 Processor -- start 2023-11-04T01:41:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 -- start start 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f62600d0690 0x7f62600b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62600d0ae0 0x7f62600b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62600b6070 con 0x7f62600b4990 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600b8ed0 con 0x7f62600d0ae0 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f62663b3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600d1ce0 con 0x7f62600d0690 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f6264950640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62600d0ae0 0x7f62600b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f625ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f62600b4990 0x7f62600b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49064/0 (socket says 172.21.15.40:49064) 2023-11-04T01:41:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f625ffff640 1 -- 172.21.15.40:0/1436308871 learned_addr learned my addr 172.21.15.40:0/1436308871 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f6264950640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62600d0ae0 0x7f62600b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55958/0 (socket says 172.21.15.40:55958) 2023-11-04T01:41:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f625f7fe640 1 --2- 172.21.15.40:0/1436308871 >> v2:172.21.15.91:3300/0 conn(0x7f62600d0690 0x7f62600b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f6264950640 1 -- 172.21.15.40:0/1436308871 >> v2:172.21.15.91:3300/0 conn(0x7f62600d0690 msgr2=0x7f62600b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f6264950640 1 --2- 172.21.15.40:0/1436308871 >> v2:172.21.15.91:3300/0 conn(0x7f62600d0690 0x7f62600b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f6264950640 1 -- 172.21.15.40:0/1436308871 >> v1:172.21.15.40:6789/0 conn(0x7f62600b4990 legacy=0x7f62600b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f6264950640 1 -- 172.21.15.40:0/1436308871 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600d1fc0 con 0x7f62600d0ae0 2023-11-04T01:41:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.334+0000 7f625effd640 1 -- 172.21.15.40:0/1436308871 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489044536 0 0) 0x7f62600b6070 con 0x7f62600b4990 2023-11-04T01:41:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f6264950640 1 --2- 172.21.15.40:0/1436308871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600d0ae0 0x7f62600b6a20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f626008c090 tx=0x7f625801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24602f31bc29b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f625effd640 1 -- 172.21.15.40:0/1436308871 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580b0440 con 0x7f62600d0ae0 2023-11-04T01:41:45.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f625effd640 1 -- 172.21.15.40:0/1436308871 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580b05a0 con 0x7f62600d0ae0 2023-11-04T01:41:45.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f625effd640 1 -- 172.21.15.40:0/1436308871 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580b0930 con 0x7f62600d0ae0 2023-11-04T01:41:45.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- 172.21.15.40:0/1436308871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600d0ae0 msgr2=0x7f62600b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 --2- 172.21.15.40:0/1436308871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600d0ae0 0x7f62600b6a20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f626008c090 tx=0x7f625801f0f0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- 172.21.15.40:0/1436308871 shutdown_connections 2023-11-04T01:41:45.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 --2- 172.21.15.40:0/1436308871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600d0ae0 0x7f62600b6a20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 --2- 172.21.15.40:0/1436308871 >> v2:172.21.15.91:3300/0 conn(0x7f62600d0690 0x7f62600b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- 172.21.15.40:0/1436308871 >> 172.21.15.40:0/1436308871 conn(0x7f62600cf990 msgr2=0x7f62600cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- 172.21.15.40:0/1436308871 shutdown_connections 2023-11-04T01:41:45.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- 172.21.15.40:0/1436308871 wait complete. 2023-11-04T01:41:45.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 Processor -- start 2023-11-04T01:41:45.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- start start 2023-11-04T01:41:45.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 0x7f6260158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62600d0690 0x7f62600ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62600d0ae0 0x7f62600b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600cbf90 con 0x7f62600b4990 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62600b1730 con 0x7f62600d0ae0 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f62663b3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600cb030 con 0x7f62600d0690 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f625ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 0x7f6260158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f625ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 0x7f6260158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55964/0 (socket says 172.21.15.40:55964) 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.338+0000 7f625ffff640 1 -- 172.21.15.40:0/3623849009 learned_addr learned my addr 172.21.15.40:0/3623849009 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f6264950640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62600d0ae0 0x7f62600b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625f7fe640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62600d0690 0x7f62600ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625ffff640 1 -- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62600d0690 msgr2=0x7f62600ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625ffff640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62600d0690 0x7f62600ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625ffff640 1 -- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62600d0ae0 msgr2=0x7f62600b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625ffff640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62600d0ae0 0x7f62600b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625ffff640 1 -- 172.21.15.40:0/3623849009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009a70 con 0x7f62600b4990 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625ffff640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 0x7f6260158210 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f625000c480 tx=0x7f625000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500074e0 con 0x7f62600b4990 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250007660 con 0x7f62600b4990 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62600cb310 con 0x7f62600b4990 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250004a30 con 0x7f62600b4990 2023-11-04T01:41:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62600cb8d0 con 0x7f62600b4990 2023-11-04T01:41:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62600744a0 con 0x7f62600b4990 2023-11-04T01:41:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6250004b90 con 0x7f62600b4990 2023-11-04T01:41:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625cff9640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f624c0664d0 0x7f624c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6250083590 con 0x7f62600b4990 2023-11-04T01:41:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625f7fe640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f624c0664d0 0x7f624c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.342+0000 7f625f7fe640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f624c0664d0 0x7f624c068990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f62600cca30 tx=0x7f6254008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.346+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62500542f0 con 0x7f62600b4990 2023-11-04T01:41:45.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.534+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62600b5b70 con 0x7f62600b4990 2023-11-04T01:41:45.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f625cff9640 1 -- 172.21.15.40:0/3623849009 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f6250053e80 con 0x7f62600b4990 2023-11-04T01:41:45.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:45.542 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:31.104506+0000","modified":"2023-11-04T01:41:34.118780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1760510907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1760510907},{"type":"v1","addr":"172.21.15.40:6835","nonce":1760510907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:45.543 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 23 2023-11-04T01:41:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f624c0664d0 msgr2=0x7f624c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f624c0664d0 0x7f624c068990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f62600cca30 tx=0x7f6254008040 comp rx=0 tx=0).stop 2023-11-04T01:41:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 msgr2=0x7f6260158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 0x7f6260158210 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f625000c480 tx=0x7f625000c940 comp rx=0 tx=0).stop 2023-11-04T01:41:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 shutdown_connections 2023-11-04T01:41:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f624c0664d0 0x7f624c068990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62600d0ae0 0x7f62600b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62600d0690 0x7f62600ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 --2- 172.21.15.40:0/3623849009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62600b4990 0x7f6260158210 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 >> 172.21.15.40:0/3623849009 conn(0x7f62600cf990 msgr2=0x7f626015c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 shutdown_connections 2023-11-04T01:41:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.538+0000 7f62663b3640 1 -- 172.21.15.40:0/3623849009 wait complete. 2023-11-04T01:41:45.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.674+0000 7fd5d81ef640 1 Processor -- start 2023-11-04T01:41:45.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.674+0000 7fd5d81ef640 1 -- start start 2023-11-04T01:41:45.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d81ef640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0690 0x7fd5d00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d81ef640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5d00d0ae0 0x7fd5d00b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d81ef640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00b6070 con 0x7fd5d00b4990 2023-11-04T01:41:45.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d81ef640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00b8ed0 con 0x7fd5d00d0ae0 2023-11-04T01:41:45.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d81ef640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00d1ce0 con 0x7fd5d00d0690 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5d00d0ae0 0x7fd5d00b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5d00d0ae0 0x7fd5d00b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55980/0 (socket says 172.21.15.40:55980) 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 -- 172.21.15.40:0/1523061205 learned_addr learned my addr 172.21.15.40:0/1523061205 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d578a640 1 --2- 172.21.15.40:0/1523061205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0690 0x7fd5d00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 -- 172.21.15.40:0/1523061205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0690 msgr2=0x7fd5d00b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 --2- 172.21.15.40:0/1523061205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0690 0x7fd5d00b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 -- 172.21.15.40:0/1523061205 >> v1:172.21.15.91:6789/0 conn(0x7fd5d00b4990 legacy=0x7fd5d00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.678+0000 7fd5d678c640 1 -- 172.21.15.40:0/1523061205 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00d1fc0 con 0x7fd5d00d0ae0 2023-11-04T01:41:45.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d678c640 1 --2- 172.21.15.40:0/1523061205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00d0ae0 0x7fd5d00b6a20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009e50 tx=0x7fd5c801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b3849856c1dbbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d4f89640 1 -- 172.21.15.40:0/1523061205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80af400 con 0x7fd5d00d0ae0 2023-11-04T01:41:45.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d4f89640 1 -- 172.21.15.40:0/1523061205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80ab050 con 0x7fd5d00d0ae0 2023-11-04T01:41:45.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d4f89640 1 -- 172.21.15.40:0/1523061205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80af780 con 0x7fd5d00d0ae0 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 -- 172.21.15.40:0/1523061205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00d0ae0 msgr2=0x7fd5d00b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/1523061205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00d0ae0 0x7fd5d00b6a20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009e50 tx=0x7fd5c801f1f0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 -- 172.21.15.40:0/1523061205 shutdown_connections 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/1523061205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00d0ae0 0x7fd5d00b6a20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/1523061205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0690 0x7fd5d00b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 -- 172.21.15.40:0/1523061205 >> 172.21.15.40:0/1523061205 conn(0x7fd5d00cf990 msgr2=0x7fd5d00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 -- 172.21.15.40:0/1523061205 shutdown_connections 2023-11-04T01:41:45.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 -- 172.21.15.40:0/1523061205 wait complete. 2023-11-04T01:41:45.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 Processor -- start 2023-11-04T01:41:45.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.682+0000 7fd5d81ef640 1 -- start start 2023-11-04T01:41:45.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 0x7fd5d00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5d00d0690 0x7fd5d00c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0ae0 0x7fd5d01e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01e5eb0 con 0x7fd5d00b4990 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01e6190 con 0x7fd5d00d0690 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01e6470 con 0x7fd5d00d0ae0 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 0x7fd5d00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 0x7fd5d00cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55984/0 (socket says 172.21.15.40:55984) 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 -- 172.21.15.40:0/2726933074 learned_addr learned my addr 172.21.15.40:0/2726933074 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d678c640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0ae0 0x7fd5d01e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d578a640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5d00d0690 0x7fd5d00c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 -- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0ae0 msgr2=0x7fd5d01e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0ae0 0x7fd5d01e9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 -- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5d00d0690 msgr2=0x7fd5d00c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5d00d0690 0x7fd5d00c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 -- 172.21.15.40:0/2726933074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8009b30 con 0x7fd5d00b4990 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d578a640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5d00d0690 0x7fd5d00c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d5f8b640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 0x7fd5d00cce30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c3c0 tx=0x7fd5cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0052d0 con 0x7fd5d00b4990 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc005430 con 0x7fd5d00b4990 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d01e6750 con 0x7fd5d00b4990 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc003840 con 0x7fd5d00b4990 2023-11-04T01:41:45.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d015b010 con 0x7fd5d00b4990 2023-11-04T01:41:45.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d00744a0 con 0x7fd5d00b4990 2023-11-04T01:41:45.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5cc0039a0 con 0x7fd5d00b4990 2023-11-04T01:41:45.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5c67fc640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd5b40664a0 0x7fd5b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd5cc083550 con 0x7fd5d00b4990 2023-11-04T01:41:45.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.686+0000 7fd5d578a640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd5b40664a0 0x7fd5b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.690+0000 7fd5d578a640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd5b40664a0 0x7fd5b4068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b1c80 tx=0x7fd5c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.690+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd5cc050830 con 0x7fd5d00b4990 2023-11-04T01:41:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.846+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d01e6c00 con 0x7fd5d00b4990 2023-11-04T01:41:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.850+0000 7fd5c67fc640 1 -- 172.21.15.40:0/2726933074 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fd5cc053e50 con 0x7fd5d00b4990 2023-11-04T01:41:45.856 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:45.856 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":50,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:39.896386+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.850+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd5b40664a0 msgr2=0x7fd5b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.850+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd5b40664a0 0x7fd5b4068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00b1c80 tx=0x7fd5c0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.850+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 msgr2=0x7fd5d00cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.850+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 0x7fd5d00cce30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c3c0 tx=0x7fd5cc00c880 comp rx=0 tx=0).stop 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.850+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 shutdown_connections 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd5b40664a0 0x7fd5b4068960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd5d00d0ae0 0x7fd5d01e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd5d00d0690 0x7fd5d00c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 --2- 172.21.15.40:0/2726933074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5d00b4990 0x7fd5d00cce30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 >> 172.21.15.40:0/2726933074 conn(0x7fd5d00cf990 msgr2=0x7fd5d00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 shutdown_connections 2023-11-04T01:41:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.854+0000 7fd5d81ef640 1 -- 172.21.15.40:0/2726933074 wait complete. 2023-11-04T01:41:45.876 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:41:45.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 Processor -- start 2023-11-04T01:41:45.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 -- start start 2023-11-04T01:41:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c0cb400 0x7f922c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f922c0cd6d0 0x7f922c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c0d0a60 con 0x7f922c15afb0 2023-11-04T01:41:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c15b390 con 0x7f922c0cd6d0 2023-11-04T01:41:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f92341c0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0d04a0 con 0x7f922c0cb400 2023-11-04T01:41:45.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f922c0cd6d0 0x7f922c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f922c0cd6d0 0x7f922c0cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55998/0 (socket says 172.21.15.40:55998) 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 -- 172.21.15.40:0/2658266564 learned_addr learned my addr 172.21.15.40:0/2658266564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923175b640 1 --2- 172.21.15.40:0/2658266564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c0cb400 0x7f922c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 -- 172.21.15.40:0/2658266564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c0cb400 msgr2=0x7f922c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 --2- 172.21.15.40:0/2658266564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c0cb400 0x7f922c0cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 -- 172.21.15.40:0/2658266564 >> v1:172.21.15.91:6789/0 conn(0x7f922c15afb0 legacy=0x7f922c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.990+0000 7f923275d640 1 -- 172.21.15.40:0/2658266564 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0d0780 con 0x7f922c0cd6d0 2023-11-04T01:41:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f923275d640 1 --2- 172.21.15.40:0/2658266564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cd6d0 0x7f922c0cdae0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9224009e50 tx=0x7f922401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f433020eb0f3b72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9230f5a640 1 -- 172.21.15.40:0/2658266564 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240a5640 con 0x7f922c0cd6d0 2023-11-04T01:41:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9230f5a640 1 -- 172.21.15.40:0/2658266564 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92240a57a0 con 0x7f922c0cd6d0 2023-11-04T01:41:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9230f5a640 1 -- 172.21.15.40:0/2658266564 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240a5b30 con 0x7f922c0cd6d0 2023-11-04T01:41:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- 172.21.15.40:0/2658266564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cd6d0 msgr2=0x7f922c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 --2- 172.21.15.40:0/2658266564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cd6d0 0x7f922c0cdae0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9224009e50 tx=0x7f922401c980 comp rx=0 tx=0).stop 2023-11-04T01:41:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- 172.21.15.40:0/2658266564 shutdown_connections 2023-11-04T01:41:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 --2- 172.21.15.40:0/2658266564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cd6d0 0x7f922c0cdae0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 --2- 172.21.15.40:0/2658266564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c0cb400 0x7f922c0cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- 172.21.15.40:0/2658266564 >> 172.21.15.40:0/2658266564 conn(0x7f922c065dc0 msgr2=0x7f922c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- 172.21.15.40:0/2658266564 shutdown_connections 2023-11-04T01:41:46.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- 172.21.15.40:0/2658266564 wait complete. 2023-11-04T01:41:46.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 Processor -- start 2023-11-04T01:41:46.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- start start 2023-11-04T01:41:46.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 0x7f922c0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f922c0cd6d0 0x7f922c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c15afb0 0x7f922c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0c52c0 con 0x7f922c0cb400 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0c8f20 con 0x7f922c0cd6d0 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f92341c0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0c9200 con 0x7f922c15afb0 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 0x7f922c0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 0x7f922c0c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56004/0 (socket says 172.21.15.40:56004) 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 -- 172.21.15.40:0/1082847273 learned_addr learned my addr 172.21.15.40:0/1082847273 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f923175b640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f922c0cd6d0 0x7f922c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f923275d640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c15afb0 0x7f922c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 -- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c15afb0 msgr2=0x7f922c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c15afb0 0x7f922c0c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 -- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f922c0cd6d0 msgr2=0x7f922c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f922c0cd6d0 0x7f922c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.994+0000 7f9231f5c640 1 -- 172.21.15.40:0/1082847273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224009b30 con 0x7f922c0cb400 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f9231f5c640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 0x7f922c0c7110 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f922800c530 tx=0x7f922800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228005220 con 0x7f922c0cb400 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9228005380 con 0x7f922c0cb400 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c0c7650 con 0x7f922c0cb400 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228007270 con 0x7f922c0cb400 2023-11-04T01:41:46.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c0c57b0 con 0x7f922c0cb400 2023-11-04T01:41:46.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c0675f0 con 0x7f922c0cb400 2023-11-04T01:41:46.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92280073d0 con 0x7f922c0cb400 2023-11-04T01:41:46.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92227fc640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92100664a0 0x7f9210068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f92280846a0 con 0x7f922c0cb400 2023-11-04T01:41:46.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f923175b640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92100664a0 0x7f9210068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:45.998+0000 7f923175b640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92100664a0 0x7f9210068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f922c152050 tx=0x7f921c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.002+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92280519f0 con 0x7f922c0cb400 2023-11-04T01:41:46.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.190+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f922c0b2c00 con 0x7f922c0cb400 2023-11-04T01:41:46.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92227fc640 1 -- 172.21.15.40:0/1082847273 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f9228055010 con 0x7f922c0cb400 2023-11-04T01:41:46.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:46.198 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:31.104506+0000","modified":"2023-11-04T01:41:34.118780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1760510907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1760510907},{"type":"v1","addr":"172.21.15.40:6835","nonce":1760510907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:46.199 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 23 2023-11-04T01:41:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92100664a0 msgr2=0x7f9210068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92100664a0 0x7f9210068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f922c152050 tx=0x7f921c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 msgr2=0x7f922c0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 0x7f922c0c7110 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f922800c530 tx=0x7f922800c9f0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 shutdown_connections 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92100664a0 0x7f9210068960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f922c15afb0 0x7f922c0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f922c0cd6d0 0x7f922c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 --2- 172.21.15.40:0/1082847273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f922c0cb400 0x7f922c0c7110 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 >> 172.21.15.40:0/1082847273 conn(0x7f922c065dc0 msgr2=0x7f922c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 shutdown_connections 2023-11-04T01:41:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.194+0000 7f92341c0640 1 -- 172.21.15.40:0/1082847273 wait complete. 2023-11-04T01:41:46.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.322+0000 7fa8aa295640 1 Processor -- start 2023-11-04T01:41:46.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.322+0000 7fa8aa295640 1 -- start start 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a40c2670 0x7fa8a40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8a40b0b70 0x7fa8a415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a406c740 con 0x7fa8a415b290 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40b0f80 con 0x7fa8a40c2670 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a415b670 con 0x7fa8a40b0b70 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a40c2670 0x7fa8a40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a40c2670 0x7fa8a40b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56012/0 (socket says 172.21.15.40:56012) 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 -- 172.21.15.40:0/3001649284 learned_addr learned my addr 172.21.15.40:0/3001649284 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a8832640 1 --2- 172.21.15.40:0/3001649284 >> v2:172.21.15.91:3300/0 conn(0x7fa8a40b0b70 0x7fa8a415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 -- 172.21.15.40:0/3001649284 >> v2:172.21.15.91:3300/0 conn(0x7fa8a40b0b70 msgr2=0x7fa8a415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 --2- 172.21.15.40:0/3001649284 >> v2:172.21.15.91:3300/0 conn(0x7fa8a40b0b70 0x7fa8a415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 -- 172.21.15.40:0/3001649284 >> v1:172.21.15.91:6789/0 conn(0x7fa8a415b290 legacy=0x7fa8a406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 -- 172.21.15.40:0/3001649284 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a406bb30 con 0x7fa8a40c2670 2023-11-04T01:41:46.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a8832640 1 --2- 172.21.15.40:0/3001649284 >> v2:172.21.15.91:3300/0 conn(0x7fa8a40b0b70 0x7fa8a415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:46.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a37fe640 1 --2- 172.21.15.40:0/3001649284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40c2670 0x7fa8a40b0630 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40ae5c0 tx=0x7fa89801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2da8ee0ca5a27f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a2ffd640 1 -- 172.21.15.40:0/3001649284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980ab600 con 0x7fa8a40c2670 2023-11-04T01:41:46.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a2ffd640 1 -- 172.21.15.40:0/3001649284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8980ab760 con 0x7fa8a40c2670 2023-11-04T01:41:46.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8a2ffd640 1 -- 172.21.15.40:0/3001649284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980abaf0 con 0x7fa8a40c2670 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- 172.21.15.40:0/3001649284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40c2670 msgr2=0x7fa8a40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 --2- 172.21.15.40:0/3001649284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40c2670 0x7fa8a40b0630 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40ae5c0 tx=0x7fa89801c400 comp rx=0 tx=0).stop 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- 172.21.15.40:0/3001649284 shutdown_connections 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 --2- 172.21.15.40:0/3001649284 >> v2:172.21.15.91:3300/0 conn(0x7fa8a40b0b70 0x7fa8a415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 --2- 172.21.15.40:0/3001649284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40c2670 0x7fa8a40b0630 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- 172.21.15.40:0/3001649284 >> 172.21.15.40:0/3001649284 conn(0x7fa8a40cebb0 msgr2=0x7fa8a40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- 172.21.15.40:0/3001649284 shutdown_connections 2023-11-04T01:41:46.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.326+0000 7fa8aa295640 1 -- 172.21.15.40:0/3001649284 wait complete. 2023-11-04T01:41:46.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 Processor -- start 2023-11-04T01:41:46.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- start start 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 0x7fa8a4154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8a40c2670 0x7fa8a4152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8a415b290 0x7fa8a415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a41552c0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4155540 con 0x7fa8a415b290 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4155820 con 0x7fa8a40c2670 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 0x7fa8a4154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 0x7fa8a4154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56024/0 (socket says 172.21.15.40:56024) 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 -- 172.21.15.40:0/185746238 learned_addr learned my addr 172.21.15.40:0/185746238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a8832640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8a415b290 0x7fa8a415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 -- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8a40c2670 msgr2=0x7fa8a4152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a37fe640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8a40c2670 0x7fa8a4152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8a40c2670 0x7fa8a4152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 -- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8a415b290 msgr2=0x7fa8a415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8a415b290 0x7fa8a415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 -- 172.21.15.40:0/185746238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8980094d0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a8832640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8a415b290 0x7fa8a415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a3fff640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 0x7fa8a4154d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa89400c450 tx=0x7fa89400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894012830 con 0x7fa8a40b0b70 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8940129b0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4155b00 con 0x7fa8a40b0b70 2023-11-04T01:41:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894012d60 con 0x7fa8a40b0b70 2023-11-04T01:41:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a415de40 con 0x7fa8a40b0b70 2023-11-04T01:41:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.330+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a415d9c0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.334+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa89401c460 con 0x7fa8a40b0b70 2023-11-04T01:41:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.334+0000 7fa8a0ff9640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8900664a0 0x7fa890068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.334+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa894083df0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.334+0000 7fa8a37fe640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8900664a0 0x7fa890068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.334+0000 7fa8a37fe640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8900664a0 0x7fa890068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa8980af000 tx=0x7fa898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.338+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8a415d9c0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.518+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8a415d9c0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.518+0000 7fa8a0ff9640 1 -- 172.21.15.40:0/185746238 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fa8a415d9c0 con 0x7fa8a40b0b70 2023-11-04T01:41:46.524 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:46.524 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:31.104506+0000","modified":"2023-11-04T01:41:34.118780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5727},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5727":{"gid":5727,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/1760510907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1760510907},{"type":"v1","addr":"172.21.15.40:6835","nonce":1760510907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:46.525 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 23 2023-11-04T01:41:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8900664a0 msgr2=0x7fa890068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8900664a0 0x7fa890068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa8980af000 tx=0x7fa898008040 comp rx=0 tx=0).stop 2023-11-04T01:41:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 msgr2=0x7fa8a4154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 0x7fa8a4154d80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa89400c450 tx=0x7fa89400c910 comp rx=0 tx=0).stop 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 shutdown_connections 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8900664a0 0x7fa890068960 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8a415b290 0x7fa8a415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8a40c2670 0x7fa8a4152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 --2- 172.21.15.40:0/185746238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a40b0b70 0x7fa8a4154d80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 >> 172.21.15.40:0/185746238 conn(0x7fa8a40cebb0 msgr2=0x7fa8a41542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 shutdown_connections 2023-11-04T01:41:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.522+0000 7fa8aa295640 1 -- 172.21.15.40:0/185746238 wait complete. 2023-11-04T01:41:46.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:46.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 Processor -- start 2023-11-04T01:41:46.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 -- start start 2023-11-04T01:41:46.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 0x7f17400ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f174006cd30 0x7f17400ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1740070d90 con 0x7f17400caf10 2023-11-04T01:41:46.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174006dd90 con 0x7f1740159e70 2023-11-04T01:41:46.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f17477fc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400cefe0 con 0x7f174006cd30 2023-11-04T01:41:46.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1745598640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 0x7f17400ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1744d97640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f174006cd30 0x7f17400ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1745d99640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f17400caf10 0x7f17400b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:54332/0 (socket says 172.21.15.40:54332) 2023-11-04T01:41:46.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1745598640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 0x7f17400ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:48096/0 (socket says 172.21.15.40:48096) 2023-11-04T01:41:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1745d99640 1 -- 172.21.15.40:0/3944701321 learned_addr learned my addr 172.21.15.40:0/3944701321 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1744d97640 1 -- 172.21.15.40:0/3944701321 >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 msgr2=0x7f17400ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1744d97640 1 --2- 172.21.15.40:0/3944701321 >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 0x7f17400ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1744d97640 1 -- 172.21.15.40:0/3944701321 >> v1:172.21.15.91:6789/0 conn(0x7f17400caf10 legacy=0x7f17400b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1744d97640 1 -- 172.21.15.40:0/3944701321 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174006d4f0 con 0x7f174006cd30 2023-11-04T01:41:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.658+0000 7f1745598640 1 --2- 172.21.15.40:0/3944701321 >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 0x7f17400ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:46.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f1744d97640 1 --2- 172.21.15.40:0/3944701321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f174006cd30 0x7f17400ca9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17300097c0 tx=0x7f173001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2381a4739adf9c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f1737fff640 1 -- 172.21.15.40:0/3944701321 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300ab650 con 0x7f174006cd30 2023-11-04T01:41:46.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f1737fff640 1 -- 172.21.15.40:0/3944701321 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17300ab7b0 con 0x7f174006cd30 2023-11-04T01:41:46.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f1737fff640 1 -- 172.21.15.40:0/3944701321 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300abb40 con 0x7f174006cd30 2023-11-04T01:41:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 -- 172.21.15.40:0/3944701321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f174006cd30 msgr2=0x7f17400ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 --2- 172.21.15.40:0/3944701321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f174006cd30 0x7f17400ca9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17300097c0 tx=0x7f173001c450 comp rx=0 tx=0).stop 2023-11-04T01:41:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 -- 172.21.15.40:0/3944701321 shutdown_connections 2023-11-04T01:41:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 --2- 172.21.15.40:0/3944701321 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f174006cd30 0x7f17400ca9d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 --2- 172.21.15.40:0/3944701321 >> v2:172.21.15.91:3300/0 conn(0x7f1740159e70 0x7f17400ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 -- 172.21.15.40:0/3944701321 >> 172.21.15.40:0/3944701321 conn(0x7f174006e760 msgr2=0x7f174006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 -- 172.21.15.40:0/3944701321 shutdown_connections 2023-11-04T01:41:46.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 -- 172.21.15.40:0/3944701321 wait complete. 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 Processor -- start 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.662+0000 7f17477fc640 1 -- start start 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f174006cd30 0x7f17401581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 0x7f174006b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1740159e70 0x7f17400cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174006bc00 con 0x7f17400caf10 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17401629c0 con 0x7f174006cd30 2023-11-04T01:41:46.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1740162c60 con 0x7f1740159e70 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 0x7f174006b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 0x7f174006b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56028/0 (socket says 172.21.15.40:56028) 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 -- 172.21.15.40:0/2852160946 learned_addr learned my addr 172.21.15.40:0/2852160946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1745d99640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1740159e70 0x7f17400cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1745598640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f174006cd30 0x7f17401581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 -- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1740159e70 msgr2=0x7f17400cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1740159e70 0x7f17400cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 -- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f174006cd30 msgr2=0x7f17401581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f174006cd30 0x7f17401581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 -- 172.21.15.40:0/2852160946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009420 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1745598640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f174006cd30 0x7f17401581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1744d97640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 0x7f174006b290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f17300ad040 tx=0x7f173001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300bf610 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1730009420 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17300bf770 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300bfae0 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17401631e0 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17400675f0 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17300bfc40 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1735ffb640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17240664a0 0x7f1724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f173011ee90 con 0x7f17400caf10 2023-11-04T01:41:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.666+0000 7f1745598640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17240664a0 0x7f1724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.670+0000 7f1745598640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17240664a0 0x7f1724068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f17401627b0 tx=0x7f173c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.670+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17300ec180 con 0x7f17400caf10 2023-11-04T01:41:46.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.834+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1740163c40 con 0x7f17400caf10 2023-11-04T01:41:46.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.834+0000 7f1735ffb640 1 -- 172.21.15.40:0/2852160946 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f17300ef7a0 con 0x7f17400caf10 2023-11-04T01:41:46.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:46.841 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":50,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:39.896386+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:29.698144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:30.083422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17240664a0 msgr2=0x7f1724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17240664a0 0x7f1724068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f17401627b0 tx=0x7f173c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 msgr2=0x7f174006b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 0x7f174006b290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f17300ad040 tx=0x7f173001ac90 comp rx=0 tx=0).stop 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 shutdown_connections 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17240664a0 0x7f1724068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1740159e70 0x7f17400cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17400caf10 0x7f174006b290 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 --2- 172.21.15.40:0/2852160946 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f174006cd30 0x7f17401581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 >> 172.21.15.40:0/2852160946 conn(0x7f174006e760 msgr2=0x7f174015c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 shutdown_connections 2023-11-04T01:41:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.838+0000 7f17477fc640 1 -- 172.21.15.40:0/2852160946 wait complete. 2023-11-04T01:41:46.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:41:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 Processor -- start 2023-11-04T01:41:46.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 -- start start 2023-11-04T01:41:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8415afd0 0x7f0f840715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f840b0d40 0x7f0f8415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840c2670 con 0x7f0f8406f8f0 2023-11-04T01:41:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84070140 con 0x7f0f840b0d40 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f894ff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8406c9f0 con 0x7f0f8415afd0 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f840b0d40 0x7f0f8415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f840b0d40 0x7f0f8415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56034/0 (socket says 172.21.15.40:56034) 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 -- 172.21.15.40:0/1761316185 learned_addr learned my addr 172.21.15.40:0/1761316185 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f82ffd640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8415afd0 0x7f0f840715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 -- 172.21.15.40:0/1761316185 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8415afd0 msgr2=0x7f0f840715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8415afd0 0x7f0f840715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 -- 172.21.15.40:0/1761316185 >> v1:172.21.15.91:6789/0 conn(0x7f0f8406f8f0 legacy=0x7f0f840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f837fe640 1 -- 172.21.15.40:0/1761316185 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8406bc30 con 0x7f0f840b0d40 2023-11-04T01:41:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.974+0000 7f0f82ffd640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8415afd0 0x7f0f840715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f837fe640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f8415ec80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009e80 tx=0x7f0f7c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f694d3716f3c0260 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f81ffb640 1 -- 172.21.15.40:0/1761316185 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0a5880 con 0x7f0f840b0d40 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f81ffb640 1 -- 172.21.15.40:0/1761316185 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c0a59e0 con 0x7f0f840b0d40 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f81ffb640 1 -- 172.21.15.40:0/1761316185 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0a5d70 con 0x7f0f840b0d40 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/1761316185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 msgr2=0x7f0f8415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f8415ec80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009e80 tx=0x7f0f7c01c9c0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/1761316185 shutdown_connections 2023-11-04T01:41:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f8415ec80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 --2- 172.21.15.40:0/1761316185 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8415afd0 0x7f0f840715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/1761316185 >> 172.21.15.40:0/1761316185 conn(0x7f0f840cebb0 msgr2=0x7f0f840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/1761316185 shutdown_connections 2023-11-04T01:41:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/1761316185 wait complete. 2023-11-04T01:41:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 Processor -- start 2023-11-04T01:41:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- start start 2023-11-04T01:41:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8406f8f0 0x7f0f840b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f84152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f8415afd0 0x7f0f840c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840b1900 con 0x7f0f840b0d40 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840b4680 con 0x7f0f8415afd0 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840c7ff0 con 0x7f0f8406f8f0 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f84152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f84152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56040/0 (socket says 172.21.15.40:56040) 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 -- 172.21.15.40:0/4028200950 learned_addr learned my addr 172.21.15.40:0/4028200950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f837fe640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f8415afd0 0x7f0f840c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f82ffd640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8406f8f0 0x7f0f840b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 -- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8406f8f0 msgr2=0x7f0f840b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8406f8f0 0x7f0f840b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 -- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f8415afd0 msgr2=0x7f0f840c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f8415afd0 0x7f0f840c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 -- 172.21.15.40:0/4028200950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c009b30 con 0x7f0f840b0d40 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f837fe640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f8415afd0 0x7f0f840c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f82ffd640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8406f8f0 0x7f0f840b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f827fc640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f84152f30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c500 tx=0x7f0f7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78005220 con 0x7f0f840b0d40 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78005380 con 0x7f0f840b0d40 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f84153470 con 0x7f0f840b0d40 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78007270 con 0x7f0f840b0d40 2023-11-04T01:41:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.978+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f840c8520 con 0x7f0f840b0d40 2023-11-04T01:41:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.982+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f840744a0 con 0x7f0f840b0d40 2023-11-04T01:41:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.982+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f780073d0 con 0x7f0f840b0d40 2023-11-04T01:41:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.982+0000 7f0f6b7fe640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f700664a0 0x7f0f70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.982+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0f78083600 con 0x7f0f840b0d40 2023-11-04T01:41:46.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.982+0000 7f0f82ffd640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f700664a0 0x7f0f70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.982+0000 7f0f82ffd640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f700664a0 0x7f0f70068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f840c4a70 tx=0x7f0f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:46.986+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f780508f0 con 0x7f0f840b0d40 2023-11-04T01:41:47.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.166+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0f8406cba0 con 0x7f0f840b0d40 2023-11-04T01:41:47.174 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:41:47.170+0000 7fde30135640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:41:47.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.170+0000 7f0f6b7fe640 1 -- 172.21.15.40:0/4028200950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0f78053f10 con 0x7f0f840b0d40 2023-11-04T01:41:47.177 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:41:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f700664a0 msgr2=0x7f0f70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f700664a0 0x7f0f70068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f840c4a70 tx=0x7f0f74008040 comp rx=0 tx=0).stop 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 msgr2=0x7f0f84152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f84152f30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c500 tx=0x7f0f7800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 shutdown_connections 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f700664a0 0x7f0f70068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f8415afd0 0x7f0f840c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840b0d40 0x7f0f84152f30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 --2- 172.21.15.40:0/4028200950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f8406f8f0 0x7f0f840b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 >> 172.21.15.40:0/4028200950 conn(0x7f0f840cebb0 msgr2=0x7f0f840cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 shutdown_connections 2023-11-04T01:41:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.174+0000 7f0f894ff640 1 -- 172.21.15.40:0/4028200950 wait complete. 2023-11-04T01:41:47.181 INFO:tasks.ceph.mds.c.smithi040.stderr: -698> 2023-11-04T01:41:33.691+0000 7f35bda40640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:47.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:41:47.206 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:41:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 Processor -- start 2023-11-04T01:41:47.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 -- start start 2023-11-04T01:41:47.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f976c0ce1b0 0x7f976c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f976c06d160 0x7f976c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c15e800 con 0x7f976c15af70 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c071200 con 0x7f976c06d160 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f97716e6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c06c0c0 con 0x7f976c0ce1b0 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f976c15af70 0x7f976c0cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57236/0 (socket says 172.21.15.40:57236) 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976affd640 1 -- 172.21.15.40:0/948783656 learned_addr learned my addr 172.21.15.40:0/948783656 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976b7fe640 1 --2- 172.21.15.40:0/948783656 >> v2:172.21.15.40:3300/0 conn(0x7f976c06d160 0x7f976c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976a7fc640 1 --2- 172.21.15.40:0/948783656 >> v2:172.21.15.91:3300/0 conn(0x7f976c0ce1b0 0x7f976c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976b7fe640 1 -- 172.21.15.40:0/948783656 >> v2:172.21.15.91:3300/0 conn(0x7f976c0ce1b0 msgr2=0x7f976c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976b7fe640 1 --2- 172.21.15.40:0/948783656 >> v2:172.21.15.91:3300/0 conn(0x7f976c0ce1b0 0x7f976c15dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976b7fe640 1 -- 172.21.15.40:0/948783656 >> v1:172.21.15.40:6789/0 conn(0x7f976c15af70 legacy=0x7f976c0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f976b7fe640 1 -- 172.21.15.40:0/948783656 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c06c3a0 con 0x7f976c06d160 2023-11-04T01:41:47.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.302+0000 7f9769ffb640 1 -- 172.21.15.40:0/948783656 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723104557 0 0) 0x7f976c15e800 con 0x7f976c15af70 2023-11-04T01:41:47.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f976b7fe640 1 --2- 172.21.15.40:0/948783656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c15e2c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f976c0cfb90 tx=0x7f976401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1ec7a24b0e4c68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f9769ffb640 1 -- 172.21.15.40:0/948783656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640a58c0 con 0x7f976c06d160 2023-11-04T01:41:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f9769ffb640 1 -- 172.21.15.40:0/948783656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640a5a20 con 0x7f976c06d160 2023-11-04T01:41:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f9769ffb640 1 -- 172.21.15.40:0/948783656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640a5db0 con 0x7f976c06d160 2023-11-04T01:41:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 -- 172.21.15.40:0/948783656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 msgr2=0x7f976c15e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 --2- 172.21.15.40:0/948783656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c15e2c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f976c0cfb90 tx=0x7f976401c910 comp rx=0 tx=0).stop 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 -- 172.21.15.40:0/948783656 shutdown_connections 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 --2- 172.21.15.40:0/948783656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c15e2c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 --2- 172.21.15.40:0/948783656 >> v2:172.21.15.91:3300/0 conn(0x7f976c0ce1b0 0x7f976c15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 -- 172.21.15.40:0/948783656 >> 172.21.15.40:0/948783656 conn(0x7f976c0cb510 msgr2=0x7f976c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 -- 172.21.15.40:0/948783656 shutdown_connections 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 -- 172.21.15.40:0/948783656 wait complete. 2023-11-04T01:41:47.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 Processor -- start 2023-11-04T01:41:47.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.306+0000 7f97716e6640 1 -- start start 2023-11-04T01:41:47.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f976c0ce1b0 0x7f976c14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f976c15af70 0x7f976c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1579e0 con 0x7f976c06d160 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c157700 con 0x7f976c15af70 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1558e0 con 0x7f976c0ce1b0 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c1563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60324/0 (socket says 172.21.15.40:60324) 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 -- 172.21.15.40:0/3905082205 learned_addr learned my addr 172.21.15.40:0/3905082205 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976b7fe640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f976c15af70 0x7f976c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 -- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f976c0ce1b0 msgr2=0x7f976c14f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f976c0ce1b0 0x7f976c14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 -- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f976c15af70 msgr2=0x7f976c15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f976c15af70 0x7f976c15bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 -- 172.21.15.40:0/3905082205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764009a70 con 0x7f976c06d160 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976b7fe640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f976c15af70 0x7f976c15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976affd640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c1563c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f975c007fd0 tx=0x7f975c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c005cf0 con 0x7f976c06d160 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c005e50 con 0x7f976c06d160 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c155bc0 con 0x7f976c06d160 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c007310 con 0x7f976c06d160 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c14fa20 con 0x7f976c06d160 2023-11-04T01:41:47.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c155740 con 0x7f976c06d160 2023-11-04T01:41:47.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f975c007470 con 0x7f976c06d160 2023-11-04T01:41:47.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97537fe640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97580664a0 0x7f9758068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f975c0836b0 con 0x7f976c06d160 2023-11-04T01:41:47.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.310+0000 7f976a7fc640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97580664a0 0x7f9758068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.314+0000 7f976a7fc640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97580664a0 0x7f9758068960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f976c1f7280 tx=0x7f9760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.314+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f976c155740 con 0x7f976c06d160 2023-11-04T01:41:47.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:47.498+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f976c155740 con 0x7f976c06d160 2023-11-04T01:41:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.186+0000 7f97537fe640 1 -- 172.21.15.40:0/3905082205 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f976c155740 con 0x7f976c06d160 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97580664a0 msgr2=0x7f9758068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97580664a0 0x7f9758068960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f976c1f7280 tx=0x7f9760008040 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 msgr2=0x7f976c1563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c1563c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f975c007fd0 tx=0x7f975c00c8e0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 shutdown_connections 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97580664a0 0x7f9758068960 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f976c15af70 0x7f976c15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f976c0ce1b0 0x7f976c14f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 --2- 172.21.15.40:0/3905082205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c06d160 0x7f976c1563c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 >> 172.21.15.40:0/3905082205 conn(0x7f976c0cb510 msgr2=0x7f976c0cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 shutdown_connections 2023-11-04T01:41:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.190+0000 7f97716e6640 1 -- 172.21.15.40:0/3905082205 wait complete. 2023-11-04T01:41:48.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:41:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb6aec4640 1 Processor -- start 2023-11-04T01:41:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb6aec4640 1 -- start start 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb6aec4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdb64159e00 0x7fdb640ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb6aec4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6415d9d0 con 0x7fdb64070180 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb6aec4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6415dcb0 con 0x7fdb640cb830 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb6aec4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6415e650 con 0x7fdb64159e00 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb63fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdb64070180 0x7fdb640cb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57252/0 (socket says 172.21.15.40:57252) 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.382+0000 7fdb63fff640 1 -- 172.21.15.40:0/613234173 learned_addr learned my addr 172.21.15.40:0/613234173 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb68c60640 1 --2- 172.21.15.40:0/613234173 >> v2:172.21.15.91:3300/0 conn(0x7fdb64159e00 0x7fdb640ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065451986 0 0) 0x7fdb6415d9d0 con 0x7fdb64070180 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb50005740 con 0x7fdb64070180 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2987413149 0 0) 0x7fdb50005740 con 0x7fdb64070180 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 >> v2:172.21.15.91:3300/0 conn(0x7fdb64159e00 msgr2=0x7fdb640ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 --2- 172.21.15.40:0/613234173 >> v2:172.21.15.91:3300/0 conn(0x7fdb64159e00 0x7fdb640ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 >> v1:172.21.15.91:6789/0 conn(0x7fdb640cb830 legacy=0x7fdb640ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6415df90 con 0x7fdb64070180 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fdb4c001680 con 0x7fdb64070180 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 >> v1:172.21.15.40:6789/0 conn(0x7fdb64070180 legacy=0x7fdb640cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb50005b90 0x7fdb50005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500069e0 0x7fdb50006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb500073a0 0x7fdb5000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6415e650 con 0x7fdb500073a0 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5000e340 con 0x7fdb500069e0 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5000e500 con 0x7fdb50005b90 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb500073a0 0x7fdb5000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb63fff640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500069e0 0x7fdb50006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 -- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb50005b90 msgr2=0x7fdb50005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb68c60640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb50005b90 0x7fdb50005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb50005b90 0x7fdb50005fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 -- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500069e0 msgr2=0x7fdb50006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500069e0 0x7fdb50006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 -- 172.21.15.40:0/613234173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50005740 con 0x7fdb500073a0 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 -- 172.21.15.40:0/613234173 reap_dead start 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb69461640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb500073a0 0x7fdb5000dba0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c001e70 tx=0x7fdb5c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec82b1fdbedff083 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c003b80 con 0x7fdb500073a0 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c003d20 con 0x7fdb500073a0 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb637fe640 1 -- 172.21.15.40:0/613234173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c005310 con 0x7fdb500073a0 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb6aec4640 1 -- 172.21.15.40:0/613234173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb500073a0 msgr2=0x7fdb5000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb500073a0 0x7fdb5000dba0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c001e70 tx=0x7fdb5c01c760 comp rx=0 tx=0).stop 2023-11-04T01:41:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb6aec4640 1 -- 172.21.15.40:0/613234173 shutdown_connections 2023-11-04T01:41:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/613234173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb500073a0 0x7fdb5000dba0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb6aec4640 1 -- 172.21.15.40:0/613234173 >> 172.21.15.40:0/613234173 conn(0x7fdb640b0630 msgr2=0x7fdb640b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.386+0000 7fdb6aec4640 1 -- 172.21.15.40:0/613234173 shutdown_connections 2023-11-04T01:41:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- 172.21.15.40:0/613234173 wait complete. 2023-11-04T01:41:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 Processor -- start 2023-11-04T01:41:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- start start 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500073a0 0x7fdb6415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 0x7fdb640c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb64154040 0x7fdb6415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640c49c0 con 0x7fdb640c35a0 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640c5390 con 0x7fdb500073a0 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640c3db0 con 0x7fdb64154040 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 0x7fdb640c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 0x7fdb640c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60338/0 (socket says 172.21.15.40:60338) 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 -- 172.21.15.40:0/2919416192 learned_addr learned my addr 172.21.15.40:0/2919416192 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb69461640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb64154040 0x7fdb6415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb68c60640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500073a0 0x7fdb6415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 -- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb64154040 msgr2=0x7fdb6415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb64154040 0x7fdb6415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 -- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500073a0 msgr2=0x7fdb6415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500073a0 0x7fdb6415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 -- 172.21.15.40:0/2919416192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640c4090 con 0x7fdb640c35a0 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb69461640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb64154040 0x7fdb6415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb63fff640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 0x7fdb640c4e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c011840 tx=0x7fdb4c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00fb60 con 0x7fdb640c35a0 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00fd20 con 0x7fdb640c35a0 2023-11-04T01:41:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb640c4370 con 0x7fdb640c35a0 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c015650 con 0x7fdb640c35a0 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640c3a20 con 0x7fdb640c35a0 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.390+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb640c4b30 con 0x7fdb640c35a0 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.394+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb4c0157b0 con 0x7fdb640c35a0 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.394+0000 7fdb617fa640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdb440664a0 0x7fdb44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.394+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fdb4c0872e0 con 0x7fdb640c35a0 2023-11-04T01:41:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.394+0000 7fdb68c60640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdb440664a0 0x7fdb44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.394+0000 7fdb68c60640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdb440664a0 0x7fdb44068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009930 tx=0x7fdb54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.398+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb4c054570 con 0x7fdb640c35a0 2023-11-04T01:41:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:48.554+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb640744a0 con 0x7fdb640c35a0 2023-11-04T01:41:49.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.190+0000 7fdb617fa640 1 -- 172.21.15.40:0/2919416192 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdb4c057b90 con 0x7fdb640c35a0 2023-11-04T01:41:49.194 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdb440664a0 msgr2=0x7fdb44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdb440664a0 0x7fdb44068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009930 tx=0x7fdb54008040 comp rx=0 tx=0).stop 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 msgr2=0x7fdb640c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 0x7fdb640c4e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c011840 tx=0x7fdb4c011c40 comp rx=0 tx=0).stop 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 shutdown_connections 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdb440664a0 0x7fdb44068960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdb64154040 0x7fdb6415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb640c35a0 0x7fdb640c4e50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 --2- 172.21.15.40:0/2919416192 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb500073a0 0x7fdb6415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 >> 172.21.15.40:0/2919416192 conn(0x7fdb640b0630 msgr2=0x7fdb640ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 shutdown_connections 2023-11-04T01:41:49.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.194+0000 7fdb6aec4640 1 -- 172.21.15.40:0/2919416192 wait complete. 2023-11-04T01:41:49.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:41:49.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.366+0000 7ff3ae92d640 1 Processor -- start 2023-11-04T01:41:49.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.366+0000 7ff3ae92d640 1 -- start start 2023-11-04T01:41:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3ae92d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3a815ba20 0x7ff3a815be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3ae92d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a815ee60 con 0x7ff3a806a870 2023-11-04T01:41:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3ae92d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a815f140 con 0x7ff3a815e980 2023-11-04T01:41:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3ae92d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815c350 con 0x7ff3a815ba20 2023-11-04T01:41:49.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3aceca640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3a806a870 0x7ff3a8140990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57268/0 (socket says 172.21.15.40:57268) 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3aceca640 1 -- 172.21.15.40:0/3743037707 learned_addr learned my addr 172.21.15.40:0/3743037707 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a7fff640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3a815ba20 0x7ff3a815be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472793941 0 0) 0x7ff3a815ee60 con 0x7ff3a806a870 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff390003530 con 0x7ff3a806a870 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1538680170 0 0) 0x7ff390003530 con 0x7ff3a806a870 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3a815ba20 msgr2=0x7ff3a815be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3a815ba20 0x7ff3a815be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 >> v1:172.21.15.91:6789/0 conn(0x7ff3a815e980 legacy=0x7ff3a806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a815f420 con 0x7ff3a806a870 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff3a0001a00 con 0x7ff3a806a870 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 >> v1:172.21.15.40:6789/0 conn(0x7ff3a806a870 legacy=0x7ff3a8140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3900039b0 0x7ff390003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3900047d0 0x7ff390004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff390005190 0x7ff39000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815c350 con 0x7ff3900047d0 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39000bed0 con 0x7ff3900039b0 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39000c010 con 0x7ff390005190 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a77fe640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3900047d0 0x7ff390004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a7fff640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3900039b0 0x7ff390003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3aceca640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff390005190 0x7ff39000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a77fe640 1 -- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff390005190 msgr2=0x7ff39000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a77fe640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff390005190 0x7ff39000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a77fe640 1 -- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3900039b0 msgr2=0x7ff390003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a77fe640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3900039b0 0x7ff390003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.370+0000 7ff3a77fe640 1 -- 172.21.15.40:0/3743037707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390003530 con 0x7ff3900047d0 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3a77fe640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3900047d0 0x7ff390004c50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0017b0 tx=0x7ff39c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3516d91209afaef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0a4ea0 con 0x7ff3900047d0 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c0a7050 con 0x7ff3900047d0 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3a6ffd640 1 -- 172.21.15.40:0/3743037707 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c003600 con 0x7ff3900047d0 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- 172.21.15.40:0/3743037707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3900047d0 msgr2=0x7ff390004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/3743037707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3900047d0 0x7ff390004c50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0017b0 tx=0x7ff39c01c3e0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3aceca640 1 -- 172.21.15.40:0/3743037707 reap_dead start 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- 172.21.15.40:0/3743037707 shutdown_connections 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- 172.21.15.40:0/3743037707 >> 172.21.15.40:0/3743037707 conn(0x7ff3a80b18e0 msgr2=0x7ff3a80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- 172.21.15.40:0/3743037707 shutdown_connections 2023-11-04T01:41:49.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- 172.21.15.40:0/3743037707 wait complete. 2023-11-04T01:41:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 Processor -- start 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- start start 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3900047d0 0x7ff3a813b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a80b29d0 0x7ff3a80b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 0x7ff3a815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a815e800 con 0x7ff3a815c4d0 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80b3390 con 0x7ff3a80b29d0 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3ae92d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a813bb90 con 0x7ff3900047d0 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3aceca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 0x7ff3a815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3aceca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 0x7ff3a815c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60360/0 (socket says 172.21.15.40:60360) 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.374+0000 7ff3aceca640 1 -- 172.21.15.40:0/1065599049 learned_addr learned my addr 172.21.15.40:0/1065599049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a77fe640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a80b29d0 0x7ff3a80b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a7fff640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3900047d0 0x7ff3a813b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3aceca640 1 -- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3900047d0 msgr2=0x7ff3a813b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3aceca640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3900047d0 0x7ff3a813b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3aceca640 1 -- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a80b29d0 msgr2=0x7ff3a80b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3aceca640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a80b29d0 0x7ff3a80b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3aceca640 1 -- 172.21.15.40:0/1065599049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a815e1c0 con 0x7ff3a815c4d0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3aceca640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 0x7ff3a815c950 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0001340 tx=0x7ff3a0011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000f920 con 0x7ff3a815c4d0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a000faa0 con 0x7ff3a815c4d0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a815ce90 con 0x7ff3a815c4d0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000fe50 con 0x7ff3a815c4d0 2023-11-04T01:41:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a815d400 con 0x7ff3a815c4d0 2023-11-04T01:41:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a80675f0 con 0x7ff3a815c4d0 2023-11-04T01:41:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3a001f460 con 0x7ff3a815c4d0 2023-11-04T01:41:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a4ff9640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3940664a0 0x7ff394068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5768+0+0 (secure 0 0 0) 0x7ff3a0086f50 con 0x7ff3a815c4d0 2023-11-04T01:41:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a7fff640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3940664a0 0x7ff394068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.378+0000 7ff3a7fff640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3940664a0 0x7ff394068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff398009b20 tx=0x7ff398008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.382+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3a0054390 con 0x7ff3a815c4d0 2023-11-04T01:41:49.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:49.542+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff3a806f2f0 con 0x7ff3a815c4d0 2023-11-04T01:41:50.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.190+0000 7ff3a4ff9640 1 -- 172.21.15.40:0/1065599049 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff3a00579b0 con 0x7ff3a815c4d0 2023-11-04T01:41:50.196 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3940664a0 msgr2=0x7ff394068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3940664a0 0x7ff394068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff398009b20 tx=0x7ff398008040 comp rx=0 tx=0).stop 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 msgr2=0x7ff3a815c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 0x7ff3a815c950 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0001340 tx=0x7ff3a0011ca0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 shutdown_connections 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3940664a0 0x7ff394068960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a815c4d0 0x7ff3a815c950 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a80b29d0 0x7ff3a80b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 --2- 172.21.15.40:0/1065599049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3900047d0 0x7ff3a813b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 >> 172.21.15.40:0/1065599049 conn(0x7ff3a80b18e0 msgr2=0x7ff3a813ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 shutdown_connections 2023-11-04T01:41:50.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.194+0000 7ff3ae92d640 1 -- 172.21.15.40:0/1065599049 wait complete. 2023-11-04T01:41:50.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:41:50.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.342+0000 7ffb84663640 1 Processor -- start 2023-11-04T01:41:50.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.342+0000 7ffb84663640 1 -- start start 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb84663640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffb7c06b980 0x7ffb7c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb84663640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb7c0ca490 0x7ffb7c0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb84663640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0cb210 con 0x7ffb7c159bf0 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb84663640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c15b390 con 0x7ffb7c0ca490 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb84663640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c15a5d0 con 0x7ffb7c06b980 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb823ff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffb7c159bf0 0x7ffb7c06b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57282/0 (socket says 172.21.15.40:57282) 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb823ff640 1 -- 172.21.15.40:0/3284551372 learned_addr learned my addr 172.21.15.40:0/3284551372 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb82c00640 1 --2- 172.21.15.40:0/3284551372 >> v2:172.21.15.40:3300/0 conn(0x7ffb7c0ca490 0x7ffb7c0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb81bfe640 1 --2- 172.21.15.40:0/3284551372 >> v2:172.21.15.91:3300/0 conn(0x7ffb7c06b980 0x7ffb7c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb813fd640 1 -- 172.21.15.40:0/3284551372 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328664848 0 0) 0x7ffb7c0cb210 con 0x7ffb7c159bf0 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb813fd640 1 -- 172.21.15.40:0/3284551372 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb68005740 con 0x7ffb7c159bf0 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb82c00640 1 -- 172.21.15.40:0/3284551372 >> v2:172.21.15.91:3300/0 conn(0x7ffb7c06b980 msgr2=0x7ffb7c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb82c00640 1 --2- 172.21.15.40:0/3284551372 >> v2:172.21.15.91:3300/0 conn(0x7ffb7c06b980 0x7ffb7c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb82c00640 1 -- 172.21.15.40:0/3284551372 >> v1:172.21.15.40:6789/0 conn(0x7ffb7c159bf0 legacy=0x7ffb7c06b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb82c00640 1 -- 172.21.15.40:0/3284551372 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c15a8b0 con 0x7ffb7c0ca490 2023-11-04T01:41:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb81bfe640 1 --2- 172.21.15.40:0/3284551372 >> v2:172.21.15.91:3300/0 conn(0x7ffb7c06b980 0x7ffb7c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb82c00640 1 --2- 172.21.15.40:0/3284551372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c0ca490 0x7ffb7c0ca870 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0ae650 tx=0x7ffb7401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5764017f6ffa38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb813fd640 1 -- 172.21.15.40:0/3284551372 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740a58a0 con 0x7ffb7c0ca490 2023-11-04T01:41:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb813fd640 1 -- 172.21.15.40:0/3284551372 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740a5a00 con 0x7ffb7c0ca490 2023-11-04T01:41:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.346+0000 7ffb813fd640 1 -- 172.21.15.40:0/3284551372 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740a5d90 con 0x7ffb7c0ca490 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/3284551372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c0ca490 msgr2=0x7ffb7c0ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 --2- 172.21.15.40:0/3284551372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c0ca490 0x7ffb7c0ca870 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0ae650 tx=0x7ffb7401c8e0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/3284551372 shutdown_connections 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 --2- 172.21.15.40:0/3284551372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c0ca490 0x7ffb7c0ca870 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 --2- 172.21.15.40:0/3284551372 >> v2:172.21.15.91:3300/0 conn(0x7ffb7c06b980 0x7ffb7c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/3284551372 >> 172.21.15.40:0/3284551372 conn(0x7ffb7c0b0e90 msgr2=0x7ffb7c0b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/3284551372 shutdown_connections 2023-11-04T01:41:50.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/3284551372 wait complete. 2023-11-04T01:41:50.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 Processor -- start 2023-11-04T01:41:50.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- start start 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb7c06b980 0x7ffb7c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb7c0ca490 0x7ffb7c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 0x7ffb7c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0a90d0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c156290 con 0x7ffb7c06b980 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c6510 con 0x7ffb7c0ca490 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 0x7ffb7c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 0x7ffb7c0c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60376/0 (socket says 172.21.15.40:60376) 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 -- 172.21.15.40:0/2421768703 learned_addr learned my addr 172.21.15.40:0/2421768703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb823ff640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb7c06b980 0x7ffb7c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb81bfe640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb7c0ca490 0x7ffb7c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 -- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb7c0ca490 msgr2=0x7ffb7c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb7c0ca490 0x7ffb7c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 -- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb7c06b980 msgr2=0x7ffb7c155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb7c06b980 0x7ffb7c155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 -- 172.21.15.40:0/2421768703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74009a70 con 0x7ffb7c159bf0 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb823ff640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb7c06b980 0x7ffb7c155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb82c00640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 0x7ffb7c0c8f70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b0040 tx=0x7ffb74019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740b9860 con 0x7ffb7c159bf0 2023-11-04T01:41:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740b99c0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0c67f0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740b9d70 con 0x7ffb7c159bf0 2023-11-04T01:41:50.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.350+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c0c6db0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.354+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c0caaf0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.354+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb740ad440 con 0x7ffb7c159bf0 2023-11-04T01:41:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.354+0000 7ffb72ffd640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb600664d0 0x7ffb60068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.354+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffb7411f340 con 0x7ffb7c159bf0 2023-11-04T01:41:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.354+0000 7ffb823ff640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb600664d0 0x7ffb60068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.354+0000 7ffb823ff640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb600664d0 0x7ffb60068990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0010f0 tx=0x7ffb6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.358+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb740ecaf0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.518+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ffb7c0675f0 con 0x7ffb7c159bf0 2023-11-04T01:41:50.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb72ffd640 1 -- 172.21.15.40:0/2421768703 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffb740f0110 con 0x7ffb7c159bf0 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb600664d0 msgr2=0x7ffb60068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb600664d0 0x7ffb60068990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0010f0 tx=0x7ffb6c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 msgr2=0x7ffb7c0c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 0x7ffb7c0c8f70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b0040 tx=0x7ffb74019680 comp rx=0 tx=0).stop 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 shutdown_connections 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffb600664d0 0x7ffb60068990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb7c159bf0 0x7ffb7c0c8f70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffb7c0ca490 0x7ffb7c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 --2- 172.21.15.40:0/2421768703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffb7c06b980 0x7ffb7c155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 >> 172.21.15.40:0/2421768703 conn(0x7ffb7c0b0e90 msgr2=0x7ffb7c06b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.526+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 shutdown_connections 2023-11-04T01:41:50.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.530+0000 7ffb84663640 1 -- 172.21.15.40:0/2421768703 wait complete. 2023-11-04T01:41:50.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:41:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.666+0000 7f68f1761640 1 Processor -- start 2023-11-04T01:41:50.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.666+0000 7f68f1761640 1 -- start start 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68f1761640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68ec06cc60 0x7f68ec0d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68f1761640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68f1761640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f68ec0ce920 0x7f68ec0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68f1761640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec0ce7c0 con 0x7f68ec06cc60 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68f1761640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec070490 con 0x7f68ec0ce920 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68f1761640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0cb3a0 con 0x7f68ec06d040 2023-11-04T01:41:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68ec06cc60 0x7f68ec0d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68ec06cc60 0x7f68ec0d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60380/0 (socket says 172.21.15.40:60380) 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 -- 172.21.15.40:0/546543890 learned_addr learned my addr 172.21.15.40:0/546543890 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eb7fe640 1 --2- 172.21.15.40:0/546543890 >> v2:172.21.15.91:3300/0 conn(0x7f68ec0ce920 0x7f68ec0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68ea7fc640 1 --2- 172.21.15.40:0/546543890 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 -- 172.21.15.40:0/546543890 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 msgr2=0x7f68ec0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 --2- 172.21.15.40:0/546543890 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 -- 172.21.15.40:0/546543890 >> v2:172.21.15.91:3300/0 conn(0x7f68ec0ce920 msgr2=0x7f68ec0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 --2- 172.21.15.40:0/546543890 >> v2:172.21.15.91:3300/0 conn(0x7f68ec0ce920 0x7f68ec0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 -- 172.21.15.40:0/546543890 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec06f480 con 0x7f68ec06cc60 2023-11-04T01:41:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68eaffd640 1 --2- 172.21.15.40:0/546543890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec0d02f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0b0760 tx=0x7f68dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d874355408e4d4cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68e9ffb640 1 -- 172.21.15.40:0/546543890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0aa5f0 con 0x7f68ec06cc60 2023-11-04T01:41:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68e9ffb640 1 -- 172.21.15.40:0/546543890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc0aa750 con 0x7f68ec06cc60 2023-11-04T01:41:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.670+0000 7f68e9ffb640 1 -- 172.21.15.40:0/546543890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0aaae0 con 0x7f68ec06cc60 2023-11-04T01:41:50.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/546543890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 msgr2=0x7f68ec0d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- 172.21.15.40:0/546543890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec0d02f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0b0760 tx=0x7f68dc01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/546543890 shutdown_connections 2023-11-04T01:41:50.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- 172.21.15.40:0/546543890 >> v2:172.21.15.91:3300/0 conn(0x7f68ec0ce920 0x7f68ec0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- 172.21.15.40:0/546543890 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- 172.21.15.40:0/546543890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec0d02f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/546543890 >> 172.21.15.40:0/546543890 conn(0x7f68ec0cd7d0 msgr2=0x7f68ec0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/546543890 shutdown_connections 2023-11-04T01:41:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/546543890 wait complete. 2023-11-04T01:41:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 Processor -- start 2023-11-04T01:41:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- start start 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68ec0ce920 0x7f68ec15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0b4de0 con 0x7f68ec06cc60 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec15a620 con 0x7f68ec0ce920 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0b4b00 con 0x7f68ec06d040 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60394/0 (socket says 172.21.15.40:60394) 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 -- 172.21.15.40:0/1162054046 learned_addr learned my addr 172.21.15.40:0/1162054046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68ea7fc640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eb7fe640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68ec0ce920 0x7f68ec15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 -- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 msgr2=0x7f68ec15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 -- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68ec0ce920 msgr2=0x7f68ec15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68ec0ce920 0x7f68ec15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 -- 172.21.15.40:0/1162054046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0094d0 con 0x7f68ec06cc60 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68eaffd640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec151fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0ac040 tx=0x7f68dc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0b3800 con 0x7f68ec06cc60 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc0b3960 con 0x7f68ec06cc60 2023-11-04T01:41:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec15a8c0 con 0x7f68ec06cc60 2023-11-04T01:41:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0b3cf0 con 0x7f68ec06cc60 2023-11-04T01:41:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.674+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec1524e0 con 0x7f68ec06cc60 2023-11-04T01:41:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.678+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec0d07f0 con 0x7f68ec06cc60 2023-11-04T01:41:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.678+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68dc0c6440 con 0x7f68ec06cc60 2023-11-04T01:41:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.678+0000 7f68d37fe640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.678+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f68dc0a7070 con 0x7f68ec06cc60 2023-11-04T01:41:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.678+0000 7f68ea7fc640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.678+0000 7f68ea7fc640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0afc10 tx=0x7f68e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.682+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68dc0ebf50 con 0x7f68ec06cc60 2023-11-04T01:41:50.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:50.886+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f68ec0744a0 con 0x7f68ec06cc60 2023-11-04T01:41:51.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.218+0000 7f68d37fe640 1 -- 172.21.15.40:0/1162054046 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v128) v1 ==== 178+0+0 (secure 0 0 0) 0x7f68dc0ef570 con 0x7f68ec06cc60 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 msgr2=0x7f68d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0afc10 tx=0x7f68e0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 msgr2=0x7f68ec151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec151fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0ac040 tx=0x7f68dc01ad10 comp rx=0 tx=0).stop 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 shutdown_connections 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68ec0ce920 0x7f68ec15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68ec06d040 0x7f68ec15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 --2- 172.21.15.40:0/1162054046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68ec06cc60 0x7f68ec151fa0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 >> 172.21.15.40:0/1162054046 conn(0x7f68ec0cd7d0 msgr2=0x7f68ec0cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 shutdown_connections 2023-11-04T01:41:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.222+0000 7f68f1761640 1 -- 172.21.15.40:0/1162054046 wait complete. 2023-11-04T01:41:51.247 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-04T01:41:51.247 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-04T01:41:51.247 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:41:51.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:51.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b3e0e0640 1 Processor -- start 2023-11-04T01:41:51.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b3e0e0640 1 -- start start 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b3e0e0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9b380ce720 0x7f9b3806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b3e0e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b38159e30 con 0x7f9b380ce070 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b3e0e0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b380ccfd0 con 0x7f9b38159a50 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b3e0e0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b380cd2b0 con 0x7f9b380ce720 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b37fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9b380ce070 0x7f9b3806fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57290/0 (socket says 172.21.15.40:57290) 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b37fff640 1 -- 172.21.15.40:0/1194745187 learned_addr learned my addr 172.21.15.40:0/1194745187 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b36ffd640 1 --2- 172.21.15.40:0/1194745187 >> v2:172.21.15.91:3300/0 conn(0x7f9b380ce720 0x7f9b3806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732920120 0 0) 0x7f9b300014a0 con 0x7f9b380ce070 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b20003450 con 0x7f9b380ce070 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3414043364 0 0) 0x7f9b20003450 con 0x7f9b380ce070 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 >> v2:172.21.15.91:3300/0 conn(0x7f9b380ce720 msgr2=0x7f9b3806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 --2- 172.21.15.40:0/1194745187 >> v2:172.21.15.91:3300/0 conn(0x7f9b380ce720 0x7f9b3806ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 >> v1:172.21.15.91:6789/0 conn(0x7f9b38159a50 legacy=0x7f9b380cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380cd590 con 0x7f9b380ce070 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9b30001b90 con 0x7f9b380ce070 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 >> v1:172.21.15.40:6789/0 conn(0x7f9b380ce070 legacy=0x7f9b3806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b20003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b2000ac60 0x7f9b2000d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b2000d690 0x7f9b2000fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380cd2b0 con 0x7f9b20003a70 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20010420 con 0x7f9b2000d690 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200105e0 con 0x7f9b2000ac60 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b377fe640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b20003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b37fff640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b2000d690 0x7f9b2000fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b36ffd640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b2000ac60 0x7f9b2000d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b377fe640 1 -- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b2000ac60 msgr2=0x7f9b2000d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b377fe640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b2000ac60 0x7f9b2000d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b377fe640 1 -- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b2000d690 msgr2=0x7f9b2000fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b377fe640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b2000d690 0x7f9b2000fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b377fe640 1 -- 172.21.15.40:0/1194745187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20003450 con 0x7f9b20003a70 2023-11-04T01:41:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b37fff640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b2000d690 0x7f9b2000fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.362+0000 7f9b37fff640 1 -- 172.21.15.40:0/1194745187 reap_dead start 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b377fe640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b20003e90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c001780 tx=0x7f9b2c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3203744f39850415 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0052d0 con 0x7f9b20003a70 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0a7050 con 0x7f9b20003a70 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b367fc640 1 -- 172.21.15.40:0/1194745187 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003600 con 0x7f9b20003a70 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/1194745187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 msgr2=0x7f9b20003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b20003e90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c001780 tx=0x7f9b2c01c3e0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/1194745187 shutdown_connections 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/1194745187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b20003e90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/1194745187 >> 172.21.15.40:0/1194745187 conn(0x7f9b380cebb0 msgr2=0x7f9b380cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/1194745187 shutdown_connections 2023-11-04T01:41:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.366+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/1194745187 wait complete. 2023-11-04T01:41:51.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 Processor -- start 2023-11-04T01:41:51.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- start start 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b380c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b380c8a10 0x7f9b38145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b38145c80 0x7f9b381576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38146190 con 0x7f9b20003a70 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38146470 con 0x7f9b38145c80 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38155e80 con 0x7f9b380c8a10 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b380c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b380c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60412/0 (socket says 172.21.15.40:60412) 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 -- 172.21.15.40:0/3596740846 learned_addr learned my addr 172.21.15.40:0/3596740846 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b37fff640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b38145c80 0x7f9b381576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b36ffd640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b380c8a10 0x7f9b38145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 -- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b380c8a10 msgr2=0x7f9b38145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b380c8a10 0x7f9b38145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 -- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b38145c80 msgr2=0x7f9b381576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b38145c80 0x7f9b381576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 -- 172.21.15.40:0/3596740846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38156160 con 0x7f9b20003a70 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b36ffd640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b380c8a10 0x7f9b38145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b377fe640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b380c5bf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01c210 tx=0x7f9b20003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003e40 con 0x7f9b20003a70 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c007a40 con 0x7f9b20003a70 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c007270 con 0x7f9b20003a70 2023-11-04T01:41:51.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b38149930 con 0x7f9b20003a70 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b380c9060 con 0x7f9b20003a70 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b2c0073d0 con 0x7f9b20003a70 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.370+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b380cc6d0 con 0x7f9b20003a70 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.374+0000 7f9b1ffff640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b240664a0 0x7f9b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.374+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9b2c11e1c0 con 0x7f9b20003a70 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.374+0000 7f9b36ffd640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b240664a0 0x7f9b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.374+0000 7f9b36ffd640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b240664a0 0x7f9b24068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9b380cc2a0 tx=0x7f9b28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.378+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b380cc6d0 con 0x7f9b20003a70 2023-11-04T01:41:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.534+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b380cc6d0 con 0x7f9b20003a70 2023-11-04T01:41:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.534+0000 7f9b1ffff640 1 -- 172.21.15.40:0/3596740846 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+14679 (secure 0 0 0) 0x7f9b380cc6d0 con 0x7f9b20003a70 2023-11-04T01:41:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:51.540 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":53,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:41:50.192540+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6835/1760510907":"2023-11-05T01:41:47.173482+0000","172.21.15.40:6834/1760510907":"2023-11-05T01:41:47.173482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:51.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b240664a0 msgr2=0x7f9b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b240664a0 0x7f9b24068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9b380cc2a0 tx=0x7f9b28008040 comp rx=0 tx=0).stop 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 msgr2=0x7f9b380c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b380c5bf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01c210 tx=0x7f9b20003700 comp rx=0 tx=0).stop 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 shutdown_connections 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b240664a0 0x7f9b24068960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b38145c80 0x7f9b381576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b380c8a10 0x7f9b38145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 --2- 172.21.15.40:0/3596740846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b20003a70 0x7f9b380c5bf0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 >> 172.21.15.40:0/3596740846 conn(0x7f9b380cebb0 msgr2=0x7f9b381551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 shutdown_connections 2023-11-04T01:41:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.538+0000 7f9b3e0e0640 1 -- 172.21.15.40:0/3596740846 wait complete. 2023-11-04T01:41:51.559 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:51.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.666+0000 7f722a8b0640 1 Processor -- start 2023-11-04T01:41:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.666+0000 7f722a8b0640 1 -- start start 2023-11-04T01:41:51.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f722a8b0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f722415acb0 0x7f722415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f722a8b0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72240cb130 con 0x7f72240b0c20 2023-11-04T01:41:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f722a8b0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722415b680 con 0x7f722415c160 2023-11-04T01:41:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f722a8b0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722415bd40 con 0x7f722415acb0 2023-11-04T01:41:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7223fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f722415acb0 0x7f722415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7228e4d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f72240b0c20 0x7f72240ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57298/0 (socket says 172.21.15.40:57298) 2023-11-04T01:41:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7228e4d640 1 -- 172.21.15.40:0/3242767107 learned_addr learned my addr 172.21.15.40:0/3242767107 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:51.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7223fff640 1 -- 172.21.15.40:0/3242767107 >> v1:172.21.15.91:6789/0 conn(0x7f722415c160 legacy=0x7f72240b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7223fff640 1 -- 172.21.15.40:0/3242767107 >> v1:172.21.15.40:6789/0 conn(0x7f72240b0c20 legacy=0x7f72240ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7223fff640 1 -- 172.21.15.40:0/3242767107 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722415b960 con 0x7f722415acb0 2023-11-04T01:41:51.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.670+0000 7f7222ffd640 1 -- 172.21.15.40:0/3242767107 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234584300 0 0) 0x7f72240cb130 con 0x7f72240b0c20 2023-11-04T01:41:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7223fff640 1 --2- 172.21.15.40:0/3242767107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415acb0 0x7f722415b090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f721c009dc0 tx=0x7f721c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7859b368b0c0a9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7222ffd640 1 -- 172.21.15.40:0/3242767107 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c0a58c0 con 0x7f722415acb0 2023-11-04T01:41:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7222ffd640 1 -- 172.21.15.40:0/3242767107 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c0a5a20 con 0x7f722415acb0 2023-11-04T01:41:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7222ffd640 1 -- 172.21.15.40:0/3242767107 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c0a5db0 con 0x7f722415acb0 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/3242767107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415acb0 msgr2=0x7f722415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 --2- 172.21.15.40:0/3242767107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415acb0 0x7f722415b090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f721c009dc0 tx=0x7f721c01c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/3242767107 shutdown_connections 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 --2- 172.21.15.40:0/3242767107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415acb0 0x7f722415b090 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/3242767107 >> 172.21.15.40:0/3242767107 conn(0x7f72240cb510 msgr2=0x7f72240cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/3242767107 shutdown_connections 2023-11-04T01:41:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/3242767107 wait complete. 2023-11-04T01:41:51.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 Processor -- start 2023-11-04T01:41:51.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- start start 2023-11-04T01:41:51.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72240b0c20 0x7f7224150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f722415acb0 0x7f7224147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 0x7f72240afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224147e50 con 0x7f722415c160 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72241506a0 con 0x7f722415acb0 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72241503c0 con 0x7f72240b0c20 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 0x7f72240afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 0x7f72240afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60436/0 (socket says 172.21.15.40:60436) 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 -- 172.21.15.40:0/2084860298 learned_addr learned my addr 172.21.15.40:0/2084860298 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f72237fe640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f722415acb0 0x7f7224147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 -- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72240b0c20 msgr2=0x7f7224150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72240b0c20 0x7f7224150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 -- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f722415acb0 msgr2=0x7f7224147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f722415acb0 0x7f7224147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 -- 172.21.15.40:0/2084860298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c009a70 con 0x7f722415c160 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7228e4d640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 0x7f72240afa80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f72140011f0 tx=0x7f721400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140074e0 con 0x7f722415c160 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214007640 con 0x7f722415c160 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214004a10 con 0x7f722415c160 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72240aefa0 con 0x7f722415c160 2023-11-04T01:41:51.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.674+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72240af560 con 0x7f722415c160 2023-11-04T01:41:51.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.678+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72240af780 con 0x7f722415c160 2023-11-04T01:41:51.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.678+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7214004b70 con 0x7f722415c160 2023-11-04T01:41:51.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.678+0000 7f7220ff9640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f72100664a0 0x7f7210068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.678+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f72140840b0 con 0x7f722415c160 2023-11-04T01:41:51.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.678+0000 7f7223fff640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f72100664a0 0x7f7210068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.678+0000 7f7223fff640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f72100664a0 0x7f7210068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f721c0af000 tx=0x7f721c004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.682+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f72140517d0 con 0x7f722415c160 2023-11-04T01:41:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.834+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72240744a0 con 0x7f722415c160 2023-11-04T01:41:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.834+0000 7f7220ff9640 1 -- 172.21.15.40:0/2084860298 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7214054df0 con 0x7f722415c160 2023-11-04T01:41:51.841 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f72100664a0 msgr2=0x7f7210068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f72100664a0 0x7f7210068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f721c0af000 tx=0x7f721c004ac0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 msgr2=0x7f72240afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 0x7f72240afa80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f72140011f0 tx=0x7f721400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 shutdown_connections 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f72100664a0 0x7f7210068960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f722415c160 0x7f72240afa80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f722415acb0 0x7f7224147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 --2- 172.21.15.40:0/2084860298 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72240b0c20 0x7f7224150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 >> 172.21.15.40:0/2084860298 conn(0x7f72240cb510 msgr2=0x7f722415c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 shutdown_connections 2023-11-04T01:41:51.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.838+0000 7f722a8b0640 1 -- 172.21.15.40:0/2084860298 wait complete. 2023-11-04T01:41:51.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:51.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.970+0000 7f417eff8640 1 Processor -- start 2023-11-04T01:41:51.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.970+0000 7f417eff8640 1 -- start start 2023-11-04T01:41:51.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417eff8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f417815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417eff8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41780b0c20 0x7f41780ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417eff8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780cb130 con 0x7f417815c160 2023-11-04T01:41:51.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417eff8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417815bd40 con 0x7f41780b0c20 2023-11-04T01:41:51.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417eff8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417806fd80 con 0x7f417815acb0 2023-11-04T01:41:51.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41780b0c20 0x7f41780ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41780b0c20 0x7f41780ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60440/0 (socket says 172.21.15.40:60440) 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 -- 172.21.15.40:0/2737165310 learned_addr learned my addr 172.21.15.40:0/2737165310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 -- 172.21.15.40:0/2737165310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 msgr2=0x7f417815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417cd94640 1 --2- 172.21.15.40:0/2737165310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f417815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 --2- 172.21.15.40:0/2737165310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f417815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 -- 172.21.15.40:0/2737165310 >> v1:172.21.15.91:6789/0 conn(0x7f417815c160 legacy=0x7f41780b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 -- 172.21.15.40:0/2737165310 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417815b680 con 0x7f41780b0c20 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f417d595640 1 --2- 172.21.15.40:0/2737165310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780ca490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4170009e50 tx=0x7f417001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfba9e392af38ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f41777fe640 1 -- 172.21.15.40:0/2737165310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700a5840 con 0x7f41780b0c20 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f41777fe640 1 -- 172.21.15.40:0/2737165310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41700a59a0 con 0x7f41780b0c20 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.974+0000 7f41777fe640 1 -- 172.21.15.40:0/2737165310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700a5d30 con 0x7f41780b0c20 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/2737165310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 msgr2=0x7f41780ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 --2- 172.21.15.40:0/2737165310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780ca490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4170009e50 tx=0x7f417001c9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/2737165310 shutdown_connections 2023-11-04T01:41:51.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 --2- 172.21.15.40:0/2737165310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780ca490 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 --2- 172.21.15.40:0/2737165310 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f417815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/2737165310 >> 172.21.15.40:0/2737165310 conn(0x7f41780cb510 msgr2=0x7f41780cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/2737165310 shutdown_connections 2023-11-04T01:41:51.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/2737165310 wait complete. 2023-11-04T01:41:51.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 Processor -- start 2023-11-04T01:41:51.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- start start 2023-11-04T01:41:51.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f4178151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f417815c160 0x7f4178150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c7550 con 0x7f41780b0c20 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c69d0 con 0x7f417815c160 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c6cb0 con 0x7f417815acb0 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60444/0 (socket says 172.21.15.40:60444) 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 -- 172.21.15.40:0/1400072293 learned_addr learned my addr 172.21.15.40:0/1400072293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417d595640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f417815c160 0x7f4178150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f4177fff640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f4178151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 -- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 msgr2=0x7f4178151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f4178151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 -- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f417815c160 msgr2=0x7f4178150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f417815c160 0x7f4178150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 -- 172.21.15.40:0/1400072293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009b30 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f4177fff640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f4178151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417d595640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f417815c160 0x7f4178150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417cd94640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780c5dc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c7f0 tx=0x7f416c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c004220 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0043a0 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780c6f90 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c004510 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.978+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4178159ba0 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.982+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41780744a0 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.982+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f416c003a70 con 0x7f41780b0c20 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.982+0000 7f41757fa640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f41640664a0 0x7f4164068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.982+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f416c083c60 con 0x7f41780b0c20 2023-11-04T01:41:51.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.982+0000 7f4177fff640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f41640664a0 0x7f4164068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.982+0000 7f4177fff640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f41640664a0 0x7f4164068960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4178166df0 tx=0x7f4168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:51.986+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f416c051310 con 0x7f41780b0c20 2023-11-04T01:41:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f41780b1150 con 0x7f41780b0c20 2023-11-04T01:41:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f41757fa640 1 -- 172.21.15.40:0/1400072293 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v53) v1 ==== 103+0+11 (secure 0 0 0) 0x7f416c01e0a0 con 0x7f41780b0c20 2023-11-04T01:41:52.143 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:41:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f41640664a0 msgr2=0x7f4164068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f41640664a0 0x7f4164068960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4178166df0 tx=0x7f4168008040 comp rx=0 tx=0).stop 2023-11-04T01:41:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 msgr2=0x7f41780c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780c5dc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c7f0 tx=0x7f416c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 shutdown_connections 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f41640664a0 0x7f4164068960 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f417815c160 0x7f4178150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f417815acb0 0x7f4178151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 --2- 172.21.15.40:0/1400072293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41780b0c20 0x7f41780c5dc0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 >> 172.21.15.40:0/1400072293 conn(0x7f41780cb510 msgr2=0x7f41780cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 shutdown_connections 2023-11-04T01:41:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.138+0000 7f417eff8640 1 -- 172.21.15.40:0/1400072293 wait complete. 2023-11-04T01:41:52.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:41:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 Processor -- start 2023-11-04T01:41:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 -- start start 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66a00715d0 0x7f66a00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f66a00b0b70 0x7f66a015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00c2670 con 0x7f66a015afd0 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a0070140 con 0x7f66a00715d0 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f66a4a9b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a0071a60 con 0x7f66a00b0b70 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66a00715d0 0x7f66a00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66a00715d0 0x7f66a00b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60456/0 (socket says 172.21.15.40:60456) 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 -- 172.21.15.40:0/2187842201 learned_addr learned my addr 172.21.15.40:0/2187842201 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f669ed9d640 1 --2- 172.21.15.40:0/2187842201 >> v2:172.21.15.91:3300/0 conn(0x7f66a00b0b70 0x7f66a015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 -- 172.21.15.40:0/2187842201 >> v2:172.21.15.91:3300/0 conn(0x7f66a00b0b70 msgr2=0x7f66a015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 --2- 172.21.15.40:0/2187842201 >> v2:172.21.15.91:3300/0 conn(0x7f66a00b0b70 0x7f66a015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 -- 172.21.15.40:0/2187842201 >> v1:172.21.15.91:6789/0 conn(0x7f66a015afd0 legacy=0x7f66a006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.278+0000 7f6695d9b640 1 -- 172.21.15.40:0/2187842201 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a006bc30 con 0x7f66a00715d0 2023-11-04T01:41:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f6695d9b640 1 --2- 172.21.15.40:0/2187842201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00715d0 0x7f66a00b0630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f66a006f7b0 tx=0x7f668801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725305d087fb1d48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f669dd9b640 1 -- 172.21.15.40:0/2187842201 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880ab600 con 0x7f66a00715d0 2023-11-04T01:41:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f669dd9b640 1 -- 172.21.15.40:0/2187842201 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66880a7050 con 0x7f66a00715d0 2023-11-04T01:41:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f669dd9b640 1 -- 172.21.15.40:0/2187842201 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880ab980 con 0x7f66a00715d0 2023-11-04T01:41:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- 172.21.15.40:0/2187842201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00715d0 msgr2=0x7f66a00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/2187842201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00715d0 0x7f66a00b0630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f66a006f7b0 tx=0x7f668801c500 comp rx=0 tx=0).stop 2023-11-04T01:41:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- 172.21.15.40:0/2187842201 shutdown_connections 2023-11-04T01:41:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/2187842201 >> v2:172.21.15.91:3300/0 conn(0x7f66a00b0b70 0x7f66a015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/2187842201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00715d0 0x7f66a00b0630 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- 172.21.15.40:0/2187842201 >> 172.21.15.40:0/2187842201 conn(0x7f66a00cebb0 msgr2=0x7f66a00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- 172.21.15.40:0/2187842201 shutdown_connections 2023-11-04T01:41:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- 172.21.15.40:0/2187842201 wait complete. 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 Processor -- start 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- start start 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66a00715d0 0x7f66a014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 0x7f66a00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66a015afd0 0x7f66a0152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00c82a0 con 0x7f66a00b0b70 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0150880 con 0x7f66a00715d0 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.282+0000 7f66a4a9b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a014f930 con 0x7f66a015afd0 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 0x7f66a00c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 0x7f66a00c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60468/0 (socket says 172.21.15.40:60468) 2023-11-04T01:41:52.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 -- 172.21.15.40:0/1952617537 learned_addr learned my addr 172.21.15.40:0/1952617537 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f669ed9d640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66a015afd0 0x7f66a0152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f669e59c640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66a00715d0 0x7f66a014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 -- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66a015afd0 msgr2=0x7f66a0152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66a015afd0 0x7f66a0152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 -- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66a00715d0 msgr2=0x7f66a014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66a00715d0 0x7f66a014f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 -- 172.21.15.40:0/1952617537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880094d0 con 0x7f66a00b0b70 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f669ed9d640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66a015afd0 0x7f66a0152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f6695d9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 0x7f66a00c6600 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f66880ae040 tx=0x7f66880192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880b4620 con 0x7f66a00b0b70 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66880b47a0 con 0x7f66a00b0b70 2023-11-04T01:41:52.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880b4b50 con 0x7f66a00b0b70 2023-11-04T01:41:52.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00c84d0 con 0x7f66a00b0b70 2023-11-04T01:41:52.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a00c8a90 con 0x7f66a00b0b70 2023-11-04T01:41:52.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a0150a30 con 0x7f66a00b0b70 2023-11-04T01:41:52.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66880b2070 con 0x7f66a00b0b70 2023-11-04T01:41:52.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66977fe640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66800664a0 0x7f6680068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f668811cda0 con 0x7f66a00b0b70 2023-11-04T01:41:52.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f669e59c640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66800664a0 0x7f6680068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.286+0000 7f669e59c640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66800664a0 0x7f6680068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6690000f70 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.290+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66a0150a30 con 0x7f66a00b0b70 2023-11-04T01:41:52.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:52.498+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f66a0150a30 con 0x7f66a00b0b70 2023-11-04T01:41:53.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.230+0000 7f66977fe640 1 -- 172.21.15.40:0/1952617537 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v130) v1 ==== 176+0+0 (secure 0 0 0) 0x7f66a0150a30 con 0x7f66a00b0b70 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66800664a0 msgr2=0x7f6680068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66800664a0 0x7f6680068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6690000f70 tx=0x7f6690009040 comp rx=0 tx=0).stop 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 msgr2=0x7f66a00c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 0x7f66a00c6600 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f66880ae040 tx=0x7f66880192a0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 shutdown_connections 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66800664a0 0x7f6680068960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66a015afd0 0x7f66a0152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a00b0b70 0x7f66a00c6600 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 --2- 172.21.15.40:0/1952617537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66a00715d0 0x7f66a014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 >> 172.21.15.40:0/1952617537 conn(0x7f66a00cebb0 msgr2=0x7f66a015a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 shutdown_connections 2023-11-04T01:41:53.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.234+0000 7f66a4a9b640 1 -- 172.21.15.40:0/1952617537 wait complete. 2023-11-04T01:41:53.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:41:53.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 Processor -- start 2023-11-04T01:41:53.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 -- start start 2023-11-04T01:41:53.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f798015af70 0x7f79800cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 0x7f79800cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798006c0c0 con 0x7f798015dd80 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7980071200 con 0x7f798015af70 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7985fa5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798006c3a0 con 0x7f798006d160 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f798015dd80 0x7f798015e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57312/0 (socket says 172.21.15.40:57312) 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797ffff640 1 -- 172.21.15.40:0/443381759 learned_addr learned my addr 172.21.15.40:0/443381759 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797f7fe640 1 --2- 172.21.15.40:0/443381759 >> v2:172.21.15.91:3300/0 conn(0x7f798015af70 0x7f79800cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 0x7f79800cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127978151 0 0) 0x7f798006c0c0 con 0x7f798015dd80 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f796c003530 con 0x7f798015dd80 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3435916607 0 0) 0x7f796c003530 con 0x7f798015dd80 2023-11-04T01:41:53.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 msgr2=0x7f79800cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 0x7f79800cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 >> v2:172.21.15.91:3300/0 conn(0x7f798015af70 msgr2=0x7f79800cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 --2- 172.21.15.40:0/443381759 >> v2:172.21.15.91:3300/0 conn(0x7f798015af70 0x7f79800cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798006c680 con 0x7f798015dd80 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f7978001a00 con 0x7f798015dd80 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 >> v1:172.21.15.40:6789/0 conn(0x7f798015dd80 legacy=0x7f798015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 0x7f796c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796c003f00 0x7f796c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c004d10 0x7f796c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7980071200 con 0x7f796c003f00 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798006c3a0 con 0x7f796c004d10 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c00b990 con 0x7f798006d160 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796c003f00 0x7f796c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f797f7fe640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 0x7f796c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 -- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 msgr2=0x7f796c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f798006d160 0x7f796c003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 -- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c004d10 msgr2=0x7f796c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c004d10 0x7f796c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.390+0000 7f7976ffd640 1 -- 172.21.15.40:0/443381759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c003530 con 0x7f796c003f00 2023-11-04T01:41:53.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7976ffd640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796c003f00 0x7f796c0047d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7968009ae0 tx=0x7f796801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e96b7885790bb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680a5640 con 0x7f796c003f00 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79680a57a0 con 0x7f796c003f00 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797effd640 1 -- 172.21.15.40:0/443381759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680a5b50 con 0x7f796c003f00 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- 172.21.15.40:0/443381759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796c003f00 msgr2=0x7f796c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 --2- 172.21.15.40:0/443381759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796c003f00 0x7f796c0047d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7968009ae0 tx=0x7f796801c9f0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797ffff640 1 -- 172.21.15.40:0/443381759 reap_dead start 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- 172.21.15.40:0/443381759 shutdown_connections 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- 172.21.15.40:0/443381759 >> 172.21.15.40:0/443381759 conn(0x7f79800cb510 msgr2=0x7f79800cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- 172.21.15.40:0/443381759 shutdown_connections 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- 172.21.15.40:0/443381759 wait complete. 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 Processor -- start 2023-11-04T01:41:53.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- start start 2023-11-04T01:41:53.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c003f00 0x7f7980151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79800b18e0 0x7f79800cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 0x7f79800acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800b2a60 con 0x7f79800ac8c0 2023-11-04T01:41:53.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800ad280 con 0x7f796c003f00 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f7985fa5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7980151580 con 0x7f79800b18e0 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 0x7f79800acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 0x7f79800acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60490/0 (socket says 172.21.15.40:60490) 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.394+0000 7f797ffff640 1 -- 172.21.15.40:0/89606738 learned_addr learned my addr 172.21.15.40:0/89606738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797f7fe640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c003f00 0x7f7980151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f7976ffd640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79800b18e0 0x7f79800cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797ffff640 1 -- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79800b18e0 msgr2=0x7f79800cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797ffff640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79800b18e0 0x7f79800cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797ffff640 1 -- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c003f00 msgr2=0x7f7980151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797ffff640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c003f00 0x7f7980151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797ffff640 1 -- 172.21.15.40:0/89606738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800b1de0 con 0x7f79800ac8c0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797f7fe640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c003f00 0x7f7980151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797ffff640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 0x7f79800acd40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7978004c00 tx=0x7f797800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800d9c0 con 0x7f79800ac8c0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800db40 con 0x7f79800ac8c0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800a030 con 0x7f79800ac8c0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79800b20c0 con 0x7f79800ac8c0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79800b2680 con 0x7f79800ac8c0 2023-11-04T01:41:53.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79800b2ba0 con 0x7f79800ac8c0 2023-11-04T01:41:53.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f797800a190 con 0x7f79800ac8c0 2023-11-04T01:41:53.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797cff9640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79600664a0 0x7f7960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7978086260 con 0x7f79800ac8c0 2023-11-04T01:41:53.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797f7fe640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79600664a0 0x7f7960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.398+0000 7f797f7fe640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79600664a0 0x7f7960068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7970009b70 tx=0x7f7970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.402+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79800b2ba0 con 0x7f79800ac8c0 2023-11-04T01:41:53.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.558+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f79800b2ba0 con 0x7f79800ac8c0 2023-11-04T01:41:53.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f797cff9640 1 -- 172.21.15.40:0/89606738 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f79800b2ba0 con 0x7f79800ac8c0 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79600664a0 msgr2=0x7f7960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79600664a0 0x7f7960068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7970009b70 tx=0x7f7970008040 comp rx=0 tx=0).stop 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 msgr2=0x7f79800acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 0x7f79800acd40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7978004c00 tx=0x7f797800ff00 comp rx=0 tx=0).stop 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 shutdown_connections 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79600664a0 0x7f7960068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79800ac8c0 0x7f79800acd40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79800b18e0 0x7f79800cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 --2- 172.21.15.40:0/89606738 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796c003f00 0x7f7980151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 >> 172.21.15.40:0/89606738 conn(0x7f79800cb510 msgr2=0x7f798015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 shutdown_connections 2023-11-04T01:41:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.566+0000 7f7985fa5640 1 -- 172.21.15.40:0/89606738 wait complete. 2023-11-04T01:41:53.589 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:41:53.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:53.655 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:53.700 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:41:53.700 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:53.700 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:53.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:53.706 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:53.706 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:53.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:53.747 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:41:53.747 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:53.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:53.754 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:41:53.755 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:53.794 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:53.794 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:41:53.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:53.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8c5fd4640 1 Processor -- start 2023-11-04T01:41:53.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8c5fd4640 1 -- start start 2023-11-04T01:41:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8c5fd4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 0x7fd8c006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8c5fd4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c006a160 con 0x7fd8c00c23f0 2023-11-04T01:41:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8c5fd4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c00cc7d0 con 0x7fd8c00ae880 2023-11-04T01:41:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8c5fd4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006dbb0 con 0x7fd8c0065dc0 2023-11-04T01:41:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd8c00c23f0 0x7fd8c00cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57320/0 (socket says 172.21.15.40:57320) 2023-11-04T01:41:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 -- 172.21.15.40:0/1099877189 learned_addr learned my addr 172.21.15.40:0/1099877189 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:41:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8beffd640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 0x7fd8c006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241468004 0 0) 0x7fd8c006a160 con 0x7fd8c00c23f0 2023-11-04T01:41:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a8003530 con 0x7fd8c00c23f0 2023-11-04T01:41:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1472628992 0 0) 0x7fd8a8003530 con 0x7fd8c00c23f0 2023-11-04T01:41:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 msgr2=0x7fd8c006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 0x7fd8c006d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 >> v1:172.21.15.91:6789/0 conn(0x7fd8c00ae880 legacy=0x7fd8c00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00cf350 con 0x7fd8c00c23f0 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd8b8001a00 con 0x7fd8c00c23f0 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 >> v1:172.21.15.40:6789/0 conn(0x7fd8c00c23f0 legacy=0x7fd8c00cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 0x7fd8a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8003f30 0x7fd8a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a8004d10 0x7fd8a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006dbb0 con 0x7fd8a8004d10 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a800ba70 con 0x7fd8a8003f30 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a800bc30 con 0x7fd8c0065dc0 2023-11-04T01:41:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a8004d10 0x7fd8a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bf7fe640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 0x7fd8a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8beffd640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8003f30 0x7fd8a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 -- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 msgr2=0x7fd8a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c0065dc0 0x7fd8a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 -- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8003f30 msgr2=0x7fd8a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8003f30 0x7fd8a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.922+0000 7fd8bffff640 1 -- 172.21.15.40:0/1099877189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8003530 con 0x7fd8a8004d10 2023-11-04T01:41:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8bffff640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a8004d10 0x7fd8a8005190 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800a830 tx=0x7fd8b801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918f11fbc99187b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80072d0 con 0x7fd8a8004d10 2023-11-04T01:41:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80a8070 con 0x7fd8a8004d10 2023-11-04T01:41:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8be7fc640 1 -- 172.21.15.40:0/1099877189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80076f0 con 0x7fd8a8004d10 2023-11-04T01:41:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/1099877189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a8004d10 msgr2=0x7fd8a8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/1099877189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8a8004d10 0x7fd8a8005190 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800a830 tx=0x7fd8b801d340 comp rx=0 tx=0).stop 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8bffff640 1 -- 172.21.15.40:0/1099877189 reap_dead start 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/1099877189 shutdown_connections 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/1099877189 >> 172.21.15.40:0/1099877189 conn(0x7fd8c00716a0 msgr2=0x7fd8c0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/1099877189 shutdown_connections 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/1099877189 wait complete. 2023-11-04T01:41:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 Processor -- start 2023-11-04T01:41:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.926+0000 7fd8c5fd4640 1 -- start start 2023-11-04T01:41:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8004d10 0x7fd8c009a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c00afbd0 0x7fd8c00c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 0x7fd8c00ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00b0050 con 0x7fd8c0162340 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c009a930 con 0x7fd8a8004d10 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00b03a0 con 0x7fd8c00afbd0 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 0x7fd8c00ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 0x7fd8c00ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60510/0 (socket says 172.21.15.40:60510) 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 -- 172.21.15.40:0/2080620800 learned_addr learned my addr 172.21.15.40:0/2080620800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bf7fe640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8004d10 0x7fd8c009a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8beffd640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c00afbd0 0x7fd8c00c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 -- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c00afbd0 msgr2=0x7fd8c00c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c00afbd0 0x7fd8c00c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 -- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8004d10 msgr2=0x7fd8c009a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8004d10 0x7fd8c009a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 -- 172.21.15.40:0/2080620800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00b0680 con 0x7fd8c0162340 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8beffd640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c00afbd0 0x7fd8c00c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bffff640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 0x7fd8c00ccd60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd8b801d170 tx=0x7fd8a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80bb070 con 0x7fd8c0162340 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8001290 con 0x7fd8c0162340 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00b0960 con 0x7fd8c0162340 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8001a00 con 0x7fd8c0162340 2023-11-04T01:41:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c00c6a30 con 0x7fd8c0162340 2023-11-04T01:41:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c00b0e80 con 0x7fd8c0162340 2023-11-04T01:41:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8b80aa030 con 0x7fd8c0162340 2023-11-04T01:41:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8a7fff640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ac0664a0 0x7fd8ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd8b811de20 con 0x7fd8c0162340 2023-11-04T01:41:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.930+0000 7fd8bf7fe640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ac0664a0 0x7fd8ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.934+0000 7fd8bf7fe640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ac0664a0 0x7fd8ac068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4000c10 tx=0x7fd8b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:53.934+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8c00b0e80 con 0x7fd8c0162340 2023-11-04T01:41:54.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8c00b0e80 con 0x7fd8c0162340 2023-11-04T01:41:54.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8a7fff640 1 -- 172.21.15.40:0/2080620800 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fd8c00b0e80 con 0x7fd8c0162340 2023-11-04T01:41:54.127 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:41:54.128 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/2224923322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2224923322},{"type":"v1","addr":"172.21.15.91:6835","nonce":2224923322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/4081304484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":4081304484},{"type":"v1","addr":"172.21.15.91:6837","nonce":4081304484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1184152561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1184152561},{"type":"v1","addr":"172.21.15.40:6833","nonce":1184152561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":6045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2200517025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2200517025},{"type":"v1","addr":"172.21.15.40:6835","nonce":2200517025}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2023-11-04T01:41:54.128 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ac0664a0 msgr2=0x7fd8ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ac0664a0 0x7fd8ac068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4000c10 tx=0x7fd8b4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 msgr2=0x7fd8c00ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 0x7fd8c00ccd60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd8b801d170 tx=0x7fd8a8005800 comp rx=0 tx=0).stop 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 shutdown_connections 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ac0664a0 0x7fd8ac068960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c0162340 0x7fd8c00ccd60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c00afbd0 0x7fd8c00c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 --2- 172.21.15.40:0/2080620800 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a8004d10 0x7fd8c009a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 >> 172.21.15.40:0/2080620800 conn(0x7fd8c00716a0 msgr2=0x7fd8c00b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 shutdown_connections 2023-11-04T01:41:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:41:54.122+0000 7fd8c5fd4640 1 -- 172.21.15.40:0/2080620800 wait complete. 2023-11-04T01:41:54.146 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:41:54.146 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:41:54.146 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:41:54.146 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:54.147 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:41:54.147 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:41:54.147 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:41:54.147 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:54.147 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:41:54.147 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:41:54.148 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:41:54.148 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:54.148 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:54.148 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:54.148 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:54.148 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:54.159 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:41:54.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:41:54.165 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:54.166 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:54.166 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:41:54.167 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:41:54.203 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:41:54.203 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:54.211 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:54.211 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:54.212 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:41:54.212 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:54.273 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:41:54.282 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:41:54.282 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:41:55.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:41:56.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:56.972 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:00.158 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:42:00.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:42:00.161 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:42:00.162 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:00.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:42:00.240 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:42:00.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.278+0000 7f87ad164640 1 Processor -- start 2023-11-04T01:42:00.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.278+0000 7f87ad164640 1 -- start start 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87ad164640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87a815ce90 0x7f87a80ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87ad164640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80add90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87ad164640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a8160c80 con 0x7f87a80ce6d0 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87ad164640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80c9800 con 0x7f87a815ce90 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87ad164640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8160f20 con 0x7f87a80b1130 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87a815ce90 0x7f87a80ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87a815ce90 0x7f87a80ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40538/0 (socket says 172.21.15.40:40538) 2023-11-04T01:42:00.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 -- 172.21.15.40:0/3850789440 learned_addr learned my addr 172.21.15.40:0/3850789440 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a759e640 1 --2- 172.21.15.40:0/3850789440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 -- 172.21.15.40:0/3850789440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 msgr2=0x7f87a80add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 --2- 172.21.15.40:0/3850789440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 -- 172.21.15.40:0/3850789440 >> v1:172.21.15.91:6789/0 conn(0x7f87a80ce6d0 legacy=0x7f87a80b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:00.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 -- 172.21.15.40:0/3850789440 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8161200 con 0x7f87a815ce90 2023-11-04T01:42:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a6d9d640 1 --2- 172.21.15.40:0/3850789440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80ccae0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8798009870 tx=0x7f879801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989fb4c5d7adfb55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a5d9b640 1 -- 172.21.15.40:0/3850789440 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87980aa5f0 con 0x7f87a815ce90 2023-11-04T01:42:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a5d9b640 1 -- 172.21.15.40:0/3850789440 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87980aa750 con 0x7f87a815ce90 2023-11-04T01:42:00.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.282+0000 7f87a5d9b640 1 -- 172.21.15.40:0/3850789440 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87980aaae0 con 0x7f87a815ce90 2023-11-04T01:42:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/3850789440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 msgr2=0x7f87a80ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 --2- 172.21.15.40:0/3850789440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80ccae0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8798009870 tx=0x7f879801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/3850789440 shutdown_connections 2023-11-04T01:42:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 --2- 172.21.15.40:0/3850789440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 --2- 172.21.15.40:0/3850789440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80ccae0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/3850789440 >> 172.21.15.40:0/3850789440 conn(0x7f87a80cefa0 msgr2=0x7f87a80cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/3850789440 shutdown_connections 2023-11-04T01:42:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/3850789440 wait complete. 2023-11-04T01:42:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 Processor -- start 2023-11-04T01:42:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- start start 2023-11-04T01:42:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87a80ce6d0 0x7f87a80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80add90 con 0x7f87a815ce90 2023-11-04T01:42:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80c8590 con 0x7f87a80ce6d0 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80c8870 con 0x7f87a80b1130 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40550/0 (socket says 172.21.15.40:40550) 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 -- 172.21.15.40:0/2590836910 learned_addr learned my addr 172.21.15.40:0/2590836910 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a6d9d640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a659c640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87a80ce6d0 0x7f87a80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 -- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 msgr2=0x7f87a80c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 -- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87a80ce6d0 msgr2=0x7f87a80ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87a80ce6d0 0x7f87a80ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 -- 172.21.15.40:0/2590836910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87980094d0 con 0x7f87a815ce90 2023-11-04T01:42:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a6d9d640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87a759e640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80c6310 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f87a000cd90 tx=0x7f87a000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0003ba0 con 0x7f87a815ce90 2023-11-04T01:42:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a0003d20 con 0x7f87a815ce90 2023-11-04T01:42:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a80c8b50 con 0x7f87a815ce90 2023-11-04T01:42:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0004260 con 0x7f87a815ce90 2023-11-04T01:42:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.286+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a80c6850 con 0x7f87a815ce90 2023-11-04T01:42:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.290+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a80c9000 con 0x7f87a815ce90 2023-11-04T01:42:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.290+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87a00043c0 con 0x7f87a815ce90 2023-11-04T01:42:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.290+0000 7f878f7fe640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87940664a0 0x7f8794068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.290+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f87a0012070 con 0x7f87a815ce90 2023-11-04T01:42:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.290+0000 7f87a6d9d640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87940664a0 0x7f8794068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.290+0000 7f87a6d9d640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87940664a0 0x7f8794068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f87980ae000 tx=0x7f87980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.294+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87a00521b0 con 0x7f87a815ce90 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:00.462+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f87a80744a0 con 0x7f87a815ce90 2023-11-04T01:42:01.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:42:01.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.906+0000 7f878f7fe640 1 -- 172.21.15.40:0/2590836910 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7f87a00557d0 con 0x7f87a815ce90 2023-11-04T01:42:01.914 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-11-04T01:42:01.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87940664a0 msgr2=0x7f8794068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87940664a0 0x7f8794068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f87980ae000 tx=0x7f87980a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:01.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 msgr2=0x7f87a80c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80c6310 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f87a000cd90 tx=0x7f87a000a660 comp rx=0 tx=0).stop 2023-11-04T01:42:01.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 shutdown_connections 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87940664a0 0x7f8794068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a815ce90 0x7f87a80c6310 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f87a80ce6d0 0x7f87a80ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 --2- 172.21.15.40:0/2590836910 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f87a80b1130 0x7f87a80c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 >> 172.21.15.40:0/2590836910 conn(0x7f87a80cefa0 msgr2=0x7f87a806fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 shutdown_connections 2023-11-04T01:42:01.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:01.910+0000 7f87ad164640 1 -- 172.21.15.40:0/2590836910 wait complete. 2023-11-04T01:42:01.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:42:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 Processor -- start 2023-11-04T01:42:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 -- start start 2023-11-04T01:42:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c15afd0 0x7f984c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f984c0b0d40 0x7f984c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c0c2670 con 0x7f984c06f8f0 2023-11-04T01:42:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c070140 con 0x7f984c0b0d40 2023-11-04T01:42:02.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f98538d8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c06c9f0 con 0x7f984c15afd0 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851674640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c15afd0 0x7f984c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851e75640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f984c0b0d40 0x7f984c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851674640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c15afd0 0x7f984c0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:44410/0 (socket says 172.21.15.40:44410) 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851674640 1 -- 172.21.15.40:0/3066135847 learned_addr learned my addr 172.21.15.40:0/3066135847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851e75640 1 -- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c15afd0 msgr2=0x7f984c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851e75640 1 --2- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c15afd0 0x7f984c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851e75640 1 -- 172.21.15.40:0/3066135847 >> v1:172.21.15.91:6789/0 conn(0x7f984c06f8f0 legacy=0x7f984c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.062+0000 7f9851e75640 1 -- 172.21.15.40:0/3066135847 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c06bc30 con 0x7f984c0b0d40 2023-11-04T01:42:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f9851e75640 1 --2- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c0b0d40 0x7f984c15ec80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9844009dc0 tx=0x7f984401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574d29993898f305 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f9843fff640 1 -- 172.21.15.40:0/3066135847 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98440a59c0 con 0x7f984c0b0d40 2023-11-04T01:42:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f9843fff640 1 -- 172.21.15.40:0/3066135847 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98440a5b20 con 0x7f984c0b0d40 2023-11-04T01:42:02.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f9843fff640 1 -- 172.21.15.40:0/3066135847 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98440ad440 con 0x7f984c0b0d40 2023-11-04T01:42:02.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 -- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c0b0d40 msgr2=0x7f984c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 --2- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c0b0d40 0x7f984c15ec80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9844009dc0 tx=0x7f984401c900 comp rx=0 tx=0).stop 2023-11-04T01:42:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 -- 172.21.15.40:0/3066135847 shutdown_connections 2023-11-04T01:42:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 --2- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c0b0d40 0x7f984c15ec80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 --2- 172.21.15.40:0/3066135847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c15afd0 0x7f984c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 -- 172.21.15.40:0/3066135847 >> 172.21.15.40:0/3066135847 conn(0x7f984c0cebb0 msgr2=0x7f984c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 -- 172.21.15.40:0/3066135847 shutdown_connections 2023-11-04T01:42:02.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.066+0000 7f98538d8640 1 -- 172.21.15.40:0/3066135847 wait complete. 2023-11-04T01:42:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 Processor -- start 2023-11-04T01:42:02.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- start start 2023-11-04T01:42:02.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c06f8f0 0x7f984c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 0x7f984c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c15afd0 0x7f984c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0b4630 con 0x7f984c0b0d40 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c150f90 con 0x7f984c15afd0 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0b25b0 con 0x7f984c06f8f0 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 0x7f984c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 0x7f984c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40566/0 (socket says 172.21.15.40:40566) 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 -- 172.21.15.40:0/594721652 learned_addr learned my addr 172.21.15.40:0/594721652 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:02.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9851e75640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c15afd0 0x7f984c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9851674640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c06f8f0 0x7f984c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 -- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c06f8f0 msgr2=0x7f984c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c06f8f0 0x7f984c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 -- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c15afd0 msgr2=0x7f984c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c15afd0 0x7f984c0c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 -- 172.21.15.40:0/594721652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844009a70 con 0x7f984c0b0d40 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9850e73640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 0x7f984c0b40f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c420 tx=0x7f983c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c0052d0 con 0x7f984c0b0d40 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c005430 con 0x7f984c0b0d40 2023-11-04T01:42:02.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c0b28b0 con 0x7f984c0b0d40 2023-11-04T01:42:02.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c007260 con 0x7f984c0b0d40 2023-11-04T01:42:02.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c0b2b30 con 0x7f984c0b0d40 2023-11-04T01:42:02.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c0744a0 con 0x7f984c0b0d40 2023-11-04T01:42:02.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.070+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f983c0073c0 con 0x7f984c0b0d40 2023-11-04T01:42:02.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.074+0000 7f9841ffb640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98300664a0 0x7f9830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.074+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f983c083010 con 0x7f984c0b0d40 2023-11-04T01:42:02.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.074+0000 7f9851674640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98300664a0 0x7f9830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.074+0000 7f9851674640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98300664a0 0x7f9830068960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9848009a40 tx=0x7f9848008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.078+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f983c050710 con 0x7f984c0b0d40 2023-11-04T01:42:02.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.290+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f984c06cba0 con 0x7f984c0b0d40 2023-11-04T01:42:02.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.290+0000 7f9841ffb640 1 -- 172.21.15.40:0/594721652 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f983c053d30 con 0x7f984c0b0d40 2023-11-04T01:42:02.296 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg==", 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.297 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ==", 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-11-04T01:42:02.298 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw==", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ==", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.299 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg==", 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.300 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg==", 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.301 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w==", 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g==", 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA==", 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.303 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg==", 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w==", 2023-11-04T01:42:02.304 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA==", 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.305 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q==", 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow r", 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.306 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ==", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg==", 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.307 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw==", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:42:02.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlYH5cAhAAAtiBIRwfeOo/LLvHf3APaQ==", 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.309 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ==", 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ==", 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:02.310 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:42:02.311 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:02.311 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:02.311 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.311 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:02.311 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-11-04T01:42:02.311 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98300664a0 msgr2=0x7f9830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98300664a0 0x7f9830068960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9848009a40 tx=0x7f9848008040 comp rx=0 tx=0).stop 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 msgr2=0x7f984c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 0x7f984c0b40f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c420 tx=0x7f983c00c8e0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 shutdown_connections 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98300664a0 0x7f9830068960 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f984c15afd0 0x7f984c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f984c0b0d40 0x7f984c0b40f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 --2- 172.21.15.40:0/594721652 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f984c06f8f0 0x7f984c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 >> 172.21.15.40:0/594721652 conn(0x7f984c0cebb0 msgr2=0x7f984c1579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 shutdown_connections 2023-11-04T01:42:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.294+0000 7f98538d8640 1 -- 172.21.15.40:0/594721652 wait complete. 2023-11-04T01:42:02.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.434+0000 7f2cd3d8d640 1 Processor -- start 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.434+0000 7f2cd3d8d640 1 -- start start 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd3d8d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ccc15d2b0 0x7f2ccc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd3d8d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15d690 0x7f2ccc0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd3d8d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0cd160 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd3d8d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0ad450 con 0x7f2ccc15d2b0 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd3d8d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0cd400 con 0x7f2ccc15d690 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ccc15d2b0 0x7f2ccc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ccc15d2b0 0x7f2ccc06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40568/0 (socket says 172.21.15.40:40568) 2023-11-04T01:42:02.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1040177657 learned_addr learned my addr 172.21.15.40:0/1040177657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:02.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1328640 1 --2- 172.21.15.40:0/1040177657 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15d690 0x7f2ccc0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1040177657 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15d690 msgr2=0x7f2ccc0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 --2- 172.21.15.40:0/1040177657 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15d690 0x7f2ccc0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1040177657 >> v1:172.21.15.91:6789/0 conn(0x7f2ccc06f8f0 legacy=0x7f2ccc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.438+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1040177657 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0cd6e0 con 0x7f2ccc15d2b0 2023-11-04T01:42:02.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd1b29640 1 --2- 172.21.15.40:0/1040177657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc15d2b0 0x7f2ccc06c630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009870 tx=0x7f2cc001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03344328abb4635 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd0b27640 1 -- 172.21.15.40:0/1040177657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00a6040 con 0x7f2ccc15d2b0 2023-11-04T01:42:02.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd0b27640 1 -- 172.21.15.40:0/1040177657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00aa600 con 0x7f2ccc15d2b0 2023-11-04T01:42:02.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd0b27640 1 -- 172.21.15.40:0/1040177657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00aa990 con 0x7f2ccc15d2b0 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1040177657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc15d2b0 msgr2=0x7f2ccc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1040177657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc15d2b0 0x7f2ccc06c630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009870 tx=0x7f2cc001c480 comp rx=0 tx=0).stop 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1040177657 shutdown_connections 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1040177657 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15d690 0x7f2ccc0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1040177657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc15d2b0 0x7f2ccc06c630 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1040177657 >> 172.21.15.40:0/1040177657 conn(0x7f2ccc0cebb0 msgr2=0x7f2ccc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1040177657 shutdown_connections 2023-11-04T01:42:02.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1040177657 wait complete. 2023-11-04T01:42:02.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 Processor -- start 2023-11-04T01:42:02.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 -- start start 2023-11-04T01:42:02.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 0x7f2ccc149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ccc15d690 0x7f2ccc0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.442+0000 7f2cd3d8d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15a610 0x7f2ccc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd3d8d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc148d60 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd3d8d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0b4730 con 0x7f2ccc15d690 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd3d8d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc1499f0 con 0x7f2ccc15a610 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 0x7f2ccc149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 0x7f2ccc149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40578/0 (socket says 172.21.15.40:40578) 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1884016001 learned_addr learned my addr 172.21.15.40:0/1884016001 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1328640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ccc15d690 0x7f2ccc0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd232a640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15a610 0x7f2ccc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15a610 msgr2=0x7f2ccc0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15a610 0x7f2ccc0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ccc15d690 msgr2=0x7f2ccc0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ccc15d690 0x7f2ccc0b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 -- 172.21.15.40:0/1884016001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00094d0 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1b29640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 0x7f2ccc149e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000c10 tx=0x7f2cc001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00b3800 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00a6030 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc0b4490 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00b3bc0 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc1493a0 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc0744a0 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cc00b3d20 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cbe7fc640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2cb00664a0 0x7f2cb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2cc011db80 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1328640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2cb00664a0 0x7f2cb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.446+0000 7f2cd1328640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2cb00664a0 0x7f2cb0068960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8003fd0 tx=0x7f2cc80039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.450+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2cc00eb1f0 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.602+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ccc071cb0 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.602+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/1884016001 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14550 (secure 0 0 0) 0x7f2cc00ee810 con 0x7f2ccc06f8f0 2023-11-04T01:42:02.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:02.610 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":58,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:01.909386+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2cb00664a0 msgr2=0x7f2cb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2cb00664a0 0x7f2cb0068960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8003fd0 tx=0x7f2cc80039a0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 msgr2=0x7f2ccc149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 0x7f2ccc149e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000c10 tx=0x7f2cc001acc0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 shutdown_connections 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2cb00664a0 0x7f2cb0068960 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ccc15a610 0x7f2ccc0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ccc15d690 0x7f2ccc0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 --2- 172.21.15.40:0/1884016001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ccc06f8f0 0x7f2ccc149e80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 >> 172.21.15.40:0/1884016001 conn(0x7f2ccc0cebb0 msgr2=0x7f2ccc0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 shutdown_connections 2023-11-04T01:42:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.606+0000 7f2cd3d8d640 1 -- 172.21.15.40:0/1884016001 wait complete. 2023-11-04T01:42:02.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:02.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:02.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 Processor -- start 2023-11-04T01:42:02.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 -- start start 2023-11-04T01:42:02.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da015d0b0 0x7f3da0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3da01610f0 0x7f3da00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da00b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00d1520 con 0x7f3da015d0b0 2023-11-04T01:42:02.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00d01e0 con 0x7f3da01610f0 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3da4b50640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00b5e00 con 0x7f3da00cfd50 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da015d0b0 0x7f3da0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da015d0b0 0x7f3da0160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 -- 172.21.15.40:0/1182826426 learned_addr learned my addr 172.21.15.40:0/1182826426 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9dd9b640 1 --2- 172.21.15.40:0/1182826426 >> v2:172.21.15.91:3300/0 conn(0x7f3da01610f0 0x7f3da00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9ed9d640 1 --2- 172.21.15.40:0/1182826426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da00b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 -- 172.21.15.40:0/1182826426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 msgr2=0x7f3da00b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 --2- 172.21.15.40:0/1182826426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da00b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 -- 172.21.15.40:0/1182826426 >> v2:172.21.15.91:3300/0 conn(0x7f3da01610f0 msgr2=0x7f3da00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 --2- 172.21.15.40:0/1182826426 >> v2:172.21.15.91:3300/0 conn(0x7f3da01610f0 0x7f3da00cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.750+0000 7f3d9e59c640 1 -- 172.21.15.40:0/1182826426 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da015d490 con 0x7f3da015d0b0 2023-11-04T01:42:02.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3d9e59c640 1 --2- 172.21.15.40:0/1182826426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da015d0b0 0x7f3da0160bb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3da0160b10 tx=0x7f3d9001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40e286c4ac9fabf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3d9d59a640 1 -- 172.21.15.40:0/1182826426 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d900ab600 con 0x7f3da015d0b0 2023-11-04T01:42:02.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3d9d59a640 1 -- 172.21.15.40:0/1182826426 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d900a7050 con 0x7f3da015d0b0 2023-11-04T01:42:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3d9d59a640 1 -- 172.21.15.40:0/1182826426 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d900ab980 con 0x7f3da015d0b0 2023-11-04T01:42:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- 172.21.15.40:0/1182826426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da015d0b0 msgr2=0x7f3da0160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- 172.21.15.40:0/1182826426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da015d0b0 0x7f3da0160bb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3da0160b10 tx=0x7f3d9001c240 comp rx=0 tx=0).stop 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- 172.21.15.40:0/1182826426 shutdown_connections 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- 172.21.15.40:0/1182826426 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da00b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- 172.21.15.40:0/1182826426 >> v2:172.21.15.91:3300/0 conn(0x7f3da01610f0 0x7f3da00cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- 172.21.15.40:0/1182826426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da015d0b0 0x7f3da0160bb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- 172.21.15.40:0/1182826426 >> 172.21.15.40:0/1182826426 conn(0x7f3da006a890 msgr2=0x7f3da006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- 172.21.15.40:0/1182826426 shutdown_connections 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- 172.21.15.40:0/1182826426 wait complete. 2023-11-04T01:42:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 Processor -- start 2023-11-04T01:42:02.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- start start 2023-11-04T01:42:02.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3da015d0b0 0x7f3da015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 0x7f3da00c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da015af00 con 0x7f3da01610f0 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da014ca80 con 0x7f3da015d0b0 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3da4b50640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da014cd60 con 0x7f3da00cfd50 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.754+0000 7f3d9ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 0x7f3da00c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 0x7f3da00c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40604/0 (socket says 172.21.15.40:40604) 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 -- 172.21.15.40:0/2019714856 learned_addr learned my addr 172.21.15.40:0/2019714856 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9e59c640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9dd9b640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3da015d0b0 0x7f3da015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 -- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 msgr2=0x7f3da014c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da014c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 -- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3da015d0b0 msgr2=0x7f3da015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3da015d0b0 0x7f3da015c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 -- 172.21.15.40:0/2019714856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900094d0 con 0x7f3da01610f0 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9ed9d640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 0x7f3da00c8840 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d98007e60 tx=0x7f3d9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98014620 con 0x7f3da01610f0 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9800ee90 con 0x7f3da01610f0 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da014d040 con 0x7f3da01610f0 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980149e0 con 0x7f3da01610f0 2023-11-04T01:42:02.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da014d600 con 0x7f3da01610f0 2023-11-04T01:42:02.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da014dc10 con 0x7f3da01610f0 2023-11-04T01:42:02.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d98014b40 con 0x7f3da01610f0 2023-11-04T01:42:02.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d8effd640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d800664a0 0x7f3d80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3d980845c0 con 0x7f3da01610f0 2023-11-04T01:42:02.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9e59c640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d800664a0 0x7f3d80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.758+0000 7f3d9e59c640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d800664a0 0x7f3d80068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d900ad000 tx=0x7f3d90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.762+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d98051ba0 con 0x7f3da01610f0 2023-11-04T01:42:02.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.918+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3da00744a0 con 0x7f3da01610f0 2023-11-04T01:42:02.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3d8effd640 1 -- 172.21.15.40:0/2019714856 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d980551c0 con 0x7f3da01610f0 2023-11-04T01:42:02.926 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:02.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d800664a0 msgr2=0x7f3d80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d800664a0 0x7f3d80068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d900ad000 tx=0x7f3d90008040 comp rx=0 tx=0).stop 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 msgr2=0x7f3da00c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 0x7f3da00c8840 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d98007e60 tx=0x7f3d9800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 shutdown_connections 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d800664a0 0x7f3d80068960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da01610f0 0x7f3da00c8840 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3da015d0b0 0x7f3da015c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 --2- 172.21.15.40:0/2019714856 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3da00cfd50 0x7f3da014c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 >> 172.21.15.40:0/2019714856 conn(0x7f3da006a890 msgr2=0x7f3da00b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 shutdown_connections 2023-11-04T01:42:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:02.922+0000 7f3da4b50640 1 -- 172.21.15.40:0/2019714856 wait complete. 2023-11-04T01:42:02.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:03.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.070+0000 7fb49cfd1640 1 Processor -- start 2023-11-04T01:42:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.070+0000 7fb49cfd1640 1 -- start start 2023-11-04T01:42:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49cfd1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb49815e330 0x7fb4980ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49cfd1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980c9fe0 con 0x7fb4980ce1b0 2023-11-04T01:42:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49cfd1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980c96b0 con 0x7fb498159fd0 2023-11-04T01:42:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49cfd1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980c9990 con 0x7fb49815e330 2023-11-04T01:42:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb495d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb4980ce1b0 0x7fb49815dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56108/0 (socket says 172.21.15.40:56108) 2023-11-04T01:42:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb496d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb49815e330 0x7fb4980ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb495d9b640 1 -- 172.21.15.40:0/3006971744 learned_addr learned my addr 172.21.15.40:0/3006971744 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:03.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49559a640 1 -- 172.21.15.40:0/3006971744 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548471531 0 0) 0x7fb4980c9fe0 con 0x7fb4980ce1b0 2023-11-04T01:42:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49559a640 1 -- 172.21.15.40:0/3006971744 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb484005740 con 0x7fb4980ce1b0 2023-11-04T01:42:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb496d9d640 1 -- 172.21.15.40:0/3006971744 >> v1:172.21.15.91:6789/0 conn(0x7fb498159fd0 legacy=0x7fb4980cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb496d9d640 1 -- 172.21.15.40:0/3006971744 >> v1:172.21.15.40:6789/0 conn(0x7fb4980ce1b0 legacy=0x7fb49815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb496d9d640 1 -- 172.21.15.40:0/3006971744 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980c9c70 con 0x7fb49815e330 2023-11-04T01:42:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb496d9d640 1 --2- 172.21.15.40:0/3006971744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49815e330 0x7fb4980ca470 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb490009d90 tx=0x7fb49001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486014e696794ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49559a640 1 -- 172.21.15.40:0/3006971744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900a5810 con 0x7fb49815e330 2023-11-04T01:42:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49559a640 1 -- 172.21.15.40:0/3006971744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4900a5970 con 0x7fb49815e330 2023-11-04T01:42:03.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.074+0000 7fb49559a640 1 -- 172.21.15.40:0/3006971744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900a5d00 con 0x7fb49815e330 2023-11-04T01:42:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- 172.21.15.40:0/3006971744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49815e330 msgr2=0x7fb4980ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/3006971744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49815e330 0x7fb4980ca470 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb490009d90 tx=0x7fb49001c950 comp rx=0 tx=0).stop 2023-11-04T01:42:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- 172.21.15.40:0/3006971744 shutdown_connections 2023-11-04T01:42:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/3006971744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49815e330 0x7fb4980ca470 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- 172.21.15.40:0/3006971744 >> 172.21.15.40:0/3006971744 conn(0x7fb4980cb510 msgr2=0x7fb4980cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- 172.21.15.40:0/3006971744 shutdown_connections 2023-11-04T01:42:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- 172.21.15.40:0/3006971744 wait complete. 2023-11-04T01:42:03.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 Processor -- start 2023-11-04T01:42:03.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- start start 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4980ce1b0 0x7fb4980c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 0x7fb4980c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49815e330 0x7fb4980b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c8940 con 0x7fb498159fd0 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c6940 con 0x7fb4980ce1b0 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c8380 con 0x7fb49815e330 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 0x7fb4980c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 0x7fb4980c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40620/0 (socket says 172.21.15.40:40620) 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 -- 172.21.15.40:0/2410338093 learned_addr learned my addr 172.21.15.40:0/2410338093 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49659c640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4980ce1b0 0x7fb4980c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb496d9d640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49815e330 0x7fb4980b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 -- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49815e330 msgr2=0x7fb4980b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49815e330 0x7fb4980b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 -- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4980ce1b0 msgr2=0x7fb4980c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4980ce1b0 0x7fb4980c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 -- 172.21.15.40:0/2410338093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009a70 con 0x7fb498159fd0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb495d9b640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 0x7fb4980c7980 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c4d0 tx=0x7fb48000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480005cf0 con 0x7fb498159fd0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480005e50 con 0x7fb498159fd0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480007270 con 0x7fb498159fd0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.078+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4980c8660 con 0x7fb498159fd0 2023-11-04T01:42:03.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4980c5ee0 con 0x7fb498159fd0 2023-11-04T01:42:03.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4980c6100 con 0x7fb498159fd0 2023-11-04T01:42:03.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4800073d0 con 0x7fb498159fd0 2023-11-04T01:42:03.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb48effd640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4780664a0 0x7fb478068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb480083250 con 0x7fb498159fd0 2023-11-04T01:42:03.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb49659c640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4780664a0 0x7fb478068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.082+0000 7fb49659c640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4780664a0 0x7fb478068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb488001650 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.086+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4800508d0 con 0x7fb498159fd0 2023-11-04T01:42:03.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.242+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb4980744a0 con 0x7fb498159fd0 2023-11-04T01:42:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.242+0000 7fb48effd640 1 -- 172.21.15.40:0/2410338093 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v58) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb480053ef0 con 0x7fb498159fd0 2023-11-04T01:42:03.249 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:03.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4780664a0 msgr2=0x7fb478068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4780664a0 0x7fb478068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb488001650 tx=0x7fb488009040 comp rx=0 tx=0).stop 2023-11-04T01:42:03.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 msgr2=0x7fb4980c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 0x7fb4980c7980 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c4d0 tx=0x7fb48000c990 comp rx=0 tx=0).stop 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 shutdown_connections 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4780664a0 0x7fb478068960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49815e330 0x7fb4980b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb498159fd0 0x7fb4980c7980 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 --2- 172.21.15.40:0/2410338093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4980ce1b0 0x7fb4980c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 >> 172.21.15.40:0/2410338093 conn(0x7fb4980cb510 msgr2=0x7fb4980b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 shutdown_connections 2023-11-04T01:42:03.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.246+0000 7fb49cfd1640 1 -- 172.21.15.40:0/2410338093 wait complete. 2023-11-04T01:42:03.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:42:03.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 Processor -- start 2023-11-04T01:42:03.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 -- start start 2023-11-04T01:42:03.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 0x7f02f806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f02f806f8f0 0x7f02f80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80cd400 con 0x7f02f815d2b0 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80ad450 con 0x7f02f806f8f0 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02fd2a6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cd6e0 con 0x7f02f815d690 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f02f815d2b0 0x7f02f80ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56112/0 (socket says 172.21.15.40:56112) 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f6ffd640 1 -- 172.21.15.40:0/1600116709 learned_addr learned my addr 172.21.15.40:0/1600116709 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f77fe640 1 --2- 172.21.15.40:0/1600116709 >> v2:172.21.15.91:3300/0 conn(0x7f02f806f8f0 0x7f02f80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 0x7f02f806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257072179 0 0) 0x7f02f80cd400 con 0x7f02f815d2b0 2023-11-04T01:42:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e4003530 con 0x7f02f815d2b0 2023-11-04T01:42:03.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859972315 0 0) 0x7f02e4003530 con 0x7f02f815d2b0 2023-11-04T01:42:03.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 msgr2=0x7f02f806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 0x7f02f806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 >> v2:172.21.15.91:3300/0 conn(0x7f02f806f8f0 msgr2=0x7f02f80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 --2- 172.21.15.40:0/1600116709 >> v2:172.21.15.91:3300/0 conn(0x7f02f806f8f0 0x7f02f80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80ad070 con 0x7f02f815d2b0 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f02e0001680 con 0x7f02f815d2b0 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 >> v1:172.21.15.40:6789/0 conn(0x7f02f815d2b0 legacy=0x7f02f80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02e4003980 0x7f02e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 0x7f02e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80ad450 con 0x7f02e40047d0 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cd6e0 con 0x7f02e4003980 2023-11-04T01:42:03.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e400b990 con 0x7f02f815d690 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f6ffd640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02e4003980 0x7f02e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 -- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 msgr2=0x7f02e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f77fe640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 0x7f02e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02f815d690 0x7f02e4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 -- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02e4003980 msgr2=0x7f02e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02e4003980 0x7f02e4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f67fc640 1 -- 172.21.15.40:0/1600116709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4003530 con 0x7f02e40047d0 2023-11-04T01:42:03.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.378+0000 7f02f6ffd640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02e4003980 0x7f02e4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02f67fc640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009ae0 tx=0x7f02e801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2da5525ccb2882b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80a6430 con 0x7f02e40047d0 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e80a6590 con 0x7f02e40047d0 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02f5ffb640 1 -- 172.21.15.40:0/1600116709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80a6940 con 0x7f02e40047d0 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02fd2a6640 1 -- 172.21.15.40:0/1600116709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02e40047d0 msgr2=0x7f02e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/1600116709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02e40047d0 0x7f02e4004c50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009ae0 tx=0x7f02e801c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02f77fe640 1 -- 172.21.15.40:0/1600116709 reap_dead start 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02fd2a6640 1 -- 172.21.15.40:0/1600116709 shutdown_connections 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02fd2a6640 1 -- 172.21.15.40:0/1600116709 >> 172.21.15.40:0/1600116709 conn(0x7f02f80cebb0 msgr2=0x7f02f80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02fd2a6640 1 -- 172.21.15.40:0/1600116709 shutdown_connections 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.382+0000 7f02fd2a6640 1 -- 172.21.15.40:0/1600116709 wait complete. 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 Processor -- start 2023-11-04T01:42:03.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- start start 2023-11-04T01:42:03.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02e40047d0 0x7f02f80cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 0x7f02f80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02f80c9d10 0x7f02f80af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8155cb0 con 0x7f02f8154340 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cbdb0 con 0x7f02f80c9d10 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80cc090 con 0x7f02e40047d0 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 0x7f02f80c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 0x7f02f80c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40630/0 (socket says 172.21.15.40:40630) 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 -- 172.21.15.40:0/4171252021 learned_addr learned my addr 172.21.15.40:0/4171252021 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f77fe640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02f80c9d10 0x7f02f80af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f6ffd640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02e40047d0 0x7f02f80cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 -- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02e40047d0 msgr2=0x7f02f80cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02e40047d0 0x7f02f80cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 -- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02f80c9d10 msgr2=0x7f02f80af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02f80c9d10 0x7f02f80af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 -- 172.21.15.40:0/4171252021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f806fee0 con 0x7f02f8154340 2023-11-04T01:42:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02f67fc640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 0x7f02f80c97d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009ae0 tx=0x7f02e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800f000 con 0x7f02f8154340 2023-11-04T01:42:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e80a6d00 con 0x7f02f8154340 2023-11-04T01:42:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f8155ec0 con 0x7f02f8154340 2023-11-04T01:42:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80b9630 con 0x7f02f8154340 2023-11-04T01:42:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f80cb960 con 0x7f02f8154340 2023-11-04T01:42:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f80744a0 con 0x7f02f8154340 2023-11-04T01:42:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02e80a7410 con 0x7f02f8154340 2023-11-04T01:42:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02ef7fe640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02d80664a0 0x7f02d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.386+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f02e811d7f0 con 0x7f02f8154340 2023-11-04T01:42:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.390+0000 7f02f6ffd640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02d80664a0 0x7f02d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.390+0000 7f02f6ffd640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02d80664a0 0x7f02d8068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02e00018f0 tx=0x7f02e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.390+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02e80eb010 con 0x7f02f8154340 2023-11-04T01:42:03.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f02f8071cb0 con 0x7f02f8154340 2023-11-04T01:42:03.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02ef7fe640 1 -- 172.21.15.40:0/4171252021 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+137 (secure 0 0 0) 0x7f02e80ee630 con 0x7f02f8154340 2023-11-04T01:42:03.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 6, 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "snap-test-pool" 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:03.556 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-11-04T01:42:03.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02d80664a0 msgr2=0x7f02d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02d80664a0 0x7f02d8068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02e00018f0 tx=0x7f02e0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:03.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 msgr2=0x7f02f80c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 0x7f02f80c97d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009ae0 tx=0x7f02e4005800 comp rx=0 tx=0).stop 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 shutdown_connections 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02d80664a0 0x7f02d8068960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02f80c9d10 0x7f02f80af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f8154340 0x7f02f80c97d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 --2- 172.21.15.40:0/4171252021 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f02e40047d0 0x7f02f80cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 >> 172.21.15.40:0/4171252021 conn(0x7f02f80cebb0 msgr2=0x7f02f8159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 shutdown_connections 2023-11-04T01:42:03.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.550+0000 7f02fd2a6640 1 -- 172.21.15.40:0/4171252021 wait complete. 2023-11-04T01:42:03.574 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:42:03.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:42:03.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 Processor -- start 2023-11-04T01:42:03.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 -- start start 2023-11-04T01:42:03.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15b1b0 0x7f130c0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f130c0701e0 0x7f130c0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c0aebd0 con 0x7f130c15ec00 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c15b590 con 0x7f130c0701e0 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1314706640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0cdf60 con 0x7f130c15b1b0 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f130c0701e0 0x7f130c0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f130c0701e0 0x7f130c0ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40646/0 (socket says 172.21.15.40:40646) 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 -- 172.21.15.40:0/2307174016 learned_addr learned my addr 172.21.15.40:0/2307174016 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f13124a2640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15b1b0 0x7f130c0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 -- 172.21.15.40:0/2307174016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15b1b0 msgr2=0x7f130c0ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15b1b0 0x7f130c0ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 -- 172.21.15.40:0/2307174016 >> v1:172.21.15.91:6789/0 conn(0x7f130c15ec00 legacy=0x7f130c15f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f1311ca1640 1 -- 172.21.15.40:0/2307174016 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0ce240 con 0x7f130c0701e0 2023-11-04T01:42:03.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.698+0000 7f13124a2640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15b1b0 0x7f130c0ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:03.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1311ca1640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c0701e0 0x7f130c0ceb90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1300009870 tx=0x7f130001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4914b436b85c05c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f13114a0640 1 -- 172.21.15.40:0/2307174016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000a9400 con 0x7f130c0701e0 2023-11-04T01:42:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f13114a0640 1 -- 172.21.15.40:0/2307174016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000a9560 con 0x7f130c0701e0 2023-11-04T01:42:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f13114a0640 1 -- 172.21.15.40:0/2307174016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000a98f0 con 0x7f130c0701e0 2023-11-04T01:42:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- 172.21.15.40:0/2307174016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c0701e0 msgr2=0x7f130c0ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c0701e0 0x7f130c0ceb90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1300009870 tx=0x7f130001c540 comp rx=0 tx=0).stop 2023-11-04T01:42:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- 172.21.15.40:0/2307174016 shutdown_connections 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c0701e0 0x7f130c0ceb90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 --2- 172.21.15.40:0/2307174016 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15b1b0 0x7f130c0ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- 172.21.15.40:0/2307174016 >> 172.21.15.40:0/2307174016 conn(0x7f130c0cbd80 msgr2=0x7f130c0cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- 172.21.15.40:0/2307174016 shutdown_connections 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- 172.21.15.40:0/2307174016 wait complete. 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 Processor -- start 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- start start 2023-11-04T01:42:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f130c0701e0 0x7f130c0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 0x7f130c0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15ec00 0x7f130c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c3160 con 0x7f130c15b1b0 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c9260 con 0x7f130c0701e0 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1314706640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c5710 con 0x7f130c15ec00 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1311ca1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 0x7f130c0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1311ca1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 0x7f130c0c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40656/0 (socket says 172.21.15.40:40656) 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.702+0000 7f1311ca1640 1 -- 172.21.15.40:0/876238188 learned_addr learned my addr 172.21.15.40:0/876238188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f13124a2640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f130c0701e0 0x7f130c0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1312ca3640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15ec00 0x7f130c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1311ca1640 1 -- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15ec00 msgr2=0x7f130c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1311ca1640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15ec00 0x7f130c14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1311ca1640 1 -- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f130c0701e0 msgr2=0x7f130c0c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1311ca1640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f130c0701e0 0x7f130c0c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1311ca1640 1 -- 172.21.15.40:0/876238188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000094d0 con 0x7f130c15b1b0 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1311ca1640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 0x7f130c0c8d20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f130001ca20 tx=0x7f13000192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000b1800 con 0x7f130c15b1b0 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000b1960 con 0x7f130c15b1b0 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c0c5980 con 0x7f130c15b1b0 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000b1cf0 con 0x7f130c15b1b0 2023-11-04T01:42:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c152bb0 con 0x7f130c15b1b0 2023-11-04T01:42:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c15ad00 con 0x7f130c15b1b0 2023-11-04T01:42:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13000b7070 con 0x7f130c15b1b0 2023-11-04T01:42:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f12feffd640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12f00664a0 0x7f12f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f130011e1a0 con 0x7f130c15b1b0 2023-11-04T01:42:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.706+0000 7f13124a2640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12f00664a0 0x7f12f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.710+0000 7f13124a2640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12f00664a0 0x7f12f0068960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f130800a9a0 tx=0x7f1308008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.710+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13000eba10 con 0x7f130c15b1b0 2023-11-04T01:42:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.866+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f130c0c5b90 con 0x7f130c15b1b0 2023-11-04T01:42:03.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f12feffd640 1 -- 172.21.15.40:0/876238188 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13000a6030 con 0x7f130c15b1b0 2023-11-04T01:42:03.947 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-11-04T01:42:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12f00664a0 msgr2=0x7f12f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12f00664a0 0x7f12f0068960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f130800a9a0 tx=0x7f1308008040 comp rx=0 tx=0).stop 2023-11-04T01:42:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 msgr2=0x7f130c0c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 0x7f130c0c8d20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f130001ca20 tx=0x7f13000192e0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 shutdown_connections 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12f00664a0 0x7f12f0068960 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f130c15ec00 0x7f130c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130c15b1b0 0x7f130c0c8d20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 --2- 172.21.15.40:0/876238188 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f130c0701e0 0x7f130c0c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 >> 172.21.15.40:0/876238188 conn(0x7f130c0cbd80 msgr2=0x7f130c157610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 shutdown_connections 2023-11-04T01:42:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:03.942+0000 7f1314706640 1 -- 172.21.15.40:0/876238188 wait complete. 2023-11-04T01:42:03.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:42:04.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 Processor -- start 2023-11-04T01:42:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 -- start start 2023-11-04T01:42:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8f40ccbf0 0x7ff8f40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f40ce920 0x7ff8f40ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40b65f0 con 0x7ff8f40ce920 2023-11-04T01:42:04.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40cfb40 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f89e7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40cf2b0 con 0x7ff8f4158be0 2023-11-04T01:42:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f40ce920 0x7ff8f40ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f40ce920 0x7ff8f40ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40658/0 (socket says 172.21.15.40:40658) 2023-11-04T01:42:04.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.098+0000 7ff8f2d9d640 1 -- 172.21.15.40:0/2147655327 learned_addr learned my addr 172.21.15.40:0/2147655327 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/2147655327 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40ccbf0 0x7ff8f40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f259c640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f2d9d640 1 -- 172.21.15.40:0/2147655327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 msgr2=0x7ff8f415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f2d9d640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f2d9d640 1 -- 172.21.15.40:0/2147655327 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40ccbf0 msgr2=0x7ff8f40b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f2d9d640 1 --2- 172.21.15.40:0/2147655327 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40ccbf0 0x7ff8f40b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f2d9d640 1 -- 172.21.15.40:0/2147655327 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40cfd50 con 0x7ff8f40ce920 2023-11-04T01:42:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f259c640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f2d9d640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ce920 0x7ff8f40ced70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4070740 tx=0x7ff8ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f56a0a4e3414dae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f159a640 1 -- 172.21.15.40:0/2147655327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0a5820 con 0x7ff8f40ce920 2023-11-04T01:42:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f159a640 1 -- 172.21.15.40:0/2147655327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0a5980 con 0x7ff8f40ce920 2023-11-04T01:42:04.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f159a640 1 -- 172.21.15.40:0/2147655327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0a5d10 con 0x7ff8f40ce920 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 -- 172.21.15.40:0/2147655327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ce920 msgr2=0x7ff8f40ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ce920 0x7ff8f40ced70 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4070740 tx=0x7ff8ec01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 -- 172.21.15.40:0/2147655327 shutdown_connections 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ce920 0x7ff8f40ced70 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/2147655327 >> v2:172.21.15.91:3300/0 conn(0x7ff8f40ccbf0 0x7ff8f40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/2147655327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 -- 172.21.15.40:0/2147655327 >> 172.21.15.40:0/2147655327 conn(0x7ff8f406f750 msgr2=0x7ff8f406fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 -- 172.21.15.40:0/2147655327 shutdown_connections 2023-11-04T01:42:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.102+0000 7ff8f89e7640 1 -- 172.21.15.40:0/2147655327 wait complete. 2023-11-04T01:42:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 Processor -- start 2023-11-04T01:42:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- start start 2023-11-04T01:42:04.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 0x7ff8f41f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f40ce920 0x7ff8f4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f4155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f406b350 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b56c0 con 0x7ff8f40ce920 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f41f9a10 con 0x7ff8f4158be0 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 0x7ff8f41f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 0x7ff8f41f94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40674/0 (socket says 172.21.15.40:40674) 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 -- 172.21.15.40:0/3743579252 learned_addr learned my addr 172.21.15.40:0/3743579252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f40ce920 0x7ff8f4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 -- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 msgr2=0x7ff8f4155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f2d9d640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f4155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 -- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f40ce920 msgr2=0x7ff8f4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f40ce920 0x7ff8f4156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 -- 172.21.15.40:0/3743579252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009b30 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f40ce920 0x7ff8f4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:04.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f259c640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 0x7ff8f41f94d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c820 tx=0x7ff8e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4007a30 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4007b90 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e400ce10 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f40b3490 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f40b3a50 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f40675f0 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.106+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8e4024480 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.110+0000 7ff8e2ffd640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8d40664a0 0x7ff8d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.110+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff8e4084180 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.110+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8d40664a0 0x7ff8d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.110+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8d40664a0 0x7ff8d4068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4165130 tx=0x7ff8e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:04.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.114+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8e40517f0 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.262+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff8f415c660 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.946+0000 7ff8e2ffd640 1 -- 172.21.15.40:0/3743579252 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff8e4054e10 con 0x7ff8f40ccbf0 2023-11-04T01:42:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8d40664a0 msgr2=0x7ff8d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8d40664a0 0x7ff8d4068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4165130 tx=0x7ff8e8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 msgr2=0x7ff8f41f94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 0x7ff8f41f94d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c820 tx=0x7ff8e400cce0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 shutdown_connections 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8d40664a0 0x7ff8d4068960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8f4158be0 0x7ff8f4155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8f40ce920 0x7ff8f4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 --2- 172.21.15.40:0/3743579252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40ccbf0 0x7ff8f41f94d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 >> 172.21.15.40:0/3743579252 conn(0x7ff8f406f750 msgr2=0x7ff8f40d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 shutdown_connections 2023-11-04T01:42:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:04.950+0000 7ff8f89e7640 1 -- 172.21.15.40:0/3743579252 wait complete. 2023-11-04T01:42:04.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:42:05.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 Processor -- start 2023-11-04T01:42:05.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 -- start start 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f365c0ce1b0 0x7f365c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c06d160 0x7f365c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c15e800 con 0x7f365c15af70 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c071200 con 0x7f365c0ce1b0 2023-11-04T01:42:05.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3660ced640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c06c0c0 con 0x7f365c06d160 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f365ad9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c06d160 0x7f365c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f365c0ce1b0 0x7f365c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f365c0ce1b0 0x7f365c15dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:57500/0 (socket says 172.21.15.40:57500) 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 -- 172.21.15.40:0/4057196212 learned_addr learned my addr 172.21.15.40:0/4057196212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f365ad9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c06d160 0x7f365c15e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:44516/0 (socket says 172.21.15.40:44516) 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 -- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c06d160 msgr2=0x7f365c15e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 --2- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c06d160 0x7f365c15e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 -- 172.21.15.40:0/4057196212 >> v1:172.21.15.91:6789/0 conn(0x7f365c15af70 legacy=0x7f365c0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.118+0000 7f3651d9b640 1 -- 172.21.15.40:0/4057196212 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c06c3a0 con 0x7f365c0ce1b0 2023-11-04T01:42:05.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3651d9b640 1 --2- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c15dd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f364400bb10 tx=0x7f364401ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba9eb1bca6d5e440 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3659d9b640 1 -- 172.21.15.40:0/4057196212 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440a7bd0 con 0x7f365c0ce1b0 2023-11-04T01:42:05.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3659d9b640 1 -- 172.21.15.40:0/4057196212 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36440a7d30 con 0x7f365c0ce1b0 2023-11-04T01:42:05.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3659d9b640 1 -- 172.21.15.40:0/4057196212 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440a7ea0 con 0x7f365c0ce1b0 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 -- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 msgr2=0x7f365c15dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 --2- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c15dd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f364400bb10 tx=0x7f364401ec10 comp rx=0 tx=0).stop 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 -- 172.21.15.40:0/4057196212 shutdown_connections 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 --2- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c06d160 0x7f365c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 --2- 172.21.15.40:0/4057196212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c15dd80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 -- 172.21.15.40:0/4057196212 >> 172.21.15.40:0/4057196212 conn(0x7f365c0cb510 msgr2=0x7f365c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 -- 172.21.15.40:0/4057196212 shutdown_connections 2023-11-04T01:42:05.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 -- 172.21.15.40:0/4057196212 wait complete. 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 Processor -- start 2023-11-04T01:42:05.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.122+0000 7f3660ced640 1 -- start start 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 0x7f365c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c15af70 0x7f365c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0b2bc0 con 0x7f365c06d160 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0c70f0 con 0x7f365c0ce1b0 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c153510 con 0x7f365c15af70 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 0x7f365c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 0x7f365c152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40690/0 (socket says 172.21.15.40:40690) 2023-11-04T01:42:05.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 -- 172.21.15.40:0/1524525206 learned_addr learned my addr 172.21.15.40:0/1524525206 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3651d9b640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365ad9d640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c15af70 0x7f365c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 -- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c15af70 msgr2=0x7f365c0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c15af70 0x7f365c0ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 -- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 msgr2=0x7f365c0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c0b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 -- 172.21.15.40:0/1524525206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364400b770 con 0x7f365c06d160 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f365a59c640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 0x7f365c152fd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c760 tx=0x7f364c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c003ba0 con 0x7f365c06d160 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c003d20 con 0x7f365c06d160 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c0c85e0 con 0x7f365c06d160 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c00aa30 con 0x7f365c06d160 2023-11-04T01:42:05.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0b2570 con 0x7f365c06d160 2023-11-04T01:42:05.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c15d500 con 0x7f365c06d160 2023-11-04T01:42:05.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f364c00ab90 con 0x7f365c06d160 2023-11-04T01:42:05.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f36537fe640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664a0 0x7f363c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f364c083cd0 con 0x7f365c06d160 2023-11-04T01:42:05.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.126+0000 7f3651d9b640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664a0 0x7f363c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.130+0000 7f3651d9b640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664a0 0x7f363c068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f36440b1000 tx=0x7f36440a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.130+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f364c0510e0 con 0x7f365c06d160 2023-11-04T01:42:05.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.326+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f365c0744a0 con 0x7f365c06d160 2023-11-04T01:42:06.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:05.998+0000 7f36537fe640 1 -- 172.21.15.40:0/1524525206 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f364c054700 con 0x7f365c06d160 2023-11-04T01:42:06.005 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 9 and data pool 10 2023-11-04T01:42:06.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664a0 msgr2=0x7f363c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664a0 0x7f363c068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f36440b1000 tx=0x7f36440a9070 comp rx=0 tx=0).stop 2023-11-04T01:42:06.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 msgr2=0x7f365c152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 0x7f365c152fd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c760 tx=0x7f364c00cc20 comp rx=0 tx=0).stop 2023-11-04T01:42:06.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 shutdown_connections 2023-11-04T01:42:06.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664a0 0x7f363c068960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f365c15af70 0x7f365c0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f365c0ce1b0 0x7f365c0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 --2- 172.21.15.40:0/1524525206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f365c06d160 0x7f365c152fd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.010+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 >> 172.21.15.40:0/1524525206 conn(0x7f365c0cb510 msgr2=0x7f365c15a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.014+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 shutdown_connections 2023-11-04T01:42:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.014+0000 7f3660ced640 1 -- 172.21.15.40:0/1524525206 wait complete. 2023-11-04T01:42:06.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:06.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b07e29640 1 Processor -- start 2023-11-04T01:42:06.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b07e29640 1 -- start start 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b07e29640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b000b4990 0x7f3b000b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b07e29640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b6070 con 0x7f3b000b74f0 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b07e29640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b8ed0 con 0x7f3b000d0690 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b07e29640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000ce590 con 0x7f3b000b4990 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b05bc5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b000b4990 0x7f3b000b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b063c6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b000b74f0 0x7f3b000cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56120/0 (socket says 172.21.15.40:56120) 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b063c6640 1 -- 172.21.15.40:0/2695805686 learned_addr learned my addr 172.21.15.40:0/2695805686 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b05bc5640 1 -- 172.21.15.40:0/2695805686 >> v1:172.21.15.91:6789/0 conn(0x7f3b000d0690 legacy=0x7f3b000cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b05bc5640 1 -- 172.21.15.40:0/2695805686 >> v1:172.21.15.40:6789/0 conn(0x7f3b000b74f0 legacy=0x7f3b000cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.162+0000 7f3b05bc5640 1 -- 172.21.15.40:0/2695805686 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000b52b0 con 0x7f3b000b4990 2023-11-04T01:42:06.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b05bc5640 1 --2- 172.21.15.40:0/2695805686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000b4990 0x7f3b000b4d70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af801f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23af14b9e8379205 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b04bc3640 1 -- 172.21.15.40:0/2695805686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80af600 con 0x7f3b000b4990 2023-11-04T01:42:06.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b04bc3640 1 -- 172.21.15.40:0/2695805686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af80ab050 con 0x7f3b000b4990 2023-11-04T01:42:06.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b04bc3640 1 -- 172.21.15.40:0/2695805686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80af980 con 0x7f3b000b4990 2023-11-04T01:42:06.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 -- 172.21.15.40:0/2695805686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000b4990 msgr2=0x7f3b000b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 --2- 172.21.15.40:0/2695805686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000b4990 0x7f3b000b4d70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af801f100 comp rx=0 tx=0).stop 2023-11-04T01:42:06.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 -- 172.21.15.40:0/2695805686 shutdown_connections 2023-11-04T01:42:06.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 --2- 172.21.15.40:0/2695805686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000b4990 0x7f3b000b4d70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 -- 172.21.15.40:0/2695805686 >> 172.21.15.40:0/2695805686 conn(0x7f3b000cf990 msgr2=0x7f3b000cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 -- 172.21.15.40:0/2695805686 shutdown_connections 2023-11-04T01:42:06.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 -- 172.21.15.40:0/2695805686 wait complete. 2023-11-04T01:42:06.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 Processor -- start 2023-11-04T01:42:06.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.166+0000 7f3b07e29640 1 -- start start 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b000b4990 0x7f3b000c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b000b74f0 0x7f3b0015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 0x7f3b000cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015d8b0 con 0x7f3b000d0690 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015db90 con 0x7f3b000b74f0 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015de70 con 0x7f3b000b4990 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 0x7f3b000cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 0x7f3b000cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40712/0 (socket says 172.21.15.40:40712) 2023-11-04T01:42:06.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 -- 172.21.15.40:0/3556222884 learned_addr learned my addr 172.21.15.40:0/3556222884 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b05bc5640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b000b4990 0x7f3b000c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b053c4640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b000b74f0 0x7f3b0015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 -- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b000b4990 msgr2=0x7f3b000c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b000b4990 0x7f3b000c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 -- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b000b74f0 msgr2=0x7f3b0015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b000b74f0 0x7f3b0015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 -- 172.21.15.40:0/3556222884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009a70 con 0x7f3b000d0690 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b053c4640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b000b74f0 0x7f3b0015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b05bc5640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b000b4990 0x7f3b000c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b063c6640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 0x7f3b000cac90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c400 tx=0x7f3af000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0005cf0 con 0x7f3b000d0690 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0005e50 con 0x7f3b000d0690 2023-11-04T01:42:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00072f0 con 0x7f3b000d0690 2023-11-04T01:42:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0015e150 con 0x7f3b000d0690 2023-11-04T01:42:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000c8fa0 con 0x7f3b000d0690 2023-11-04T01:42:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0015e670 con 0x7f3b000d0690 2023-11-04T01:42:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3af0007450 con 0x7f3b000d0690 2023-11-04T01:42:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3afe7fc640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3aec0664a0 0x7f3aec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3af0083530 con 0x7f3b000d0690 2023-11-04T01:42:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.170+0000 7f3b05bc5640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3aec0664a0 0x7f3aec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.174+0000 7f3b05bc5640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3aec0664a0 0x7f3aec068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3af80b1000 tx=0x7f3af80aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.174+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3af0050850 con 0x7f3b000d0690 2023-11-04T01:42:06.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.342+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b000744a0 con 0x7f3b000d0690 2023-11-04T01:42:06.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.342+0000 7f3afe7fc640 1 -- 172.21.15.40:0/3556222884 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18217 (secure 0 0 0) 0x7f3af0053e70 con 0x7f3b000d0690 2023-11-04T01:42:06.349 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:06.350 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":61,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:05.330104+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:06.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3aec0664a0 msgr2=0x7f3aec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3aec0664a0 0x7f3aec068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3af80b1000 tx=0x7f3af80aa000 comp rx=0 tx=0).stop 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 msgr2=0x7f3b000cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 0x7f3b000cac90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c400 tx=0x7f3af000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 shutdown_connections 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3aec0664a0 0x7f3aec068960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b000d0690 0x7f3b000cac90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b000b74f0 0x7f3b0015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 --2- 172.21.15.40:0/3556222884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b000b4990 0x7f3b000c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 >> 172.21.15.40:0/3556222884 conn(0x7f3b000cf990 msgr2=0x7f3b000cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 shutdown_connections 2023-11-04T01:42:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.346+0000 7f3b07e29640 1 -- 172.21.15.40:0/3556222884 wait complete. 2023-11-04T01:42:06.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:06.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.474+0000 7f90ed425640 1 Processor -- start 2023-11-04T01:42:06.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.474+0000 7f90ed425640 1 -- start start 2023-11-04T01:42:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80ae650 0x7f90e80ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90e80aea30 0x7f90e80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80cc6b0 con 0x7f90e8072350 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e80cf4c0 con 0x7f90e80aea30 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80cd700 con 0x7f90e80ae650 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90dffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90e8072350 0x7f90e80ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56130/0 (socket says 172.21.15.40:56130) 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90e80aea30 0x7f90e80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90dffff640 1 -- 172.21.15.40:0/827198898 learned_addr learned my addr 172.21.15.40:0/827198898 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e6ffd640 1 --2- 172.21.15.40:0/827198898 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80ae650 0x7f90e80ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e77fe640 1 -- 172.21.15.40:0/827198898 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80ae650 msgr2=0x7f90e80ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e77fe640 1 --2- 172.21.15.40:0/827198898 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80ae650 0x7f90e80ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e77fe640 1 -- 172.21.15.40:0/827198898 >> v1:172.21.15.40:6789/0 conn(0x7f90e8072350 legacy=0x7f90e80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e67fc640 1 -- 172.21.15.40:0/827198898 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677588086 0 0) 0x7f90e80cc6b0 con 0x7f90e8072350 2023-11-04T01:42:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e77fe640 1 -- 172.21.15.40:0/827198898 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e80cc900 con 0x7f90e80aea30 2023-11-04T01:42:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e77fe640 1 --2- 172.21.15.40:0/827198898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e80aea30 0x7f90e80cf950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009d90 tx=0x7f90e001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e798306bd2e3f00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e67fc640 1 -- 172.21.15.40:0/827198898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00a5840 con 0x7f90e80aea30 2023-11-04T01:42:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e67fc640 1 -- 172.21.15.40:0/827198898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e00a59a0 con 0x7f90e80aea30 2023-11-04T01:42:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90e67fc640 1 -- 172.21.15.40:0/827198898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00a5d30 con 0x7f90e80aea30 2023-11-04T01:42:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- 172.21.15.40:0/827198898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e80aea30 msgr2=0x7f90e80cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 --2- 172.21.15.40:0/827198898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e80aea30 0x7f90e80cf950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009d90 tx=0x7f90e001c800 comp rx=0 tx=0).stop 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- 172.21.15.40:0/827198898 shutdown_connections 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 --2- 172.21.15.40:0/827198898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e80aea30 0x7f90e80cf950 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 --2- 172.21.15.40:0/827198898 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80ae650 0x7f90e80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- 172.21.15.40:0/827198898 >> 172.21.15.40:0/827198898 conn(0x7f90e80716a0 msgr2=0x7f90e8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- 172.21.15.40:0/827198898 shutdown_connections 2023-11-04T01:42:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.478+0000 7f90ed425640 1 -- 172.21.15.40:0/827198898 wait complete. 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 Processor -- start 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- start start 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 0x7f90e8145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90e80ae650 0x7f90e815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80aea30 0x7f90e81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80c4120 con 0x7f90e8072350 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80c43c0 con 0x7f90e80ae650 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80c46a0 con 0x7f90e80aea30 2023-11-04T01:42:06.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 0x7f90e8145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 0x7f90e8145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40726/0 (socket says 172.21.15.40:40726) 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 -- 172.21.15.40:0/711795886 learned_addr learned my addr 172.21.15.40:0/711795886 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e77fe640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80aea30 0x7f90e81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90dffff640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90e80ae650 0x7f90e815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 -- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80aea30 msgr2=0x7f90e81569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80aea30 0x7f90e81569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 -- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90e80ae650 msgr2=0x7f90e815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90e80ae650 0x7f90e815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 -- 172.21.15.40:0/711795886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0009a70 con 0x7f90e8072350 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90dffff640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90e80ae650 0x7f90e815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90e6ffd640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 0x7f90e8145ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c7f0 tx=0x7f90d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8007820 con 0x7f90e8072350 2023-11-04T01:42:06.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8007980 con 0x7f90e8072350 2023-11-04T01:42:06.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8007d30 con 0x7f90e8072350 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e80c4980 con 0x7f90e8072350 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e815b760 con 0x7f90e8072350 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.482+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e80c4ba0 con 0x7f90e8072350 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.486+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90d80113f0 con 0x7f90e8072350 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.486+0000 7f90df7fe640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90c80664a0 0x7f90c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.486+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90d8084c30 con 0x7f90e8072350 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.486+0000 7f90dffff640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90c80664a0 0x7f90c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.486+0000 7f90dffff640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90c80664a0 0x7f90c8068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.490+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90d80515d0 con 0x7f90e8072350 2023-11-04T01:42:06.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.638+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e80675f0 con 0x7f90e8072350 2023-11-04T01:42:06.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90df7fe640 1 -- 172.21.15.40:0/711795886 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18217 (secure 0 0 0) 0x7f90d8054bf0 con 0x7f90e8072350 2023-11-04T01:42:06.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:06.648 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":61,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:05.330104+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:06.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90c80664a0 msgr2=0x7f90c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90c80664a0 0x7f90c8068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 msgr2=0x7f90e8145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 0x7f90e8145ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c7f0 tx=0x7f90d800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 shutdown_connections 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90c80664a0 0x7f90c8068960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90e80aea30 0x7f90e81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90e80ae650 0x7f90e815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 --2- 172.21.15.40:0/711795886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e8072350 0x7f90e8145ac0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 >> 172.21.15.40:0/711795886 conn(0x7f90e80716a0 msgr2=0x7f90e80b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.642+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 shutdown_connections 2023-11-04T01:42:06.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.646+0000 7f90ed425640 1 -- 172.21.15.40:0/711795886 wait complete. 2023-11-04T01:42:06.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:42:06.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.786+0000 7fe0e1751640 1 Processor -- start 2023-11-04T01:42:06.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.786+0000 7fe0e1751640 1 -- start start 2023-11-04T01:42:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0e1751640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0e1751640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe0dc0cff20 0x7fe0dc0d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0e1751640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc0b5e00 con 0x7fe0dc1610f0 2023-11-04T01:42:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0e1751640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc0d1520 con 0x7fe0dc0cff20 2023-11-04T01:42:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0e1751640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc15d490 con 0x7fe0dc15d0b0 2023-11-04T01:42:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0db7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe0dc0cff20 0x7fe0dc0d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:44558/0 (socket says 172.21.15.40:44558) 2023-11-04T01:42:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0daffd640 1 -- 172.21.15.40:0/1173315559 learned_addr learned my addr 172.21.15.40:0/1173315559 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0db7fe640 1 -- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 msgr2=0x7fe0dc160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0db7fe640 1 --2- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0db7fe640 1 -- 172.21.15.40:0/1173315559 >> v1:172.21.15.91:6789/0 conn(0x7fe0dc1610f0 legacy=0x7fe0dc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0db7fe640 1 -- 172.21.15.40:0/1173315559 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0b8930 con 0x7fe0dc0cff20 2023-11-04T01:42:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0daffd640 1 --2- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.790+0000 7fe0db7fe640 1 --2- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc0d1940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009d90 tx=0x7fe0d401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=455e3e49c71eeb7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0da7fc640 1 -- 172.21.15.40:0/1173315559 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40a5920 con 0x7fe0dc0cff20 2023-11-04T01:42:06.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0da7fc640 1 -- 172.21.15.40:0/1173315559 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d40a5a80 con 0x7fe0dc0cff20 2023-11-04T01:42:06.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0da7fc640 1 -- 172.21.15.40:0/1173315559 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40a5e10 con 0x7fe0dc0cff20 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc0cff20 msgr2=0x7fe0dc0d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 --2- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc0d1940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009d90 tx=0x7fe0d401c950 comp rx=0 tx=0).stop 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- 172.21.15.40:0/1173315559 shutdown_connections 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 --2- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc0d1940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 --2- 172.21.15.40:0/1173315559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- 172.21.15.40:0/1173315559 >> 172.21.15.40:0/1173315559 conn(0x7fe0dc06a890 msgr2=0x7fe0dc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- 172.21.15.40:0/1173315559 shutdown_connections 2023-11-04T01:42:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- 172.21.15.40:0/1173315559 wait complete. 2023-11-04T01:42:06.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 Processor -- start 2023-11-04T01:42:06.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- start start 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc1610f0 0x7fe0dc0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc15ffb0 con 0x7fe0dc0cff20 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc15f9f0 con 0x7fe0dc1610f0 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc15fcd0 con 0x7fe0dc15d0b0 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40742/0 (socket says 172.21.15.40:40742) 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 -- 172.21.15.40:0/272007377 learned_addr learned my addr 172.21.15.40:0/272007377 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0d27fc640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0db7fe640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc1610f0 0x7fe0dc0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 -- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 msgr2=0x7fe0dc15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 -- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc1610f0 msgr2=0x7fe0dc0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc1610f0 0x7fe0dc0cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 -- 172.21.15.40:0/272007377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0094d0 con 0x7fe0dc0cff20 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0db7fe640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc1610f0 0x7fe0dc0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0daffd640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc158590 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00e9d0 tx=0x7fe0cc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00ca60 con 0x7fe0dc0cff20 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc00cbc0 con 0x7fe0dc0cff20 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4009a70 con 0x7fe0dc0cff20 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.794+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc013470 con 0x7fe0dc0cff20 2023-11-04T01:42:06.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc0cab10 con 0x7fe0dc0cff20 2023-11-04T01:42:06.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc0744a0 con 0x7fe0dc0cff20 2023-11-04T01:42:06.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0cc0135d0 con 0x7fe0dc0cff20 2023-11-04T01:42:06.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0d3fff640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0bc0664a0 0x7fe0bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0cc0842b0 con 0x7fe0dc0cff20 2023-11-04T01:42:06.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0d27fc640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0bc0664a0 0x7fe0bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.798+0000 7fe0d27fc640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0bc0664a0 0x7fe0bc068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b5690 tx=0x7fe0c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.802+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe0cc051660 con 0x7fe0dc0cff20 2023-11-04T01:42:06.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.994+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe0dc0d0a10 con 0x7fe0dc0cff20 2023-11-04T01:42:07.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:06.998+0000 7fe0d3fff640 1 -- 172.21.15.40:0/272007377 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe0cc054c80 con 0x7fe0dc0cff20 2023-11-04T01:42:07.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0bc0664a0 msgr2=0x7fe0bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0bc0664a0 0x7fe0bc068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b5690 tx=0x7fe0c4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:07.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 msgr2=0x7fe0dc158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc158590 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00e9d0 tx=0x7fe0cc00ee90 comp rx=0 tx=0).stop 2023-11-04T01:42:07.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 shutdown_connections 2023-11-04T01:42:07.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0bc0664a0 0x7fe0bc068960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe0dc1610f0 0x7fe0dc0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe0dc15d0b0 0x7fe0dc15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 --2- 172.21.15.40:0/272007377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cff20 0x7fe0dc158590 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 >> 172.21.15.40:0/272007377 conn(0x7fe0dc06a890 msgr2=0x7fe0dc0b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 shutdown_connections 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.002+0000 7fe0e1751640 1 -- 172.21.15.40:0/272007377 wait complete. 2023-11-04T01:42:07.027 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:42:07.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:42:07.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 Processor -- start 2023-11-04T01:42:07.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 -- start start 2023-11-04T01:42:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6894144840 0x7f689415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68940b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689406cc10 con 0x7f68940b54d0 2023-11-04T01:42:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68940b5960 con 0x7f6894144840 2023-11-04T01:42:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689c7b0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6894071d10 con 0x7f6894070b40 2023-11-04T01:42:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6894144840 0x7f689415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6894144840 0x7f689415f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40746/0 (socket says 172.21.15.40:40746) 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 -- 172.21.15.40:0/2816849215 learned_addr learned my addr 172.21.15.40:0/2816849215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f6899d4b640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68940b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 -- 172.21.15.40:0/2816849215 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 msgr2=0x7f68940b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68940b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 -- 172.21.15.40:0/2816849215 >> v1:172.21.15.91:6789/0 conn(0x7f68940b54d0 legacy=0x7f689406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f689a54c640 1 -- 172.21.15.40:0/2816849215 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689415fb20 con 0x7f6894144840 2023-11-04T01:42:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.142+0000 7f6899d4b640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68940b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689a54c640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6894144840 0x7f689415f5e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6884009870 tx=0x7f688401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64286df2a3f48e94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689954a640 1 -- 172.21.15.40:0/2816849215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840ab600 con 0x7f6894144840 2023-11-04T01:42:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689954a640 1 -- 172.21.15.40:0/2816849215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840a7050 con 0x7f6894144840 2023-11-04T01:42:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689954a640 1 -- 172.21.15.40:0/2816849215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840ab980 con 0x7f6894144840 2023-11-04T01:42:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 -- 172.21.15.40:0/2816849215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6894144840 msgr2=0x7f689415f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6894144840 0x7f689415f5e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6884009870 tx=0x7f688401c440 comp rx=0 tx=0).stop 2023-11-04T01:42:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 -- 172.21.15.40:0/2816849215 shutdown_connections 2023-11-04T01:42:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68940b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 --2- 172.21.15.40:0/2816849215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6894144840 0x7f689415f5e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 -- 172.21.15.40:0/2816849215 >> 172.21.15.40:0/2816849215 conn(0x7f68940cfc70 msgr2=0x7f68940d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 -- 172.21.15.40:0/2816849215 shutdown_connections 2023-11-04T01:42:07.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 -- 172.21.15.40:0/2816849215 wait complete. 2023-11-04T01:42:07.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 Processor -- start 2023-11-04T01:42:07.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.146+0000 7f689c7b0640 1 -- start start 2023-11-04T01:42:07.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68941f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 0x7f689415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6894144840 0x7f6894159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68941f7ac0 con 0x7f68940b54d0 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689413aef0 con 0x7f6894144840 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689415e350 con 0x7f6894070b40 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 0x7f689415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 0x7f689415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40752/0 (socket says 172.21.15.40:40752) 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 -- 172.21.15.40:0/1304891717 learned_addr learned my addr 172.21.15.40:0/1304891717 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689ad4d640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6894144840 0x7f6894159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689a54c640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68941f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 -- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 msgr2=0x7f68941f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68941f7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 -- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6894144840 msgr2=0x7f6894159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6894144840 0x7f6894159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 -- 172.21.15.40:0/1304891717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840094d0 con 0x7f68940b54d0 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6899d4b640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 0x7f689415cf00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f688800c7f0 tx=0x7f688800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888007820 con 0x7f68940b54d0 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888007980 con 0x7f68940b54d0 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888007d30 con 0x7f68940b54d0 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689415e630 con 0x7f68940b54d0 2023-11-04T01:42:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68941f76e0 con 0x7f68940b54d0 2023-11-04T01:42:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68941f7c00 con 0x7f68940b54d0 2023-11-04T01:42:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68880113f0 con 0x7f68940b54d0 2023-11-04T01:42:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.150+0000 7f6892ffd640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.154+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6888084370 con 0x7f68940b54d0 2023-11-04T01:42:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.154+0000 7f689a54c640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.154+0000 7f689a54c640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f68840ad000 tx=0x7f6884008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.158+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68941f7c00 con 0x7f68940b54d0 2023-11-04T01:42:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:07.350+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f68941f7c00 con 0x7f68940b54d0 2023-11-04T01:42:08.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.010+0000 7f6892ffd640 1 -- 172.21.15.40:0/1304891717 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f68941f7c00 con 0x7f68940b54d0 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 msgr2=0x7f6880068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f68840ad000 tx=0x7f6884008040 comp rx=0 tx=0).stop 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 msgr2=0x7f689415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 0x7f689415cf00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f688800c7f0 tx=0x7f688800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 shutdown_connections 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6894144840 0x7f6894159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68940b54d0 0x7f689415cf00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 --2- 172.21.15.40:0/1304891717 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6894070b40 0x7f68941f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 >> 172.21.15.40:0/1304891717 conn(0x7f68940cfc70 msgr2=0x7f68941580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 shutdown_connections 2023-11-04T01:42:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.014+0000 7f689c7b0640 1 -- 172.21.15.40:0/1304891717 wait complete. 2023-11-04T01:42:08.039 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:42:08.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:08.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.162+0000 7ff476c95640 1 Processor -- start 2023-11-04T01:42:08.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff476c95640 1 -- start start 2023-11-04T01:42:08.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff476c95640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700b4990 0x7ff4700b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff476c95640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4700b74f0 0x7ff4700cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff476c95640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4700b6070 con 0x7ff4700d0690 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff476c95640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700b8ed0 con 0x7ff4700b74f0 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff476c95640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700b52b0 con 0x7ff4700b4990 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff467fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff4700d0690 0x7ff4700cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43790/0 (socket says 172.21.15.40:43790) 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff467fff640 1 -- 172.21.15.40:0/3360212120 learned_addr learned my addr 172.21.15.40:0/3360212120 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff475232640 1 --2- 172.21.15.40:0/3360212120 >> v2:172.21.15.40:3300/0 conn(0x7ff4700b74f0 0x7ff4700cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff474a31640 1 --2- 172.21.15.40:0/3360212120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700b4990 0x7ff4700b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff4677fe640 1 -- 172.21.15.40:0/3360212120 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195076526 0 0) 0x7ff4700b6070 con 0x7ff4700d0690 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff4677fe640 1 -- 172.21.15.40:0/3360212120 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff458003530 con 0x7ff4700d0690 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff475232640 1 -- 172.21.15.40:0/3360212120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700b4990 msgr2=0x7ff4700b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff475232640 1 --2- 172.21.15.40:0/3360212120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700b4990 0x7ff4700b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff475232640 1 -- 172.21.15.40:0/3360212120 >> v1:172.21.15.40:6789/0 conn(0x7ff4700d0690 legacy=0x7ff4700cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.166+0000 7ff475232640 1 -- 172.21.15.40:0/3360212120 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700d1ce0 con 0x7ff4700b74f0 2023-11-04T01:42:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff475232640 1 --2- 172.21.15.40:0/3360212120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff4700cde80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff468009d90 tx=0x7ff46801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2011f6bdf674ef78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff4677fe640 1 -- 172.21.15.40:0/3360212120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680af600 con 0x7ff4700b74f0 2023-11-04T01:42:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff4677fe640 1 -- 172.21.15.40:0/3360212120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4680ab050 con 0x7ff4700b74f0 2023-11-04T01:42:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff4677fe640 1 -- 172.21.15.40:0/3360212120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680af960 con 0x7ff4700b74f0 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- 172.21.15.40:0/3360212120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 msgr2=0x7ff4700cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 --2- 172.21.15.40:0/3360212120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff4700cde80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff468009d90 tx=0x7ff46801f130 comp rx=0 tx=0).stop 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- 172.21.15.40:0/3360212120 shutdown_connections 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 --2- 172.21.15.40:0/3360212120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff4700cde80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 --2- 172.21.15.40:0/3360212120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700b4990 0x7ff4700b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- 172.21.15.40:0/3360212120 >> 172.21.15.40:0/3360212120 conn(0x7ff4700cf990 msgr2=0x7ff4700cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- 172.21.15.40:0/3360212120 shutdown_connections 2023-11-04T01:42:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- 172.21.15.40:0/3360212120 wait complete. 2023-11-04T01:42:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 Processor -- start 2023-11-04T01:42:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- start start 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4700b4990 0x7ff47014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff47015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700d0690 0x7ff47015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47014dd10 con 0x7ff4700b74f0 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700cc0a0 con 0x7ff4700b4990 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff476c95640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700cc380 con 0x7ff4700d0690 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff47015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff47015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57204/0 (socket says 172.21.15.40:57204) 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 -- 172.21.15.40:0/520068626 learned_addr learned my addr 172.21.15.40:0/520068626 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff474a31640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4700b4990 0x7ff47014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff475232640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700d0690 0x7ff47015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 -- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700d0690 msgr2=0x7ff47015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700d0690 0x7ff47015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 -- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4700b4990 msgr2=0x7ff47014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4700b4990 0x7ff47014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff467fff640 1 -- 172.21.15.40:0/520068626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009a70 con 0x7ff4700b74f0 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.170+0000 7ff475232640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700d0690 0x7ff47015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff467fff640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff47015a520 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff46c001ec0 tx=0x7ff46c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005d50 con 0x7ff4700b74f0 2023-11-04T01:42:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c007070 con 0x7ff4700b74f0 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c007420 con 0x7ff4700b74f0 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4700cc660 con 0x7ff4700b74f0 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4700ccc20 con 0x7ff4700b74f0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4700cce10 con 0x7ff4700b74f0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff46c007580 con 0x7ff4700b74f0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff4657fa640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff45c0664a0 0x7ff45c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff46c083220 con 0x7ff4700b74f0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff474a31640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff45c0664a0 0x7ff45c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.174+0000 7ff474a31640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff45c0664a0 0x7ff45c068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff47015bd00 tx=0x7ff460008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.178+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff46c050610 con 0x7ff4700b74f0 2023-11-04T01:42:08.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4700744a0 con 0x7ff4700b74f0 2023-11-04T01:42:08.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff4657fa640 1 -- 172.21.15.40:0/520068626 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4911 (secure 0 0 0) 0x7ff46c053c30 con 0x7ff4700b74f0 2023-11-04T01:42:08.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:08.376 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:05.330601+0000","modified":"2023-11-04T01:42:07.357303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3229855719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3229855719},{"type":"v1","addr":"172.21.15.40:6835","nonce":3229855719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:08.376 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff45c0664a0 msgr2=0x7ff45c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff45c0664a0 0x7ff45c068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff47015bd00 tx=0x7ff460008040 comp rx=0 tx=0).stop 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 msgr2=0x7ff47015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff47015a520 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff46c001ec0 tx=0x7ff46c00c960 comp rx=0 tx=0).stop 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 shutdown_connections 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff45c0664a0 0x7ff45c068960 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4700d0690 0x7ff47015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4700b74f0 0x7ff47015a520 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 --2- 172.21.15.40:0/520068626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4700b4990 0x7ff47014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.370+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 >> 172.21.15.40:0/520068626 conn(0x7ff4700cf990 msgr2=0x7ff4700ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.374+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 shutdown_connections 2023-11-04T01:42:08.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.374+0000 7ff476c95640 1 -- 172.21.15.40:0/520068626 wait complete. 2023-11-04T01:42:08.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:08.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.506+0000 7fcc9bc0b640 1 Processor -- start 2023-11-04T01:42:08.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.506+0000 7fcc9bc0b640 1 -- start start 2023-11-04T01:42:08.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc9bc0b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcc940715d0 0x7fcc940b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc9bc0b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc940c2670 con 0x7fcc9415afd0 2023-11-04T01:42:08.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc9bc0b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9406bc30 con 0x7fcc940b0b70 2023-11-04T01:42:08.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc9bc0b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc94070140 con 0x7fcc940715d0 2023-11-04T01:42:08.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc999a7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcc9415afd0 0x7fcc9406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43804/0 (socket says 172.21.15.40:43804) 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc999a7640 1 -- 172.21.15.40:0/3951191417 learned_addr learned my addr 172.21.15.40:0/3951191417 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc991a6640 1 --2- 172.21.15.40:0/3951191417 >> v2:172.21.15.91:3300/0 conn(0x7fcc940715d0 0x7fcc940b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc989a5640 1 -- 172.21.15.40:0/3951191417 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145222738 0 0) 0x7fcc940c2670 con 0x7fcc9415afd0 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc989a5640 1 -- 172.21.15.40:0/3951191417 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc80003530 con 0x7fcc9415afd0 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc991a6640 1 -- 172.21.15.40:0/3951191417 >> v1:172.21.15.91:6789/0 conn(0x7fcc940b0b70 legacy=0x7fcc9415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc991a6640 1 -- 172.21.15.40:0/3951191417 >> v1:172.21.15.40:6789/0 conn(0x7fcc9415afd0 legacy=0x7fcc9406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc989a5640 1 -- 172.21.15.40:0/3951191417 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010372800 0 0) 0x7fcc80003530 con 0x7fcc9415afd0 2023-11-04T01:42:08.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc991a6640 1 -- 172.21.15.40:0/3951191417 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9406bf10 con 0x7fcc940715d0 2023-11-04T01:42:08.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc991a6640 1 --2- 172.21.15.40:0/3951191417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc940715d0 0x7fcc940b0630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc900097c0 tx=0x7fcc9001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eeb3e1b10c9d0e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc989a5640 1 -- 172.21.15.40:0/3951191417 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84001680 con 0x7fcc940715d0 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc989a5640 1 -- 172.21.15.40:0/3951191417 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc900a7050 con 0x7fcc940715d0 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.510+0000 7fcc989a5640 1 -- 172.21.15.40:0/3951191417 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900ab600 con 0x7fcc940715d0 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3951191417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc940715d0 msgr2=0x7fcc940b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3951191417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc940715d0 0x7fcc940b0630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc900097c0 tx=0x7fcc9001c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3951191417 shutdown_connections 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3951191417 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc940715d0 0x7fcc940b0630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3951191417 >> 172.21.15.40:0/3951191417 conn(0x7fcc940cebb0 msgr2=0x7fcc940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3951191417 shutdown_connections 2023-11-04T01:42:08.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3951191417 wait complete. 2023-11-04T01:42:08.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 Processor -- start 2023-11-04T01:42:08.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- start start 2023-11-04T01:42:08.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcc940715d0 0x7fcc9414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 0x7fcc94155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc9415afd0 0x7fcc9414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94155cc0 con 0x7fcc940b0b70 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94151fe0 con 0x7fcc9415afd0 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94154320 con 0x7fcc940715d0 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 0x7fcc94155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 0x7fcc94155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57218/0 (socket says 172.21.15.40:57218) 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 -- 172.21.15.40:0/3164154601 learned_addr learned my addr 172.21.15.40:0/3164154601 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc999a7640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcc940715d0 0x7fcc9414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9a1a8640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc9415afd0 0x7fcc9414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 -- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcc940715d0 msgr2=0x7fcc9414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcc940715d0 0x7fcc9414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 -- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc9415afd0 msgr2=0x7fcc9414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc9415afd0 0x7fcc9414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 -- 172.21.15.40:0/3164154601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009420 con 0x7fcc940b0b70 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc991a6640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 0x7fcc94155780 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000c10 tx=0x7fcc90019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90003ab0 con 0x7fcc940b0b70 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90003c10 con 0x7fcc940b0b70 2023-11-04T01:42:08.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc94154040 con 0x7fcc940b0b70 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900b5410 con 0x7fcc940b0b70 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.514+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc940c7770 con 0x7fcc940b0b70 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.518+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc940c72f0 con 0x7fcc940b0b70 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.518+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc900b2050 con 0x7fcc940b0b70 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.518+0000 7fcc8a7fc640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc780664a0 0x7fcc78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.518+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc9011e330 con 0x7fcc940b0b70 2023-11-04T01:42:08.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.518+0000 7fcc999a7640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc780664a0 0x7fcc78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.518+0000 7fcc999a7640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc780664a0 0x7fcc78068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005890 tx=0x7fcc84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.522+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc940c72f0 con 0x7fcc940b0b70 2023-11-04T01:42:08.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.678+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc940c72f0 con 0x7fcc940b0b70 2023-11-04T01:42:08.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.678+0000 7fcc8a7fc640 1 -- 172.21.15.40:0/3164154601 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fcc940c72f0 con 0x7fcc940b0b70 2023-11-04T01:42:08.685 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:08.686 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":62,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:07.002080+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:08.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc780664a0 msgr2=0x7fcc78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc780664a0 0x7fcc78068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005890 tx=0x7fcc84009040 comp rx=0 tx=0).stop 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 msgr2=0x7fcc94155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 0x7fcc94155780 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000c10 tx=0x7fcc90019140 comp rx=0 tx=0).stop 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 shutdown_connections 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc780664a0 0x7fcc78068960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc9415afd0 0x7fcc9414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc940b0b70 0x7fcc94155780 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 --2- 172.21.15.40:0/3164154601 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcc940715d0 0x7fcc9414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 >> 172.21.15.40:0/3164154601 conn(0x7fcc940cebb0 msgr2=0x7fcc940af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 shutdown_connections 2023-11-04T01:42:08.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.682+0000 7fcc9bc0b640 1 -- 172.21.15.40:0/3164154601 wait complete. 2023-11-04T01:42:08.704 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:42:08.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:08.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 Processor -- start 2023-11-04T01:42:08.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 -- start start 2023-11-04T01:42:08.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f45e815afd0 0x7f45e80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45e806f8f0 0x7f45e80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e80c2670 con 0x7f45e80b0b70 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e8070140 con 0x7f45e806f8f0 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45eeb20640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e815fc90 con 0x7f45e815afd0 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45e7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45e806f8f0 0x7f45e80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45e7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45e806f8f0 0x7f45e80b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57228/0 (socket says 172.21.15.40:57228) 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.822+0000 7f45e7fff640 1 -- 172.21.15.40:0/1649266369 learned_addr learned my addr 172.21.15.40:0/1649266369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45ec8bc640 1 --2- 172.21.15.40:0/1649266369 >> v2:172.21.15.91:3300/0 conn(0x7f45e815afd0 0x7f45e80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e7fff640 1 -- 172.21.15.40:0/1649266369 >> v2:172.21.15.91:3300/0 conn(0x7f45e815afd0 msgr2=0x7f45e80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e7fff640 1 --2- 172.21.15.40:0/1649266369 >> v2:172.21.15.91:3300/0 conn(0x7f45e815afd0 0x7f45e80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e7fff640 1 -- 172.21.15.40:0/1649266369 >> v1:172.21.15.91:6789/0 conn(0x7f45e80b0b70 legacy=0x7f45e80c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e7fff640 1 -- 172.21.15.40:0/1649266369 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e806bc30 con 0x7f45e806f8f0 2023-11-04T01:42:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e7fff640 1 --2- 172.21.15.40:0/1649266369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e806f8f0 0x7f45e80b0630 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ce980 tx=0x7f45dc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82168d35a4c982f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e77fe640 1 -- 172.21.15.40:0/1649266369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0ab600 con 0x7f45e806f8f0 2023-11-04T01:42:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e77fe640 1 -- 172.21.15.40:0/1649266369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc0a7050 con 0x7f45e806f8f0 2023-11-04T01:42:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45e77fe640 1 -- 172.21.15.40:0/1649266369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0ab980 con 0x7f45e806f8f0 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 -- 172.21.15.40:0/1649266369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e806f8f0 msgr2=0x7f45e80b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 --2- 172.21.15.40:0/1649266369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e806f8f0 0x7f45e80b0630 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f45e80ce980 tx=0x7f45dc01c4c0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 -- 172.21.15.40:0/1649266369 shutdown_connections 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 --2- 172.21.15.40:0/1649266369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e806f8f0 0x7f45e80b0630 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 --2- 172.21.15.40:0/1649266369 >> v2:172.21.15.91:3300/0 conn(0x7f45e815afd0 0x7f45e80715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 -- 172.21.15.40:0/1649266369 >> 172.21.15.40:0/1649266369 conn(0x7f45e80cebb0 msgr2=0x7f45e80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 -- 172.21.15.40:0/1649266369 shutdown_connections 2023-11-04T01:42:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.826+0000 7f45eeb20640 1 -- 172.21.15.40:0/1649266369 wait complete. 2023-11-04T01:42:08.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 Processor -- start 2023-11-04T01:42:08.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- start start 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f45e806f8f0 0x7f45e81404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 0x7f45e80b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f45e815afd0 0x7f45e80c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8152740 con 0x7f45e80b0b70 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8151b30 con 0x7f45e806f8f0 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8151e10 con 0x7f45e815afd0 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 0x7f45e80b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 0x7f45e80b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57232/0 (socket says 172.21.15.40:57232) 2023-11-04T01:42:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 -- 172.21.15.40:0/4009054752 learned_addr learned my addr 172.21.15.40:0/4009054752 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45ec8bc640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f45e806f8f0 0x7f45e81404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45ed0bd640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f45e815afd0 0x7f45e80c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 -- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f45e815afd0 msgr2=0x7f45e80c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f45e815afd0 0x7f45e80c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 -- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f45e806f8f0 msgr2=0x7f45e81404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f45e806f8f0 0x7f45e81404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 -- 172.21.15.40:0/4009054752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0094d0 con 0x7f45e80b0b70 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45ec8bc640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f45e806f8f0 0x7f45e81404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45ed0bd640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f45e815afd0 0x7f45e80c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e7fff640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 0x7f45e80b1c10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f45dc01a0f0 tx=0x7f45dc019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0b4840 con 0x7f45e80b0b70 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc0b49a0 con 0x7f45e80b0b70 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e81520f0 con 0x7f45e80b0b70 2023-11-04T01:42:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0b4d30 con 0x7f45e80b0b70 2023-11-04T01:42:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e80c2260 con 0x7f45e80b0b70 2023-11-04T01:42:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e80744a0 con 0x7f45e80b0b70 2023-11-04T01:42:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.830+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45dc0b2040 con 0x7f45e80b0b70 2023-11-04T01:42:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.834+0000 7f45e57fa640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f45d40664a0 0x7f45d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.834+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45dc11d8a0 con 0x7f45e80b0b70 2023-11-04T01:42:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.834+0000 7f45ec8bc640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f45d40664a0 0x7f45d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.834+0000 7f45ec8bc640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f45d40664a0 0x7f45d4068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f45e8156d20 tx=0x7f45d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.838+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45dc0eaba0 con 0x7f45e80b0b70 2023-11-04T01:42:08.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:08.986+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45e806c4d0 con 0x7f45d40664a0 2023-11-04T01:42:09.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.018+0000 7f45e57fa640 1 -- 172.21.15.40:0/4009054752 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363467 (secure 0 0 0) 0x7f45d800f920 con 0x7f45d40664a0 2023-11-04T01:42:09.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f45d40664a0 msgr2=0x7f45d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f45d40664a0 0x7f45d4068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f45e8156d20 tx=0x7f45d8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 msgr2=0x7f45e80b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 0x7f45e80b1c10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f45dc01a0f0 tx=0x7f45dc019260 comp rx=0 tx=0).stop 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 shutdown_connections 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f45d40664a0 0x7f45d4068960 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f45e815afd0 0x7f45e80c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e80b0b70 0x7f45e80b1c10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 --2- 172.21.15.40:0/4009054752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f45e806f8f0 0x7f45e81404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.022+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 >> 172.21.15.40:0/4009054752 conn(0x7f45e80cebb0 msgr2=0x7f45e80cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.026+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 shutdown_connections 2023-11-04T01:42:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.026+0000 7f45eeb20640 1 -- 172.21.15.40:0/4009054752 wait complete. 2023-11-04T01:42:09.047 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-11-04T01:42:07.795295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231228,"kb_used_data":6732,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743492,"statfs":{"total":773094113280,"available":772857335808,"internally_reserved":0,"allocated":6893568,"data_stored":3648788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001617"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964311+0000","last_change":"2023-11-04T01:42:04.964311+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964311+0000","last_undegraded":"2023-11-04T01:42:04.964311+0000","last_fullsized":"2023-11-04T01:42:04.964311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963394+0000","last_change":"2023-11-04T01:42:04.963394+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963394+0000","last_undegraded":"2023-11-04T01:42:04.963394+0000","last_fullsized":"2023-11-04T01:42:04.963394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970604+0000","last_change":"2023-11-04T01:42:04.970604+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970604+0000","last_undegraded":"2023-11-04T01:42:04.970604+0000","last_fullsized":"2023-11-04T01:42:04.970604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963630+0000","last_change":"2023-11-04T01:42:04.963630+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963630+0000","last_undegraded":"2023-11-04T01:42:04.963630+0000","last_fullsized":"2023-11-04T01:42:04.963630+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980355+0000","last_change":"2023-11-04T01:42:04.980355+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980355+0000","last_undegraded":"2023-11-04T01:42:04.980355+0000","last_fullsized":"2023-11-04T01:42:04.980355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964101+0000","last_change":"2023-11-04T01:42:04.964101+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964101+0000","last_undegraded":"2023-11-04T01:42:04.964101+0000","last_fullsized":"2023-11-04T01:42:04.964101+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967421+0000","last_change":"2023-11-04T01:42:04.967421+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967421+0000","last_undegraded":"2023-11-04T01:42:04.967421+0000","last_fullsized":"2023-11-04T01:42:04.967421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970577+0000","last_change":"2023-11-04T01:42:04.970577+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970577+0000","last_undegraded":"2023-11-04T01:42:04.970577+0000","last_fullsized":"2023-11-04T01:42:04.970577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972671+0000","last_change":"2023-11-04T01:42:04.972671+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972671+0000","last_undegraded":"2023-11-04T01:42:04.972671+0000","last_fullsized":"2023-11-04T01:42:04.972671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968979+0000","last_change":"2023-11-04T01:42:04.968979+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968979+0000","last_undegraded":"2023-11-04T01:42:04.968979+0000","last_fullsized":"2023-11-04T01:42:04.968979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967722+0000","last_change":"2023-11-04T01:42:04.967722+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967722+0000","last_undegraded":"2023-11-04T01:42:04.967722+0000","last_fullsized":"2023-11-04T01:42:04.967722+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969387+0000","last_change":"2023-11-04T01:42:04.969387+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969387+0000","last_undegraded":"2023-11-04T01:42:04.969387+0000","last_fullsized":"2023-11-04T01:42:04.969387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961992+0000","last_change":"2023-11-04T01:42:04.961992+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961992+0000","last_undegraded":"2023-11-04T01:42:04.961992+0000","last_fullsized":"2023-11-04T01:42:04.961992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.971346+0000","last_change":"2023-11-04T01:42:04.971346+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.971346+0000","last_undegraded":"2023-11-04T01:42:04.971346+0000","last_fullsized":"2023-11-04T01:42:04.971346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968406+0000","last_change":"2023-11-04T01:42:04.968406+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968406+0000","last_undegraded":"2023-11-04T01:42:04.968406+0000","last_fullsized":"2023-11-04T01:42:04.968406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969330+0000","last_change":"2023-11-04T01:42:04.969330+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969330+0000","last_undegraded":"2023-11-04T01:42:04.969330+0000","last_fullsized":"2023-11-04T01:42:04.969330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963815+0000","last_change":"2023-11-04T01:42:04.963815+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963815+0000","last_undegraded":"2023-11-04T01:42:04.963815+0000","last_fullsized":"2023-11-04T01:42:04.963815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961915+0000","last_change":"2023-11-04T01:42:04.961915+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961915+0000","last_undegraded":"2023-11-04T01:42:04.961915+0000","last_fullsized":"2023-11-04T01:42:04.961915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977955+0000","last_change":"2023-11-04T01:42:04.977955+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977955+0000","last_undegraded":"2023-11-04T01:42:04.977955+0000","last_fullsized":"2023-11-04T01:42:04.977955+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960714+0000","last_change":"2023-11-04T01:42:04.960714+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960714+0000","last_undegraded":"2023-11-04T01:42:04.960714+0000","last_fullsized":"2023-11-04T01:42:04.960714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960644+0000","last_change":"2023-11-04T01:42:04.960644+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960644+0000","last_undegraded":"2023-11-04T01:42:04.960644+0000","last_fullsized":"2023-11-04T01:42:04.960644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961806+0000","last_change":"2023-11-04T01:42:04.961806+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961806+0000","last_undegraded":"2023-11-04T01:42:04.961806+0000","last_fullsized":"2023-11-04T01:42:04.961806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960731+0000","last_change":"2023-11-04T01:42:04.960731+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960731+0000","last_undegraded":"2023-11-04T01:42:04.960731+0000","last_fullsized":"2023-11-04T01:42:04.960731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968164+0000","last_change":"2023-11-04T01:42:04.968164+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968164+0000","last_undegraded":"2023-11-04T01:42:04.968164+0000","last_fullsized":"2023-11-04T01:42:04.968164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965282+0000","last_change":"2023-11-04T01:42:04.965282+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965282+0000","last_undegraded":"2023-11-04T01:42:04.965282+0000","last_fullsized":"2023-11-04T01:42:04.965282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968209+0000","last_change":"2023-11-04T01:42:04.968209+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968209+0000","last_undegraded":"2023-11-04T01:42:04.968209+0000","last_fullsized":"2023-11-04T01:42:04.968209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966582+0000","last_change":"2023-11-04T01:42:04.966582+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966582+0000","last_undegraded":"2023-11-04T01:42:04.966582+0000","last_fullsized":"2023-11-04T01:42:04.966582+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966509+0000","last_change":"2023-11-04T01:42:04.966509+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966509+0000","last_undegraded":"2023-11-04T01:42:04.966509+0000","last_fullsized":"2023-11-04T01:42:04.966509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972381+0000","last_change":"2023-11-04T01:42:04.972381+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972381+0000","last_undegraded":"2023-11-04T01:42:04.972381+0000","last_fullsized":"2023-11-04T01:42:04.972381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963276+0000","last_change":"2023-11-04T01:42:04.963276+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963276+0000","last_undegraded":"2023-11-04T01:42:04.963276+0000","last_fullsized":"2023-11-04T01:42:04.963276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961302+0000","last_change":"2023-11-04T01:42:04.961302+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961302+0000","last_undegraded":"2023-11-04T01:42:04.961302+0000","last_fullsized":"2023-11-04T01:42:04.961302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964401+0000","last_change":"2023-11-04T01:42:04.964401+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964401+0000","last_undegraded":"2023-11-04T01:42:04.964401+0000","last_fullsized":"2023-11-04T01:42:04.964401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979252+0000","last_change":"2023-11-04T01:42:04.979252+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979252+0000","last_undegraded":"2023-11-04T01:42:04.979252+0000","last_fullsized":"2023-11-04T01:42:04.979252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975784+0000","last_change":"2023-11-04T01:42:04.971841+0000","last_active":"2023-11-04T01:42:04.975784+0000","last_peered":"2023-11-04T01:42:04.975784+0000","last_clean":"2023-11-04T01:42:04.975784+0000","last_became_active":"2023-11-04T01:42:04.971405+0000","last_became_peered":"2023-11-04T01:42:04.971405+0000","last_unstale":"2023-11-04T01:42:04.975784+0000","last_undegraded":"2023-11-04T01:42:04.975784+0000","last_fullsized":"2023-11-04T01:42:04.975784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:17.604230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966449+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:03.966449+0000","last_peered":"2023-11-04T01:42:03.966449+0000","last_clean":"2023-11-04T01:42:03.966449+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:03.966449+0000","last_undegraded":"2023-11-04T01:42:03.966449+0000","last_fullsized":"2023-11-04T01:42:03.966449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966189+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:03.966189+0000","last_peered":"2023-11-04T01:42:03.966189+0000","last_clean":"2023-11-04T01:42:03.966189+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:03.966189+0000","last_undegraded":"2023-11-04T01:42:03.966189+0000","last_fullsized":"2023-11-04T01:42:03.966189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960838+0000","last_change":"2023-11-04T01:42:04.960838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960838+0000","last_undegraded":"2023-11-04T01:42:04.960838+0000","last_fullsized":"2023-11-04T01:42:04.960838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015040+0000","last_change":"2023-11-04T01:42:05.010568+0000","last_active":"2023-11-04T01:42:05.015040+0000","last_peered":"2023-11-04T01:42:05.015040+0000","last_clean":"2023-11-04T01:42:05.015040+0000","last_became_active":"2023-11-04T01:42:05.009935+0000","last_became_peered":"2023-11-04T01:42:05.009935+0000","last_unstale":"2023-11-04T01:42:05.015040+0000","last_undegraded":"2023-11-04T01:42:05.015040+0000","last_fullsized":"2023-11-04T01:42:05.015040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:58.106427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957847+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:03.957847+0000","last_peered":"2023-11-04T01:42:03.957847+0000","last_clean":"2023-11-04T01:42:03.957847+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:03.957847+0000","last_undegraded":"2023-11-04T01:42:03.957847+0000","last_fullsized":"2023-11-04T01:42:03.957847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.982231+0000","last_change":"2023-11-04T01:42:04.982231+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.982231+0000","last_undegraded":"2023-11-04T01:42:04.982231+0000","last_fullsized":"2023-11-04T01:42:04.982231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980251+0000","last_change":"2023-11-04T01:42:04.978763+0000","last_active":"2023-11-04T01:42:04.980251+0000","last_peered":"2023-11-04T01:42:04.980251+0000","last_clean":"2023-11-04T01:42:04.980251+0000","last_became_active":"2023-11-04T01:42:04.978517+0000","last_became_peered":"2023-11-04T01:42:04.978517+0000","last_unstale":"2023-11-04T01:42:04.980251+0000","last_undegraded":"2023-11-04T01:42:04.980251+0000","last_fullsized":"2023-11-04T01:42:04.980251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:24:48.216767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967737+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:03.967737+0000","last_peered":"2023-11-04T01:42:03.967737+0000","last_clean":"2023-11-04T01:42:03.967737+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:03.967737+0000","last_undegraded":"2023-11-04T01:42:03.967737+0000","last_fullsized":"2023-11-04T01:42:03.967737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970601+0000","last_change":"2023-11-04T01:42:04.970601+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970601+0000","last_undegraded":"2023-11-04T01:42:04.970601+0000","last_fullsized":"2023-11-04T01:42:04.970601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.010311+0000","last_change":"2023-11-04T01:42:05.003124+0000","last_active":"2023-11-04T01:42:05.010311+0000","last_peered":"2023-11-04T01:42:05.010311+0000","last_clean":"2023-11-04T01:42:05.010311+0000","last_became_active":"2023-11-04T01:42:05.002439+0000","last_became_peered":"2023-11-04T01:42:05.002439+0000","last_unstale":"2023-11-04T01:42:05.010311+0000","last_undegraded":"2023-11-04T01:42:05.010311+0000","last_fullsized":"2023-11-04T01:42:05.010311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:38.112432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949271+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:03.949271+0000","last_peered":"2023-11-04T01:42:03.949271+0000","last_clean":"2023-11-04T01:42:03.949271+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:03.949271+0000","last_undegraded":"2023-11-04T01:42:03.949271+0000","last_fullsized":"2023-11-04T01:42:03.949271+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976588+0000","last_change":"2023-11-04T01:42:04.976588+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976588+0000","last_undegraded":"2023-11-04T01:42:04.976588+0000","last_fullsized":"2023-11-04T01:42:04.976588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013327+0000","last_change":"2023-11-04T01:42:05.007493+0000","last_active":"2023-11-04T01:42:05.013327+0000","last_peered":"2023-11-04T01:42:05.013327+0000","last_clean":"2023-11-04T01:42:05.013327+0000","last_became_active":"2023-11-04T01:42:05.006869+0000","last_became_peered":"2023-11-04T01:42:05.006869+0000","last_unstale":"2023-11-04T01:42:05.013327+0000","last_undegraded":"2023-11-04T01:42:05.013327+0000","last_fullsized":"2023-11-04T01:42:05.013327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:08.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956698+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:03.956698+0000","last_peered":"2023-11-04T01:42:03.956698+0000","last_clean":"2023-11-04T01:42:03.956698+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:03.956698+0000","last_undegraded":"2023-11-04T01:42:03.956698+0000","last_fullsized":"2023-11-04T01:42:03.956698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976659+0000","last_change":"2023-11-04T01:42:04.976659+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976659+0000","last_undegraded":"2023-11-04T01:42:04.976659+0000","last_fullsized":"2023-11-04T01:42:04.976659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012469+0000","last_change":"2023-11-04T01:42:05.006827+0000","last_active":"2023-11-04T01:42:05.012469+0000","last_peered":"2023-11-04T01:42:05.012469+0000","last_clean":"2023-11-04T01:42:05.012469+0000","last_became_active":"2023-11-04T01:42:05.006480+0000","last_became_peered":"2023-11-04T01:42:05.006480+0000","last_unstale":"2023-11-04T01:42:05.012469+0000","last_undegraded":"2023-11-04T01:42:05.012469+0000","last_fullsized":"2023-11-04T01:42:05.012469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:42.750611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960719+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:03.960719+0000","last_peered":"2023-11-04T01:42:03.960719+0000","last_clean":"2023-11-04T01:42:03.960719+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:03.960719+0000","last_undegraded":"2023-11-04T01:42:03.960719+0000","last_fullsized":"2023-11-04T01:42:03.960719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963624+0000","last_change":"2023-11-04T01:42:04.963624+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963624+0000","last_undegraded":"2023-11-04T01:42:04.963624+0000","last_fullsized":"2023-11-04T01:42:04.963624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997165+0000","last_change":"2023-11-04T01:42:04.994894+0000","last_active":"2023-11-04T01:42:04.997165+0000","last_peered":"2023-11-04T01:42:04.997165+0000","last_clean":"2023-11-04T01:42:04.997165+0000","last_became_active":"2023-11-04T01:42:04.994554+0000","last_became_peered":"2023-11-04T01:42:04.994554+0000","last_unstale":"2023-11-04T01:42:04.997165+0000","last_undegraded":"2023-11-04T01:42:04.997165+0000","last_fullsized":"2023-11-04T01:42:04.997165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956751+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:03.956751+0000","last_peered":"2023-11-04T01:42:03.956751+0000","last_clean":"2023-11-04T01:42:03.956751+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:03.956751+0000","last_undegraded":"2023-11-04T01:42:03.956751+0000","last_fullsized":"2023-11-04T01:42:03.956751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960699+0000","last_change":"2023-11-04T01:42:04.960699+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960699+0000","last_undegraded":"2023-11-04T01:42:04.960699+0000","last_fullsized":"2023-11-04T01:42:04.960699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004643+0000","last_change":"2023-11-04T01:42:05.000316+0000","last_active":"2023-11-04T01:42:05.004643+0000","last_peered":"2023-11-04T01:42:05.004643+0000","last_clean":"2023-11-04T01:42:05.004643+0000","last_became_active":"2023-11-04T01:42:04.999528+0000","last_became_peered":"2023-11-04T01:42:04.999528+0000","last_unstale":"2023-11-04T01:42:05.004643+0000","last_undegraded":"2023-11-04T01:42:05.004643+0000","last_fullsized":"2023-11-04T01:42:05.004643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967084+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:03.967084+0000","last_peered":"2023-11-04T01:42:03.967084+0000","last_clean":"2023-11-04T01:42:03.967084+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:03.967084+0000","last_undegraded":"2023-11-04T01:42:03.967084+0000","last_fullsized":"2023-11-04T01:42:03.967084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967082+0000","last_change":"2023-11-04T01:42:04.967082+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967082+0000","last_undegraded":"2023-11-04T01:42:04.967082+0000","last_fullsized":"2023-11-04T01:42:04.967082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004122+0000","last_change":"2023-11-04T01:42:05.002909+0000","last_active":"2023-11-04T01:42:05.004122+0000","last_peered":"2023-11-04T01:42:05.004122+0000","last_clean":"2023-11-04T01:42:05.004122+0000","last_became_active":"2023-11-04T01:42:05.002124+0000","last_became_peered":"2023-11-04T01:42:05.002124+0000","last_unstale":"2023-11-04T01:42:05.004122+0000","last_undegraded":"2023-11-04T01:42:05.004122+0000","last_fullsized":"2023-11-04T01:42:05.004122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:52.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965927+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:03.965927+0000","last_peered":"2023-11-04T01:42:03.965927+0000","last_clean":"2023-11-04T01:42:03.965927+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:03.965927+0000","last_undegraded":"2023-11-04T01:42:03.965927+0000","last_fullsized":"2023-11-04T01:42:03.965927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977926+0000","last_change":"2023-11-04T01:42:04.977926+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977926+0000","last_undegraded":"2023-11-04T01:42:04.977926+0000","last_fullsized":"2023-11-04T01:42:04.977926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.982259+0000","last_change":"2023-11-04T01:42:04.980535+0000","last_active":"2023-11-04T01:42:04.982259+0000","last_peered":"2023-11-04T01:42:04.982259+0000","last_clean":"2023-11-04T01:42:04.982259+0000","last_became_active":"2023-11-04T01:42:04.980311+0000","last_became_peered":"2023-11-04T01:42:04.980311+0000","last_unstale":"2023-11-04T01:42:04.982259+0000","last_undegraded":"2023-11-04T01:42:04.982259+0000","last_fullsized":"2023-11-04T01:42:04.982259+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.961031+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:03.961031+0000","last_peered":"2023-11-04T01:42:03.961031+0000","last_clean":"2023-11-04T01:42:03.961031+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:03.961031+0000","last_undegraded":"2023-11-04T01:42:03.961031+0000","last_fullsized":"2023-11-04T01:42:03.961031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965667+0000","last_change":"2023-11-04T01:42:04.965667+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965667+0000","last_undegraded":"2023-11-04T01:42:04.965667+0000","last_fullsized":"2023-11-04T01:42:04.965667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012538+0000","last_change":"2023-11-04T01:42:05.010609+0000","last_active":"2023-11-04T01:42:05.012538+0000","last_peered":"2023-11-04T01:42:05.012538+0000","last_clean":"2023-11-04T01:42:05.012538+0000","last_became_active":"2023-11-04T01:42:05.009776+0000","last_became_peered":"2023-11-04T01:42:05.009776+0000","last_unstale":"2023-11-04T01:42:05.012538+0000","last_undegraded":"2023-11-04T01:42:05.012538+0000","last_fullsized":"2023-11-04T01:42:05.012538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:29.902914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965033+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:03.965033+0000","last_peered":"2023-11-04T01:42:03.965033+0000","last_clean":"2023-11-04T01:42:03.965033+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:03.965033+0000","last_undegraded":"2023-11-04T01:42:03.965033+0000","last_fullsized":"2023-11-04T01:42:03.965033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970106+0000","last_change":"2023-11-04T01:42:04.970106+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970106+0000","last_undegraded":"2023-11-04T01:42:04.970106+0000","last_fullsized":"2023-11-04T01:42:04.970106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.009032+0000","last_change":"2023-11-04T01:42:04.999767+0000","last_active":"2023-11-04T01:42:05.009032+0000","last_peered":"2023-11-04T01:42:05.009032+0000","last_clean":"2023-11-04T01:42:05.009032+0000","last_became_active":"2023-11-04T01:42:04.998886+0000","last_became_peered":"2023-11-04T01:42:04.998886+0000","last_unstale":"2023-11-04T01:42:05.009032+0000","last_undegraded":"2023-11-04T01:42:05.009032+0000","last_fullsized":"2023-11-04T01:42:05.009032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949319+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:03.949319+0000","last_peered":"2023-11-04T01:42:03.949319+0000","last_clean":"2023-11-04T01:42:03.949319+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:03.949319+0000","last_undegraded":"2023-11-04T01:42:03.949319+0000","last_fullsized":"2023-11-04T01:42:03.949319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965420+0000","last_change":"2023-11-04T01:42:04.965420+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965420+0000","last_undegraded":"2023-11-04T01:42:04.965420+0000","last_fullsized":"2023-11-04T01:42:04.965420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997637+0000","last_change":"2023-11-04T01:42:04.995797+0000","last_active":"2023-11-04T01:42:04.997637+0000","last_peered":"2023-11-04T01:42:04.997637+0000","last_clean":"2023-11-04T01:42:04.997637+0000","last_became_active":"2023-11-04T01:42:04.995421+0000","last_became_peered":"2023-11-04T01:42:04.995421+0000","last_unstale":"2023-11-04T01:42:04.997637+0000","last_undegraded":"2023-11-04T01:42:04.997637+0000","last_fullsized":"2023-11-04T01:42:04.997637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:58.765673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959054+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:03.959054+0000","last_peered":"2023-11-04T01:42:03.959054+0000","last_clean":"2023-11-04T01:42:03.959054+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:03.959054+0000","last_undegraded":"2023-11-04T01:42:03.959054+0000","last_fullsized":"2023-11-04T01:42:03.959054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969628+0000","last_change":"2023-11-04T01:42:04.969628+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969628+0000","last_undegraded":"2023-11-04T01:42:04.969628+0000","last_fullsized":"2023-11-04T01:42:04.969628+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.996668+0000","last_change":"2023-11-04T01:42:04.995419+0000","last_active":"2023-11-04T01:42:04.996668+0000","last_peered":"2023-11-04T01:42:04.996668+0000","last_clean":"2023-11-04T01:42:04.996668+0000","last_became_active":"2023-11-04T01:42:04.995091+0000","last_became_peered":"2023-11-04T01:42:04.995091+0000","last_unstale":"2023-11-04T01:42:04.996668+0000","last_undegraded":"2023-11-04T01:42:04.996668+0000","last_fullsized":"2023-11-04T01:42:04.996668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:41.938181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962392+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:03.962392+0000","last_peered":"2023-11-04T01:42:03.962392+0000","last_clean":"2023-11-04T01:42:03.962392+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:03.962392+0000","last_undegraded":"2023-11-04T01:42:03.962392+0000","last_fullsized":"2023-11-04T01:42:03.962392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979780+0000","last_change":"2023-11-04T01:42:04.979780+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979780+0000","last_undegraded":"2023-11-04T01:42:04.979780+0000","last_fullsized":"2023-11-04T01:42:04.979780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013286+0000","last_change":"2023-11-04T01:42:05.007381+0000","last_active":"2023-11-04T01:42:05.013286+0000","last_peered":"2023-11-04T01:42:05.013286+0000","last_clean":"2023-11-04T01:42:05.013286+0000","last_became_active":"2023-11-04T01:42:05.006783+0000","last_became_peered":"2023-11-04T01:42:05.006783+0000","last_unstale":"2023-11-04T01:42:05.013286+0000","last_undegraded":"2023-11-04T01:42:05.013286+0000","last_fullsized":"2023-11-04T01:42:05.013286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:29.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960774+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:03.960774+0000","last_peered":"2023-11-04T01:42:03.960774+0000","last_clean":"2023-11-04T01:42:03.960774+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:03.960774+0000","last_undegraded":"2023-11-04T01:42:03.960774+0000","last_fullsized":"2023-11-04T01:42:03.960774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959872+0000","last_change":"2023-11-04T01:42:04.959872+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959872+0000","last_undegraded":"2023-11-04T01:42:04.959872+0000","last_fullsized":"2023-11-04T01:42:04.959872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.976478+0000","last_change":"2023-11-04T01:42:04.974191+0000","last_active":"2023-11-04T01:42:04.976478+0000","last_peered":"2023-11-04T01:42:04.976478+0000","last_clean":"2023-11-04T01:42:04.976478+0000","last_became_active":"2023-11-04T01:42:04.973849+0000","last_became_peered":"2023-11-04T01:42:04.973849+0000","last_unstale":"2023-11-04T01:42:04.976478+0000","last_undegraded":"2023-11-04T01:42:04.976478+0000","last_fullsized":"2023-11-04T01:42:04.976478+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.692976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965551+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:03.965551+0000","last_peered":"2023-11-04T01:42:03.965551+0000","last_clean":"2023-11-04T01:42:03.965551+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:03.965551+0000","last_undegraded":"2023-11-04T01:42:03.965551+0000","last_fullsized":"2023-11-04T01:42:03.965551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967061+0000","last_change":"2023-11-04T01:42:04.967061+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967061+0000","last_undegraded":"2023-11-04T01:42:04.967061+0000","last_fullsized":"2023-11-04T01:42:04.967061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004108+0000","last_change":"2023-11-04T01:42:05.002890+0000","last_active":"2023-11-04T01:42:05.004108+0000","last_peered":"2023-11-04T01:42:05.004108+0000","last_clean":"2023-11-04T01:42:05.004108+0000","last_became_active":"2023-11-04T01:42:05.002136+0000","last_became_peered":"2023-11-04T01:42:05.002136+0000","last_unstale":"2023-11-04T01:42:05.004108+0000","last_undegraded":"2023-11-04T01:42:05.004108+0000","last_fullsized":"2023-11-04T01:42:05.004108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:53.284018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966872+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:03.966872+0000","last_peered":"2023-11-04T01:42:03.966872+0000","last_clean":"2023-11-04T01:42:03.966872+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:03.966872+0000","last_undegraded":"2023-11-04T01:42:03.966872+0000","last_fullsized":"2023-11-04T01:42:03.966872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.988515+0000","last_change":"2023-11-04T01:42:04.988515+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.988515+0000","last_undegraded":"2023-11-04T01:42:04.988515+0000","last_fullsized":"2023-11-04T01:42:04.988515+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980369+0000","last_change":"2023-11-04T01:42:04.977260+0000","last_active":"2023-11-04T01:42:04.980369+0000","last_peered":"2023-11-04T01:42:04.980369+0000","last_clean":"2023-11-04T01:42:04.980369+0000","last_became_active":"2023-11-04T01:42:04.976923+0000","last_became_peered":"2023-11-04T01:42:04.976923+0000","last_unstale":"2023-11-04T01:42:04.980369+0000","last_undegraded":"2023-11-04T01:42:04.980369+0000","last_fullsized":"2023-11-04T01:42:04.980369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:16.997158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960957+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:03.960957+0000","last_peered":"2023-11-04T01:42:03.960957+0000","last_clean":"2023-11-04T01:42:03.960957+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:03.960957+0000","last_undegraded":"2023-11-04T01:42:03.960957+0000","last_fullsized":"2023-11-04T01:42:03.960957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.978615+0000","last_change":"2023-11-04T01:42:04.978615+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.978615+0000","last_undegraded":"2023-11-04T01:42:04.978615+0000","last_fullsized":"2023-11-04T01:42:04.978615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.990277+0000","last_change":"2023-11-04T01:42:04.989338+0000","last_active":"2023-11-04T01:42:04.990277+0000","last_peered":"2023-11-04T01:42:04.990277+0000","last_clean":"2023-11-04T01:42:04.990277+0000","last_became_active":"2023-11-04T01:42:04.988983+0000","last_became_peered":"2023-11-04T01:42:04.988983+0000","last_unstale":"2023-11-04T01:42:04.990277+0000","last_undegraded":"2023-11-04T01:42:04.990277+0000","last_fullsized":"2023-11-04T01:42:04.990277+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:56.213941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949185+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:03.949185+0000","last_peered":"2023-11-04T01:42:03.949185+0000","last_clean":"2023-11-04T01:42:03.949185+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:03.949185+0000","last_undegraded":"2023-11-04T01:42:03.949185+0000","last_fullsized":"2023-11-04T01:42:03.949185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959932+0000","last_change":"2023-11-04T01:42:04.959932+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959932+0000","last_undegraded":"2023-11-04T01:42:04.959932+0000","last_fullsized":"2023-11-04T01:42:04.959932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012445+0000","last_change":"2023-11-04T01:42:05.006675+0000","last_active":"2023-11-04T01:42:05.012445+0000","last_peered":"2023-11-04T01:42:05.012445+0000","last_clean":"2023-11-04T01:42:05.012445+0000","last_became_active":"2023-11-04T01:42:05.006360+0000","last_became_peered":"2023-11-04T01:42:05.006360+0000","last_unstale":"2023-11-04T01:42:05.012445+0000","last_undegraded":"2023-11-04T01:42:05.012445+0000","last_fullsized":"2023-11-04T01:42:05.012445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:04.101815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960594+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:03.960594+0000","last_peered":"2023-11-04T01:42:03.960594+0000","last_clean":"2023-11-04T01:42:03.960594+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:03.960594+0000","last_undegraded":"2023-11-04T01:42:03.960594+0000","last_fullsized":"2023-11-04T01:42:03.960594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980514+0000","last_change":"2023-11-04T01:42:04.980514+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980514+0000","last_undegraded":"2023-11-04T01:42:04.980514+0000","last_fullsized":"2023-11-04T01:42:04.980514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997662+0000","last_change":"2023-11-04T01:42:04.996167+0000","last_active":"2023-11-04T01:42:04.997662+0000","last_peered":"2023-11-04T01:42:04.997662+0000","last_clean":"2023-11-04T01:42:04.997662+0000","last_became_active":"2023-11-04T01:42:04.995600+0000","last_became_peered":"2023-11-04T01:42:04.995600+0000","last_unstale":"2023-11-04T01:42:04.997662+0000","last_undegraded":"2023-11-04T01:42:04.997662+0000","last_fullsized":"2023-11-04T01:42:04.997662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:09:09.522884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949309+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:03.949309+0000","last_peered":"2023-11-04T01:42:03.949309+0000","last_clean":"2023-11-04T01:42:03.949309+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:03.949309+0000","last_undegraded":"2023-11-04T01:42:03.949309+0000","last_fullsized":"2023-11-04T01:42:03.949309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960654+0000","last_change":"2023-11-04T01:42:04.960654+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960654+0000","last_undegraded":"2023-11-04T01:42:04.960654+0000","last_fullsized":"2023-11-04T01:42:04.960654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012004+0000","last_change":"2023-11-04T01:42:05.007624+0000","last_active":"2023-11-04T01:42:05.012004+0000","last_peered":"2023-11-04T01:42:05.012004+0000","last_clean":"2023-11-04T01:42:05.012004+0000","last_became_active":"2023-11-04T01:42:05.006885+0000","last_became_peered":"2023-11-04T01:42:05.006885+0000","last_unstale":"2023-11-04T01:42:05.012004+0000","last_undegraded":"2023-11-04T01:42:05.012004+0000","last_fullsized":"2023-11-04T01:42:05.012004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:38.637066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.958955+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:03.958955+0000","last_peered":"2023-11-04T01:42:03.958955+0000","last_clean":"2023-11-04T01:42:03.958955+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:03.958955+0000","last_undegraded":"2023-11-04T01:42:03.958955+0000","last_fullsized":"2023-11-04T01:42:03.958955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968875+0000","last_change":"2023-11-04T01:42:04.968875+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968875+0000","last_undegraded":"2023-11-04T01:42:04.968875+0000","last_fullsized":"2023-11-04T01:42:04.968875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.977461+0000","last_change":"2023-11-04T01:42:04.975673+0000","last_active":"2023-11-04T01:42:04.977461+0000","last_peered":"2023-11-04T01:42:04.977461+0000","last_clean":"2023-11-04T01:42:04.977461+0000","last_became_active":"2023-11-04T01:42:04.975387+0000","last_became_peered":"2023-11-04T01:42:04.975387+0000","last_unstale":"2023-11-04T01:42:04.977461+0000","last_undegraded":"2023-11-04T01:42:04.977461+0000","last_fullsized":"2023-11-04T01:42:04.977461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:34.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962370+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:03.962370+0000","last_peered":"2023-11-04T01:42:03.962370+0000","last_clean":"2023-11-04T01:42:03.962370+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:03.962370+0000","last_undegraded":"2023-11-04T01:42:03.962370+0000","last_fullsized":"2023-11-04T01:42:03.962370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962814+0000","last_change":"2023-11-04T01:42:04.962814+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962814+0000","last_undegraded":"2023-11-04T01:42:04.962814+0000","last_fullsized":"2023-11-04T01:42:04.962814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975489+0000","last_change":"2023-11-04T01:42:04.972222+0000","last_active":"2023-11-04T01:42:04.975489+0000","last_peered":"2023-11-04T01:42:04.975489+0000","last_clean":"2023-11-04T01:42:04.975489+0000","last_became_active":"2023-11-04T01:42:04.971888+0000","last_became_peered":"2023-11-04T01:42:04.971888+0000","last_unstale":"2023-11-04T01:42:04.975489+0000","last_undegraded":"2023-11-04T01:42:04.975489+0000","last_fullsized":"2023-11-04T01:42:04.975489+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:39.375558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966888+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:03.966888+0000","last_peered":"2023-11-04T01:42:03.966888+0000","last_clean":"2023-11-04T01:42:03.966888+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:03.966888+0000","last_undegraded":"2023-11-04T01:42:03.966888+0000","last_fullsized":"2023-11-04T01:42:03.966888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976632+0000","last_change":"2023-11-04T01:42:04.976632+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976632+0000","last_undegraded":"2023-11-04T01:42:04.976632+0000","last_fullsized":"2023-11-04T01:42:04.976632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013275+0000","last_change":"2023-11-04T01:42:05.007348+0000","last_active":"2023-11-04T01:42:05.013275+0000","last_peered":"2023-11-04T01:42:05.013275+0000","last_clean":"2023-11-04T01:42:05.013275+0000","last_became_active":"2023-11-04T01:42:05.006661+0000","last_became_peered":"2023-11-04T01:42:05.006661+0000","last_unstale":"2023-11-04T01:42:05.013275+0000","last_undegraded":"2023-11-04T01:42:05.013275+0000","last_fullsized":"2023-11-04T01:42:05.013275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:01:12.774886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957638+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:03.957638+0000","last_peered":"2023-11-04T01:42:03.957638+0000","last_clean":"2023-11-04T01:42:03.957638+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:03.957638+0000","last_undegraded":"2023-11-04T01:42:03.957638+0000","last_fullsized":"2023-11-04T01:42:03.957638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964445+0000","last_change":"2023-11-04T01:42:04.964445+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964445+0000","last_undegraded":"2023-11-04T01:42:04.964445+0000","last_fullsized":"2023-11-04T01:42:04.964445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984367+0000","last_change":"2023-11-04T01:42:04.983369+0000","last_active":"2023-11-04T01:42:04.984367+0000","last_peered":"2023-11-04T01:42:04.984367+0000","last_clean":"2023-11-04T01:42:04.984367+0000","last_became_active":"2023-11-04T01:42:04.983083+0000","last_became_peered":"2023-11-04T01:42:04.983083+0000","last_unstale":"2023-11-04T01:42:04.984367+0000","last_undegraded":"2023-11-04T01:42:04.984367+0000","last_fullsized":"2023-11-04T01:42:04.984367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960886+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:03.960886+0000","last_peered":"2023-11-04T01:42:03.960886+0000","last_clean":"2023-11-04T01:42:03.960886+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:03.960886+0000","last_undegraded":"2023-11-04T01:42:03.960886+0000","last_fullsized":"2023-11-04T01:42:03.960886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965988+0000","last_change":"2023-11-04T01:42:04.965988+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965988+0000","last_undegraded":"2023-11-04T01:42:04.965988+0000","last_fullsized":"2023-11-04T01:42:04.965988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015151+0000","last_change":"2023-11-04T01:42:05.011704+0000","last_active":"2023-11-04T01:42:05.015151+0000","last_peered":"2023-11-04T01:42:05.015151+0000","last_clean":"2023-11-04T01:42:05.015151+0000","last_became_active":"2023-11-04T01:42:05.010990+0000","last_became_peered":"2023-11-04T01:42:05.010990+0000","last_unstale":"2023-11-04T01:42:05.015151+0000","last_undegraded":"2023-11-04T01:42:05.015151+0000","last_fullsized":"2023-11-04T01:42:05.015151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:38.042581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949162+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:03.949162+0000","last_peered":"2023-11-04T01:42:03.949162+0000","last_clean":"2023-11-04T01:42:03.949162+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:03.949162+0000","last_undegraded":"2023-11-04T01:42:03.949162+0000","last_fullsized":"2023-11-04T01:42:03.949162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960929+0000","last_change":"2023-11-04T01:42:04.960929+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960929+0000","last_undegraded":"2023-11-04T01:42:04.960929+0000","last_fullsized":"2023-11-04T01:42:04.960929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984339+0000","last_change":"2023-11-04T01:42:04.978969+0000","last_active":"2023-11-04T01:42:04.984339+0000","last_peered":"2023-11-04T01:42:04.984339+0000","last_clean":"2023-11-04T01:42:04.984339+0000","last_became_active":"2023-11-04T01:42:04.978240+0000","last_became_peered":"2023-11-04T01:42:04.978240+0000","last_unstale":"2023-11-04T01:42:04.984339+0000","last_undegraded":"2023-11-04T01:42:04.984339+0000","last_fullsized":"2023-11-04T01:42:04.984339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:20.145051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.964938+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:03.964938+0000","last_peered":"2023-11-04T01:42:03.964938+0000","last_clean":"2023-11-04T01:42:03.964938+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:03.964938+0000","last_undegraded":"2023-11-04T01:42:03.964938+0000","last_fullsized":"2023-11-04T01:42:03.964938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979351+0000","last_change":"2023-11-04T01:42:04.979351+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979351+0000","last_undegraded":"2023-11-04T01:42:04.979351+0000","last_fullsized":"2023-11-04T01:42:04.979351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013341+0000","last_change":"2023-11-04T01:42:05.007818+0000","last_active":"2023-11-04T01:42:05.013341+0000","last_peered":"2023-11-04T01:42:05.013341+0000","last_clean":"2023-11-04T01:42:05.013341+0000","last_became_active":"2023-11-04T01:42:05.006963+0000","last_became_peered":"2023-11-04T01:42:05.006963+0000","last_unstale":"2023-11-04T01:42:05.013341+0000","last_undegraded":"2023-11-04T01:42:05.013341+0000","last_fullsized":"2023-11-04T01:42:05.013341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:38.168718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959078+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:03.959078+0000","last_peered":"2023-11-04T01:42:03.959078+0000","last_clean":"2023-11-04T01:42:03.959078+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:03.959078+0000","last_undegraded":"2023-11-04T01:42:03.959078+0000","last_fullsized":"2023-11-04T01:42:03.959078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962838+0000","last_change":"2023-11-04T01:42:04.962838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962838+0000","last_undegraded":"2023-11-04T01:42:04.962838+0000","last_fullsized":"2023-11-04T01:42:04.962838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.005558+0000","last_change":"2023-11-04T01:42:05.001976+0000","last_active":"2023-11-04T01:42:05.005558+0000","last_peered":"2023-11-04T01:42:05.005558+0000","last_clean":"2023-11-04T01:42:05.005558+0000","last_became_active":"2023-11-04T01:42:05.001247+0000","last_became_peered":"2023-11-04T01:42:05.001247+0000","last_unstale":"2023-11-04T01:42:05.005558+0000","last_undegraded":"2023-11-04T01:42:05.005558+0000","last_fullsized":"2023-11-04T01:42:05.005558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:20.498259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960813+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:03.960813+0000","last_peered":"2023-11-04T01:42:03.960813+0000","last_clean":"2023-11-04T01:42:03.960813+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:03.960813+0000","last_undegraded":"2023-11-04T01:42:03.960813+0000","last_fullsized":"2023-11-04T01:42:03.960813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964373+0000","last_change":"2023-11-04T01:42:04.964373+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964373+0000","last_undegraded":"2023-11-04T01:42:04.964373+0000","last_fullsized":"2023-11-04T01:42:04.964373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015020+0000","last_change":"2023-11-04T01:42:05.010393+0000","last_active":"2023-11-04T01:42:05.015020+0000","last_peered":"2023-11-04T01:42:05.015020+0000","last_clean":"2023-11-04T01:42:05.015020+0000","last_became_active":"2023-11-04T01:42:05.009748+0000","last_became_peered":"2023-11-04T01:42:05.009748+0000","last_unstale":"2023-11-04T01:42:05.015020+0000","last_undegraded":"2023-11-04T01:42:05.015020+0000","last_fullsized":"2023-11-04T01:42:05.015020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:52.103809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966597+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:03.966597+0000","last_peered":"2023-11-04T01:42:03.966597+0000","last_clean":"2023-11-04T01:42:03.966597+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:03.966597+0000","last_undegraded":"2023-11-04T01:42:03.966597+0000","last_fullsized":"2023-11-04T01:42:03.966597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965842+0000","last_change":"2023-11-04T01:42:04.965842+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965842+0000","last_undegraded":"2023-11-04T01:42:04.965842+0000","last_fullsized":"2023-11-04T01:42:04.965842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004590+0000","last_change":"2023-11-04T01:42:05.000198+0000","last_active":"2023-11-04T01:42:05.004590+0000","last_peered":"2023-11-04T01:42:05.004590+0000","last_clean":"2023-11-04T01:42:05.004590+0000","last_became_active":"2023-11-04T01:42:04.999551+0000","last_became_peered":"2023-11-04T01:42:04.999551+0000","last_unstale":"2023-11-04T01:42:05.004590+0000","last_undegraded":"2023-11-04T01:42:05.004590+0000","last_fullsized":"2023-11-04T01:42:05.004590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:34.807369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956841+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:03.956841+0000","last_peered":"2023-11-04T01:42:03.956841+0000","last_clean":"2023-11-04T01:42:03.956841+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:03.956841+0000","last_undegraded":"2023-11-04T01:42:03.956841+0000","last_fullsized":"2023-11-04T01:42:03.956841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1302528,"data_stored":896392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":29.603000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.462},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":8.1280000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":2.6389999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":25.791}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":3.98},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":25.696999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":11.064},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":4.1630000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.581},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":4.0730000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.92000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":1.048},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.748}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.006}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.133},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.139},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.2}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.089},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.4910000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.155},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.089}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.753},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":1.0329999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.103}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":1.21}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":1.163}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.28},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":1.0860000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.329},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.747}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.622}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":903012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.80400000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":0.82699999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:09.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.206+0000 7f149443c640 1 Processor -- start 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.206+0000 7f149443c640 1 -- start start 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f149443c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f148c0b0890 0x7f148c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f149443c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0ce320 con 0x7f148c0b0c70 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f149443c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0ce600 con 0x7f148c0c9960 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f149443c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c06d2f0 con 0x7f148c0b0890 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14929d9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f148c0b0c70 0x7f148c0ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43820/0 (socket says 172.21.15.40:43820) 2023-11-04T01:42:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14929d9640 1 -- 172.21.15.40:0/1073640264 learned_addr learned my addr 172.21.15.40:0/1073640264 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672750499 0 0) 0x7f148c0ce320 con 0x7f148c0b0c70 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14921d8640 1 --2- 172.21.15.40:0/1073640264 >> v2:172.21.15.91:3300/0 conn(0x7f148c0b0890 0x7f148c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1478005740 con 0x7f148c0b0c70 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2770501323 0 0) 0x7f1478005740 con 0x7f148c0b0c70 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 >> v2:172.21.15.91:3300/0 conn(0x7f148c0b0890 msgr2=0x7f148c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 --2- 172.21.15.40:0/1073640264 >> v2:172.21.15.91:3300/0 conn(0x7f148c0b0890 0x7f148c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 >> v1:172.21.15.91:6789/0 conn(0x7f148c0c9960 legacy=0x7f148c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0ce8e0 con 0x7f148c0b0c70 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1484001a00 con 0x7f148c0b0c70 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 >> v1:172.21.15.40:6789/0 conn(0x7f148c0b0c70 legacy=0x7f148c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1478005b90 0x7f1478005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f1478006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14780073a0 0x7f147800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c06d2f0 con 0x7f14780069e0 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147800e240 con 0x7f14780073a0 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147800e400 con 0x7f1478005b90 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f1478006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14921d8640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1478005b90 0x7f1478005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 -- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1478005b90 msgr2=0x7f1478005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1478005b90 0x7f1478005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 -- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14780073a0 msgr2=0x7f147800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f14780073a0 0x7f147800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 -- 172.21.15.40:0/1073640264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478005740 con 0x7f14780069e0 2023-11-04T01:42:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14929d9640 1 -- 172.21.15.40:0/1073640264 reap_dead start 2023-11-04T01:42:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14921d8640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1478005b90 0x7f1478005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:09.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14919d7640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f1478006e60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f147c001780 tx=0x7f147c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9ad4e9a9b764ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.210+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c0052d0 con 0x7f14780069e0 2023-11-04T01:42:09.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c0a7050 con 0x7f14780069e0 2023-11-04T01:42:09.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14911d6640 1 -- 172.21.15.40:0/1073640264 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c003600 con 0x7f14780069e0 2023-11-04T01:42:09.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/1073640264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 msgr2=0x7f1478006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f1478006e60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f147c001780 tx=0x7f147c01c400 comp rx=0 tx=0).stop 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/1073640264 shutdown_connections 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 --2- 172.21.15.40:0/1073640264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f1478006e60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/1073640264 >> 172.21.15.40:0/1073640264 conn(0x7f148c0cebb0 msgr2=0x7f148c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/1073640264 shutdown_connections 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/1073640264 wait complete. 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 Processor -- start 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- start start 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f148c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f148c1f27f0 0x7f148c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f148c158390 0x7f148c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c151150 con 0x7f14780069e0 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c158be0 con 0x7f148c158390 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0c5c60 con 0x7f148c1f27f0 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f148c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f148c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57254/0 (socket says 172.21.15.40:57254) 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 -- 172.21.15.40:0/2292757917 learned_addr learned my addr 172.21.15.40:0/2292757917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14929d9640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f148c158390 0x7f148c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14919d7640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f148c1f27f0 0x7f148c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 -- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f148c1f27f0 msgr2=0x7f148c150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f148c1f27f0 0x7f148c150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 -- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f148c158390 msgr2=0x7f148c06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f148c158390 0x7f148c06ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 -- 172.21.15.40:0/2292757917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0c8940 con 0x7f14780069e0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14929d9640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f148c158390 0x7f148c06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f14921d8640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f148c1520d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1488010820 tx=0x7f1488010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488004220 con 0x7f14780069e0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488010ed0 con 0x7f14780069e0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800e960 con 0x7f14780069e0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c151350 con 0x7f14780069e0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.214+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1518d0 con 0x7f14780069e0 2023-11-04T01:42:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.218+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c0744a0 con 0x7f14780069e0 2023-11-04T01:42:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.218+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f148800eac0 con 0x7f14780069e0 2023-11-04T01:42:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.218+0000 7f1482ffd640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14700664d0 0x7f1470068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.218+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1488083f40 con 0x7f14780069e0 2023-11-04T01:42:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.218+0000 7f14919d7640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14700664d0 0x7f1470068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.218+0000 7f14919d7640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14700664d0 0x7f1470068990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f147c004000 tx=0x7f147c0011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.222+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14880511d0 con 0x7f14780069e0 2023-11-04T01:42:09.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.366+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f148c0cca70 con 0x7f14700664d0 2023-11-04T01:42:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.394+0000 7f1482ffd640 1 -- 172.21.15.40:0/2292757917 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363467 (secure 0 0 0) 0x7f147c005270 con 0x7f14700664d0 2023-11-04T01:42:09.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14700664d0 msgr2=0x7f1470068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14700664d0 0x7f1470068990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f147c004000 tx=0x7f147c0011a0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 msgr2=0x7f148c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f148c1520d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f1488010820 tx=0x7f1488010ce0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 shutdown_connections 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14700664d0 0x7f1470068990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f148c158390 0x7f148c06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f148c1f27f0 0x7f148c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 --2- 172.21.15.40:0/2292757917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14780069e0 0x7f148c1520d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 >> 172.21.15.40:0/2292757917 conn(0x7f148c0cebb0 msgr2=0x7f148c0cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 shutdown_connections 2023-11-04T01:42:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.398+0000 7f149443c640 1 -- 172.21.15.40:0/2292757917 wait complete. 2023-11-04T01:42:09.422 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-11-04T01:42:07.795295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231228,"kb_used_data":6732,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743492,"statfs":{"total":773094113280,"available":772857335808,"internally_reserved":0,"allocated":6893568,"data_stored":3648788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001617"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964311+0000","last_change":"2023-11-04T01:42:04.964311+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964311+0000","last_undegraded":"2023-11-04T01:42:04.964311+0000","last_fullsized":"2023-11-04T01:42:04.964311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963394+0000","last_change":"2023-11-04T01:42:04.963394+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963394+0000","last_undegraded":"2023-11-04T01:42:04.963394+0000","last_fullsized":"2023-11-04T01:42:04.963394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970604+0000","last_change":"2023-11-04T01:42:04.970604+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970604+0000","last_undegraded":"2023-11-04T01:42:04.970604+0000","last_fullsized":"2023-11-04T01:42:04.970604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963630+0000","last_change":"2023-11-04T01:42:04.963630+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963630+0000","last_undegraded":"2023-11-04T01:42:04.963630+0000","last_fullsized":"2023-11-04T01:42:04.963630+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980355+0000","last_change":"2023-11-04T01:42:04.980355+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980355+0000","last_undegraded":"2023-11-04T01:42:04.980355+0000","last_fullsized":"2023-11-04T01:42:04.980355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964101+0000","last_change":"2023-11-04T01:42:04.964101+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964101+0000","last_undegraded":"2023-11-04T01:42:04.964101+0000","last_fullsized":"2023-11-04T01:42:04.964101+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967421+0000","last_change":"2023-11-04T01:42:04.967421+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967421+0000","last_undegraded":"2023-11-04T01:42:04.967421+0000","last_fullsized":"2023-11-04T01:42:04.967421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970577+0000","last_change":"2023-11-04T01:42:04.970577+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970577+0000","last_undegraded":"2023-11-04T01:42:04.970577+0000","last_fullsized":"2023-11-04T01:42:04.970577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972671+0000","last_change":"2023-11-04T01:42:04.972671+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972671+0000","last_undegraded":"2023-11-04T01:42:04.972671+0000","last_fullsized":"2023-11-04T01:42:04.972671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968979+0000","last_change":"2023-11-04T01:42:04.968979+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968979+0000","last_undegraded":"2023-11-04T01:42:04.968979+0000","last_fullsized":"2023-11-04T01:42:04.968979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967722+0000","last_change":"2023-11-04T01:42:04.967722+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967722+0000","last_undegraded":"2023-11-04T01:42:04.967722+0000","last_fullsized":"2023-11-04T01:42:04.967722+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969387+0000","last_change":"2023-11-04T01:42:04.969387+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969387+0000","last_undegraded":"2023-11-04T01:42:04.969387+0000","last_fullsized":"2023-11-04T01:42:04.969387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961992+0000","last_change":"2023-11-04T01:42:04.961992+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961992+0000","last_undegraded":"2023-11-04T01:42:04.961992+0000","last_fullsized":"2023-11-04T01:42:04.961992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.971346+0000","last_change":"2023-11-04T01:42:04.971346+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.971346+0000","last_undegraded":"2023-11-04T01:42:04.971346+0000","last_fullsized":"2023-11-04T01:42:04.971346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968406+0000","last_change":"2023-11-04T01:42:04.968406+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968406+0000","last_undegraded":"2023-11-04T01:42:04.968406+0000","last_fullsized":"2023-11-04T01:42:04.968406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969330+0000","last_change":"2023-11-04T01:42:04.969330+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969330+0000","last_undegraded":"2023-11-04T01:42:04.969330+0000","last_fullsized":"2023-11-04T01:42:04.969330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963815+0000","last_change":"2023-11-04T01:42:04.963815+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963815+0000","last_undegraded":"2023-11-04T01:42:04.963815+0000","last_fullsized":"2023-11-04T01:42:04.963815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961915+0000","last_change":"2023-11-04T01:42:04.961915+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961915+0000","last_undegraded":"2023-11-04T01:42:04.961915+0000","last_fullsized":"2023-11-04T01:42:04.961915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977955+0000","last_change":"2023-11-04T01:42:04.977955+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977955+0000","last_undegraded":"2023-11-04T01:42:04.977955+0000","last_fullsized":"2023-11-04T01:42:04.977955+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960714+0000","last_change":"2023-11-04T01:42:04.960714+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960714+0000","last_undegraded":"2023-11-04T01:42:04.960714+0000","last_fullsized":"2023-11-04T01:42:04.960714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960644+0000","last_change":"2023-11-04T01:42:04.960644+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960644+0000","last_undegraded":"2023-11-04T01:42:04.960644+0000","last_fullsized":"2023-11-04T01:42:04.960644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961806+0000","last_change":"2023-11-04T01:42:04.961806+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961806+0000","last_undegraded":"2023-11-04T01:42:04.961806+0000","last_fullsized":"2023-11-04T01:42:04.961806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960731+0000","last_change":"2023-11-04T01:42:04.960731+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960731+0000","last_undegraded":"2023-11-04T01:42:04.960731+0000","last_fullsized":"2023-11-04T01:42:04.960731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968164+0000","last_change":"2023-11-04T01:42:04.968164+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968164+0000","last_undegraded":"2023-11-04T01:42:04.968164+0000","last_fullsized":"2023-11-04T01:42:04.968164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965282+0000","last_change":"2023-11-04T01:42:04.965282+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965282+0000","last_undegraded":"2023-11-04T01:42:04.965282+0000","last_fullsized":"2023-11-04T01:42:04.965282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968209+0000","last_change":"2023-11-04T01:42:04.968209+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968209+0000","last_undegraded":"2023-11-04T01:42:04.968209+0000","last_fullsized":"2023-11-04T01:42:04.968209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966582+0000","last_change":"2023-11-04T01:42:04.966582+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966582+0000","last_undegraded":"2023-11-04T01:42:04.966582+0000","last_fullsized":"2023-11-04T01:42:04.966582+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966509+0000","last_change":"2023-11-04T01:42:04.966509+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966509+0000","last_undegraded":"2023-11-04T01:42:04.966509+0000","last_fullsized":"2023-11-04T01:42:04.966509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972381+0000","last_change":"2023-11-04T01:42:04.972381+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972381+0000","last_undegraded":"2023-11-04T01:42:04.972381+0000","last_fullsized":"2023-11-04T01:42:04.972381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963276+0000","last_change":"2023-11-04T01:42:04.963276+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963276+0000","last_undegraded":"2023-11-04T01:42:04.963276+0000","last_fullsized":"2023-11-04T01:42:04.963276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961302+0000","last_change":"2023-11-04T01:42:04.961302+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961302+0000","last_undegraded":"2023-11-04T01:42:04.961302+0000","last_fullsized":"2023-11-04T01:42:04.961302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964401+0000","last_change":"2023-11-04T01:42:04.964401+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964401+0000","last_undegraded":"2023-11-04T01:42:04.964401+0000","last_fullsized":"2023-11-04T01:42:04.964401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979252+0000","last_change":"2023-11-04T01:42:04.979252+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979252+0000","last_undegraded":"2023-11-04T01:42:04.979252+0000","last_fullsized":"2023-11-04T01:42:04.979252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975784+0000","last_change":"2023-11-04T01:42:04.971841+0000","last_active":"2023-11-04T01:42:04.975784+0000","last_peered":"2023-11-04T01:42:04.975784+0000","last_clean":"2023-11-04T01:42:04.975784+0000","last_became_active":"2023-11-04T01:42:04.971405+0000","last_became_peered":"2023-11-04T01:42:04.971405+0000","last_unstale":"2023-11-04T01:42:04.975784+0000","last_undegraded":"2023-11-04T01:42:04.975784+0000","last_fullsized":"2023-11-04T01:42:04.975784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:17.604230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966449+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:03.966449+0000","last_peered":"2023-11-04T01:42:03.966449+0000","last_clean":"2023-11-04T01:42:03.966449+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:03.966449+0000","last_undegraded":"2023-11-04T01:42:03.966449+0000","last_fullsized":"2023-11-04T01:42:03.966449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966189+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:03.966189+0000","last_peered":"2023-11-04T01:42:03.966189+0000","last_clean":"2023-11-04T01:42:03.966189+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:03.966189+0000","last_undegraded":"2023-11-04T01:42:03.966189+0000","last_fullsized":"2023-11-04T01:42:03.966189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960838+0000","last_change":"2023-11-04T01:42:04.960838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960838+0000","last_undegraded":"2023-11-04T01:42:04.960838+0000","last_fullsized":"2023-11-04T01:42:04.960838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015040+0000","last_change":"2023-11-04T01:42:05.010568+0000","last_active":"2023-11-04T01:42:05.015040+0000","last_peered":"2023-11-04T01:42:05.015040+0000","last_clean":"2023-11-04T01:42:05.015040+0000","last_became_active":"2023-11-04T01:42:05.009935+0000","last_became_peered":"2023-11-04T01:42:05.009935+0000","last_unstale":"2023-11-04T01:42:05.015040+0000","last_undegraded":"2023-11-04T01:42:05.015040+0000","last_fullsized":"2023-11-04T01:42:05.015040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:58.106427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957847+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:03.957847+0000","last_peered":"2023-11-04T01:42:03.957847+0000","last_clean":"2023-11-04T01:42:03.957847+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:03.957847+0000","last_undegraded":"2023-11-04T01:42:03.957847+0000","last_fullsized":"2023-11-04T01:42:03.957847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.982231+0000","last_change":"2023-11-04T01:42:04.982231+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.982231+0000","last_undegraded":"2023-11-04T01:42:04.982231+0000","last_fullsized":"2023-11-04T01:42:04.982231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980251+0000","last_change":"2023-11-04T01:42:04.978763+0000","last_active":"2023-11-04T01:42:04.980251+0000","last_peered":"2023-11-04T01:42:04.980251+0000","last_clean":"2023-11-04T01:42:04.980251+0000","last_became_active":"2023-11-04T01:42:04.978517+0000","last_became_peered":"2023-11-04T01:42:04.978517+0000","last_unstale":"2023-11-04T01:42:04.980251+0000","last_undegraded":"2023-11-04T01:42:04.980251+0000","last_fullsized":"2023-11-04T01:42:04.980251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:24:48.216767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967737+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:03.967737+0000","last_peered":"2023-11-04T01:42:03.967737+0000","last_clean":"2023-11-04T01:42:03.967737+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:03.967737+0000","last_undegraded":"2023-11-04T01:42:03.967737+0000","last_fullsized":"2023-11-04T01:42:03.967737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970601+0000","last_change":"2023-11-04T01:42:04.970601+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970601+0000","last_undegraded":"2023-11-04T01:42:04.970601+0000","last_fullsized":"2023-11-04T01:42:04.970601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.010311+0000","last_change":"2023-11-04T01:42:05.003124+0000","last_active":"2023-11-04T01:42:05.010311+0000","last_peered":"2023-11-04T01:42:05.010311+0000","last_clean":"2023-11-04T01:42:05.010311+0000","last_became_active":"2023-11-04T01:42:05.002439+0000","last_became_peered":"2023-11-04T01:42:05.002439+0000","last_unstale":"2023-11-04T01:42:05.010311+0000","last_undegraded":"2023-11-04T01:42:05.010311+0000","last_fullsized":"2023-11-04T01:42:05.010311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:38.112432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949271+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:03.949271+0000","last_peered":"2023-11-04T01:42:03.949271+0000","last_clean":"2023-11-04T01:42:03.949271+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:03.949271+0000","last_undegraded":"2023-11-04T01:42:03.949271+0000","last_fullsized":"2023-11-04T01:42:03.949271+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976588+0000","last_change":"2023-11-04T01:42:04.976588+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976588+0000","last_undegraded":"2023-11-04T01:42:04.976588+0000","last_fullsized":"2023-11-04T01:42:04.976588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013327+0000","last_change":"2023-11-04T01:42:05.007493+0000","last_active":"2023-11-04T01:42:05.013327+0000","last_peered":"2023-11-04T01:42:05.013327+0000","last_clean":"2023-11-04T01:42:05.013327+0000","last_became_active":"2023-11-04T01:42:05.006869+0000","last_became_peered":"2023-11-04T01:42:05.006869+0000","last_unstale":"2023-11-04T01:42:05.013327+0000","last_undegraded":"2023-11-04T01:42:05.013327+0000","last_fullsized":"2023-11-04T01:42:05.013327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:08.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956698+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:03.956698+0000","last_peered":"2023-11-04T01:42:03.956698+0000","last_clean":"2023-11-04T01:42:03.956698+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:03.956698+0000","last_undegraded":"2023-11-04T01:42:03.956698+0000","last_fullsized":"2023-11-04T01:42:03.956698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976659+0000","last_change":"2023-11-04T01:42:04.976659+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976659+0000","last_undegraded":"2023-11-04T01:42:04.976659+0000","last_fullsized":"2023-11-04T01:42:04.976659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012469+0000","last_change":"2023-11-04T01:42:05.006827+0000","last_active":"2023-11-04T01:42:05.012469+0000","last_peered":"2023-11-04T01:42:05.012469+0000","last_clean":"2023-11-04T01:42:05.012469+0000","last_became_active":"2023-11-04T01:42:05.006480+0000","last_became_peered":"2023-11-04T01:42:05.006480+0000","last_unstale":"2023-11-04T01:42:05.012469+0000","last_undegraded":"2023-11-04T01:42:05.012469+0000","last_fullsized":"2023-11-04T01:42:05.012469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:42.750611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960719+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:03.960719+0000","last_peered":"2023-11-04T01:42:03.960719+0000","last_clean":"2023-11-04T01:42:03.960719+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:03.960719+0000","last_undegraded":"2023-11-04T01:42:03.960719+0000","last_fullsized":"2023-11-04T01:42:03.960719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963624+0000","last_change":"2023-11-04T01:42:04.963624+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963624+0000","last_undegraded":"2023-11-04T01:42:04.963624+0000","last_fullsized":"2023-11-04T01:42:04.963624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997165+0000","last_change":"2023-11-04T01:42:04.994894+0000","last_active":"2023-11-04T01:42:04.997165+0000","last_peered":"2023-11-04T01:42:04.997165+0000","last_clean":"2023-11-04T01:42:04.997165+0000","last_became_active":"2023-11-04T01:42:04.994554+0000","last_became_peered":"2023-11-04T01:42:04.994554+0000","last_unstale":"2023-11-04T01:42:04.997165+0000","last_undegraded":"2023-11-04T01:42:04.997165+0000","last_fullsized":"2023-11-04T01:42:04.997165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956751+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:03.956751+0000","last_peered":"2023-11-04T01:42:03.956751+0000","last_clean":"2023-11-04T01:42:03.956751+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:03.956751+0000","last_undegraded":"2023-11-04T01:42:03.956751+0000","last_fullsized":"2023-11-04T01:42:03.956751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960699+0000","last_change":"2023-11-04T01:42:04.960699+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960699+0000","last_undegraded":"2023-11-04T01:42:04.960699+0000","last_fullsized":"2023-11-04T01:42:04.960699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004643+0000","last_change":"2023-11-04T01:42:05.000316+0000","last_active":"2023-11-04T01:42:05.004643+0000","last_peered":"2023-11-04T01:42:05.004643+0000","last_clean":"2023-11-04T01:42:05.004643+0000","last_became_active":"2023-11-04T01:42:04.999528+0000","last_became_peered":"2023-11-04T01:42:04.999528+0000","last_unstale":"2023-11-04T01:42:05.004643+0000","last_undegraded":"2023-11-04T01:42:05.004643+0000","last_fullsized":"2023-11-04T01:42:05.004643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967084+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:03.967084+0000","last_peered":"2023-11-04T01:42:03.967084+0000","last_clean":"2023-11-04T01:42:03.967084+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:03.967084+0000","last_undegraded":"2023-11-04T01:42:03.967084+0000","last_fullsized":"2023-11-04T01:42:03.967084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967082+0000","last_change":"2023-11-04T01:42:04.967082+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967082+0000","last_undegraded":"2023-11-04T01:42:04.967082+0000","last_fullsized":"2023-11-04T01:42:04.967082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004122+0000","last_change":"2023-11-04T01:42:05.002909+0000","last_active":"2023-11-04T01:42:05.004122+0000","last_peered":"2023-11-04T01:42:05.004122+0000","last_clean":"2023-11-04T01:42:05.004122+0000","last_became_active":"2023-11-04T01:42:05.002124+0000","last_became_peered":"2023-11-04T01:42:05.002124+0000","last_unstale":"2023-11-04T01:42:05.004122+0000","last_undegraded":"2023-11-04T01:42:05.004122+0000","last_fullsized":"2023-11-04T01:42:05.004122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:52.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965927+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:03.965927+0000","last_peered":"2023-11-04T01:42:03.965927+0000","last_clean":"2023-11-04T01:42:03.965927+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:03.965927+0000","last_undegraded":"2023-11-04T01:42:03.965927+0000","last_fullsized":"2023-11-04T01:42:03.965927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977926+0000","last_change":"2023-11-04T01:42:04.977926+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977926+0000","last_undegraded":"2023-11-04T01:42:04.977926+0000","last_fullsized":"2023-11-04T01:42:04.977926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.982259+0000","last_change":"2023-11-04T01:42:04.980535+0000","last_active":"2023-11-04T01:42:04.982259+0000","last_peered":"2023-11-04T01:42:04.982259+0000","last_clean":"2023-11-04T01:42:04.982259+0000","last_became_active":"2023-11-04T01:42:04.980311+0000","last_became_peered":"2023-11-04T01:42:04.980311+0000","last_unstale":"2023-11-04T01:42:04.982259+0000","last_undegraded":"2023-11-04T01:42:04.982259+0000","last_fullsized":"2023-11-04T01:42:04.982259+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.961031+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:03.961031+0000","last_peered":"2023-11-04T01:42:03.961031+0000","last_clean":"2023-11-04T01:42:03.961031+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:03.961031+0000","last_undegraded":"2023-11-04T01:42:03.961031+0000","last_fullsized":"2023-11-04T01:42:03.961031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965667+0000","last_change":"2023-11-04T01:42:04.965667+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965667+0000","last_undegraded":"2023-11-04T01:42:04.965667+0000","last_fullsized":"2023-11-04T01:42:04.965667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012538+0000","last_change":"2023-11-04T01:42:05.010609+0000","last_active":"2023-11-04T01:42:05.012538+0000","last_peered":"2023-11-04T01:42:05.012538+0000","last_clean":"2023-11-04T01:42:05.012538+0000","last_became_active":"2023-11-04T01:42:05.009776+0000","last_became_peered":"2023-11-04T01:42:05.009776+0000","last_unstale":"2023-11-04T01:42:05.012538+0000","last_undegraded":"2023-11-04T01:42:05.012538+0000","last_fullsized":"2023-11-04T01:42:05.012538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:29.902914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965033+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:03.965033+0000","last_peered":"2023-11-04T01:42:03.965033+0000","last_clean":"2023-11-04T01:42:03.965033+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:03.965033+0000","last_undegraded":"2023-11-04T01:42:03.965033+0000","last_fullsized":"2023-11-04T01:42:03.965033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970106+0000","last_change":"2023-11-04T01:42:04.970106+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970106+0000","last_undegraded":"2023-11-04T01:42:04.970106+0000","last_fullsized":"2023-11-04T01:42:04.970106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.009032+0000","last_change":"2023-11-04T01:42:04.999767+0000","last_active":"2023-11-04T01:42:05.009032+0000","last_peered":"2023-11-04T01:42:05.009032+0000","last_clean":"2023-11-04T01:42:05.009032+0000","last_became_active":"2023-11-04T01:42:04.998886+0000","last_became_peered":"2023-11-04T01:42:04.998886+0000","last_unstale":"2023-11-04T01:42:05.009032+0000","last_undegraded":"2023-11-04T01:42:05.009032+0000","last_fullsized":"2023-11-04T01:42:05.009032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949319+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:03.949319+0000","last_peered":"2023-11-04T01:42:03.949319+0000","last_clean":"2023-11-04T01:42:03.949319+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:03.949319+0000","last_undegraded":"2023-11-04T01:42:03.949319+0000","last_fullsized":"2023-11-04T01:42:03.949319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965420+0000","last_change":"2023-11-04T01:42:04.965420+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965420+0000","last_undegraded":"2023-11-04T01:42:04.965420+0000","last_fullsized":"2023-11-04T01:42:04.965420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997637+0000","last_change":"2023-11-04T01:42:04.995797+0000","last_active":"2023-11-04T01:42:04.997637+0000","last_peered":"2023-11-04T01:42:04.997637+0000","last_clean":"2023-11-04T01:42:04.997637+0000","last_became_active":"2023-11-04T01:42:04.995421+0000","last_became_peered":"2023-11-04T01:42:04.995421+0000","last_unstale":"2023-11-04T01:42:04.997637+0000","last_undegraded":"2023-11-04T01:42:04.997637+0000","last_fullsized":"2023-11-04T01:42:04.997637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:58.765673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959054+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:03.959054+0000","last_peered":"2023-11-04T01:42:03.959054+0000","last_clean":"2023-11-04T01:42:03.959054+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:03.959054+0000","last_undegraded":"2023-11-04T01:42:03.959054+0000","last_fullsized":"2023-11-04T01:42:03.959054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969628+0000","last_change":"2023-11-04T01:42:04.969628+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969628+0000","last_undegraded":"2023-11-04T01:42:04.969628+0000","last_fullsized":"2023-11-04T01:42:04.969628+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.996668+0000","last_change":"2023-11-04T01:42:04.995419+0000","last_active":"2023-11-04T01:42:04.996668+0000","last_peered":"2023-11-04T01:42:04.996668+0000","last_clean":"2023-11-04T01:42:04.996668+0000","last_became_active":"2023-11-04T01:42:04.995091+0000","last_became_peered":"2023-11-04T01:42:04.995091+0000","last_unstale":"2023-11-04T01:42:04.996668+0000","last_undegraded":"2023-11-04T01:42:04.996668+0000","last_fullsized":"2023-11-04T01:42:04.996668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:41.938181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962392+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:03.962392+0000","last_peered":"2023-11-04T01:42:03.962392+0000","last_clean":"2023-11-04T01:42:03.962392+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:03.962392+0000","last_undegraded":"2023-11-04T01:42:03.962392+0000","last_fullsized":"2023-11-04T01:42:03.962392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979780+0000","last_change":"2023-11-04T01:42:04.979780+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979780+0000","last_undegraded":"2023-11-04T01:42:04.979780+0000","last_fullsized":"2023-11-04T01:42:04.979780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013286+0000","last_change":"2023-11-04T01:42:05.007381+0000","last_active":"2023-11-04T01:42:05.013286+0000","last_peered":"2023-11-04T01:42:05.013286+0000","last_clean":"2023-11-04T01:42:05.013286+0000","last_became_active":"2023-11-04T01:42:05.006783+0000","last_became_peered":"2023-11-04T01:42:05.006783+0000","last_unstale":"2023-11-04T01:42:05.013286+0000","last_undegraded":"2023-11-04T01:42:05.013286+0000","last_fullsized":"2023-11-04T01:42:05.013286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:29.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960774+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:03.960774+0000","last_peered":"2023-11-04T01:42:03.960774+0000","last_clean":"2023-11-04T01:42:03.960774+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:03.960774+0000","last_undegraded":"2023-11-04T01:42:03.960774+0000","last_fullsized":"2023-11-04T01:42:03.960774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959872+0000","last_change":"2023-11-04T01:42:04.959872+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959872+0000","last_undegraded":"2023-11-04T01:42:04.959872+0000","last_fullsized":"2023-11-04T01:42:04.959872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.976478+0000","last_change":"2023-11-04T01:42:04.974191+0000","last_active":"2023-11-04T01:42:04.976478+0000","last_peered":"2023-11-04T01:42:04.976478+0000","last_clean":"2023-11-04T01:42:04.976478+0000","last_became_active":"2023-11-04T01:42:04.973849+0000","last_became_peered":"2023-11-04T01:42:04.973849+0000","last_unstale":"2023-11-04T01:42:04.976478+0000","last_undegraded":"2023-11-04T01:42:04.976478+0000","last_fullsized":"2023-11-04T01:42:04.976478+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.692976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965551+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:03.965551+0000","last_peered":"2023-11-04T01:42:03.965551+0000","last_clean":"2023-11-04T01:42:03.965551+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:03.965551+0000","last_undegraded":"2023-11-04T01:42:03.965551+0000","last_fullsized":"2023-11-04T01:42:03.965551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967061+0000","last_change":"2023-11-04T01:42:04.967061+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967061+0000","last_undegraded":"2023-11-04T01:42:04.967061+0000","last_fullsized":"2023-11-04T01:42:04.967061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004108+0000","last_change":"2023-11-04T01:42:05.002890+0000","last_active":"2023-11-04T01:42:05.004108+0000","last_peered":"2023-11-04T01:42:05.004108+0000","last_clean":"2023-11-04T01:42:05.004108+0000","last_became_active":"2023-11-04T01:42:05.002136+0000","last_became_peered":"2023-11-04T01:42:05.002136+0000","last_unstale":"2023-11-04T01:42:05.004108+0000","last_undegraded":"2023-11-04T01:42:05.004108+0000","last_fullsized":"2023-11-04T01:42:05.004108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:53.284018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966872+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:03.966872+0000","last_peered":"2023-11-04T01:42:03.966872+0000","last_clean":"2023-11-04T01:42:03.966872+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:03.966872+0000","last_undegraded":"2023-11-04T01:42:03.966872+0000","last_fullsized":"2023-11-04T01:42:03.966872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.988515+0000","last_change":"2023-11-04T01:42:04.988515+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.988515+0000","last_undegraded":"2023-11-04T01:42:04.988515+0000","last_fullsized":"2023-11-04T01:42:04.988515+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980369+0000","last_change":"2023-11-04T01:42:04.977260+0000","last_active":"2023-11-04T01:42:04.980369+0000","last_peered":"2023-11-04T01:42:04.980369+0000","last_clean":"2023-11-04T01:42:04.980369+0000","last_became_active":"2023-11-04T01:42:04.976923+0000","last_became_peered":"2023-11-04T01:42:04.976923+0000","last_unstale":"2023-11-04T01:42:04.980369+0000","last_undegraded":"2023-11-04T01:42:04.980369+0000","last_fullsized":"2023-11-04T01:42:04.980369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:16.997158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960957+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:03.960957+0000","last_peered":"2023-11-04T01:42:03.960957+0000","last_clean":"2023-11-04T01:42:03.960957+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:03.960957+0000","last_undegraded":"2023-11-04T01:42:03.960957+0000","last_fullsized":"2023-11-04T01:42:03.960957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.978615+0000","last_change":"2023-11-04T01:42:04.978615+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.978615+0000","last_undegraded":"2023-11-04T01:42:04.978615+0000","last_fullsized":"2023-11-04T01:42:04.978615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.990277+0000","last_change":"2023-11-04T01:42:04.989338+0000","last_active":"2023-11-04T01:42:04.990277+0000","last_peered":"2023-11-04T01:42:04.990277+0000","last_clean":"2023-11-04T01:42:04.990277+0000","last_became_active":"2023-11-04T01:42:04.988983+0000","last_became_peered":"2023-11-04T01:42:04.988983+0000","last_unstale":"2023-11-04T01:42:04.990277+0000","last_undegraded":"2023-11-04T01:42:04.990277+0000","last_fullsized":"2023-11-04T01:42:04.990277+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:56.213941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949185+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:03.949185+0000","last_peered":"2023-11-04T01:42:03.949185+0000","last_clean":"2023-11-04T01:42:03.949185+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:03.949185+0000","last_undegraded":"2023-11-04T01:42:03.949185+0000","last_fullsized":"2023-11-04T01:42:03.949185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959932+0000","last_change":"2023-11-04T01:42:04.959932+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959932+0000","last_undegraded":"2023-11-04T01:42:04.959932+0000","last_fullsized":"2023-11-04T01:42:04.959932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012445+0000","last_change":"2023-11-04T01:42:05.006675+0000","last_active":"2023-11-04T01:42:05.012445+0000","last_peered":"2023-11-04T01:42:05.012445+0000","last_clean":"2023-11-04T01:42:05.012445+0000","last_became_active":"2023-11-04T01:42:05.006360+0000","last_became_peered":"2023-11-04T01:42:05.006360+0000","last_unstale":"2023-11-04T01:42:05.012445+0000","last_undegraded":"2023-11-04T01:42:05.012445+0000","last_fullsized":"2023-11-04T01:42:05.012445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:04.101815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960594+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:03.960594+0000","last_peered":"2023-11-04T01:42:03.960594+0000","last_clean":"2023-11-04T01:42:03.960594+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:03.960594+0000","last_undegraded":"2023-11-04T01:42:03.960594+0000","last_fullsized":"2023-11-04T01:42:03.960594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980514+0000","last_change":"2023-11-04T01:42:04.980514+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980514+0000","last_undegraded":"2023-11-04T01:42:04.980514+0000","last_fullsized":"2023-11-04T01:42:04.980514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997662+0000","last_change":"2023-11-04T01:42:04.996167+0000","last_active":"2023-11-04T01:42:04.997662+0000","last_peered":"2023-11-04T01:42:04.997662+0000","last_clean":"2023-11-04T01:42:04.997662+0000","last_became_active":"2023-11-04T01:42:04.995600+0000","last_became_peered":"2023-11-04T01:42:04.995600+0000","last_unstale":"2023-11-04T01:42:04.997662+0000","last_undegraded":"2023-11-04T01:42:04.997662+0000","last_fullsized":"2023-11-04T01:42:04.997662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:09:09.522884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949309+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:03.949309+0000","last_peered":"2023-11-04T01:42:03.949309+0000","last_clean":"2023-11-04T01:42:03.949309+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:03.949309+0000","last_undegraded":"2023-11-04T01:42:03.949309+0000","last_fullsized":"2023-11-04T01:42:03.949309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960654+0000","last_change":"2023-11-04T01:42:04.960654+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960654+0000","last_undegraded":"2023-11-04T01:42:04.960654+0000","last_fullsized":"2023-11-04T01:42:04.960654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012004+0000","last_change":"2023-11-04T01:42:05.007624+0000","last_active":"2023-11-04T01:42:05.012004+0000","last_peered":"2023-11-04T01:42:05.012004+0000","last_clean":"2023-11-04T01:42:05.012004+0000","last_became_active":"2023-11-04T01:42:05.006885+0000","last_became_peered":"2023-11-04T01:42:05.006885+0000","last_unstale":"2023-11-04T01:42:05.012004+0000","last_undegraded":"2023-11-04T01:42:05.012004+0000","last_fullsized":"2023-11-04T01:42:05.012004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:38.637066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.958955+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:03.958955+0000","last_peered":"2023-11-04T01:42:03.958955+0000","last_clean":"2023-11-04T01:42:03.958955+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:03.958955+0000","last_undegraded":"2023-11-04T01:42:03.958955+0000","last_fullsized":"2023-11-04T01:42:03.958955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968875+0000","last_change":"2023-11-04T01:42:04.968875+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968875+0000","last_undegraded":"2023-11-04T01:42:04.968875+0000","last_fullsized":"2023-11-04T01:42:04.968875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.977461+0000","last_change":"2023-11-04T01:42:04.975673+0000","last_active":"2023-11-04T01:42:04.977461+0000","last_peered":"2023-11-04T01:42:04.977461+0000","last_clean":"2023-11-04T01:42:04.977461+0000","last_became_active":"2023-11-04T01:42:04.975387+0000","last_became_peered":"2023-11-04T01:42:04.975387+0000","last_unstale":"2023-11-04T01:42:04.977461+0000","last_undegraded":"2023-11-04T01:42:04.977461+0000","last_fullsized":"2023-11-04T01:42:04.977461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:34.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962370+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:03.962370+0000","last_peered":"2023-11-04T01:42:03.962370+0000","last_clean":"2023-11-04T01:42:03.962370+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:03.962370+0000","last_undegraded":"2023-11-04T01:42:03.962370+0000","last_fullsized":"2023-11-04T01:42:03.962370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962814+0000","last_change":"2023-11-04T01:42:04.962814+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962814+0000","last_undegraded":"2023-11-04T01:42:04.962814+0000","last_fullsized":"2023-11-04T01:42:04.962814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975489+0000","last_change":"2023-11-04T01:42:04.972222+0000","last_active":"2023-11-04T01:42:04.975489+0000","last_peered":"2023-11-04T01:42:04.975489+0000","last_clean":"2023-11-04T01:42:04.975489+0000","last_became_active":"2023-11-04T01:42:04.971888+0000","last_became_peered":"2023-11-04T01:42:04.971888+0000","last_unstale":"2023-11-04T01:42:04.975489+0000","last_undegraded":"2023-11-04T01:42:04.975489+0000","last_fullsized":"2023-11-04T01:42:04.975489+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:39.375558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966888+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:03.966888+0000","last_peered":"2023-11-04T01:42:03.966888+0000","last_clean":"2023-11-04T01:42:03.966888+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:03.966888+0000","last_undegraded":"2023-11-04T01:42:03.966888+0000","last_fullsized":"2023-11-04T01:42:03.966888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976632+0000","last_change":"2023-11-04T01:42:04.976632+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976632+0000","last_undegraded":"2023-11-04T01:42:04.976632+0000","last_fullsized":"2023-11-04T01:42:04.976632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013275+0000","last_change":"2023-11-04T01:42:05.007348+0000","last_active":"2023-11-04T01:42:05.013275+0000","last_peered":"2023-11-04T01:42:05.013275+0000","last_clean":"2023-11-04T01:42:05.013275+0000","last_became_active":"2023-11-04T01:42:05.006661+0000","last_became_peered":"2023-11-04T01:42:05.006661+0000","last_unstale":"2023-11-04T01:42:05.013275+0000","last_undegraded":"2023-11-04T01:42:05.013275+0000","last_fullsized":"2023-11-04T01:42:05.013275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:01:12.774886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957638+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:03.957638+0000","last_peered":"2023-11-04T01:42:03.957638+0000","last_clean":"2023-11-04T01:42:03.957638+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:03.957638+0000","last_undegraded":"2023-11-04T01:42:03.957638+0000","last_fullsized":"2023-11-04T01:42:03.957638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964445+0000","last_change":"2023-11-04T01:42:04.964445+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964445+0000","last_undegraded":"2023-11-04T01:42:04.964445+0000","last_fullsized":"2023-11-04T01:42:04.964445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984367+0000","last_change":"2023-11-04T01:42:04.983369+0000","last_active":"2023-11-04T01:42:04.984367+0000","last_peered":"2023-11-04T01:42:04.984367+0000","last_clean":"2023-11-04T01:42:04.984367+0000","last_became_active":"2023-11-04T01:42:04.983083+0000","last_became_peered":"2023-11-04T01:42:04.983083+0000","last_unstale":"2023-11-04T01:42:04.984367+0000","last_undegraded":"2023-11-04T01:42:04.984367+0000","last_fullsized":"2023-11-04T01:42:04.984367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960886+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:03.960886+0000","last_peered":"2023-11-04T01:42:03.960886+0000","last_clean":"2023-11-04T01:42:03.960886+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:03.960886+0000","last_undegraded":"2023-11-04T01:42:03.960886+0000","last_fullsized":"2023-11-04T01:42:03.960886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965988+0000","last_change":"2023-11-04T01:42:04.965988+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965988+0000","last_undegraded":"2023-11-04T01:42:04.965988+0000","last_fullsized":"2023-11-04T01:42:04.965988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015151+0000","last_change":"2023-11-04T01:42:05.011704+0000","last_active":"2023-11-04T01:42:05.015151+0000","last_peered":"2023-11-04T01:42:05.015151+0000","last_clean":"2023-11-04T01:42:05.015151+0000","last_became_active":"2023-11-04T01:42:05.010990+0000","last_became_peered":"2023-11-04T01:42:05.010990+0000","last_unstale":"2023-11-04T01:42:05.015151+0000","last_undegraded":"2023-11-04T01:42:05.015151+0000","last_fullsized":"2023-11-04T01:42:05.015151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:38.042581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949162+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:03.949162+0000","last_peered":"2023-11-04T01:42:03.949162+0000","last_clean":"2023-11-04T01:42:03.949162+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:03.949162+0000","last_undegraded":"2023-11-04T01:42:03.949162+0000","last_fullsized":"2023-11-04T01:42:03.949162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960929+0000","last_change":"2023-11-04T01:42:04.960929+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960929+0000","last_undegraded":"2023-11-04T01:42:04.960929+0000","last_fullsized":"2023-11-04T01:42:04.960929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984339+0000","last_change":"2023-11-04T01:42:04.978969+0000","last_active":"2023-11-04T01:42:04.984339+0000","last_peered":"2023-11-04T01:42:04.984339+0000","last_clean":"2023-11-04T01:42:04.984339+0000","last_became_active":"2023-11-04T01:42:04.978240+0000","last_became_peered":"2023-11-04T01:42:04.978240+0000","last_unstale":"2023-11-04T01:42:04.984339+0000","last_undegraded":"2023-11-04T01:42:04.984339+0000","last_fullsized":"2023-11-04T01:42:04.984339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:20.145051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.964938+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:03.964938+0000","last_peered":"2023-11-04T01:42:03.964938+0000","last_clean":"2023-11-04T01:42:03.964938+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:03.964938+0000","last_undegraded":"2023-11-04T01:42:03.964938+0000","last_fullsized":"2023-11-04T01:42:03.964938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979351+0000","last_change":"2023-11-04T01:42:04.979351+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979351+0000","last_undegraded":"2023-11-04T01:42:04.979351+0000","last_fullsized":"2023-11-04T01:42:04.979351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013341+0000","last_change":"2023-11-04T01:42:05.007818+0000","last_active":"2023-11-04T01:42:05.013341+0000","last_peered":"2023-11-04T01:42:05.013341+0000","last_clean":"2023-11-04T01:42:05.013341+0000","last_became_active":"2023-11-04T01:42:05.006963+0000","last_became_peered":"2023-11-04T01:42:05.006963+0000","last_unstale":"2023-11-04T01:42:05.013341+0000","last_undegraded":"2023-11-04T01:42:05.013341+0000","last_fullsized":"2023-11-04T01:42:05.013341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:38.168718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959078+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:03.959078+0000","last_peered":"2023-11-04T01:42:03.959078+0000","last_clean":"2023-11-04T01:42:03.959078+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:03.959078+0000","last_undegraded":"2023-11-04T01:42:03.959078+0000","last_fullsized":"2023-11-04T01:42:03.959078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962838+0000","last_change":"2023-11-04T01:42:04.962838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962838+0000","last_undegraded":"2023-11-04T01:42:04.962838+0000","last_fullsized":"2023-11-04T01:42:04.962838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.005558+0000","last_change":"2023-11-04T01:42:05.001976+0000","last_active":"2023-11-04T01:42:05.005558+0000","last_peered":"2023-11-04T01:42:05.005558+0000","last_clean":"2023-11-04T01:42:05.005558+0000","last_became_active":"2023-11-04T01:42:05.001247+0000","last_became_peered":"2023-11-04T01:42:05.001247+0000","last_unstale":"2023-11-04T01:42:05.005558+0000","last_undegraded":"2023-11-04T01:42:05.005558+0000","last_fullsized":"2023-11-04T01:42:05.005558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:20.498259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960813+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:03.960813+0000","last_peered":"2023-11-04T01:42:03.960813+0000","last_clean":"2023-11-04T01:42:03.960813+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:03.960813+0000","last_undegraded":"2023-11-04T01:42:03.960813+0000","last_fullsized":"2023-11-04T01:42:03.960813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964373+0000","last_change":"2023-11-04T01:42:04.964373+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964373+0000","last_undegraded":"2023-11-04T01:42:04.964373+0000","last_fullsized":"2023-11-04T01:42:04.964373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015020+0000","last_change":"2023-11-04T01:42:05.010393+0000","last_active":"2023-11-04T01:42:05.015020+0000","last_peered":"2023-11-04T01:42:05.015020+0000","last_clean":"2023-11-04T01:42:05.015020+0000","last_became_active":"2023-11-04T01:42:05.009748+0000","last_became_peered":"2023-11-04T01:42:05.009748+0000","last_unstale":"2023-11-04T01:42:05.015020+0000","last_undegraded":"2023-11-04T01:42:05.015020+0000","last_fullsized":"2023-11-04T01:42:05.015020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:52.103809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966597+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:03.966597+0000","last_peered":"2023-11-04T01:42:03.966597+0000","last_clean":"2023-11-04T01:42:03.966597+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:03.966597+0000","last_undegraded":"2023-11-04T01:42:03.966597+0000","last_fullsized":"2023-11-04T01:42:03.966597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965842+0000","last_change":"2023-11-04T01:42:04.965842+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965842+0000","last_undegraded":"2023-11-04T01:42:04.965842+0000","last_fullsized":"2023-11-04T01:42:04.965842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004590+0000","last_change":"2023-11-04T01:42:05.000198+0000","last_active":"2023-11-04T01:42:05.004590+0000","last_peered":"2023-11-04T01:42:05.004590+0000","last_clean":"2023-11-04T01:42:05.004590+0000","last_became_active":"2023-11-04T01:42:04.999551+0000","last_became_peered":"2023-11-04T01:42:04.999551+0000","last_unstale":"2023-11-04T01:42:05.004590+0000","last_undegraded":"2023-11-04T01:42:05.004590+0000","last_fullsized":"2023-11-04T01:42:05.004590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:34.807369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956841+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:03.956841+0000","last_peered":"2023-11-04T01:42:03.956841+0000","last_clean":"2023-11-04T01:42:03.956841+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:03.956841+0000","last_undegraded":"2023-11-04T01:42:03.956841+0000","last_fullsized":"2023-11-04T01:42:03.956841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1302528,"data_stored":896392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":29.603000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.462},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":8.1280000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":2.6389999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":25.791}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":3.98},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":25.696999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":11.064},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":4.1630000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.581},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":4.0730000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.92000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":1.048},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.748}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.006}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.133},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.139},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.2}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.089},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.4910000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.155},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.089}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.753},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":1.0329999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.103}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":1.21}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":1.163}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.28},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":1.0860000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.329},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.747}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.622}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":903012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.80400000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":0.82699999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:09.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:09.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 Processor -- start 2023-11-04T01:42:09.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 -- start start 2023-11-04T01:42:09.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d300ce070 0x7f1d3006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d30159e30 con 0x7f1d30159a50 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d30070b80 con 0x7f1d300ce070 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d358e5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300ccfd0 con 0x7f1d300ce720 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d300ce070 0x7f1d3006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d300ce070 0x7f1d3006bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57264/0 (socket says 172.21.15.40:57264) 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/3770323960 learned_addr learned my addr 172.21.15.40:0/3770323960 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2e7fc640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/3770323960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 msgr2=0x7f1d3006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/3770323960 >> v1:172.21.15.91:6789/0 conn(0x7f1d30159a50 legacy=0x7f1d300cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/3770323960 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300cd2b0 con 0x7f1d300ce070 2023-11-04T01:42:09.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2e7fc640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:09.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.586+0000 7f1d2f7fe640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300ce070 0x7f1d3006bfd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009e80 tx=0x7f1d2801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311260d716deb8c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2dffb640 1 -- 172.21.15.40:0/3770323960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280af400 con 0x7f1d300ce070 2023-11-04T01:42:09.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2dffb640 1 -- 172.21.15.40:0/3770323960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d280ab050 con 0x7f1d300ce070 2023-11-04T01:42:09.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2dffb640 1 -- 172.21.15.40:0/3770323960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280af780 con 0x7f1d300ce070 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/3770323960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300ce070 msgr2=0x7f1d3006bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300ce070 0x7f1d3006bfd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009e80 tx=0x7f1d2801f1e0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/3770323960 shutdown_connections 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300ce070 0x7f1d3006bfd0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 --2- 172.21.15.40:0/3770323960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/3770323960 >> 172.21.15.40:0/3770323960 conn(0x7f1d300cebb0 msgr2=0x7f1d300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/3770323960 shutdown_connections 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/3770323960 wait complete. 2023-11-04T01:42:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 Processor -- start 2023-11-04T01:42:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- start start 2023-11-04T01:42:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d300ce070 0x7f1d301efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 0x7f1d3015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301f6e80 con 0x7f1d30159a50 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300c5d20 con 0x7f1d300ce070 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300c6000 con 0x7f1d300ce720 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 0x7f1d3015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 0x7f1d3015c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57272/0 (socket says 172.21.15.40:57272) 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/1091329078 learned_addr learned my addr 172.21.15.40:0/1091329078 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2effd640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d300ce070 0x7f1d301efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2e7fc640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 msgr2=0x7f1d3015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d300ce070 msgr2=0x7f1d301efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d300ce070 0x7f1d301efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 -- 172.21.15.40:0/1091329078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009b30 con 0x7f1d30159a50 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d2f7fe640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 0x7f1d3015c5b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b2040 tx=0x7f1d2801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280afd60 con 0x7f1d30159a50 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28009510 con 0x7f1d30159a50 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d300c62e0 con 0x7f1d30159a50 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280ba660 con 0x7f1d30159a50 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.590+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301f0290 con 0x7f1d30159a50 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.594+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d280b6040 con 0x7f1d30159a50 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.594+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300744a0 con 0x7f1d30159a50 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.594+0000 7f1d27fff640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1d100664a0 0x7f1d10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.594+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d28122720 con 0x7f1d30159a50 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.594+0000 7f1d2effd640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1d100664a0 0x7f1d10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.594+0000 7f1d2effd640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1d100664a0 0x7f1d10068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1d30157000 tx=0x7f1d20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.598+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1d280efa30 con 0x7f1d30159a50 2023-11-04T01:42:09.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.746+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d300cd870 con 0x7f1d100664a0 2023-11-04T01:42:09.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d27fff640 1 -- 172.21.15.40:0/1091329078 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363467 (secure 0 0 0) 0x7f1d200050d0 con 0x7f1d100664a0 2023-11-04T01:42:09.780 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1d100664a0 msgr2=0x7f1d10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1d100664a0 0x7f1d10068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1d30157000 tx=0x7f1d20009040 comp rx=0 tx=0).stop 2023-11-04T01:42:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 msgr2=0x7f1d3015c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 0x7f1d3015c5b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b2040 tx=0x7f1d2801bf80 comp rx=0 tx=0).stop 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 shutdown_connections 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1d100664a0 0x7f1d10068960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d30159a50 0x7f1d3015c5b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1d300ce720 0x7f1d3015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 --2- 172.21.15.40:0/1091329078 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1d300ce070 0x7f1d301efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 >> 172.21.15.40:0/1091329078 conn(0x7f1d300cebb0 msgr2=0x7f1d300cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 shutdown_connections 2023-11-04T01:42:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.774+0000 7f1d358e5640 1 -- 172.21.15.40:0/1091329078 wait complete. 2023-11-04T01:42:09.797 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-11-04T01:42:07.795295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231228,"kb_used_data":6732,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743492,"statfs":{"total":773094113280,"available":772857335808,"internally_reserved":0,"allocated":6893568,"data_stored":3648788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001617"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964311+0000","last_change":"2023-11-04T01:42:04.964311+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964311+0000","last_undegraded":"2023-11-04T01:42:04.964311+0000","last_fullsized":"2023-11-04T01:42:04.964311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963394+0000","last_change":"2023-11-04T01:42:04.963394+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963394+0000","last_undegraded":"2023-11-04T01:42:04.963394+0000","last_fullsized":"2023-11-04T01:42:04.963394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970604+0000","last_change":"2023-11-04T01:42:04.970604+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970604+0000","last_undegraded":"2023-11-04T01:42:04.970604+0000","last_fullsized":"2023-11-04T01:42:04.970604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963630+0000","last_change":"2023-11-04T01:42:04.963630+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963630+0000","last_undegraded":"2023-11-04T01:42:04.963630+0000","last_fullsized":"2023-11-04T01:42:04.963630+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980355+0000","last_change":"2023-11-04T01:42:04.980355+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980355+0000","last_undegraded":"2023-11-04T01:42:04.980355+0000","last_fullsized":"2023-11-04T01:42:04.980355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964101+0000","last_change":"2023-11-04T01:42:04.964101+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964101+0000","last_undegraded":"2023-11-04T01:42:04.964101+0000","last_fullsized":"2023-11-04T01:42:04.964101+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967421+0000","last_change":"2023-11-04T01:42:04.967421+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967421+0000","last_undegraded":"2023-11-04T01:42:04.967421+0000","last_fullsized":"2023-11-04T01:42:04.967421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970577+0000","last_change":"2023-11-04T01:42:04.970577+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970577+0000","last_undegraded":"2023-11-04T01:42:04.970577+0000","last_fullsized":"2023-11-04T01:42:04.970577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972671+0000","last_change":"2023-11-04T01:42:04.972671+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972671+0000","last_undegraded":"2023-11-04T01:42:04.972671+0000","last_fullsized":"2023-11-04T01:42:04.972671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968979+0000","last_change":"2023-11-04T01:42:04.968979+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968979+0000","last_undegraded":"2023-11-04T01:42:04.968979+0000","last_fullsized":"2023-11-04T01:42:04.968979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967722+0000","last_change":"2023-11-04T01:42:04.967722+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967722+0000","last_undegraded":"2023-11-04T01:42:04.967722+0000","last_fullsized":"2023-11-04T01:42:04.967722+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969387+0000","last_change":"2023-11-04T01:42:04.969387+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969387+0000","last_undegraded":"2023-11-04T01:42:04.969387+0000","last_fullsized":"2023-11-04T01:42:04.969387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961992+0000","last_change":"2023-11-04T01:42:04.961992+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961992+0000","last_undegraded":"2023-11-04T01:42:04.961992+0000","last_fullsized":"2023-11-04T01:42:04.961992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.971346+0000","last_change":"2023-11-04T01:42:04.971346+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.971346+0000","last_undegraded":"2023-11-04T01:42:04.971346+0000","last_fullsized":"2023-11-04T01:42:04.971346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968406+0000","last_change":"2023-11-04T01:42:04.968406+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968406+0000","last_undegraded":"2023-11-04T01:42:04.968406+0000","last_fullsized":"2023-11-04T01:42:04.968406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969330+0000","last_change":"2023-11-04T01:42:04.969330+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969330+0000","last_undegraded":"2023-11-04T01:42:04.969330+0000","last_fullsized":"2023-11-04T01:42:04.969330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963815+0000","last_change":"2023-11-04T01:42:04.963815+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963815+0000","last_undegraded":"2023-11-04T01:42:04.963815+0000","last_fullsized":"2023-11-04T01:42:04.963815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961915+0000","last_change":"2023-11-04T01:42:04.961915+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961915+0000","last_undegraded":"2023-11-04T01:42:04.961915+0000","last_fullsized":"2023-11-04T01:42:04.961915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977955+0000","last_change":"2023-11-04T01:42:04.977955+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977955+0000","last_undegraded":"2023-11-04T01:42:04.977955+0000","last_fullsized":"2023-11-04T01:42:04.977955+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960714+0000","last_change":"2023-11-04T01:42:04.960714+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960714+0000","last_undegraded":"2023-11-04T01:42:04.960714+0000","last_fullsized":"2023-11-04T01:42:04.960714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960644+0000","last_change":"2023-11-04T01:42:04.960644+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960644+0000","last_undegraded":"2023-11-04T01:42:04.960644+0000","last_fullsized":"2023-11-04T01:42:04.960644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961806+0000","last_change":"2023-11-04T01:42:04.961806+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961806+0000","last_undegraded":"2023-11-04T01:42:04.961806+0000","last_fullsized":"2023-11-04T01:42:04.961806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960731+0000","last_change":"2023-11-04T01:42:04.960731+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960731+0000","last_undegraded":"2023-11-04T01:42:04.960731+0000","last_fullsized":"2023-11-04T01:42:04.960731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968164+0000","last_change":"2023-11-04T01:42:04.968164+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968164+0000","last_undegraded":"2023-11-04T01:42:04.968164+0000","last_fullsized":"2023-11-04T01:42:04.968164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965282+0000","last_change":"2023-11-04T01:42:04.965282+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965282+0000","last_undegraded":"2023-11-04T01:42:04.965282+0000","last_fullsized":"2023-11-04T01:42:04.965282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968209+0000","last_change":"2023-11-04T01:42:04.968209+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968209+0000","last_undegraded":"2023-11-04T01:42:04.968209+0000","last_fullsized":"2023-11-04T01:42:04.968209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966582+0000","last_change":"2023-11-04T01:42:04.966582+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966582+0000","last_undegraded":"2023-11-04T01:42:04.966582+0000","last_fullsized":"2023-11-04T01:42:04.966582+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966509+0000","last_change":"2023-11-04T01:42:04.966509+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966509+0000","last_undegraded":"2023-11-04T01:42:04.966509+0000","last_fullsized":"2023-11-04T01:42:04.966509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972381+0000","last_change":"2023-11-04T01:42:04.972381+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972381+0000","last_undegraded":"2023-11-04T01:42:04.972381+0000","last_fullsized":"2023-11-04T01:42:04.972381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963276+0000","last_change":"2023-11-04T01:42:04.963276+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963276+0000","last_undegraded":"2023-11-04T01:42:04.963276+0000","last_fullsized":"2023-11-04T01:42:04.963276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961302+0000","last_change":"2023-11-04T01:42:04.961302+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961302+0000","last_undegraded":"2023-11-04T01:42:04.961302+0000","last_fullsized":"2023-11-04T01:42:04.961302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964401+0000","last_change":"2023-11-04T01:42:04.964401+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964401+0000","last_undegraded":"2023-11-04T01:42:04.964401+0000","last_fullsized":"2023-11-04T01:42:04.964401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979252+0000","last_change":"2023-11-04T01:42:04.979252+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979252+0000","last_undegraded":"2023-11-04T01:42:04.979252+0000","last_fullsized":"2023-11-04T01:42:04.979252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975784+0000","last_change":"2023-11-04T01:42:04.971841+0000","last_active":"2023-11-04T01:42:04.975784+0000","last_peered":"2023-11-04T01:42:04.975784+0000","last_clean":"2023-11-04T01:42:04.975784+0000","last_became_active":"2023-11-04T01:42:04.971405+0000","last_became_peered":"2023-11-04T01:42:04.971405+0000","last_unstale":"2023-11-04T01:42:04.975784+0000","last_undegraded":"2023-11-04T01:42:04.975784+0000","last_fullsized":"2023-11-04T01:42:04.975784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:17.604230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966449+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:03.966449+0000","last_peered":"2023-11-04T01:42:03.966449+0000","last_clean":"2023-11-04T01:42:03.966449+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:03.966449+0000","last_undegraded":"2023-11-04T01:42:03.966449+0000","last_fullsized":"2023-11-04T01:42:03.966449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966189+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:03.966189+0000","last_peered":"2023-11-04T01:42:03.966189+0000","last_clean":"2023-11-04T01:42:03.966189+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:03.966189+0000","last_undegraded":"2023-11-04T01:42:03.966189+0000","last_fullsized":"2023-11-04T01:42:03.966189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960838+0000","last_change":"2023-11-04T01:42:04.960838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960838+0000","last_undegraded":"2023-11-04T01:42:04.960838+0000","last_fullsized":"2023-11-04T01:42:04.960838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015040+0000","last_change":"2023-11-04T01:42:05.010568+0000","last_active":"2023-11-04T01:42:05.015040+0000","last_peered":"2023-11-04T01:42:05.015040+0000","last_clean":"2023-11-04T01:42:05.015040+0000","last_became_active":"2023-11-04T01:42:05.009935+0000","last_became_peered":"2023-11-04T01:42:05.009935+0000","last_unstale":"2023-11-04T01:42:05.015040+0000","last_undegraded":"2023-11-04T01:42:05.015040+0000","last_fullsized":"2023-11-04T01:42:05.015040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:58.106427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957847+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:03.957847+0000","last_peered":"2023-11-04T01:42:03.957847+0000","last_clean":"2023-11-04T01:42:03.957847+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:03.957847+0000","last_undegraded":"2023-11-04T01:42:03.957847+0000","last_fullsized":"2023-11-04T01:42:03.957847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.982231+0000","last_change":"2023-11-04T01:42:04.982231+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.982231+0000","last_undegraded":"2023-11-04T01:42:04.982231+0000","last_fullsized":"2023-11-04T01:42:04.982231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980251+0000","last_change":"2023-11-04T01:42:04.978763+0000","last_active":"2023-11-04T01:42:04.980251+0000","last_peered":"2023-11-04T01:42:04.980251+0000","last_clean":"2023-11-04T01:42:04.980251+0000","last_became_active":"2023-11-04T01:42:04.978517+0000","last_became_peered":"2023-11-04T01:42:04.978517+0000","last_unstale":"2023-11-04T01:42:04.980251+0000","last_undegraded":"2023-11-04T01:42:04.980251+0000","last_fullsized":"2023-11-04T01:42:04.980251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:24:48.216767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967737+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:03.967737+0000","last_peered":"2023-11-04T01:42:03.967737+0000","last_clean":"2023-11-04T01:42:03.967737+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:03.967737+0000","last_undegraded":"2023-11-04T01:42:03.967737+0000","last_fullsized":"2023-11-04T01:42:03.967737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970601+0000","last_change":"2023-11-04T01:42:04.970601+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970601+0000","last_undegraded":"2023-11-04T01:42:04.970601+0000","last_fullsized":"2023-11-04T01:42:04.970601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.010311+0000","last_change":"2023-11-04T01:42:05.003124+0000","last_active":"2023-11-04T01:42:05.010311+0000","last_peered":"2023-11-04T01:42:05.010311+0000","last_clean":"2023-11-04T01:42:05.010311+0000","last_became_active":"2023-11-04T01:42:05.002439+0000","last_became_peered":"2023-11-04T01:42:05.002439+0000","last_unstale":"2023-11-04T01:42:05.010311+0000","last_undegraded":"2023-11-04T01:42:05.010311+0000","last_fullsized":"2023-11-04T01:42:05.010311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:38.112432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949271+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:03.949271+0000","last_peered":"2023-11-04T01:42:03.949271+0000","last_clean":"2023-11-04T01:42:03.949271+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:03.949271+0000","last_undegraded":"2023-11-04T01:42:03.949271+0000","last_fullsized":"2023-11-04T01:42:03.949271+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976588+0000","last_change":"2023-11-04T01:42:04.976588+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976588+0000","last_undegraded":"2023-11-04T01:42:04.976588+0000","last_fullsized":"2023-11-04T01:42:04.976588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013327+0000","last_change":"2023-11-04T01:42:05.007493+0000","last_active":"2023-11-04T01:42:05.013327+0000","last_peered":"2023-11-04T01:42:05.013327+0000","last_clean":"2023-11-04T01:42:05.013327+0000","last_became_active":"2023-11-04T01:42:05.006869+0000","last_became_peered":"2023-11-04T01:42:05.006869+0000","last_unstale":"2023-11-04T01:42:05.013327+0000","last_undegraded":"2023-11-04T01:42:05.013327+0000","last_fullsized":"2023-11-04T01:42:05.013327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:08.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956698+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:03.956698+0000","last_peered":"2023-11-04T01:42:03.956698+0000","last_clean":"2023-11-04T01:42:03.956698+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:03.956698+0000","last_undegraded":"2023-11-04T01:42:03.956698+0000","last_fullsized":"2023-11-04T01:42:03.956698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976659+0000","last_change":"2023-11-04T01:42:04.976659+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976659+0000","last_undegraded":"2023-11-04T01:42:04.976659+0000","last_fullsized":"2023-11-04T01:42:04.976659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012469+0000","last_change":"2023-11-04T01:42:05.006827+0000","last_active":"2023-11-04T01:42:05.012469+0000","last_peered":"2023-11-04T01:42:05.012469+0000","last_clean":"2023-11-04T01:42:05.012469+0000","last_became_active":"2023-11-04T01:42:05.006480+0000","last_became_peered":"2023-11-04T01:42:05.006480+0000","last_unstale":"2023-11-04T01:42:05.012469+0000","last_undegraded":"2023-11-04T01:42:05.012469+0000","last_fullsized":"2023-11-04T01:42:05.012469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:42.750611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960719+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:03.960719+0000","last_peered":"2023-11-04T01:42:03.960719+0000","last_clean":"2023-11-04T01:42:03.960719+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:03.960719+0000","last_undegraded":"2023-11-04T01:42:03.960719+0000","last_fullsized":"2023-11-04T01:42:03.960719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963624+0000","last_change":"2023-11-04T01:42:04.963624+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963624+0000","last_undegraded":"2023-11-04T01:42:04.963624+0000","last_fullsized":"2023-11-04T01:42:04.963624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997165+0000","last_change":"2023-11-04T01:42:04.994894+0000","last_active":"2023-11-04T01:42:04.997165+0000","last_peered":"2023-11-04T01:42:04.997165+0000","last_clean":"2023-11-04T01:42:04.997165+0000","last_became_active":"2023-11-04T01:42:04.994554+0000","last_became_peered":"2023-11-04T01:42:04.994554+0000","last_unstale":"2023-11-04T01:42:04.997165+0000","last_undegraded":"2023-11-04T01:42:04.997165+0000","last_fullsized":"2023-11-04T01:42:04.997165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956751+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:03.956751+0000","last_peered":"2023-11-04T01:42:03.956751+0000","last_clean":"2023-11-04T01:42:03.956751+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:03.956751+0000","last_undegraded":"2023-11-04T01:42:03.956751+0000","last_fullsized":"2023-11-04T01:42:03.956751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960699+0000","last_change":"2023-11-04T01:42:04.960699+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960699+0000","last_undegraded":"2023-11-04T01:42:04.960699+0000","last_fullsized":"2023-11-04T01:42:04.960699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004643+0000","last_change":"2023-11-04T01:42:05.000316+0000","last_active":"2023-11-04T01:42:05.004643+0000","last_peered":"2023-11-04T01:42:05.004643+0000","last_clean":"2023-11-04T01:42:05.004643+0000","last_became_active":"2023-11-04T01:42:04.999528+0000","last_became_peered":"2023-11-04T01:42:04.999528+0000","last_unstale":"2023-11-04T01:42:05.004643+0000","last_undegraded":"2023-11-04T01:42:05.004643+0000","last_fullsized":"2023-11-04T01:42:05.004643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967084+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:03.967084+0000","last_peered":"2023-11-04T01:42:03.967084+0000","last_clean":"2023-11-04T01:42:03.967084+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:03.967084+0000","last_undegraded":"2023-11-04T01:42:03.967084+0000","last_fullsized":"2023-11-04T01:42:03.967084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967082+0000","last_change":"2023-11-04T01:42:04.967082+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967082+0000","last_undegraded":"2023-11-04T01:42:04.967082+0000","last_fullsized":"2023-11-04T01:42:04.967082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004122+0000","last_change":"2023-11-04T01:42:05.002909+0000","last_active":"2023-11-04T01:42:05.004122+0000","last_peered":"2023-11-04T01:42:05.004122+0000","last_clean":"2023-11-04T01:42:05.004122+0000","last_became_active":"2023-11-04T01:42:05.002124+0000","last_became_peered":"2023-11-04T01:42:05.002124+0000","last_unstale":"2023-11-04T01:42:05.004122+0000","last_undegraded":"2023-11-04T01:42:05.004122+0000","last_fullsized":"2023-11-04T01:42:05.004122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:52.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965927+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:03.965927+0000","last_peered":"2023-11-04T01:42:03.965927+0000","last_clean":"2023-11-04T01:42:03.965927+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:03.965927+0000","last_undegraded":"2023-11-04T01:42:03.965927+0000","last_fullsized":"2023-11-04T01:42:03.965927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977926+0000","last_change":"2023-11-04T01:42:04.977926+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977926+0000","last_undegraded":"2023-11-04T01:42:04.977926+0000","last_fullsized":"2023-11-04T01:42:04.977926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.982259+0000","last_change":"2023-11-04T01:42:04.980535+0000","last_active":"2023-11-04T01:42:04.982259+0000","last_peered":"2023-11-04T01:42:04.982259+0000","last_clean":"2023-11-04T01:42:04.982259+0000","last_became_active":"2023-11-04T01:42:04.980311+0000","last_became_peered":"2023-11-04T01:42:04.980311+0000","last_unstale":"2023-11-04T01:42:04.982259+0000","last_undegraded":"2023-11-04T01:42:04.982259+0000","last_fullsized":"2023-11-04T01:42:04.982259+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.961031+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:03.961031+0000","last_peered":"2023-11-04T01:42:03.961031+0000","last_clean":"2023-11-04T01:42:03.961031+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:03.961031+0000","last_undegraded":"2023-11-04T01:42:03.961031+0000","last_fullsized":"2023-11-04T01:42:03.961031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965667+0000","last_change":"2023-11-04T01:42:04.965667+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965667+0000","last_undegraded":"2023-11-04T01:42:04.965667+0000","last_fullsized":"2023-11-04T01:42:04.965667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012538+0000","last_change":"2023-11-04T01:42:05.010609+0000","last_active":"2023-11-04T01:42:05.012538+0000","last_peered":"2023-11-04T01:42:05.012538+0000","last_clean":"2023-11-04T01:42:05.012538+0000","last_became_active":"2023-11-04T01:42:05.009776+0000","last_became_peered":"2023-11-04T01:42:05.009776+0000","last_unstale":"2023-11-04T01:42:05.012538+0000","last_undegraded":"2023-11-04T01:42:05.012538+0000","last_fullsized":"2023-11-04T01:42:05.012538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:29.902914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965033+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:03.965033+0000","last_peered":"2023-11-04T01:42:03.965033+0000","last_clean":"2023-11-04T01:42:03.965033+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:03.965033+0000","last_undegraded":"2023-11-04T01:42:03.965033+0000","last_fullsized":"2023-11-04T01:42:03.965033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970106+0000","last_change":"2023-11-04T01:42:04.970106+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970106+0000","last_undegraded":"2023-11-04T01:42:04.970106+0000","last_fullsized":"2023-11-04T01:42:04.970106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.009032+0000","last_change":"2023-11-04T01:42:04.999767+0000","last_active":"2023-11-04T01:42:05.009032+0000","last_peered":"2023-11-04T01:42:05.009032+0000","last_clean":"2023-11-04T01:42:05.009032+0000","last_became_active":"2023-11-04T01:42:04.998886+0000","last_became_peered":"2023-11-04T01:42:04.998886+0000","last_unstale":"2023-11-04T01:42:05.009032+0000","last_undegraded":"2023-11-04T01:42:05.009032+0000","last_fullsized":"2023-11-04T01:42:05.009032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949319+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:03.949319+0000","last_peered":"2023-11-04T01:42:03.949319+0000","last_clean":"2023-11-04T01:42:03.949319+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:03.949319+0000","last_undegraded":"2023-11-04T01:42:03.949319+0000","last_fullsized":"2023-11-04T01:42:03.949319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965420+0000","last_change":"2023-11-04T01:42:04.965420+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965420+0000","last_undegraded":"2023-11-04T01:42:04.965420+0000","last_fullsized":"2023-11-04T01:42:04.965420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997637+0000","last_change":"2023-11-04T01:42:04.995797+0000","last_active":"2023-11-04T01:42:04.997637+0000","last_peered":"2023-11-04T01:42:04.997637+0000","last_clean":"2023-11-04T01:42:04.997637+0000","last_became_active":"2023-11-04T01:42:04.995421+0000","last_became_peered":"2023-11-04T01:42:04.995421+0000","last_unstale":"2023-11-04T01:42:04.997637+0000","last_undegraded":"2023-11-04T01:42:04.997637+0000","last_fullsized":"2023-11-04T01:42:04.997637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:58.765673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959054+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:03.959054+0000","last_peered":"2023-11-04T01:42:03.959054+0000","last_clean":"2023-11-04T01:42:03.959054+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:03.959054+0000","last_undegraded":"2023-11-04T01:42:03.959054+0000","last_fullsized":"2023-11-04T01:42:03.959054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969628+0000","last_change":"2023-11-04T01:42:04.969628+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969628+0000","last_undegraded":"2023-11-04T01:42:04.969628+0000","last_fullsized":"2023-11-04T01:42:04.969628+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.996668+0000","last_change":"2023-11-04T01:42:04.995419+0000","last_active":"2023-11-04T01:42:04.996668+0000","last_peered":"2023-11-04T01:42:04.996668+0000","last_clean":"2023-11-04T01:42:04.996668+0000","last_became_active":"2023-11-04T01:42:04.995091+0000","last_became_peered":"2023-11-04T01:42:04.995091+0000","last_unstale":"2023-11-04T01:42:04.996668+0000","last_undegraded":"2023-11-04T01:42:04.996668+0000","last_fullsized":"2023-11-04T01:42:04.996668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:41.938181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962392+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:03.962392+0000","last_peered":"2023-11-04T01:42:03.962392+0000","last_clean":"2023-11-04T01:42:03.962392+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:03.962392+0000","last_undegraded":"2023-11-04T01:42:03.962392+0000","last_fullsized":"2023-11-04T01:42:03.962392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979780+0000","last_change":"2023-11-04T01:42:04.979780+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979780+0000","last_undegraded":"2023-11-04T01:42:04.979780+0000","last_fullsized":"2023-11-04T01:42:04.979780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013286+0000","last_change":"2023-11-04T01:42:05.007381+0000","last_active":"2023-11-04T01:42:05.013286+0000","last_peered":"2023-11-04T01:42:05.013286+0000","last_clean":"2023-11-04T01:42:05.013286+0000","last_became_active":"2023-11-04T01:42:05.006783+0000","last_became_peered":"2023-11-04T01:42:05.006783+0000","last_unstale":"2023-11-04T01:42:05.013286+0000","last_undegraded":"2023-11-04T01:42:05.013286+0000","last_fullsized":"2023-11-04T01:42:05.013286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:29.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960774+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:03.960774+0000","last_peered":"2023-11-04T01:42:03.960774+0000","last_clean":"2023-11-04T01:42:03.960774+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:03.960774+0000","last_undegraded":"2023-11-04T01:42:03.960774+0000","last_fullsized":"2023-11-04T01:42:03.960774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959872+0000","last_change":"2023-11-04T01:42:04.959872+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959872+0000","last_undegraded":"2023-11-04T01:42:04.959872+0000","last_fullsized":"2023-11-04T01:42:04.959872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.976478+0000","last_change":"2023-11-04T01:42:04.974191+0000","last_active":"2023-11-04T01:42:04.976478+0000","last_peered":"2023-11-04T01:42:04.976478+0000","last_clean":"2023-11-04T01:42:04.976478+0000","last_became_active":"2023-11-04T01:42:04.973849+0000","last_became_peered":"2023-11-04T01:42:04.973849+0000","last_unstale":"2023-11-04T01:42:04.976478+0000","last_undegraded":"2023-11-04T01:42:04.976478+0000","last_fullsized":"2023-11-04T01:42:04.976478+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.692976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965551+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:03.965551+0000","last_peered":"2023-11-04T01:42:03.965551+0000","last_clean":"2023-11-04T01:42:03.965551+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:03.965551+0000","last_undegraded":"2023-11-04T01:42:03.965551+0000","last_fullsized":"2023-11-04T01:42:03.965551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967061+0000","last_change":"2023-11-04T01:42:04.967061+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967061+0000","last_undegraded":"2023-11-04T01:42:04.967061+0000","last_fullsized":"2023-11-04T01:42:04.967061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004108+0000","last_change":"2023-11-04T01:42:05.002890+0000","last_active":"2023-11-04T01:42:05.004108+0000","last_peered":"2023-11-04T01:42:05.004108+0000","last_clean":"2023-11-04T01:42:05.004108+0000","last_became_active":"2023-11-04T01:42:05.002136+0000","last_became_peered":"2023-11-04T01:42:05.002136+0000","last_unstale":"2023-11-04T01:42:05.004108+0000","last_undegraded":"2023-11-04T01:42:05.004108+0000","last_fullsized":"2023-11-04T01:42:05.004108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:53.284018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966872+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:03.966872+0000","last_peered":"2023-11-04T01:42:03.966872+0000","last_clean":"2023-11-04T01:42:03.966872+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:03.966872+0000","last_undegraded":"2023-11-04T01:42:03.966872+0000","last_fullsized":"2023-11-04T01:42:03.966872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.988515+0000","last_change":"2023-11-04T01:42:04.988515+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.988515+0000","last_undegraded":"2023-11-04T01:42:04.988515+0000","last_fullsized":"2023-11-04T01:42:04.988515+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980369+0000","last_change":"2023-11-04T01:42:04.977260+0000","last_active":"2023-11-04T01:42:04.980369+0000","last_peered":"2023-11-04T01:42:04.980369+0000","last_clean":"2023-11-04T01:42:04.980369+0000","last_became_active":"2023-11-04T01:42:04.976923+0000","last_became_peered":"2023-11-04T01:42:04.976923+0000","last_unstale":"2023-11-04T01:42:04.980369+0000","last_undegraded":"2023-11-04T01:42:04.980369+0000","last_fullsized":"2023-11-04T01:42:04.980369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:16.997158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960957+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:03.960957+0000","last_peered":"2023-11-04T01:42:03.960957+0000","last_clean":"2023-11-04T01:42:03.960957+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:03.960957+0000","last_undegraded":"2023-11-04T01:42:03.960957+0000","last_fullsized":"2023-11-04T01:42:03.960957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.978615+0000","last_change":"2023-11-04T01:42:04.978615+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.978615+0000","last_undegraded":"2023-11-04T01:42:04.978615+0000","last_fullsized":"2023-11-04T01:42:04.978615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.990277+0000","last_change":"2023-11-04T01:42:04.989338+0000","last_active":"2023-11-04T01:42:04.990277+0000","last_peered":"2023-11-04T01:42:04.990277+0000","last_clean":"2023-11-04T01:42:04.990277+0000","last_became_active":"2023-11-04T01:42:04.988983+0000","last_became_peered":"2023-11-04T01:42:04.988983+0000","last_unstale":"2023-11-04T01:42:04.990277+0000","last_undegraded":"2023-11-04T01:42:04.990277+0000","last_fullsized":"2023-11-04T01:42:04.990277+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:56.213941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949185+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:03.949185+0000","last_peered":"2023-11-04T01:42:03.949185+0000","last_clean":"2023-11-04T01:42:03.949185+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:03.949185+0000","last_undegraded":"2023-11-04T01:42:03.949185+0000","last_fullsized":"2023-11-04T01:42:03.949185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959932+0000","last_change":"2023-11-04T01:42:04.959932+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959932+0000","last_undegraded":"2023-11-04T01:42:04.959932+0000","last_fullsized":"2023-11-04T01:42:04.959932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012445+0000","last_change":"2023-11-04T01:42:05.006675+0000","last_active":"2023-11-04T01:42:05.012445+0000","last_peered":"2023-11-04T01:42:05.012445+0000","last_clean":"2023-11-04T01:42:05.012445+0000","last_became_active":"2023-11-04T01:42:05.006360+0000","last_became_peered":"2023-11-04T01:42:05.006360+0000","last_unstale":"2023-11-04T01:42:05.012445+0000","last_undegraded":"2023-11-04T01:42:05.012445+0000","last_fullsized":"2023-11-04T01:42:05.012445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:04.101815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960594+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:03.960594+0000","last_peered":"2023-11-04T01:42:03.960594+0000","last_clean":"2023-11-04T01:42:03.960594+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:03.960594+0000","last_undegraded":"2023-11-04T01:42:03.960594+0000","last_fullsized":"2023-11-04T01:42:03.960594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980514+0000","last_change":"2023-11-04T01:42:04.980514+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980514+0000","last_undegraded":"2023-11-04T01:42:04.980514+0000","last_fullsized":"2023-11-04T01:42:04.980514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997662+0000","last_change":"2023-11-04T01:42:04.996167+0000","last_active":"2023-11-04T01:42:04.997662+0000","last_peered":"2023-11-04T01:42:04.997662+0000","last_clean":"2023-11-04T01:42:04.997662+0000","last_became_active":"2023-11-04T01:42:04.995600+0000","last_became_peered":"2023-11-04T01:42:04.995600+0000","last_unstale":"2023-11-04T01:42:04.997662+0000","last_undegraded":"2023-11-04T01:42:04.997662+0000","last_fullsized":"2023-11-04T01:42:04.997662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:09:09.522884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949309+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:03.949309+0000","last_peered":"2023-11-04T01:42:03.949309+0000","last_clean":"2023-11-04T01:42:03.949309+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:03.949309+0000","last_undegraded":"2023-11-04T01:42:03.949309+0000","last_fullsized":"2023-11-04T01:42:03.949309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960654+0000","last_change":"2023-11-04T01:42:04.960654+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960654+0000","last_undegraded":"2023-11-04T01:42:04.960654+0000","last_fullsized":"2023-11-04T01:42:04.960654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012004+0000","last_change":"2023-11-04T01:42:05.007624+0000","last_active":"2023-11-04T01:42:05.012004+0000","last_peered":"2023-11-04T01:42:05.012004+0000","last_clean":"2023-11-04T01:42:05.012004+0000","last_became_active":"2023-11-04T01:42:05.006885+0000","last_became_peered":"2023-11-04T01:42:05.006885+0000","last_unstale":"2023-11-04T01:42:05.012004+0000","last_undegraded":"2023-11-04T01:42:05.012004+0000","last_fullsized":"2023-11-04T01:42:05.012004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:38.637066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.958955+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:03.958955+0000","last_peered":"2023-11-04T01:42:03.958955+0000","last_clean":"2023-11-04T01:42:03.958955+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:03.958955+0000","last_undegraded":"2023-11-04T01:42:03.958955+0000","last_fullsized":"2023-11-04T01:42:03.958955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968875+0000","last_change":"2023-11-04T01:42:04.968875+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968875+0000","last_undegraded":"2023-11-04T01:42:04.968875+0000","last_fullsized":"2023-11-04T01:42:04.968875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.977461+0000","last_change":"2023-11-04T01:42:04.975673+0000","last_active":"2023-11-04T01:42:04.977461+0000","last_peered":"2023-11-04T01:42:04.977461+0000","last_clean":"2023-11-04T01:42:04.977461+0000","last_became_active":"2023-11-04T01:42:04.975387+0000","last_became_peered":"2023-11-04T01:42:04.975387+0000","last_unstale":"2023-11-04T01:42:04.977461+0000","last_undegraded":"2023-11-04T01:42:04.977461+0000","last_fullsized":"2023-11-04T01:42:04.977461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:34.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962370+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:03.962370+0000","last_peered":"2023-11-04T01:42:03.962370+0000","last_clean":"2023-11-04T01:42:03.962370+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:03.962370+0000","last_undegraded":"2023-11-04T01:42:03.962370+0000","last_fullsized":"2023-11-04T01:42:03.962370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962814+0000","last_change":"2023-11-04T01:42:04.962814+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962814+0000","last_undegraded":"2023-11-04T01:42:04.962814+0000","last_fullsized":"2023-11-04T01:42:04.962814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975489+0000","last_change":"2023-11-04T01:42:04.972222+0000","last_active":"2023-11-04T01:42:04.975489+0000","last_peered":"2023-11-04T01:42:04.975489+0000","last_clean":"2023-11-04T01:42:04.975489+0000","last_became_active":"2023-11-04T01:42:04.971888+0000","last_became_peered":"2023-11-04T01:42:04.971888+0000","last_unstale":"2023-11-04T01:42:04.975489+0000","last_undegraded":"2023-11-04T01:42:04.975489+0000","last_fullsized":"2023-11-04T01:42:04.975489+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:39.375558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966888+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:03.966888+0000","last_peered":"2023-11-04T01:42:03.966888+0000","last_clean":"2023-11-04T01:42:03.966888+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:03.966888+0000","last_undegraded":"2023-11-04T01:42:03.966888+0000","last_fullsized":"2023-11-04T01:42:03.966888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976632+0000","last_change":"2023-11-04T01:42:04.976632+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976632+0000","last_undegraded":"2023-11-04T01:42:04.976632+0000","last_fullsized":"2023-11-04T01:42:04.976632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013275+0000","last_change":"2023-11-04T01:42:05.007348+0000","last_active":"2023-11-04T01:42:05.013275+0000","last_peered":"2023-11-04T01:42:05.013275+0000","last_clean":"2023-11-04T01:42:05.013275+0000","last_became_active":"2023-11-04T01:42:05.006661+0000","last_became_peered":"2023-11-04T01:42:05.006661+0000","last_unstale":"2023-11-04T01:42:05.013275+0000","last_undegraded":"2023-11-04T01:42:05.013275+0000","last_fullsized":"2023-11-04T01:42:05.013275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:01:12.774886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957638+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:03.957638+0000","last_peered":"2023-11-04T01:42:03.957638+0000","last_clean":"2023-11-04T01:42:03.957638+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:03.957638+0000","last_undegraded":"2023-11-04T01:42:03.957638+0000","last_fullsized":"2023-11-04T01:42:03.957638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964445+0000","last_change":"2023-11-04T01:42:04.964445+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964445+0000","last_undegraded":"2023-11-04T01:42:04.964445+0000","last_fullsized":"2023-11-04T01:42:04.964445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984367+0000","last_change":"2023-11-04T01:42:04.983369+0000","last_active":"2023-11-04T01:42:04.984367+0000","last_peered":"2023-11-04T01:42:04.984367+0000","last_clean":"2023-11-04T01:42:04.984367+0000","last_became_active":"2023-11-04T01:42:04.983083+0000","last_became_peered":"2023-11-04T01:42:04.983083+0000","last_unstale":"2023-11-04T01:42:04.984367+0000","last_undegraded":"2023-11-04T01:42:04.984367+0000","last_fullsized":"2023-11-04T01:42:04.984367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960886+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:03.960886+0000","last_peered":"2023-11-04T01:42:03.960886+0000","last_clean":"2023-11-04T01:42:03.960886+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:03.960886+0000","last_undegraded":"2023-11-04T01:42:03.960886+0000","last_fullsized":"2023-11-04T01:42:03.960886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965988+0000","last_change":"2023-11-04T01:42:04.965988+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965988+0000","last_undegraded":"2023-11-04T01:42:04.965988+0000","last_fullsized":"2023-11-04T01:42:04.965988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015151+0000","last_change":"2023-11-04T01:42:05.011704+0000","last_active":"2023-11-04T01:42:05.015151+0000","last_peered":"2023-11-04T01:42:05.015151+0000","last_clean":"2023-11-04T01:42:05.015151+0000","last_became_active":"2023-11-04T01:42:05.010990+0000","last_became_peered":"2023-11-04T01:42:05.010990+0000","last_unstale":"2023-11-04T01:42:05.015151+0000","last_undegraded":"2023-11-04T01:42:05.015151+0000","last_fullsized":"2023-11-04T01:42:05.015151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:38.042581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949162+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:03.949162+0000","last_peered":"2023-11-04T01:42:03.949162+0000","last_clean":"2023-11-04T01:42:03.949162+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:03.949162+0000","last_undegraded":"2023-11-04T01:42:03.949162+0000","last_fullsized":"2023-11-04T01:42:03.949162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960929+0000","last_change":"2023-11-04T01:42:04.960929+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960929+0000","last_undegraded":"2023-11-04T01:42:04.960929+0000","last_fullsized":"2023-11-04T01:42:04.960929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984339+0000","last_change":"2023-11-04T01:42:04.978969+0000","last_active":"2023-11-04T01:42:04.984339+0000","last_peered":"2023-11-04T01:42:04.984339+0000","last_clean":"2023-11-04T01:42:04.984339+0000","last_became_active":"2023-11-04T01:42:04.978240+0000","last_became_peered":"2023-11-04T01:42:04.978240+0000","last_unstale":"2023-11-04T01:42:04.984339+0000","last_undegraded":"2023-11-04T01:42:04.984339+0000","last_fullsized":"2023-11-04T01:42:04.984339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:20.145051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.964938+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:03.964938+0000","last_peered":"2023-11-04T01:42:03.964938+0000","last_clean":"2023-11-04T01:42:03.964938+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:03.964938+0000","last_undegraded":"2023-11-04T01:42:03.964938+0000","last_fullsized":"2023-11-04T01:42:03.964938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979351+0000","last_change":"2023-11-04T01:42:04.979351+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979351+0000","last_undegraded":"2023-11-04T01:42:04.979351+0000","last_fullsized":"2023-11-04T01:42:04.979351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013341+0000","last_change":"2023-11-04T01:42:05.007818+0000","last_active":"2023-11-04T01:42:05.013341+0000","last_peered":"2023-11-04T01:42:05.013341+0000","last_clean":"2023-11-04T01:42:05.013341+0000","last_became_active":"2023-11-04T01:42:05.006963+0000","last_became_peered":"2023-11-04T01:42:05.006963+0000","last_unstale":"2023-11-04T01:42:05.013341+0000","last_undegraded":"2023-11-04T01:42:05.013341+0000","last_fullsized":"2023-11-04T01:42:05.013341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:38.168718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959078+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:03.959078+0000","last_peered":"2023-11-04T01:42:03.959078+0000","last_clean":"2023-11-04T01:42:03.959078+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:03.959078+0000","last_undegraded":"2023-11-04T01:42:03.959078+0000","last_fullsized":"2023-11-04T01:42:03.959078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962838+0000","last_change":"2023-11-04T01:42:04.962838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962838+0000","last_undegraded":"2023-11-04T01:42:04.962838+0000","last_fullsized":"2023-11-04T01:42:04.962838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.005558+0000","last_change":"2023-11-04T01:42:05.001976+0000","last_active":"2023-11-04T01:42:05.005558+0000","last_peered":"2023-11-04T01:42:05.005558+0000","last_clean":"2023-11-04T01:42:05.005558+0000","last_became_active":"2023-11-04T01:42:05.001247+0000","last_became_peered":"2023-11-04T01:42:05.001247+0000","last_unstale":"2023-11-04T01:42:05.005558+0000","last_undegraded":"2023-11-04T01:42:05.005558+0000","last_fullsized":"2023-11-04T01:42:05.005558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:20.498259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960813+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:03.960813+0000","last_peered":"2023-11-04T01:42:03.960813+0000","last_clean":"2023-11-04T01:42:03.960813+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:03.960813+0000","last_undegraded":"2023-11-04T01:42:03.960813+0000","last_fullsized":"2023-11-04T01:42:03.960813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964373+0000","last_change":"2023-11-04T01:42:04.964373+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964373+0000","last_undegraded":"2023-11-04T01:42:04.964373+0000","last_fullsized":"2023-11-04T01:42:04.964373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015020+0000","last_change":"2023-11-04T01:42:05.010393+0000","last_active":"2023-11-04T01:42:05.015020+0000","last_peered":"2023-11-04T01:42:05.015020+0000","last_clean":"2023-11-04T01:42:05.015020+0000","last_became_active":"2023-11-04T01:42:05.009748+0000","last_became_peered":"2023-11-04T01:42:05.009748+0000","last_unstale":"2023-11-04T01:42:05.015020+0000","last_undegraded":"2023-11-04T01:42:05.015020+0000","last_fullsized":"2023-11-04T01:42:05.015020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:52.103809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966597+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:03.966597+0000","last_peered":"2023-11-04T01:42:03.966597+0000","last_clean":"2023-11-04T01:42:03.966597+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:03.966597+0000","last_undegraded":"2023-11-04T01:42:03.966597+0000","last_fullsized":"2023-11-04T01:42:03.966597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965842+0000","last_change":"2023-11-04T01:42:04.965842+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965842+0000","last_undegraded":"2023-11-04T01:42:04.965842+0000","last_fullsized":"2023-11-04T01:42:04.965842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004590+0000","last_change":"2023-11-04T01:42:05.000198+0000","last_active":"2023-11-04T01:42:05.004590+0000","last_peered":"2023-11-04T01:42:05.004590+0000","last_clean":"2023-11-04T01:42:05.004590+0000","last_became_active":"2023-11-04T01:42:04.999551+0000","last_became_peered":"2023-11-04T01:42:04.999551+0000","last_unstale":"2023-11-04T01:42:05.004590+0000","last_undegraded":"2023-11-04T01:42:05.004590+0000","last_fullsized":"2023-11-04T01:42:05.004590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:34.807369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956841+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:03.956841+0000","last_peered":"2023-11-04T01:42:03.956841+0000","last_clean":"2023-11-04T01:42:03.956841+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:03.956841+0000","last_undegraded":"2023-11-04T01:42:03.956841+0000","last_fullsized":"2023-11-04T01:42:03.956841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1302528,"data_stored":896392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":29.603000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.462},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":8.1280000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":2.6389999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":25.791}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":3.98},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":25.696999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":11.064},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":4.1630000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.581},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":4.0730000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.92000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":1.048},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.748}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.006}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.133},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.139},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.2}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.089},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.4910000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.155},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.089}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.753},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":1.0329999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.103}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":1.21}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":1.163}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.28},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":1.0860000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.329},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.747}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.622}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":903012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.80400000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":0.82699999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:09.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.964311+0000', 'last_change': '2023-11-04T01:42:04.964311+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.964311+0000', 'last_undegraded': '2023-11-04T01:42:04.964311+0000', 'last_fullsized': '2023-11-04T01:42:04.964311+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.963394+0000', 'last_change': '2023-11-04T01:42:04.963394+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.963394+0000', 'last_undegraded': '2023-11-04T01:42:04.963394+0000', 'last_fullsized': '2023-11-04T01:42:04.963394+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.970604+0000', 'last_change': '2023-11-04T01:42:04.970604+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.970604+0000', 'last_undegraded': '2023-11-04T01:42:04.970604+0000', 'last_fullsized': '2023-11-04T01:42:04.970604+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.963630+0000', 'last_change': '2023-11-04T01:42:04.963630+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.963630+0000', 'last_undegraded': '2023-11-04T01:42:04.963630+0000', 'last_fullsized': '2023-11-04T01:42:04.963630+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.980355+0000', 'last_change': '2023-11-04T01:42:04.980355+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.980355+0000', 'last_undegraded': '2023-11-04T01:42:04.980355+0000', 'last_fullsized': '2023-11-04T01:42:04.980355+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.964101+0000', 'last_change': '2023-11-04T01:42:04.964101+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.964101+0000', 'last_undegraded': '2023-11-04T01:42:04.964101+0000', 'last_fullsized': '2023-11-04T01:42:04.964101+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.967421+0000', 'last_change': '2023-11-04T01:42:04.967421+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.967421+0000', 'last_undegraded': '2023-11-04T01:42:04.967421+0000', 'last_fullsized': '2023-11-04T01:42:04.967421+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.970577+0000', 'last_change': '2023-11-04T01:42:04.970577+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.970577+0000', 'last_undegraded': '2023-11-04T01:42:04.970577+0000', 'last_fullsized': '2023-11-04T01:42:04.970577+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.972671+0000', 'last_change': '2023-11-04T01:42:04.972671+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.972671+0000', 'last_undegraded': '2023-11-04T01:42:04.972671+0000', 'last_fullsized': '2023-11-04T01:42:04.972671+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.968979+0000', 'last_change': '2023-11-04T01:42:04.968979+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.968979+0000', 'last_undegraded': '2023-11-04T01:42:04.968979+0000', 'last_fullsized': '2023-11-04T01:42:04.968979+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-11-04T01:42:09.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.967722+0000', 'last_change': '2023-11-04T01:42:04.967722+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.967722+0000', 'last_undegraded': '2023-11-04T01:42:04.967722+0000', 'last_fullsized': '2023-11-04T01:42:04.967722+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.969387+0000', 'last_change': '2023-11-04T01:42:04.969387+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.969387+0000', 'last_undegraded': '2023-11-04T01:42:04.969387+0000', 'last_fullsized': '2023-11-04T01:42:04.969387+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.961992+0000', 'last_change': '2023-11-04T01:42:04.961992+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.961992+0000', 'last_undegraded': '2023-11-04T01:42:04.961992+0000', 'last_fullsized': '2023-11-04T01:42:04.961992+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.971346+0000', 'last_change': '2023-11-04T01:42:04.971346+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.971346+0000', 'last_undegraded': '2023-11-04T01:42:04.971346+0000', 'last_fullsized': '2023-11-04T01:42:04.971346+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.968406+0000', 'last_change': '2023-11-04T01:42:04.968406+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.968406+0000', 'last_undegraded': '2023-11-04T01:42:04.968406+0000', 'last_fullsized': '2023-11-04T01:42:04.968406+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-11-04T01:42:09.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.969330+0000', 'last_change': '2023-11-04T01:42:04.969330+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.969330+0000', 'last_undegraded': '2023-11-04T01:42:04.969330+0000', 'last_fullsized': '2023-11-04T01:42:04.969330+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.963815+0000', 'last_change': '2023-11-04T01:42:04.963815+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.963815+0000', 'last_undegraded': '2023-11-04T01:42:04.963815+0000', 'last_fullsized': '2023-11-04T01:42:04.963815+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.961915+0000', 'last_change': '2023-11-04T01:42:04.961915+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.961915+0000', 'last_undegraded': '2023-11-04T01:42:04.961915+0000', 'last_fullsized': '2023-11-04T01:42:04.961915+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.977955+0000', 'last_change': '2023-11-04T01:42:04.977955+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.977955+0000', 'last_undegraded': '2023-11-04T01:42:04.977955+0000', 'last_fullsized': '2023-11-04T01:42:04.977955+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960714+0000', 'last_change': '2023-11-04T01:42:04.960714+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960714+0000', 'last_undegraded': '2023-11-04T01:42:04.960714+0000', 'last_fullsized': '2023-11-04T01:42:04.960714+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-11-04T01:42:09.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960644+0000', 'last_change': '2023-11-04T01:42:04.960644+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960644+0000', 'last_undegraded': '2023-11-04T01:42:04.960644+0000', 'last_fullsized': '2023-11-04T01:42:04.960644+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.961806+0000', 'last_change': '2023-11-04T01:42:04.961806+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.961806+0000', 'last_undegraded': '2023-11-04T01:42:04.961806+0000', 'last_fullsized': '2023-11-04T01:42:04.961806+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960731+0000', 'last_change': '2023-11-04T01:42:04.960731+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960731+0000', 'last_undegraded': '2023-11-04T01:42:04.960731+0000', 'last_fullsized': '2023-11-04T01:42:04.960731+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.968164+0000', 'last_change': '2023-11-04T01:42:04.968164+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.968164+0000', 'last_undegraded': '2023-11-04T01:42:04.968164+0000', 'last_fullsized': '2023-11-04T01:42:04.968164+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.965282+0000', 'last_change': '2023-11-04T01:42:04.965282+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.965282+0000', 'last_undegraded': '2023-11-04T01:42:04.965282+0000', 'last_fullsized': '2023-11-04T01:42:04.965282+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-11-04T01:42:09.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.968209+0000', 'last_change': '2023-11-04T01:42:04.968209+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.968209+0000', 'last_undegraded': '2023-11-04T01:42:04.968209+0000', 'last_fullsized': '2023-11-04T01:42:04.968209+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.966582+0000', 'last_change': '2023-11-04T01:42:04.966582+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.966582+0000', 'last_undegraded': '2023-11-04T01:42:04.966582+0000', 'last_fullsized': '2023-11-04T01:42:04.966582+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.966509+0000', 'last_change': '2023-11-04T01:42:04.966509+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.966509+0000', 'last_undegraded': '2023-11-04T01:42:04.966509+0000', 'last_fullsized': '2023-11-04T01:42:04.966509+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.972381+0000', 'last_change': '2023-11-04T01:42:04.972381+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.972381+0000', 'last_undegraded': '2023-11-04T01:42:04.972381+0000', 'last_fullsized': '2023-11-04T01:42:04.972381+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.963276+0000', 'last_change': '2023-11-04T01:42:04.963276+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.963276+0000', 'last_undegraded': '2023-11-04T01:42:04.963276+0000', 'last_fullsized': '2023-11-04T01:42:04.963276+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.961302+0000', 'last_change': '2023-11-04T01:42:04.961302+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.961302+0000', 'last_undegraded': '2023-11-04T01:42:04.961302+0000', 'last_fullsized': '2023-11-04T01:42:04.961302+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-11-04T01:42:09.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.964401+0000', 'last_change': '2023-11-04T01:42:04.964401+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.964401+0000', 'last_undegraded': '2023-11-04T01:42:04.964401+0000', 'last_fullsized': '2023-11-04T01:42:04.964401+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.979252+0000', 'last_change': '2023-11-04T01:42:04.979252+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.979252+0000', 'last_undegraded': '2023-11-04T01:42:04.979252+0000', 'last_fullsized': '2023-11-04T01:42:04.979252+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960838+0000', 'last_change': '2023-11-04T01:42:04.960838+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960838+0000', 'last_undegraded': '2023-11-04T01:42:04.960838+0000', 'last_fullsized': '2023-11-04T01:42:04.960838+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.982231+0000', 'last_change': '2023-11-04T01:42:04.982231+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.982231+0000', 'last_undegraded': '2023-11-04T01:42:04.982231+0000', 'last_fullsized': '2023-11-04T01:42:04.982231+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.970601+0000', 'last_change': '2023-11-04T01:42:04.970601+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.970601+0000', 'last_undegraded': '2023-11-04T01:42:04.970601+0000', 'last_fullsized': '2023-11-04T01:42:04.970601+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-04T01:42:09.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.976588+0000', 'last_change': '2023-11-04T01:42:04.976588+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.976588+0000', 'last_undegraded': '2023-11-04T01:42:04.976588+0000', 'last_fullsized': '2023-11-04T01:42:04.976588+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.976659+0000', 'last_change': '2023-11-04T01:42:04.976659+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.976659+0000', 'last_undegraded': '2023-11-04T01:42:04.976659+0000', 'last_fullsized': '2023-11-04T01:42:04.976659+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.963624+0000', 'last_change': '2023-11-04T01:42:04.963624+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.963624+0000', 'last_undegraded': '2023-11-04T01:42:04.963624+0000', 'last_fullsized': '2023-11-04T01:42:04.963624+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960699+0000', 'last_change': '2023-11-04T01:42:04.960699+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960699+0000', 'last_undegraded': '2023-11-04T01:42:04.960699+0000', 'last_fullsized': '2023-11-04T01:42:04.960699+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.967082+0000', 'last_change': '2023-11-04T01:42:04.967082+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.967082+0000', 'last_undegraded': '2023-11-04T01:42:04.967082+0000', 'last_fullsized': '2023-11-04T01:42:04.967082+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-04T01:42:09.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.977926+0000', 'last_change': '2023-11-04T01:42:04.977926+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.977926+0000', 'last_undegraded': '2023-11-04T01:42:04.977926+0000', 'last_fullsized': '2023-11-04T01:42:04.977926+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.965667+0000', 'last_change': '2023-11-04T01:42:04.965667+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.965667+0000', 'last_undegraded': '2023-11-04T01:42:04.965667+0000', 'last_fullsized': '2023-11-04T01:42:04.965667+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.970106+0000', 'last_change': '2023-11-04T01:42:04.970106+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.970106+0000', 'last_undegraded': '2023-11-04T01:42:04.970106+0000', 'last_fullsized': '2023-11-04T01:42:04.970106+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.965420+0000', 'last_change': '2023-11-04T01:42:04.965420+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.965420+0000', 'last_undegraded': '2023-11-04T01:42:04.965420+0000', 'last_fullsized': '2023-11-04T01:42:04.965420+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.969628+0000', 'last_change': '2023-11-04T01:42:04.969628+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.969628+0000', 'last_undegraded': '2023-11-04T01:42:04.969628+0000', 'last_fullsized': '2023-11-04T01:42:04.969628+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.979780+0000', 'last_change': '2023-11-04T01:42:04.979780+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.979780+0000', 'last_undegraded': '2023-11-04T01:42:04.979780+0000', 'last_fullsized': '2023-11-04T01:42:04.979780+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.959872+0000', 'last_change': '2023-11-04T01:42:04.959872+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.959872+0000', 'last_undegraded': '2023-11-04T01:42:04.959872+0000', 'last_fullsized': '2023-11-04T01:42:04.959872+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.967061+0000', 'last_change': '2023-11-04T01:42:04.967061+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.967061+0000', 'last_undegraded': '2023-11-04T01:42:04.967061+0000', 'last_fullsized': '2023-11-04T01:42:04.967061+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.988515+0000', 'last_change': '2023-11-04T01:42:04.988515+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.988515+0000', 'last_undegraded': '2023-11-04T01:42:04.988515+0000', 'last_fullsized': '2023-11-04T01:42:04.988515+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.978615+0000', 'last_change': '2023-11-04T01:42:04.978615+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.978615+0000', 'last_undegraded': '2023-11-04T01:42:04.978615+0000', 'last_fullsized': '2023-11-04T01:42:04.978615+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.959932+0000', 'last_change': '2023-11-04T01:42:04.959932+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.959932+0000', 'last_undegraded': '2023-11-04T01:42:04.959932+0000', 'last_fullsized': '2023-11-04T01:42:04.959932+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-04T01:42:09.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.980514+0000', 'last_change': '2023-11-04T01:42:04.980514+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.980514+0000', 'last_undegraded': '2023-11-04T01:42:04.980514+0000', 'last_fullsized': '2023-11-04T01:42:04.980514+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960654+0000', 'last_change': '2023-11-04T01:42:04.960654+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960654+0000', 'last_undegraded': '2023-11-04T01:42:04.960654+0000', 'last_fullsized': '2023-11-04T01:42:04.960654+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.968875+0000', 'last_change': '2023-11-04T01:42:04.968875+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.968875+0000', 'last_undegraded': '2023-11-04T01:42:04.968875+0000', 'last_fullsized': '2023-11-04T01:42:04.968875+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.962814+0000', 'last_change': '2023-11-04T01:42:04.962814+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.962814+0000', 'last_undegraded': '2023-11-04T01:42:04.962814+0000', 'last_fullsized': '2023-11-04T01:42:04.962814+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.976632+0000', 'last_change': '2023-11-04T01:42:04.976632+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.976632+0000', 'last_undegraded': '2023-11-04T01:42:04.976632+0000', 'last_fullsized': '2023-11-04T01:42:04.976632+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.964445+0000', 'last_change': '2023-11-04T01:42:04.964445+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.964445+0000', 'last_undegraded': '2023-11-04T01:42:04.964445+0000', 'last_fullsized': '2023-11-04T01:42:04.964445+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-11-04T01:42:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.965988+0000', 'last_change': '2023-11-04T01:42:04.965988+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.965988+0000', 'last_undegraded': '2023-11-04T01:42:04.965988+0000', 'last_fullsized': '2023-11-04T01:42:04.965988+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.960929+0000', 'last_change': '2023-11-04T01:42:04.960929+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.960929+0000', 'last_undegraded': '2023-11-04T01:42:04.960929+0000', 'last_fullsized': '2023-11-04T01:42:04.960929+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.979351+0000', 'last_change': '2023-11-04T01:42:04.979351+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.979351+0000', 'last_undegraded': '2023-11-04T01:42:04.979351+0000', 'last_fullsized': '2023-11-04T01:42:04.979351+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.962838+0000', 'last_change': '2023-11-04T01:42:04.962838+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.962838+0000', 'last_undegraded': '2023-11-04T01:42:04.962838+0000', 'last_fullsized': '2023-11-04T01:42:04.962838+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.964373+0000', 'last_change': '2023-11-04T01:42:04.964373+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.964373+0000', 'last_undegraded': '2023-11-04T01:42:04.964373+0000', 'last_fullsized': '2023-11-04T01:42:04.964373+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-04T01:42:09.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:42:04.965842+0000', 'last_change': '2023-11-04T01:42:04.965842+0000', 'last_active': '2023-11-04T01:42:04.945280+0000', 'last_peered': '2023-11-04T01:42:04.945280+0000', 'last_clean': '2023-11-04T01:42:04.945280+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:04.965842+0000', 'last_undegraded': '2023-11-04T01:42:04.965842+0000', 'last_fullsized': '2023-11-04T01:42:04.965842+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:04.945280+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:42:09.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:42:09.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 Processor -- start 2023-11-04T01:42:09.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 -- start start 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f93bc06baa0 0x7f93bc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93bc15d240 0x7f93bc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc15dc10 con 0x7f93bc15d240 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc159b10 con 0x7f93bc06baa0 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93c1aea640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc06fc90 con 0x7f93bc159730 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93bc15d240 0x7f93bc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93bc15d240 0x7f93bc15d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57284/0 (socket says 172.21.15.40:57284) 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 -- 172.21.15.40:0/1482152237 learned_addr learned my addr 172.21.15.40:0/1482152237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/1482152237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93baffd640 1 --2- 172.21.15.40:0/1482152237 >> v2:172.21.15.91:3300/0 conn(0x7f93bc06baa0 0x7f93bc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 -- 172.21.15.40:0/1482152237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 msgr2=0x7f93bc0c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 --2- 172.21.15.40:0/1482152237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 -- 172.21.15.40:0/1482152237 >> v2:172.21.15.91:3300/0 conn(0x7f93bc06baa0 msgr2=0x7f93bc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 --2- 172.21.15.40:0/1482152237 >> v2:172.21.15.91:3300/0 conn(0x7f93bc06baa0 0x7f93bc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.958+0000 7f93bbfff640 1 -- 172.21.15.40:0/1482152237 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc15e0a0 con 0x7f93bc15d240 2023-11-04T01:42:09.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93bbfff640 1 --2- 172.21.15.40:0/1482152237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc15d6d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f93bc06b930 tx=0x7f93b40211a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddcb467b220e28a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93ba7fc640 1 -- 172.21.15.40:0/1482152237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4004030 con 0x7f93bc15d240 2023-11-04T01:42:09.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93ba7fc640 1 -- 172.21.15.40:0/1482152237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40ad030 con 0x7f93bc15d240 2023-11-04T01:42:09.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93ba7fc640 1 -- 172.21.15.40:0/1482152237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4004410 con 0x7f93bc15d240 2023-11-04T01:42:09.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- 172.21.15.40:0/1482152237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 msgr2=0x7f93bc15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- 172.21.15.40:0/1482152237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc15d6d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f93bc06b930 tx=0x7f93b40211a0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- 172.21.15.40:0/1482152237 shutdown_connections 2023-11-04T01:42:09.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- 172.21.15.40:0/1482152237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc15d6d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- 172.21.15.40:0/1482152237 >> v2:172.21.15.91:3300/0 conn(0x7f93bc06baa0 0x7f93bc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- 172.21.15.40:0/1482152237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- 172.21.15.40:0/1482152237 >> 172.21.15.40:0/1482152237 conn(0x7f93bc0b07d0 msgr2=0x7f93bc0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- 172.21.15.40:0/1482152237 shutdown_connections 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- 172.21.15.40:0/1482152237 wait complete. 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 Processor -- start 2023-11-04T01:42:09.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- start start 2023-11-04T01:42:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93bc06baa0 0x7f93bc15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc152070 con 0x7f93bc15d240 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0b4720 con 0x7f93bc06baa0 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93c1aea640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc151460 con 0x7f93bc159730 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc0b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57290/0 (socket says 172.21.15.40:57290) 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.962+0000 7f93bbfff640 1 -- 172.21.15.40:0/2248076766 learned_addr learned my addr 172.21.15.40:0/2248076766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93bc06baa0 0x7f93bc15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93baffd640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bbfff640 1 -- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 msgr2=0x7f93bc0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bbfff640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bbfff640 1 -- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93bc06baa0 msgr2=0x7f93bc15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bbfff640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93bc06baa0 0x7f93bc15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bbfff640 1 -- 172.21.15.40:0/2248076766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b400b780 con 0x7f93bc15d240 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bbfff640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc0b41e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f93b401f850 tx=0x7f93b401df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4003820 con 0x7f93bc15d240 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40039a0 con 0x7f93bc15d240 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc151740 con 0x7f93bc15d240 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4003d50 con 0x7f93bc15d240 2023-11-04T01:42:09.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc151d00 con 0x7f93bc15d240 2023-11-04T01:42:09.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc152220 con 0x7f93bc15d240 2023-11-04T01:42:09.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93b40bc420 con 0x7f93bc15d240 2023-11-04T01:42:09.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93a3fff640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93a80664a0 0x7f93a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93b41237a0 con 0x7f93bc15d240 2023-11-04T01:42:09.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93a80664a0 0x7f93a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.966+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93a80664a0 0x7f93a8068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b950 tx=0x7f93ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:09.970+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93b40f0be0 con 0x7f93bc15d240 2023-11-04T01:42:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.186+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f93bc074510 con 0x7f93bc15d240 2023-11-04T01:42:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.186+0000 7f93a3fff640 1 -- 172.21.15.40:0/2248076766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1596 (secure 0 0 0) 0x7f93b40f4200 con 0x7f93bc15d240 2023-11-04T01:42:10.193 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:10.193 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":157,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061984,"num_in_osds":8,"osd_in_since":1699061975,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":65},{"state_name":"creating+peering","count":64}],"num_pgs":129,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":236777472,"bytes_avail":772857335808,"bytes_total":773094113280,"inactive_pgs_ratio":0.4961240291595459},"fsmap":{"epoch":30,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6150}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-04T01:41:47.788736+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93a80664a0 msgr2=0x7f93a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93a80664a0 0x7f93a8068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b950 tx=0x7f93ac008040 comp rx=0 tx=0).stop 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 msgr2=0x7f93bc0b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc0b41e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f93b401f850 tx=0x7f93b401df40 comp rx=0 tx=0).stop 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 shutdown_connections 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f93a80664a0 0x7f93a8068960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc15d240 0x7f93bc0b41e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f93bc159730 0x7f93bc0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 --2- 172.21.15.40:0/2248076766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f93bc06baa0 0x7f93bc15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 >> 172.21.15.40:0/2248076766 conn(0x7f93bc0b07d0 msgr2=0x7f93bc0cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 shutdown_connections 2023-11-04T01:42:10.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.190+0000 7f93c1aea640 1 -- 172.21.15.40:0/2248076766 wait complete. 2023-11-04T01:42:10.212 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:42:10.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 Processor -- start 2023-11-04T01:42:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 -- start start 2023-11-04T01:42:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f37680cb400 0x7f37680cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 0x7f37680cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37680ce040 con 0x7f376815afb0 2023-11-04T01:42:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376815b390 con 0x7f37680cb400 2023-11-04T01:42:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f377040e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680d0a60 con 0x7f37680cd6d0 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 0x7f37680cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 0x7f37680cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:60174/0 (socket says 172.21.15.40:60174) 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 -- 172.21.15.40:0/4130506422 learned_addr learned my addr 172.21.15.40:0/4130506422 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376d9a9640 1 --2- 172.21.15.40:0/4130506422 >> v2:172.21.15.91:3300/0 conn(0x7f37680cb400 0x7f37680cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 -- 172.21.15.40:0/4130506422 >> v2:172.21.15.91:3300/0 conn(0x7f37680cb400 msgr2=0x7f37680cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 --2- 172.21.15.40:0/4130506422 >> v2:172.21.15.91:3300/0 conn(0x7f37680cb400 0x7f37680cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 -- 172.21.15.40:0/4130506422 >> v1:172.21.15.91:6789/0 conn(0x7f376815afb0 legacy=0x7f37680b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.334+0000 7f376e9ab640 1 -- 172.21.15.40:0/4130506422 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680d04a0 con 0x7f37680cd6d0 2023-11-04T01:42:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f376e9ab640 1 --2- 172.21.15.40:0/4130506422 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 0x7f37680cdb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3760009e50 tx=0x7f376001c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a0ad39831947a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f376d1a8640 1 -- 172.21.15.40:0/4130506422 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600a5730 con 0x7f37680cd6d0 2023-11-04T01:42:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f376d1a8640 1 -- 172.21.15.40:0/4130506422 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600a5890 con 0x7f37680cd6d0 2023-11-04T01:42:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f376d1a8640 1 -- 172.21.15.40:0/4130506422 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600a5c20 con 0x7f37680cd6d0 2023-11-04T01:42:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 -- 172.21.15.40:0/4130506422 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 msgr2=0x7f37680cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 --2- 172.21.15.40:0/4130506422 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 0x7f37680cdb00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3760009e50 tx=0x7f376001c980 comp rx=0 tx=0).stop 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 -- 172.21.15.40:0/4130506422 shutdown_connections 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 --2- 172.21.15.40:0/4130506422 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f37680cd6d0 0x7f37680cdb00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 --2- 172.21.15.40:0/4130506422 >> v2:172.21.15.91:3300/0 conn(0x7f37680cb400 0x7f37680cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 -- 172.21.15.40:0/4130506422 >> 172.21.15.40:0/4130506422 conn(0x7f3768065dc0 msgr2=0x7f37680661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 -- 172.21.15.40:0/4130506422 shutdown_connections 2023-11-04T01:42:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 -- 172.21.15.40:0/4130506422 wait complete. 2023-11-04T01:42:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 Processor -- start 2023-11-04T01:42:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.338+0000 7f377040e640 1 -- start start 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 0x7f37680c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37680cd6d0 0x7f3768150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f376815afb0 0x7f3768156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768152740 con 0x7f37680cb400 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680ca520 con 0x7f37680cd6d0 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680cacd0 con 0x7f376815afb0 2023-11-04T01:42:10.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 0x7f37680c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 0x7f37680c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57300/0 (socket says 172.21.15.40:57300) 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 -- 172.21.15.40:0/3724335208 learned_addr learned my addr 172.21.15.40:0/3724335208 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376d9a9640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37680cd6d0 0x7f3768150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e9ab640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f376815afb0 0x7f3768156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 -- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f376815afb0 msgr2=0x7f3768156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f376815afb0 0x7f3768156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 -- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37680cd6d0 msgr2=0x7f3768150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37680cd6d0 0x7f3768150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 -- 172.21.15.40:0/3724335208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760009b30 con 0x7f37680cb400 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e9ab640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f376815afb0 0x7f3768156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:10.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376e1aa640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 0x7f37680c7df0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f376400c480 tx=0x7f376400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640052d0 con 0x7f37680cb400 2023-11-04T01:42:10.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3768152b60 con 0x7f37680cb400 2023-11-04T01:42:10.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764005450 con 0x7f37680cb400 2023-11-04T01:42:10.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764012870 con 0x7f37680cb400 2023-11-04T01:42:10.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37680ca9f0 con 0x7f37680cb400 2023-11-04T01:42:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37680675f0 con 0x7f37680cb400 2023-11-04T01:42:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37640129d0 con 0x7f37680cb400 2023-11-04T01:42:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f375effd640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f374c0664d0 0x7f374c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3764083b90 con 0x7f37680cb400 2023-11-04T01:42:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.342+0000 7f376d9a9640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f374c0664d0 0x7f374c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.346+0000 7f376d9a9640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f374c0664d0 0x7f374c068990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f37680c45b0 tx=0x7f3758008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.346+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3764050ec0 con 0x7f37680cb400 2023-11-04T01:42:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.502+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37680cec70 con 0x7f374c0664d0 2023-11-04T01:42:10.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f375effd640 1 -- 172.21.15.40:0/3724335208 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363467 (secure 0 0 0) 0x7f37580118b0 con 0x7f374c0664d0 2023-11-04T01:42:10.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f374c0664d0 msgr2=0x7f374c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f374c0664d0 0x7f374c068990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f37680c45b0 tx=0x7f3758008040 comp rx=0 tx=0).stop 2023-11-04T01:42:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 msgr2=0x7f37680c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 0x7f37680c7df0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f376400c480 tx=0x7f376400c940 comp rx=0 tx=0).stop 2023-11-04T01:42:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 shutdown_connections 2023-11-04T01:42:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f374c0664d0 0x7f374c068990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f376815afb0 0x7f3768156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f37680cd6d0 0x7f3768150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 --2- 172.21.15.40:0/3724335208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37680cb400 0x7f37680c7df0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 >> 172.21.15.40:0/3724335208 conn(0x7f3768065dc0 msgr2=0x7f37680b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 shutdown_connections 2023-11-04T01:42:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:10.530+0000 7f377040e640 1 -- 172.21.15.40:0/3724335208 wait complete. 2023-11-04T01:42:10.554 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-11-04T01:42:09.796045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231228,"kb_used_data":6732,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743492,"statfs":{"total":773094113280,"available":772857335808,"internally_reserved":0,"allocated":6893568,"data_stored":3648788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.845800"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964311+0000","last_change":"2023-11-04T01:42:04.964311+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964311+0000","last_undegraded":"2023-11-04T01:42:04.964311+0000","last_fullsized":"2023-11-04T01:42:04.964311+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963394+0000","last_change":"2023-11-04T01:42:04.963394+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963394+0000","last_undegraded":"2023-11-04T01:42:04.963394+0000","last_fullsized":"2023-11-04T01:42:04.963394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970604+0000","last_change":"2023-11-04T01:42:04.970604+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970604+0000","last_undegraded":"2023-11-04T01:42:04.970604+0000","last_fullsized":"2023-11-04T01:42:04.970604+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963630+0000","last_change":"2023-11-04T01:42:04.963630+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963630+0000","last_undegraded":"2023-11-04T01:42:04.963630+0000","last_fullsized":"2023-11-04T01:42:04.963630+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980355+0000","last_change":"2023-11-04T01:42:04.980355+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980355+0000","last_undegraded":"2023-11-04T01:42:04.980355+0000","last_fullsized":"2023-11-04T01:42:04.980355+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964101+0000","last_change":"2023-11-04T01:42:04.964101+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964101+0000","last_undegraded":"2023-11-04T01:42:04.964101+0000","last_fullsized":"2023-11-04T01:42:04.964101+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967421+0000","last_change":"2023-11-04T01:42:04.967421+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967421+0000","last_undegraded":"2023-11-04T01:42:04.967421+0000","last_fullsized":"2023-11-04T01:42:04.967421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970577+0000","last_change":"2023-11-04T01:42:04.970577+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970577+0000","last_undegraded":"2023-11-04T01:42:04.970577+0000","last_fullsized":"2023-11-04T01:42:04.970577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972671+0000","last_change":"2023-11-04T01:42:04.972671+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972671+0000","last_undegraded":"2023-11-04T01:42:04.972671+0000","last_fullsized":"2023-11-04T01:42:04.972671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968979+0000","last_change":"2023-11-04T01:42:04.968979+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968979+0000","last_undegraded":"2023-11-04T01:42:04.968979+0000","last_fullsized":"2023-11-04T01:42:04.968979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967722+0000","last_change":"2023-11-04T01:42:04.967722+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967722+0000","last_undegraded":"2023-11-04T01:42:04.967722+0000","last_fullsized":"2023-11-04T01:42:04.967722+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969387+0000","last_change":"2023-11-04T01:42:04.969387+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969387+0000","last_undegraded":"2023-11-04T01:42:04.969387+0000","last_fullsized":"2023-11-04T01:42:04.969387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961992+0000","last_change":"2023-11-04T01:42:04.961992+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961992+0000","last_undegraded":"2023-11-04T01:42:04.961992+0000","last_fullsized":"2023-11-04T01:42:04.961992+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.971346+0000","last_change":"2023-11-04T01:42:04.971346+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.971346+0000","last_undegraded":"2023-11-04T01:42:04.971346+0000","last_fullsized":"2023-11-04T01:42:04.971346+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968406+0000","last_change":"2023-11-04T01:42:04.968406+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968406+0000","last_undegraded":"2023-11-04T01:42:04.968406+0000","last_fullsized":"2023-11-04T01:42:04.968406+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969330+0000","last_change":"2023-11-04T01:42:04.969330+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969330+0000","last_undegraded":"2023-11-04T01:42:04.969330+0000","last_fullsized":"2023-11-04T01:42:04.969330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963815+0000","last_change":"2023-11-04T01:42:04.963815+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963815+0000","last_undegraded":"2023-11-04T01:42:04.963815+0000","last_fullsized":"2023-11-04T01:42:04.963815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961915+0000","last_change":"2023-11-04T01:42:04.961915+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961915+0000","last_undegraded":"2023-11-04T01:42:04.961915+0000","last_fullsized":"2023-11-04T01:42:04.961915+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977955+0000","last_change":"2023-11-04T01:42:04.977955+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977955+0000","last_undegraded":"2023-11-04T01:42:04.977955+0000","last_fullsized":"2023-11-04T01:42:04.977955+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960714+0000","last_change":"2023-11-04T01:42:04.960714+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960714+0000","last_undegraded":"2023-11-04T01:42:04.960714+0000","last_fullsized":"2023-11-04T01:42:04.960714+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960644+0000","last_change":"2023-11-04T01:42:04.960644+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960644+0000","last_undegraded":"2023-11-04T01:42:04.960644+0000","last_fullsized":"2023-11-04T01:42:04.960644+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961806+0000","last_change":"2023-11-04T01:42:04.961806+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961806+0000","last_undegraded":"2023-11-04T01:42:04.961806+0000","last_fullsized":"2023-11-04T01:42:04.961806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960731+0000","last_change":"2023-11-04T01:42:04.960731+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960731+0000","last_undegraded":"2023-11-04T01:42:04.960731+0000","last_fullsized":"2023-11-04T01:42:04.960731+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968164+0000","last_change":"2023-11-04T01:42:04.968164+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968164+0000","last_undegraded":"2023-11-04T01:42:04.968164+0000","last_fullsized":"2023-11-04T01:42:04.968164+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965282+0000","last_change":"2023-11-04T01:42:04.965282+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965282+0000","last_undegraded":"2023-11-04T01:42:04.965282+0000","last_fullsized":"2023-11-04T01:42:04.965282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968209+0000","last_change":"2023-11-04T01:42:04.968209+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968209+0000","last_undegraded":"2023-11-04T01:42:04.968209+0000","last_fullsized":"2023-11-04T01:42:04.968209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966582+0000","last_change":"2023-11-04T01:42:04.966582+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966582+0000","last_undegraded":"2023-11-04T01:42:04.966582+0000","last_fullsized":"2023-11-04T01:42:04.966582+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.966509+0000","last_change":"2023-11-04T01:42:04.966509+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.966509+0000","last_undegraded":"2023-11-04T01:42:04.966509+0000","last_fullsized":"2023-11-04T01:42:04.966509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.972381+0000","last_change":"2023-11-04T01:42:04.972381+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.972381+0000","last_undegraded":"2023-11-04T01:42:04.972381+0000","last_fullsized":"2023-11-04T01:42:04.972381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963276+0000","last_change":"2023-11-04T01:42:04.963276+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963276+0000","last_undegraded":"2023-11-04T01:42:04.963276+0000","last_fullsized":"2023-11-04T01:42:04.963276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.961302+0000","last_change":"2023-11-04T01:42:04.961302+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.961302+0000","last_undegraded":"2023-11-04T01:42:04.961302+0000","last_fullsized":"2023-11-04T01:42:04.961302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964401+0000","last_change":"2023-11-04T01:42:04.964401+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964401+0000","last_undegraded":"2023-11-04T01:42:04.964401+0000","last_fullsized":"2023-11-04T01:42:04.964401+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979252+0000","last_change":"2023-11-04T01:42:04.979252+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979252+0000","last_undegraded":"2023-11-04T01:42:04.979252+0000","last_fullsized":"2023-11-04T01:42:04.979252+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975784+0000","last_change":"2023-11-04T01:42:04.971841+0000","last_active":"2023-11-04T01:42:04.975784+0000","last_peered":"2023-11-04T01:42:04.975784+0000","last_clean":"2023-11-04T01:42:04.975784+0000","last_became_active":"2023-11-04T01:42:04.971405+0000","last_became_peered":"2023-11-04T01:42:04.971405+0000","last_unstale":"2023-11-04T01:42:04.975784+0000","last_undegraded":"2023-11-04T01:42:04.975784+0000","last_fullsized":"2023-11-04T01:42:04.975784+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:17.604230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":200,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966449+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:03.966449+0000","last_peered":"2023-11-04T01:42:03.966449+0000","last_clean":"2023-11-04T01:42:03.966449+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:03.966449+0000","last_undegraded":"2023-11-04T01:42:03.966449+0000","last_fullsized":"2023-11-04T01:42:03.966449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966189+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:03.966189+0000","last_peered":"2023-11-04T01:42:03.966189+0000","last_clean":"2023-11-04T01:42:03.966189+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:03.966189+0000","last_undegraded":"2023-11-04T01:42:03.966189+0000","last_fullsized":"2023-11-04T01:42:03.966189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960838+0000","last_change":"2023-11-04T01:42:04.960838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960838+0000","last_undegraded":"2023-11-04T01:42:04.960838+0000","last_fullsized":"2023-11-04T01:42:04.960838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015040+0000","last_change":"2023-11-04T01:42:05.010568+0000","last_active":"2023-11-04T01:42:05.015040+0000","last_peered":"2023-11-04T01:42:05.015040+0000","last_clean":"2023-11-04T01:42:05.015040+0000","last_became_active":"2023-11-04T01:42:05.009935+0000","last_became_peered":"2023-11-04T01:42:05.009935+0000","last_unstale":"2023-11-04T01:42:05.015040+0000","last_undegraded":"2023-11-04T01:42:05.015040+0000","last_fullsized":"2023-11-04T01:42:05.015040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:58.106427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957847+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:03.957847+0000","last_peered":"2023-11-04T01:42:03.957847+0000","last_clean":"2023-11-04T01:42:03.957847+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:03.957847+0000","last_undegraded":"2023-11-04T01:42:03.957847+0000","last_fullsized":"2023-11-04T01:42:03.957847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.982231+0000","last_change":"2023-11-04T01:42:04.982231+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.982231+0000","last_undegraded":"2023-11-04T01:42:04.982231+0000","last_fullsized":"2023-11-04T01:42:04.982231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980251+0000","last_change":"2023-11-04T01:42:04.978763+0000","last_active":"2023-11-04T01:42:04.980251+0000","last_peered":"2023-11-04T01:42:04.980251+0000","last_clean":"2023-11-04T01:42:04.980251+0000","last_became_active":"2023-11-04T01:42:04.978517+0000","last_became_peered":"2023-11-04T01:42:04.978517+0000","last_unstale":"2023-11-04T01:42:04.980251+0000","last_undegraded":"2023-11-04T01:42:04.980251+0000","last_fullsized":"2023-11-04T01:42:04.980251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:24:48.216767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967737+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:03.967737+0000","last_peered":"2023-11-04T01:42:03.967737+0000","last_clean":"2023-11-04T01:42:03.967737+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:03.967737+0000","last_undegraded":"2023-11-04T01:42:03.967737+0000","last_fullsized":"2023-11-04T01:42:03.967737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970601+0000","last_change":"2023-11-04T01:42:04.970601+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970601+0000","last_undegraded":"2023-11-04T01:42:04.970601+0000","last_fullsized":"2023-11-04T01:42:04.970601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.010311+0000","last_change":"2023-11-04T01:42:05.003124+0000","last_active":"2023-11-04T01:42:05.010311+0000","last_peered":"2023-11-04T01:42:05.010311+0000","last_clean":"2023-11-04T01:42:05.010311+0000","last_became_active":"2023-11-04T01:42:05.002439+0000","last_became_peered":"2023-11-04T01:42:05.002439+0000","last_unstale":"2023-11-04T01:42:05.010311+0000","last_undegraded":"2023-11-04T01:42:05.010311+0000","last_fullsized":"2023-11-04T01:42:05.010311+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:38.112432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949271+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:03.949271+0000","last_peered":"2023-11-04T01:42:03.949271+0000","last_clean":"2023-11-04T01:42:03.949271+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:03.949271+0000","last_undegraded":"2023-11-04T01:42:03.949271+0000","last_fullsized":"2023-11-04T01:42:03.949271+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976588+0000","last_change":"2023-11-04T01:42:04.976588+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976588+0000","last_undegraded":"2023-11-04T01:42:04.976588+0000","last_fullsized":"2023-11-04T01:42:04.976588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013327+0000","last_change":"2023-11-04T01:42:05.007493+0000","last_active":"2023-11-04T01:42:05.013327+0000","last_peered":"2023-11-04T01:42:05.013327+0000","last_clean":"2023-11-04T01:42:05.013327+0000","last_became_active":"2023-11-04T01:42:05.006869+0000","last_became_peered":"2023-11-04T01:42:05.006869+0000","last_unstale":"2023-11-04T01:42:05.013327+0000","last_undegraded":"2023-11-04T01:42:05.013327+0000","last_fullsized":"2023-11-04T01:42:05.013327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:08.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956698+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:03.956698+0000","last_peered":"2023-11-04T01:42:03.956698+0000","last_clean":"2023-11-04T01:42:03.956698+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:03.956698+0000","last_undegraded":"2023-11-04T01:42:03.956698+0000","last_fullsized":"2023-11-04T01:42:03.956698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976659+0000","last_change":"2023-11-04T01:42:04.976659+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976659+0000","last_undegraded":"2023-11-04T01:42:04.976659+0000","last_fullsized":"2023-11-04T01:42:04.976659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012469+0000","last_change":"2023-11-04T01:42:05.006827+0000","last_active":"2023-11-04T01:42:05.012469+0000","last_peered":"2023-11-04T01:42:05.012469+0000","last_clean":"2023-11-04T01:42:05.012469+0000","last_became_active":"2023-11-04T01:42:05.006480+0000","last_became_peered":"2023-11-04T01:42:05.006480+0000","last_unstale":"2023-11-04T01:42:05.012469+0000","last_undegraded":"2023-11-04T01:42:05.012469+0000","last_fullsized":"2023-11-04T01:42:05.012469+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:42.750611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960719+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:03.960719+0000","last_peered":"2023-11-04T01:42:03.960719+0000","last_clean":"2023-11-04T01:42:03.960719+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:03.960719+0000","last_undegraded":"2023-11-04T01:42:03.960719+0000","last_fullsized":"2023-11-04T01:42:03.960719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.963624+0000","last_change":"2023-11-04T01:42:04.963624+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.963624+0000","last_undegraded":"2023-11-04T01:42:04.963624+0000","last_fullsized":"2023-11-04T01:42:04.963624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997165+0000","last_change":"2023-11-04T01:42:04.994894+0000","last_active":"2023-11-04T01:42:04.997165+0000","last_peered":"2023-11-04T01:42:04.997165+0000","last_clean":"2023-11-04T01:42:04.997165+0000","last_became_active":"2023-11-04T01:42:04.994554+0000","last_became_peered":"2023-11-04T01:42:04.994554+0000","last_unstale":"2023-11-04T01:42:04.997165+0000","last_undegraded":"2023-11-04T01:42:04.997165+0000","last_fullsized":"2023-11-04T01:42:04.997165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956751+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:03.956751+0000","last_peered":"2023-11-04T01:42:03.956751+0000","last_clean":"2023-11-04T01:42:03.956751+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:03.956751+0000","last_undegraded":"2023-11-04T01:42:03.956751+0000","last_fullsized":"2023-11-04T01:42:03.956751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960699+0000","last_change":"2023-11-04T01:42:04.960699+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960699+0000","last_undegraded":"2023-11-04T01:42:04.960699+0000","last_fullsized":"2023-11-04T01:42:04.960699+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004643+0000","last_change":"2023-11-04T01:42:05.000316+0000","last_active":"2023-11-04T01:42:05.004643+0000","last_peered":"2023-11-04T01:42:05.004643+0000","last_clean":"2023-11-04T01:42:05.004643+0000","last_became_active":"2023-11-04T01:42:04.999528+0000","last_became_peered":"2023-11-04T01:42:04.999528+0000","last_unstale":"2023-11-04T01:42:05.004643+0000","last_undegraded":"2023-11-04T01:42:05.004643+0000","last_fullsized":"2023-11-04T01:42:05.004643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.967084+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:03.967084+0000","last_peered":"2023-11-04T01:42:03.967084+0000","last_clean":"2023-11-04T01:42:03.967084+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:03.967084+0000","last_undegraded":"2023-11-04T01:42:03.967084+0000","last_fullsized":"2023-11-04T01:42:03.967084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967082+0000","last_change":"2023-11-04T01:42:04.967082+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967082+0000","last_undegraded":"2023-11-04T01:42:04.967082+0000","last_fullsized":"2023-11-04T01:42:04.967082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004122+0000","last_change":"2023-11-04T01:42:05.002909+0000","last_active":"2023-11-04T01:42:05.004122+0000","last_peered":"2023-11-04T01:42:05.004122+0000","last_clean":"2023-11-04T01:42:05.004122+0000","last_became_active":"2023-11-04T01:42:05.002124+0000","last_became_peered":"2023-11-04T01:42:05.002124+0000","last_unstale":"2023-11-04T01:42:05.004122+0000","last_undegraded":"2023-11-04T01:42:05.004122+0000","last_fullsized":"2023-11-04T01:42:05.004122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:52.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965927+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:03.965927+0000","last_peered":"2023-11-04T01:42:03.965927+0000","last_clean":"2023-11-04T01:42:03.965927+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:03.965927+0000","last_undegraded":"2023-11-04T01:42:03.965927+0000","last_fullsized":"2023-11-04T01:42:03.965927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.977926+0000","last_change":"2023-11-04T01:42:04.977926+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.977926+0000","last_undegraded":"2023-11-04T01:42:04.977926+0000","last_fullsized":"2023-11-04T01:42:04.977926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.982259+0000","last_change":"2023-11-04T01:42:04.980535+0000","last_active":"2023-11-04T01:42:04.982259+0000","last_peered":"2023-11-04T01:42:04.982259+0000","last_clean":"2023-11-04T01:42:04.982259+0000","last_became_active":"2023-11-04T01:42:04.980311+0000","last_became_peered":"2023-11-04T01:42:04.980311+0000","last_unstale":"2023-11-04T01:42:04.982259+0000","last_undegraded":"2023-11-04T01:42:04.982259+0000","last_fullsized":"2023-11-04T01:42:04.982259+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.961031+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:03.961031+0000","last_peered":"2023-11-04T01:42:03.961031+0000","last_clean":"2023-11-04T01:42:03.961031+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:03.961031+0000","last_undegraded":"2023-11-04T01:42:03.961031+0000","last_fullsized":"2023-11-04T01:42:03.961031+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965667+0000","last_change":"2023-11-04T01:42:04.965667+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965667+0000","last_undegraded":"2023-11-04T01:42:04.965667+0000","last_fullsized":"2023-11-04T01:42:04.965667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012538+0000","last_change":"2023-11-04T01:42:05.010609+0000","last_active":"2023-11-04T01:42:05.012538+0000","last_peered":"2023-11-04T01:42:05.012538+0000","last_clean":"2023-11-04T01:42:05.012538+0000","last_became_active":"2023-11-04T01:42:05.009776+0000","last_became_peered":"2023-11-04T01:42:05.009776+0000","last_unstale":"2023-11-04T01:42:05.012538+0000","last_undegraded":"2023-11-04T01:42:05.012538+0000","last_fullsized":"2023-11-04T01:42:05.012538+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:29.902914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965033+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:03.965033+0000","last_peered":"2023-11-04T01:42:03.965033+0000","last_clean":"2023-11-04T01:42:03.965033+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:03.965033+0000","last_undegraded":"2023-11-04T01:42:03.965033+0000","last_fullsized":"2023-11-04T01:42:03.965033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.970106+0000","last_change":"2023-11-04T01:42:04.970106+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.970106+0000","last_undegraded":"2023-11-04T01:42:04.970106+0000","last_fullsized":"2023-11-04T01:42:04.970106+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.009032+0000","last_change":"2023-11-04T01:42:04.999767+0000","last_active":"2023-11-04T01:42:05.009032+0000","last_peered":"2023-11-04T01:42:05.009032+0000","last_clean":"2023-11-04T01:42:05.009032+0000","last_became_active":"2023-11-04T01:42:04.998886+0000","last_became_peered":"2023-11-04T01:42:04.998886+0000","last_unstale":"2023-11-04T01:42:05.009032+0000","last_undegraded":"2023-11-04T01:42:05.009032+0000","last_fullsized":"2023-11-04T01:42:05.009032+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:01.390661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949319+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:03.949319+0000","last_peered":"2023-11-04T01:42:03.949319+0000","last_clean":"2023-11-04T01:42:03.949319+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:03.949319+0000","last_undegraded":"2023-11-04T01:42:03.949319+0000","last_fullsized":"2023-11-04T01:42:03.949319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965420+0000","last_change":"2023-11-04T01:42:04.965420+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965420+0000","last_undegraded":"2023-11-04T01:42:04.965420+0000","last_fullsized":"2023-11-04T01:42:04.965420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997637+0000","last_change":"2023-11-04T01:42:04.995797+0000","last_active":"2023-11-04T01:42:04.997637+0000","last_peered":"2023-11-04T01:42:04.997637+0000","last_clean":"2023-11-04T01:42:04.997637+0000","last_became_active":"2023-11-04T01:42:04.995421+0000","last_became_peered":"2023-11-04T01:42:04.995421+0000","last_unstale":"2023-11-04T01:42:04.997637+0000","last_undegraded":"2023-11-04T01:42:04.997637+0000","last_fullsized":"2023-11-04T01:42:04.997637+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:58.765673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959054+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:03.959054+0000","last_peered":"2023-11-04T01:42:03.959054+0000","last_clean":"2023-11-04T01:42:03.959054+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:03.959054+0000","last_undegraded":"2023-11-04T01:42:03.959054+0000","last_fullsized":"2023-11-04T01:42:03.959054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.969628+0000","last_change":"2023-11-04T01:42:04.969628+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.969628+0000","last_undegraded":"2023-11-04T01:42:04.969628+0000","last_fullsized":"2023-11-04T01:42:04.969628+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.996668+0000","last_change":"2023-11-04T01:42:04.995419+0000","last_active":"2023-11-04T01:42:04.996668+0000","last_peered":"2023-11-04T01:42:04.996668+0000","last_clean":"2023-11-04T01:42:04.996668+0000","last_became_active":"2023-11-04T01:42:04.995091+0000","last_became_peered":"2023-11-04T01:42:04.995091+0000","last_unstale":"2023-11-04T01:42:04.996668+0000","last_undegraded":"2023-11-04T01:42:04.996668+0000","last_fullsized":"2023-11-04T01:42:04.996668+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:41.938181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962392+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:03.962392+0000","last_peered":"2023-11-04T01:42:03.962392+0000","last_clean":"2023-11-04T01:42:03.962392+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:03.962392+0000","last_undegraded":"2023-11-04T01:42:03.962392+0000","last_fullsized":"2023-11-04T01:42:03.962392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979780+0000","last_change":"2023-11-04T01:42:04.979780+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979780+0000","last_undegraded":"2023-11-04T01:42:04.979780+0000","last_fullsized":"2023-11-04T01:42:04.979780+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013286+0000","last_change":"2023-11-04T01:42:05.007381+0000","last_active":"2023-11-04T01:42:05.013286+0000","last_peered":"2023-11-04T01:42:05.013286+0000","last_clean":"2023-11-04T01:42:05.013286+0000","last_became_active":"2023-11-04T01:42:05.006783+0000","last_became_peered":"2023-11-04T01:42:05.006783+0000","last_unstale":"2023-11-04T01:42:05.013286+0000","last_undegraded":"2023-11-04T01:42:05.013286+0000","last_fullsized":"2023-11-04T01:42:05.013286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:29.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960774+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:03.960774+0000","last_peered":"2023-11-04T01:42:03.960774+0000","last_clean":"2023-11-04T01:42:03.960774+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:03.960774+0000","last_undegraded":"2023-11-04T01:42:03.960774+0000","last_fullsized":"2023-11-04T01:42:03.960774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959872+0000","last_change":"2023-11-04T01:42:04.959872+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959872+0000","last_undegraded":"2023-11-04T01:42:04.959872+0000","last_fullsized":"2023-11-04T01:42:04.959872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.976478+0000","last_change":"2023-11-04T01:42:04.974191+0000","last_active":"2023-11-04T01:42:04.976478+0000","last_peered":"2023-11-04T01:42:04.976478+0000","last_clean":"2023-11-04T01:42:04.976478+0000","last_became_active":"2023-11-04T01:42:04.973849+0000","last_became_peered":"2023-11-04T01:42:04.973849+0000","last_unstale":"2023-11-04T01:42:04.976478+0000","last_undegraded":"2023-11-04T01:42:04.976478+0000","last_fullsized":"2023-11-04T01:42:04.976478+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.692976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.965551+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:03.965551+0000","last_peered":"2023-11-04T01:42:03.965551+0000","last_clean":"2023-11-04T01:42:03.965551+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:03.965551+0000","last_undegraded":"2023-11-04T01:42:03.965551+0000","last_fullsized":"2023-11-04T01:42:03.965551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.967061+0000","last_change":"2023-11-04T01:42:04.967061+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.967061+0000","last_undegraded":"2023-11-04T01:42:04.967061+0000","last_fullsized":"2023-11-04T01:42:04.967061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004108+0000","last_change":"2023-11-04T01:42:05.002890+0000","last_active":"2023-11-04T01:42:05.004108+0000","last_peered":"2023-11-04T01:42:05.004108+0000","last_clean":"2023-11-04T01:42:05.004108+0000","last_became_active":"2023-11-04T01:42:05.002136+0000","last_became_peered":"2023-11-04T01:42:05.002136+0000","last_unstale":"2023-11-04T01:42:05.004108+0000","last_undegraded":"2023-11-04T01:42:05.004108+0000","last_fullsized":"2023-11-04T01:42:05.004108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:53.284018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966872+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:03.966872+0000","last_peered":"2023-11-04T01:42:03.966872+0000","last_clean":"2023-11-04T01:42:03.966872+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:03.966872+0000","last_undegraded":"2023-11-04T01:42:03.966872+0000","last_fullsized":"2023-11-04T01:42:03.966872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.988515+0000","last_change":"2023-11-04T01:42:04.988515+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.988515+0000","last_undegraded":"2023-11-04T01:42:04.988515+0000","last_fullsized":"2023-11-04T01:42:04.988515+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.980369+0000","last_change":"2023-11-04T01:42:04.977260+0000","last_active":"2023-11-04T01:42:04.980369+0000","last_peered":"2023-11-04T01:42:04.980369+0000","last_clean":"2023-11-04T01:42:04.980369+0000","last_became_active":"2023-11-04T01:42:04.976923+0000","last_became_peered":"2023-11-04T01:42:04.976923+0000","last_unstale":"2023-11-04T01:42:04.980369+0000","last_undegraded":"2023-11-04T01:42:04.980369+0000","last_fullsized":"2023-11-04T01:42:04.980369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:16.997158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960957+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:03.960957+0000","last_peered":"2023-11-04T01:42:03.960957+0000","last_clean":"2023-11-04T01:42:03.960957+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:03.960957+0000","last_undegraded":"2023-11-04T01:42:03.960957+0000","last_fullsized":"2023-11-04T01:42:03.960957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.978615+0000","last_change":"2023-11-04T01:42:04.978615+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.978615+0000","last_undegraded":"2023-11-04T01:42:04.978615+0000","last_fullsized":"2023-11-04T01:42:04.978615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.990277+0000","last_change":"2023-11-04T01:42:04.989338+0000","last_active":"2023-11-04T01:42:04.990277+0000","last_peered":"2023-11-04T01:42:04.990277+0000","last_clean":"2023-11-04T01:42:04.990277+0000","last_became_active":"2023-11-04T01:42:04.988983+0000","last_became_peered":"2023-11-04T01:42:04.988983+0000","last_unstale":"2023-11-04T01:42:04.990277+0000","last_undegraded":"2023-11-04T01:42:04.990277+0000","last_fullsized":"2023-11-04T01:42:04.990277+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:56.213941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949185+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:03.949185+0000","last_peered":"2023-11-04T01:42:03.949185+0000","last_clean":"2023-11-04T01:42:03.949185+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:03.949185+0000","last_undegraded":"2023-11-04T01:42:03.949185+0000","last_fullsized":"2023-11-04T01:42:03.949185+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.959932+0000","last_change":"2023-11-04T01:42:04.959932+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.959932+0000","last_undegraded":"2023-11-04T01:42:04.959932+0000","last_fullsized":"2023-11-04T01:42:04.959932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012445+0000","last_change":"2023-11-04T01:42:05.006675+0000","last_active":"2023-11-04T01:42:05.012445+0000","last_peered":"2023-11-04T01:42:05.012445+0000","last_clean":"2023-11-04T01:42:05.012445+0000","last_became_active":"2023-11-04T01:42:05.006360+0000","last_became_peered":"2023-11-04T01:42:05.006360+0000","last_unstale":"2023-11-04T01:42:05.012445+0000","last_undegraded":"2023-11-04T01:42:05.012445+0000","last_fullsized":"2023-11-04T01:42:05.012445+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:04.101815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960594+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:03.960594+0000","last_peered":"2023-11-04T01:42:03.960594+0000","last_clean":"2023-11-04T01:42:03.960594+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:03.960594+0000","last_undegraded":"2023-11-04T01:42:03.960594+0000","last_fullsized":"2023-11-04T01:42:03.960594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.980514+0000","last_change":"2023-11-04T01:42:04.980514+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.980514+0000","last_undegraded":"2023-11-04T01:42:04.980514+0000","last_fullsized":"2023-11-04T01:42:04.980514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.997662+0000","last_change":"2023-11-04T01:42:04.996167+0000","last_active":"2023-11-04T01:42:04.997662+0000","last_peered":"2023-11-04T01:42:04.997662+0000","last_clean":"2023-11-04T01:42:04.997662+0000","last_became_active":"2023-11-04T01:42:04.995600+0000","last_became_peered":"2023-11-04T01:42:04.995600+0000","last_unstale":"2023-11-04T01:42:04.997662+0000","last_undegraded":"2023-11-04T01:42:04.997662+0000","last_fullsized":"2023-11-04T01:42:04.997662+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:09:09.522884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949309+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:03.949309+0000","last_peered":"2023-11-04T01:42:03.949309+0000","last_clean":"2023-11-04T01:42:03.949309+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:03.949309+0000","last_undegraded":"2023-11-04T01:42:03.949309+0000","last_fullsized":"2023-11-04T01:42:03.949309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960654+0000","last_change":"2023-11-04T01:42:04.960654+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960654+0000","last_undegraded":"2023-11-04T01:42:04.960654+0000","last_fullsized":"2023-11-04T01:42:04.960654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.012004+0000","last_change":"2023-11-04T01:42:05.007624+0000","last_active":"2023-11-04T01:42:05.012004+0000","last_peered":"2023-11-04T01:42:05.012004+0000","last_clean":"2023-11-04T01:42:05.012004+0000","last_became_active":"2023-11-04T01:42:05.006885+0000","last_became_peered":"2023-11-04T01:42:05.006885+0000","last_unstale":"2023-11-04T01:42:05.012004+0000","last_undegraded":"2023-11-04T01:42:05.012004+0000","last_fullsized":"2023-11-04T01:42:05.012004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:38.637066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.958955+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:03.958955+0000","last_peered":"2023-11-04T01:42:03.958955+0000","last_clean":"2023-11-04T01:42:03.958955+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:03.958955+0000","last_undegraded":"2023-11-04T01:42:03.958955+0000","last_fullsized":"2023-11-04T01:42:03.958955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.968875+0000","last_change":"2023-11-04T01:42:04.968875+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.968875+0000","last_undegraded":"2023-11-04T01:42:04.968875+0000","last_fullsized":"2023-11-04T01:42:04.968875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.977461+0000","last_change":"2023-11-04T01:42:04.975673+0000","last_active":"2023-11-04T01:42:04.977461+0000","last_peered":"2023-11-04T01:42:04.977461+0000","last_clean":"2023-11-04T01:42:04.977461+0000","last_became_active":"2023-11-04T01:42:04.975387+0000","last_became_peered":"2023-11-04T01:42:04.975387+0000","last_unstale":"2023-11-04T01:42:04.977461+0000","last_undegraded":"2023-11-04T01:42:04.977461+0000","last_fullsized":"2023-11-04T01:42:04.977461+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:34.889459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.962370+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:03.962370+0000","last_peered":"2023-11-04T01:42:03.962370+0000","last_clean":"2023-11-04T01:42:03.962370+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:03.962370+0000","last_undegraded":"2023-11-04T01:42:03.962370+0000","last_fullsized":"2023-11-04T01:42:03.962370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962814+0000","last_change":"2023-11-04T01:42:04.962814+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962814+0000","last_undegraded":"2023-11-04T01:42:04.962814+0000","last_fullsized":"2023-11-04T01:42:04.962814+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.975489+0000","last_change":"2023-11-04T01:42:04.972222+0000","last_active":"2023-11-04T01:42:04.975489+0000","last_peered":"2023-11-04T01:42:04.975489+0000","last_clean":"2023-11-04T01:42:04.975489+0000","last_became_active":"2023-11-04T01:42:04.971888+0000","last_became_peered":"2023-11-04T01:42:04.971888+0000","last_unstale":"2023-11-04T01:42:04.975489+0000","last_undegraded":"2023-11-04T01:42:04.975489+0000","last_fullsized":"2023-11-04T01:42:04.975489+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:39.375558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966888+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:03.966888+0000","last_peered":"2023-11-04T01:42:03.966888+0000","last_clean":"2023-11-04T01:42:03.966888+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:03.966888+0000","last_undegraded":"2023-11-04T01:42:03.966888+0000","last_fullsized":"2023-11-04T01:42:03.966888+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.976632+0000","last_change":"2023-11-04T01:42:04.976632+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.976632+0000","last_undegraded":"2023-11-04T01:42:04.976632+0000","last_fullsized":"2023-11-04T01:42:04.976632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013275+0000","last_change":"2023-11-04T01:42:05.007348+0000","last_active":"2023-11-04T01:42:05.013275+0000","last_peered":"2023-11-04T01:42:05.013275+0000","last_clean":"2023-11-04T01:42:05.013275+0000","last_became_active":"2023-11-04T01:42:05.006661+0000","last_became_peered":"2023-11-04T01:42:05.006661+0000","last_unstale":"2023-11-04T01:42:05.013275+0000","last_undegraded":"2023-11-04T01:42:05.013275+0000","last_fullsized":"2023-11-04T01:42:05.013275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:01:12.774886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.957638+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:03.957638+0000","last_peered":"2023-11-04T01:42:03.957638+0000","last_clean":"2023-11-04T01:42:03.957638+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:03.957638+0000","last_undegraded":"2023-11-04T01:42:03.957638+0000","last_fullsized":"2023-11-04T01:42:03.957638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964445+0000","last_change":"2023-11-04T01:42:04.964445+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964445+0000","last_undegraded":"2023-11-04T01:42:04.964445+0000","last_fullsized":"2023-11-04T01:42:04.964445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984367+0000","last_change":"2023-11-04T01:42:04.983369+0000","last_active":"2023-11-04T01:42:04.984367+0000","last_peered":"2023-11-04T01:42:04.984367+0000","last_clean":"2023-11-04T01:42:04.984367+0000","last_became_active":"2023-11-04T01:42:04.983083+0000","last_became_peered":"2023-11-04T01:42:04.983083+0000","last_unstale":"2023-11-04T01:42:04.984367+0000","last_undegraded":"2023-11-04T01:42:04.984367+0000","last_fullsized":"2023-11-04T01:42:04.984367+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960886+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:03.960886+0000","last_peered":"2023-11-04T01:42:03.960886+0000","last_clean":"2023-11-04T01:42:03.960886+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:03.960886+0000","last_undegraded":"2023-11-04T01:42:03.960886+0000","last_fullsized":"2023-11-04T01:42:03.960886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965988+0000","last_change":"2023-11-04T01:42:04.965988+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965988+0000","last_undegraded":"2023-11-04T01:42:04.965988+0000","last_fullsized":"2023-11-04T01:42:04.965988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015151+0000","last_change":"2023-11-04T01:42:05.011704+0000","last_active":"2023-11-04T01:42:05.015151+0000","last_peered":"2023-11-04T01:42:05.015151+0000","last_clean":"2023-11-04T01:42:05.015151+0000","last_became_active":"2023-11-04T01:42:05.010990+0000","last_became_peered":"2023-11-04T01:42:05.010990+0000","last_unstale":"2023-11-04T01:42:05.015151+0000","last_undegraded":"2023-11-04T01:42:05.015151+0000","last_fullsized":"2023-11-04T01:42:05.015151+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:38.042581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.949162+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:03.949162+0000","last_peered":"2023-11-04T01:42:03.949162+0000","last_clean":"2023-11-04T01:42:03.949162+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:03.949162+0000","last_undegraded":"2023-11-04T01:42:03.949162+0000","last_fullsized":"2023-11-04T01:42:03.949162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.960929+0000","last_change":"2023-11-04T01:42:04.960929+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.960929+0000","last_undegraded":"2023-11-04T01:42:04.960929+0000","last_fullsized":"2023-11-04T01:42:04.960929+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:04.984339+0000","last_change":"2023-11-04T01:42:04.978969+0000","last_active":"2023-11-04T01:42:04.984339+0000","last_peered":"2023-11-04T01:42:04.984339+0000","last_clean":"2023-11-04T01:42:04.984339+0000","last_became_active":"2023-11-04T01:42:04.978240+0000","last_became_peered":"2023-11-04T01:42:04.978240+0000","last_unstale":"2023-11-04T01:42:04.984339+0000","last_undegraded":"2023-11-04T01:42:04.984339+0000","last_fullsized":"2023-11-04T01:42:04.984339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:20.145051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.964938+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:03.964938+0000","last_peered":"2023-11-04T01:42:03.964938+0000","last_clean":"2023-11-04T01:42:03.964938+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:03.964938+0000","last_undegraded":"2023-11-04T01:42:03.964938+0000","last_fullsized":"2023-11-04T01:42:03.964938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.979351+0000","last_change":"2023-11-04T01:42:04.979351+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.979351+0000","last_undegraded":"2023-11-04T01:42:04.979351+0000","last_fullsized":"2023-11-04T01:42:04.979351+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.013341+0000","last_change":"2023-11-04T01:42:05.007818+0000","last_active":"2023-11-04T01:42:05.013341+0000","last_peered":"2023-11-04T01:42:05.013341+0000","last_clean":"2023-11-04T01:42:05.013341+0000","last_became_active":"2023-11-04T01:42:05.006963+0000","last_became_peered":"2023-11-04T01:42:05.006963+0000","last_unstale":"2023-11-04T01:42:05.013341+0000","last_undegraded":"2023-11-04T01:42:05.013341+0000","last_fullsized":"2023-11-04T01:42:05.013341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:38.168718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":37,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.959078+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:03.959078+0000","last_peered":"2023-11-04T01:42:03.959078+0000","last_clean":"2023-11-04T01:42:03.959078+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:03.959078+0000","last_undegraded":"2023-11-04T01:42:03.959078+0000","last_fullsized":"2023-11-04T01:42:03.959078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.962838+0000","last_change":"2023-11-04T01:42:04.962838+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.962838+0000","last_undegraded":"2023-11-04T01:42:04.962838+0000","last_fullsized":"2023-11-04T01:42:04.962838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.005558+0000","last_change":"2023-11-04T01:42:05.001976+0000","last_active":"2023-11-04T01:42:05.005558+0000","last_peered":"2023-11-04T01:42:05.005558+0000","last_clean":"2023-11-04T01:42:05.005558+0000","last_became_active":"2023-11-04T01:42:05.001247+0000","last_became_peered":"2023-11-04T01:42:05.001247+0000","last_unstale":"2023-11-04T01:42:05.005558+0000","last_undegraded":"2023-11-04T01:42:05.005558+0000","last_fullsized":"2023-11-04T01:42:05.005558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:20.498259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.960813+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:03.960813+0000","last_peered":"2023-11-04T01:42:03.960813+0000","last_clean":"2023-11-04T01:42:03.960813+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:03.960813+0000","last_undegraded":"2023-11-04T01:42:03.960813+0000","last_fullsized":"2023-11-04T01:42:03.960813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.964373+0000","last_change":"2023-11-04T01:42:04.964373+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.964373+0000","last_undegraded":"2023-11-04T01:42:04.964373+0000","last_fullsized":"2023-11-04T01:42:04.964373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.015020+0000","last_change":"2023-11-04T01:42:05.010393+0000","last_active":"2023-11-04T01:42:05.015020+0000","last_peered":"2023-11-04T01:42:05.015020+0000","last_clean":"2023-11-04T01:42:05.015020+0000","last_became_active":"2023-11-04T01:42:05.009748+0000","last_became_peered":"2023-11-04T01:42:05.009748+0000","last_unstale":"2023-11-04T01:42:05.015020+0000","last_undegraded":"2023-11-04T01:42:05.015020+0000","last_fullsized":"2023-11-04T01:42:05.015020+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:52.103809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.966597+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:03.966597+0000","last_peered":"2023-11-04T01:42:03.966597+0000","last_clean":"2023-11-04T01:42:03.966597+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:03.966597+0000","last_undegraded":"2023-11-04T01:42:03.966597+0000","last_fullsized":"2023-11-04T01:42:03.966597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2023-11-04T01:42:04.965842+0000","last_change":"2023-11-04T01:42:04.965842+0000","last_active":"2023-11-04T01:42:04.945280+0000","last_peered":"2023-11-04T01:42:04.945280+0000","last_clean":"2023-11-04T01:42:04.945280+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:04.965842+0000","last_undegraded":"2023-11-04T01:42:04.965842+0000","last_fullsized":"2023-11-04T01:42:04.965842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.004590+0000","last_change":"2023-11-04T01:42:05.000198+0000","last_active":"2023-11-04T01:42:05.004590+0000","last_peered":"2023-11-04T01:42:05.004590+0000","last_clean":"2023-11-04T01:42:05.004590+0000","last_became_active":"2023-11-04T01:42:04.999551+0000","last_became_peered":"2023-11-04T01:42:04.999551+0000","last_unstale":"2023-11-04T01:42:05.004590+0000","last_undegraded":"2023-11-04T01:42:05.004590+0000","last_fullsized":"2023-11-04T01:42:05.004590+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:34.807369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":38,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-04T01:42:03.956841+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:03.956841+0000","last_peered":"2023-11-04T01:42:03.956841+0000","last_clean":"2023-11-04T01:42:03.956841+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:03.956841+0000","last_undegraded":"2023-11-04T01:42:03.956841+0000","last_fullsized":"2023-11-04T01:42:03.956841+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1302528,"data_stored":896392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":29.603000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.462},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":8.1280000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":2.6389999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":25.791}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":3.98},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":25.696999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":11.064},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":4.1630000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.581},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":4.0730000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.92000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":1.048},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.748}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.006}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.133},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.139},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.2}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.089},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.4910000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98499999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":1.4159999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.383},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.155},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.089}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":312644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.753},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":1.0329999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.103}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":1.21}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":1.163}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.28},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":1.0860000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.329},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":708608,"data_stored":306024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.747}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.622}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.93999999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91200000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":903012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.80400000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":0.82699999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.052},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:10.924 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:42:10.922+0000 7efd2d190640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:13.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:13.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.690+0000 7fb29a862640 1 Processor -- start 2023-11-04T01:42:13.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.690+0000 7fb29a862640 1 -- start start 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb29a862640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2940b0630 0x7fb2940b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb29a862640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb29415dc50 0x7fb29415e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb29a862640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29406cfd0 con 0x7fb294159fc0 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb29a862640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940ca030 con 0x7fb2940b0630 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb29a862640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940b1000 con 0x7fb29415dc50 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb2937fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2940b0630 0x7fb2940b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb293fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb294159fc0 0x7fb2940ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43834/0 (socket says 172.21.15.40:43834) 2023-11-04T01:42:13.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb293fff640 1 -- 172.21.15.40:0/3066099587 learned_addr learned my addr 172.21.15.40:0/3066099587 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:13.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb298dff640 1 --2- 172.21.15.40:0/3066099587 >> v2:172.21.15.91:3300/0 conn(0x7fb29415dc50 0x7fb29415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb2937fe640 1 -- 172.21.15.40:0/3066099587 >> v2:172.21.15.91:3300/0 conn(0x7fb29415dc50 msgr2=0x7fb29415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:13.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb2937fe640 1 --2- 172.21.15.40:0/3066099587 >> v2:172.21.15.91:3300/0 conn(0x7fb29415dc50 0x7fb29415e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb2937fe640 1 -- 172.21.15.40:0/3066099587 >> v1:172.21.15.40:6789/0 conn(0x7fb294159fc0 legacy=0x7fb2940ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb292ffd640 1 -- 172.21.15.40:0/3066099587 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854012528 0 0) 0x7fb29406cfd0 con 0x7fb294159fc0 2023-11-04T01:42:13.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.694+0000 7fb2937fe640 1 -- 172.21.15.40:0/3066099587 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29415e5a0 con 0x7fb2940b0630 2023-11-04T01:42:13.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb2937fe640 1 --2- 172.21.15.40:0/3066099587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb2940b0ac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb2940c9100 tx=0x7fb27c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118d6ae0f0925bb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb292ffd640 1 -- 172.21.15.40:0/3066099587 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0a59a0 con 0x7fb2940b0630 2023-11-04T01:42:13.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb292ffd640 1 -- 172.21.15.40:0/3066099587 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c0a5b00 con 0x7fb2940b0630 2023-11-04T01:42:13.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb292ffd640 1 -- 172.21.15.40:0/3066099587 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0a5e90 con 0x7fb2940b0630 2023-11-04T01:42:13.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- 172.21.15.40:0/3066099587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 msgr2=0x7fb2940b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 --2- 172.21.15.40:0/3066099587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb2940b0ac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb2940c9100 tx=0x7fb27c01c8e0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- 172.21.15.40:0/3066099587 shutdown_connections 2023-11-04T01:42:13.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 --2- 172.21.15.40:0/3066099587 >> v2:172.21.15.91:3300/0 conn(0x7fb29415dc50 0x7fb29415e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 --2- 172.21.15.40:0/3066099587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb2940b0ac0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- 172.21.15.40:0/3066099587 >> 172.21.15.40:0/3066099587 conn(0x7fb2940cebb0 msgr2=0x7fb2940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:13.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- 172.21.15.40:0/3066099587 shutdown_connections 2023-11-04T01:42:13.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- 172.21.15.40:0/3066099587 wait complete. 2023-11-04T01:42:13.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 Processor -- start 2023-11-04T01:42:13.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- start start 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb294149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb294159fc0 0x7fb29414a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb29415dc50 0x7fb2941564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29415b440 con 0x7fb2940b0630 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29415b6e0 con 0x7fb29415dc50 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb29a862640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29415b9c0 con 0x7fb294159fc0 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb293fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb294149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb293fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb294149850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57318/0 (socket says 172.21.15.40:57318) 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb293fff640 1 -- 172.21.15.40:0/2143792743 learned_addr learned my addr 172.21.15.40:0/2143792743 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:13.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.698+0000 7fb298dff640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb29415dc50 0x7fb2941564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb2937fe640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb294159fc0 0x7fb29414a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb293fff640 1 -- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb294159fc0 msgr2=0x7fb29414a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb293fff640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb294159fc0 0x7fb29414a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb293fff640 1 -- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb29415dc50 msgr2=0x7fb2941564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb293fff640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb29415dc50 0x7fb2941564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb293fff640 1 -- 172.21.15.40:0/2143792743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c009a70 con 0x7fb2940b0630 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb298dff640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb29415dc50 0x7fb2941564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb2937fe640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb294159fc0 0x7fb29414a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb293fff640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb294149850 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c480 tx=0x7fb28400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2840074e0 con 0x7fb2940b0630 2023-11-04T01:42:13.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284007660 con 0x7fb2940b0630 2023-11-04T01:42:13.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29415bca0 con 0x7fb2940b0630 2023-11-04T01:42:13.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284004a30 con 0x7fb2940b0630 2023-11-04T01:42:13.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29415c4a0 con 0x7fb2940b0630 2023-11-04T01:42:13.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2940744a0 con 0x7fb2940b0630 2023-11-04T01:42:13.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb284004b90 con 0x7fb2940b0630 2023-11-04T01:42:13.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb290ff9640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2740664a0 0x7fb274068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2840834a0 con 0x7fb2940b0630 2023-11-04T01:42:13.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb2937fe640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2740664a0 0x7fb274068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.702+0000 7fb2937fe640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2740664a0 0x7fb274068960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0af000 tx=0x7fb27c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.706+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2840542e0 con 0x7fb2940b0630 2023-11-04T01:42:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.858+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2940c9c50 con 0x7fb2740664a0 2023-11-04T01:42:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.890+0000 7fb290ff9640 1 -- 172.21.15.40:0/2143792743 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368763 (secure 0 0 0) 0x7fb27c0ad4c0 con 0x7fb2740664a0 2023-11-04T01:42:13.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2740664a0 msgr2=0x7fb274068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2740664a0 0x7fb274068960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0af000 tx=0x7fb27c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 msgr2=0x7fb294149850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb294149850 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb28400c480 tx=0x7fb28400c940 comp rx=0 tx=0).stop 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 shutdown_connections 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2740664a0 0x7fb274068960 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb29415dc50 0x7fb2941564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb294159fc0 0x7fb29414a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 --2- 172.21.15.40:0/2143792743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2940b0630 0x7fb294149850 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 >> 172.21.15.40:0/2143792743 conn(0x7fb2940cebb0 msgr2=0x7fb294153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 shutdown_connections 2023-11-04T01:42:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:13.894+0000 7fb29a862640 1 -- 172.21.15.40:0/2143792743 wait complete. 2023-11-04T01:42:13.917 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-11-04T01:42:13.798112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":247,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235696,"kb_used_data":7048,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739024,"statfs":{"total":773094113280,"available":772852760576,"internally_reserved":0,"allocated":7217152,"data_stored":3796956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":90,"apply_latency_ms":90,"commit_latency_ns":90000000,"apply_latency_ns":90000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003852"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.017448+0000","last_change":"2023-11-04T01:42:06.039450+0000","last_active":"2023-11-04T01:42:07.017448+0000","last_peered":"2023-11-04T01:42:07.017448+0000","last_clean":"2023-11-04T01:42:07.017448+0000","last_became_active":"2023-11-04T01:42:06.039148+0000","last_became_peered":"2023-11-04T01:42:06.039148+0000","last_unstale":"2023-11-04T01:42:07.017448+0000","last_undegraded":"2023-11-04T01:42:07.017448+0000","last_fullsized":"2023-11-04T01:42:07.017448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:09.326746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.017298+0000","last_change":"2023-11-04T01:42:06.034653+0000","last_active":"2023-11-04T01:42:07.017298+0000","last_peered":"2023-11-04T01:42:07.017298+0000","last_clean":"2023-11-04T01:42:07.017298+0000","last_became_active":"2023-11-04T01:42:06.034255+0000","last_became_peered":"2023-11-04T01:42:06.034255+0000","last_unstale":"2023-11-04T01:42:07.017298+0000","last_undegraded":"2023-11-04T01:42:07.017298+0000","last_fullsized":"2023-11-04T01:42:07.017298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:30.351051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.027679+0000","last_change":"2023-11-04T01:42:06.064697+0000","last_active":"2023-11-04T01:42:07.027679+0000","last_peered":"2023-11-04T01:42:07.027679+0000","last_clean":"2023-11-04T01:42:07.027679+0000","last_became_active":"2023-11-04T01:42:06.064232+0000","last_became_peered":"2023-11-04T01:42:06.064232+0000","last_unstale":"2023-11-04T01:42:07.027679+0000","last_undegraded":"2023-11-04T01:42:07.027679+0000","last_fullsized":"2023-11-04T01:42:07.027679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:40.387140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269504+0000","last_change":"2023-11-04T01:42:06.027749+0000","last_active":"2023-11-04T01:42:07.269504+0000","last_peered":"2023-11-04T01:42:07.269504+0000","last_clean":"2023-11-04T01:42:07.269504+0000","last_became_active":"2023-11-04T01:42:06.026985+0000","last_became_peered":"2023-11-04T01:42:06.026985+0000","last_unstale":"2023-11-04T01:42:07.269504+0000","last_undegraded":"2023-11-04T01:42:07.269504+0000","last_fullsized":"2023-11-04T01:42:07.269504+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:27:07.165920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020909+0000","last_change":"2023-11-04T01:42:06.041999+0000","last_active":"2023-11-04T01:42:07.020909+0000","last_peered":"2023-11-04T01:42:07.020909+0000","last_clean":"2023-11-04T01:42:07.020909+0000","last_became_active":"2023-11-04T01:42:06.041512+0000","last_became_peered":"2023-11-04T01:42:06.041512+0000","last_unstale":"2023-11-04T01:42:07.020909+0000","last_undegraded":"2023-11-04T01:42:07.020909+0000","last_fullsized":"2023-11-04T01:42:07.020909+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:17:57.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.268627+0000","last_change":"2023-11-04T01:42:06.057224+0000","last_active":"2023-11-04T01:42:07.268627+0000","last_peered":"2023-11-04T01:42:07.268627+0000","last_clean":"2023-11-04T01:42:07.268627+0000","last_became_active":"2023-11-04T01:42:06.056896+0000","last_became_peered":"2023-11-04T01:42:06.056896+0000","last_unstale":"2023-11-04T01:42:07.268627+0000","last_undegraded":"2023-11-04T01:42:07.268627+0000","last_fullsized":"2023-11-04T01:42:07.268627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:18.615813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021347+0000","last_change":"2023-11-04T01:42:06.056346+0000","last_active":"2023-11-04T01:42:07.021347+0000","last_peered":"2023-11-04T01:42:07.021347+0000","last_clean":"2023-11-04T01:42:07.021347+0000","last_became_active":"2023-11-04T01:42:06.056082+0000","last_became_peered":"2023-11-04T01:42:06.056082+0000","last_unstale":"2023-11-04T01:42:07.021347+0000","last_undegraded":"2023-11-04T01:42:07.021347+0000","last_fullsized":"2023-11-04T01:42:07.021347+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:56:09.654805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.019103+0000","last_change":"2023-11-04T01:42:06.058663+0000","last_active":"2023-11-04T01:42:07.019103+0000","last_peered":"2023-11-04T01:42:07.019103+0000","last_clean":"2023-11-04T01:42:07.019103+0000","last_became_active":"2023-11-04T01:42:06.058134+0000","last_became_peered":"2023-11-04T01:42:06.058134+0000","last_unstale":"2023-11-04T01:42:07.019103+0000","last_undegraded":"2023-11-04T01:42:07.019103+0000","last_fullsized":"2023-11-04T01:42:07.019103+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:04.266398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.028214+0000","last_change":"2023-11-04T01:42:06.062240+0000","last_active":"2023-11-04T01:42:07.028214+0000","last_peered":"2023-11-04T01:42:07.028214+0000","last_clean":"2023-11-04T01:42:07.028214+0000","last_became_active":"2023-11-04T01:42:06.061339+0000","last_became_peered":"2023-11-04T01:42:06.061339+0000","last_unstale":"2023-11-04T01:42:07.028214+0000","last_undegraded":"2023-11-04T01:42:07.028214+0000","last_fullsized":"2023-11-04T01:42:07.028214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:24:49.228350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.027778+0000","last_change":"2023-11-04T01:42:06.060630+0000","last_active":"2023-11-04T01:42:07.027778+0000","last_peered":"2023-11-04T01:42:07.027778+0000","last_clean":"2023-11-04T01:42:07.027778+0000","last_became_active":"2023-11-04T01:42:06.060239+0000","last_became_peered":"2023-11-04T01:42:06.060239+0000","last_unstale":"2023-11-04T01:42:07.027778+0000","last_undegraded":"2023-11-04T01:42:07.027778+0000","last_fullsized":"2023-11-04T01:42:07.027778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:59.777255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269186+0000","last_change":"2023-11-04T01:42:06.010464+0000","last_active":"2023-11-04T01:42:07.269186+0000","last_peered":"2023-11-04T01:42:07.269186+0000","last_clean":"2023-11-04T01:42:07.269186+0000","last_became_active":"2023-11-04T01:42:06.009676+0000","last_became_peered":"2023-11-04T01:42:06.009676+0000","last_unstale":"2023-11-04T01:42:07.269186+0000","last_undegraded":"2023-11-04T01:42:07.269186+0000","last_fullsized":"2023-11-04T01:42:07.269186+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:03.803381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020110+0000","last_change":"2023-11-04T01:42:06.046900+0000","last_active":"2023-11-04T01:42:07.020110+0000","last_peered":"2023-11-04T01:42:07.020110+0000","last_clean":"2023-11-04T01:42:07.020110+0000","last_became_active":"2023-11-04T01:42:06.046455+0000","last_became_peered":"2023-11-04T01:42:06.046455+0000","last_unstale":"2023-11-04T01:42:07.020110+0000","last_undegraded":"2023-11-04T01:42:07.020110+0000","last_fullsized":"2023-11-04T01:42:07.020110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:54.295600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.019364+0000","last_change":"2023-11-04T01:42:06.005976+0000","last_active":"2023-11-04T01:42:07.019364+0000","last_peered":"2023-11-04T01:42:07.019364+0000","last_clean":"2023-11-04T01:42:07.019364+0000","last_became_active":"2023-11-04T01:42:06.005210+0000","last_became_peered":"2023-11-04T01:42:06.005210+0000","last_unstale":"2023-11-04T01:42:07.019364+0000","last_undegraded":"2023-11-04T01:42:07.019364+0000","last_fullsized":"2023-11-04T01:42:07.019364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:40.004276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.027083+0000","last_change":"2023-11-04T01:42:06.058344+0000","last_active":"2023-11-04T01:42:07.027083+0000","last_peered":"2023-11-04T01:42:07.027083+0000","last_clean":"2023-11-04T01:42:07.027083+0000","last_became_active":"2023-11-04T01:42:06.057114+0000","last_became_peered":"2023-11-04T01:42:06.057114+0000","last_unstale":"2023-11-04T01:42:07.027083+0000","last_undegraded":"2023-11-04T01:42:07.027083+0000","last_fullsized":"2023-11-04T01:42:07.027083+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:34.980048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.026783+0000","last_change":"2023-11-04T01:42:06.058238+0000","last_active":"2023-11-04T01:42:07.026783+0000","last_peered":"2023-11-04T01:42:07.026783+0000","last_clean":"2023-11-04T01:42:07.026783+0000","last_became_active":"2023-11-04T01:42:06.057735+0000","last_became_peered":"2023-11-04T01:42:06.057735+0000","last_unstale":"2023-11-04T01:42:07.026783+0000","last_undegraded":"2023-11-04T01:42:07.026783+0000","last_fullsized":"2023-11-04T01:42:07.026783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:17.780386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021445+0000","last_change":"2023-11-04T01:42:06.012264+0000","last_active":"2023-11-04T01:42:07.021445+0000","last_peered":"2023-11-04T01:42:07.021445+0000","last_clean":"2023-11-04T01:42:07.021445+0000","last_became_active":"2023-11-04T01:42:06.011839+0000","last_became_peered":"2023-11-04T01:42:06.011839+0000","last_unstale":"2023-11-04T01:42:07.021445+0000","last_undegraded":"2023-11-04T01:42:07.021445+0000","last_fullsized":"2023-11-04T01:42:07.021445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:07.619946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.017551+0000","last_change":"2023-11-04T01:42:06.051896+0000","last_active":"2023-11-04T01:42:07.017551+0000","last_peered":"2023-11-04T01:42:07.017551+0000","last_clean":"2023-11-04T01:42:07.017551+0000","last_became_active":"2023-11-04T01:42:06.051493+0000","last_became_peered":"2023-11-04T01:42:06.051493+0000","last_unstale":"2023-11-04T01:42:07.017551+0000","last_undegraded":"2023-11-04T01:42:07.017551+0000","last_fullsized":"2023-11-04T01:42:07.017551+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:59.118010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269574+0000","last_change":"2023-11-04T01:42:06.027304+0000","last_active":"2023-11-04T01:42:07.269574+0000","last_peered":"2023-11-04T01:42:07.269574+0000","last_clean":"2023-11-04T01:42:07.269574+0000","last_became_active":"2023-11-04T01:42:06.026547+0000","last_became_peered":"2023-11-04T01:42:06.026547+0000","last_unstale":"2023-11-04T01:42:07.269574+0000","last_undegraded":"2023-11-04T01:42:07.269574+0000","last_fullsized":"2023-11-04T01:42:07.269574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:42.679193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020514+0000","last_change":"2023-11-04T01:42:06.032300+0000","last_active":"2023-11-04T01:42:07.020514+0000","last_peered":"2023-11-04T01:42:07.020514+0000","last_clean":"2023-11-04T01:42:07.020514+0000","last_became_active":"2023-11-04T01:42:06.030876+0000","last_became_peered":"2023-11-04T01:42:06.030876+0000","last_unstale":"2023-11-04T01:42:07.020514+0000","last_undegraded":"2023-11-04T01:42:07.020514+0000","last_fullsized":"2023-11-04T01:42:07.020514+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:42.949764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.267200+0000","last_change":"2023-11-04T01:42:06.031784+0000","last_active":"2023-11-04T01:42:07.267200+0000","last_peered":"2023-11-04T01:42:07.267200+0000","last_clean":"2023-11-04T01:42:07.267200+0000","last_became_active":"2023-11-04T01:42:06.031449+0000","last_became_peered":"2023-11-04T01:42:06.031449+0000","last_unstale":"2023-11-04T01:42:07.267200+0000","last_undegraded":"2023-11-04T01:42:07.267200+0000","last_fullsized":"2023-11-04T01:42:07.267200+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:05.621175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020024+0000","last_change":"2023-11-04T01:42:06.004348+0000","last_active":"2023-11-04T01:42:07.020024+0000","last_peered":"2023-11-04T01:42:07.020024+0000","last_clean":"2023-11-04T01:42:07.020024+0000","last_became_active":"2023-11-04T01:42:06.003474+0000","last_became_peered":"2023-11-04T01:42:06.003474+0000","last_unstale":"2023-11-04T01:42:07.020024+0000","last_undegraded":"2023-11-04T01:42:07.020024+0000","last_fullsized":"2023-11-04T01:42:07.020024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:53.473087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.266873+0000","last_change":"2023-11-04T01:42:06.044735+0000","last_active":"2023-11-04T01:42:07.266873+0000","last_peered":"2023-11-04T01:42:07.266873+0000","last_clean":"2023-11-04T01:42:07.266873+0000","last_became_active":"2023-11-04T01:42:06.044460+0000","last_became_peered":"2023-11-04T01:42:06.044460+0000","last_unstale":"2023-11-04T01:42:07.266873+0000","last_undegraded":"2023-11-04T01:42:07.266873+0000","last_fullsized":"2023-11-04T01:42:07.266873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:36.337718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.267054+0000","last_change":"2023-11-04T01:42:06.056677+0000","last_active":"2023-11-04T01:42:07.267054+0000","last_peered":"2023-11-04T01:42:07.267054+0000","last_clean":"2023-11-04T01:42:07.267054+0000","last_became_active":"2023-11-04T01:42:06.056082+0000","last_became_peered":"2023-11-04T01:42:06.056082+0000","last_unstale":"2023-11-04T01:42:07.267054+0000","last_undegraded":"2023-11-04T01:42:07.267054+0000","last_fullsized":"2023-11-04T01:42:07.267054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:25.068688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.026790+0000","last_change":"2023-11-04T01:42:06.060387+0000","last_active":"2023-11-04T01:42:07.026790+0000","last_peered":"2023-11-04T01:42:07.026790+0000","last_clean":"2023-11-04T01:42:07.026790+0000","last_became_active":"2023-11-04T01:42:06.059896+0000","last_became_peered":"2023-11-04T01:42:06.059896+0000","last_unstale":"2023-11-04T01:42:07.026790+0000","last_undegraded":"2023-11-04T01:42:07.026790+0000","last_fullsized":"2023-11-04T01:42:07.026790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:25.818484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021194+0000","last_change":"2023-11-04T01:42:06.021419+0000","last_active":"2023-11-04T01:42:07.021194+0000","last_peered":"2023-11-04T01:42:07.021194+0000","last_clean":"2023-11-04T01:42:07.021194+0000","last_became_active":"2023-11-04T01:42:06.020757+0000","last_became_peered":"2023-11-04T01:42:06.020757+0000","last_unstale":"2023-11-04T01:42:07.021194+0000","last_undegraded":"2023-11-04T01:42:07.021194+0000","last_fullsized":"2023-11-04T01:42:07.021194+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:51.752564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020392+0000","last_change":"2023-11-04T01:42:06.020488+0000","last_active":"2023-11-04T01:42:07.020392+0000","last_peered":"2023-11-04T01:42:07.020392+0000","last_clean":"2023-11-04T01:42:07.020392+0000","last_became_active":"2023-11-04T01:42:06.019516+0000","last_became_peered":"2023-11-04T01:42:06.019516+0000","last_unstale":"2023-11-04T01:42:07.020392+0000","last_undegraded":"2023-11-04T01:42:07.020392+0000","last_fullsized":"2023-11-04T01:42:07.020392+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:18.008740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269371+0000","last_change":"2023-11-04T01:42:06.014577+0000","last_active":"2023-11-04T01:42:07.269371+0000","last_peered":"2023-11-04T01:42:07.269371+0000","last_clean":"2023-11-04T01:42:07.269371+0000","last_became_active":"2023-11-04T01:42:06.013843+0000","last_became_peered":"2023-11-04T01:42:06.013843+0000","last_unstale":"2023-11-04T01:42:07.269371+0000","last_undegraded":"2023-11-04T01:42:07.269371+0000","last_fullsized":"2023-11-04T01:42:07.269371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:07.975845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.016771+0000","last_change":"2023-11-04T01:42:06.031988+0000","last_active":"2023-11-04T01:42:07.016771+0000","last_peered":"2023-11-04T01:42:07.016771+0000","last_clean":"2023-11-04T01:42:07.016771+0000","last_became_active":"2023-11-04T01:42:06.031677+0000","last_became_peered":"2023-11-04T01:42:06.031677+0000","last_unstale":"2023-11-04T01:42:07.016771+0000","last_undegraded":"2023-11-04T01:42:07.016771+0000","last_fullsized":"2023-11-04T01:42:07.016771+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:53.115392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.027336+0000","last_change":"2023-11-04T01:42:06.059872+0000","last_active":"2023-11-04T01:42:07.027336+0000","last_peered":"2023-11-04T01:42:07.027336+0000","last_clean":"2023-11-04T01:42:07.027336+0000","last_became_active":"2023-11-04T01:42:06.058855+0000","last_became_peered":"2023-11-04T01:42:06.058855+0000","last_unstale":"2023-11-04T01:42:07.027336+0000","last_undegraded":"2023-11-04T01:42:07.027336+0000","last_fullsized":"2023-11-04T01:42:07.027336+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:18.615813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.019181+0000","last_change":"2023-11-04T01:42:06.057526+0000","last_active":"2023-11-04T01:42:07.019181+0000","last_peered":"2023-11-04T01:42:07.019181+0000","last_clean":"2023-11-04T01:42:07.019181+0000","last_became_active":"2023-11-04T01:42:06.057008+0000","last_became_peered":"2023-11-04T01:42:06.057008+0000","last_unstale":"2023-11-04T01:42:07.019181+0000","last_undegraded":"2023-11-04T01:42:07.019181+0000","last_fullsized":"2023-11-04T01:42:07.019181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:43.762193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.268679+0000","last_change":"2023-11-04T01:42:05.997319+0000","last_active":"2023-11-04T01:42:07.268679+0000","last_peered":"2023-11-04T01:42:07.268679+0000","last_clean":"2023-11-04T01:42:07.268679+0000","last_became_active":"2023-11-04T01:42:05.996590+0000","last_became_peered":"2023-11-04T01:42:05.996590+0000","last_unstale":"2023-11-04T01:42:07.268679+0000","last_undegraded":"2023-11-04T01:42:07.268679+0000","last_fullsized":"2023-11-04T01:42:07.268679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:39.124014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.267305+0000","last_change":"2023-11-04T01:42:06.018634+0000","last_active":"2023-11-04T01:42:07.267305+0000","last_peered":"2023-11-04T01:42:07.267305+0000","last_clean":"2023-11-04T01:42:07.267305+0000","last_became_active":"2023-11-04T01:42:06.018112+0000","last_became_peered":"2023-11-04T01:42:06.018112+0000","last_unstale":"2023-11-04T01:42:07.267305+0000","last_undegraded":"2023-11-04T01:42:07.267305+0000","last_fullsized":"2023-11-04T01:42:07.267305+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:34.980048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.022162+0000","last_change":"2023-11-04T01:42:06.028381+0000","last_active":"2023-11-04T01:42:07.022162+0000","last_peered":"2023-11-04T01:42:07.022162+0000","last_clean":"2023-11-04T01:42:07.022162+0000","last_became_active":"2023-11-04T01:42:06.027130+0000","last_became_peered":"2023-11-04T01:42:06.027130+0000","last_unstale":"2023-11-04T01:42:07.022162+0000","last_undegraded":"2023-11-04T01:42:07.022162+0000","last_fullsized":"2023-11-04T01:42:07.022162+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:08.782518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.998087+0000","last_change":"2023-11-04T01:42:04.971841+0000","last_active":"2023-11-04T01:42:05.998087+0000","last_peered":"2023-11-04T01:42:05.998087+0000","last_clean":"2023-11-04T01:42:05.998087+0000","last_became_active":"2023-11-04T01:42:04.971405+0000","last_became_peered":"2023-11-04T01:42:04.971405+0000","last_unstale":"2023-11-04T01:42:05.998087+0000","last_undegraded":"2023-11-04T01:42:05.998087+0000","last_fullsized":"2023-11-04T01:42:05.998087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:23:01.395580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.013994+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:06.013994+0000","last_peered":"2023-11-04T01:42:06.013994+0000","last_clean":"2023-11-04T01:42:06.013994+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:06.013994+0000","last_undegraded":"2023-11-04T01:42:06.013994+0000","last_fullsized":"2023-11-04T01:42:06.013994+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.993989+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:05.993989+0000","last_peered":"2023-11-04T01:42:05.993989+0000","last_clean":"2023-11-04T01:42:05.993989+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:05.993989+0000","last_undegraded":"2023-11-04T01:42:05.993989+0000","last_fullsized":"2023-11-04T01:42:05.993989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269576+0000","last_change":"2023-11-04T01:42:06.033681+0000","last_active":"2023-11-04T01:42:07.269576+0000","last_peered":"2023-11-04T01:42:07.269576+0000","last_clean":"2023-11-04T01:42:07.269576+0000","last_became_active":"2023-11-04T01:42:06.033017+0000","last_became_peered":"2023-11-04T01:42:06.033017+0000","last_unstale":"2023-11-04T01:42:07.269576+0000","last_undegraded":"2023-11-04T01:42:07.269576+0000","last_fullsized":"2023-11-04T01:42:07.269576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:10:09.279466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.057702+0000","last_change":"2023-11-04T01:42:05.010568+0000","last_active":"2023-11-04T01:42:06.057702+0000","last_peered":"2023-11-04T01:42:06.057702+0000","last_clean":"2023-11-04T01:42:06.057702+0000","last_became_active":"2023-11-04T01:42:05.009935+0000","last_became_peered":"2023-11-04T01:42:05.009935+0000","last_unstale":"2023-11-04T01:42:06.057702+0000","last_undegraded":"2023-11-04T01:42:06.057702+0000","last_fullsized":"2023-11-04T01:42:06.057702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:16.997158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.990272+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:05.990272+0000","last_peered":"2023-11-04T01:42:05.990272+0000","last_clean":"2023-11-04T01:42:05.990272+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:05.990272+0000","last_undegraded":"2023-11-04T01:42:05.990272+0000","last_fullsized":"2023-11-04T01:42:05.990272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021321+0000","last_change":"2023-11-04T01:42:06.031583+0000","last_active":"2023-11-04T01:42:07.021321+0000","last_peered":"2023-11-04T01:42:07.021321+0000","last_clean":"2023-11-04T01:42:07.021321+0000","last_became_active":"2023-11-04T01:42:06.030908+0000","last_became_peered":"2023-11-04T01:42:06.030908+0000","last_unstale":"2023-11-04T01:42:07.021321+0000","last_undegraded":"2023-11-04T01:42:07.021321+0000","last_fullsized":"2023-11-04T01:42:07.021321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:30.914496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.000639+0000","last_change":"2023-11-04T01:42:04.978763+0000","last_active":"2023-11-04T01:42:06.000639+0000","last_peered":"2023-11-04T01:42:06.000639+0000","last_clean":"2023-11-04T01:42:06.000639+0000","last_became_active":"2023-11-04T01:42:04.978517+0000","last_became_peered":"2023-11-04T01:42:04.978517+0000","last_unstale":"2023-11-04T01:42:06.000639+0000","last_undegraded":"2023-11-04T01:42:06.000639+0000","last_fullsized":"2023-11-04T01:42:06.000639+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:24:49.518017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.034284+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:06.034284+0000","last_peered":"2023-11-04T01:42:06.034284+0000","last_clean":"2023-11-04T01:42:06.034284+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:06.034284+0000","last_undegraded":"2023-11-04T01:42:06.034284+0000","last_fullsized":"2023-11-04T01:42:06.034284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.027250+0000","last_change":"2023-11-04T01:42:06.059100+0000","last_active":"2023-11-04T01:42:07.027250+0000","last_peered":"2023-11-04T01:42:07.027250+0000","last_clean":"2023-11-04T01:42:07.027250+0000","last_became_active":"2023-11-04T01:42:06.058613+0000","last_became_peered":"2023-11-04T01:42:06.058613+0000","last_unstale":"2023-11-04T01:42:07.027250+0000","last_undegraded":"2023-11-04T01:42:07.027250+0000","last_fullsized":"2023-11-04T01:42:07.027250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:35.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.049484+0000","last_change":"2023-11-04T01:42:05.003124+0000","last_active":"2023-11-04T01:42:06.049484+0000","last_peered":"2023-11-04T01:42:06.049484+0000","last_clean":"2023-11-04T01:42:06.049484+0000","last_became_active":"2023-11-04T01:42:05.002439+0000","last_became_peered":"2023-11-04T01:42:05.002439+0000","last_unstale":"2023-11-04T01:42:06.049484+0000","last_undegraded":"2023-11-04T01:42:06.049484+0000","last_fullsized":"2023-11-04T01:42:06.049484+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:29.339468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.007854+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:06.007854+0000","last_peered":"2023-11-04T01:42:06.007854+0000","last_clean":"2023-11-04T01:42:06.007854+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:06.007854+0000","last_undegraded":"2023-11-04T01:42:06.007854+0000","last_fullsized":"2023-11-04T01:42:06.007854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020923+0000","last_change":"2023-11-04T01:42:06.042531+0000","last_active":"2023-11-04T01:42:07.020923+0000","last_peered":"2023-11-04T01:42:07.020923+0000","last_clean":"2023-11-04T01:42:07.020923+0000","last_became_active":"2023-11-04T01:42:06.041896+0000","last_became_peered":"2023-11-04T01:42:06.041896+0000","last_unstale":"2023-11-04T01:42:07.020923+0000","last_undegraded":"2023-11-04T01:42:07.020923+0000","last_fullsized":"2023-11-04T01:42:07.020923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:02.402244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.059964+0000","last_change":"2023-11-04T01:42:05.007493+0000","last_active":"2023-11-04T01:42:06.059964+0000","last_peered":"2023-11-04T01:42:06.059964+0000","last_clean":"2023-11-04T01:42:06.059964+0000","last_became_active":"2023-11-04T01:42:05.006869+0000","last_became_peered":"2023-11-04T01:42:05.006869+0000","last_unstale":"2023-11-04T01:42:06.059964+0000","last_undegraded":"2023-11-04T01:42:06.059964+0000","last_fullsized":"2023-11-04T01:42:06.059964+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:20.472735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.010150+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:06.010150+0000","last_peered":"2023-11-04T01:42:06.010150+0000","last_clean":"2023-11-04T01:42:06.010150+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:06.010150+0000","last_undegraded":"2023-11-04T01:42:06.010150+0000","last_fullsized":"2023-11-04T01:42:06.010150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020438+0000","last_change":"2023-11-04T01:42:06.034563+0000","last_active":"2023-11-04T01:42:07.020438+0000","last_peered":"2023-11-04T01:42:07.020438+0000","last_clean":"2023-11-04T01:42:07.020438+0000","last_became_active":"2023-11-04T01:42:06.031074+0000","last_became_peered":"2023-11-04T01:42:06.031074+0000","last_unstale":"2023-11-04T01:42:07.020438+0000","last_undegraded":"2023-11-04T01:42:07.020438+0000","last_fullsized":"2023-11-04T01:42:07.020438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:38:54.127462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.007827+0000","last_change":"2023-11-04T01:42:05.006827+0000","last_active":"2023-11-04T01:42:06.007827+0000","last_peered":"2023-11-04T01:42:06.007827+0000","last_clean":"2023-11-04T01:42:06.007827+0000","last_became_active":"2023-11-04T01:42:05.006480+0000","last_became_peered":"2023-11-04T01:42:05.006480+0000","last_unstale":"2023-11-04T01:42:06.007827+0000","last_undegraded":"2023-11-04T01:42:06.007827+0000","last_fullsized":"2023-11-04T01:42:06.007827+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:00:53.204008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.000668+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:06.000668+0000","last_peered":"2023-11-04T01:42:06.000668+0000","last_clean":"2023-11-04T01:42:06.000668+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:06.000668+0000","last_undegraded":"2023-11-04T01:42:06.000668+0000","last_fullsized":"2023-11-04T01:42:06.000668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.267650+0000","last_change":"2023-11-04T01:42:06.018435+0000","last_active":"2023-11-04T01:42:07.267650+0000","last_peered":"2023-11-04T01:42:07.267650+0000","last_clean":"2023-11-04T01:42:07.267650+0000","last_became_active":"2023-11-04T01:42:06.017585+0000","last_became_peered":"2023-11-04T01:42:06.017585+0000","last_unstale":"2023-11-04T01:42:07.267650+0000","last_undegraded":"2023-11-04T01:42:07.267650+0000","last_fullsized":"2023-11-04T01:42:07.267650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:05:35.901042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.039395+0000","last_change":"2023-11-04T01:42:04.994894+0000","last_active":"2023-11-04T01:42:06.039395+0000","last_peered":"2023-11-04T01:42:06.039395+0000","last_clean":"2023-11-04T01:42:06.039395+0000","last_became_active":"2023-11-04T01:42:04.994554+0000","last_became_peered":"2023-11-04T01:42:04.994554+0000","last_unstale":"2023-11-04T01:42:06.039395+0000","last_undegraded":"2023-11-04T01:42:06.039395+0000","last_fullsized":"2023-11-04T01:42:06.039395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:16.768804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.023438+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:06.023438+0000","last_peered":"2023-11-04T01:42:06.023438+0000","last_clean":"2023-11-04T01:42:06.023438+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:06.023438+0000","last_undegraded":"2023-11-04T01:42:06.023438+0000","last_fullsized":"2023-11-04T01:42:06.023438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.019364+0000","last_change":"2023-11-04T01:42:06.019919+0000","last_active":"2023-11-04T01:42:07.019364+0000","last_peered":"2023-11-04T01:42:07.019364+0000","last_clean":"2023-11-04T01:42:07.019364+0000","last_became_active":"2023-11-04T01:42:06.018448+0000","last_became_peered":"2023-11-04T01:42:06.018448+0000","last_unstale":"2023-11-04T01:42:07.019364+0000","last_undegraded":"2023-11-04T01:42:07.019364+0000","last_fullsized":"2023-11-04T01:42:07.019364+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:05.113398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.992223+0000","last_change":"2023-11-04T01:42:05.000316+0000","last_active":"2023-11-04T01:42:05.992223+0000","last_peered":"2023-11-04T01:42:05.992223+0000","last_clean":"2023-11-04T01:42:05.992223+0000","last_became_active":"2023-11-04T01:42:04.999528+0000","last_became_peered":"2023-11-04T01:42:04.999528+0000","last_unstale":"2023-11-04T01:42:05.992223+0000","last_undegraded":"2023-11-04T01:42:05.992223+0000","last_fullsized":"2023-11-04T01:42:05.992223+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:52:45.095120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.022575+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:06.022575+0000","last_peered":"2023-11-04T01:42:06.022575+0000","last_clean":"2023-11-04T01:42:06.022575+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:06.022575+0000","last_undegraded":"2023-11-04T01:42:06.022575+0000","last_fullsized":"2023-11-04T01:42:06.022575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020903+0000","last_change":"2023-11-04T01:42:06.034915+0000","last_active":"2023-11-04T01:42:07.020903+0000","last_peered":"2023-11-04T01:42:07.020903+0000","last_clean":"2023-11-04T01:42:07.020903+0000","last_became_active":"2023-11-04T01:42:06.034319+0000","last_became_peered":"2023-11-04T01:42:06.034319+0000","last_unstale":"2023-11-04T01:42:07.020903+0000","last_undegraded":"2023-11-04T01:42:07.020903+0000","last_fullsized":"2023-11-04T01:42:07.020903+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:45.753310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.021806+0000","last_change":"2023-11-04T01:42:05.002909+0000","last_active":"2023-11-04T01:42:06.021806+0000","last_peered":"2023-11-04T01:42:06.021806+0000","last_clean":"2023-11-04T01:42:06.021806+0000","last_became_active":"2023-11-04T01:42:05.002124+0000","last_became_peered":"2023-11-04T01:42:05.002124+0000","last_unstale":"2023-11-04T01:42:06.021806+0000","last_undegraded":"2023-11-04T01:42:06.021806+0000","last_fullsized":"2023-11-04T01:42:06.021806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:24.806901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.992575+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:05.992575+0000","last_peered":"2023-11-04T01:42:05.992575+0000","last_clean":"2023-11-04T01:42:05.992575+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:05.992575+0000","last_undegraded":"2023-11-04T01:42:05.992575+0000","last_fullsized":"2023-11-04T01:42:05.992575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021611+0000","last_change":"2023-11-04T01:42:06.022804+0000","last_active":"2023-11-04T01:42:07.021611+0000","last_peered":"2023-11-04T01:42:07.021611+0000","last_clean":"2023-11-04T01:42:07.021611+0000","last_became_active":"2023-11-04T01:42:06.022164+0000","last_became_peered":"2023-11-04T01:42:06.022164+0000","last_unstale":"2023-11-04T01:42:07.021611+0000","last_undegraded":"2023-11-04T01:42:07.021611+0000","last_fullsized":"2023-11-04T01:42:07.021611+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:56:39.124014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.026735+0000","last_change":"2023-11-04T01:42:04.980535+0000","last_active":"2023-11-04T01:42:06.026735+0000","last_peered":"2023-11-04T01:42:06.026735+0000","last_clean":"2023-11-04T01:42:06.026735+0000","last_became_active":"2023-11-04T01:42:04.980311+0000","last_became_peered":"2023-11-04T01:42:04.980311+0000","last_unstale":"2023-11-04T01:42:06.026735+0000","last_undegraded":"2023-11-04T01:42:06.026735+0000","last_fullsized":"2023-11-04T01:42:06.026735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:09.340809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.999395+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:05.999395+0000","last_peered":"2023-11-04T01:42:05.999395+0000","last_clean":"2023-11-04T01:42:05.999395+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:05.999395+0000","last_undegraded":"2023-11-04T01:42:05.999395+0000","last_fullsized":"2023-11-04T01:42:05.999395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269040+0000","last_change":"2023-11-04T01:42:06.040998+0000","last_active":"2023-11-04T01:42:07.269040+0000","last_peered":"2023-11-04T01:42:07.269040+0000","last_clean":"2023-11-04T01:42:07.269040+0000","last_became_active":"2023-11-04T01:42:06.040645+0000","last_became_peered":"2023-11-04T01:42:06.040645+0000","last_unstale":"2023-11-04T01:42:07.269040+0000","last_undegraded":"2023-11-04T01:42:07.269040+0000","last_fullsized":"2023-11-04T01:42:07.269040+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:05:40.387140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.065468+0000","last_change":"2023-11-04T01:42:05.010609+0000","last_active":"2023-11-04T01:42:06.065468+0000","last_peered":"2023-11-04T01:42:06.065468+0000","last_clean":"2023-11-04T01:42:06.065468+0000","last_became_active":"2023-11-04T01:42:05.009776+0000","last_became_peered":"2023-11-04T01:42:05.009776+0000","last_unstale":"2023-11-04T01:42:06.065468+0000","last_undegraded":"2023-11-04T01:42:06.065468+0000","last_fullsized":"2023-11-04T01:42:06.065468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:08.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.013390+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:06.013390+0000","last_peered":"2023-11-04T01:42:06.013390+0000","last_clean":"2023-11-04T01:42:06.013390+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:06.013390+0000","last_undegraded":"2023-11-04T01:42:06.013390+0000","last_fullsized":"2023-11-04T01:42:06.013390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021686+0000","last_change":"2023-11-04T01:42:06.019915+0000","last_active":"2023-11-04T01:42:07.021686+0000","last_peered":"2023-11-04T01:42:07.021686+0000","last_clean":"2023-11-04T01:42:07.021686+0000","last_became_active":"2023-11-04T01:42:06.019618+0000","last_became_peered":"2023-11-04T01:42:06.019618+0000","last_unstale":"2023-11-04T01:42:07.021686+0000","last_undegraded":"2023-11-04T01:42:07.021686+0000","last_fullsized":"2023-11-04T01:42:07.021686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:31.809410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.993240+0000","last_change":"2023-11-04T01:42:04.999767+0000","last_active":"2023-11-04T01:42:05.993240+0000","last_peered":"2023-11-04T01:42:05.993240+0000","last_clean":"2023-11-04T01:42:05.993240+0000","last_became_active":"2023-11-04T01:42:04.998886+0000","last_became_peered":"2023-11-04T01:42:04.998886+0000","last_unstale":"2023-11-04T01:42:05.993240+0000","last_undegraded":"2023-11-04T01:42:05.993240+0000","last_fullsized":"2023-11-04T01:42:05.993240+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:38.168718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.017705+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:06.017705+0000","last_peered":"2023-11-04T01:42:06.017705+0000","last_clean":"2023-11-04T01:42:06.017705+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:06.017705+0000","last_undegraded":"2023-11-04T01:42:06.017705+0000","last_fullsized":"2023-11-04T01:42:06.017705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.016048+0000","last_change":"2023-11-04T01:42:06.040477+0000","last_active":"2023-11-04T01:42:07.016048+0000","last_peered":"2023-11-04T01:42:07.016048+0000","last_clean":"2023-11-04T01:42:07.016048+0000","last_became_active":"2023-11-04T01:42:06.040150+0000","last_became_peered":"2023-11-04T01:42:06.040150+0000","last_unstale":"2023-11-04T01:42:07.016048+0000","last_undegraded":"2023-11-04T01:42:07.016048+0000","last_fullsized":"2023-11-04T01:42:07.016048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:52:46.106702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.999924+0000","last_change":"2023-11-04T01:42:04.995797+0000","last_active":"2023-11-04T01:42:05.999924+0000","last_peered":"2023-11-04T01:42:05.999924+0000","last_clean":"2023-11-04T01:42:05.999924+0000","last_became_active":"2023-11-04T01:42:04.995421+0000","last_became_peered":"2023-11-04T01:42:04.995421+0000","last_unstale":"2023-11-04T01:42:05.999924+0000","last_undegraded":"2023-11-04T01:42:05.999924+0000","last_fullsized":"2023-11-04T01:42:05.999924+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:37.249821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.994631+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:05.994631+0000","last_peered":"2023-11-04T01:42:05.994631+0000","last_clean":"2023-11-04T01:42:05.994631+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:05.994631+0000","last_undegraded":"2023-11-04T01:42:05.994631+0000","last_fullsized":"2023-11-04T01:42:05.994631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021403+0000","last_change":"2023-11-04T01:42:06.012583+0000","last_active":"2023-11-04T01:42:07.021403+0000","last_peered":"2023-11-04T01:42:07.021403+0000","last_clean":"2023-11-04T01:42:07.021403+0000","last_became_active":"2023-11-04T01:42:06.012067+0000","last_became_peered":"2023-11-04T01:42:06.012067+0000","last_unstale":"2023-11-04T01:42:07.021403+0000","last_undegraded":"2023-11-04T01:42:07.021403+0000","last_fullsized":"2023-11-04T01:42:07.021403+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:18.075764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.009739+0000","last_change":"2023-11-04T01:42:04.995419+0000","last_active":"2023-11-04T01:42:06.009739+0000","last_peered":"2023-11-04T01:42:06.009739+0000","last_clean":"2023-11-04T01:42:06.009739+0000","last_became_active":"2023-11-04T01:42:04.995091+0000","last_became_peered":"2023-11-04T01:42:04.995091+0000","last_unstale":"2023-11-04T01:42:06.009739+0000","last_undegraded":"2023-11-04T01:42:06.009739+0000","last_fullsized":"2023-11-04T01:42:06.009739+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:41.667611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.985607+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:05.985607+0000","last_peered":"2023-11-04T01:42:05.985607+0000","last_clean":"2023-11-04T01:42:05.985607+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:05.985607+0000","last_undegraded":"2023-11-04T01:42:05.985607+0000","last_fullsized":"2023-11-04T01:42:05.985607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.019789+0000","last_change":"2023-11-04T01:42:06.027980+0000","last_active":"2023-11-04T01:42:07.019789+0000","last_peered":"2023-11-04T01:42:07.019789+0000","last_clean":"2023-11-04T01:42:07.019789+0000","last_became_active":"2023-11-04T01:42:06.027230+0000","last_became_peered":"2023-11-04T01:42:06.027230+0000","last_unstale":"2023-11-04T01:42:07.019789+0000","last_undegraded":"2023-11-04T01:42:07.019789+0000","last_fullsized":"2023-11-04T01:42:07.019789+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:31.004514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.033588+0000","last_change":"2023-11-04T01:42:05.007381+0000","last_active":"2023-11-04T01:42:06.033588+0000","last_peered":"2023-11-04T01:42:06.033588+0000","last_clean":"2023-11-04T01:42:06.033588+0000","last_became_active":"2023-11-04T01:42:05.006783+0000","last_became_peered":"2023-11-04T01:42:05.006783+0000","last_unstale":"2023-11-04T01:42:06.033588+0000","last_undegraded":"2023-11-04T01:42:06.033588+0000","last_fullsized":"2023-11-04T01:42:06.033588+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:08:50.740982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.000696+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:06.000696+0000","last_peered":"2023-11-04T01:42:06.000696+0000","last_clean":"2023-11-04T01:42:06.000696+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:06.000696+0000","last_undegraded":"2023-11-04T01:42:06.000696+0000","last_fullsized":"2023-11-04T01:42:06.000696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.268880+0000","last_change":"2023-11-04T01:42:06.057886+0000","last_active":"2023-11-04T01:42:07.268880+0000","last_peered":"2023-11-04T01:42:07.268880+0000","last_clean":"2023-11-04T01:42:07.268880+0000","last_became_active":"2023-11-04T01:42:06.057418+0000","last_became_peered":"2023-11-04T01:42:06.057418+0000","last_unstale":"2023-11-04T01:42:07.268880+0000","last_undegraded":"2023-11-04T01:42:07.268880+0000","last_fullsized":"2023-11-04T01:42:07.268880+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:08.782518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.998966+0000","last_change":"2023-11-04T01:42:04.974191+0000","last_active":"2023-11-04T01:42:05.998966+0000","last_peered":"2023-11-04T01:42:05.998966+0000","last_clean":"2023-11-04T01:42:05.998966+0000","last_became_active":"2023-11-04T01:42:04.973849+0000","last_became_peered":"2023-11-04T01:42:04.973849+0000","last_unstale":"2023-11-04T01:42:05.998966+0000","last_undegraded":"2023-11-04T01:42:05.998966+0000","last_fullsized":"2023-11-04T01:42:05.998966+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:14:36.454557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.991097+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:05.991097+0000","last_peered":"2023-11-04T01:42:05.991097+0000","last_clean":"2023-11-04T01:42:05.991097+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:05.991097+0000","last_undegraded":"2023-11-04T01:42:05.991097+0000","last_fullsized":"2023-11-04T01:42:05.991097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269726+0000","last_change":"2023-11-04T01:42:06.029373+0000","last_active":"2023-11-04T01:42:07.269726+0000","last_peered":"2023-11-04T01:42:07.269726+0000","last_clean":"2023-11-04T01:42:07.269726+0000","last_became_active":"2023-11-04T01:42:06.028916+0000","last_became_peered":"2023-11-04T01:42:06.028916+0000","last_unstale":"2023-11-04T01:42:07.269726+0000","last_undegraded":"2023-11-04T01:42:07.269726+0000","last_fullsized":"2023-11-04T01:42:07.269726+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:09:10.534467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.048973+0000","last_change":"2023-11-04T01:42:05.002890+0000","last_active":"2023-11-04T01:42:06.048973+0000","last_peered":"2023-11-04T01:42:06.048973+0000","last_clean":"2023-11-04T01:42:06.048973+0000","last_became_active":"2023-11-04T01:42:05.002136+0000","last_became_peered":"2023-11-04T01:42:05.002136+0000","last_unstale":"2023-11-04T01:42:06.048973+0000","last_undegraded":"2023-11-04T01:42:06.048973+0000","last_fullsized":"2023-11-04T01:42:06.048973+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:20.472735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.013609+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:06.013609+0000","last_peered":"2023-11-04T01:42:06.013609+0000","last_clean":"2023-11-04T01:42:06.013609+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:06.013609+0000","last_undegraded":"2023-11-04T01:42:06.013609+0000","last_fullsized":"2023-11-04T01:42:06.013609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.027750+0000","last_change":"2023-11-04T01:42:06.062093+0000","last_active":"2023-11-04T01:42:07.027750+0000","last_peered":"2023-11-04T01:42:07.027750+0000","last_clean":"2023-11-04T01:42:07.027750+0000","last_became_active":"2023-11-04T01:42:06.060867+0000","last_became_peered":"2023-11-04T01:42:06.060867+0000","last_unstale":"2023-11-04T01:42:07.027750+0000","last_undegraded":"2023-11-04T01:42:07.027750+0000","last_fullsized":"2023-11-04T01:42:07.027750+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:09:10.534467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.033900+0000","last_change":"2023-11-04T01:42:04.977260+0000","last_active":"2023-11-04T01:42:06.033900+0000","last_peered":"2023-11-04T01:42:06.033900+0000","last_clean":"2023-11-04T01:42:06.033900+0000","last_became_active":"2023-11-04T01:42:04.976923+0000","last_became_peered":"2023-11-04T01:42:04.976923+0000","last_unstale":"2023-11-04T01:42:06.033900+0000","last_undegraded":"2023-11-04T01:42:06.033900+0000","last_fullsized":"2023-11-04T01:42:06.033900+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:56.234552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.999411+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:05.999411+0000","last_peered":"2023-11-04T01:42:05.999411+0000","last_clean":"2023-11-04T01:42:05.999411+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:05.999411+0000","last_undegraded":"2023-11-04T01:42:05.999411+0000","last_fullsized":"2023-11-04T01:42:05.999411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021278+0000","last_change":"2023-11-04T01:42:06.031507+0000","last_active":"2023-11-04T01:42:07.021278+0000","last_peered":"2023-11-04T01:42:07.021278+0000","last_clean":"2023-11-04T01:42:07.021278+0000","last_became_active":"2023-11-04T01:42:06.030750+0000","last_became_peered":"2023-11-04T01:42:06.030750+0000","last_unstale":"2023-11-04T01:42:07.021278+0000","last_undegraded":"2023-11-04T01:42:07.021278+0000","last_fullsized":"2023-11-04T01:42:07.021278+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:06.973395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"61'4","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.060424+0000","last_change":"2023-11-04T01:42:04.989338+0000","last_active":"2023-11-04T01:42:06.060424+0000","last_peered":"2023-11-04T01:42:06.060424+0000","last_clean":"2023-11-04T01:42:06.060424+0000","last_became_active":"2023-11-04T01:42:04.988983+0000","last_became_peered":"2023-11-04T01:42:04.988983+0000","last_unstale":"2023-11-04T01:42:06.060424+0000","last_undegraded":"2023-11-04T01:42:06.060424+0000","last_fullsized":"2023-11-04T01:42:06.060424+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:56.731046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.007762+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:06.007762+0000","last_peered":"2023-11-04T01:42:06.007762+0000","last_clean":"2023-11-04T01:42:06.007762+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:06.007762+0000","last_undegraded":"2023-11-04T01:42:06.007762+0000","last_fullsized":"2023-11-04T01:42:06.007762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269569+0000","last_change":"2023-11-04T01:42:06.029243+0000","last_active":"2023-11-04T01:42:07.269569+0000","last_peered":"2023-11-04T01:42:07.269569+0000","last_clean":"2023-11-04T01:42:07.269569+0000","last_became_active":"2023-11-04T01:42:06.028422+0000","last_became_peered":"2023-11-04T01:42:06.028422+0000","last_unstale":"2023-11-04T01:42:07.269569+0000","last_undegraded":"2023-11-04T01:42:07.269569+0000","last_fullsized":"2023-11-04T01:42:07.269569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:23.065935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.060254+0000","last_change":"2023-11-04T01:42:05.006675+0000","last_active":"2023-11-04T01:42:06.060254+0000","last_peered":"2023-11-04T01:42:06.060254+0000","last_clean":"2023-11-04T01:42:06.060254+0000","last_became_active":"2023-11-04T01:42:05.006360+0000","last_became_peered":"2023-11-04T01:42:05.006360+0000","last_unstale":"2023-11-04T01:42:06.060254+0000","last_undegraded":"2023-11-04T01:42:06.060254+0000","last_fullsized":"2023-11-04T01:42:06.060254+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:14.548183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.000126+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:06.000126+0000","last_peered":"2023-11-04T01:42:06.000126+0000","last_clean":"2023-11-04T01:42:06.000126+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:06.000126+0000","last_undegraded":"2023-11-04T01:42:06.000126+0000","last_fullsized":"2023-11-04T01:42:06.000126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.019913+0000","last_change":"2023-11-04T01:42:06.035498+0000","last_active":"2023-11-04T01:42:07.019913+0000","last_peered":"2023-11-04T01:42:07.019913+0000","last_clean":"2023-11-04T01:42:07.019913+0000","last_became_active":"2023-11-04T01:42:06.032959+0000","last_became_peered":"2023-11-04T01:42:06.032959+0000","last_unstale":"2023-11-04T01:42:07.019913+0000","last_undegraded":"2023-11-04T01:42:07.019913+0000","last_fullsized":"2023-11-04T01:42:07.019913+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:00:40.683138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.999574+0000","last_change":"2023-11-04T01:42:04.996167+0000","last_active":"2023-11-04T01:42:05.999574+0000","last_peered":"2023-11-04T01:42:05.999574+0000","last_clean":"2023-11-04T01:42:05.999574+0000","last_became_active":"2023-11-04T01:42:04.995600+0000","last_became_peered":"2023-11-04T01:42:04.995600+0000","last_unstale":"2023-11-04T01:42:05.999574+0000","last_undegraded":"2023-11-04T01:42:05.999574+0000","last_fullsized":"2023-11-04T01:42:05.999574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:54.518125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.021159+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:06.021159+0000","last_peered":"2023-11-04T01:42:06.021159+0000","last_clean":"2023-11-04T01:42:06.021159+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:06.021159+0000","last_undegraded":"2023-11-04T01:42:06.021159+0000","last_fullsized":"2023-11-04T01:42:06.021159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.268128+0000","last_change":"2023-11-04T01:42:06.013063+0000","last_active":"2023-11-04T01:42:07.268128+0000","last_peered":"2023-11-04T01:42:07.268128+0000","last_clean":"2023-11-04T01:42:07.268128+0000","last_became_active":"2023-11-04T01:42:06.012663+0000","last_became_peered":"2023-11-04T01:42:06.012663+0000","last_unstale":"2023-11-04T01:42:07.268128+0000","last_undegraded":"2023-11-04T01:42:07.268128+0000","last_fullsized":"2023-11-04T01:42:07.268128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:42.749625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.999149+0000","last_change":"2023-11-04T01:42:05.007624+0000","last_active":"2023-11-04T01:42:05.999149+0000","last_peered":"2023-11-04T01:42:05.999149+0000","last_clean":"2023-11-04T01:42:05.999149+0000","last_became_active":"2023-11-04T01:42:05.006885+0000","last_became_peered":"2023-11-04T01:42:05.006885+0000","last_unstale":"2023-11-04T01:42:05.999149+0000","last_undegraded":"2023-11-04T01:42:05.999149+0000","last_fullsized":"2023-11-04T01:42:05.999149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:07.367794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.992991+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:05.992991+0000","last_peered":"2023-11-04T01:42:05.992991+0000","last_clean":"2023-11-04T01:42:05.992991+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:05.992991+0000","last_undegraded":"2023-11-04T01:42:05.992991+0000","last_fullsized":"2023-11-04T01:42:05.992991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021333+0000","last_change":"2023-11-04T01:42:06.012552+0000","last_active":"2023-11-04T01:42:07.021333+0000","last_peered":"2023-11-04T01:42:07.021333+0000","last_clean":"2023-11-04T01:42:07.021333+0000","last_became_active":"2023-11-04T01:42:06.012195+0000","last_became_peered":"2023-11-04T01:42:06.012195+0000","last_unstale":"2023-11-04T01:42:07.021333+0000","last_undegraded":"2023-11-04T01:42:07.021333+0000","last_fullsized":"2023-11-04T01:42:07.021333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.969238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.033626+0000","last_change":"2023-11-04T01:42:04.975673+0000","last_active":"2023-11-04T01:42:06.033626+0000","last_peered":"2023-11-04T01:42:06.033626+0000","last_clean":"2023-11-04T01:42:06.033626+0000","last_became_active":"2023-11-04T01:42:04.975387+0000","last_became_peered":"2023-11-04T01:42:04.975387+0000","last_unstale":"2023-11-04T01:42:06.033626+0000","last_undegraded":"2023-11-04T01:42:06.033626+0000","last_fullsized":"2023-11-04T01:42:06.033626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:47.899520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.985424+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:05.985424+0000","last_peered":"2023-11-04T01:42:05.985424+0000","last_clean":"2023-11-04T01:42:05.985424+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:05.985424+0000","last_undegraded":"2023-11-04T01:42:05.985424+0000","last_fullsized":"2023-11-04T01:42:05.985424+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.015922+0000","last_change":"2023-11-04T01:42:06.040210+0000","last_active":"2023-11-04T01:42:07.015922+0000","last_peered":"2023-11-04T01:42:07.015922+0000","last_clean":"2023-11-04T01:42:07.015922+0000","last_became_active":"2023-11-04T01:42:06.039916+0000","last_became_peered":"2023-11-04T01:42:06.039916+0000","last_unstale":"2023-11-04T01:42:07.015922+0000","last_undegraded":"2023-11-04T01:42:07.015922+0000","last_fullsized":"2023-11-04T01:42:07.015922+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:45:39.578684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"61'1","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.019282+0000","last_change":"2023-11-04T01:42:04.972222+0000","last_active":"2023-11-04T01:42:06.019282+0000","last_peered":"2023-11-04T01:42:06.019282+0000","last_clean":"2023-11-04T01:42:06.019282+0000","last_became_active":"2023-11-04T01:42:04.971888+0000","last_became_peered":"2023-11-04T01:42:04.971888+0000","last_unstale":"2023-11-04T01:42:06.019282+0000","last_undegraded":"2023-11-04T01:42:06.019282+0000","last_fullsized":"2023-11-04T01:42:06.019282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:05.990297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.014236+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:06.014236+0000","last_peered":"2023-11-04T01:42:06.014236+0000","last_clean":"2023-11-04T01:42:06.014236+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:06.014236+0000","last_undegraded":"2023-11-04T01:42:06.014236+0000","last_fullsized":"2023-11-04T01:42:06.014236+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.021568+0000","last_change":"2023-11-04T01:42:06.025169+0000","last_active":"2023-11-04T01:42:07.021568+0000","last_peered":"2023-11-04T01:42:07.021568+0000","last_clean":"2023-11-04T01:42:07.021568+0000","last_became_active":"2023-11-04T01:42:06.024460+0000","last_became_peered":"2023-11-04T01:42:06.024460+0000","last_unstale":"2023-11-04T01:42:07.021568+0000","last_undegraded":"2023-11-04T01:42:07.021568+0000","last_fullsized":"2023-11-04T01:42:07.021568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:35.818952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"61'3","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.057516+0000","last_change":"2023-11-04T01:42:05.007348+0000","last_active":"2023-11-04T01:42:06.057516+0000","last_peered":"2023-11-04T01:42:06.057516+0000","last_clean":"2023-11-04T01:42:06.057516+0000","last_became_active":"2023-11-04T01:42:05.006661+0000","last_became_peered":"2023-11-04T01:42:05.006661+0000","last_unstale":"2023-11-04T01:42:06.057516+0000","last_undegraded":"2023-11-04T01:42:06.057516+0000","last_fullsized":"2023-11-04T01:42:06.057516+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:52.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.990029+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:05.990029+0000","last_peered":"2023-11-04T01:42:05.990029+0000","last_clean":"2023-11-04T01:42:05.990029+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:05.990029+0000","last_undegraded":"2023-11-04T01:42:05.990029+0000","last_fullsized":"2023-11-04T01:42:05.990029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.269868+0000","last_change":"2023-11-04T01:42:06.019003+0000","last_active":"2023-11-04T01:42:07.269868+0000","last_peered":"2023-11-04T01:42:07.269868+0000","last_clean":"2023-11-04T01:42:07.269868+0000","last_became_active":"2023-11-04T01:42:06.016532+0000","last_became_peered":"2023-11-04T01:42:06.016532+0000","last_unstale":"2023-11-04T01:42:07.269868+0000","last_undegraded":"2023-11-04T01:42:07.269868+0000","last_fullsized":"2023-11-04T01:42:07.269868+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:57.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'6","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.055945+0000","last_change":"2023-11-04T01:42:04.983369+0000","last_active":"2023-11-04T01:42:06.055945+0000","last_peered":"2023-11-04T01:42:06.055945+0000","last_clean":"2023-11-04T01:42:06.055945+0000","last_became_active":"2023-11-04T01:42:04.983083+0000","last_became_peered":"2023-11-04T01:42:04.983083+0000","last_unstale":"2023-11-04T01:42:06.055945+0000","last_undegraded":"2023-11-04T01:42:06.055945+0000","last_fullsized":"2023-11-04T01:42:06.055945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:22.054353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.999166+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:05.999166+0000","last_peered":"2023-11-04T01:42:05.999166+0000","last_clean":"2023-11-04T01:42:05.999166+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:05.999166+0000","last_undegraded":"2023-11-04T01:42:05.999166+0000","last_fullsized":"2023-11-04T01:42:05.999166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.016886+0000","last_change":"2023-11-04T01:42:06.025315+0000","last_active":"2023-11-04T01:42:07.016886+0000","last_peered":"2023-11-04T01:42:07.016886+0000","last_clean":"2023-11-04T01:42:07.016886+0000","last_became_active":"2023-11-04T01:42:06.024922+0000","last_became_peered":"2023-11-04T01:42:06.024922+0000","last_unstale":"2023-11-04T01:42:07.016886+0000","last_undegraded":"2023-11-04T01:42:07.016886+0000","last_fullsized":"2023-11-04T01:42:07.016886+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:55:39.180301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.035067+0000","last_change":"2023-11-04T01:42:05.011704+0000","last_active":"2023-11-04T01:42:06.035067+0000","last_peered":"2023-11-04T01:42:06.035067+0000","last_clean":"2023-11-04T01:42:06.035067+0000","last_became_active":"2023-11-04T01:42:05.010990+0000","last_became_peered":"2023-11-04T01:42:05.010990+0000","last_unstale":"2023-11-04T01:42:06.035067+0000","last_undegraded":"2023-11-04T01:42:06.035067+0000","last_fullsized":"2023-11-04T01:42:06.035067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:00:53.204008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.007671+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:06.007671+0000","last_peered":"2023-11-04T01:42:06.007671+0000","last_clean":"2023-11-04T01:42:06.007671+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:06.007671+0000","last_undegraded":"2023-11-04T01:42:06.007671+0000","last_fullsized":"2023-11-04T01:42:06.007671+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.267711+0000","last_change":"2023-11-04T01:42:06.023233+0000","last_active":"2023-11-04T01:42:07.267711+0000","last_peered":"2023-11-04T01:42:07.267711+0000","last_clean":"2023-11-04T01:42:07.267711+0000","last_became_active":"2023-11-04T01:42:06.022949+0000","last_became_peered":"2023-11-04T01:42:06.022949+0000","last_unstale":"2023-11-04T01:42:07.267711+0000","last_undegraded":"2023-11-04T01:42:07.267711+0000","last_fullsized":"2023-11-04T01:42:07.267711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:43.114965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.994618+0000","last_change":"2023-11-04T01:42:04.978969+0000","last_active":"2023-11-04T01:42:05.994618+0000","last_peered":"2023-11-04T01:42:05.994618+0000","last_clean":"2023-11-04T01:42:05.994618+0000","last_became_active":"2023-11-04T01:42:04.978240+0000","last_became_peered":"2023-11-04T01:42:04.978240+0000","last_unstale":"2023-11-04T01:42:05.994618+0000","last_undegraded":"2023-11-04T01:42:05.994618+0000","last_fullsized":"2023-11-04T01:42:05.994618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:29.902914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":42,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.989082+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:05.989082+0000","last_peered":"2023-11-04T01:42:05.989082+0000","last_clean":"2023-11-04T01:42:05.989082+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:05.989082+0000","last_undegraded":"2023-11-04T01:42:05.989082+0000","last_fullsized":"2023-11-04T01:42:05.989082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.020243+0000","last_change":"2023-11-04T01:42:06.034990+0000","last_active":"2023-11-04T01:42:07.020243+0000","last_peered":"2023-11-04T01:42:07.020243+0000","last_clean":"2023-11-04T01:42:07.020243+0000","last_became_active":"2023-11-04T01:42:06.031898+0000","last_became_peered":"2023-11-04T01:42:06.031898+0000","last_unstale":"2023-11-04T01:42:07.020243+0000","last_undegraded":"2023-11-04T01:42:07.020243+0000","last_fullsized":"2023-11-04T01:42:07.020243+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:14.656194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.012556+0000","last_change":"2023-11-04T01:42:05.007818+0000","last_active":"2023-11-04T01:42:06.012556+0000","last_peered":"2023-11-04T01:42:06.012556+0000","last_clean":"2023-11-04T01:42:06.012556+0000","last_became_active":"2023-11-04T01:42:05.006963+0000","last_became_peered":"2023-11-04T01:42:05.006963+0000","last_unstale":"2023-11-04T01:42:06.012556+0000","last_undegraded":"2023-11-04T01:42:06.012556+0000","last_fullsized":"2023-11-04T01:42:06.012556+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:42.750611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":39,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.994843+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:05.994843+0000","last_peered":"2023-11-04T01:42:05.994843+0000","last_clean":"2023-11-04T01:42:05.994843+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:05.994843+0000","last_undegraded":"2023-11-04T01:42:05.994843+0000","last_fullsized":"2023-11-04T01:42:05.994843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.016489+0000","last_change":"2023-11-04T01:42:06.056118+0000","last_active":"2023-11-04T01:42:07.016489+0000","last_peered":"2023-11-04T01:42:07.016489+0000","last_clean":"2023-11-04T01:42:07.016489+0000","last_became_active":"2023-11-04T01:42:06.055816+0000","last_became_peered":"2023-11-04T01:42:06.055816+0000","last_unstale":"2023-11-04T01:42:07.016489+0000","last_undegraded":"2023-11-04T01:42:07.016489+0000","last_fullsized":"2023-11-04T01:42:07.016489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:01:13.786469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"61'8","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.065779+0000","last_change":"2023-11-04T01:42:05.001976+0000","last_active":"2023-11-04T01:42:06.065779+0000","last_peered":"2023-11-04T01:42:06.065779+0000","last_clean":"2023-11-04T01:42:06.065779+0000","last_became_active":"2023-11-04T01:42:05.001247+0000","last_became_peered":"2023-11-04T01:42:05.001247+0000","last_unstale":"2023-11-04T01:42:06.065779+0000","last_undegraded":"2023-11-04T01:42:06.065779+0000","last_fullsized":"2023-11-04T01:42:06.065779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:05.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.001024+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:06.001024+0000","last_peered":"2023-11-04T01:42:06.001024+0000","last_clean":"2023-11-04T01:42:06.001024+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:06.001024+0000","last_undegraded":"2023-11-04T01:42:06.001024+0000","last_fullsized":"2023-11-04T01:42:06.001024+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.268595+0000","last_change":"2023-11-04T01:42:06.058817+0000","last_active":"2023-11-04T01:42:07.268595+0000","last_peered":"2023-11-04T01:42:07.268595+0000","last_clean":"2023-11-04T01:42:07.268595+0000","last_became_active":"2023-11-04T01:42:06.056824+0000","last_became_peered":"2023-11-04T01:42:06.056824+0000","last_unstale":"2023-11-04T01:42:07.268595+0000","last_undegraded":"2023-11-04T01:42:07.268595+0000","last_fullsized":"2023-11-04T01:42:07.268595+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:35.818952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"61'2","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.058337+0000","last_change":"2023-11-04T01:42:05.010393+0000","last_active":"2023-11-04T01:42:06.058337+0000","last_peered":"2023-11-04T01:42:06.058337+0000","last_clean":"2023-11-04T01:42:06.058337+0000","last_became_active":"2023-11-04T01:42:05.009748+0000","last_became_peered":"2023-11-04T01:42:05.009748+0000","last_unstale":"2023-11-04T01:42:06.058337+0000","last_undegraded":"2023-11-04T01:42:06.058337+0000","last_fullsized":"2023-11-04T01:42:06.058337+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:19.025273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.013967+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:06.013967+0000","last_peered":"2023-11-04T01:42:06.013967+0000","last_clean":"2023-11-04T01:42:06.013967+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:06.013967+0000","last_undegraded":"2023-11-04T01:42:06.013967+0000","last_fullsized":"2023-11-04T01:42:06.013967+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:42:07.018983+0000","last_change":"2023-11-04T01:42:06.021551+0000","last_active":"2023-11-04T01:42:07.018983+0000","last_peered":"2023-11-04T01:42:07.018983+0000","last_clean":"2023-11-04T01:42:07.018983+0000","last_became_active":"2023-11-04T01:42:06.020721+0000","last_became_peered":"2023-11-04T01:42:06.020721+0000","last_unstale":"2023-11-04T01:42:07.018983+0000","last_undegraded":"2023-11-04T01:42:07.018983+0000","last_fullsized":"2023-11-04T01:42:07.018983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:04.945280+0000","last_clean_scrub_stamp":"2023-11-04T01:42:04.945280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:39.054164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:05.991416+0000","last_change":"2023-11-04T01:42:05.000198+0000","last_active":"2023-11-04T01:42:05.991416+0000","last_peered":"2023-11-04T01:42:05.991416+0000","last_clean":"2023-11-04T01:42:05.991416+0000","last_became_active":"2023-11-04T01:42:04.999551+0000","last_became_peered":"2023-11-04T01:42:04.999551+0000","last_unstale":"2023-11-04T01:42:05.991416+0000","last_undegraded":"2023-11-04T01:42:05.991416+0000","last_fullsized":"2023-11-04T01:42:05.991416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:03.933697+0000","last_clean_scrub_stamp":"2023-11-04T01:42:03.933697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:09.340809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:42:06.016480+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:06.016480+0000","last_peered":"2023-11-04T01:42:06.016480+0000","last_clean":"2023-11-04T01:42:06.016480+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:06.016480+0000","last_undegraded":"2023-11-04T01:42:06.016480+0000","last_fullsized":"2023-11-04T01:42:06.016480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":917569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.22},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.94299999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.3080000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.2450000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":1.27},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.054},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":1.3480000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":326459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.76000000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.048},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.89000000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.93300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":1.2},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.96599999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":1.008},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.373}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.099},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.161}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":326447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.1060000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.139}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.026}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.071}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.91100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":328037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.155},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.872},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.089}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":745472,"data_stored":326425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.94799999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":1.0149999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.056},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.089}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":1.2310000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":1.1830000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":326425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.746}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":0.53500000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.01},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":0.79100000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":328801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.76900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.87},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.79000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.014},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1339392,"data_stored":916793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.754}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.628},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.028}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.073},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.999}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":0.88},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":0.92700000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.177}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.256},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:13.924 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:42:13.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:42:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 Processor -- start 2023-11-04T01:42:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 -- start start 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 0x7f62a40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f62a415d250 0x7f62a40c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a40ca390 con 0x7f62a40c94e0 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40b0e00 con 0x7f62a415d250 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a9d3e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40c9af0 con 0x7f62a40b04e0 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f62a40c94e0 0x7f62a40cc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43840/0 (socket says 172.21.15.40:43840) 2023-11-04T01:42:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a3fff640 1 -- 172.21.15.40:0/3338451443 learned_addr learned my addr 172.21.15.40:0/3338451443 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3338451443 >> v2:172.21.15.91:3300/0 conn(0x7f62a415d250 0x7f62a40c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a37fe640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 0x7f62a40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038025333 0 0) 0x7f629c001120 con 0x7f62a40c94e0 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6290003530 con 0x7f62a40c94e0 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317264557 0 0) 0x7f6290003530 con 0x7f62a40c94e0 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 msgr2=0x7f62a40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 0x7f62a40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 >> v2:172.21.15.91:3300/0 conn(0x7f62a415d250 msgr2=0x7f62a40c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 --2- 172.21.15.40:0/3338451443 >> v2:172.21.15.91:3300/0 conn(0x7f62a415d250 0x7f62a40c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40c9dd0 con 0x7f62a40c94e0 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f629c001810 con 0x7f62a40c94e0 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 >> v1:172.21.15.40:6789/0 conn(0x7f62a40c94e0 legacy=0x7f62a40cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6290003980 0x7f6290003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900047d0 0x7f6290004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 0x7f6290005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40b0e00 con 0x7f62900047d0 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40c9af0 con 0x7f6290003980 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629000b990 con 0x7f62a40b04e0 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900047d0 0x7f6290004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a37fe640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6290003980 0x7f6290003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a3fff640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 0x7f6290005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 msgr2=0x7f6290005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.094+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a40b04e0 0x7f6290005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6290003980 msgr2=0x7f6290003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6290003980 0x7f6290003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3338451443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290003530 con 0x7f62900047d0 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900047d0 0x7f6290004c50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f628c009f90 tx=0x7f628c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73966de5e3ba354b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0a5b90 con 0x7f62900047d0 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00f040 con 0x7f62900047d0 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a27fc640 1 -- 172.21.15.40:0/3338451443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0ad440 con 0x7f62900047d0 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3338451443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900047d0 msgr2=0x7f6290004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3338451443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900047d0 0x7f6290004c50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f628c009f90 tx=0x7f628c01cc60 comp rx=0 tx=0).stop 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a3fff640 1 -- 172.21.15.40:0/3338451443 reap_dead start 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3338451443 shutdown_connections 2023-11-04T01:42:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3338451443 >> 172.21.15.40:0/3338451443 conn(0x7f62a40ce9e0 msgr2=0x7f62a40cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3338451443 shutdown_connections 2023-11-04T01:42:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.098+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3338451443 wait complete. 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 Processor -- start 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- start start 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62900047d0 0x7f62a40c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 0x7f62a415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a415e6b0 0x7f62a406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41f5ee0 con 0x7f62a41f2180 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40b3220 con 0x7f62900047d0 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40b3500 con 0x7f62a415e6b0 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 0x7f62a415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 0x7f62a415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57340/0 (socket says 172.21.15.40:57340) 2023-11-04T01:42:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3670646484 learned_addr learned my addr 172.21.15.40:0/3670646484 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a37fe640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62900047d0 0x7f62a40c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a3fff640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a415e6b0 0x7f62a406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a415e6b0 msgr2=0x7f62a406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a415e6b0 0x7f62a406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62900047d0 msgr2=0x7f62a40c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62900047d0 0x7f62a40c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 -- 172.21.15.40:0/3670646484 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40b37e0 con 0x7f62a41f2180 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a3fff640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a415e6b0 0x7f62a406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a2ffd640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 0x7f62a415e170 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f628c01ca90 tx=0x7f628c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0adc00 con 0x7f62a41f2180 2023-11-04T01:42:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c0add80 con 0x7f62a41f2180 2023-11-04T01:42:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a40b3ac0 con 0x7f62a41f2180 2023-11-04T01:42:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0b6650 con 0x7f62a41f2180 2023-11-04T01:42:14.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a41f2600 con 0x7f62a41f2180 2023-11-04T01:42:14.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a41f6050 con 0x7f62a41f2180 2023-11-04T01:42:14.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.102+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f628c0b4040 con 0x7f62a41f2180 2023-11-04T01:42:14.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.106+0000 7f629bfff640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62840664a0 0x7f6284068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.106+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f628c11e9f0 con 0x7f62a41f2180 2023-11-04T01:42:14.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.106+0000 7f62a37fe640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62840664a0 0x7f6284068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.106+0000 7f62a37fe640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62840664a0 0x7f6284068960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6294009950 tx=0x7f6294008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.110+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f628c0ebd10 con 0x7f62a41f2180 2023-11-04T01:42:14.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.322+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f62a40744a0 con 0x7f62a41f2180 2023-11-04T01:42:14.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.326+0000 7f629bfff640 1 -- 172.21.15.40:0/3670646484 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f628c0ef330 con 0x7f62a41f2180 2023-11-04T01:42:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-11-04T01:42:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:42:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2023-11-04T01:42:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2023-11-04T01:42:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:14.332 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62840664a0 msgr2=0x7f6284068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62840664a0 0x7f6284068960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6294009950 tx=0x7f6294008040 comp rx=0 tx=0).stop 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 msgr2=0x7f62a415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 0x7f62a415e170 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f628c01ca90 tx=0x7f628c009750 comp rx=0 tx=0).stop 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 shutdown_connections 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62840664a0 0x7f6284068960 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f62a415e6b0 0x7f62a406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a41f2180 0x7f62a415e170 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 --2- 172.21.15.40:0/3670646484 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62900047d0 0x7f62a40c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 >> 172.21.15.40:0/3670646484 conn(0x7f62a40ce9e0 msgr2=0x7f62a406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 shutdown_connections 2023-11-04T01:42:14.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.330+0000 7f62a9d3e640 1 -- 172.21.15.40:0/3670646484 wait complete. 2023-11-04T01:42:14.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:14.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.462+0000 7f16cd18d640 1 Processor -- start 2023-11-04T01:42:14.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.462+0000 7f16cd18d640 1 -- start start 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16cd18d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c815afd0 0x7f16c80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16cd18d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c80b0d40 0x7f16c815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16cd18d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80c2670 con 0x7f16c806f8f0 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16cd18d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8070140 con 0x7f16c80b0d40 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16cd18d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c806c9f0 con 0x7f16c815afd0 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c80b0d40 0x7f16c815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c80b0d40 0x7f16c815ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57350/0 (socket says 172.21.15.40:57350) 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 -- 172.21.15.40:0/4034815483 learned_addr learned my addr 172.21.15.40:0/4034815483 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:14.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c6d9d640 1 --2- 172.21.15.40:0/4034815483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c815afd0 0x7f16c80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 -- 172.21.15.40:0/4034815483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c815afd0 msgr2=0x7f16c80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 --2- 172.21.15.40:0/4034815483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c815afd0 0x7f16c80715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 -- 172.21.15.40:0/4034815483 >> v1:172.21.15.91:6789/0 conn(0x7f16c806f8f0 legacy=0x7f16c80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 -- 172.21.15.40:0/4034815483 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c806bc30 con 0x7f16c80b0d40 2023-11-04T01:42:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c759e640 1 --2- 172.21.15.40:0/4034815483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c815ec80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f16c00098a0 tx=0x7f16c001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32646a4f736e2078 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c5d9b640 1 -- 172.21.15.40:0/4034815483 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00ab670 con 0x7f16c80b0d40 2023-11-04T01:42:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c5d9b640 1 -- 172.21.15.40:0/4034815483 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c00ab7d0 con 0x7f16c80b0d40 2023-11-04T01:42:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.466+0000 7f16c5d9b640 1 -- 172.21.15.40:0/4034815483 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00abb60 con 0x7f16c80b0d40 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/4034815483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 msgr2=0x7f16c815ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 --2- 172.21.15.40:0/4034815483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c815ec80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f16c00098a0 tx=0x7f16c001c4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/4034815483 shutdown_connections 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 --2- 172.21.15.40:0/4034815483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c815ec80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 --2- 172.21.15.40:0/4034815483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c815afd0 0x7f16c80715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/4034815483 >> 172.21.15.40:0/4034815483 conn(0x7f16c80cebb0 msgr2=0x7f16c80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/4034815483 shutdown_connections 2023-11-04T01:42:14.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/4034815483 wait complete. 2023-11-04T01:42:14.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 Processor -- start 2023-11-04T01:42:14.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- start start 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c806f8f0 0x7f16c80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c80b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c815afd0 0x7f16c80b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81f6ce0 con 0x7f16c80b0d40 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81f7540 con 0x7f16c815afd0 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80b4450 con 0x7f16c806f8f0 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c80b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c80b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57360/0 (socket says 172.21.15.40:57360) 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 -- 172.21.15.40:0/3641367292 learned_addr learned my addr 172.21.15.40:0/3641367292 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c6d9d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c806f8f0 0x7f16c80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c759e640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c815afd0 0x7f16c80b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 -- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c806f8f0 msgr2=0x7f16c80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c806f8f0 0x7f16c80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 -- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c815afd0 msgr2=0x7f16c80b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c815afd0 0x7f16c80b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 -- 172.21.15.40:0/3641367292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00094d0 con 0x7f16c80b0d40 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16c659c640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c80b17d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c7f0 tx=0x7f16b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000aa50 con 0x7f16c80b0d40 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b000abb0 con 0x7f16c80b0d40 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c81f6ef0 con 0x7f16c80b0d40 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0012420 con 0x7f16c80b0d40 2023-11-04T01:42:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.470+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c81f79d0 con 0x7f16c80b0d40 2023-11-04T01:42:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.474+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c80744a0 con 0x7f16c80b0d40 2023-11-04T01:42:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.474+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16b0012580 con 0x7f16c80b0d40 2023-11-04T01:42:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.474+0000 7f16bf7fe640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.474+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16b00844f0 con 0x7f16c80b0d40 2023-11-04T01:42:14.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.474+0000 7f16c6d9d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.474+0000 7f16c6d9d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f16b800a8d0 tx=0x7f16b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.478+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f16b00518a0 con 0x7f16c80b0d40 2023-11-04T01:42:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.658+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16c806cba0 con 0x7f16c80b0d40 2023-11-04T01:42:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.658+0000 7f16bf7fe640 1 -- 172.21.15.40:0/3641367292 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f16b0054ec0 con 0x7f16c80b0d40 2023-11-04T01:42:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:14.665 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:05.330601+0000","modified":"2023-11-04T01:42:07.357303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3229855719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3229855719},{"type":"v1","addr":"172.21.15.40:6835","nonce":3229855719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2023-11-04T01:42:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 msgr2=0x7f16a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f16b800a8d0 tx=0x7f16b8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 msgr2=0x7f16c80b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c80b17d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c7f0 tx=0x7f16b000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 shutdown_connections 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c815afd0 0x7f16c80b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c80b0d40 0x7f16c80b17d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 --2- 172.21.15.40:0/3641367292 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c806f8f0 0x7f16c80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 >> 172.21.15.40:0/3641367292 conn(0x7f16c80cebb0 msgr2=0x7f16c81578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 shutdown_connections 2023-11-04T01:42:14.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:14.662+0000 7f16cd18d640 1 -- 172.21.15.40:0/3641367292 wait complete. 2023-11-04T01:42:15.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:42:05.330601+0000', 'modified': '2023-11-04T01:42:07.357303+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6150': {'gid': 6150, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/3229855719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 3229855719}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 3229855719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:42:15.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:42:15.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb41e6640 1 Processor -- start 2023-11-04T01:42:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb41e6640 1 -- start start 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb41e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 0x7f8fac0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb41e6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac0c2670 con 0x7f8fac06f8f0 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb41e6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac06bc30 con 0x7f8fac0b0d40 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb41e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac070140 con 0x7f8fac15afd0 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb1781640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8fac06f8f0 0x7f8fac0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43844/0 (socket says 172.21.15.40:43844) 2023-11-04T01:42:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb1781640 1 -- 172.21.15.40:0/3855716627 learned_addr learned my addr 172.21.15.40:0/3855716627 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 0x7f8fac0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34475235 0 0) 0x7f8fac0c2670 con 0x7f8fac06f8f0 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f98003530 con 0x7f8fac06f8f0 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1160291314 0 0) 0x7f8f98003530 con 0x7f8fac06f8f0 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 msgr2=0x7f8fac0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 0x7f8fac0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 >> v1:172.21.15.91:6789/0 conn(0x7f8fac0b0d40 legacy=0x7f8fac15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac06bf10 con 0x7f8fac06f8f0 2023-11-04T01:42:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8f9c001680 con 0x7f8fac06f8f0 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 >> v1:172.21.15.40:6789/0 conn(0x7f8fac06f8f0 legacy=0x7f8fac0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f980039b0 0x7f8f98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 0x7f8f980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f98004d10 0x7f8f98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac070140 con 0x7f8f98004d10 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9800ba70 con 0x7f8f980039b0 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9800bc30 con 0x7f8fac15afd0 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb2783640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f98004d10 0x7f8f98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb1781640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 0x7f8f980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f980039b0 0x7f8f98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb2783640 1 -- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 msgr2=0x7f8f980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb2783640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac15afd0 0x7f8f980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb2783640 1 -- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f980039b0 msgr2=0x7f8f98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb2783640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f980039b0 0x7f8f98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.214+0000 7f8fb2783640 1 -- 172.21.15.40:0/3855716627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98003530 con 0x7f8f98004d10 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb2783640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f98004d10 0x7f8f98005190 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8fac06f7d0 tx=0x7f8fa401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6a698fdec9f3b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4003b80 con 0x7f8f98004d10 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4003ce0 con 0x7f8f98004d10 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb0f80640 1 -- 172.21.15.40:0/3855716627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4005310 con 0x7f8f98004d10 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb41e6640 1 -- 172.21.15.40:0/3855716627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f98004d10 msgr2=0x7f8f98005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/3855716627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f98004d10 0x7f8f98005190 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8fac06f7d0 tx=0x7f8fa401c700 comp rx=0 tx=0).stop 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb2783640 1 -- 172.21.15.40:0/3855716627 reap_dead start 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb41e6640 1 -- 172.21.15.40:0/3855716627 shutdown_connections 2023-11-04T01:42:15.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb41e6640 1 -- 172.21.15.40:0/3855716627 >> 172.21.15.40:0/3855716627 conn(0x7f8fac0cebb0 msgr2=0x7f8fac0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb41e6640 1 -- 172.21.15.40:0/3855716627 shutdown_connections 2023-11-04T01:42:15.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.218+0000 7f8fb41e6640 1 -- 172.21.15.40:0/3855716627 wait complete. 2023-11-04T01:42:15.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 Processor -- start 2023-11-04T01:42:15.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 -- start start 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fac0cb530 0x7f8fac0ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 0x7f8fac1f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac0cb910 0x7f8fac155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0cd2c0 con 0x7f8fac0cce30 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0cd5a0 con 0x7f8fac0cb530 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0cd880 con 0x7f8fac0cb910 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 0x7f8fac1f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1f82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fac0cb530 0x7f8fac0ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 0x7f8fac1f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57384/0 (socket says 172.21.15.40:57384) 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 -- 172.21.15.40:0/4134814866 learned_addr learned my addr 172.21.15.40:0/4134814866 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb2783640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac0cb910 0x7f8fac155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 -- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac0cb910 msgr2=0x7f8fac155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac0cb910 0x7f8fac155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 -- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fac0cb530 msgr2=0x7f8fac0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fac0cb530 0x7f8fac0ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 -- 172.21.15.40:0/4134814866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0cdb60 con 0x7f8fac0cce30 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb1781640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 0x7f8fac1f3540 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00eb20 tx=0x7f8f9c005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fa27fc640 1 -- 172.21.15.40:0/4134814866 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c001680 con 0x7f8fac0cce30 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fa27fc640 1 -- 172.21.15.40:0/4134814866 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00c8d0 con 0x7f8fac0cce30 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0cde40 con 0x7f8fac0cce30 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fa27fc640 1 -- 172.21.15.40:0/4134814866 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00cc60 con 0x7f8fac0cce30 2023-11-04T01:42:15.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac155a90 con 0x7f8fac0cce30 2023-11-04T01:42:15.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fa27fc640 1 -- 172.21.15.40:0/4134814866 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f9c01d460 con 0x7f8fac0cce30 2023-11-04T01:42:15.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.222+0000 7f8fa27fc640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f900664a0 0x7f8f90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fa27fc640 1 -- 172.21.15.40:0/4134814866 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f9c083ff0 con 0x7f8fac0cce30 2023-11-04T01:42:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f900664a0 0x7f8f90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 Processor -- start 2023-11-04T01:42:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- start start 2023-11-04T01:42:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f900664a0 0x7f8f90068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009ae0 tx=0x7f8fa8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f7192380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 0x5653f7145600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f7145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f7010460 con 0x5653f71928c0 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f6fa1690 con 0x5653f7145b40 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f9ebc0 con 0x5653f7191fa0 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 0x5653f7145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 0x5653f7145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57388/0 (socket says 172.21.15.40:57388) 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 -- 172.21.15.40:0/457060829 learned_addr learned my addr 172.21.15.40:0/457060829 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f7192380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb2783640 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f7145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 -- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 msgr2=0x5653f7192380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f7192380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 -- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 msgr2=0x5653f7145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f7145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 -- 172.21.15.40:0/457060829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f6c92890 con 0x5653f71928c0 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb1781640 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 0x5653f7145600 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c05cd40 tx=0x7f8f9c0557b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84c600d1b3dd91d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8f8f7fe640 1 -- 172.21.15.40:0/457060829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c06c070 con 0x5653f71928c0 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8f8f7fe640 1 -- 172.21.15.40:0/457060829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c05d270 con 0x5653f71928c0 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8f8f7fe640 1 -- 172.21.15.40:0/457060829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00cdc0 con 0x5653f71928c0 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- 172.21.15.40:0/457060829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 msgr2=0x5653f7145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 0x5653f7145600 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c05cd40 tx=0x7f8f9c0557b0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- 172.21.15.40:0/457060829 shutdown_connections 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f7145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f71928c0 0x5653f7145600 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 --2- 172.21.15.40:0/457060829 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f7192380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- 172.21.15.40:0/457060829 >> 172.21.15.40:0/457060829 conn(0x5653f7172d40 msgr2=0x5653f7175130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- 172.21.15.40:0/457060829 shutdown_connections 2023-11-04T01:42:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- 172.21.15.40:0/457060829 wait complete. 2023-11-04T01:42:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 -- start start 2023-11-04T01:42:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.226+0000 7f8fb7313000 1 Processor -- start 2023-11-04T01:42:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 0x5653f714bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f71928c0 0x5653f714c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f9a4b0 con 0x5653f7191fa0 2023-11-04T01:42:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f52aa0 con 0x5653f7145b40 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f58940 con 0x5653f71928c0 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 10 client.0 _ll_register_callbacks cb 0x5653f7133460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 0x5653f714bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 0x5653f714bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57394/0 (socket says 172.21.15.40:57394) 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 -- 172.21.15.40:0/865910007 learned_addr learned my addr 172.21.15.40:0/865910007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb2783640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f71928c0 0x5653f714c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 -- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f71928c0 msgr2=0x5653f714c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f71928c0 0x5653f714c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 -- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 msgr2=0x5653f714b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 -- 172.21.15.40:0/865910007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac155a90 con 0x5653f7191fa0 2023-11-04T01:42:15.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1781640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 0x5653f714bf20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c084250 tx=0x7f8f9c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42d57d44910ed87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 1 -- 172.21.15.40:0/865910007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c070070 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 1 -- 172.21.15.40:0/865910007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f9c053310 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653f6f57e10 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 1 -- 172.21.15.40:0/865910007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9c06c070 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 10 client.6303 fetch_fsmap learned FSMap version 30 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5653f6f5b1a0 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 1 -- 172.21.15.40:0/865910007 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c074020 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 1 -- 172.21.15.40:0/865910007 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8f9c051680 con 0x5653f7191fa0 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 10 client.6303 fetch_fsmap finished waiting for FSMap version 30 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 10 client.6303 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 20 client.6303 populate_metadata read hostname 'smithi040' 2023-11-04T01:42:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f714cd00 0x5653f71a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 4 client.6303 mds_command: new command op to 6150 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 --> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653f6f98e00 con 0x5653f714cd00 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f714cd00 0x5653f71a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 10 client.6303 ms_handle_connect on v2:172.21.15.40:6834/3229855719 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f714cd00 0x5653f71a3720 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89890eb0e4252ac9 server_cookie=502fc7ef212070ef in_seq=0 out_seq=0 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 1 -- 172.21.15.40:0/865910007 <== mds.0 v2:172.21.15.40:6834/3229855719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653f6f98e00 con 0x5653f714cd00 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 10 client.6303 handle_command_reply: tid=0 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 client.6303 shutdown 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 msgr2=0x5653f714bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 0x5653f714bf20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c084250 tx=0x7f8f9c012000 comp rx=0 tx=0).stop 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 shutdown_connections 2023-11-04T01:42:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f714cd00 0x5653f71a3720 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f71928c0 0x5653f714c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7191fa0 0x5653f714bf20 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8f8cff9640 0 client.6303 ms_handle_reset on v2:172.21.15.40:6834/3229855719 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 --2- 172.21.15.40:0/865910007 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 >> 172.21.15.40:0/865910007 conn(0x5653f7172d40 msgr2=0x5653f7175130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 shutdown_connections 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 1 -- 172.21.15.40:0/865910007 wait complete. 2023-11-04T01:42:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.230+0000 7f8fb7313000 20 client.6303 trim_cache size 0 max 16384 2023-11-04T01:42:15.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.246+0000 7f8fb7313000 1 Processor -- start 2023-11-04T01:42:15.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.246+0000 7f8fb7313000 1 -- start start 2023-11-04T01:42:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 0x5653f7191690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f714dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f6c53940 con 0x5653f7172d40 2023-11-04T01:42:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f99340 con 0x5653f7145b40 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f9e4b0 con 0x5653f7191fa0 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 0x5653f7191690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 0x5653f7191690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57410/0 (socket says 172.21.15.40:57410) 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/2213391162 learned_addr learned my addr 172.21.15.40:0/2213391162 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1781640 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb2783640 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f714dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 msgr2=0x5653f714dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f714dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 msgr2=0x5653f714d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/2213391162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f6f414a0 con 0x5653f7172d40 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1781640 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 0x5653f7191690 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x5653f714d0e0 tx=0x7f8fa8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df18ab7c1d0aebe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8f8ffff640 1 -- 172.21.15.40:0/2213391162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa802a040 con 0x5653f7172d40 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8f8ffff640 1 -- 172.21.15.40:0/2213391162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa802d3f0 con 0x5653f7172d40 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8f8ffff640 1 -- 172.21.15.40:0/2213391162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa802d760 con 0x5653f7172d40 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- 172.21.15.40:0/2213391162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 msgr2=0x5653f7191690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 0x5653f7191690 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x5653f714d0e0 tx=0x7f8fa8017000 comp rx=0 tx=0).stop 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- 172.21.15.40:0/2213391162 shutdown_connections 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7191fa0 0x5653f714dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7145b40 0x5653f714d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- 172.21.15.40:0/2213391162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7172d40 0x5653f7191690 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- 172.21.15.40:0/2213391162 >> 172.21.15.40:0/2213391162 conn(0x5653f714bb70 msgr2=0x5653f714d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- 172.21.15.40:0/2213391162 shutdown_connections 2023-11-04T01:42:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- 172.21.15.40:0/2213391162 wait complete. 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- start start 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 Processor -- start 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 0x5653f71a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7172d40 0x5653f71af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7191fa0 0x5653f71af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f947b0 con 0x5653f7145b40 2023-11-04T01:42:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f7145a00 con 0x5653f7191fa0 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f6f978b0 con 0x5653f7172d40 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb7313000 10 client.0 _ll_register_callbacks cb 0x7f8f9c051330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 0x5653f71a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 0x5653f71a4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57426/0 (socket says 172.21.15.40:57426) 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/3426177750 learned_addr learned my addr 172.21.15.40:0/3426177750 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7172d40 msgr2=0x5653f71af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7172d40 0x5653f71af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7191fa0 msgr2=0x5653f71af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb2783640 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7191fa0 0x5653f71af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7191fa0 0x5653f71af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 -- 172.21.15.40:0/3426177750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa8014a90 con 0x5653f7145b40 2023-11-04T01:42:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8fb1f82640 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 0x5653f71a4fc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8008010 tx=0x7f8fa8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d2591a5a68165d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.250+0000 7f8f8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 1 -- 172.21.15.40:0/3426177750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8003620 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 1 -- 172.21.15.40:0/3426177750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fa803ac30 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653f6f64d10 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 1 -- 172.21.15.40:0/3426177750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa803ae10 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 10 client.6309 fetch_fsmap learned FSMap version 30 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5653f6c92cc0 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 1 -- 172.21.15.40:0/3426177750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653f6f64d10 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 1 -- 172.21.15.40:0/3426177750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8fa802d050 con 0x5653f7145b40 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 10 client.6309 fetch_fsmap finished waiting for FSMap version 30 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 10 client.6309 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:42:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 20 client.6309 populate_metadata read hostname 'smithi040' 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f71928c0 0x5653f71f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 4 client.6309 mds_command: new command op to 6150 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 --> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653f6f93490 con 0x5653f71928c0 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb1781640 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f71928c0 0x5653f71f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 10 client.6309 ms_handle_connect on v2:172.21.15.40:6834/3229855719 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb1781640 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f71928c0 0x5653f71f28d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76cc5439e62bc8de server_cookie=5cb44dd30ff31f54 in_seq=0 out_seq=0 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 1 -- 172.21.15.40:0/3426177750 <== mds.0 v2:172.21.15.40:6834/3229855719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5653f6f93490 con 0x5653f71928c0 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 10 client.6309 handle_command_reply: tid=0 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 client.6309 shutdown 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 msgr2=0x5653f71a4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 0x5653f71a4fc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8008010 tx=0x7f8fa8004740 comp rx=0 tx=0).stop 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 shutdown_connections 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:6834/3229855719,v1:172.21.15.40:6835/3229855719] conn(0x5653f71928c0 0x5653f71f28d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5653f7191fa0 0x5653f71af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5653f7172d40 0x5653f71af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 --2- 172.21.15.40:0/3426177750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5653f7145b40 0x5653f71a4fc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8f8cff9640 0 client.6309 ms_handle_reset on v2:172.21.15.40:6834/3229855719 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 >> 172.21.15.40:0/3426177750 conn(0x5653f714bb70 msgr2=0x5653f714d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 shutdown_connections 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 1 -- 172.21.15.40:0/3426177750 wait complete. 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb7313000 20 client.6309 trim_cache size 0 max 16384 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:42:15.265 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 6150, 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 9.2548896769999995, 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 30, 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 62, 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 62, 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 15.01651736 2023-11-04T01:42:15.266 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f900664a0 msgr2=0x7f8f90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f900664a0 0x7f8f90068960 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009ae0 tx=0x7f8fa8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 msgr2=0x7f8fac1f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 0x7f8fac1f3540 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00eb20 tx=0x7f8f9c005e20 comp rx=0 tx=0).stop 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 shutdown_connections 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f900664a0 0x7f8f90068960 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8fac0cb910 0x7f8fac155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac0cce30 0x7f8fac1f3540 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 --2- 172.21.15.40:0/4134814866 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8fac0cb530 0x7f8fac0ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 >> 172.21.15.40:0/4134814866 conn(0x7f8fac0cebb0 msgr2=0x7f8fac0b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 shutdown_connections 2023-11-04T01:42:15.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.254+0000 7f8fb41e6640 1 -- 172.21.15.40:0/4134814866 wait complete. 2023-11-04T01:42:15.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 Processor -- start 2023-11-04T01:42:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 -- start start 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f415afd0 0x7fb4f40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb4f406f8f0 0x7fb4f40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f40c2670 con 0x7fb4f40b0b70 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f4070140 con 0x7fb4f415afd0 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f8e3b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f415fc90 con 0x7fb4f406f8f0 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f415afd0 0x7fb4f40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f415afd0 0x7fb4f40715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57436/0 (socket says 172.21.15.40:57436) 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 -- 172.21.15.40:0/795241105 learned_addr learned my addr 172.21.15.40:0/795241105 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f1d9b640 1 --2- 172.21.15.40:0/795241105 >> v2:172.21.15.91:3300/0 conn(0x7fb4f406f8f0 0x7fb4f40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 -- 172.21.15.40:0/795241105 >> v2:172.21.15.91:3300/0 conn(0x7fb4f406f8f0 msgr2=0x7fb4f40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 --2- 172.21.15.40:0/795241105 >> v2:172.21.15.91:3300/0 conn(0x7fb4f406f8f0 0x7fb4f40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 -- 172.21.15.40:0/795241105 >> v1:172.21.15.91:6789/0 conn(0x7fb4f40b0b70 legacy=0x7fb4f40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.386+0000 7fb4f259c640 1 -- 172.21.15.40:0/795241105 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f406bc30 con 0x7fb4f415afd0 2023-11-04T01:42:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 --2- 172.21.15.40:0/795241105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f415afd0 0x7fb4f40715d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40ce900 tx=0x7fb4e401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8180ae2dc855f208 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f159a640 1 -- 172.21.15.40:0/795241105 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40ab600 con 0x7fb4f415afd0 2023-11-04T01:42:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f159a640 1 -- 172.21.15.40:0/795241105 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40a7050 con 0x7fb4f415afd0 2023-11-04T01:42:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f159a640 1 -- 172.21.15.40:0/795241105 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40ab980 con 0x7fb4f415afd0 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/795241105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f415afd0 msgr2=0x7fb4f40715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/795241105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f415afd0 0x7fb4f40715d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40ce900 tx=0x7fb4e401c4c0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/795241105 shutdown_connections 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/795241105 >> v2:172.21.15.91:3300/0 conn(0x7fb4f406f8f0 0x7fb4f40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/795241105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f415afd0 0x7fb4f40715d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/795241105 >> 172.21.15.40:0/795241105 conn(0x7fb4f40cebb0 msgr2=0x7fb4f40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/795241105 shutdown_connections 2023-11-04T01:42:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/795241105 wait complete. 2023-11-04T01:42:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 Processor -- start 2023-11-04T01:42:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- start start 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 0x7fb4f40c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4f40b0b70 0x7fb4f40b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4f415afd0 0x7fb4f4151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b1bf0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40c8300 con 0x7fb4f40b0b70 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f8e3b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40c85e0 con 0x7fb4f415afd0 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 0x7fb4f40c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 0x7fb4f40c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57438/0 (socket says 172.21.15.40:57438) 2023-11-04T01:42:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 -- 172.21.15.40:0/2216588419 learned_addr learned my addr 172.21.15.40:0/2216588419 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 -- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4f415afd0 msgr2=0x7fb4f4151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4f415afd0 0x7fb4f4151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 -- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4f40b0b70 msgr2=0x7fb4f40b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f1d9b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4f40b0b70 0x7fb4f40b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4f40b0b70 0x7fb4f40b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 -- 172.21.15.40:0/2216588419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40094d0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.390+0000 7fb4f259c640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 0x7fb4f40c5bf0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40ae040 tx=0x7fb4e401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b6620 con 0x7fb4f406f8f0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40abe90 con 0x7fb4f406f8f0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40b69e0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f40c88c0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40c6130 con 0x7fb4f406f8f0 2023-11-04T01:42:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f40b1dc0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4e40b2040 con 0x7fb4f406f8f0 2023-11-04T01:42:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4e2ffd640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4d40664a0 0x7fb4d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4e411e480 con 0x7fb4f406f8f0 2023-11-04T01:42:15.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4f1d9b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4d40664a0 0x7fb4d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.394+0000 7fb4f1d9b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4d40664a0 0x7fb4d4068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4156ab0 tx=0x7fb4e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.398+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4f40b1dc0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4f40b1dc0 con 0x7fb4f406f8f0 2023-11-04T01:42:15.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4e2ffd640 1 -- 172.21.15.40:0/2216588419 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4e40eb790 con 0x7fb4f406f8f0 2023-11-04T01:42:15.595 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:15.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4d40664a0 msgr2=0x7fb4d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4d40664a0 0x7fb4d4068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4156ab0 tx=0x7fb4e8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 msgr2=0x7fb4f40c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 0x7fb4f40c5bf0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40ae040 tx=0x7fb4e401ad00 comp rx=0 tx=0).stop 2023-11-04T01:42:15.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 shutdown_connections 2023-11-04T01:42:15.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4d40664a0 0x7fb4d4068960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4f415afd0 0x7fb4f4151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4f40b0b70 0x7fb4f40b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 --2- 172.21.15.40:0/2216588419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f406f8f0 0x7fb4f40c5bf0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 >> 172.21.15.40:0/2216588419 conn(0x7fb4f40cebb0 msgr2=0x7fb4f40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 shutdown_connections 2023-11-04T01:42:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:15.590+0000 7fb4f8e3b640 1 -- 172.21.15.40:0/2216588419 wait complete. 2023-11-04T01:42:15.613 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:15.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:15.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:42:15.614 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:15.614 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:15.614 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:15.614 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:15.614 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:15.614 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:15.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:15.614 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:42:15.620 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:15.621 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42138sec preferred_lft 42138sec 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.622 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:42:15.623 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:15.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:15.624 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:15.670 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:42:15.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:15.672 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:42:15.719 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:42:15.720 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:15.720 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:42:15.720 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:42:15.720 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:42:15.720 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:15.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:15.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:42:15.720 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:42:15.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:42:15.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:42:15.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:42:15.721 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:42:15.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:15.795 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:42:15.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:15.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:15.843 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:15.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:15.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:42:15.902 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:15.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:15.902 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:15.951 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:15.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:15.951 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:16.003 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:16.051 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:42:16.052 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:42:16.053 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:16.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:16.055 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:42:16.103 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:16.103 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:16.147 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:16.154 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:42:16.154 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:42:16.154 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:42:16.155 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:42:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:16.157 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:16.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:16.159 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:42:16.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:42:16.226+0000 7fc866436580 -1 init, newargv = 0x560ce65b1770 newargc=15 2023-11-04T01:42:16.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[52101]: starting ceph client 2023-11-04T01:42:16.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[52101]: starting fuse 2023-11-04T01:42:17.308 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:17.319 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:42:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:17.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:17.321 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:42:17.366 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:42:17.367 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:17.367 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:42:17.368 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:42:17.369 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:17.369 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:17.369 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:17.369 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:42:17.494 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.52101.asok 2023-11-04T01:42:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:17.507 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52101.asok 2023-11-04T01:42:17.507 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:17.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.52101.asok status 2023-11-04T01:42:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:17.710 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:42:17.710 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:42:17.710 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:17.710 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:17.710 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:42:17.710 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "52101", 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 6324, 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 6324 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2153217865 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2153217865 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.6324 192.168.0.1:0/2153217865", 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2153217865", 2023-11-04T01:42:17.712 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:42:17.713 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 30, 2023-11-04T01:42:17.713 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 62, 2023-11-04T01:42:17.713 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:17.713 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:42:17.713 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:42:17.713 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:42:17.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:17.730 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:17.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:17.731 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:17.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:17.782 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:42:17.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:17.789 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:17.789 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:17.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:17.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:17.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-04T01:42:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.958+0000 7ffab8d2e640 1 Processor -- start 2023-11-04T01:42:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab8d2e640 1 -- start start 2023-11-04T01:42:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab8d2e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffab415af50 0x7ffab40cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab8d2e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffab40b32f0 0x7ffab40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab8d2e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab40cd830 con 0x7ffab40cf4c0 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab8d2e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40b3780 con 0x7ffab40b32f0 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab8d2e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40cdad0 con 0x7ffab415af50 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffab40b32f0 0x7ffab40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffab40b32f0 0x7ffab40ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45892/0 (socket says 172.21.15.40:45892) 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 -- 172.21.15.40:0/2576602333 learned_addr learned my addr 172.21.15.40:0/2576602333 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab2d9d640 1 --1- 172.21.15.40:0/2576602333 >> v1:172.21.15.40:6789/0 conn(0x7ffab40cf4c0 0x7ffab415e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34180/0 (socket says 172.21.15.40:34180) 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab259c640 1 --2- 172.21.15.40:0/2576602333 >> v2:172.21.15.91:3300/0 conn(0x7ffab415af50 0x7ffab40cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 -- 172.21.15.40:0/2576602333 >> v2:172.21.15.91:3300/0 conn(0x7ffab415af50 msgr2=0x7ffab40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 --2- 172.21.15.40:0/2576602333 >> v2:172.21.15.91:3300/0 conn(0x7ffab415af50 0x7ffab40cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 -- 172.21.15.40:0/2576602333 >> v1:172.21.15.40:6789/0 conn(0x7ffab40cf4c0 legacy=0x7ffab415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab159a640 1 -- 172.21.15.40:0/2576602333 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132515483 0 0) 0x7ffab40cd830 con 0x7ffab40cf4c0 2023-11-04T01:42:17.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.962+0000 7ffab1d9b640 1 -- 172.21.15.40:0/2576602333 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40cddb0 con 0x7ffab40b32f0 2023-11-04T01:42:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab1d9b640 1 --2- 172.21.15.40:0/2576602333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab40b32f0 0x7ffab40ce8b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffab40681a0 tx=0x7ffaa801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cd3673fc30d88f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab159a640 1 -- 172.21.15.40:0/2576602333 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80aa5f0 con 0x7ffab40b32f0 2023-11-04T01:42:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab159a640 1 -- 172.21.15.40:0/2576602333 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80aa750 con 0x7ffab40b32f0 2023-11-04T01:42:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab159a640 1 -- 172.21.15.40:0/2576602333 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80aaae0 con 0x7ffab40b32f0 2023-11-04T01:42:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- 172.21.15.40:0/2576602333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab40b32f0 msgr2=0x7ffab40ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/2576602333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab40b32f0 0x7ffab40ce8b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ffab40681a0 tx=0x7ffaa801c470 comp rx=0 tx=0).stop 2023-11-04T01:42:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- 172.21.15.40:0/2576602333 shutdown_connections 2023-11-04T01:42:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/2576602333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab40b32f0 0x7ffab40ce8b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/2576602333 >> v2:172.21.15.91:3300/0 conn(0x7ffab415af50 0x7ffab40cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- 172.21.15.40:0/2576602333 >> 172.21.15.40:0/2576602333 conn(0x7ffab4065dc0 msgr2=0x7ffab40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- 172.21.15.40:0/2576602333 shutdown_connections 2023-11-04T01:42:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- 172.21.15.40:0/2576602333 wait complete. 2023-11-04T01:42:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 Processor -- start 2023-11-04T01:42:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- start start 2023-11-04T01:42:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffab40cf4c0 0x7ffab415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffab415af50 0x7ffab40b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 0x7ffab4151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab41511f0 con 0x7ffab4151fd0 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab415be60 con 0x7ffab415af50 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab8d2e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab415c0b0 con 0x7ffab40cf4c0 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 0x7ffab4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 0x7ffab4151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45902/0 (socket says 172.21.15.40:45902) 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.966+0000 7ffab2d9d640 1 -- 172.21.15.40:0/3614817895 learned_addr learned my addr 172.21.15.40:0/3614817895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab1d9b640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffab415af50 0x7ffab40b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab259c640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffab40cf4c0 0x7ffab415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab2d9d640 1 -- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffab40cf4c0 msgr2=0x7ffab415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab2d9d640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffab40cf4c0 0x7ffab415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab2d9d640 1 -- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffab415af50 msgr2=0x7ffab40b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab2d9d640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffab415af50 0x7ffab40b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab2d9d640 1 -- 172.21.15.40:0/3614817895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80094d0 con 0x7ffab4151fd0 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab1d9b640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffab415af50 0x7ffab40b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab2d9d640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 0x7ffab4151610 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c470 tx=0x7ffaac00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0074e0 con 0x7ffab4151fd0 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac007640 con 0x7ffab4151fd0 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab4150b30 con 0x7ffab4151fd0 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac004a30 con 0x7ffab4151fd0 2023-11-04T01:42:17.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab415c390 con 0x7ffab4151fd0 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab4151330 con 0x7ffab4151fd0 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffaac004b90 con 0x7ffab4151fd0 2023-11-04T01:42:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffaa2ffd640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffa940664a0 0x7ffa94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffaac083460 con 0x7ffab4151fd0 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.970+0000 7ffab259c640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffa940664a0 0x7ffa94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.974+0000 7ffab259c640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffa940664a0 0x7ffa94068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4003fd0 tx=0x7ffaa40039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:17.974+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffab4151330 con 0x7ffab4151fd0 2023-11-04T01:42:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:18.134+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7ffab4151330 con 0x7ffab4151fd0 2023-11-04T01:42:19.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.074+0000 7ffaa2ffd640 1 -- 172.21.15.40:0/3614817895 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v63) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffab4151330 con 0x7ffab4151fd0 2023-11-04T01:42:19.081 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'test_data_pool' created 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffa940664a0 msgr2=0x7ffa94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffa940664a0 0x7ffa94068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4003fd0 tx=0x7ffaa40039a0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 msgr2=0x7ffab4151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 0x7ffab4151610 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c470 tx=0x7ffaac00c930 comp rx=0 tx=0).stop 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 shutdown_connections 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ffa940664a0 0x7ffa94068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffab4151fd0 0x7ffab4151610 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffab415af50 0x7ffab40b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 --2- 172.21.15.40:0/3614817895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffab40cf4c0 0x7ffab415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 >> 172.21.15.40:0/3614817895 conn(0x7ffab4065dc0 msgr2=0x7ffab40b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 shutdown_connections 2023-11-04T01:42:19.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.078+0000 7ffab8d2e640 1 -- 172.21.15.40:0/3614817895 wait complete. 2023-11-04T01:42:19.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-04T01:42:19.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.238+0000 7f70eb696640 1 Processor -- start 2023-11-04T01:42:19.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.238+0000 7f70eb696640 1 -- start start 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.238+0000 7f70eb696640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 0x7f70e415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.238+0000 7f70eb696640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40cb130 con 0x7f70e415acb0 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.238+0000 7f70eb696640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e415b680 con 0x7f70e415c160 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.238+0000 7f70eb696640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415bd40 con 0x7f70e40b0c20 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e9432640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70e415acb0 0x7f70e40b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34196/0 (socket says 172.21.15.40:34196) 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e9432640 1 -- 172.21.15.40:0/898881759 learned_addr learned my addr 172.21.15.40:0/898881759 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 0x7f70e415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691960631 0 0) 0x7f70e40cb130 con 0x7f70e415acb0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d0003530 con 0x7f70e415acb0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211116544 0 0) 0x7f70d0003530 con 0x7f70e415acb0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 msgr2=0x7f70e415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 0x7f70e415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 >> v1:172.21.15.91:6789/0 conn(0x7f70e415c160 legacy=0x7f70e40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e415b960 con 0x7f70e415acb0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f70e0001680 con 0x7f70e415acb0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 >> v1:172.21.15.40:6789/0 conn(0x7f70e415acb0 legacy=0x7f70e40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70d00039b0 0x7f70d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70d00047d0 0x7f70d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 0x7f70d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415bd40 con 0x7f70d00047d0 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d000ba40 con 0x7f70d00039b0 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d000bc00 con 0x7f70e40b0c20 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70d00047d0 0x7f70d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e9432640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70d00039b0 0x7f70d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e9c33640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 0x7f70d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 -- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 msgr2=0x7f70d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70e40b0c20 0x7f70d0005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 -- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70d00039b0 msgr2=0x7f70d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70d00039b0 0x7f70d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 -- 172.21.15.40:0/898881759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0003530 con 0x7f70d00047d0 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e8c31640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70d00047d0 0x7f70d0004c50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ab0 tx=0x7f70d401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e518af57db03967 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40a6500 con 0x7f70d00047d0 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d40a6660 con 0x7f70d00047d0 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70dbfff640 1 -- 172.21.15.40:0/898881759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40a6a10 con 0x7f70d00047d0 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70eb696640 1 -- 172.21.15.40:0/898881759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70d00047d0 msgr2=0x7f70d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70eb696640 1 --2- 172.21.15.40:0/898881759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70d00047d0 0x7f70d0004c50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ab0 tx=0x7f70d401ca10 comp rx=0 tx=0).stop 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.242+0000 7f70e9c33640 1 -- 172.21.15.40:0/898881759 reap_dead start 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- 172.21.15.40:0/898881759 shutdown_connections 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- 172.21.15.40:0/898881759 >> 172.21.15.40:0/898881759 conn(0x7f70e40cb510 msgr2=0x7f70e40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- 172.21.15.40:0/898881759 shutdown_connections 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- 172.21.15.40:0/898881759 wait complete. 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 Processor -- start 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- start start 2023-11-04T01:42:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70d00047d0 0x7f70e4152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70e40c6ed0 0x7f70e414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 0x7f70e40b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c7350 con 0x7f70e40c8600 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e414f460 con 0x7f70e40c6ed0 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c8170 con 0x7f70d00047d0 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 0x7f70e40b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 0x7f70e40b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45918/0 (socket says 172.21.15.40:45918) 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 -- 172.21.15.40:0/1220586732 learned_addr learned my addr 172.21.15.40:0/1220586732 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9432640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70d00047d0 0x7f70e4152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e8c31640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70e40c6ed0 0x7f70e414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 -- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70d00047d0 msgr2=0x7f70e4152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70d00047d0 0x7f70e4152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 -- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70e40c6ed0 msgr2=0x7f70e414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70e40c6ed0 0x7f70e414ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 -- 172.21.15.40:0/1220586732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40c7560 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e8c31640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70e40c6ed0 0x7f70e414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9432640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70d00047d0 0x7f70e4152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70e9c33640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 0x7f70e40b2930 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b47e0 tx=0x7f70dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc003b80 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc003ce0 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e40c7840 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc005290 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.246+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e40c7e00 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.250+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e40744a0 con 0x7f70e40c8600 2023-11-04T01:42:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.250+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70dc0053f0 con 0x7f70e40c8600 2023-11-04T01:42:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.250+0000 7f70d9ffb640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70c80664a0 0x7f70c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.250+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6415+0+0 (secure 0 0 0) 0x7f70dc083ff0 con 0x7f70e40c8600 2023-11-04T01:42:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.250+0000 7f70e9432640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70c80664a0 0x7f70c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.250+0000 7f70e9432640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70c80664a0 0x7f70c8068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f70e0001060 tx=0x7f70e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.254+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f70dc0511f0 con 0x7f70e40c8600 2023-11-04T01:42:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:19.410+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f70e40c82b0 con 0x7f70e40c8600 2023-11-04T01:42:20.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.090+0000 7f70d9ffb640 1 -- 172.21.15.40:0/1220586732 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v64) v1 ==== 126+0+0 (secure 0 0 0) 0x7f70dc018020 con 0x7f70e40c8600 2023-11-04T01:42:20.096 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'test_metadata_pool' created 2023-11-04T01:42:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70c80664a0 msgr2=0x7f70c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70c80664a0 0x7f70c8068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f70e0001060 tx=0x7f70e0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 msgr2=0x7f70e40b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 0x7f70e40b2930 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b47e0 tx=0x7f70dc00dc00 comp rx=0 tx=0).stop 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 shutdown_connections 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70c80664a0 0x7f70c8068960 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e40c8600 0x7f70e40b2930 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70e40c6ed0 0x7f70e414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 --2- 172.21.15.40:0/1220586732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f70d00047d0 0x7f70e4152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 >> 172.21.15.40:0/1220586732 conn(0x7f70e40cb510 msgr2=0x7f70e415a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 shutdown_connections 2023-11-04T01:42:20.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.094+0000 7f70eb696640 1 -- 172.21.15.40:0/1220586732 wait complete. 2023-11-04T01:42:20.142 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-04T01:42:20.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 Processor -- start 2023-11-04T01:42:20.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 -- start start 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 0x556c632b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d85c0 0x556c632972a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c6320bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63187190 con 0x556c631d81e0 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c6313efc0 con 0x556c632afc50 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc913499080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c6313ecc0 con 0x556c631d85c0 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 0x556c632b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 0x556c632b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45936/0 (socket says 172.21.15.40:45936) 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 -- 172.21.15.40:0/947018331 learned_addr learned my addr 172.21.15.40:0/947018331 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc9107b7640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d85c0 0x556c632972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc9117b9640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c6320bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 -- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d85c0 msgr2=0x556c632972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d85c0 0x556c632972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 -- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 msgr2=0x556c6320bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c6320bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 -- 172.21.15.40:0/947018331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90800a1c0 con 0x556c631d81e0 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc9107b7640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d85c0 0x556c632972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc9117b9640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c6320bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc910fb8640 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 0x556c632b1cb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc90000a6f0 tx=0x7fc90000abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f992acf632ebf4e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc90f7b5640 1 -- 172.21.15.40:0/947018331 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000f070 con 0x556c631d81e0 2023-11-04T01:42:20.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc90f7b5640 1 -- 172.21.15.40:0/947018331 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000ae00 con 0x556c631d81e0 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.170+0000 7fc90f7b5640 1 -- 172.21.15.40:0/947018331 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900008c10 con 0x556c631d81e0 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/947018331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 msgr2=0x556c632b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 0x556c632b1cb0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc90000a6f0 tx=0x7fc90000abb0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/947018331 shutdown_connections 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c6320bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d85c0 0x556c632972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- 172.21.15.40:0/947018331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d81e0 0x556c632b1cb0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/947018331 >> 172.21.15.40:0/947018331 conn(0x556c631de690 msgr2=0x556c632b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/947018331 shutdown_connections 2023-11-04T01:42:20.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/947018331 wait complete. 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 Processor -- start 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- start start 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d81e0 0x556c63208320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 0x556c632abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c632923e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c631152c0 con 0x556c631d85c0 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c632ab320 con 0x556c632afc50 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c632ab080 con 0x556c631d81e0 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 0x556c632abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 0x556c632abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45952/0 (socket says 172.21.15.40:45952) 2023-11-04T01:42:20.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 -- 172.21.15.40:0/1258910097 learned_addr learned my addr 172.21.15.40:0/1258910097 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc910fb8640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d81e0 0x556c63208320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9117b9640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c632923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 -- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d81e0 msgr2=0x556c63208320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d81e0 0x556c63208320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 -- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 msgr2=0x556c632923e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c632923e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 -- 172.21.15.40:0/1258910097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90000a430 con 0x556c631d85c0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9117b9640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c632923e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc9107b7640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 0x556c632abb70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc90400df10 tx=0x7fc90400b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9040032d0 con 0x556c631d85c0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904001460 con 0x556c631d85c0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c6312d420 con 0x556c631d85c0 2023-11-04T01:42:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c631205d0 con 0x556c631d85c0 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.174+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9040017d0 con 0x556c631d85c0 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.178+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc904001930 con 0x556c631d85c0 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.178+0000 7fc90e7b3640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8fc064e80 0x7fc8fc067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.178+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc904082ef0 con 0x556c631d85c0 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.178+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- pool_op(create snap pool 11 tid 1 name snap4 v0) v4 -- 0x556c63191110 con 0x556c631d85c0 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.178+0000 7fc910fb8640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8fc064e80 0x7fc8fc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:20.178+0000 7fc910fb8640 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8fc064e80 0x7fc8fc067340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc90000afd0 tx=0x7fc900012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.102+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v65) v1 ==== 43+0+0 (secure 0 0 0) 0x7fc90404ffd0 con 0x556c631d85c0 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.102+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=65}) v3 -- 0x7fc8fc06f050 con 0x556c631d85c0 2023-11-04T01:42:21.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.102+0000 7fc90e7b3640 1 -- 172.21.15.40:0/1258910097 <== mon.0 v2:172.21.15.40:3300/0 7 ==== osd_map(65..65 src has 1..65) v4 ==== 718+0+0 (secure 0 0 0) 0x7fc904054390 con 0x556c631d85c0 2023-11-04T01:42:21.117 INFO:teuthology.orchestra.run.smithi040.stdout:created pool test_data_pool snap snap4 2023-11-04T01:42:21.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.114+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8fc064e80 msgr2=0x7fc8fc067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.114+0000 7fc913499080 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8fc064e80 0x7fc8fc067340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc90000afd0 tx=0x7fc900012000 comp rx=0 tx=0).stop 2023-11-04T01:42:21.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.114+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 msgr2=0x556c632abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.114+0000 7fc913499080 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 0x556c632abb70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc90400df10 tx=0x7fc90400b5c0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.118+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 shutdown_connections 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.118+0000 7fc913499080 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8fc064e80 0x7fc8fc067340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.118+0000 7fc913499080 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x556c632afc50 0x556c632923e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.118+0000 7fc913499080 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556c631d85c0 0x556c632abb70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.118+0000 7fc913499080 1 --2- 172.21.15.40:0/1258910097 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x556c631d81e0 0x556c63208320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.118+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 >> 172.21.15.40:0/1258910097 conn(0x556c631de690 msgr2=0x556c632b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.122+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 shutdown_connections 2023-11-04T01:42:21.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.122+0000 7fc913499080 1 -- 172.21.15.40:0/1258910097 wait complete. 2023-11-04T01:42:21.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-04T01:42:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 Processor -- start 2023-11-04T01:42:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 -- start start 2023-11-04T01:42:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cd670 0x7f48700ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f487006cfc0 0x7f487015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4870160c50 con 0x7f48700cda50 2023-11-04T01:42:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700cedf0 con 0x7f487006cfc0 2023-11-04T01:42:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4876e34640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870160ef0 con 0x7f48700cd670 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f486ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f487006cfc0 0x7f487015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f48753d1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f48700cda50 0x7f48700af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34202/0 (socket says 172.21.15.40:34202) 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f48753d1640 1 -- 172.21.15.40:0/1430867660 learned_addr learned my addr 172.21.15.40:0/1430867660 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4874bd0640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cd670 0x7f48700ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f486ffff640 1 -- 172.21.15.40:0/1430867660 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cd670 msgr2=0x7f48700ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f486ffff640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cd670 0x7f48700ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f486ffff640 1 -- 172.21.15.40:0/1430867660 >> v1:172.21.15.40:6789/0 conn(0x7f48700cda50 legacy=0x7f48700af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f486ffff640 1 -- 172.21.15.40:0/1430867660 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48701611d0 con 0x7f487006cfc0 2023-11-04T01:42:21.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.306+0000 7f4874bd0640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cd670 0x7f48700ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f486ffff640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f487015cb80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f48600097c0 tx=0x7f486001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcfd3d60b7b6862 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f486f7fe640 1 -- 172.21.15.40:0/1430867660 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600ab650 con 0x7f487006cfc0 2023-11-04T01:42:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f486f7fe640 1 -- 172.21.15.40:0/1430867660 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600ab7b0 con 0x7f487006cfc0 2023-11-04T01:42:21.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f486f7fe640 1 -- 172.21.15.40:0/1430867660 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600abb40 con 0x7f487006cfc0 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 -- 172.21.15.40:0/1430867660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 msgr2=0x7f487015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f487015cb80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f48600097c0 tx=0x7f486001c450 comp rx=0 tx=0).stop 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 -- 172.21.15.40:0/1430867660 shutdown_connections 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f487015cb80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 --2- 172.21.15.40:0/1430867660 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cd670 0x7f48700ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 -- 172.21.15.40:0/1430867660 >> 172.21.15.40:0/1430867660 conn(0x7f4870065dc0 msgr2=0x7f48700661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 -- 172.21.15.40:0/1430867660 shutdown_connections 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 -- 172.21.15.40:0/1430867660 wait complete. 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 Processor -- start 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.310+0000 7f4876e34640 1 -- start start 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f4870158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48700cd670 0x7f48700c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cda50 0x7f487015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487015fac0 con 0x7f487006cfc0 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700c7700 con 0x7f48700cd670 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48700c7140 con 0x7f48700cda50 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f4870158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f4870158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45962/0 (socket says 172.21.15.40:45962) 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 -- 172.21.15.40:0/3595486245 learned_addr learned my addr 172.21.15.40:0/3595486245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486ffff640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48700cd670 0x7f48700c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f48753d1640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cda50 0x7f487015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 -- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cda50 msgr2=0x7f487015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f48700cda50 0x7f487015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 -- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48700cd670 msgr2=0x7f48700c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48700cd670 0x7f48700c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 -- 172.21.15.40:0/3595486245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009420 con 0x7f487006cfc0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4874bd0640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487006cfc0 0x7f4870158f10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f486400d7d0 tx=0x7f486400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640059a0 con 0x7f487006cfc0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864005b00 con 0x7f487006cfc0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864005e90 con 0x7f487006cfc0 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 -- 172.21.15.40:0/3595486245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48700c7420 con 0x7f487006cfc0 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 -- 172.21.15.40:0/3595486245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487015dab0 con 0x7f487006cfc0 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f4876e34640 1 -- 172.21.15.40:0/3595486245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700b6c60 con 0x7f487006cfc0 2023-11-04T01:42:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4864004030 con 0x7f487006cfc0 2023-11-04T01:42:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486d7fa640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664a0 0x7f485c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6811+0+0 (secure 0 0 0) 0x7f48640842f0 con 0x7f487006cfc0 2023-11-04T01:42:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.314+0000 7f486ffff640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664a0 0x7f485c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.318+0000 7f486ffff640 1 --2- 172.21.15.40:0/3595486245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664a0 0x7f485c068960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f48600af000 tx=0x7f48600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.322+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4864051310 con 0x7f487006cfc0 2023-11-04T01:42:21.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.510+0000 7f4876e34640 1 -- 172.21.15.40:0/3595486245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f487006c0d0 con 0x7f487006cfc0 2023-11-04T01:42:21.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.514+0000 7f486d7fa640 1 -- 172.21.15.40:0/3595486245 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(11) already has mon-managed snaps; can't attach pool to fs v30) v1 ==== 198+0+0 (secure 0 0 0) 0x7f4864059e60 con 0x7f487006cfc0 2023-11-04T01:42:21.518 INFO:teuthology.orchestra.run.smithi040.stderr:Error ENOTSUP: pool(11) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:42:21.524 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:42:21.525 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-04T01:42:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 Processor -- start 2023-11-04T01:42:21.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- start start 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 0x5563a12cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1216f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12ce1d0 0x5563a1243d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a11c3190 con 0x5563a12405c0 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a117afc0 con 0x5563a12ce1d0 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563a117acc0 con 0x5563a12409a0 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 0x5563a12cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 0x5563a12cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45970/0 (socket says 172.21.15.40:45970) 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 -- 172.21.15.40:0/2381362020 learned_addr learned my addr 172.21.15.40:0/2381362020 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df864640 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12ce1d0 0x5563a1243d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6de862640 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1216f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 -- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 msgr2=0x5563a1216f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1216f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 -- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12ce1d0 msgr2=0x5563a1243d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12ce1d0 0x5563a1243d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 -- 172.21.15.40:0/2381362020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d4005d30 con 0x5563a12405c0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6df063640 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 0x5563a12cd9d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0001d10 tx=0x7fe6d000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4b8963df24a514 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6dd860640 1 -- 172.21.15.40:0/2381362020 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000bea0 con 0x5563a12405c0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6dd860640 1 -- 172.21.15.40:0/2381362020 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000e690 con 0x5563a12405c0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6dd860640 1 -- 172.21.15.40:0/2381362020 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000ea40 con 0x5563a12405c0 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- 172.21.15.40:0/2381362020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 msgr2=0x5563a12cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 0x5563a12cd9d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0001d10 tx=0x7fe6d000b6d0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- 172.21.15.40:0/2381362020 shutdown_connections 2023-11-04T01:42:21.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12ce1d0 0x5563a1243d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1216f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 --2- 172.21.15.40:0/2381362020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12405c0 0x5563a12cd9d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- 172.21.15.40:0/2381362020 >> 172.21.15.40:0/2381362020 conn(0x5563a123ef00 msgr2=0x5563a12ed1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- 172.21.15.40:0/2381362020 shutdown_connections 2023-11-04T01:42:21.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- 172.21.15.40:0/2381362020 wait complete. 2023-11-04T01:42:21.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 Processor -- start 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.558+0000 7fe6e1544080 1 -- start start 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12405c0 0x5563a123ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1384f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 0x5563a1385440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a11512c0 con 0x5563a12ce1d0 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a123da70 con 0x5563a12405c0 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563a123e1e0 con 0x5563a12409a0 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 0x5563a1385440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 0x5563a1385440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45978/0 (socket says 172.21.15.40:45978) 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 -- 172.21.15.40:0/1876695667 learned_addr learned my addr 172.21.15.40:0/1876695667 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df063640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12405c0 0x5563a123ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6de862640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1384f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 -- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 msgr2=0x5563a1384f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1384f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 -- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12405c0 msgr2=0x5563a123ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12405c0 0x5563a123ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 -- 172.21.15.40:0/1876695667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8001e20 con 0x5563a12ce1d0 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6de862640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1384f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df864640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 0x5563a1385440 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800e290 tx=0x7fe6d800e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8013870 con 0x5563a12ce1d0 2023-11-04T01:42:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d80139f0 con 0x5563a12ce1d0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5563a1169420 con 0x5563a12ce1d0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8013da0 con 0x5563a12ce1d0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563a115c5d0 con 0x5563a12ce1d0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6d8014410 con 0x5563a12ce1d0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6dc85e640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe6cc064e80 0x7fe6cc067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6811+0+0 (secure 0 0 0) 0x7fe6d80838d0 con 0x5563a12ce1d0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6df063640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe6cc064e80 0x7fe6cc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.562+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- pool_op(delete snap pool 11 tid 1 name snap4 v0) v4 -- 0x5563a11cd110 con 0x5563a12ce1d0 2023-11-04T01:42:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:21.566+0000 7fe6df063640 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe6cc064e80 0x7fe6cc067340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0011040 tx=0x7fe6d0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.110+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v66) v1 ==== 43+0+0 (secure 0 0 0) 0x7fe6d8050a50 con 0x5563a12ce1d0 2023-11-04T01:42:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.110+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=66}) v3 -- 0x7fe6cc06f0b0 con 0x5563a12ce1d0 2023-11-04T01:42:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6dc85e640 1 -- 172.21.15.40:0/1876695667 <== mon.0 v2:172.21.15.40:3300/0 7 ==== osd_map(66..66 src has 1..66) v4 ==== 970+0+0 (secure 0 0 0) 0x7fe6d8054e10 con 0x5563a12ce1d0 2023-11-04T01:42:22.119 INFO:teuthology.orchestra.run.smithi040.stdout:removed pool test_data_pool snap snap4 2023-11-04T01:42:22.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe6cc064e80 msgr2=0x7fe6cc067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe6cc064e80 0x7fe6cc067340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0011040 tx=0x7fe6d0009000 comp rx=0 tx=0).stop 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 msgr2=0x5563a1385440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 0x5563a1385440 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800e290 tx=0x7fe6d800e750 comp rx=0 tx=0).stop 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 shutdown_connections 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe6cc064e80 0x7fe6cc067340 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5563a12ce1d0 0x5563a1385440 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5563a12409a0 0x5563a1384f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 --2- 172.21.15.40:0/1876695667 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5563a12405c0 0x5563a123ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 >> 172.21.15.40:0/1876695667 conn(0x5563a123ef00 msgr2=0x5563a12162c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 shutdown_connections 2023-11-04T01:42:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.114+0000 7fe6e1544080 1 -- 172.21.15.40:0/1876695667 wait complete. 2023-11-04T01:42:22.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-04T01:42:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5529975640 1 Processor -- start 2023-11-04T01:42:22.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5529975640 1 -- start start 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5529975640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55240b0c20 0x7f552406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5529975640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552406c010 con 0x7f552415d290 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5529975640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240ac960 con 0x7f552406b840 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5529975640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55240c90e0 con 0x7f55240b0c20 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f55227fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55240b0c20 0x7f552406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5522ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f552415d290 0x7f55240b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34210/0 (socket says 172.21.15.40:34210) 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f55227fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55240b0c20 0x7f552406b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45988/0 (socket says 172.21.15.40:45988) 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f5522ffd640 1 -- 172.21.15.40:0/2538684990 learned_addr learned my addr 172.21.15.40:0/2538684990 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f55227fc640 1 -- 172.21.15.40:0/2538684990 >> v1:172.21.15.91:6789/0 conn(0x7f552406b840 legacy=0x7f5524160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f55227fc640 1 -- 172.21.15.40:0/2538684990 >> v1:172.21.15.40:6789/0 conn(0x7f552415d290 legacy=0x7f55240b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.302+0000 7f55227fc640 1 -- 172.21.15.40:0/2538684990 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240acc40 con 0x7f55240b0c20 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f55227fc640 1 --2- 172.21.15.40:0/2538684990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f552406b300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f550c0097c0 tx=0x7f550c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add25d78e4a6af77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5521ffb640 1 -- 172.21.15.40:0/2538684990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0ab610 con 0x7f55240b0c20 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5521ffb640 1 -- 172.21.15.40:0/2538684990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0ab770 con 0x7f55240b0c20 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5521ffb640 1 -- 172.21.15.40:0/2538684990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0abb00 con 0x7f55240b0c20 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- 172.21.15.40:0/2538684990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 msgr2=0x7f552406b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 --2- 172.21.15.40:0/2538684990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f552406b300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f550c0097c0 tx=0x7f550c01c410 comp rx=0 tx=0).stop 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- 172.21.15.40:0/2538684990 shutdown_connections 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 --2- 172.21.15.40:0/2538684990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f552406b300 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- 172.21.15.40:0/2538684990 >> 172.21.15.40:0/2538684990 conn(0x7f55240cb510 msgr2=0x7f55240cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- 172.21.15.40:0/2538684990 shutdown_connections 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- 172.21.15.40:0/2538684990 wait complete. 2023-11-04T01:42:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 Processor -- start 2023-11-04T01:42:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- start start 2023-11-04T01:42:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f552406b840 0x7f55240b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f55240b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f552415d290 0x7f55240afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240cdc60 con 0x7f55240b0c20 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240af8c0 con 0x7f552415d290 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f5529975640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5524151320 con 0x7f552406b840 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.306+0000 7f55227fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f55240b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f55240b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45994/0 (socket says 172.21.15.40:45994) 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 -- 172.21.15.40:0/835013788 learned_addr learned my addr 172.21.15.40:0/835013788 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55237fe640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f552415d290 0x7f55240afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f5522ffd640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f552406b840 0x7f55240b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 -- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f552406b840 msgr2=0x7f55240b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f552406b840 0x7f55240b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 -- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f552415d290 msgr2=0x7f55240afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f552415d290 0x7f55240afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 -- 172.21.15.40:0/835013788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009420 con 0x7f55240b0c20 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55237fe640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f552415d290 0x7f55240afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f55227fc640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55240b0c20 0x7f55240b3fd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f550c0ad040 tx=0x7f550c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0b5810 con 0x7f55240b0c20 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0b5990 con 0x7f55240b0c20 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f5529975640 1 -- 172.21.15.40:0/835013788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55240cd400 con 0x7f55240b0c20 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0b5d40 con 0x7f55240b0c20 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f5529975640 1 -- 172.21.15.40:0/835013788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55240cd980 con 0x7f55240b0c20 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f5529975640 1 -- 172.21.15.40:0/835013788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55240afa50 con 0x7f55240b0c20 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f550c0bf410 con 0x7f55240b0c20 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f551bfff640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55040664d0 0x7f5504068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f550c11ee90 con 0x7f55240b0c20 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f5522ffd640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55040664d0 0x7f5504068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.310+0000 7f5522ffd640 1 --2- 172.21.15.40:0/835013788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55040664d0 0x7f5504068990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5514005c10 tx=0x7f5514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.314+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f550c0ebf40 con 0x7f55240b0c20 2023-11-04T01:42:22.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.474+0000 7f5529975640 1 -- 172.21.15.40:0/835013788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f55240744a0 con 0x7f55240b0c20 2023-11-04T01:42:22.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.474+0000 7f551bfff640 1 -- 172.21.15.40:0/835013788 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v66) v1 ==== 296+0+0 (secure 0 0 0) 0x7f550c0ef560 con 0x7f55240b0c20 2023-11-04T01:42:22.480 INFO:teuthology.orchestra.run.smithi040.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:42:22.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:22.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-04T01:42:22.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 Processor -- start 2023-11-04T01:42:22.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 -- start start 2023-11-04T01:42:22.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f687806cfc0 0x7f687815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68780cda50 0x7f687815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6878160c50 con 0x7f68780cd670 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687815d600 con 0x7f687806cfc0 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687e489640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6878160ef0 con 0x7f68780cda50 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f68777fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f687806cfc0 0x7f687815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f68777fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f687806cfc0 0x7f687815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46010/0 (socket says 172.21.15.40:46010) 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f68777fe640 1 -- 172.21.15.40:0/2948557895 learned_addr learned my addr 172.21.15.40:0/2948557895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f687ca26640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68780cda50 0x7f687815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f68777fe640 1 -- 172.21.15.40:0/2948557895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68780cda50 msgr2=0x7f687815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f68777fe640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68780cda50 0x7f687815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.602+0000 7f68777fe640 1 -- 172.21.15.40:0/2948557895 >> v1:172.21.15.91:6789/0 conn(0x7f68780cd670 legacy=0x7f68780ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f68777fe640 1 -- 172.21.15.40:0/2948557895 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68781611d0 con 0x7f687806cfc0 2023-11-04T01:42:22.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687ca26640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68780cda50 0x7f687815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f68777fe640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f687806cfc0 0x7f687815cb80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6868009870 tx=0x7f686801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314ccd510d448248 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f6876ffd640 1 -- 172.21.15.40:0/2948557895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680aa670 con 0x7f687806cfc0 2023-11-04T01:42:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f6876ffd640 1 -- 172.21.15.40:0/2948557895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680aa7d0 con 0x7f687806cfc0 2023-11-04T01:42:22.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f6876ffd640 1 -- 172.21.15.40:0/2948557895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680aab60 con 0x7f687806cfc0 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 -- 172.21.15.40:0/2948557895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f687806cfc0 msgr2=0x7f687815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f687806cfc0 0x7f687815cb80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6868009870 tx=0x7f686801c510 comp rx=0 tx=0).stop 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 -- 172.21.15.40:0/2948557895 shutdown_connections 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68780cda50 0x7f687815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 --2- 172.21.15.40:0/2948557895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f687806cfc0 0x7f687815cb80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 -- 172.21.15.40:0/2948557895 >> 172.21.15.40:0/2948557895 conn(0x7f6878065dc0 msgr2=0x7f68780661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 -- 172.21.15.40:0/2948557895 shutdown_connections 2023-11-04T01:42:22.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.606+0000 7f687e489640 1 -- 172.21.15.40:0/2948557895 wait complete. 2023-11-04T01:42:22.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 Processor -- start 2023-11-04T01:42:22.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- start start 2023-11-04T01:42:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f687806cfc0 0x7f687814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68780cd670 0x7f68780c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68780cda50 0x7f68780d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780ca970 con 0x7f68780cda50 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c9d60 con 0x7f68780cd670 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780ca040 con 0x7f687806cfc0 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68780cda50 0x7f68780d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68780cda50 0x7f68780d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46020/0 (socket says 172.21.15.40:46020) 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 -- 172.21.15.40:0/4188721427 learned_addr learned my addr 172.21.15.40:0/4188721427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f68777fe640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68780cd670 0x7f68780c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6877fff640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f687806cfc0 0x7f687814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 -- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f687806cfc0 msgr2=0x7f687814f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f687806cfc0 0x7f687814f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 -- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68780cd670 msgr2=0x7f68780c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68780cd670 0x7f68780c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 -- 172.21.15.40:0/4188721427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680094d0 con 0x7f68780cda50 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f68777fe640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68780cd670 0x7f68780c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6877fff640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f687806cfc0 0x7f687814f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687ca26640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68780cda50 0x7f68780d0f70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f687000cd50 tx=0x7f687000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000f680 con 0x7f68780cda50 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687000f800 con 0x7f68780cda50 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- 172.21.15.40:0/4188721427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68780ca320 con 0x7f68780cda50 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000fbb0 con 0x7f68780cda50 2023-11-04T01:42:22.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- 172.21.15.40:0/4188721427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780c7fd0 con 0x7f68780cda50 2023-11-04T01:42:22.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f687e489640 1 -- 172.21.15.40:0/4188721427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68780caae0 con 0x7f68780cda50 2023-11-04T01:42:22.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f687000b040 con 0x7f68780cda50 2023-11-04T01:42:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.610+0000 7f6874ff9640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68640664d0 0x7f6864068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.614+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f6870084ca0 con 0x7f68780cda50 2023-11-04T01:42:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.614+0000 7f6877fff640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68640664d0 0x7f6864068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.614+0000 7f6877fff640 1 --2- 172.21.15.40:0/4188721427 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68640664d0 0x7f6864068990 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f686c007fd0 tx=0x7f686c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.618+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6870051d50 con 0x7f68780cda50 2023-11-04T01:42:22.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.778+0000 7f687e489640 1 -- 172.21.15.40:0/4188721427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f68780675f0 con 0x7f68780cda50 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:22.778+0000 7f6874ff9640 1 -- 172.21.15.40:0/4188721427 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v66) v1 ==== 304+0+0 (secure 0 0 0) 0x7f6870055370 con 0x7f68780cda50 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:42:22.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:22.790 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:22.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:22.835 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:22.899 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:22.900 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:42:22.900 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:22.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 Processor -- start 2023-11-04T01:42:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 -- start start 2023-11-04T01:42:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb0bc0722e0 0x7fb0bc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc0b4270 con 0x7fb0bc15d540 2023-11-04T01:42:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc06ad60 con 0x7fb0bc0722e0 2023-11-04T01:42:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0c1377640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc06cb40 con 0x7fb0bc06a370 2023-11-04T01:42:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0bb7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0ba7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb0bc0722e0 0x7fb0bc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0baffd640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb0bc15d540 0x7fb0bc06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48434/0 (socket says 172.21.15.40:48434) 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0baffd640 1 -- 172.21.15.40:0/3203171643 learned_addr learned my addr 172.21.15.40:0/3203171643 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0ba7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb0bc0722e0 0x7fb0bc0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:36216/0 (socket says 172.21.15.40:36216) 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0bb7fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc06a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:55794/0 (socket says 172.21.15.40:55794) 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 msgr2=0x7fb0bc06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0ba7fc640 1 --2- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc06a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/3203171643 >> v1:172.21.15.91:6789/0 conn(0x7fb0bc15d540 legacy=0x7fb0bc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.070+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/3203171643 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc06ce20 con 0x7fb0bc0722e0 2023-11-04T01:42:23.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0ba7fc640 1 --2- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc0b4f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40097c0 tx=0x7fb0a401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90f1e57d2e5dad5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0b9ffb640 1 -- 172.21.15.40:0/3203171643 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40ab600 con 0x7fb0bc0722e0 2023-11-04T01:42:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0b9ffb640 1 -- 172.21.15.40:0/3203171643 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a40a7050 con 0x7fb0bc0722e0 2023-11-04T01:42:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0b9ffb640 1 -- 172.21.15.40:0/3203171643 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40ab980 con 0x7fb0bc0722e0 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 -- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc0722e0 msgr2=0x7fb0bc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 --2- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc0b4f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40097c0 tx=0x7fb0a401c330 comp rx=0 tx=0).stop 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 -- 172.21.15.40:0/3203171643 shutdown_connections 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 --2- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc06a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 --2- 172.21.15.40:0/3203171643 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc0b4f10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 -- 172.21.15.40:0/3203171643 >> 172.21.15.40:0/3203171643 conn(0x7fb0bc0716a0 msgr2=0x7fb0bc071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 -- 172.21.15.40:0/3203171643 shutdown_connections 2023-11-04T01:42:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 -- 172.21.15.40:0/3203171643 wait complete. 2023-11-04T01:42:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 Processor -- start 2023-11-04T01:42:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.074+0000 7fb0c1377640 1 -- start start 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc1f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc15d540 0x7fb0bc1f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc1f6750 con 0x7fb0bc0722e0 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0c7d10 con 0x7fb0bc15d540 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0c7ff0 con 0x7fb0bc06a370 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc1f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46032/0 (socket says 172.21.15.40:46032) 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/2192428592 learned_addr learned my addr 172.21.15.40:0/2192428592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0bb7fe640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc15d540 0x7fb0bc1f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0baffd640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc1f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 msgr2=0x7fb0bc1f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc1f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc15d540 msgr2=0x7fb0bc1f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc15d540 0x7fb0bc1f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 -- 172.21.15.40:0/2192428592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4009420 con 0x7fb0bc0722e0 2023-11-04T01:42:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0ba7fc640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc1f5b10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb0a401a9e0 tx=0x7fb0a40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40b4400 con 0x7fb0bc0722e0 2023-11-04T01:42:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a40b4580 con 0x7fb0bc0722e0 2023-11-04T01:42:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40b4930 con 0x7fb0bc0722e0 2023-11-04T01:42:23.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc1f69a0 con 0x7fb0bc0722e0 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc1f90c0 con 0x7fb0bc0722e0 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc0675f0 con 0x7fb0bc0722e0 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0a40b2040 con 0x7fb0bc0722e0 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.078+0000 7fb0b37fe640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb09c0664d0 0x7fb09c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.082+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fb0a411e280 con 0x7fb0bc0722e0 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.082+0000 7fb0baffd640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb09c0664d0 0x7fb09c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.082+0000 7fb0baffd640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb09c0664d0 0x7fb09c068990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0012f0 tx=0x7fb0ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.086+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb0a40eb220 con 0x7fb0bc0722e0 2023-11-04T01:42:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.242+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0bc1f6e50 con 0x7fb0bc0722e0 2023-11-04T01:42:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0b37fe640 1 -- 172.21.15.40:0/2192428592 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+21783 (secure 0 0 0) 0x7fb0a40ee840 con 0x7fb0bc0722e0 2023-11-04T01:42:23.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:23.251 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":66,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:22.098775+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb09c0664d0 msgr2=0x7fb09c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb09c0664d0 0x7fb09c068990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0012f0 tx=0x7fb0ac009040 comp rx=0 tx=0).stop 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 msgr2=0x7fb0bc1f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc1f5b10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb0a401a9e0 tx=0x7fb0a40190d0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 shutdown_connections 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb09c0664d0 0x7fb09c068990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb0bc15d540 0x7fb0bc1f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0bc0722e0 0x7fb0bc1f5b10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 --2- 172.21.15.40:0/2192428592 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb0bc06a370 0x7fb0bc1f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 >> 172.21.15.40:0/2192428592 conn(0x7fb0bc0716a0 msgr2=0x7fb0bc0b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 shutdown_connections 2023-11-04T01:42:23.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.246+0000 7fb0c1377640 1 -- 172.21.15.40:0/2192428592 wait complete. 2023-11-04T01:42:23.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:03.913153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:04.307758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:23.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71cb8e8640 1 Processor -- start 2023-11-04T01:42:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71cb8e8640 1 -- start start 2023-11-04T01:42:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71cb8e8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71c415acb0 0x7f71c415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71cb8e8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40cb130 con 0x7f71c40b0c20 2023-11-04T01:42:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71cb8e8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c415b680 con 0x7f71c415c160 2023-11-04T01:42:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71cb8e8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c415bd40 con 0x7f71c415acb0 2023-11-04T01:42:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71c9e85640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f71c40b0c20 0x7f71c40ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34220/0 (socket says 172.21.15.40:34220) 2023-11-04T01:42:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71c9e85640 1 -- 172.21.15.40:0/666922831 learned_addr learned my addr 172.21.15.40:0/666922831 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71c9684640 1 --2- 172.21.15.40:0/666922831 >> v2:172.21.15.40:3300/0 conn(0x7f71c415acb0 0x7f71c415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71bbfff640 1 -- 172.21.15.40:0/666922831 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748885932 0 0) 0x7f71c40cb130 con 0x7f71c40b0c20 2023-11-04T01:42:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71bbfff640 1 -- 172.21.15.40:0/666922831 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b0003530 con 0x7f71c40b0c20 2023-11-04T01:42:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71c9684640 1 -- 172.21.15.40:0/666922831 >> v1:172.21.15.91:6789/0 conn(0x7f71c415c160 legacy=0x7f71c40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71c9684640 1 -- 172.21.15.40:0/666922831 >> v1:172.21.15.40:6789/0 conn(0x7f71c40b0c20 legacy=0x7f71c40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.398+0000 7f71c9684640 1 -- 172.21.15.40:0/666922831 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c415b960 con 0x7f71c415acb0 2023-11-04T01:42:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71c9684640 1 --2- 172.21.15.40:0/666922831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415acb0 0x7f71c415b090 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f71c00097f0 tx=0x7f71c001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549bcda7af47c7f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71bbfff640 1 -- 172.21.15.40:0/666922831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c00a8050 con 0x7f71c415acb0 2023-11-04T01:42:23.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71bbfff640 1 -- 172.21.15.40:0/666922831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c00ac5f0 con 0x7f71c415acb0 2023-11-04T01:42:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71bbfff640 1 -- 172.21.15.40:0/666922831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c00ac980 con 0x7f71c415acb0 2023-11-04T01:42:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- 172.21.15.40:0/666922831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415acb0 msgr2=0x7f71c415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/666922831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415acb0 0x7f71c415b090 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f71c00097f0 tx=0x7f71c001c480 comp rx=0 tx=0).stop 2023-11-04T01:42:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- 172.21.15.40:0/666922831 shutdown_connections 2023-11-04T01:42:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/666922831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415acb0 0x7f71c415b090 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- 172.21.15.40:0/666922831 >> 172.21.15.40:0/666922831 conn(0x7f71c40cb510 msgr2=0x7f71c40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- 172.21.15.40:0/666922831 shutdown_connections 2023-11-04T01:42:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- 172.21.15.40:0/666922831 wait complete. 2023-11-04T01:42:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 Processor -- start 2023-11-04T01:42:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- start start 2023-11-04T01:42:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71c40b0c20 0x7f71c40c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71c415acb0 0x7f71c4149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 0x7f71c4147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4148020 con 0x7f71c415c160 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4149ca0 con 0x7f71c415acb0 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71cb8e8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4147d80 con 0x7f71c40b0c20 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71c9e85640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 0x7f71c4147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71c9e85640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 0x7f71c4147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46038/0 (socket says 172.21.15.40:46038) 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71c9e85640 1 -- 172.21.15.40:0/1710536869 learned_addr learned my addr 172.21.15.40:0/1710536869 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.402+0000 7f71c8e83640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71c415acb0 0x7f71c4149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9684640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71c40b0c20 0x7f71c40c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9e85640 1 -- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71c40b0c20 msgr2=0x7f71c40c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9e85640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71c40b0c20 0x7f71c40c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9e85640 1 -- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71c415acb0 msgr2=0x7f71c4149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9e85640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71c415acb0 0x7f71c4149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9e85640 1 -- 172.21.15.40:0/1710536869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0009420 con 0x7f71c415c160 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9e85640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 0x7f71c4147840 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00cae0 tx=0x7f71bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00ac40 con 0x7f71c415c160 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00ada0 con 0x7f71c415c160 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c414c1f0 con 0x7f71c415c160 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc012640 con 0x7f71c415c160 2023-11-04T01:42:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c414c7b0 con 0x7f71c415c160 2023-11-04T01:42:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c40744a0 con 0x7f71c415c160 2023-11-04T01:42:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71bc007070 con 0x7f71c415c160 2023-11-04T01:42:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71b9ffb640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71a80664a0 0x7f71a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f71bc084210 con 0x7f71c415c160 2023-11-04T01:42:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9684640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71a80664a0 0x7f71a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.406+0000 7f71c9684640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71a80664a0 0x7f71a8068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f71c00ae000 tx=0x7f71c00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.410+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71bc0512e0 con 0x7f71c415c160 2023-11-04T01:42:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.566+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71c415b1a0 con 0x7f71c415c160 2023-11-04T01:42:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.566+0000 7f71b9ffb640 1 -- 172.21.15.40:0/1710536869 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71bc054900 con 0x7f71c415c160 2023-11-04T01:42:23.573 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71a80664a0 msgr2=0x7f71a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71a80664a0 0x7f71a8068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f71c00ae000 tx=0x7f71c00a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 msgr2=0x7f71c4147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 0x7f71c4147840 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00cae0 tx=0x7f71bc00a060 comp rx=0 tx=0).stop 2023-11-04T01:42:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 shutdown_connections 2023-11-04T01:42:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f71a80664a0 0x7f71a8068960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c415c160 0x7f71c4147840 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f71c415acb0 0x7f71c4149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 --2- 172.21.15.40:0/1710536869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f71c40b0c20 0x7f71c40c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 >> 172.21.15.40:0/1710536869 conn(0x7f71c40cb510 msgr2=0x7f71c40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 shutdown_connections 2023-11-04T01:42:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.570+0000 7f71cb8e8640 1 -- 172.21.15.40:0/1710536869 wait complete. 2023-11-04T01:42:23.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:23.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.714+0000 7fb656955640 1 Processor -- start 2023-11-04T01:42:23.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.714+0000 7fb656955640 1 -- start start 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb656955640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6500d0ad0 0x7fb6500d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb656955640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6500d08e0 con 0x7fb65015d6c0 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb656955640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6500d2080 con 0x7fb6500b5090 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb656955640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500d2360 con 0x7fb6500d0ad0 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb65015d6c0 0x7fb6500b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34222/0 (socket says 172.21.15.40:34222) 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64ffff640 1 -- 172.21.15.40:0/2584921597 learned_addr learned my addr 172.21.15.40:0/2584921597 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb654ef2640 1 --2- 172.21.15.40:0/2584921597 >> v2:172.21.15.40:3300/0 conn(0x7fb6500d0ad0 0x7fb6500d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64effd640 1 -- 172.21.15.40:0/2584921597 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058911644 0 0) 0x7fb6500d08e0 con 0x7fb65015d6c0 2023-11-04T01:42:23.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64effd640 1 -- 172.21.15.40:0/2584921597 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb63c003530 con 0x7fb65015d6c0 2023-11-04T01:42:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb654ef2640 1 -- 172.21.15.40:0/2584921597 >> v1:172.21.15.91:6789/0 conn(0x7fb6500b5090 legacy=0x7fb6500b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb654ef2640 1 -- 172.21.15.40:0/2584921597 >> v1:172.21.15.40:6789/0 conn(0x7fb65015d6c0 legacy=0x7fb6500b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb654ef2640 1 -- 172.21.15.40:0/2584921597 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6500d2640 con 0x7fb6500d0ad0 2023-11-04T01:42:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb654ef2640 1 --2- 172.21.15.40:0/2584921597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500d19c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb648009d90 tx=0x7fb64801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d417a1f7e6ba23bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64effd640 1 -- 172.21.15.40:0/2584921597 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6480af600 con 0x7fb6500d0ad0 2023-11-04T01:42:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64effd640 1 -- 172.21.15.40:0/2584921597 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6480ab050 con 0x7fb6500d0ad0 2023-11-04T01:42:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.718+0000 7fb64effd640 1 -- 172.21.15.40:0/2584921597 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6480af960 con 0x7fb6500d0ad0 2023-11-04T01:42:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/2584921597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 msgr2=0x7fb6500d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 --2- 172.21.15.40:0/2584921597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500d19c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb648009d90 tx=0x7fb64801f130 comp rx=0 tx=0).stop 2023-11-04T01:42:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/2584921597 shutdown_connections 2023-11-04T01:42:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 --2- 172.21.15.40:0/2584921597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500d19c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/2584921597 >> 172.21.15.40:0/2584921597 conn(0x7fb6500cf980 msgr2=0x7fb6500cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/2584921597 shutdown_connections 2023-11-04T01:42:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/2584921597 wait complete. 2023-11-04T01:42:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 Processor -- start 2023-11-04T01:42:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- start start 2023-11-04T01:42:23.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6500b5090 0x7fb650157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb65015d6c0 0x7fb6501f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650157cb0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500cb970 con 0x7fb65015d6c0 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500cbc50 con 0x7fb6500b5090 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46062/0 (socket says 172.21.15.40:46062) 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 -- 172.21.15.40:0/3423156825 learned_addr learned my addr 172.21.15.40:0/3423156825 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb654ef2640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb65015d6c0 0x7fb6501f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64ffff640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6500b5090 0x7fb650157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 -- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6500b5090 msgr2=0x7fb650157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6500b5090 0x7fb650157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 -- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb65015d6c0 msgr2=0x7fb6501f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb65015d6c0 0x7fb6501f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 -- 172.21.15.40:0/3423156825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb648009a70 con 0x7fb6500d0ad0 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64ffff640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6500b5090 0x7fb650157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64f7fe640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500cca10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c420 tx=0x7fb64000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400052d0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb640005430 con 0x7fb6500d0ad0 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6500cbf30 con 0x7fb6500d0ad0 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640007260 con 0x7fb6500d0ad0 2023-11-04T01:42:23.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.722+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6500cc4f0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.726+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6500cc6e0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.726+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6400073c0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.726+0000 7fb64cff9640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6300664d0 0x7fb630068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.726+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fb640083700 con 0x7fb6500d0ad0 2023-11-04T01:42:23.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.726+0000 7fb64ffff640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6300664d0 0x7fb630068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.726+0000 7fb64ffff640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6300664d0 0x7fb630068990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb6380011f0 tx=0x7fb638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.730+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb640050680 con 0x7fb6500d0ad0 2023-11-04T01:42:23.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.886+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb6500675f0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.886+0000 7fb64cff9640 1 -- 172.21.15.40:0/3423156825 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v66) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb640053ca0 con 0x7fb6500d0ad0 2023-11-04T01:42:23.892 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:23.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6300664d0 msgr2=0x7fb630068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6300664d0 0x7fb630068990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb6380011f0 tx=0x7fb638009040 comp rx=0 tx=0).stop 2023-11-04T01:42:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 msgr2=0x7fb6500cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500cca10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c420 tx=0x7fb64000c8e0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 shutdown_connections 2023-11-04T01:42:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb6300664d0 0x7fb630068990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb65015d6c0 0x7fb6501f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6500d0ad0 0x7fb6500cca10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 --2- 172.21.15.40:0/3423156825 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb6500b5090 0x7fb650157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 >> 172.21.15.40:0/3423156825 conn(0x7fb6500cf980 msgr2=0x7fb65015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 shutdown_connections 2023-11-04T01:42:23.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:23.890+0000 7fb656955640 1 -- 172.21.15.40:0/3423156825 wait complete. 2023-11-04T01:42:23.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 Processor -- start 2023-11-04T01:42:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 -- start start 2023-11-04T01:42:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f424415af50 0x7f42440cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42440b32f0 0x7f42440ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440cd830 con 0x7f42440cf4c0 2023-11-04T01:42:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440b3780 con 0x7f424415af50 2023-11-04T01:42:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f424b090640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440cdad0 con 0x7f42440b32f0 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f424415af50 0x7f42440cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f424415af50 0x7f42440cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46072/0 (socket says 172.21.15.40:46072) 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 -- 172.21.15.40:0/4060029757 learned_addr learned my addr 172.21.15.40:0/4060029757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4243fff640 1 --2- 172.21.15.40:0/4060029757 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42440b32f0 0x7f42440ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 -- 172.21.15.40:0/4060029757 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42440b32f0 msgr2=0x7f42440ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 --2- 172.21.15.40:0/4060029757 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42440b32f0 0x7f42440ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 -- 172.21.15.40:0/4060029757 >> v1:172.21.15.91:6789/0 conn(0x7f42440cf4c0 legacy=0x7f424415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.030+0000 7f4248e2c640 1 -- 172.21.15.40:0/4060029757 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440cddb0 con 0x7f424415af50 2023-11-04T01:42:24.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f4248e2c640 1 --2- 172.21.15.40:0/4060029757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f424415af50 0x7f42440cb330 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f423c006fd0 tx=0x7f423c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aabb99f95b62e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f42437fe640 1 -- 172.21.15.40:0/4060029757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0aa610 con 0x7f424415af50 2023-11-04T01:42:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f42437fe640 1 -- 172.21.15.40:0/4060029757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0a6040 con 0x7f424415af50 2023-11-04T01:42:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f42437fe640 1 -- 172.21.15.40:0/4060029757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0aa990 con 0x7f424415af50 2023-11-04T01:42:24.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 -- 172.21.15.40:0/4060029757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f424415af50 msgr2=0x7f42440cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 --2- 172.21.15.40:0/4060029757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f424415af50 0x7f42440cb330 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f423c006fd0 tx=0x7f423c01c490 comp rx=0 tx=0).stop 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 -- 172.21.15.40:0/4060029757 shutdown_connections 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 --2- 172.21.15.40:0/4060029757 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f42440b32f0 0x7f42440ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 --2- 172.21.15.40:0/4060029757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f424415af50 0x7f42440cb330 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 -- 172.21.15.40:0/4060029757 >> 172.21.15.40:0/4060029757 conn(0x7f4244065dc0 msgr2=0x7f42440661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 -- 172.21.15.40:0/4060029757 shutdown_connections 2023-11-04T01:42:24.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 -- 172.21.15.40:0/4060029757 wait complete. 2023-11-04T01:42:24.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 Processor -- start 2023-11-04T01:42:24.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.034+0000 7f424b090640 1 -- start start 2023-11-04T01:42:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 0x7f4244148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f424415af50 0x7f42440c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42440c97c0 0x7f4244146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c9d00 con 0x7f42440cf4c0 2023-11-04T01:42:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c9fe0 con 0x7f42440c97c0 2023-11-04T01:42:24.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440ca2c0 con 0x7f424415af50 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 0x7f4244148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 0x7f4244148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46078/0 (socket says 172.21.15.40:46078) 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 -- 172.21.15.40:0/698635768 learned_addr learned my addr 172.21.15.40:0/698635768 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424962d640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42440c97c0 0x7f4244146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4243fff640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f424415af50 0x7f42440c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 -- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f424415af50 msgr2=0x7f42440c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f424415af50 0x7f42440c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 -- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42440c97c0 msgr2=0x7f4244146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42440c97c0 0x7f4244146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 -- 172.21.15.40:0/698635768 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009480 con 0x7f42440cf4c0 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424962d640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42440c97c0 0x7f4244146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4243fff640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f424415af50 0x7f42440c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4248e2c640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 0x7f4244148ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f423c01a0c0 tx=0x7f423c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c005ba0 con 0x7f42440cf4c0 2023-11-04T01:42:24.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c005d00 con 0x7f42440cf4c0 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42440ca5a0 con 0x7f42440cf4c0 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c003b70 con 0x7f42440cf4c0 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42441493e0 con 0x7f42440cf4c0 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244066a90 con 0x7f42440cf4c0 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f423c003cd0 con 0x7f42440cf4c0 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f42417fa640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42240664a0 0x7f4224068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f423c11eb10 con 0x7f42440cf4c0 2023-11-04T01:42:24.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.038+0000 7f4243fff640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42240664a0 0x7f4224068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.042+0000 7f4243fff640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42240664a0 0x7f4224068960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42440c7b20 tx=0x7f422c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.042+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f423c0ebbe0 con 0x7f42440cf4c0 2023-11-04T01:42:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.198+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42440ccf20 con 0x7f42440cf4c0 2023-11-04T01:42:24.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f42417fa640 1 -- 172.21.15.40:0/698635768 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f423c0ef200 con 0x7f42440cf4c0 2023-11-04T01:42:24.206 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42240664a0 msgr2=0x7f4224068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42240664a0 0x7f4224068960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42440c7b20 tx=0x7f422c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 msgr2=0x7f4244148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 0x7f4244148ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f423c01a0c0 tx=0x7f423c019230 comp rx=0 tx=0).stop 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 shutdown_connections 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f42240664a0 0x7f4224068960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f42440c97c0 0x7f4244146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f424415af50 0x7f42440c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 --2- 172.21.15.40:0/698635768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42440cf4c0 0x7f4244148ea0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 >> 172.21.15.40:0/698635768 conn(0x7f4244065dc0 msgr2=0x7f424406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 shutdown_connections 2023-11-04T01:42:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.202+0000 7f424b090640 1 -- 172.21.15.40:0/698635768 wait complete. 2023-11-04T01:42:24.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbf229640 1 Processor -- start 2023-11-04T01:42:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbf229640 1 -- start start 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbf229640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fb80b0c20 0x7f7fb80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbf229640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb815f990 con 0x7f7fb815ad90 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbf229640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb815ec10 con 0x7f7fb815b170 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbf229640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb815f570 con 0x7f7fb80b0c20 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbcfc5640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7fb815ad90 0x7f7fb80b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34234/0 (socket says 172.21.15.40:34234) 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbcfc5640 1 -- 172.21.15.40:0/1858056831 learned_addr learned my addr 172.21.15.40:0/1858056831 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbd7c6640 1 --2- 172.21.15.40:0/1858056831 >> v2:172.21.15.40:3300/0 conn(0x7f7fb80b0c20 0x7f7fb80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fb77fe640 1 -- 172.21.15.40:0/1858056831 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715835074 0 0) 0x7f7fa4001120 con 0x7f7fb815ad90 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fb77fe640 1 -- 172.21.15.40:0/1858056831 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa8003530 con 0x7f7fb815ad90 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbd7c6640 1 -- 172.21.15.40:0/1858056831 >> v1:172.21.15.91:6789/0 conn(0x7f7fb815b170 legacy=0x7f7fb80ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbd7c6640 1 -- 172.21.15.40:0/1858056831 >> v1:172.21.15.40:6789/0 conn(0x7f7fb815ad90 legacy=0x7f7fb80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.338+0000 7f7fbd7c6640 1 -- 172.21.15.40:0/1858056831 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80cd9a0 con 0x7f7fb80b0c20 2023-11-04T01:42:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbd7c6640 1 --2- 172.21.15.40:0/1858056831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80b0c20 0x7f7fb80caca0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009d90 tx=0x7f7fb001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cd615ea8332e68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb77fe640 1 -- 172.21.15.40:0/1858056831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00a5870 con 0x7f7fb80b0c20 2023-11-04T01:42:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb77fe640 1 -- 172.21.15.40:0/1858056831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb00a59d0 con 0x7f7fb80b0c20 2023-11-04T01:42:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb77fe640 1 -- 172.21.15.40:0/1858056831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00a5d60 con 0x7f7fb80b0c20 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- 172.21.15.40:0/1858056831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80b0c20 msgr2=0x7f7fb80caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1858056831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80b0c20 0x7f7fb80caca0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009d90 tx=0x7f7fb001c8c0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- 172.21.15.40:0/1858056831 shutdown_connections 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1858056831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb80b0c20 0x7f7fb80caca0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- 172.21.15.40:0/1858056831 >> 172.21.15.40:0/1858056831 conn(0x7f7fb80cb510 msgr2=0x7f7fb80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- 172.21.15.40:0/1858056831 shutdown_connections 2023-11-04T01:42:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- 172.21.15.40:0/1858056831 wait complete. 2023-11-04T01:42:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 Processor -- start 2023-11-04T01:42:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- start start 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fb80b0c20 0x7f7fb8151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 0x7f7fb814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fb815b170 0x7f7fb80c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb814f710 con 0x7f7fb815ad90 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8152cf0 con 0x7f7fb815b170 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbf229640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8152fd0 con 0x7f7fb80b0c20 2023-11-04T01:42:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 0x7f7fb814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 0x7f7fb814f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46108/0 (socket says 172.21.15.40:46108) 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 -- 172.21.15.40:0/1028660583 learned_addr learned my addr 172.21.15.40:0/1028660583 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbd7c6640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fb815b170 0x7f7fb80c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbcfc5640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fb80b0c20 0x7f7fb8151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 -- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fb80b0c20 msgr2=0x7f7fb8151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fb80b0c20 0x7f7fb8151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 -- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fb815b170 msgr2=0x7f7fb80c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fb815b170 0x7f7fb80c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fb7fff640 1 -- 172.21.15.40:0/1028660583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0009a70 con 0x7f7fb815ad90 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.342+0000 7f7fbd7c6640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fb815b170 0x7f7fb80c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb7fff640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 0x7f7fb814f1d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00c500 tx=0x7f7fac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac005220 con 0x7f7fb815ad90 2023-11-04T01:42:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac005380 con 0x7f7fb815ad90 2023-11-04T01:42:24.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac007270 con 0x7f7fb815ad90 2023-11-04T01:42:24.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb81532b0 con 0x7f7fb815ad90 2023-11-04T01:42:24.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80c88b0 con 0x7f7fb815ad90 2023-11-04T01:42:24.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb8153760 con 0x7f7fb815ad90 2023-11-04T01:42:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fac0073d0 con 0x7f7fb815ad90 2023-11-04T01:42:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb57fa640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7f9c0664a0 0x7f7f9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f7fac083bc0 con 0x7f7fb815ad90 2023-11-04T01:42:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fbcfc5640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7f9c0664a0 0x7f7f9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.346+0000 7f7fbcfc5640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7f9c0664a0 0x7f7f9c068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4001280 tx=0x7f7fa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.350+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7fac050bf0 con 0x7f7fb815ad90 2023-11-04T01:42:24.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.502+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fb80744a0 con 0x7f7fb815ad90 2023-11-04T01:42:24.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fb57fa640 1 -- 172.21.15.40:0/1028660583 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fac054210 con 0x7f7fb815ad90 2023-11-04T01:42:24.510 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7f9c0664a0 msgr2=0x7f7f9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7f9c0664a0 0x7f7f9c068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4001280 tx=0x7f7fa4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 msgr2=0x7f7fb814f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 0x7f7fb814f1d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00c500 tx=0x7f7fac00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 shutdown_connections 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7f9c0664a0 0x7f7f9c068960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7fb815b170 0x7f7fb80c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb815ad90 0x7f7fb814f1d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 --2- 172.21.15.40:0/1028660583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7fb80b0c20 0x7f7fb8151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 >> 172.21.15.40:0/1028660583 conn(0x7f7fb80cb510 msgr2=0x7f7fb80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 shutdown_connections 2023-11-04T01:42:24.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.506+0000 7f7fbf229640 1 -- 172.21.15.40:0/1028660583 wait complete. 2023-11-04T01:42:24.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 Processor -- start 2023-11-04T01:42:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 -- start start 2023-11-04T01:42:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff68c15af70 0x7ff68c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff68c06d160 0x7ff68c0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c15e890 con 0x7ff68c15dd80 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c071200 con 0x7ff68c15af70 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff6914b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c06c0c0 con 0x7ff68c06d160 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff68c15af70 0x7ff68c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff68c15af70 0x7ff68c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46120/0 (socket says 172.21.15.40:46120) 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 -- 172.21.15.40:0/2918651028 learned_addr learned my addr 172.21.15.40:0/2918651028 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68a7fc640 1 --2- 172.21.15.40:0/2918651028 >> v2:172.21.15.91:3300/0 conn(0x7ff68c06d160 0x7ff68c0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 -- 172.21.15.40:0/2918651028 >> v2:172.21.15.91:3300/0 conn(0x7ff68c06d160 msgr2=0x7ff68c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 --2- 172.21.15.40:0/2918651028 >> v2:172.21.15.91:3300/0 conn(0x7ff68c06d160 0x7ff68c0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 -- 172.21.15.40:0/2918651028 >> v1:172.21.15.91:6789/0 conn(0x7ff68c15dd80 legacy=0x7ff68c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.650+0000 7ff68affd640 1 -- 172.21.15.40:0/2918651028 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c06c3a0 con 0x7ff68c15af70 2023-11-04T01:42:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff68affd640 1 --2- 172.21.15.40:0/2918651028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c15af70 0x7ff68c0cdaa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0cfb90 tx=0x7ff67c01e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c221d9cd721600 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff689ffb640 1 -- 172.21.15.40:0/2918651028 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0b2600 con 0x7ff68c15af70 2023-11-04T01:42:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff689ffb640 1 -- 172.21.15.40:0/2918651028 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c0b2760 con 0x7ff68c15af70 2023-11-04T01:42:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff689ffb640 1 -- 172.21.15.40:0/2918651028 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0b2af0 con 0x7ff68c15af70 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 -- 172.21.15.40:0/2918651028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c15af70 msgr2=0x7ff68c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 --2- 172.21.15.40:0/2918651028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c15af70 0x7ff68c0cdaa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0cfb90 tx=0x7ff67c01e6d0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 -- 172.21.15.40:0/2918651028 shutdown_connections 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 --2- 172.21.15.40:0/2918651028 >> v2:172.21.15.91:3300/0 conn(0x7ff68c06d160 0x7ff68c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 --2- 172.21.15.40:0/2918651028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c15af70 0x7ff68c0cdaa0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 -- 172.21.15.40:0/2918651028 >> 172.21.15.40:0/2918651028 conn(0x7ff68c0cb510 msgr2=0x7ff68c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 -- 172.21.15.40:0/2918651028 shutdown_connections 2023-11-04T01:42:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.654+0000 7ff6914b0640 1 -- 172.21.15.40:0/2918651028 wait complete. 2023-11-04T01:42:24.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 Processor -- start 2023-11-04T01:42:24.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 -- start start 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 0x7ff68c15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff68c15af70 0x7ff68c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff68c15dd80 0x7ff68c0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c151100 con 0x7ff68c06d160 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c15a780 con 0x7ff68c15af70 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c1504f0 con 0x7ff68c15dd80 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 0x7ff68c15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 0x7ff68c15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46134/0 (socket says 172.21.15.40:46134) 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 -- 172.21.15.40:0/1782573309 learned_addr learned my addr 172.21.15.40:0/1782573309 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68a7fc640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff68c15af70 0x7ff68c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68b7fe640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff68c15dd80 0x7ff68c0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 -- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff68c15dd80 msgr2=0x7ff68c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff68c15dd80 0x7ff68c0b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 -- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff68c15af70 msgr2=0x7ff68c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff68c15af70 0x7ff68c1467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 -- 172.21.15.40:0/1782573309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0094d0 con 0x7ff68c06d160 2023-11-04T01:42:24.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff68affd640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 0x7ff68c15a240 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff67c000c10 tx=0x7ff67c01b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0b6040 con 0x7ff68c06d160 2023-11-04T01:42:24.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c0ba830 con 0x7ff68c06d160 2023-11-04T01:42:24.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0b2600 con 0x7ff68c06d160 2023-11-04T01:42:24.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c1507d0 con 0x7ff68c06d160 2023-11-04T01:42:24.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.658+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c150d90 con 0x7ff68c06d160 2023-11-04T01:42:24.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.662+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c0744a0 con 0x7ff68c06d160 2023-11-04T01:42:24.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.662+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff67c0babe0 con 0x7ff68c06d160 2023-11-04T01:42:24.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.662+0000 7ff6737fe640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6780664a0 0x7ff678068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.662+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7ff67c1211f0 con 0x7ff68c06d160 2023-11-04T01:42:24.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.662+0000 7ff68a7fc640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6780664a0 0x7ff678068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.662+0000 7ff68a7fc640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6780664a0 0x7ff678068960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff68c14fd70 tx=0x7ff680008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.666+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff67c0ee190 con 0x7ff68c06d160 2023-11-04T01:42:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.826+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff68c15e890 con 0x7ff68c06d160 2023-11-04T01:42:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.826+0000 7ff6737fe640 1 -- 172.21.15.40:0/1782573309 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v66) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff68c15e890 con 0x7ff68c06d160 2023-11-04T01:42:24.831 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.826+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6780664a0 msgr2=0x7ff678068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.826+0000 7ff6914b0640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6780664a0 0x7ff678068960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff68c14fd70 tx=0x7ff680008040 comp rx=0 tx=0).stop 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.826+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 msgr2=0x7ff68c15a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.826+0000 7ff6914b0640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 0x7ff68c15a240 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff67c000c10 tx=0x7ff67c01b470 comp rx=0 tx=0).stop 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 shutdown_connections 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6780664a0 0x7ff678068960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff68c15dd80 0x7ff68c0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff68c15af70 0x7ff68c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 --2- 172.21.15.40:0/1782573309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68c06d160 0x7ff68c15a240 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 >> 172.21.15.40:0/1782573309 conn(0x7ff68c0cb510 msgr2=0x7ff68c0cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 shutdown_connections 2023-11-04T01:42:24.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.830+0000 7ff6914b0640 1 -- 172.21.15.40:0/1782573309 wait complete. 2023-11-04T01:42:24.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:24.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 Processor -- start 2023-11-04T01:42:24.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 -- start start 2023-11-04T01:42:24.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa1040cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa10406d160 0x7fa1040cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa10415dd80 0x7fa10415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10406c0c0 con 0x7fa10406d160 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10406c3a0 con 0x7fa10415dd80 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10c559640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10406c680 con 0x7fa10415af70 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa10406d160 0x7fa1040cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa10406d160 0x7fa1040cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46140/0 (socket says 172.21.15.40:46140) 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 -- 172.21.15.40:0/538077529 learned_addr learned my addr 172.21.15.40:0/538077529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10aaf6640 1 --2- 172.21.15.40:0/538077529 >> v2:172.21.15.91:3300/0 conn(0x7fa10415dd80 0x7fa10415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa10a2f5640 1 --2- 172.21.15.40:0/538077529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa1040cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 -- 172.21.15.40:0/538077529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 msgr2=0x7fa1040cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 --2- 172.21.15.40:0/538077529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa1040cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 -- 172.21.15.40:0/538077529 >> v2:172.21.15.91:3300/0 conn(0x7fa10415dd80 msgr2=0x7fa10415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 --2- 172.21.15.40:0/538077529 >> v2:172.21.15.91:3300/0 conn(0x7fa10415dd80 0x7fa10415e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 -- 172.21.15.40:0/538077529 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10406c960 con 0x7fa10406d160 2023-11-04T01:42:24.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa109af4640 1 --2- 172.21.15.40:0/538077529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10406d160 0x7fa1040cdfe0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa10406f780 tx=0x7fa0f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69b51e8c3d3b772 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa1092f3640 1 -- 172.21.15.40:0/538077529 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40ac630 con 0x7fa10406d160 2023-11-04T01:42:24.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa1092f3640 1 -- 172.21.15.40:0/538077529 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40ac790 con 0x7fa10406d160 2023-11-04T01:42:24.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.970+0000 7fa1092f3640 1 -- 172.21.15.40:0/538077529 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40acb20 con 0x7fa10406d160 2023-11-04T01:42:24.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/538077529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10406d160 msgr2=0x7fa1040cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- 172.21.15.40:0/538077529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10406d160 0x7fa1040cdfe0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa10406f780 tx=0x7fa0f401c500 comp rx=0 tx=0).stop 2023-11-04T01:42:24.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/538077529 shutdown_connections 2023-11-04T01:42:24.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- 172.21.15.40:0/538077529 >> v2:172.21.15.91:3300/0 conn(0x7fa10415dd80 0x7fa10415e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- 172.21.15.40:0/538077529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10406d160 0x7fa1040cdfe0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- 172.21.15.40:0/538077529 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa1040cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/538077529 >> 172.21.15.40:0/538077529 conn(0x7fa1040cb510 msgr2=0x7fa1040cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/538077529 shutdown_connections 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/538077529 wait complete. 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 Processor -- start 2023-11-04T01:42:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- start start 2023-11-04T01:42:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10406d160 0x7fa1041fa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa104159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 0x7fa1040c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104159ba0 con 0x7fa10415dd80 2023-11-04T01:42:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040c49f0 con 0x7fa10406d160 2023-11-04T01:42:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041588a0 con 0x7fa10415af70 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 0x7fa1040c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10a2f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10406d160 0x7fa1041fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 0x7fa1040c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46152/0 (socket says 172.21.15.40:46152) 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 -- 172.21.15.40:0/236006562 learned_addr learned my addr 172.21.15.40:0/236006562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa109af4640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa104159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 -- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 msgr2=0x7fa104159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa104159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 -- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10406d160 msgr2=0x7fa1041fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10406d160 0x7fa1041fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 -- 172.21.15.40:0/236006562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40094d0 con 0x7fa10415dd80 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10aaf6640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 0x7fa1040c4150 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc007e60 tx=0x7fa0fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc014420 con 0x7fa10415dd80 2023-11-04T01:42:24.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0145a0 con 0x7fa10415dd80 2023-11-04T01:42:24.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa104158b80 con 0x7fa10415dd80 2023-11-04T01:42:24.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc014950 con 0x7fa10415dd80 2023-11-04T01:42:24.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.974+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa104159140 con 0x7fa10415dd80 2023-11-04T01:42:24.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.978+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104159330 con 0x7fa10415dd80 2023-11-04T01:42:24.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.978+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0fc014ab0 con 0x7fa10415dd80 2023-11-04T01:42:24.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.978+0000 7fa0faffd640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664a0 0x7fa0e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.978+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fa0fc084a40 con 0x7fa10415dd80 2023-11-04T01:42:24.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.978+0000 7fa10a2f5640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664a0 0x7fa0e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.978+0000 7fa10a2f5640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664a0 0x7fa0e8068960 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa1000045f0 tx=0x7fa100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:24.982+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0fc086e60 con 0x7fa10415dd80 2023-11-04T01:42:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fa1040744a0 con 0x7fa10415dd80 2023-11-04T01:42:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa0faffd640 1 -- 172.21.15.40:0/236006562 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v66) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa0fc051ba0 con 0x7fa10415dd80 2023-11-04T01:42:25.143 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:25.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664a0 msgr2=0x7fa0e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664a0 0x7fa0e8068960 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa1000045f0 tx=0x7fa100008040 comp rx=0 tx=0).stop 2023-11-04T01:42:25.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 msgr2=0x7fa1040c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 0x7fa1040c4150 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc007e60 tx=0x7fa0fc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 shutdown_connections 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0e80664a0 0x7fa0e8068960 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa10415dd80 0x7fa1040c4150 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa10415af70 0x7fa104159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 --2- 172.21.15.40:0/236006562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa10406d160 0x7fa1041fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 >> 172.21.15.40:0/236006562 conn(0x7fa1040cb510 msgr2=0x7fa1040c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 shutdown_connections 2023-11-04T01:42:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.138+0000 7fa10c559640 1 -- 172.21.15.40:0/236006562 wait complete. 2023-11-04T01:42:25.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f99b26640 1 Processor -- start 2023-11-04T01:42:25.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f99b26640 1 -- start start 2023-11-04T01:42:25.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f99b26640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 0x7f8f940b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f99b26640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f940ccee0 con 0x7f8f940ca400 2023-11-04T01:42:25.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f99b26640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9415a5d0 con 0x7f8f9415a1f0 2023-11-04T01:42:25.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f99b26640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940ca900 con 0x7f8f940cdea0 2023-11-04T01:42:25.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f93fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8f940ca400 0x7f8f940704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34250/0 (socket says 172.21.15.40:34250) 2023-11-04T01:42:25.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f93fff640 1 -- 172.21.15.40:0/137461853 learned_addr learned my addr 172.21.15.40:0/137461853 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f92ffd640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 0x7f8f940b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419042008 0 0) 0x7f8f940ccee0 con 0x7f8f940ca400 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f7c003530 con 0x7f8f940ca400 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1397948224 0 0) 0x7f8f7c003530 con 0x7f8f940ca400 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 msgr2=0x7f8f940b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 0x7f8f940b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 >> v1:172.21.15.91:6789/0 conn(0x7f8f9415a1f0 legacy=0x7f8f940cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940cabe0 con 0x7f8f940ca400 2023-11-04T01:42:25.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8f8c001a00 con 0x7f8f940ca400 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 >> v1:172.21.15.40:6789/0 conn(0x7f8f940ca400 legacy=0x7f8f940704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f7c0039b0 0x7f8f7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 0x7f8f7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c004d10 0x7f8f7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940ca900 con 0x7f8f7c0039b0 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c00ba70 con 0x7f8f7c004d10 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c00bc30 con 0x7f8f940cdea0 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f937fe640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f7c0039b0 0x7f8f7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f92ffd640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 0x7f8f7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f93fff640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c004d10 0x7f8f7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f937fe640 1 -- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 msgr2=0x7f8f7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f937fe640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940cdea0 0x7f8f7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f937fe640 1 -- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c004d10 msgr2=0x7f8f7c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f937fe640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c004d10 0x7f8f7c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.274+0000 7f8f937fe640 1 -- 172.21.15.40:0/137461853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c003530 con 0x7f8f7c0039b0 2023-11-04T01:42:25.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f937fe640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f7c0039b0 0x7f8f7c003dd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8f84001750 tx=0x7f8f8401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ed950887f12ba6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840052d0 con 0x7f8f7c0039b0 2023-11-04T01:42:25.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840a7050 con 0x7f8f7c0039b0 2023-11-04T01:42:25.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f927fc640 1 -- 172.21.15.40:0/137461853 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84003600 con 0x7f8f7c0039b0 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- 172.21.15.40:0/137461853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f7c0039b0 msgr2=0x7f8f7c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 --2- 172.21.15.40:0/137461853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f7c0039b0 0x7f8f7c003dd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8f84001750 tx=0x7f8f8401c3c0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f93fff640 1 -- 172.21.15.40:0/137461853 reap_dead start 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- 172.21.15.40:0/137461853 shutdown_connections 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- 172.21.15.40:0/137461853 >> 172.21.15.40:0/137461853 conn(0x7f8f940cebb0 msgr2=0x7f8f940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- 172.21.15.40:0/137461853 shutdown_connections 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- 172.21.15.40:0/137461853 wait complete. 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 Processor -- start 2023-11-04T01:42:25.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- start start 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c0039b0 0x7f8f94160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 0x7f8f9414de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940c6e40 0x7f8f940c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9414e390 con 0x7f8f940b35b0 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940c7810 con 0x7f8f7c0039b0 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f99b26640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9415efe0 con 0x7f8f940c6e40 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 0x7f8f9414de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f92ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 0x7f8f9414de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46174/0 (socket says 172.21.15.40:46174) 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.278+0000 7f8f92ffd640 1 -- 172.21.15.40:0/1938580976 learned_addr learned my addr 172.21.15.40:0/1938580976 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:25.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f92ffd640 1 -- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940c6e40 msgr2=0x7f8f940c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f92ffd640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940c6e40 0x7f8f940c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f92ffd640 1 -- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c0039b0 msgr2=0x7f8f94160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f937fe640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c0039b0 0x7f8f94160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f92ffd640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c0039b0 0x7f8f94160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f92ffd640 1 -- 172.21.15.40:0/1938580976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94151090 con 0x7f8f940b35b0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f92ffd640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 0x7f8f9414de50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8f880115e0 tx=0x7f8f88011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800f8f0 con 0x7f8f940b35b0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800fa50 con 0x7f8f940b35b0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f94151370 con 0x7f8f940b35b0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800fdc0 con 0x7f8f940b35b0 2023-11-04T01:42:25.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9415f2c0 con 0x7f8f940b35b0 2023-11-04T01:42:25.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f940744a0 con 0x7f8f940b35b0 2023-11-04T01:42:25.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f88015460 con 0x7f8f940b35b0 2023-11-04T01:42:25.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f7bfff640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f800664a0 0x7f8f80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f8f88084a40 con 0x7f8f940b35b0 2023-11-04T01:42:25.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f937fe640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f800664a0 0x7f8f80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.282+0000 7f8f937fe640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f800664a0 0x7f8f80068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0057b0 tx=0x7f8f840011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.286+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f88086e60 con 0x7f8f940b35b0 2023-11-04T01:42:25.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f9406cfb0 con 0x7f8f940b35b0 2023-11-04T01:42:25.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f7bfff640 1 -- 172.21.15.40:0/1938580976 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f88051af0 con 0x7f8f940b35b0 2023-11-04T01:42:25.459 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f800664a0 msgr2=0x7f8f80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f800664a0 0x7f8f80068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0057b0 tx=0x7f8f840011a0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 msgr2=0x7f8f9414de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 0x7f8f9414de50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8f880115e0 tx=0x7f8f88011aa0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 shutdown_connections 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8f800664a0 0x7f8f80068960 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8f940c6e40 0x7f8f940c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f940b35b0 0x7f8f9414de50 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 --2- 172.21.15.40:0/1938580976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8f7c0039b0 0x7f8f94160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 >> 172.21.15.40:0/1938580976 conn(0x7f8f940cebb0 msgr2=0x7f8f94157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 shutdown_connections 2023-11-04T01:42:25.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.454+0000 7f8f99b26640 1 -- 172.21.15.40:0/1938580976 wait complete. 2023-11-04T01:42:25.477 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:42:25.477 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:25.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:25.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[52101]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:25.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:42:25.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:25.528 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:25.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:25.582 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:42:25.582 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:25.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:25.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:42:25.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:25.589 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:42:25.634 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:42:25.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:25.635 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:42:25.635 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:25.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:25.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:42:25.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:25.641 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:42:25.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:42:25.687 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:42:25.687 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:25.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:25.693 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:42:25.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:25.693 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:42:25.742 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:42:25.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:25.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.862+0000 7f2ea5924640 1 Processor -- start 2023-11-04T01:42:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.862+0000 7f2ea5924640 1 -- start start 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2ea5924640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0890 0x7f2ea00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2ea5924640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ea00c9960 0x7f2ea00704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2ea5924640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea00ce320 con 0x7f2ea00b0c70 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2ea5924640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea006d2f0 con 0x7f2ea00c9960 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2ea5924640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00ce110 con 0x7f2ea00b0890 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2ea00b0c70 0x7f2ea00ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34266/0 (socket says 172.21.15.40:34266) 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9f7fe640 1 -- 172.21.15.40:0/2937072491 learned_addr learned my addr 172.21.15.40:0/2937072491 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9e7fc640 1 --2- 172.21.15.40:0/2937072491 >> v2:172.21.15.40:3300/0 conn(0x7f2ea00c9960 0x7f2ea00704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9dffb640 1 -- 172.21.15.40:0/2937072491 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744151038 0 0) 0x7f2ea00ce320 con 0x7f2ea00b0c70 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9effd640 1 --2- 172.21.15.40:0/2937072491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0890 0x7f2ea00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9dffb640 1 -- 172.21.15.40:0/2937072491 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e88003530 con 0x7f2ea00b0c70 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9e7fc640 1 -- 172.21.15.40:0/2937072491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0890 msgr2=0x7f2ea00cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9e7fc640 1 --2- 172.21.15.40:0/2937072491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0890 0x7f2ea00cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9e7fc640 1 -- 172.21.15.40:0/2937072491 >> v1:172.21.15.40:6789/0 conn(0x7f2ea00b0c70 legacy=0x7f2ea00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9e7fc640 1 -- 172.21.15.40:0/2937072491 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00ce600 con 0x7f2ea00c9960 2023-11-04T01:42:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9e7fc640 1 --2- 172.21.15.40:0/2937072491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea00704e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097c0 tx=0x7f2e9001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1728da0999623ca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9dffb640 1 -- 172.21.15.40:0/2937072491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e900ab650 con 0x7f2ea00c9960 2023-11-04T01:42:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9dffb640 1 -- 172.21.15.40:0/2937072491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e900ab7b0 con 0x7f2ea00c9960 2023-11-04T01:42:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.866+0000 7f2e9dffb640 1 -- 172.21.15.40:0/2937072491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e900abb40 con 0x7f2ea00c9960 2023-11-04T01:42:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/2937072491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 msgr2=0x7f2ea00704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 --2- 172.21.15.40:0/2937072491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea00704e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097c0 tx=0x7f2e9001c450 comp rx=0 tx=0).stop 2023-11-04T01:42:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/2937072491 shutdown_connections 2023-11-04T01:42:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 --2- 172.21.15.40:0/2937072491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea00704e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 --2- 172.21.15.40:0/2937072491 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0890 0x7f2ea00cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/2937072491 >> 172.21.15.40:0/2937072491 conn(0x7f2ea00cebb0 msgr2=0x7f2ea00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/2937072491 shutdown_connections 2023-11-04T01:42:25.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/2937072491 wait complete. 2023-11-04T01:42:25.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 Processor -- start 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- start start 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ea00b0890 0x7f2ea0150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0c70 0x7f2ea015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c36e0 con 0x7f2ea00c9960 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c23f0 con 0x7f2ea00b0890 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c2640 con 0x7f2ea00b0c70 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea015e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46184/0 (socket says 172.21.15.40:46184) 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 -- 172.21.15.40:0/3924271369 learned_addr learned my addr 172.21.15.40:0/3924271369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9effd640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ea00b0890 0x7f2ea0150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 -- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0c70 msgr2=0x7f2ea015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0c70 0x7f2ea015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 -- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ea00b0890 msgr2=0x7f2ea0150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ea00b0890 0x7f2ea0150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 -- 172.21.15.40:0/3924271369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90009420 con 0x7f2ea00c9960 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e9f7fe640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea015e000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800cb40 tx=0x7f2e9800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800aca0 con 0x7f2ea00c9960 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9800ae00 con 0x7f2ea00c9960 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea00c2920 con 0x7f2ea00c9960 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98012620 con 0x7f2ea00c9960 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.870+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea00c2ee0 con 0x7f2ea00c9960 2023-11-04T01:42:25.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.874+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea00744a0 con 0x7f2ea00c9960 2023-11-04T01:42:25.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.874+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e98007070 con 0x7f2ea00c9960 2023-11-04T01:42:25.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.874+0000 7f2e87fff640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e8c0664a0 0x7f2e8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.874+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f2e98084370 con 0x7f2ea00c9960 2023-11-04T01:42:25.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.874+0000 7f2e9effd640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e8c0664a0 0x7f2e8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.874+0000 7f2e9effd640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e8c0664a0 0x7f2e8c068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ea01f5470 tx=0x7f2e9400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:25.878+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e98051380 con 0x7f2ea00c9960 2023-11-04T01:42:26.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.066+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ea00b1320 con 0x7f2ea00c9960 2023-11-04T01:42:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2e87fff640 1 -- 172.21.15.40:0/3924271369 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f2e980549a0 con 0x7f2ea00c9960 2023-11-04T01:42:26.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:26.074 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:05.330601+0000","modified":"2023-11-04T01:42:07.357303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3229855719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3229855719},{"type":"v1","addr":"172.21.15.40:6835","nonce":3229855719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:26.075 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2023-11-04T01:42:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e8c0664a0 msgr2=0x7f2e8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e8c0664a0 0x7f2e8c068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ea01f5470 tx=0x7f2e9400d040 comp rx=0 tx=0).stop 2023-11-04T01:42:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 msgr2=0x7f2ea015e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea015e000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800cb40 tx=0x7f2e9800a060 comp rx=0 tx=0).stop 2023-11-04T01:42:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 shutdown_connections 2023-11-04T01:42:26.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e8c0664a0 0x7f2e8c068960 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea00c9960 0x7f2ea015e000 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ea00b0c70 0x7f2ea015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 --2- 172.21.15.40:0/3924271369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ea00b0890 0x7f2ea0150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 >> 172.21.15.40:0/3924271369 conn(0x7f2ea00cebb0 msgr2=0x7f2ea0073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 shutdown_connections 2023-11-04T01:42:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.070+0000 7f2ea5924640 1 -- 172.21.15.40:0/3924271369 wait complete. 2023-11-04T01:42:26.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.206+0000 7f96ac61c640 1 Processor -- start 2023-11-04T01:42:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96ac61c640 1 -- start start 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96ac61c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f96a415b050 0x7f96a40d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96ac61c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96a40cdf00 0x7f96a415b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96ac61c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a415fa20 con 0x7f96a40cfe80 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96ac61c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40d0ca0 con 0x7f96a40cdf00 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96ac61c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a406daf0 con 0x7f96a415b050 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96a9bb7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f96a40cfe80 0x7f96a40cd7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34276/0 (socket says 172.21.15.40:34276) 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aabb9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96a40cdf00 0x7f96a415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96a9bb7640 1 -- 172.21.15.40:0/2320294846 learned_addr learned my addr 172.21.15.40:0/2320294846 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aa3b8640 1 --2- 172.21.15.40:0/2320294846 >> v2:172.21.15.91:3300/0 conn(0x7f96a415b050 0x7f96a40d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aabb9640 1 -- 172.21.15.40:0/2320294846 >> v2:172.21.15.91:3300/0 conn(0x7f96a415b050 msgr2=0x7f96a40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aabb9640 1 --2- 172.21.15.40:0/2320294846 >> v2:172.21.15.91:3300/0 conn(0x7f96a415b050 0x7f96a40d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aabb9640 1 -- 172.21.15.40:0/2320294846 >> v1:172.21.15.40:6789/0 conn(0x7f96a40cfe80 legacy=0x7f96a40cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aabb9640 1 -- 172.21.15.40:0/2320294846 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a415ec60 con 0x7f96a40cdf00 2023-11-04T01:42:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96aabb9640 1 --2- 172.21.15.40:0/2320294846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a40cdf00 0x7f96a415b430 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f96a40cd7c0 tx=0x7f96a001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aa399800adc2bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96a93b6640 1 -- 172.21.15.40:0/2320294846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00ac600 con 0x7f96a40cdf00 2023-11-04T01:42:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96a93b6640 1 -- 172.21.15.40:0/2320294846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00a8050 con 0x7f96a40cdf00 2023-11-04T01:42:26.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.210+0000 7f96a93b6640 1 -- 172.21.15.40:0/2320294846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00ac980 con 0x7f96a40cdf00 2023-11-04T01:42:26.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2320294846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a40cdf00 msgr2=0x7f96a415b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2320294846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a40cdf00 0x7f96a415b430 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f96a40cd7c0 tx=0x7f96a001c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2320294846 shutdown_connections 2023-11-04T01:42:26.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2320294846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a40cdf00 0x7f96a415b430 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2320294846 >> v2:172.21.15.91:3300/0 conn(0x7f96a415b050 0x7f96a40d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2320294846 >> 172.21.15.40:0/2320294846 conn(0x7f96a40b28f0 msgr2=0x7f96a40b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2320294846 shutdown_connections 2023-11-04T01:42:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2320294846 wait complete. 2023-11-04T01:42:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 Processor -- start 2023-11-04T01:42:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- start start 2023-11-04T01:42:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96a40cdf00 0x7f96a4165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a40cfe80 0x7f96a41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 0x7f96a40b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4155bc0 con 0x7f96a415b050 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40c7440 con 0x7f96a40cfe80 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4154f40 con 0x7f96a40cdf00 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 0x7f96a40b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 0x7f96a40b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46202/0 (socket says 172.21.15.40:46202) 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 -- 172.21.15.40:0/2551413211 learned_addr learned my addr 172.21.15.40:0/2551413211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aa3b8640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96a40cdf00 0x7f96a4165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 -- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96a40cdf00 msgr2=0x7f96a4165300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96a9bb7640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a40cfe80 0x7f96a41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96a40cdf00 0x7f96a4165300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 -- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a40cfe80 msgr2=0x7f96a41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a40cfe80 0x7f96a41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 -- 172.21.15.40:0/2551413211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0009420 con 0x7f96a415b050 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96a9bb7640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a40cfe80 0x7f96a41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96aabb9640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 0x7f96a40b2cd0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f96a0019fd0 tx=0x7f96a001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00b7450 con 0x7f96a415b050 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00b75b0 con 0x7f96a415b050 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a4155220 con 0x7f96a415b050 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00b7960 con 0x7f96a415b050 2023-11-04T01:42:26.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.214+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a41557e0 con 0x7f96a415b050 2023-11-04T01:42:26.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.218+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a4155d00 con 0x7f96a415b050 2023-11-04T01:42:26.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.218+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96a00b3070 con 0x7f96a415b050 2023-11-04T01:42:26.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.218+0000 7f969affd640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96880664a0 0x7f9688068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.218+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f96a011e960 con 0x7f96a415b050 2023-11-04T01:42:26.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.218+0000 7f96aa3b8640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96880664a0 0x7f9688068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.218+0000 7f96aa3b8640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96880664a0 0x7f9688068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e90 tx=0x7f969c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.222+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96a4155d00 con 0x7f96a415b050 2023-11-04T01:42:26.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.374+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96a4155d00 con 0x7f96a415b050 2023-11-04T01:42:26.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.378+0000 7f969affd640 1 -- 172.21.15.40:0/2551413211 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+21783 (secure 0 0 0) 0x7f96a4155d00 con 0x7f96a415b050 2023-11-04T01:42:26.384 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:26.384 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":66,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:22.098775+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.378+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96880664a0 msgr2=0x7f9688068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.378+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96880664a0 0x7f9688068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e90 tx=0x7f969c00b040 comp rx=0 tx=0).stop 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.378+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 msgr2=0x7f96a40b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.378+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 0x7f96a40b2cd0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f96a0019fd0 tx=0x7f96a001abe0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 shutdown_connections 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96880664a0 0x7f9688068960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a415b050 0x7f96a40b2cd0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96a40cfe80 0x7f96a41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 --2- 172.21.15.40:0/2551413211 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96a40cdf00 0x7f96a4165300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 >> 172.21.15.40:0/2551413211 conn(0x7f96a40b28f0 msgr2=0x7f96a415a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 shutdown_connections 2023-11-04T01:42:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.382+0000 7f96ac61c640 1 -- 172.21.15.40:0/2551413211 wait complete. 2023-11-04T01:42:26.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:03.913153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:04.307758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:26.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.518+0000 7fa4e0ec2640 1 Processor -- start 2023-11-04T01:42:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.518+0000 7fa4e0ec2640 1 -- start start 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4e0ec2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4dc15cb90 0x7fa4dc0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4e0ec2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4e0ec2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc0ccda0 con 0x7fa4dc0c9830 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4e0ec2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c9cc0 con 0x7fa4dc15cb90 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4e0ec2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc070db0 con 0x7fa4dc0716c0 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4dc15cb90 0x7fa4dc0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4dc15cb90 0x7fa4dc0704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46206/0 (socket says 172.21.15.40:46206) 2023-11-04T01:42:26.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 -- 172.21.15.40:0/842919017 learned_addr learned my addr 172.21.15.40:0/842919017 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:26.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4d9d9b640 1 --2- 172.21.15.40:0/842919017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 -- 172.21.15.40:0/842919017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 msgr2=0x7fa4dc0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 --2- 172.21.15.40:0/842919017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc0c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 -- 172.21.15.40:0/842919017 >> v1:172.21.15.91:6789/0 conn(0x7fa4dc0c9830 legacy=0x7fa4dc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 -- 172.21.15.40:0/842919017 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc071090 con 0x7fa4dc15cb90 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4da59c640 1 --2- 172.21.15.40:0/842919017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0704b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00aa40 tx=0x7fa4cc01d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7735f42f11b8b52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4d959a640 1 -- 172.21.15.40:0/842919017 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0a6740 con 0x7fa4dc15cb90 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4d959a640 1 -- 172.21.15.40:0/842919017 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc0a68a0 con 0x7fa4dc15cb90 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.522+0000 7fa4d959a640 1 -- 172.21.15.40:0/842919017 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0a6c30 con 0x7fa4dc15cb90 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/842919017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc15cb90 msgr2=0x7fa4dc0704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/842919017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0704b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00aa40 tx=0x7fa4cc01d8b0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/842919017 shutdown_connections 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/842919017 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/842919017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0704b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/842919017 >> 172.21.15.40:0/842919017 conn(0x7fa4dc0cb510 msgr2=0x7fa4dc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/842919017 shutdown_connections 2023-11-04T01:42:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/842919017 wait complete. 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 Processor -- start 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- start start 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 0x7fa4dc15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b22f0 con 0x7fa4dc0c9830 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc151140 con 0x7fa4dc15cb90 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc156560 con 0x7fa4dc0716c0 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 0x7fa4dc15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 0x7fa4dc15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46220/0 (socket says 172.21.15.40:46220) 2023-11-04T01:42:26.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 -- 172.21.15.40:0/1817052873 learned_addr learned my addr 172.21.15.40:0/1817052873 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4dad9d640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4da59c640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 -- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 msgr2=0x7fa4dc155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 -- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4dc15cb90 msgr2=0x7fa4dc0c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0c2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 -- 172.21.15.40:0/1817052873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc00a670 con 0x7fa4dc0c9830 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4d9d9b640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 0x7fa4dc15a720 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c7f0 tx=0x7fa4d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0004220 con 0x7fa4dc0c9830 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d00043a0 con 0x7fa4dc0c9830 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc0b2590 con 0x7fa4dc0c9830 2023-11-04T01:42:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0004510 con 0x7fa4dc0c9830 2023-11-04T01:42:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc0b2b50 con 0x7fa4dc0c9830 2023-11-04T01:42:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.526+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc0b2d70 con 0x7fa4dc0c9830 2023-11-04T01:42:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.530+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa4d0003a70 con 0x7fa4dc0c9830 2023-11-04T01:42:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.530+0000 7fa4caffd640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4bc0664d0 0x7fa4bc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.530+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fa4d0084300 con 0x7fa4dc0c9830 2023-11-04T01:42:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.530+0000 7fa4da59c640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4bc0664d0 0x7fa4bc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.530+0000 7fa4da59c640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4bc0664d0 0x7fa4bc068990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b0000 tx=0x7fa4cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.534+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4d0051280 con 0x7fa4dc0c9830 2023-11-04T01:42:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.690+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4dc0744a0 con 0x7fa4dc0c9830 2023-11-04T01:42:26.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.690+0000 7fa4caffd640 1 -- 172.21.15.40:0/1817052873 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4d00548a0 con 0x7fa4dc0c9830 2023-11-04T01:42:26.697 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4bc0664d0 msgr2=0x7fa4bc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4bc0664d0 0x7fa4bc068990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0b0000 tx=0x7fa4cc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 msgr2=0x7fa4dc15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 0x7fa4dc15a720 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c7f0 tx=0x7fa4d000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 shutdown_connections 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4bc0664d0 0x7fa4bc068990 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4dc15cb90 0x7fa4dc0c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0c9830 0x7fa4dc15a720 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 --2- 172.21.15.40:0/1817052873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4dc0716c0 0x7fa4dc155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 >> 172.21.15.40:0/1817052873 conn(0x7fa4dc0cb510 msgr2=0x7fa4dc159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 shutdown_connections 2023-11-04T01:42:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.694+0000 7fa4e0ec2640 1 -- 172.21.15.40:0/1817052873 wait complete. 2023-11-04T01:42:26.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:26.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.830+0000 7f2e9a66f640 1 Processor -- start 2023-11-04T01:42:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.830+0000 7f2e9a66f640 1 -- start start 2023-11-04T01:42:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e9a66f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 0x7f2e940c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e9a66f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2e9415b1b0 0x7f2e940b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e9a66f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940c9530 con 0x7f2e9406cdd0 2023-11-04T01:42:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e9a66f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e940712f0 con 0x7f2e9415b1b0 2023-11-04T01:42:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e9a66f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940715d0 con 0x7f2e9415add0 2023-11-04T01:42:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 0x7f2e940c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e937fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2e9415b1b0 0x7f2e940b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 0x7f2e940c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:55972/0 (socket says 172.21.15.40:55972) 2023-11-04T01:42:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e98c0c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2e9406cdd0 0x7f2e9406a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:48496/0 (socket says 172.21.15.40:48496) 2023-11-04T01:42:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 -- 172.21.15.40:0/358645807 learned_addr learned my addr 172.21.15.40:0/358645807 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 -- 172.21.15.40:0/358645807 >> v2:172.21.15.91:3300/0 conn(0x7f2e9415b1b0 msgr2=0x7f2e940b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 --2- 172.21.15.40:0/358645807 >> v2:172.21.15.91:3300/0 conn(0x7f2e9415b1b0 0x7f2e940b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 -- 172.21.15.40:0/358645807 >> v1:172.21.15.91:6789/0 conn(0x7f2e9406cdd0 legacy=0x7f2e9406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e93fff640 1 -- 172.21.15.40:0/358645807 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940718b0 con 0x7f2e9415add0 2023-11-04T01:42:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.834+0000 7f2e937fe640 1 --2- 172.21.15.40:0/358645807 >> v2:172.21.15.91:3300/0 conn(0x7f2e9415b1b0 0x7f2e940b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e93fff640 1 --2- 172.21.15.40:0/358645807 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 0x7f2e940c8ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e50 tx=0x7f2e8c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d2b1423d9d024f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e92ffd640 1 -- 172.21.15.40:0/358645807 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0a5860 con 0x7f2e9415add0 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e92ffd640 1 -- 172.21.15.40:0/358645807 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0a59c0 con 0x7f2e9415add0 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e92ffd640 1 -- 172.21.15.40:0/358645807 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0a5d50 con 0x7f2e9415add0 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 -- 172.21.15.40:0/358645807 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 msgr2=0x7f2e940c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/358645807 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 0x7f2e940c8ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e50 tx=0x7f2e8c01c980 comp rx=0 tx=0).stop 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 -- 172.21.15.40:0/358645807 shutdown_connections 2023-11-04T01:42:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/358645807 >> v2:172.21.15.91:3300/0 conn(0x7f2e9415b1b0 0x7f2e940b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/358645807 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415add0 0x7f2e940c8ff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 -- 172.21.15.40:0/358645807 >> 172.21.15.40:0/358645807 conn(0x7f2e940cb420 msgr2=0x7f2e940cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 -- 172.21.15.40:0/358645807 shutdown_connections 2023-11-04T01:42:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 -- 172.21.15.40:0/358645807 wait complete. 2023-11-04T01:42:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 Processor -- start 2023-11-04T01:42:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.838+0000 7f2e9a66f640 1 -- start start 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 0x7f2e94151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e9415add0 0x7f2e94159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415b1b0 0x7f2e94150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94152bc0 con 0x7f2e9406cdd0 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c2490 con 0x7f2e9415add0 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c5340 con 0x7f2e9415b1b0 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 0x7f2e94151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 0x7f2e94151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46236/0 (socket says 172.21.15.40:46236) 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 -- 172.21.15.40:0/3172210562 learned_addr learned my addr 172.21.15.40:0/3172210562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e937fe640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e9415add0 0x7f2e94159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e98c0c640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415b1b0 0x7f2e94150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 -- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415b1b0 msgr2=0x7f2e94150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415b1b0 0x7f2e94150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 -- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e9415add0 msgr2=0x7f2e94159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e9415add0 0x7f2e94159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 -- 172.21.15.40:0/3172210562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009420 con 0x7f2e9406cdd0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e93fff640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 0x7f2e94151940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c01a5b0 tx=0x7f2e8c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0b8670 con 0x7f2e9406cdd0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0b87d0 con 0x7f2e9406cdd0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c009b30 con 0x7f2e9406cdd0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0b8b60 con 0x7f2e9406cdd0 2023-11-04T01:42:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e94152320 con 0x7f2e9406cdd0 2023-11-04T01:42:26.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e941532f0 con 0x7f2e9406cdd0 2023-11-04T01:42:26.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e8c0b8cc0 con 0x7f2e9406cdd0 2023-11-04T01:42:26.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e90ff9640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e800664a0 0x7f2e80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f2e8c11f820 con 0x7f2e9406cdd0 2023-11-04T01:42:26.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.842+0000 7f2e937fe640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e800664a0 0x7f2e80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.846+0000 7f2e937fe640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e800664a0 0x7f2e80068960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2e941f8f80 tx=0x7f2e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.846+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e941532f0 con 0x7f2e9406cdd0 2023-11-04T01:42:27.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.998+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f2e941532f0 con 0x7f2e9406cdd0 2023-11-04T01:42:27.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:26.998+0000 7f2e90ff9640 1 -- 172.21.15.40:0/3172210562 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v66) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2e941532f0 con 0x7f2e9406cdd0 2023-11-04T01:42:27.004 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e800664a0 msgr2=0x7f2e80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e800664a0 0x7f2e80068960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2e941f8f80 tx=0x7f2e88008040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 msgr2=0x7f2e94151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 0x7f2e94151940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c01a5b0 tx=0x7f2e8c019720 comp rx=0 tx=0).stop 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 shutdown_connections 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e800664a0 0x7f2e80068960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e9415b1b0 0x7f2e94150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e9415add0 0x7f2e94159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 --2- 172.21.15.40:0/3172210562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e9406cdd0 0x7f2e94151940 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 >> 172.21.15.40:0/3172210562 conn(0x7f2e940cb420 msgr2=0x7f2e940c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 shutdown_connections 2023-11-04T01:42:27.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.002+0000 7f2e9a66f640 1 -- 172.21.15.40:0/3172210562 wait complete. 2023-11-04T01:42:27.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:27.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:27.067 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:27.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 Processor -- start 2023-11-04T01:42:27.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 -- start start 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6ff4144840 0x7f6ff415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ff4070b40 0x7f6ff40b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff406cc10 con 0x7f6ff40b54d0 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40b5960 con 0x7f6ff4070b40 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ffafb2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff4071d10 con 0x7f6ff4144840 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff954f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ff40b54d0 0x7f6ff406a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34278/0 (socket says 172.21.15.40:34278) 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff954f640 1 -- 172.21.15.40:0/4177057850 learned_addr learned my addr 172.21.15.40:0/4177057850 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff3fff640 1 --2- 172.21.15.40:0/4177057850 >> v2:172.21.15.40:3300/0 conn(0x7f6ff4070b40 0x7f6ff40b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff8d4e640 1 --2- 172.21.15.40:0/4177057850 >> v2:172.21.15.91:3300/0 conn(0x7f6ff4144840 0x7f6ff415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff37fe640 1 -- 172.21.15.40:0/4177057850 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196252486 0 0) 0x7f6ff406cc10 con 0x7f6ff40b54d0 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff37fe640 1 -- 172.21.15.40:0/4177057850 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe4003530 con 0x7f6ff40b54d0 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff3fff640 1 -- 172.21.15.40:0/4177057850 >> v2:172.21.15.91:3300/0 conn(0x7f6ff4144840 msgr2=0x7f6ff415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff3fff640 1 --2- 172.21.15.40:0/4177057850 >> v2:172.21.15.91:3300/0 conn(0x7f6ff4144840 0x7f6ff415f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff3fff640 1 -- 172.21.15.40:0/4177057850 >> v1:172.21.15.40:6789/0 conn(0x7f6ff40b54d0 legacy=0x7f6ff406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff3fff640 1 -- 172.21.15.40:0/4177057850 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff415fb20 con 0x7f6ff4070b40 2023-11-04T01:42:27.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.138+0000 7f6ff8d4e640 1 --2- 172.21.15.40:0/4177057850 >> v2:172.21.15.91:3300/0 conn(0x7f6ff4144840 0x7f6ff415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:27.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ff3fff640 1 --2- 172.21.15.40:0/4177057850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4070b40 0x7f6ff40b4f90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6ff406f9d0 tx=0x7f6fe001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0525b5c5ccde48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ff37fe640 1 -- 172.21.15.40:0/4177057850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00ab600 con 0x7f6ff4070b40 2023-11-04T01:42:27.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ff37fe640 1 -- 172.21.15.40:0/4177057850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe00a7050 con 0x7f6ff4070b40 2023-11-04T01:42:27.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ff37fe640 1 -- 172.21.15.40:0/4177057850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00ab960 con 0x7f6ff4070b40 2023-11-04T01:42:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 -- 172.21.15.40:0/4177057850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4070b40 msgr2=0x7f6ff40b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/4177057850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4070b40 0x7f6ff40b4f90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6ff406f9d0 tx=0x7f6fe001c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 -- 172.21.15.40:0/4177057850 shutdown_connections 2023-11-04T01:42:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/4177057850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4070b40 0x7f6ff40b4f90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/4177057850 >> v2:172.21.15.91:3300/0 conn(0x7f6ff4144840 0x7f6ff415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 -- 172.21.15.40:0/4177057850 >> 172.21.15.40:0/4177057850 conn(0x7f6ff40cfc70 msgr2=0x7f6ff40d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 -- 172.21.15.40:0/4177057850 shutdown_connections 2023-11-04T01:42:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 -- 172.21.15.40:0/4177057850 wait complete. 2023-11-04T01:42:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 Processor -- start 2023-11-04T01:42:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.142+0000 7f6ffafb2640 1 -- start start 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff4070b40 0x7f6ff415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff40b54d0 0x7f6ff40b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 0x7f6ff40b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b45e0 con 0x7f6ff4144840 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4165970 con 0x7f6ff40b54d0 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b3960 con 0x7f6ff4070b40 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 0x7f6ff40b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 0x7f6ff40b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46250/0 (socket says 172.21.15.40:46250) 2023-11-04T01:42:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 -- 172.21.15.40:0/2812616908 learned_addr learned my addr 172.21.15.40:0/2812616908 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff3fff640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff40b54d0 0x7f6ff40b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff8d4e640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff4070b40 0x7f6ff415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 -- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff4070b40 msgr2=0x7f6ff415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff4070b40 0x7f6ff415aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 -- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff40b54d0 msgr2=0x7f6ff40b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff40b54d0 0x7f6ff40b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 -- 172.21.15.40:0/2812616908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009420 con 0x7f6ff4144840 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff954f640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 0x7f6ff40b32c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00cb70 tx=0x7f6fec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00ace0 con 0x7f6ff4144840 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00ae40 con 0x7f6ff4144840 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff40b3c40 con 0x7f6ff4144840 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec012620 con 0x7f6ff4144840 2023-11-04T01:42:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff40b4200 con 0x7f6ff4144840 2023-11-04T01:42:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff40b4720 con 0x7f6ff4144840 2023-11-04T01:42:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6fec007070 con 0x7f6ff4144840 2023-11-04T01:42:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff17fa640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6fd80664a0 0x7f6fd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f6fec0842d0 con 0x7f6ff4144840 2023-11-04T01:42:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.146+0000 7f6ff8d4e640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6fd80664a0 0x7f6fd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.150+0000 7f6ff8d4e640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6fd80664a0 0x7f6fd8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800d8b0 tx=0x7f6fe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.150+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ff40b4720 con 0x7f6ff4144840 2023-11-04T01:42:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.298+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ff40b4720 con 0x7f6ff4144840 2023-11-04T01:42:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.298+0000 7f6ff17fa640 1 -- 172.21.15.40:0/2812616908 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ff40b4720 con 0x7f6ff4144840 2023-11-04T01:42:27.305 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:27.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6fd80664a0 msgr2=0x7f6fd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6fd80664a0 0x7f6fd8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800d8b0 tx=0x7f6fe8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 msgr2=0x7f6ff40b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 0x7f6ff40b32c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00cb70 tx=0x7f6fec00a430 comp rx=0 tx=0).stop 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 shutdown_connections 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6fd80664a0 0x7f6fd8068960 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ff4144840 0x7f6ff40b32c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ff40b54d0 0x7f6ff40b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 --2- 172.21.15.40:0/2812616908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ff4070b40 0x7f6ff415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 >> 172.21.15.40:0/2812616908 conn(0x7f6ff40cfc70 msgr2=0x7f6ff4142980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 shutdown_connections 2023-11-04T01:42:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.302+0000 7f6ffafb2640 1 -- 172.21.15.40:0/2812616908 wait complete. 2023-11-04T01:42:27.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:27.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 Processor -- start 2023-11-04T01:42:27.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 -- start start 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f025c15add0 0x7f025c0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f025c15b1b0 0x7f025c0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c06cdd0 0x7f025c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0c9530 con 0x7f025c15b1b0 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0712f0 con 0x7f025c15add0 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0263d89640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0715d0 con 0x7f025c06cdd0 2023-11-04T01:42:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f025c15b1b0 0x7f025c0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f025c15b1b0 0x7f025c0b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34364/0 (socket says 172.21.15.40:34364) 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 -- 172.21.15.40:0/3613754220 learned_addr learned my addr 172.21.15.40:0/3613754220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261b25640 1 --2- 172.21.15.40:0/3613754220 >> v2:172.21.15.91:3300/0 conn(0x7f025c15add0 0x7f025c0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0262326640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c06cdd0 0x7f025c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 -- 172.21.15.40:0/3613754220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c06cdd0 msgr2=0x7f025c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c06cdd0 0x7f025c06a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 -- 172.21.15.40:0/3613754220 >> v2:172.21.15.91:3300/0 conn(0x7f025c15add0 msgr2=0x7f025c0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 --2- 172.21.15.40:0/3613754220 >> v2:172.21.15.91:3300/0 conn(0x7f025c15add0 0x7f025c0c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0261324640 1 -- 172.21.15.40:0/3613754220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0718b0 con 0x7f025c15b1b0 2023-11-04T01:42:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.490+0000 7f0262326640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c06cdd0 0x7f025c06a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0261324640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15b1b0 0x7f025c0b4260 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f025c0ce860 tx=0x7f024c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03f4466b24fbce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0260b23640 1 -- 172.21.15.40:0/3613754220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0ab600 con 0x7f025c15b1b0 2023-11-04T01:42:27.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0260b23640 1 -- 172.21.15.40:0/3613754220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0a7050 con 0x7f025c15b1b0 2023-11-04T01:42:27.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0260b23640 1 -- 172.21.15.40:0/3613754220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0ab980 con 0x7f025c15b1b0 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- 172.21.15.40:0/3613754220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15b1b0 msgr2=0x7f025c0b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15b1b0 0x7f025c0b4260 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f025c0ce860 tx=0x7f024c01c470 comp rx=0 tx=0).stop 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- 172.21.15.40:0/3613754220 shutdown_connections 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c06cdd0 0x7f025c06a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- 172.21.15.40:0/3613754220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15b1b0 0x7f025c0b4260 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- 172.21.15.40:0/3613754220 >> v2:172.21.15.91:3300/0 conn(0x7f025c15add0 0x7f025c0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- 172.21.15.40:0/3613754220 >> 172.21.15.40:0/3613754220 conn(0x7f025c0cb420 msgr2=0x7f025c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- 172.21.15.40:0/3613754220 shutdown_connections 2023-11-04T01:42:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- 172.21.15.40:0/3613754220 wait complete. 2023-11-04T01:42:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 Processor -- start 2023-11-04T01:42:27.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- start start 2023-11-04T01:42:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f025c06cdd0 0x7f025c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 0x7f025c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c15b1b0 0x7f025c151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0b1ab0 con 0x7f025c15add0 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0b2f10 con 0x7f025c06cdd0 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0263d89640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0b31f0 con 0x7f025c15b1b0 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0261324640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 0x7f025c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0261324640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 0x7f025c155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34374/0 (socket says 172.21.15.40:34374) 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0261324640 1 -- 172.21.15.40:0/2043744301 learned_addr learned my addr 172.21.15.40:0/2043744301 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0261b25640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f025c06cdd0 0x7f025c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.494+0000 7f0262326640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c15b1b0 0x7f025c151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261324640 1 -- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c15b1b0 msgr2=0x7f025c151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261324640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c15b1b0 0x7f025c151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261324640 1 -- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f025c06cdd0 msgr2=0x7f025c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261324640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f025c06cdd0 0x7f025c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261324640 1 -- 172.21.15.40:0/2043744301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0094d0 con 0x7f025c15add0 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261324640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 0x7f025c155950 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f024c01cd10 tx=0x7f024c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0b4840 con 0x7f025c15add0 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0b49a0 con 0x7f025c15add0 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c0b34d0 con 0x7f025c15add0 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0b4d30 con 0x7f025c15add0 2023-11-04T01:42:27.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0b2480 con 0x7f025c15add0 2023-11-04T01:42:27.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c0b15a0 con 0x7f025c15add0 2023-11-04T01:42:27.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f024c0b2040 con 0x7f025c15add0 2023-11-04T01:42:27.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f02527fc640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02400664a0 0x7f0240068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f024c11e4f0 con 0x7f025c15add0 2023-11-04T01:42:27.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261b25640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02400664a0 0x7f0240068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.498+0000 7f0261b25640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02400664a0 0x7f0240068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f025800b930 tx=0x7f0258008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.502+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f025c0b15a0 con 0x7f025c15add0 2023-11-04T01:42:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f025c0b15a0 con 0x7f025c15add0 2023-11-04T01:42:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f02527fc640 1 -- 172.21.15.40:0/2043744301 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f025c0b15a0 con 0x7f025c15add0 2023-11-04T01:42:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02400664a0 msgr2=0x7f0240068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02400664a0 0x7f0240068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f025800b930 tx=0x7f0258008040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 msgr2=0x7f025c155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 0x7f025c155950 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f024c01cd10 tx=0x7f024c019210 comp rx=0 tx=0).stop 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 shutdown_connections 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f02400664a0 0x7f0240068960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f025c15b1b0 0x7f025c151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c15add0 0x7f025c155950 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 --2- 172.21.15.40:0/2043744301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f025c06cdd0 0x7f025c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 >> 172.21.15.40:0/2043744301 conn(0x7f025c0cb420 msgr2=0x7f025c156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 shutdown_connections 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.658+0000 7f0263d89640 1 -- 172.21.15.40:0/2043744301 wait complete. 2023-11-04T01:42:27.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:27.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.794+0000 7fd252dda640 1 Processor -- start 2023-11-04T01:42:27.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd252dda640 1 -- start start 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd252dda640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd24c0b26c0 0x7fd24c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd252dda640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c160cb0 con 0x7fd24c15d420 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd252dda640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0b2fe0 con 0x7fd24c06b580 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd252dda640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c06c390 con 0x7fd24c0b26c0 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd24c15d420 0x7fd24c15d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60348/0 (socket says 172.21.15.40:60348) 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 -- 172.21.15.40:0/3278342357 learned_addr learned my addr 172.21.15.40:0/3278342357 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd250b76640 1 --2- 172.21.15.40:0/3278342357 >> v2:172.21.15.91:3300/0 conn(0x7fd24c0b26c0 0x7fd24c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533683244 0 0) 0x7fd24c160cb0 con 0x7fd24c15d420 2023-11-04T01:42:27.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd238003530 con 0x7fd24c15d420 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981956841 0 0) 0x7fd238003530 con 0x7fd24c15d420 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 >> v2:172.21.15.91:3300/0 conn(0x7fd24c0b26c0 msgr2=0x7fd24c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 --2- 172.21.15.40:0/3278342357 >> v2:172.21.15.91:3300/0 conn(0x7fd24c0b26c0 0x7fd24c0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 >> v1:172.21.15.91:6789/0 conn(0x7fd24c06b580 legacy=0x7fd24c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c160f50 con 0x7fd24c15d420 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd244001a00 con 0x7fd24c15d420 2023-11-04T01:42:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 >> v1:172.21.15.40:6789/0 conn(0x7fd24c15d420 legacy=0x7fd24c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238003980 0x7fd238003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd2380047d0 0x7fd238004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd238005190 0x7fd23800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c06c390 con 0x7fd238005190 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800c030 con 0x7fd238003980 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800c1f0 con 0x7fd2380047d0 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd238005190 0x7fd23800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd24bfff640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd2380047d0 0x7fd238004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 -- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd2380047d0 msgr2=0x7fd238004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd2380047d0 0x7fd238004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 -- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238003980 msgr2=0x7fd238003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238003980 0x7fd238003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.798+0000 7fd251377640 1 -- 172.21.15.40:0/3278342357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238003530 con 0x7fd238005190 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd251377640 1 -- 172.21.15.40:0/3278342357 reap_dead start 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd251377640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd238005190 0x7fd23800b990 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd24400a830 tx=0x7fd24401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b100a2267fd742 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440072d0 con 0x7fd238005190 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2440a8070 con 0x7fd238005190 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24b7fe640 1 -- 172.21.15.40:0/3278342357 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244007690 con 0x7fd238005190 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/3278342357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd238005190 msgr2=0x7fd23800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd238005190 0x7fd23800b990 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd24400a830 tx=0x7fd24401d340 comp rx=0 tx=0).stop 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/3278342357 shutdown_connections 2023-11-04T01:42:27.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 --2- 172.21.15.40:0/3278342357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd238005190 0x7fd23800b990 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/3278342357 >> 172.21.15.40:0/3278342357 conn(0x7fd24c09a030 msgr2=0x7fd24c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/3278342357 shutdown_connections 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/3278342357 wait complete. 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 Processor -- start 2023-11-04T01:42:27.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- start start 2023-11-04T01:42:27.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238005190 0x7fd24c1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 0x7fd24c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd24c0caa00 0x7fd24c0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b5330 con 0x7fd24c0ca580 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b5610 con 0x7fd238005190 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b3820 con 0x7fd24c0caa00 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 0x7fd24c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 0x7fd24c0b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34388/0 (socket says 172.21.15.40:34388) 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 -- 172.21.15.40:0/1272448081 learned_addr learned my addr 172.21.15.40:0/1272448081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd250b76640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238005190 0x7fd24c1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd251377640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd24c0caa00 0x7fd24c0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 -- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd24c0caa00 msgr2=0x7fd24c0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd24c0caa00 0x7fd24c0c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 -- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238005190 msgr2=0x7fd24c1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238005190 0x7fd24c1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 -- 172.21.15.40:0/1272448081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0b3b00 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd250b76640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238005190 0x7fd24c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd251377640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd24c0caa00 0x7fd24c0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd24bfff640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 0x7fd24c0b4300 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d4c0 tx=0x7fd23c00d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c005480 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c003620 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0b3de0 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0039f0 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.802+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0b4840 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.806+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c0744a0 con 0x7fd24c0ca580 2023-11-04T01:42:27.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.806+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd23c003b50 con 0x7fd24c0ca580 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.806+0000 7fd2497fa640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd22c0664a0 0x7fd22c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.806+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fd23c084200 con 0x7fd24c0ca580 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.806+0000 7fd250b76640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd22c0664a0 0x7fd22c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.806+0000 7fd250b76640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd22c0664a0 0x7fd22c068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd2340047c0 tx=0x7fd234008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.810+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd23c051190 con 0x7fd24c0ca580 2023-11-04T01:42:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.966+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fd24c0b4b20 con 0x7fd24c0ca580 2023-11-04T01:42:27.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.966+0000 7fd2497fa640 1 -- 172.21.15.40:0/1272448081 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v67) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd23c0547b0 con 0x7fd24c0ca580 2023-11-04T01:42:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd22c0664a0 msgr2=0x7fd22c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd22c0664a0 0x7fd22c068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd2340047c0 tx=0x7fd234008040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 msgr2=0x7fd24c0b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 0x7fd24c0b4300 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d4c0 tx=0x7fd23c00d980 comp rx=0 tx=0).stop 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 shutdown_connections 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd22c0664a0 0x7fd22c068960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd24c0caa00 0x7fd24c0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24c0ca580 0x7fd24c0b4300 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 --2- 172.21.15.40:0/1272448081 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd238005190 0x7fd24c1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 >> 172.21.15.40:0/1272448081 conn(0x7fd24c09a030 msgr2=0x7fd24c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 shutdown_connections 2023-11-04T01:42:27.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:27.970+0000 7fd252dda640 1 -- 172.21.15.40:0/1272448081 wait complete. 2023-11-04T01:42:27.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.102+0000 7f840aae5640 1 Processor -- start 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f840aae5640 1 -- start start 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f840aae5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 0x7f84040adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f840aae5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84040cd020 con 0x7f84040cc990 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f840aae5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84040cd300 con 0x7f84040c9a00 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f840aae5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84040cce10 con 0x7f84040adb50 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84040cc990 0x7f84040c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60352/0 (socket says 172.21.15.40:60352) 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 -- 172.21.15.40:0/2914014520 learned_addr learned my addr 172.21.15.40:0/2914014520 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992749299 0 0) 0x7f84040cd020 con 0x7f84040cc990 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f4005740 con 0x7f84040cc990 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8408881640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 0x7f84040adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2394766235 0 0) 0x7f83f4005740 con 0x7f84040cc990 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 msgr2=0x7f84040adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 0x7f84040adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 >> v1:172.21.15.91:6789/0 conn(0x7f84040c9a00 legacy=0x7f840406f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040cd5e0 con 0x7f84040cc990 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f83f0001680 con 0x7f84040cc990 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 >> v1:172.21.15.40:6789/0 conn(0x7f84040cc990 legacy=0x7f84040c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83f4005bc0 0x7f83f4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f83f4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 0x7f83f40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040cce10 con 0x7f83f40069e0 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f400dc50 con 0x7f83f4005bc0 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f400de10 con 0x7f84040adb50 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f83f4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8408881640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83f4005bc0 0x7f83f4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 -- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 msgr2=0x7f83f40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040adb50 0x7f83f40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 -- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83f4005bc0 msgr2=0x7f83f4005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f83f4005bc0 0x7f83f4005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.106+0000 7f8403fff640 1 -- 172.21.15.40:0/2914014520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4005740 con 0x7f83f40069e0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8403fff640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f83f4006e60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c210 tx=0x7f83f001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa2d8f78819bb04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0005ae0 con 0x7f83f40069e0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00ab070 con 0x7f83f40069e0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f84037fe640 1 -- 172.21.15.40:0/2914014520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0007070 con 0x7f83f40069e0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- 172.21.15.40:0/2914014520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 msgr2=0x7f83f4006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 --2- 172.21.15.40:0/2914014520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f83f4006e60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c210 tx=0x7f83f001f350 comp rx=0 tx=0).stop 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8409082640 1 -- 172.21.15.40:0/2914014520 reap_dead start 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- 172.21.15.40:0/2914014520 shutdown_connections 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- 172.21.15.40:0/2914014520 >> 172.21.15.40:0/2914014520 conn(0x7f84040cb510 msgr2=0x7f84040cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- 172.21.15.40:0/2914014520 shutdown_connections 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- 172.21.15.40:0/2914014520 wait complete. 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 Processor -- start 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- start start 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f8404156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040aae90 0x7f84041ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84040a9fa0 0x7f84040ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040c5c00 con 0x7f83f40069e0 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040c5ea0 con 0x7f84040a9fa0 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f840aae5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84040c6180 con 0x7f84040aae90 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f8404156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f8404156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34404/0 (socket says 172.21.15.40:34404) 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 -- 172.21.15.40:0/2048584622 learned_addr learned my addr 172.21.15.40:0/2048584622 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8403fff640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040aae90 0x7f84041ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8409082640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84040a9fa0 0x7f84040ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 -- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040aae90 msgr2=0x7f84041ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040aae90 0x7f84041ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 -- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84040a9fa0 msgr2=0x7f84040ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84040a9fa0 0x7f84040ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 -- 172.21.15.40:0/2048584622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040c6460 con 0x7f83f40069e0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.110+0000 7f8408881640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f8404156e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f83f8011600 tx=0x7f83f8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8004220 con 0x7f83f40069e0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8004380 con 0x7f83f40069e0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84040ab3a0 con 0x7f83f40069e0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800f8c0 con 0x7f83f40069e0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8404157530 con 0x7f83f40069e0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84040c65f0 con 0x7f83f40069e0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83f800fa20 con 0x7f83f40069e0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f84017fa640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e80664d0 0x7f83e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f83f8084450 con 0x7f83f40069e0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f8403fff640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e80664d0 0x7f83e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.114+0000 7f8403fff640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e80664d0 0x7f83e8068990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83f00af000 tx=0x7f83f00aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.118+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f83f8051490 con 0x7f83f40069e0 2023-11-04T01:42:28.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f84040744a0 con 0x7f83f40069e0 2023-11-04T01:42:28.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f84017fa640 1 -- 172.21.15.40:0/2048584622 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v67) v1 ==== 107+0+11 (secure 0 0 0) 0x7f83f8054ab0 con 0x7f83f40069e0 2023-11-04T01:42:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e80664d0 msgr2=0x7f83e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e80664d0 0x7f83e8068990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83f00af000 tx=0x7f83f00aa000 comp rx=0 tx=0).stop 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 msgr2=0x7f8404156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f8404156e70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f83f8011600 tx=0x7f83f8011ac0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 shutdown_connections 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f83e80664d0 0x7f83e8068990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84040a9fa0 0x7f84040ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84040aae90 0x7f84041ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 --2- 172.21.15.40:0/2048584622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40069e0 0x7f8404156e70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.270+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 >> 172.21.15.40:0/2048584622 conn(0x7f84040cb510 msgr2=0x7f8404158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.274+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 shutdown_connections 2023-11-04T01:42:28.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.274+0000 7f840aae5640 1 -- 172.21.15.40:0/2048584622 wait complete. 2023-11-04T01:42:28.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 Processor -- start 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 -- start start 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa0d40b4990 0x7fa0d40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 0x7fa0d40cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40b6070 con 0x7fa0d40d0690 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40b8ed0 con 0x7fa0d40b4990 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0da31a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b52b0 con 0x7fa0d40b74f0 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa0d40d0690 0x7fa0d40cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60358/0 (socket says 172.21.15.40:60358) 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 -- 172.21.15.40:0/3614828217 learned_addr learned my addr 172.21.15.40:0/3614828217 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470284253 0 0) 0x7fa0d40b6070 con 0x7fa0d40d0690 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d3fff640 1 --2- 172.21.15.40:0/3614828217 >> v2:172.21.15.91:3300/0 conn(0x7fa0d40b4990 0x7fa0d40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0bc003530 con 0x7fa0d40d0690 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d88b7640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 0x7fa0d40cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656493954 0 0) 0x7fa0bc003530 con 0x7fa0d40d0690 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 msgr2=0x7fa0d40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 0x7fa0d40cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 >> v2:172.21.15.91:3300/0 conn(0x7fa0d40b4990 msgr2=0x7fa0d40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 --2- 172.21.15.40:0/3614828217 >> v2:172.21.15.91:3300/0 conn(0x7fa0d40b4990 0x7fa0d40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40d1ce0 con 0x7fa0d40d0690 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fa0c8001680 con 0x7fa0d40d0690 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 >> v1:172.21.15.40:6789/0 conn(0x7fa0d40d0690 legacy=0x7fa0d40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 0x7fa0bc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0bc004d10 0x7fa0bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b8ed0 con 0x7fa0bc003f00 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b52b0 con 0x7fa0bc004d10 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc00ba70 con 0x7fa0d40b74f0 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d3fff640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 0x7fa0bc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 -- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 msgr2=0x7fa0bc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40b74f0 0x7fa0bc003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 -- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0bc004d10 msgr2=0x7fa0bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0bc004d10 0x7fa0bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.406+0000 7fa0d37fe640 1 -- 172.21.15.40:0/3614828217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc003530 con 0x7fa0bc003f00 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0bc0047d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c210 tx=0x7fa0c801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661738ab64b8dbb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80a5940 con 0x7fa0bc003f00 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80a5aa0 con 0x7fa0bc003f00 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d2ffd640 1 -- 172.21.15.40:0/3614828217 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80058e0 con 0x7fa0bc003f00 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- 172.21.15.40:0/3614828217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 msgr2=0x7fa0bc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 --2- 172.21.15.40:0/3614828217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0bc0047d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c210 tx=0x7fa0c801cc40 comp rx=0 tx=0).stop 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d88b7640 1 -- 172.21.15.40:0/3614828217 reap_dead start 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- 172.21.15.40:0/3614828217 shutdown_connections 2023-11-04T01:42:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- 172.21.15.40:0/3614828217 >> 172.21.15.40:0/3614828217 conn(0x7fa0d40cf990 msgr2=0x7fa0d40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- 172.21.15.40:0/3614828217 shutdown_connections 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- 172.21.15.40:0/3614828217 wait complete. 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 Processor -- start 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- start start 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0d4157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d4159d10 0x7fa0d41f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40cd540 0x7fa0d40cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40cdf00 con 0x7fa0bc003f00 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d41f22b0 con 0x7fa0d4159d10 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0da31a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b1860 con 0x7fa0d40cd540 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0d4157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0d4157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34416/0 (socket says 172.21.15.40:34416) 2023-11-04T01:42:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 -- 172.21.15.40:0/64272613 learned_addr learned my addr 172.21.15.40:0/64272613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d4159d10 0x7fa0d41f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d88b7640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40cd540 0x7fa0d40cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 -- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40cd540 msgr2=0x7fa0d40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40cd540 0x7fa0d40cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 -- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d4159d10 msgr2=0x7fa0d41f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d4159d10 0x7fa0d41f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 -- 172.21.15.40:0/64272613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d41f2550 con 0x7fa0bc003f00 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d4159d10 0x7fa0d41f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d3fff640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0d4157630 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4010900 tx=0x7fa0c4010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40096b0 con 0x7fa0bc003f00 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.410+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c400ec20 con 0x7fa0bc003f00 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d41f2830 con 0x7fa0bc003f00 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c401c400 con 0x7fa0bc003f00 2023-11-04T01:42:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d41f2df0 con 0x7fa0bc003f00 2023-11-04T01:42:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d415a0f0 con 0x7fa0bc003f00 2023-11-04T01:42:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0c401c560 con 0x7fa0bc003f00 2023-11-04T01:42:28.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0d0ff9640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0c00664a0 0x7fa0c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fa0c4084950 con 0x7fa0bc003f00 2023-11-04T01:42:28.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0c00664a0 0x7fa0c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.414+0000 7fa0d37fe640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0c00664a0 0x7fa0c0068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80aa000 tx=0x7fa0c8001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.418+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0c4051a40 con 0x7fa0bc003f00 2023-11-04T01:42:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.598+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0d40744a0 con 0x7fa0bc003f00 2023-11-04T01:42:28.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0d0ff9640 1 -- 172.21.15.40:0/64272613 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4911 (secure 0 0 0) 0x7fa0c4082e60 con 0x7fa0bc003f00 2023-11-04T01:42:28.606 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:05.330601+0000","modified":"2023-11-04T01:42:07.357303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3229855719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3229855719},{"type":"v1","addr":"172.21.15.40:6835","nonce":3229855719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2023-11-04T01:42:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0c00664a0 msgr2=0x7fa0c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0c00664a0 0x7fa0c0068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80aa000 tx=0x7fa0c8001a80 comp rx=0 tx=0).stop 2023-11-04T01:42:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 msgr2=0x7fa0d4157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0d4157630 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4010900 tx=0x7fa0c4010dc0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 shutdown_connections 2023-11-04T01:42:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa0c00664a0 0x7fa0c0068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa0d40cd540 0x7fa0d40cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d4159d10 0x7fa0d41f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 --2- 172.21.15.40:0/64272613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0bc003f00 0x7fa0d4157630 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 >> 172.21.15.40:0/64272613 conn(0x7fa0d40cf990 msgr2=0x7fa0d40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 shutdown_connections 2023-11-04T01:42:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.602+0000 7fa0da31a640 1 -- 172.21.15.40:0/64272613 wait complete. 2023-11-04T01:42:28.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.738+0000 7fd0b6387640 1 Processor -- start 2023-11-04T01:42:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.738+0000 7fd0b6387640 1 -- start start 2023-11-04T01:42:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b00b4990 0x7fd0b00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00b6070 con 0x7fd0b00d0690 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00b8ed0 con 0x7fd0b00b4990 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00b52b0 con 0x7fd0b00b74f0 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b00b4990 0x7fd0b00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b00b4990 0x7fd0b00b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34430/0 (socket says 172.21.15.40:34430) 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 -- 172.21.15.40:0/3027025761 learned_addr learned my addr 172.21.15.40:0/3027025761 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 -- 172.21.15.40:0/3027025761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 msgr2=0x7fd0b00cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 --2- 172.21.15.40:0/3027025761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 -- 172.21.15.40:0/3027025761 >> v1:172.21.15.91:6789/0 conn(0x7fd0b00d0690 legacy=0x7fd0b00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 -- 172.21.15.40:0/3027025761 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00d1ce0 con 0x7fd0b00b4990 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0affff640 1 --2- 172.21.15.40:0/3027025761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00b4990 0x7fd0b00b4d70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009e50 tx=0x7fd0a001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a492bbbfa87ff9db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0aeffd640 1 -- 172.21.15.40:0/3027025761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00af400 con 0x7fd0b00b4990 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0aeffd640 1 -- 172.21.15.40:0/3027025761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00ab050 con 0x7fd0b00b4990 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0aeffd640 1 -- 172.21.15.40:0/3027025761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00af780 con 0x7fd0b00b4990 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- 172.21.15.40:0/3027025761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00b4990 msgr2=0x7fd0b00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 --2- 172.21.15.40:0/3027025761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00b4990 0x7fd0b00b4d70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009e50 tx=0x7fd0a001f1c0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- 172.21.15.40:0/3027025761 shutdown_connections 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 --2- 172.21.15.40:0/3027025761 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b00cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 --2- 172.21.15.40:0/3027025761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00b4990 0x7fd0b00b4d70 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- 172.21.15.40:0/3027025761 >> 172.21.15.40:0/3027025761 conn(0x7fd0b00cf990 msgr2=0x7fd0b00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- 172.21.15.40:0/3027025761 shutdown_connections 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.742+0000 7fd0b6387640 1 -- 172.21.15.40:0/3027025761 wait complete. 2023-11-04T01:42:28.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 Processor -- start 2023-11-04T01:42:28.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- start start 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b00b4990 0x7fd0b01f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 0x7fd0b00b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b015f4f0 con 0x7fd0b00d0690 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01f6ce0 con 0x7fd0b00b4990 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b015e970 con 0x7fd0b00b74f0 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 0x7fd0b00b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 0x7fd0b00b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34440/0 (socket says 172.21.15.40:34440) 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 -- 172.21.15.40:0/2456363507 learned_addr learned my addr 172.21.15.40:0/2456363507 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0affff640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b00b4990 0x7fd0b01f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0af7fe640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 -- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 msgr2=0x7fd0b014b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b014b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 -- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b00b4990 msgr2=0x7fd0b01f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b00b4990 0x7fd0b01f67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 -- 172.21.15.40:0/2456363507 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0009b30 con 0x7fd0b00d0690 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b4924640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 0x7fd0b00b79b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b410 tx=0x7fd0a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8011830 con 0x7fd0b00d0690 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a80119b0 con 0x7fd0b00d0690 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b015ec50 con 0x7fd0b00d0690 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8011d60 con 0x7fd0b00d0690 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b015f210 con 0x7fd0b00d0690 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.746+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b00744a0 con 0x7fd0b00d0690 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.750+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0a801a400 con 0x7fd0b00d0690 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.750+0000 7fd0acff9640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd09c0664a0 0x7fd09c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.750+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fd0a80844e0 con 0x7fd0b00d0690 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.750+0000 7fd0affff640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd09c0664a0 0x7fd09c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.750+0000 7fd0affff640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd09c0664a0 0x7fd09c068960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00b1000 tx=0x7fd0a00aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.754+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0a8051520 con 0x7fd0b00d0690 2023-11-04T01:42:28.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.906+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0b015cc00 con 0x7fd0b00d0690 2023-11-04T01:42:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.906+0000 7fd0acff9640 1 -- 172.21.15.40:0/2456363507 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+21739 (secure 0 0 0) 0x7fd0a8054b40 con 0x7fd0b00d0690 2023-11-04T01:42:28.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":67,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:27.909006+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd09c0664a0 msgr2=0x7fd09c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd09c0664a0 0x7fd09c068960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00b1000 tx=0x7fd0a00aa000 comp rx=0 tx=0).stop 2023-11-04T01:42:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 msgr2=0x7fd0b00b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 0x7fd0b00b79b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b410 tx=0x7fd0a800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 shutdown_connections 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd09c0664a0 0x7fd09c068960 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b00d0690 0x7fd0b00b79b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd0b00b74f0 0x7fd0b014b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 --2- 172.21.15.40:0/2456363507 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd0b00b4990 0x7fd0b01f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 >> 172.21.15.40:0/2456363507 conn(0x7fd0b00cf990 msgr2=0x7fd0b00cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 shutdown_connections 2023-11-04T01:42:28.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:28.910+0000 7fd0b6387640 1 -- 172.21.15.40:0/2456363507 wait complete. 2023-11-04T01:42:28.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:42:28.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 Processor -- start 2023-11-04T01:42:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 -- start start 2023-11-04T01:42:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 0x7ff5d80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80b74f0 0x7ff5d80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d80b6070 con 0x7ff5d80d0690 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d80b8ed0 con 0x7ff5d80b4990 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5de457640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80b52b0 con 0x7ff5d80b74f0 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5d7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 0x7ff5d80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5cffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff5d80d0690 0x7ff5d80cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:38430/0 (socket says 172.21.15.40:38430) 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5dc9f4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80b74f0 0x7ff5d80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5cffff640 1 -- 172.21.15.40:0/3807211964 learned_addr learned my addr 172.21.15.40:0/3807211964 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5d7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 0x7ff5d80b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:37288/0 (socket says 172.21.15.40:37288) 2023-11-04T01:42:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5dc9f4640 1 -- 172.21.15.40:0/3807211964 >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 msgr2=0x7ff5d80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5dc9f4640 1 --2- 172.21.15.40:0/3807211964 >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 0x7ff5d80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5dc9f4640 1 -- 172.21.15.40:0/3807211964 >> v1:172.21.15.91:6789/0 conn(0x7ff5d80d0690 legacy=0x7ff5d80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5dc9f4640 1 -- 172.21.15.40:0/3807211964 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80d1ce0 con 0x7ff5d80b74f0 2023-11-04T01:42:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.042+0000 7ff5d7fff640 1 --2- 172.21.15.40:0/3807211964 >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 0x7ff5d80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5dc9f4640 1 --2- 172.21.15.40:0/3807211964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80b74f0 0x7ff5d80cde80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009d90 tx=0x7ff5d001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6350578cd207e23a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5d77fe640 1 -- 172.21.15.40:0/3807211964 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00af600 con 0x7ff5d80b74f0 2023-11-04T01:42:29.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5d77fe640 1 -- 172.21.15.40:0/3807211964 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d00ab050 con 0x7ff5d80b74f0 2023-11-04T01:42:29.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5d77fe640 1 -- 172.21.15.40:0/3807211964 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00af980 con 0x7ff5d80b74f0 2023-11-04T01:42:29.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 -- 172.21.15.40:0/3807211964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80b74f0 msgr2=0x7ff5d80cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 --2- 172.21.15.40:0/3807211964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80b74f0 0x7ff5d80cde80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009d90 tx=0x7ff5d001f130 comp rx=0 tx=0).stop 2023-11-04T01:42:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 -- 172.21.15.40:0/3807211964 shutdown_connections 2023-11-04T01:42:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 --2- 172.21.15.40:0/3807211964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80b74f0 0x7ff5d80cde80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 --2- 172.21.15.40:0/3807211964 >> v2:172.21.15.91:3300/0 conn(0x7ff5d80b4990 0x7ff5d80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 -- 172.21.15.40:0/3807211964 >> 172.21.15.40:0/3807211964 conn(0x7ff5d80cf990 msgr2=0x7ff5d80cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 -- 172.21.15.40:0/3807211964 shutdown_connections 2023-11-04T01:42:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.046+0000 7ff5de457640 1 -- 172.21.15.40:0/3807211964 wait complete. 2023-11-04T01:42:29.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 Processor -- start 2023-11-04T01:42:29.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- start start 2023-11-04T01:42:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 0x7ff5d80aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5d80b74f0 0x7ff5d80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80d0690 0x7ff5d815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80aa850 con 0x7ff5d80b4990 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80acbe0 con 0x7ff5d80b74f0 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d80ab040 con 0x7ff5d80d0690 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 0x7ff5d80aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 0x7ff5d80aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34452/0 (socket says 172.21.15.40:34452) 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 -- 172.21.15.40:0/2506010390 learned_addr learned my addr 172.21.15.40:0/2506010390 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5dc9f4640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80d0690 0x7ff5d815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5cffff640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5d80b74f0 0x7ff5d80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 -- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80d0690 msgr2=0x7ff5d815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80d0690 0x7ff5d815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 -- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5d80b74f0 msgr2=0x7ff5d80ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5d80b74f0 0x7ff5d80ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 -- 172.21.15.40:0/2506010390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8009420 con 0x7ff5d80b4990 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d7fff640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 0x7ff5d80aa310 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800e980 tx=0x7ff5c800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800ca00 con 0x7ff5d80b4990 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800cb60 con 0x7ff5d80b4990 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d0009a70 con 0x7ff5d80b4990 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8013470 con 0x7ff5d80b4990 2023-11-04T01:42:29.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d80ae1c0 con 0x7ff5d80b4990 2023-11-04T01:42:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d80744a0 con 0x7ff5d80b4990 2023-11-04T01:42:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5c80135d0 con 0x7ff5d80b4990 2023-11-04T01:42:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d57fa640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.050+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7ff5c80844a0 con 0x7ff5d80b4990 2023-11-04T01:42:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.054+0000 7ff5cffff640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.054+0000 7ff5cffff640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5b80664a0 0x7ff5b8068960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80b37b0 tx=0x7ff5c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.054+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5c8051570 con 0x7ff5d80b4990 2023-11-04T01:42:29.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.250+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d80b37e0 con 0x7ff5d80b4990 2023-11-04T01:42:29.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.250+0000 7ff5d57fa640 1 -- 172.21.15.40:0/2506010390 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4911 (secure 0 0 0) 0x7ff5c8054b90 con 0x7ff5d80b4990 2023-11-04T01:42:29.256 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:05.330601+0000","modified":"2023-11-04T01:42:07.357303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3229855719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3229855719},{"type":"v1","addr":"172.21.15.40:6835","nonce":3229855719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:29.256 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5b80664a0 msgr2=0x7ff5b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5b80664a0 0x7ff5b8068960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80b37b0 tx=0x7ff5c0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 msgr2=0x7ff5d80aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 0x7ff5d80aa310 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800e980 tx=0x7ff5c800ee40 comp rx=0 tx=0).stop 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 shutdown_connections 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff5d80d0690 0x7ff5d815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff5d80b74f0 0x7ff5d80ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 --2- 172.21.15.40:0/2506010390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5d80b4990 0x7ff5d80aa310 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 >> 172.21.15.40:0/2506010390 conn(0x7ff5d80cf990 msgr2=0x7ff5d80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 shutdown_connections 2023-11-04T01:42:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.254+0000 7ff5de457640 1 -- 172.21.15.40:0/2506010390 wait complete. 2023-11-04T01:42:29.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:29.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.394+0000 7fb73b52d640 1 Processor -- start 2023-11-04T01:42:29.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.394+0000 7fb73b52d640 1 -- start start 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb73b52d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb73415b290 0x7fb73406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb73b52d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7340c2670 0x7fb7340b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb73b52d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb73406fe30 0x7fb7340b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb73b52d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73406c740 con 0x7fb73406fe30 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb73b52d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73415b670 con 0x7fb73415b290 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb73b52d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73406bb30 con 0x7fb7340c2670 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb73406fe30 0x7fb7340b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb73406fe30 0x7fb7340b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34454/0 (socket says 172.21.15.40:34454) 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 -- 172.21.15.40:0/336182108 learned_addr learned my addr 172.21.15.40:0/336182108 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb7392c9640 1 --2- 172.21.15.40:0/336182108 >> v2:172.21.15.91:3300/0 conn(0x7fb73415b290 0x7fb73406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb738ac8640 1 --2- 172.21.15.40:0/336182108 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7340c2670 0x7fb7340b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 -- 172.21.15.40:0/336182108 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7340c2670 msgr2=0x7fb7340b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 --2- 172.21.15.40:0/336182108 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7340c2670 0x7fb7340b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 -- 172.21.15.40:0/336182108 >> v2:172.21.15.91:3300/0 conn(0x7fb73415b290 msgr2=0x7fb73406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 --2- 172.21.15.40:0/336182108 >> v2:172.21.15.91:3300/0 conn(0x7fb73415b290 0x7fb73406f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 -- 172.21.15.40:0/336182108 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73406be10 con 0x7fb73406fe30 2023-11-04T01:42:29.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.398+0000 7fb739aca640 1 --2- 172.21.15.40:0/336182108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73406fe30 0x7fb7340b0b70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb7340ce930 tx=0x7fb72c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2956fd69770e278 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb72bfff640 1 -- 172.21.15.40:0/336182108 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0a5790 con 0x7fb73406fe30 2023-11-04T01:42:29.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb72bfff640 1 -- 172.21.15.40:0/336182108 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0a58f0 con 0x7fb73406fe30 2023-11-04T01:42:29.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb72bfff640 1 -- 172.21.15.40:0/336182108 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0a5c80 con 0x7fb73406fe30 2023-11-04T01:42:29.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- 172.21.15.40:0/336182108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73406fe30 msgr2=0x7fb7340b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- 172.21.15.40:0/336182108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73406fe30 0x7fb7340b0b70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb7340ce930 tx=0x7fb72c01c910 comp rx=0 tx=0).stop 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- 172.21.15.40:0/336182108 shutdown_connections 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- 172.21.15.40:0/336182108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73406fe30 0x7fb7340b0b70 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- 172.21.15.40:0/336182108 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb7340c2670 0x7fb7340b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- 172.21.15.40:0/336182108 >> v2:172.21.15.91:3300/0 conn(0x7fb73415b290 0x7fb73406f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- 172.21.15.40:0/336182108 >> 172.21.15.40:0/336182108 conn(0x7fb7340cebb0 msgr2=0x7fb7340cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- 172.21.15.40:0/336182108 shutdown_connections 2023-11-04T01:42:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- 172.21.15.40:0/336182108 wait complete. 2023-11-04T01:42:29.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 Processor -- start 2023-11-04T01:42:29.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- start start 2023-11-04T01:42:29.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb73406fe30 0x7fb734140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7340c2670 0x7fb734150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 0x7fb734153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73413fdd0 con 0x7fb73415b290 2023-11-04T01:42:29.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73415e8f0 con 0x7fb7340c2670 2023-11-04T01:42:29.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb73b52d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73415e610 con 0x7fb73406fe30 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb739aca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 0x7fb734153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb739aca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 0x7fb734153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34456/0 (socket says 172.21.15.40:34456) 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb739aca640 1 -- 172.21.15.40:0/1642244079 learned_addr learned my addr 172.21.15.40:0/1642244079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb7392c9640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb73406fe30 0x7fb734140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.402+0000 7fb738ac8640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7340c2670 0x7fb734150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb739aca640 1 -- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb73406fe30 msgr2=0x7fb734140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb739aca640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb73406fe30 0x7fb734140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb739aca640 1 -- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7340c2670 msgr2=0x7fb734150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb739aca640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7340c2670 0x7fb734150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb739aca640 1 -- 172.21.15.40:0/1642244079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009b30 con 0x7fb73415b290 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb739aca640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 0x7fb734153b40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0af040 tx=0x7fb72c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0b8670 con 0x7fb73415b290 2023-11-04T01:42:29.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0b87d0 con 0x7fb73415b290 2023-11-04T01:42:29.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73413f780 con 0x7fb73415b290 2023-11-04T01:42:29.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0b8b60 con 0x7fb73415b290 2023-11-04T01:42:29.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb734152f80 con 0x7fb73415b290 2023-11-04T01:42:29.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73413ff40 con 0x7fb73415b290 2023-11-04T01:42:29.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb72c0b8cc0 con 0x7fb73415b290 2023-11-04T01:42:29.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb729ffb640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7180664d0 0x7fb718068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fb72c11f8c0 con 0x7fb73415b290 2023-11-04T01:42:29.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb7392c9640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7180664d0 0x7fb718068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.406+0000 7fb7392c9640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7180664d0 0x7fb718068990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb7340b0b30 tx=0x7fb730008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.410+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb72c0eca80 con 0x7fb73415b290 2023-11-04T01:42:29.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.598+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7340744a0 con 0x7fb73415b290 2023-11-04T01:42:29.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.598+0000 7fb729ffb640 1 -- 172.21.15.40:0/1642244079 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4911 (secure 0 0 0) 0x7fb72c0f00a0 con 0x7fb73415b290 2023-11-04T01:42:29.605 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:05.330601+0000","modified":"2023-11-04T01:42:07.357303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3229855719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3229855719},{"type":"v1","addr":"172.21.15.40:6835","nonce":3229855719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 30 2023-11-04T01:42:29.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7180664d0 msgr2=0x7fb718068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7180664d0 0x7fb718068990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb7340b0b30 tx=0x7fb730008040 comp rx=0 tx=0).stop 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 msgr2=0x7fb734153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 0x7fb734153b40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0af040 tx=0x7fb72c0196b0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 shutdown_connections 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7180664d0 0x7fb718068990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb73415b290 0x7fb734153b40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb7340c2670 0x7fb734150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 --2- 172.21.15.40:0/1642244079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb73406fe30 0x7fb734140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 >> 172.21.15.40:0/1642244079 conn(0x7fb7340cebb0 msgr2=0x7fb734157450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 shutdown_connections 2023-11-04T01:42:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.602+0000 7fb73b52d640 1 -- 172.21.15.40:0/1642244079 wait complete. 2023-11-04T01:42:29.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:29.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 Processor -- start 2023-11-04T01:42:29.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 -- start start 2023-11-04T01:42:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f5415a1f0 0x7f0f540cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540b0d40 0x7f0f540704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f540ccee0 con 0x7f0f540cdea0 2023-11-04T01:42:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5415a5d0 con 0x7f0f5415a1f0 2023-11-04T01:42:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f5b9c8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540ca900 con 0x7f0f540b0d40 2023-11-04T01:42:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f5415a1f0 0x7f0f540cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59f65640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540b0d40 0x7f0f540704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f5415a1f0 0x7f0f540cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34466/0 (socket says 172.21.15.40:34466) 2023-11-04T01:42:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 -- 172.21.15.40:0/3310829721 learned_addr learned my addr 172.21.15.40:0/3310829721 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f58f63640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0f540cdea0 0x7f0f540b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:38440/0 (socket says 172.21.15.40:38440) 2023-11-04T01:42:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 -- 172.21.15.40:0/3310829721 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540b0d40 msgr2=0x7f0f540704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 --2- 172.21.15.40:0/3310829721 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540b0d40 0x7f0f540704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 -- 172.21.15.40:0/3310829721 >> v1:172.21.15.91:6789/0 conn(0x7f0f540cdea0 legacy=0x7f0f540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.738+0000 7f0f59764640 1 -- 172.21.15.40:0/3310829721 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540cabe0 con 0x7f0f5415a1f0 2023-11-04T01:42:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 --2- 172.21.15.40:0/3310829721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5415a1f0 0x7f0f540cd370 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000b920 tx=0x7f0f5001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da19e80ccd3f2af7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f4bfff640 1 -- 172.21.15.40:0/3310829721 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500a5a70 con 0x7f0f5415a1f0 2023-11-04T01:42:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f4bfff640 1 -- 172.21.15.40:0/3310829721 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500a5bd0 con 0x7f0f5415a1f0 2023-11-04T01:42:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f4bfff640 1 -- 172.21.15.40:0/3310829721 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500ad440 con 0x7f0f5415a1f0 2023-11-04T01:42:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/3310829721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5415a1f0 msgr2=0x7f0f540cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/3310829721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5415a1f0 0x7f0f540cd370 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000b920 tx=0x7f0f5001c9b0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/3310829721 shutdown_connections 2023-11-04T01:42:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/3310829721 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540b0d40 0x7f0f540704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/3310829721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5415a1f0 0x7f0f540cd370 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/3310829721 >> 172.21.15.40:0/3310829721 conn(0x7f0f540cebb0 msgr2=0x7f0f540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/3310829721 shutdown_connections 2023-11-04T01:42:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/3310829721 wait complete. 2023-11-04T01:42:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 Processor -- start 2023-11-04T01:42:29.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- start start 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 0x7f0f541f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540cdea0 0x7f0f5415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f5415a1f0 0x7f0f5414c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5415d670 con 0x7f0f540b0d40 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5415b500 con 0x7f0f5415a1f0 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f5b9c8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541f24f0 con 0x7f0f540cdea0 2023-11-04T01:42:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 0x7f0f541f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 0x7f0f541f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34478/0 (socket says 172.21.15.40:34478) 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 -- 172.21.15.40:0/2445626044 learned_addr learned my addr 172.21.15.40:0/2445626044 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f58f63640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540cdea0 0x7f0f5415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59f65640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f5415a1f0 0x7f0f5414c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 -- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540cdea0 msgr2=0x7f0f5415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540cdea0 0x7f0f5415d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 -- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f5415a1f0 msgr2=0x7f0f5414c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f5415a1f0 0x7f0f5414c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59764640 1 -- 172.21.15.40:0/2445626044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5000b580 con 0x7f0f540b0d40 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f58f63640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540cdea0 0x7f0f5415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.742+0000 7f0f59f65640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f5415a1f0 0x7f0f5414c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f59764640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 0x7f0f541f1e10 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000b920 tx=0x7f0f50019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500b8670 con 0x7f0f540b0d40 2023-11-04T01:42:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500b87d0 con 0x7f0f540b0d40 2023-11-04T01:42:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f541f27d0 con 0x7f0f540b0d40 2023-11-04T01:42:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500b8b60 con 0x7f0f540b0d40 2023-11-04T01:42:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f541f2d90 con 0x7f0f540b0d40 2023-11-04T01:42:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f540744a0 con 0x7f0f540b0d40 2023-11-04T01:42:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f500b4070 con 0x7f0f540b0d40 2023-11-04T01:42:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f49ffb640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f380664a0 0x7f0f38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f0f5011fa80 con 0x7f0f540b0d40 2023-11-04T01:42:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f58f63640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f380664a0 0x7f0f38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.746+0000 7f0f58f63640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f380664a0 0x7f0f38068960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0f540b2b50 tx=0x7f0f44007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.750+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f500ecb50 con 0x7f0f540b0d40 2023-11-04T01:42:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.902+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f54155e80 con 0x7f0f540b0d40 2023-11-04T01:42:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.902+0000 7f0f49ffb640 1 -- 172.21.15.40:0/2445626044 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+21739 (secure 0 0 0) 0x7f0f500f0170 con 0x7f0f540b0d40 2023-11-04T01:42:29.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":67,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:27.909006+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:03.913153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:04.307758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f380664a0 msgr2=0x7f0f38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f380664a0 0x7f0f38068960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0f540b2b50 tx=0x7f0f44007d50 comp rx=0 tx=0).stop 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 msgr2=0x7f0f541f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 0x7f0f541f1e10 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000b920 tx=0x7f0f50019750 comp rx=0 tx=0).stop 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 shutdown_connections 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0f380664a0 0x7f0f38068960 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0f5415a1f0 0x7f0f5414c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0f540cdea0 0x7f0f5415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 --2- 172.21.15.40:0/2445626044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f540b0d40 0x7f0f541f1e10 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 >> 172.21.15.40:0/2445626044 conn(0x7f0f540cebb0 msgr2=0x7f0f540c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 shutdown_connections 2023-11-04T01:42:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:29.906+0000 7f0f5b9c8640 1 -- 172.21.15.40:0/2445626044 wait complete. 2023-11-04T01:42:29.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:42:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 Processor -- start 2023-11-04T01:42:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 -- start start 2023-11-04T01:42:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff71415b090 0x7ff71415f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff71406a870 0x7ff7140b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7140cbe40 con 0x7ff71415b470 2023-11-04T01:42:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71415fca0 con 0x7ff71406a870 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71b38d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7140cc120 con 0x7ff71415b090 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff71406a870 0x7ff7140b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff71406a870 0x7ff7140b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34490/0 (socket says 172.21.15.40:34490) 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 -- 172.21.15.40:0/3079848113 learned_addr learned my addr 172.21.15.40:0/3079848113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff719129640 1 --2- 172.21.15.40:0/3079848113 >> v2:172.21.15.91:3300/0 conn(0x7ff71415b090 0x7ff71415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 -- 172.21.15.40:0/3079848113 >> v2:172.21.15.91:3300/0 conn(0x7ff71415b090 msgr2=0x7ff71415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 --2- 172.21.15.40:0/3079848113 >> v2:172.21.15.91:3300/0 conn(0x7ff71415b090 0x7ff71415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 -- 172.21.15.40:0/3079848113 >> v1:172.21.15.91:6789/0 conn(0x7ff71415b470 legacy=0x7ff71406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.046+0000 7ff71992a640 1 -- 172.21.15.40:0/3079848113 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140cc400 con 0x7ff71406a870 2023-11-04T01:42:30.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71992a640 1 --2- 172.21.15.40:0/3079848113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71406a870 0x7ff7140b4160 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff714072760 tx=0x7ff71001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389448703bef3f5b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff70bfff640 1 -- 172.21.15.40:0/3079848113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100aa430 con 0x7ff71406a870 2023-11-04T01:42:30.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff70bfff640 1 -- 172.21.15.40:0/3079848113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7100aa590 con 0x7ff71406a870 2023-11-04T01:42:30.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff70bfff640 1 -- 172.21.15.40:0/3079848113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100aa920 con 0x7ff71406a870 2023-11-04T01:42:30.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- 172.21.15.40:0/3079848113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71406a870 msgr2=0x7ff7140b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 --2- 172.21.15.40:0/3079848113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71406a870 0x7ff7140b4160 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff714072760 tx=0x7ff71001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- 172.21.15.40:0/3079848113 shutdown_connections 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 --2- 172.21.15.40:0/3079848113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71406a870 0x7ff7140b4160 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 --2- 172.21.15.40:0/3079848113 >> v2:172.21.15.91:3300/0 conn(0x7ff71415b090 0x7ff71415f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- 172.21.15.40:0/3079848113 >> 172.21.15.40:0/3079848113 conn(0x7ff7140716a0 msgr2=0x7ff714071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- 172.21.15.40:0/3079848113 shutdown_connections 2023-11-04T01:42:30.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- 172.21.15.40:0/3079848113 wait complete. 2023-11-04T01:42:30.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 Processor -- start 2023-11-04T01:42:30.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- start start 2023-11-04T01:42:30.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff71406a870 0x7ff71409c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff71415b090 0x7ff714151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 0x7ff71415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140afc80 con 0x7ff71415b470 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71409c750 con 0x7ff71415b090 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71b38d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71409ab30 con 0x7ff71406a870 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71992a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 0x7ff71415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71992a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 0x7ff71415db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34498/0 (socket says 172.21.15.40:34498) 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.050+0000 7ff71992a640 1 -- 172.21.15.40:0/1530530537 learned_addr learned my addr 172.21.15.40:0/1530530537 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff718928640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff71415b090 0x7ff714151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71992a640 1 -- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff71406a870 msgr2=0x7ff71409c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71992a640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff71406a870 0x7ff71409c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71992a640 1 -- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff71415b090 msgr2=0x7ff714151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71992a640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff71415b090 0x7ff714151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71992a640 1 -- 172.21.15.40:0/1530530537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100094d0 con 0x7ff71415b470 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff718928640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff71415b090 0x7ff714151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71992a640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 0x7ff71415db00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff7100ac040 tx=0x7ff71001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100aa430 con 0x7ff71415b470 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7100b3800 con 0x7ff71415b470 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff714099f20 con 0x7ff71415b470 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7100b3b90 con 0x7ff71415b470 2023-11-04T01:42:30.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71409a4e0 con 0x7ff71415b470 2023-11-04T01:42:30.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7140675f0 con 0x7ff71415b470 2023-11-04T01:42:30.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7100b3cf0 con 0x7ff71415b470 2023-11-04T01:42:30.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff709ffb640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6f80664a0 0x7ff6f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6800+0+0 (secure 0 0 0) 0x7ff71011ea70 con 0x7ff71415b470 2023-11-04T01:42:30.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff719129640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6f80664a0 0x7ff6f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.054+0000 7ff719129640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6f80664a0 0x7ff6f8068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0070b0 tx=0x7ff70c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.058+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7100ebab0 con 0x7ff71415b470 2023-11-04T01:42:30.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.246+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff71409ac70 con 0x7ff71415b470 2023-11-04T01:42:30.253 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:42:30.246+0000 7fde30135640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:42:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.250+0000 7ff709ffb640 1 -- 172.21.15.40:0/1530530537 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff7100ef0d0 con 0x7ff71415b470 2023-11-04T01:42:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6f80664a0 msgr2=0x7ff6f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6f80664a0 0x7ff6f8068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0070b0 tx=0x7ff70c007040 comp rx=0 tx=0).stop 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 msgr2=0x7ff71415db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 0x7ff71415db00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff7100ac040 tx=0x7ff71001ad10 comp rx=0 tx=0).stop 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 shutdown_connections 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff6f80664a0 0x7ff6f8068960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff71415b470 0x7ff71415db00 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff71415b090 0x7ff714151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 --2- 172.21.15.40:0/1530530537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff71406a870 0x7ff71409c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 >> 172.21.15.40:0/1530530537 conn(0x7ff7140716a0 msgr2=0x7ff71406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 shutdown_connections 2023-11-04T01:42:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.254+0000 7ff71b38d640 1 -- 172.21.15.40:0/1530530537 wait complete. 2023-11-04T01:42:30.262 INFO:tasks.ceph.mds.a.smithi040.stderr: -904> 2023-11-04T01:42:10.922+0000 7efd2d190640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:30.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:42:30.294 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:42:30.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 Processor -- start 2023-11-04T01:42:30.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 -- start start 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2aa8070b40 0x7f2aa80b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa80b54d0 0x7f2aa80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa806cc10 con 0x7f2aa8144840 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa80b5960 con 0x7f2aa80b54d0 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aae078640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa8071d10 con 0x7f2aa8070b40 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa80b54d0 0x7f2aa80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa80b54d0 0x7f2aa80ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34526/0 (socket says 172.21.15.40:34526) 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 -- 172.21.15.40:0/3916983935 learned_addr learned my addr 172.21.15.40:0/3916983935 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa6ffd640 1 --2- 172.21.15.40:0/3916983935 >> v2:172.21.15.91:3300/0 conn(0x7f2aa8070b40 0x7f2aa80b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 -- 172.21.15.40:0/3916983935 >> v2:172.21.15.91:3300/0 conn(0x7f2aa8070b40 msgr2=0x7f2aa80b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 --2- 172.21.15.40:0/3916983935 >> v2:172.21.15.91:3300/0 conn(0x7f2aa8070b40 0x7f2aa80b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 -- 172.21.15.40:0/3916983935 >> v1:172.21.15.91:6789/0 conn(0x7f2aa8144840 legacy=0x7f2aa815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.386+0000 7f2aa7fff640 1 -- 172.21.15.40:0/3916983935 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8071100 con 0x7f2aa80b54d0 2023-11-04T01:42:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa7fff640 1 --2- 172.21.15.40:0/3916983935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa80b54d0 0x7f2aa80ce680 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80704d0 tx=0x7f2aa001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bbdf6aeda56c85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa67fc640 1 -- 172.21.15.40:0/3916983935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00a56a0 con 0x7f2aa80b54d0 2023-11-04T01:42:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa67fc640 1 -- 172.21.15.40:0/3916983935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa00a5800 con 0x7f2aa80b54d0 2023-11-04T01:42:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa67fc640 1 -- 172.21.15.40:0/3916983935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00a5b90 con 0x7f2aa80b54d0 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- 172.21.15.40:0/3916983935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa80b54d0 msgr2=0x7f2aa80ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 --2- 172.21.15.40:0/3916983935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa80b54d0 0x7f2aa80ce680 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80704d0 tx=0x7f2aa001c8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- 172.21.15.40:0/3916983935 shutdown_connections 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 --2- 172.21.15.40:0/3916983935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa80b54d0 0x7f2aa80ce680 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 --2- 172.21.15.40:0/3916983935 >> v2:172.21.15.91:3300/0 conn(0x7f2aa8070b40 0x7f2aa80b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- 172.21.15.40:0/3916983935 >> 172.21.15.40:0/3916983935 conn(0x7f2aa80cfc70 msgr2=0x7f2aa80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- 172.21.15.40:0/3916983935 shutdown_connections 2023-11-04T01:42:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- 172.21.15.40:0/3916983935 wait complete. 2023-11-04T01:42:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 Processor -- start 2023-11-04T01:42:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- start start 2023-11-04T01:42:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa8070b40 0x7f2aa80afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa80b54d0 0x7f2aa8142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 0x7f2aa81374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8142d40 con 0x7f2aa8144840 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8143b60 con 0x7f2aa80b54d0 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aae078640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8143ff0 con 0x7f2aa8070b40 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 0x7f2aa81374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 0x7f2aa81374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34528/0 (socket says 172.21.15.40:34528) 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.390+0000 7f2aa7fff640 1 -- 172.21.15.40:0/4137740458 learned_addr learned my addr 172.21.15.40:0/4137740458 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa6ffd640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa80b54d0 0x7f2aa8142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa77fe640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa8070b40 0x7f2aa80afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa7fff640 1 -- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa8070b40 msgr2=0x7f2aa80afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa7fff640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa8070b40 0x7f2aa80afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa7fff640 1 -- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa80b54d0 msgr2=0x7f2aa8142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa7fff640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa80b54d0 0x7f2aa8142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa7fff640 1 -- 172.21.15.40:0/4137740458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009b30 con 0x7f2aa8144840 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa77fe640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa8070b40 0x7f2aa80afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa7fff640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 0x7f2aa81374b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2aa001a500 tx=0x7f2aa0019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00b8670 con 0x7f2aa8144840 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa00b87d0 con 0x7f2aa8144840 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00b8b60 con 0x7f2aa8144840 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa8142f50 con 0x7f2aa8144840 2023-11-04T01:42:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa8143510 con 0x7f2aa8144840 2023-11-04T01:42:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa8143cd0 con 0x7f2aa8144840 2023-11-04T01:42:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2aa00b8cc0 con 0x7f2aa8144840 2023-11-04T01:42:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2a8ffff640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a940664d0 0x7f2a94068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f2aa011f360 con 0x7f2aa8144840 2023-11-04T01:42:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.394+0000 7f2aa77fe640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a940664d0 0x7f2a94068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.398+0000 7f2aa77fe640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a940664d0 0x7f2a94068990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800a850 tx=0x7f2a98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.398+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2aa00ec480 con 0x7f2aa8144840 2023-11-04T01:42:30.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:30.594+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2aa8143cd0 con 0x7f2aa8144840 2023-11-04T01:42:31.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.254+0000 7f2a8ffff640 1 -- 172.21.15.40:0/4137740458 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2aa00efaa0 con 0x7f2aa8144840 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a940664d0 msgr2=0x7f2a94068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a940664d0 0x7f2a94068990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800a850 tx=0x7f2a98008040 comp rx=0 tx=0).stop 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 msgr2=0x7f2aa81374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 0x7f2aa81374b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2aa001a500 tx=0x7f2aa0019670 comp rx=0 tx=0).stop 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 shutdown_connections 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a940664d0 0x7f2a94068990 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa8144840 0x7f2aa81374b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa80b54d0 0x7f2aa8142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 --2- 172.21.15.40:0/4137740458 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa8070b40 0x7f2aa80afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 >> 172.21.15.40:0/4137740458 conn(0x7f2aa80cfc70 msgr2=0x7f2aa80b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 shutdown_connections 2023-11-04T01:42:31.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.258+0000 7f2aae078640 1 -- 172.21.15.40:0/4137740458 wait complete. 2023-11-04T01:42:31.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:42:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 Processor -- start 2023-11-04T01:42:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 -- start start 2023-11-04T01:42:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd8d415ae60 0x7fd8d40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8d406b320 0x7fd8d406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d415f8a0 con 0x7fd8d40ca440 2023-11-04T01:42:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d415ea00 con 0x7fd8d406b320 2023-11-04T01:42:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d974d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d415b240 con 0x7fd8d415ae60 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8d406b320 0x7fd8d406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d27fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd8d40ca440 0x7fd8d415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60378/0 (socket says 172.21.15.40:60378) 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8d406b320 0x7fd8d406b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34540/0 (socket says 172.21.15.40:34540) 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d27fc640 1 -- 172.21.15.40:0/2830866229 learned_addr learned my addr 172.21.15.40:0/2830866229 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d2ffd640 1 --2- 172.21.15.40:0/2830866229 >> v2:172.21.15.91:3300/0 conn(0x7fd8d415ae60 0x7fd8d40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d37fe640 1 -- 172.21.15.40:0/2830866229 >> v2:172.21.15.91:3300/0 conn(0x7fd8d415ae60 msgr2=0x7fd8d40cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d37fe640 1 --2- 172.21.15.40:0/2830866229 >> v2:172.21.15.91:3300/0 conn(0x7fd8d415ae60 0x7fd8d40cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d37fe640 1 -- 172.21.15.40:0/2830866229 >> v1:172.21.15.40:6789/0 conn(0x7fd8d40ca440 legacy=0x7fd8d415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d1ffb640 1 -- 172.21.15.40:0/2830866229 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982901388 0 0) 0x7fd8d415f8a0 con 0x7fd8d40ca440 2023-11-04T01:42:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.454+0000 7fd8d37fe640 1 -- 172.21.15.40:0/2830866229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d406cda0 con 0x7fd8d406b320 2023-11-04T01:42:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d37fe640 1 --2- 172.21.15.40:0/2830866229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d406b320 0x7fd8d406b7b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd8d406b1f0 tx=0x7fd8cc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a57944eee37b5b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d1ffb640 1 -- 172.21.15.40:0/2830866229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0a59a0 con 0x7fd8d406b320 2023-11-04T01:42:31.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d1ffb640 1 -- 172.21.15.40:0/2830866229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc0a5b00 con 0x7fd8d406b320 2023-11-04T01:42:31.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d1ffb640 1 -- 172.21.15.40:0/2830866229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0a5e90 con 0x7fd8d406b320 2023-11-04T01:42:31.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 -- 172.21.15.40:0/2830866229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d406b320 msgr2=0x7fd8d406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 --2- 172.21.15.40:0/2830866229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d406b320 0x7fd8d406b7b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd8d406b1f0 tx=0x7fd8cc01c8e0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 -- 172.21.15.40:0/2830866229 shutdown_connections 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 --2- 172.21.15.40:0/2830866229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d406b320 0x7fd8d406b7b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 --2- 172.21.15.40:0/2830866229 >> v2:172.21.15.91:3300/0 conn(0x7fd8d415ae60 0x7fd8d40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 -- 172.21.15.40:0/2830866229 >> 172.21.15.40:0/2830866229 conn(0x7fd8d40b0630 msgr2=0x7fd8d40b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 -- 172.21.15.40:0/2830866229 shutdown_connections 2023-11-04T01:42:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 -- 172.21.15.40:0/2830866229 wait complete. 2023-11-04T01:42:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 Processor -- start 2023-11-04T01:42:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.458+0000 7fd8d974d640 1 -- start start 2023-11-04T01:42:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8d406b320 0x7fd8d40c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8d40ca440 0x7fd8d415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 0x7fd8d414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d415c980 con 0x7fd8d415ae60 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d415c6a0 con 0x7fd8d40ca440 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d414fa80 con 0x7fd8d406b320 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 0x7fd8d414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 0x7fd8d414f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34542/0 (socket says 172.21.15.40:34542) 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 -- 172.21.15.40:0/3742903305 learned_addr learned my addr 172.21.15.40:0/3742903305 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d27fc640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8d40ca440 0x7fd8d415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d2ffd640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8d406b320 0x7fd8d40c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 -- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8d406b320 msgr2=0x7fd8d40c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8d406b320 0x7fd8d40c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 -- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8d40ca440 msgr2=0x7fd8d415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8d40ca440 0x7fd8d415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 -- 172.21.15.40:0/3742903305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc009a70 con 0x7fd8d415ae60 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d2ffd640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8d406b320 0x7fd8d40c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d37fe640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 0x7fd8d414f050 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0b0040 tx=0x7fd8cc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0ade20 con 0x7fd8d415ae60 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc009450 con 0x7fd8d415ae60 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d414fd60 con 0x7fd8d415ae60 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0b9690 con 0x7fd8d415ae60 2023-11-04T01:42:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d415c390 con 0x7fd8d415ae60 2023-11-04T01:42:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d4150280 con 0x7fd8d415ae60 2023-11-04T01:42:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8cc0b97f0 con 0x7fd8d415ae60 2023-11-04T01:42:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8bb7fe640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8c00664a0 0x7fd8c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6858+0+0 (secure 0 0 0) 0x7fd8cc11fac0 con 0x7fd8d415ae60 2023-11-04T01:42:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.462+0000 7fd8d2ffd640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8c00664a0 0x7fd8c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.466+0000 7fd8d2ffd640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8c00664a0 0x7fd8c0068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd8d41f6810 tx=0x7fd8c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:31.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.466+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8d4150280 con 0x7fd8d415ae60 2023-11-04T01:42:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:31.626+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8d4150280 con 0x7fd8d415ae60 2023-11-04T01:42:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.262+0000 7fd8bb7fe640 1 -- 172.21.15.40:0/3742903305 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd8d4150280 con 0x7fd8d415ae60 2023-11-04T01:42:32.269 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:42:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8c00664a0 msgr2=0x7fd8c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8c00664a0 0x7fd8c0068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd8d41f6810 tx=0x7fd8c8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 msgr2=0x7fd8d414f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 0x7fd8d414f050 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0b0040 tx=0x7fd8cc019680 comp rx=0 tx=0).stop 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 shutdown_connections 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8c00664a0 0x7fd8c0068960 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d415ae60 0x7fd8d414f050 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8d40ca440 0x7fd8d415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 --2- 172.21.15.40:0/3742903305 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8d406b320 0x7fd8d40c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 >> 172.21.15.40:0/3742903305 conn(0x7fd8d40b0630 msgr2=0x7fd8d40b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 shutdown_connections 2023-11-04T01:42:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.266+0000 7fd8d974d640 1 -- 172.21.15.40:0/3742903305 wait complete. 2023-11-04T01:42:32.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:42:32.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 Processor -- start 2023-11-04T01:42:32.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 -- start start 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f796015ae60 0x7f79600cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79600ca440 0x7f796015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796015ea00 con 0x7f796006b320 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796015b240 con 0x7f796015ae60 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7966694640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796006cda0 con 0x7f79600ca440 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f795ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f796015ae60 0x7f79600cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7964c31640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f796006b320 0x7f796006b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60388/0 (socket says 172.21.15.40:60388) 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.426+0000 7f7964c31640 1 -- 172.21.15.40:0/2831159595 learned_addr learned my addr 172.21.15.40:0/2831159595 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795ffff640 1 -- 172.21.15.40:0/2831159595 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79600ca440 msgr2=0x7f796015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795f7fe640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79600ca440 0x7f796015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795effd640 1 -- 172.21.15.40:0/2831159595 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060126676 0 0) 0x7f796015ea00 con 0x7f796006b320 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795ffff640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79600ca440 0x7f796015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795ffff640 1 -- 172.21.15.40:0/2831159595 >> v1:172.21.15.40:6789/0 conn(0x7f796006b320 legacy=0x7f796006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795ffff640 1 -- 172.21.15.40:0/2831159595 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796006d080 con 0x7f796015ae60 2023-11-04T01:42:32.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795f7fe640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79600ca440 0x7f796015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:32.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795ffff640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796015ae60 0x7f79600cab10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f79500097c0 tx=0x7f795001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37766bcba1650783 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795effd640 1 -- 172.21.15.40:0/2831159595 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500ab670 con 0x7f796015ae60 2023-11-04T01:42:32.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795effd640 1 -- 172.21.15.40:0/2831159595 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79500ab7d0 con 0x7f796015ae60 2023-11-04T01:42:32.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f795effd640 1 -- 172.21.15.40:0/2831159595 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500abb60 con 0x7f796015ae60 2023-11-04T01:42:32.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 -- 172.21.15.40:0/2831159595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796015ae60 msgr2=0x7f79600cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796015ae60 0x7f79600cab10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f79500097c0 tx=0x7f795001c450 comp rx=0 tx=0).stop 2023-11-04T01:42:32.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 -- 172.21.15.40:0/2831159595 shutdown_connections 2023-11-04T01:42:32.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79600ca440 0x7f796015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 --2- 172.21.15.40:0/2831159595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f796015ae60 0x7f79600cab10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 -- 172.21.15.40:0/2831159595 >> 172.21.15.40:0/2831159595 conn(0x7f79600b0630 msgr2=0x7f79600b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 -- 172.21.15.40:0/2831159595 shutdown_connections 2023-11-04T01:42:32.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.430+0000 7f7966694640 1 -- 172.21.15.40:0/2831159595 wait complete. 2023-11-04T01:42:32.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 Processor -- start 2023-11-04T01:42:32.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- start start 2023-11-04T01:42:32.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796006b320 0x7f7960163e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 0x7f7960164370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f796015ae60 0x7f79600c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600cc6a0 con 0x7f79600ca440 2023-11-04T01:42:32.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601649a0 con 0x7f796006b320 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7960164c80 con 0x7f796015ae60 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 0x7f7960164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 0x7f7960164370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34554/0 (socket says 172.21.15.40:34554) 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 -- 172.21.15.40:0/4076505754 learned_addr learned my addr 172.21.15.40:0/4076505754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795ffff640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796006b320 0x7f7960163e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7964c31640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f796015ae60 0x7f79600c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 -- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f796015ae60 msgr2=0x7f79600c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f796015ae60 0x7f79600c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 -- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796006b320 msgr2=0x7f7960163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796006b320 0x7f7960163e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 -- 172.21.15.40:0/4076505754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009420 con 0x7f79600ca440 2023-11-04T01:42:32.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795f7fe640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 0x7f7960164370 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f795400c7c0 tx=0x7f795400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954007a30 con 0x7f79600ca440 2023-11-04T01:42:32.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954007b90 con 0x7f79600ca440 2023-11-04T01:42:32.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7960164f60 con 0x7f79600ca440 2023-11-04T01:42:32.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400ce70 con 0x7f79600ca440 2023-11-04T01:42:32.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79600c7480 con 0x7f79600ca440 2023-11-04T01:42:32.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.434+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79600744a0 con 0x7f79600ca440 2023-11-04T01:42:32.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.438+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79540193f0 con 0x7f79600ca440 2023-11-04T01:42:32.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.438+0000 7f795cff9640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f794c0664a0 0x7f794c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.438+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f79540846a0 con 0x7f79600ca440 2023-11-04T01:42:32.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.438+0000 7f795ffff640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f794c0664a0 0x7f794c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.438+0000 7f795ffff640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f794c0664a0 0x7f794c068960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f79500af000 tx=0x7f79500a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.442+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79540517b0 con 0x7f79600ca440 2023-11-04T01:42:32.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:32.602+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f796006c8b0 con 0x7f79600ca440 2023-11-04T01:42:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.266+0000 7f795cff9640 1 -- 172.21.15.40:0/4076505754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7954054dd0 con 0x7f79600ca440 2023-11-04T01:42:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-11-04T01:42:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f794c0664a0 msgr2=0x7f794c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f794c0664a0 0x7f794c068960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f79500af000 tx=0x7f79500a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 msgr2=0x7f7960164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 0x7f7960164370 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f795400c7c0 tx=0x7f795400cc80 comp rx=0 tx=0).stop 2023-11-04T01:42:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 shutdown_connections 2023-11-04T01:42:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f794c0664a0 0x7f794c068960 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f796015ae60 0x7f79600c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79600ca440 0x7f7960164370 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 --2- 172.21.15.40:0/4076505754 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f796006b320 0x7f7960163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 >> 172.21.15.40:0/4076505754 conn(0x7f79600b0630 msgr2=0x7f79600b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 shutdown_connections 2023-11-04T01:42:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.270+0000 7f7966694640 1 -- 172.21.15.40:0/4076505754 wait complete. 2023-11-04T01:42:33.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:42:33.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.418+0000 7fbacee0f640 1 Processor -- start 2023-11-04T01:42:33.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.418+0000 7fbacee0f640 1 -- start start 2023-11-04T01:42:33.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacee0f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbac815e170 0x7fbac80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacee0f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80c9c00 con 0x7fbac80cdaa0 2023-11-04T01:42:33.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacee0f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80ce420 con 0x7fbac815af90 2023-11-04T01:42:33.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacee0f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac815a890 con 0x7fbac815e170 2023-11-04T01:42:33.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbac7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbac80cdaa0 0x7fbac815da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60394/0 (socket says 172.21.15.40:60394) 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbac7fff640 1 -- 172.21.15.40:0/1422014061 learned_addr learned my addr 172.21.15.40:0/1422014061 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacd3ac640 1 --2- 172.21.15.40:0/1422014061 >> v2:172.21.15.91:3300/0 conn(0x7fbac815e170 0x7fbac80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbac77fe640 1 -- 172.21.15.40:0/1422014061 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98252595 0 0) 0x7fbac80c9c00 con 0x7fbac80cdaa0 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbac77fe640 1 -- 172.21.15.40:0/1422014061 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab0003530 con 0x7fbac80cdaa0 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbac77fe640 1 -- 172.21.15.40:0/1422014061 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542157171 0 0) 0x7fbab0003530 con 0x7fbac80cdaa0 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacd3ac640 1 -- 172.21.15.40:0/1422014061 >> v1:172.21.15.91:6789/0 conn(0x7fbac815af90 legacy=0x7fbac80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacd3ac640 1 -- 172.21.15.40:0/1422014061 >> v1:172.21.15.40:6789/0 conn(0x7fbac80cdaa0 legacy=0x7fbac815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.422+0000 7fbacd3ac640 1 -- 172.21.15.40:0/1422014061 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac815e640 con 0x7fbac815e170 2023-11-04T01:42:33.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacd3ac640 1 --2- 172.21.15.40:0/1422014061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815e170 0x7fbac80cdee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009d90 tx=0x7fbac001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15fe663409d67f3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbac77fe640 1 -- 172.21.15.40:0/1422014061 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc001680 con 0x7fbac815e170 2023-11-04T01:42:33.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbac77fe640 1 -- 172.21.15.40:0/1422014061 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac00a5680 con 0x7fbac815e170 2023-11-04T01:42:33.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbac77fe640 1 -- 172.21.15.40:0/1422014061 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00a59f0 con 0x7fbac815e170 2023-11-04T01:42:33.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- 172.21.15.40:0/1422014061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815e170 msgr2=0x7fbac80cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 --2- 172.21.15.40:0/1422014061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815e170 0x7fbac80cdee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009d90 tx=0x7fbac001c840 comp rx=0 tx=0).stop 2023-11-04T01:42:33.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- 172.21.15.40:0/1422014061 shutdown_connections 2023-11-04T01:42:33.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 --2- 172.21.15.40:0/1422014061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815e170 0x7fbac80cdee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- 172.21.15.40:0/1422014061 >> 172.21.15.40:0/1422014061 conn(0x7fbac80cb510 msgr2=0x7fbac80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- 172.21.15.40:0/1422014061 shutdown_connections 2023-11-04T01:42:33.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- 172.21.15.40:0/1422014061 wait complete. 2023-11-04T01:42:33.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 Processor -- start 2023-11-04T01:42:33.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- start start 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 0x7fbac814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815af90 0x7fbac80c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac815e170 0x7fbac80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c76e0 con 0x7fbac80cdaa0 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac814e450 con 0x7fbac815af90 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacee0f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c6820 con 0x7fbac815e170 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 0x7fbac814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 0x7fbac814df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34560/0 (socket says 172.21.15.40:34560) 2023-11-04T01:42:33.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 -- 172.21.15.40:0/2468098931 learned_addr learned my addr 172.21.15.40:0/2468098931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbac7fff640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815af90 0x7fbac80c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbacd3ac640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac815e170 0x7fbac80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 -- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac815e170 msgr2=0x7fbac80c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac815e170 0x7fbac80c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 -- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815af90 msgr2=0x7fbac80c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815af90 0x7fbac80c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 -- 172.21.15.40:0/2468098931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0009a70 con 0x7fbac80cdaa0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.426+0000 7fbaccbab640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 0x7fbac814df10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c500 tx=0x7fbab800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8005220 con 0x7fbac80cdaa0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8005380 con 0x7fbac80cdaa0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80c6b00 con 0x7fbac80cdaa0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8007270 con 0x7fbac80cdaa0 2023-11-04T01:42:33.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80c7300 con 0x7fbac80cdaa0 2023-11-04T01:42:33.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac80c7820 con 0x7fbac80cdaa0 2023-11-04T01:42:33.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbab80073d0 con 0x7fbac80cdaa0 2023-11-04T01:42:33.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac57fa640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbab40664a0 0x7fbab4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fbab8083890 con 0x7fbac80cdaa0 2023-11-04T01:42:33.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac7fff640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbab40664a0 0x7fbab4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.430+0000 7fbac7fff640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbab40664a0 0x7fbab4068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbabc001ba0 tx=0x7fbabc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.434+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbac80c7820 con 0x7fbac80cdaa0 2023-11-04T01:42:33.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.598+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbac80744a0 con 0x7fbac80cdaa0 2023-11-04T01:42:33.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbac57fa640 1 -- 172.21.15.40:0/2468098931 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbab8050bf0 con 0x7fbac80cdaa0 2023-11-04T01:42:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbab40664a0 msgr2=0x7fbab4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbab40664a0 0x7fbab4068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbabc001ba0 tx=0x7fbabc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 msgr2=0x7fbac814df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 0x7fbac814df10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbab800c500 tx=0x7fbab800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 shutdown_connections 2023-11-04T01:42:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbab40664a0 0x7fbab4068960 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbac815e170 0x7fbac80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbac815af90 0x7fbac80c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 --2- 172.21.15.40:0/2468098931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbac80cdaa0 0x7fbac814df10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 >> 172.21.15.40:0/2468098931 conn(0x7fbac80cb510 msgr2=0x7fbac8071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 shutdown_connections 2023-11-04T01:42:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.606+0000 7fbacee0f640 1 -- 172.21.15.40:0/2468098931 wait complete. 2023-11-04T01:42:33.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:42:33.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f6b75640 1 Processor -- start 2023-11-04T01:42:33.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f6b75640 1 -- start start 2023-11-04T01:42:33.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f6b75640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00b0d40 0x7fa5f0166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f6b75640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00c2670 con 0x7fa5f015afd0 2023-11-04T01:42:33.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f6b75640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f006bc30 con 0x7fa5f00715d0 2023-11-04T01:42:33.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f6b75640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0070140 con 0x7fa5f00b0d40 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f4911640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa5f015afd0 0x7fa5f006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60406/0 (socket says 172.21.15.40:60406) 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f4911640 1 -- 172.21.15.40:0/3342315277 learned_addr learned my addr 172.21.15.40:0/3342315277 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f5112640 1 --2- 172.21.15.40:0/3342315277 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00b0d40 0x7fa5f0166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5ef7fe640 1 -- 172.21.15.40:0/3342315277 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289703654 0 0) 0x7fa5f00c2670 con 0x7fa5f015afd0 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5ef7fe640 1 -- 172.21.15.40:0/3342315277 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d8003530 con 0x7fa5f015afd0 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5ef7fe640 1 -- 172.21.15.40:0/3342315277 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3214076099 0 0) 0x7fa5d8003530 con 0x7fa5f015afd0 2023-11-04T01:42:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f5112640 1 -- 172.21.15.40:0/3342315277 >> v1:172.21.15.91:6789/0 conn(0x7fa5f00715d0 legacy=0x7fa5f00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f5112640 1 -- 172.21.15.40:0/3342315277 >> v1:172.21.15.40:6789/0 conn(0x7fa5f015afd0 legacy=0x7fa5f006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.750+0000 7fa5f5112640 1 -- 172.21.15.40:0/3342315277 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f006bf10 con 0x7fa5f00b0d40 2023-11-04T01:42:33.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f5112640 1 --2- 172.21.15.40:0/3342315277 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00b0d40 0x7fa5f0166010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097f0 tx=0x7fa5e801c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284bb0b2614d17bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5ef7fe640 1 -- 172.21.15.40:0/3342315277 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0001a00 con 0x7fa5f00b0d40 2023-11-04T01:42:33.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5ef7fe640 1 -- 172.21.15.40:0/3342315277 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e80a7050 con 0x7fa5f00b0d40 2023-11-04T01:42:33.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5ef7fe640 1 -- 172.21.15.40:0/3342315277 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80ab600 con 0x7fa5f00b0d40 2023-11-04T01:42:33.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- 172.21.15.40:0/3342315277 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00b0d40 msgr2=0x7fa5f0166010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/3342315277 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00b0d40 0x7fa5f0166010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097f0 tx=0x7fa5e801c290 comp rx=0 tx=0).stop 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- 172.21.15.40:0/3342315277 shutdown_connections 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/3342315277 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00b0d40 0x7fa5f0166010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- 172.21.15.40:0/3342315277 >> 172.21.15.40:0/3342315277 conn(0x7fa5f00cebb0 msgr2=0x7fa5f00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- 172.21.15.40:0/3342315277 shutdown_connections 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- 172.21.15.40:0/3342315277 wait complete. 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 Processor -- start 2023-11-04T01:42:33.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- start start 2023-11-04T01:42:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00715d0 0x7fa5f01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5f00b0d40 0x7fa5f00ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 0x7fa5f00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f015fc90 con 0x7fa5f015afd0 2023-11-04T01:42:33.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0164bf0 con 0x7fa5f00b0d40 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f6b75640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01522a0 con 0x7fa5f00715d0 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f5112640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 0x7fa5f00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f5112640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 0x7fa5f00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34570/0 (socket says 172.21.15.40:34570) 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5f5112640 1 -- 172.21.15.40:0/192151309 learned_addr learned my addr 172.21.15.40:0/192151309 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.754+0000 7fa5effff640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5f00b0d40 0x7fa5f00ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f4911640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00715d0 0x7fa5f01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f5112640 1 -- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00715d0 msgr2=0x7fa5f01517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f5112640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00715d0 0x7fa5f01517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f5112640 1 -- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5f00b0d40 msgr2=0x7fa5f00ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f5112640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5f00b0d40 0x7fa5f00ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f5112640 1 -- 172.21.15.40:0/192151309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009420 con 0x7fa5f015afd0 2023-11-04T01:42:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f4911640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00715d0 0x7fa5f01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f5112640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 0x7fa5f00cd500 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097f0 tx=0x7fa5e8019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8003a30 con 0x7fa5f015afd0 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8003b90 con 0x7fa5f015afd0 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00b3160 con 0x7fa5f015afd0 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80b5410 con 0x7fa5f015afd0 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f0165120 con 0x7fa5f015afd0 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00744a0 con 0x7fa5f015afd0 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5e80b2050 con 0x7fa5f015afd0 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5ed7fa640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa5dc0664d0 0x7fa5dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fa5e811e090 con 0x7fa5f015afd0 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f4911640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa5dc0664d0 0x7fa5dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.758+0000 7fa5f4911640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa5dc0664d0 0x7fa5dc068990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ce8d0 tx=0x7fa5e0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.762+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5e80eb3e0 con 0x7fa5f015afd0 2023-11-04T01:42:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:33.974+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7fa5f00c55c0 con 0x7fa5f015afd0 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.270+0000 7fa5ed7fa640 1 -- 172.21.15.40:0/192151309 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v166) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa5e80eea00 con 0x7fa5f015afd0 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa5dc0664d0 msgr2=0x7fa5dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa5dc0664d0 0x7fa5dc068990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ce8d0 tx=0x7fa5e0007ec0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 msgr2=0x7fa5f00cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 0x7fa5f00cd500 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097f0 tx=0x7fa5e8019030 comp rx=0 tx=0).stop 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 shutdown_connections 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa5dc0664d0 0x7fa5dc068990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f015afd0 0x7fa5f00cd500 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5f00b0d40 0x7fa5f00ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 --2- 172.21.15.40:0/192151309 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa5f00715d0 0x7fa5f01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 >> 172.21.15.40:0/192151309 conn(0x7fa5f00cebb0 msgr2=0x7fa5f00cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 shutdown_connections 2023-11-04T01:42:34.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.274+0000 7fa5f6b75640 1 -- 172.21.15.40:0/192151309 wait complete. 2023-11-04T01:42:34.302 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-04T01:42:34.302 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-04T01:42:34.302 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:42:34.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.422+0000 7fb000cec640 1 Processor -- start 2023-11-04T01:42:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.422+0000 7fb000cec640 1 -- start start 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7fb000cec640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faffc0b0d40 0x7faffc166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7fb000cec640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc0c2670 con 0x7faffc0715d0 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7fb000cec640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc06bc30 con 0x7faffc15afd0 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7fb000cec640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc070140 con 0x7faffc0b0d40 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff9d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faffc0715d0 0x7faffc0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60410/0 (socket says 172.21.15.40:60410) 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff9d9b640 1 -- 172.21.15.40:0/2173817954 learned_addr learned my addr 172.21.15.40:0/2173817954 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 --2- 172.21.15.40:0/2173817954 >> v2:172.21.15.91:3300/0 conn(0x7faffc0b0d40 0x7faffc166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497601234 0 0) 0x7faffc0c2670 con 0x7faffc0715d0 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe4003530 con 0x7faffc0715d0 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795186599 0 0) 0x7fafe4003530 con 0x7faffc0715d0 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 >> v2:172.21.15.91:3300/0 conn(0x7faffc0b0d40 msgr2=0x7faffc166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 --2- 172.21.15.40:0/2173817954 >> v2:172.21.15.91:3300/0 conn(0x7faffc0b0d40 0x7faffc166010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 >> v1:172.21.15.91:6789/0 conn(0x7faffc15afd0 legacy=0x7faffc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc06bf10 con 0x7faffc0715d0 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7faff0001a00 con 0x7faffc0715d0 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 >> v1:172.21.15.40:6789/0 conn(0x7faffc0715d0 legacy=0x7faffc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafe4003980 0x7fafe4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe40047d0 0x7fafe4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe4005190 0x7fafe400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc070140 con 0x7fafe4005190 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe400c030 con 0x7fafe4003980 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe400c1f0 con 0x7fafe40047d0 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe4005190 0x7fafe400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faff9d9b640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe40047d0 0x7fafe4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffa59c640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafe4003980 0x7fafe4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 -- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe40047d0 msgr2=0x7fafe4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe40047d0 0x7fafe4004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 -- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafe4003980 msgr2=0x7fafe4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafe4003980 0x7fafe4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffad9d640 1 -- 172.21.15.40:0/2173817954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe4003530 con 0x7fafe4005190 2023-11-04T01:42:34.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.426+0000 7faffa59c640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafe4003980 0x7fafe4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 -- 172.21.15.40:0/2173817954 reap_dead start 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe4005190 0x7fafe400b990 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7faffc0c8d60 tx=0x7faff401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adedbef5ef73d4b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a5620 con 0x7fafe4005190 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40a5780 con 0x7fafe4005190 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faff959a640 1 -- 172.21.15.40:0/2173817954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a5b10 con 0x7fafe4005190 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- 172.21.15.40:0/2173817954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe4005190 msgr2=0x7fafe400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe4005190 0x7fafe400b990 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7faffc0c8d60 tx=0x7faff401ca30 comp rx=0 tx=0).stop 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- 172.21.15.40:0/2173817954 shutdown_connections 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 --2- 172.21.15.40:0/2173817954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe4005190 0x7fafe400b990 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- 172.21.15.40:0/2173817954 >> 172.21.15.40:0/2173817954 conn(0x7faffc0cebb0 msgr2=0x7faffc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- 172.21.15.40:0/2173817954 shutdown_connections 2023-11-04T01:42:34.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- 172.21.15.40:0/2173817954 wait complete. 2023-11-04T01:42:34.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 Processor -- start 2023-11-04T01:42:34.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- start start 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe4005190 0x7faffc14b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faffc0b17d0 0x7faffc0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 0x7faffc157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc15fc90 con 0x7faffc1575e0 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc157fd0 con 0x7faffc0b17d0 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7fb000cec640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0b30e0 con 0x7fafe4005190 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 0x7faffc157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 0x7faffc157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34598/0 (socket says 172.21.15.40:34598) 2023-11-04T01:42:34.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 -- 172.21.15.40:0/411110161 learned_addr learned my addr 172.21.15.40:0/411110161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faff9d9b640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faffc0b17d0 0x7faffc0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffa59c640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe4005190 0x7faffc14b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 -- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe4005190 msgr2=0x7faffc14b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe4005190 0x7faffc14b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 -- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faffc0b17d0 msgr2=0x7faffc0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faffc0b17d0 0x7faffc0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 -- 172.21.15.40:0/411110161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc1f09f0 con 0x7faffc1575e0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.430+0000 7faffad9d640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 0x7faffc157a90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faff401c860 tx=0x7fafe4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a5620 con 0x7faffc1575e0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40ad640 con 0x7faffc1575e0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc14fa90 con 0x7faffc1575e0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40ad9b0 con 0x7faffc1575e0 2023-11-04T01:42:34.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0b2270 con 0x7faffc1575e0 2023-11-04T01:42:34.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc0744a0 con 0x7faffc1575e0 2023-11-04T01:42:34.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faff40adb10 con 0x7faffc1575e0 2023-11-04T01:42:34.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fafeaffd640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafdc0664d0 0x7fafdc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7faff411da10 con 0x7faffc1575e0 2023-11-04T01:42:34.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7faffa59c640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafdc0664d0 0x7fafdc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.434+0000 7faffa59c640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafdc0664d0 0x7fafdc068990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fafec007fd0 tx=0x7fafec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.438+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faff40eaea0 con 0x7faffc1575e0 2023-11-04T01:42:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.594+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faffc0b3220 con 0x7faffc1575e0 2023-11-04T01:42:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fafeaffd640 1 -- 172.21.15.40:0/411110161 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18171 (secure 0 0 0) 0x7faff40be070 con 0x7faffc1575e0 2023-11-04T01:42:34.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:34.603 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":70,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:33.267662+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6835/3229855719":"2023-11-05T01:42:30.252039+0000","172.21.15.40:6834/3229855719":"2023-11-05T01:42:30.252039+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafdc0664d0 msgr2=0x7fafdc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafdc0664d0 0x7fafdc068990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fafec007fd0 tx=0x7fafec009040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 msgr2=0x7faffc157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 0x7faffc157a90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7faff401c860 tx=0x7fafe4005800 comp rx=0 tx=0).stop 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 shutdown_connections 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafdc0664d0 0x7fafdc068990 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faffc1575e0 0x7faffc157a90 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faffc0b17d0 0x7faffc0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 --2- 172.21.15.40:0/411110161 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafe4005190 0x7faffc14b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 >> 172.21.15.40:0/411110161 conn(0x7faffc0cebb0 msgr2=0x7faffc1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 shutdown_connections 2023-11-04T01:42:34.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.598+0000 7fb000cec640 1 -- 172.21.15.40:0/411110161 wait complete. 2023-11-04T01:42:34.623 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:34.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:34.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f501656b640 1 Processor -- start 2023-11-04T01:42:34.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f501656b640 1 -- start start 2023-11-04T01:42:34.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f501656b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f501006a870 0x7f50100cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f501656b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50100cd6f0 con 0x7f50100718e0 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f501656b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50100ce570 con 0x7f501015afd0 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f501656b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50100cda40 con 0x7f501006a870 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f50100718e0 0x7f501006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60420/0 (socket says 172.21.15.40:60420) 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500f7fe640 1 -- 172.21.15.40:0/2450546336 learned_addr learned my addr 172.21.15.40:0/2450546336 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 --2- 172.21.15.40:0/2450546336 >> v2:172.21.15.91:3300/0 conn(0x7f501006a870 0x7f50100cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235581326 0 0) 0x7f50100cd6f0 con 0x7f50100718e0 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ffc003530 con 0x7f50100718e0 2023-11-04T01:42:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918129466 0 0) 0x7f4ffc003530 con 0x7f50100718e0 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 >> v2:172.21.15.91:3300/0 conn(0x7f501006a870 msgr2=0x7f50100cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 --2- 172.21.15.40:0/2450546336 >> v2:172.21.15.91:3300/0 conn(0x7f501006a870 0x7f50100cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 >> v1:172.21.15.91:6789/0 conn(0x7f501015afd0 legacy=0x7f50100cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100cf0a0 con 0x7f50100718e0 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f4ff8001680 con 0x7f50100718e0 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 >> v1:172.21.15.40:6789/0 conn(0x7f50100718e0 legacy=0x7f501006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ffc003980 0x7f4ffc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ffc0047d0 0x7f4ffc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f4ffc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50100cda40 con 0x7f4ffc0052b0 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00c180 con 0x7f4ffc0047d0 2023-11-04T01:42:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00c340 con 0x7f4ffc003980 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 --2- 172.21.15.40:0/2450546336 >> v2:172.21.15.91:3300/0 conn(0x7f501006a870 0x7f50100cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f4ffc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500f7fe640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ffc0047d0 0x7f4ffc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f500ffff640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ffc003980 0x7f4ffc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 -- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ffc003980 msgr2=0x7f4ffc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ffc003980 0x7f4ffc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 -- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ffc0047d0 msgr2=0x7f4ffc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ffc0047d0 0x7f4ffc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.742+0000 7f5014b08640 1 -- 172.21.15.40:0/2450546336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc003530 con 0x7f4ffc0052b0 2023-11-04T01:42:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f5014b08640 1 -- 172.21.15.40:0/2450546336 reap_dead start 2023-11-04T01:42:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f5014b08640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f4ffc00b990 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f500800e320 tx=0x7f500801cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e89c32752b20e15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50080a5dc0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500800f040 con 0x7f4ffc0052b0 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f500effd640 1 -- 172.21.15.40:0/2450546336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008003be0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 -- 172.21.15.40:0/2450546336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 msgr2=0x7f4ffc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f4ffc00b990 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f500800e320 tx=0x7f500801cdd0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 -- 172.21.15.40:0/2450546336 shutdown_connections 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 --2- 172.21.15.40:0/2450546336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f4ffc00b990 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 -- 172.21.15.40:0/2450546336 >> 172.21.15.40:0/2450546336 conn(0x7f50100cc5a0 msgr2=0x7f50100cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 -- 172.21.15.40:0/2450546336 shutdown_connections 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 -- 172.21.15.40:0/2450546336 wait complete. 2023-11-04T01:42:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 Processor -- start 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.746+0000 7f501656b640 1 -- start start 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f50100b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5010151540 0x7f5010159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f50101519c0 0x7f5010159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50101467f0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50101504a0 con 0x7f5010151540 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5010150780 con 0x7f50101519c0 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f50100b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f50100b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34610/0 (socket says 172.21.15.40:34610) 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 -- 172.21.15.40:0/978135012 learned_addr learned my addr 172.21.15.40:0/978135012 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500f7fe640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5010151540 0x7f5010159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f5014b08640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f50101519c0 0x7f5010159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 -- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f50101519c0 msgr2=0x7f5010159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f50101519c0 0x7f5010159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 -- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5010151540 msgr2=0x7f5010159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5010151540 0x7f5010159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 -- 172.21.15.40:0/978135012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010150a60 con 0x7f4ffc0052b0 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f5014b08640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f50101519c0 0x7f5010159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500ffff640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f50100b1fb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f500000e410 tx=0x7f500000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000052e0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000005440 con 0x7f4ffc0052b0 2023-11-04T01:42:34.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000003800 con 0x7f4ffc0052b0 2023-11-04T01:42:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5010150d40 con 0x7f4ffc0052b0 2023-11-04T01:42:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5010156e00 con 0x7f4ffc0052b0 2023-11-04T01:42:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50100ce9f0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5000003960 con 0x7f4ffc0052b0 2023-11-04T01:42:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500cff9640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4ff00664a0 0x7f4ff0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.750+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f50000836b0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.754+0000 7f500f7fe640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4ff00664a0 0x7f4ff0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.754+0000 7f500f7fe640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4ff00664a0 0x7f4ff0068960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5010152580 tx=0x7f4ff8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.758+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5000050ab0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50100710f0 con 0x7f4ffc0052b0 2023-11-04T01:42:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f500cff9640 1 -- 172.21.15.40:0/978135012 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5000019020 con 0x7f4ffc0052b0 2023-11-04T01:42:34.916 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:34.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4ff00664a0 msgr2=0x7f4ff0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4ff00664a0 0x7f4ff0068960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5010152580 tx=0x7f4ff8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 msgr2=0x7f50100b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f50100b1fb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f500000e410 tx=0x7f500000e8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 shutdown_connections 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4ff00664a0 0x7f4ff0068960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f50101519c0 0x7f5010159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5010151540 0x7f5010159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 --2- 172.21.15.40:0/978135012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc0052b0 0x7f50100b1fb0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 >> 172.21.15.40:0/978135012 conn(0x7f50100cc5a0 msgr2=0x7f50100ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.910+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 shutdown_connections 2023-11-04T01:42:34.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:34.914+0000 7f501656b640 1 -- 172.21.15.40:0/978135012 wait complete. 2023-11-04T01:42:34.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:35.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 Processor -- start 2023-11-04T01:42:35.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 -- start start 2023-11-04T01:42:35.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd47815d0b0 0x7fd478160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4780cff20 0x7fd4780d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4780b5e00 con 0x7fd4781610f0 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4780d1520 con 0x7fd4780cff20 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd47dfd3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815d490 con 0x7fd47815d0b0 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd477fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4780cff20 0x7fd4780d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd476ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd4781610f0 0x7fd4780cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60432/0 (socket says 172.21.15.40:60432) 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd476ffd640 1 -- 172.21.15.40:0/3735786507 learned_addr learned my addr 172.21.15.40:0/3735786507 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd4777fe640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd47815d0b0 0x7fd478160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd477fff640 1 -- 172.21.15.40:0/3735786507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd47815d0b0 msgr2=0x7fd478160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd477fff640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd47815d0b0 0x7fd478160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd477fff640 1 -- 172.21.15.40:0/3735786507 >> v1:172.21.15.40:6789/0 conn(0x7fd4781610f0 legacy=0x7fd4780cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd477fff640 1 -- 172.21.15.40:0/3735786507 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780b8930 con 0x7fd4780cff20 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd4767fc640 1 -- 172.21.15.40:0/3735786507 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673406710 0 0) 0x7fd4780b5e00 con 0x7fd4781610f0 2023-11-04T01:42:35.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.038+0000 7fd4777fe640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd47815d0b0 0x7fd478160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:35.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd477fff640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd4780d1940 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd470009d90 tx=0x7fd47001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44aa06c6da9ed5e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd4767fc640 1 -- 172.21.15.40:0/3735786507 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700a5920 con 0x7fd4780cff20 2023-11-04T01:42:35.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd4767fc640 1 -- 172.21.15.40:0/3735786507 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700a5a80 con 0x7fd4780cff20 2023-11-04T01:42:35.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd4767fc640 1 -- 172.21.15.40:0/3735786507 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700a5e10 con 0x7fd4780cff20 2023-11-04T01:42:35.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 -- 172.21.15.40:0/3735786507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 msgr2=0x7fd4780d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd4780d1940 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd470009d90 tx=0x7fd47001c950 comp rx=0 tx=0).stop 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 -- 172.21.15.40:0/3735786507 shutdown_connections 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd4780d1940 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/3735786507 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd47815d0b0 0x7fd478160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 -- 172.21.15.40:0/3735786507 >> 172.21.15.40:0/3735786507 conn(0x7fd47806a890 msgr2=0x7fd47806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 -- 172.21.15.40:0/3735786507 shutdown_connections 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 -- 172.21.15.40:0/3735786507 wait complete. 2023-11-04T01:42:35.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 Processor -- start 2023-11-04T01:42:35.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.042+0000 7fd47dfd3640 1 -- start start 2023-11-04T01:42:35.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd478159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd47815d0b0 0x7fd47815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4781610f0 0x7fd47814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815d880 con 0x7fd4780cff20 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815bdb0 con 0x7fd47815d0b0 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815c090 con 0x7fd4781610f0 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd478159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd478159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34626/0 (socket says 172.21.15.40:34626) 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 -- 172.21.15.40:0/4213221633 learned_addr learned my addr 172.21.15.40:0/4213221633 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 -- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4781610f0 msgr2=0x7fd47814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4781610f0 0x7fd47814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 -- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd47815d0b0 msgr2=0x7fd47815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd476ffd640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd47815d0b0 0x7fd47815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd47815d0b0 0x7fd47815abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 -- 172.21.15.40:0/4213221633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470009a70 con 0x7fd4780cff20 2023-11-04T01:42:35.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd4777fe640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd478159730 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd46800c7c0 tx=0x7fd46800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468007a30 con 0x7fd4780cff20 2023-11-04T01:42:35.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd468007b90 con 0x7fd4780cff20 2023-11-04T01:42:35.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47815c390 con 0x7fd4780cff20 2023-11-04T01:42:35.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800ce70 con 0x7fd4780cff20 2023-11-04T01:42:35.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47815b130 con 0x7fd4780cff20 2023-11-04T01:42:35.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4780b1c90 con 0x7fd4780cff20 2023-11-04T01:42:35.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4680113f0 con 0x7fd4780cff20 2023-11-04T01:42:35.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd45ffff640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664d0 0x7fd464068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fd4680843e0 con 0x7fd4780cff20 2023-11-04T01:42:35.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.046+0000 7fd476ffd640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664d0 0x7fd464068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.050+0000 7fd476ffd640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664d0 0x7fd464068990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd478158ca0 tx=0x7fd46c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.050+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4680517c0 con 0x7fd4780cff20 2023-11-04T01:42:35.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fd4780d0e30 con 0x7fd4780cff20 2023-11-04T01:42:35.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd45ffff640 1 -- 172.21.15.40:0/4213221633 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd468054de0 con 0x7fd4780cff20 2023-11-04T01:42:35.211 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664d0 msgr2=0x7fd464068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664d0 0x7fd464068990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd478158ca0 tx=0x7fd46c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 msgr2=0x7fd478159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd478159730 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd46800c7c0 tx=0x7fd46800cc80 comp rx=0 tx=0).stop 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 shutdown_connections 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664d0 0x7fd464068990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4781610f0 0x7fd47814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd47815d0b0 0x7fd47815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 --2- 172.21.15.40:0/4213221633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4780cff20 0x7fd478159730 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 >> 172.21.15.40:0/4213221633 conn(0x7fd47806a890 msgr2=0x7fd4780b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 shutdown_connections 2023-11-04T01:42:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.206+0000 7fd47dfd3640 1 -- 172.21.15.40:0/4213221633 wait complete. 2023-11-04T01:42:35.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:35.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f5861bf8640 1 Processor -- start 2023-11-04T01:42:35.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f5861bf8640 1 -- start start 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f5861bf8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f585c15b170 0x7f585c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f5861bf8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c15f990 con 0x7f585c15ad90 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f5861bf8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c15ec10 con 0x7f585c0b0c20 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f5861bf8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c15f570 con 0x7f585c15b170 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f585c15b170 0x7f585c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f585c15ad90 0x7f585c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60448/0 (socket says 172.21.15.40:60448) 2023-11-04T01:42:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585b7fe640 1 -- 172.21.15.40:0/2033762801 learned_addr learned my addr 172.21.15.40:0/2033762801 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585affd640 1 -- 172.21.15.40:0/2033762801 >> v1:172.21.15.91:6789/0 conn(0x7f585c0b0c20 legacy=0x7f585c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585affd640 1 -- 172.21.15.40:0/2033762801 >> v1:172.21.15.40:6789/0 conn(0x7f585c15ad90 legacy=0x7f585c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585a7fc640 1 -- 172.21.15.40:0/2033762801 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357895368 0 0) 0x7f584c001120 con 0x7f585c15ad90 2023-11-04T01:42:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.346+0000 7f585affd640 1 -- 172.21.15.40:0/2033762801 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0cd9a0 con 0x7f585c15b170 2023-11-04T01:42:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585affd640 1 --2- 172.21.15.40:0/2033762801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15b170 0x7f585c0ca590 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58500097c0 tx=0x7f585001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc14f0965551232 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585a7fc640 1 -- 172.21.15.40:0/2033762801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500ab600 con 0x7f585c15b170 2023-11-04T01:42:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585a7fc640 1 -- 172.21.15.40:0/2033762801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500a7050 con 0x7f585c15b170 2023-11-04T01:42:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585a7fc640 1 -- 172.21.15.40:0/2033762801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500ab980 con 0x7f585c15b170 2023-11-04T01:42:35.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- 172.21.15.40:0/2033762801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15b170 msgr2=0x7f585c0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2033762801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15b170 0x7f585c0ca590 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f58500097c0 tx=0x7f585001c3b0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- 172.21.15.40:0/2033762801 shutdown_connections 2023-11-04T01:42:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2033762801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15b170 0x7f585c0ca590 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- 172.21.15.40:0/2033762801 >> 172.21.15.40:0/2033762801 conn(0x7f585c0cb510 msgr2=0x7f585c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- 172.21.15.40:0/2033762801 shutdown_connections 2023-11-04T01:42:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- 172.21.15.40:0/2033762801 wait complete. 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 Processor -- start 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- start start 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f585c0b0c20 0x7f585c158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 0x7f585c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f585c15b170 0x7f585c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c1580e0 con 0x7f585c15ad90 2023-11-04T01:42:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c157c50 con 0x7f585c15b170 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f5861bf8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c158330 con 0x7f585c0b0c20 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 0x7f585c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 0x7f585c152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34648/0 (socket says 172.21.15.40:34648) 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585affd640 1 -- 172.21.15.40:0/2638486435 learned_addr learned my addr 172.21.15.40:0/2638486435 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585b7fe640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f585c0b0c20 0x7f585c158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.350+0000 7f585bfff640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f585c15b170 0x7f585c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585affd640 1 -- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f585c0b0c20 msgr2=0x7f585c158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585affd640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f585c0b0c20 0x7f585c158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585affd640 1 -- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f585c15b170 msgr2=0x7f585c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585affd640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f585c15b170 0x7f585c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585affd640 1 -- 172.21.15.40:0/2638486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850009420 con 0x7f585c15ad90 2023-11-04T01:42:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585bfff640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f585c15b170 0x7f585c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:35.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585affd640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 0x7f585c152d50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f5850019fe0 tx=0x7f5850019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850004220 con 0x7f585c15ad90 2023-11-04T01:42:35.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850004380 con 0x7f585c15ad90 2023-11-04T01:42:35.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c158610 con 0x7f585c15ad90 2023-11-04T01:42:35.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850003820 con 0x7f585c15ad90 2023-11-04T01:42:35.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c153430 con 0x7f585c15ad90 2023-11-04T01:42:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c0744a0 con 0x7f585c15ad90 2023-11-04T01:42:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58500b2040 con 0x7f585c15ad90 2023-11-04T01:42:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5843fff640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f58480664a0 0x7f5848068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f585011ea00 con 0x7f585c15ad90 2023-11-04T01:42:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585b7fe640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f58480664a0 0x7f5848068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.354+0000 7f585b7fe640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f58480664a0 0x7f5848068960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f584c007fd0 tx=0x7f584c007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.358+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58500ebf50 con 0x7f585c15ad90 2023-11-04T01:42:35.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.510+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f585c0cde60 con 0x7f585c15ad90 2023-11-04T01:42:35.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.510+0000 7f5843fff640 1 -- 172.21.15.40:0/2638486435 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7f58500b0070 con 0x7f585c15ad90 2023-11-04T01:42:35.517 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f58480664a0 msgr2=0x7f5848068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f58480664a0 0x7f5848068960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f584c007fd0 tx=0x7f584c007ba0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 msgr2=0x7f585c152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 0x7f585c152d50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f5850019fe0 tx=0x7f5850019150 comp rx=0 tx=0).stop 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 shutdown_connections 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f58480664a0 0x7f5848068960 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f585c15b170 0x7f585c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585c15ad90 0x7f585c152d50 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 --2- 172.21.15.40:0/2638486435 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f585c0b0c20 0x7f585c158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 >> 172.21.15.40:0/2638486435 conn(0x7f585c0cb510 msgr2=0x7f585c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 shutdown_connections 2023-11-04T01:42:35.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.514+0000 7f5861bf8640 1 -- 172.21.15.40:0/2638486435 wait complete. 2023-11-04T01:42:35.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:35.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 Processor -- start 2023-11-04T01:42:35.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 -- start start 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f792015acb0 0x7f792015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f792015c160 0x7f79200b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79200b0a50 0x7f79200ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792015bd40 con 0x7f79200b0a50 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792006fd80 con 0x7f792015c160 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7927b6a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b0ee0 con 0x7f792015acb0 2023-11-04T01:42:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7926107640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79200b0a50 0x7f79200ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.642+0000 7f7926107640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79200b0a50 0x7f79200ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34662/0 (socket says 172.21.15.40:34662) 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 -- 172.21.15.40:0/1257008171 learned_addr learned my addr 172.21.15.40:0/1257008171 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7925105640 1 --2- 172.21.15.40:0/1257008171 >> v2:172.21.15.91:3300/0 conn(0x7f792015c160 0x7f79200b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7925906640 1 --2- 172.21.15.40:0/1257008171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f792015acb0 0x7f792015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 -- 172.21.15.40:0/1257008171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f792015acb0 msgr2=0x7f792015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 --2- 172.21.15.40:0/1257008171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f792015acb0 0x7f792015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 -- 172.21.15.40:0/1257008171 >> v2:172.21.15.91:3300/0 conn(0x7f792015c160 msgr2=0x7f79200b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 --2- 172.21.15.40:0/1257008171 >> v2:172.21.15.91:3300/0 conn(0x7f792015c160 0x7f79200b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 -- 172.21.15.40:0/1257008171 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79200cb130 con 0x7f79200b0a50 2023-11-04T01:42:35.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7926107640 1 --2- 172.21.15.40:0/1257008171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79200b0a50 0x7f79200ca490 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f79200cc260 tx=0x7f791801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e47d7f2a4473cf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7924904640 1 -- 172.21.15.40:0/1257008171 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180a5820 con 0x7f79200b0a50 2023-11-04T01:42:35.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7924904640 1 -- 172.21.15.40:0/1257008171 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180a5980 con 0x7f79200b0a50 2023-11-04T01:42:35.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7924904640 1 -- 172.21.15.40:0/1257008171 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180a5d10 con 0x7f79200b0a50 2023-11-04T01:42:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 -- 172.21.15.40:0/1257008171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79200b0a50 msgr2=0x7f79200ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1257008171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79200b0a50 0x7f79200ca490 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f79200cc260 tx=0x7f791801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 -- 172.21.15.40:0/1257008171 shutdown_connections 2023-11-04T01:42:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1257008171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79200b0a50 0x7f79200ca490 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1257008171 >> v2:172.21.15.91:3300/0 conn(0x7f792015c160 0x7f79200b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1257008171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f792015acb0 0x7f792015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 -- 172.21.15.40:0/1257008171 >> 172.21.15.40:0/1257008171 conn(0x7f79200cb510 msgr2=0x7f79200cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 -- 172.21.15.40:0/1257008171 shutdown_connections 2023-11-04T01:42:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.646+0000 7f7927b6a640 1 -- 172.21.15.40:0/1257008171 wait complete. 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 Processor -- start 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- start start 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79200b0a50 0x7f79200b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 0x7f7920147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792015c160 0x7f792014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b3d50 con 0x7f792015acb0 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b30d0 con 0x7f792015c160 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200b33b0 con 0x7f79200b0a50 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 0x7f7920147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 0x7f7920147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34678/0 (socket says 172.21.15.40:34678) 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 -- 172.21.15.40:0/1013118173 learned_addr learned my addr 172.21.15.40:0/1013118173 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7926107640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792015c160 0x7f792014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925906640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79200b0a50 0x7f79200b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 -- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79200b0a50 msgr2=0x7f79200b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79200b0a50 0x7f79200b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 -- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792015c160 msgr2=0x7f792014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792015c160 0x7f792014f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 -- 172.21.15.40:0/1013118173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009b30 con 0x7f792015acb0 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7926107640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792015c160 0x7f792014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925105640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 0x7f7920147b80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f791000d5f0 tx=0x7f791000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100125f0 con 0x7f792015acb0 2023-11-04T01:42:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910012750 con 0x7f792015acb0 2023-11-04T01:42:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910012ae0 con 0x7f792015acb0 2023-11-04T01:42:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79200b3690 con 0x7f792015acb0 2023-11-04T01:42:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200b2d10 con 0x7f792015acb0 2023-11-04T01:42:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79200744a0 con 0x7f792015acb0 2023-11-04T01:42:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7910012c40 con 0x7f792015acb0 2023-11-04T01:42:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f79167fc640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79040664a0 0x7f7904068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f7910084350 con 0x7f792015acb0 2023-11-04T01:42:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.650+0000 7f7925906640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79040664a0 0x7f7904068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.654+0000 7f7925906640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79040664a0 0x7f7904068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f791c00b9d0 tx=0x7f791c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.654+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7910051730 con 0x7f792015acb0 2023-11-04T01:42:35.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.802+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f79200cde30 con 0x7f792015acb0 2023-11-04T01:42:35.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.802+0000 7f79167fc640 1 -- 172.21.15.40:0/1013118173 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v70) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7910007380 con 0x7f792015acb0 2023-11-04T01:42:35.809 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79040664a0 msgr2=0x7f7904068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79040664a0 0x7f7904068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f791c00b9d0 tx=0x7f791c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 msgr2=0x7f7920147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 0x7f7920147b80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f791000d5f0 tx=0x7f791000dab0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 shutdown_connections 2023-11-04T01:42:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f79040664a0 0x7f7904068960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f792015c160 0x7f792014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f792015acb0 0x7f7920147b80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 --2- 172.21.15.40:0/1013118173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f79200b0a50 0x7f79200b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 >> 172.21.15.40:0/1013118173 conn(0x7f79200cb510 msgr2=0x7f792015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 shutdown_connections 2023-11-04T01:42:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.806+0000 7f7927b6a640 1 -- 172.21.15.40:0/1013118173 wait complete. 2023-11-04T01:42:35.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:42:35.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 Processor -- start 2023-11-04T01:42:35.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 -- start start 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b1415d030 0x7f4b140d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b140acb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b140aefe0 con 0x7f4b140af1d0 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b140aed00 con 0x7f4b1415d030 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b19f8b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1406ca60 con 0x7f4b1406da70 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b1415d030 0x7f4b140d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b1415d030 0x7f4b140d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34684/0 (socket says 172.21.15.40:34684) 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 -- 172.21.15.40:0/4237947545 learned_addr learned my addr 172.21.15.40:0/4237947545 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b13fff640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b140acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 -- 172.21.15.40:0/4237947545 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 msgr2=0x7f4b140acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b140acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 -- 172.21.15.40:0/4237947545 >> v1:172.21.15.91:6789/0 conn(0x7f4b140af1d0 legacy=0x7f4b1406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b137fe640 1 -- 172.21.15.40:0/4237947545 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1406cd40 con 0x7f4b1415d030 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.938+0000 7f4b13fff640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b140acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b137fe640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b140d0770 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009870 tx=0x7f4b0401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68551154b076f330 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b127fc640 1 -- 172.21.15.40:0/4237947545 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040ab620 con 0x7f4b1415d030 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b127fc640 1 -- 172.21.15.40:0/4237947545 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040ab780 con 0x7f4b1415d030 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b127fc640 1 -- 172.21.15.40:0/4237947545 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040abb10 con 0x7f4b1415d030 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 -- 172.21.15.40:0/4237947545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 msgr2=0x7f4b140d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b140d0770 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009870 tx=0x7f4b0401c510 comp rx=0 tx=0).stop 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 -- 172.21.15.40:0/4237947545 shutdown_connections 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b140acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/4237947545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b140d0770 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 -- 172.21.15.40:0/4237947545 >> 172.21.15.40:0/4237947545 conn(0x7f4b140cfc50 msgr2=0x7f4b140d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 -- 172.21.15.40:0/4237947545 shutdown_connections 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 -- 172.21.15.40:0/4237947545 wait complete. 2023-11-04T01:42:35.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 Processor -- start 2023-11-04T01:42:35.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.942+0000 7f4b19f8b640 1 -- start start 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b1414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b140af1d0 0x7f4b1414a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b14145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1414c9a0 con 0x7f4b1415d030 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140b4140 con 0x7f4b140af1d0 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140b43b0 con 0x7f4b1406da70 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b14145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b14145f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34696/0 (socket says 172.21.15.40:34696) 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 -- 172.21.15.40:0/1876291972 learned_addr learned my addr 172.21.15.40:0/1876291972 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b137fe640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b1414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b12ffd640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b140af1d0 0x7f4b1414a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 -- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 msgr2=0x7f4b1414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b1414f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 -- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b140af1d0 msgr2=0x7f4b1414a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b140af1d0 0x7f4b1414a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 -- 172.21.15.40:0/1876291972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b040094d0 con 0x7f4b1415d030 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b13fff640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b14145f30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00e840 tx=0x7f4b0c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00c6d0 con 0x7f4b1415d030 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00c830 con 0x7f4b1415d030 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b140b4690 con 0x7f4b1415d030 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00cbe0 con 0x7f4b1415d030 2023-11-04T01:42:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1414a950 con 0x7f4b1415d030 2023-11-04T01:42:35.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1414cb50 con 0x7f4b1415d030 2023-11-04T01:42:35.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b0c00cd40 con 0x7f4b1415d030 2023-11-04T01:42:35.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b0bfff640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4af40664d0 0x7f4af4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.946+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f4b0c083cf0 con 0x7f4b1415d030 2023-11-04T01:42:35.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.950+0000 7f4b137fe640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4af40664d0 0x7f4af4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.950+0000 7f4b137fe640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4af40664d0 0x7f4af4068990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4b040af000 tx=0x7f4b040a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:35.954+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b1414cb50 con 0x7f4b1415d030 2023-11-04T01:42:36.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.158+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f4b1414cb50 con 0x7f4b1415d030 2023-11-04T01:42:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.282+0000 7f4b0bfff640 1 -- 172.21.15.40:0/1876291972 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v168) v1 ==== 151+0+0 (secure 0 0 0) 0x7f4b1414cb50 con 0x7f4b1415d030 2023-11-04T01:42:36.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4af40664d0 msgr2=0x7f4af4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4af40664d0 0x7f4af4068990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4b040af000 tx=0x7f4b040a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 msgr2=0x7f4b14145f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b14145f30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00e840 tx=0x7f4b0c00ed00 comp rx=0 tx=0).stop 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 shutdown_connections 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4af40664d0 0x7f4af4068990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1415d030 0x7f4b14145f30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b140af1d0 0x7f4b1414a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 --2- 172.21.15.40:0/1876291972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b1406da70 0x7f4b1414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 >> 172.21.15.40:0/1876291972 conn(0x7f4b140cfc50 msgr2=0x7f4b14156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 shutdown_connections 2023-11-04T01:42:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.286+0000 7f4b19f8b640 1 -- 172.21.15.40:0/1876291972 wait complete. 2023-11-04T01:42:36.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:42:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5cbcf7640 1 Processor -- start 2023-11-04T01:42:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5cbcf7640 1 -- start start 2023-11-04T01:42:36.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5cbcf7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5c40adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5cbcf7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c40cd020 con 0x7fb5c40cc990 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5cbcf7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c40cd300 con 0x7fb5c40c9a00 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5cbcf7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40cce10 con 0x7fb5c40adb50 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb5c40cc990 0x7fb5c40c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60458/0 (socket says 172.21.15.40:60458) 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 -- 172.21.15.40:0/2881689632 learned_addr learned my addr 172.21.15.40:0/2881689632 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9a93640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5c40adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993004763 0 0) 0x7fb5c40cd020 con 0x7fb5c40cc990 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b0003530 con 0x7fb5c40cc990 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1443368835 0 0) 0x7fb5b0003530 con 0x7fb5c40cc990 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 msgr2=0x7fb5c40adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5c40adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 >> v1:172.21.15.91:6789/0 conn(0x7fb5c40c9a00 legacy=0x7fb5c406f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40cd5e0 con 0x7fb5c40cc990 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fb5b4001680 con 0x7fb5c40cc990 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 >> v1:172.21.15.40:6789/0 conn(0x7fb5c40cc990 legacy=0x7fb5c40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40cce10 con 0x7fb5b00047d0 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b000cb50 con 0x7fb5b00039b0 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b000cd10 con 0x7fb5c40adb50 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9a93640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5ca294640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 -- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 msgr2=0x7fb5b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 -- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5b00039b0 msgr2=0x7fb5b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5c9292640 1 -- 172.21.15.40:0/2881689632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b0003530 con 0x7fb5b00047d0 2023-11-04T01:42:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.430+0000 7fb5ca294640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c40adb50 0x7fb5b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9292640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5b0004c50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c210 tx=0x7fb5b401f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e4f7e3ff0cbfcc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4005ae0 con 0x7fb5b00047d0 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b40ab070 con 0x7fb5b00047d0 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c8a91640 1 -- 172.21.15.40:0/2881689632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4007070 con 0x7fb5b00047d0 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/2881689632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 msgr2=0x7fb5b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/2881689632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5b0004c50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c210 tx=0x7fb5b401f350 comp rx=0 tx=0).stop 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5ca294640 1 -- 172.21.15.40:0/2881689632 reap_dead start 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/2881689632 shutdown_connections 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/2881689632 >> 172.21.15.40:0/2881689632 conn(0x7fb5c40cb510 msgr2=0x7fb5c40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/2881689632 shutdown_connections 2023-11-04T01:42:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/2881689632 wait complete. 2023-11-04T01:42:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 Processor -- start 2023-11-04T01:42:36.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- start start 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5c41550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c41f0520 0x7fb5c40c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5c40c82b0 0x7fb5c41debb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c41e0a10 con 0x7fb5b00047d0 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40c8730 con 0x7fb5c40c82b0 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5cbcf7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c41df920 con 0x7fb5c41f0520 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5c41550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5c41550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34726/0 (socket says 172.21.15.40:34726) 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 -- 172.21.15.40:0/3407263631 learned_addr learned my addr 172.21.15.40:0/3407263631 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5ca294640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5c40c82b0 0x7fb5c41debb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9292640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c41f0520 0x7fb5c40c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 -- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c41f0520 msgr2=0x7fb5c40c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c41f0520 0x7fb5c40c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 -- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5c40c82b0 msgr2=0x7fb5c41debb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5c40c82b0 0x7fb5c41debb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9a93640 1 -- 172.21.15.40:0/3407263631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c41e0070 con 0x7fb5b00047d0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.434+0000 7fb5c9292640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c41f0520 0x7fb5c40c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5c9a93640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5c41550a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00115e0 tx=0x7fb5c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000f8f0 con 0x7fb5b00047d0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000fa50 con 0x7fb5b00047d0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c41e0350 con 0x7fb5b00047d0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000fdc0 con 0x7fb5b00047d0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c41f09a0 con 0x7fb5b00047d0 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c40744a0 con 0x7fb5b00047d0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5c0015460 con 0x7fb5b00047d0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5ba7fc640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb5a80664d0 0x7fb5a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fb5c0084830 con 0x7fb5b00047d0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5c9292640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb5a80664d0 0x7fb5a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.438+0000 7fb5c9292640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb5a80664d0 0x7fb5a8068990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40af000 tx=0x7fb5b40aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.442+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5c0051b70 con 0x7fb5b00047d0 2023-11-04T01:42:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.594+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb5c40b11b0 con 0x7fb5b00047d0 2023-11-04T01:42:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.598+0000 7fb5ba7fc640 1 -- 172.21.15.40:0/3407263631 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb5c0055190 con 0x7fb5b00047d0 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb5a80664d0 msgr2=0x7fb5a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb5a80664d0 0x7fb5a8068990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40af000 tx=0x7fb5b40aa000 comp rx=0 tx=0).stop 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 msgr2=0x7fb5c41550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5c41550a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00115e0 tx=0x7fb5c0011aa0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 shutdown_connections 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb5a80664d0 0x7fb5a8068990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5c40c82b0 0x7fb5c41debb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb5c41f0520 0x7fb5c40c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 --2- 172.21.15.40:0/3407263631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5b00047d0 0x7fb5c41550a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 >> 172.21.15.40:0/3407263631 conn(0x7fb5c40cb510 msgr2=0x7fb5c4158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 shutdown_connections 2023-11-04T01:42:36.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.602+0000 7fb5cbcf7640 1 -- 172.21.15.40:0/3407263631 wait complete. 2023-11-04T01:42:36.622 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:36.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:36.664 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:36.711 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:36.711 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:42:36.711 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:36.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:36.717 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:42:36.717 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:36.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:36.722 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:42:36.722 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:36.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:36.763 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:42:36.763 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:36.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:36.769 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:42:36.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 Processor -- start 2023-11-04T01:42:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 -- start start 2023-11-04T01:42:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bbc15d2b0 0x7f6bbc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0cd400 con 0x7f6bbc15d690 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0ad450 con 0x7f6bbc15d2b0 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc35ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0cd6e0 con 0x7f6bbc06f8f0 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bbc15d2b0 0x7f6bbc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bbc15d2b0 0x7f6bbc06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34736/0 (socket says 172.21.15.40:34736) 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 -- 172.21.15.40:0/2305378921 learned_addr learned my addr 172.21.15.40:0/2305378921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1b67640 1 --2- 172.21.15.40:0/2305378921 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 -- 172.21.15.40:0/2305378921 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 msgr2=0x7f6bbc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 --2- 172.21.15.40:0/2305378921 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 -- 172.21.15.40:0/2305378921 >> v1:172.21.15.91:6789/0 conn(0x7f6bbc15d690 legacy=0x7f6bbc0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.926+0000 7f6bc1366640 1 -- 172.21.15.40:0/2305378921 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0ad070 con 0x7f6bbc15d2b0 2023-11-04T01:42:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc1366640 1 --2- 172.21.15.40:0/2305378921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc06c630 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0b16f0 tx=0x7f6bb801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4077361123219ca3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bb3fff640 1 -- 172.21.15.40:0/2305378921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80a5670 con 0x7f6bbc15d2b0 2023-11-04T01:42:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bb3fff640 1 -- 172.21.15.40:0/2305378921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80a57d0 con 0x7f6bbc15d2b0 2023-11-04T01:42:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bb3fff640 1 -- 172.21.15.40:0/2305378921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80a5b60 con 0x7f6bbc15d2b0 2023-11-04T01:42:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 -- 172.21.15.40:0/2305378921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d2b0 msgr2=0x7f6bbc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/2305378921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc06c630 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0b16f0 tx=0x7f6bb801c920 comp rx=0 tx=0).stop 2023-11-04T01:42:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 -- 172.21.15.40:0/2305378921 shutdown_connections 2023-11-04T01:42:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/2305378921 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/2305378921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc06c630 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 -- 172.21.15.40:0/2305378921 >> 172.21.15.40:0/2305378921 conn(0x7f6bbc0cebb0 msgr2=0x7f6bbc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 -- 172.21.15.40:0/2305378921 shutdown_connections 2023-11-04T01:42:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 -- 172.21.15.40:0/2305378921 wait complete. 2023-11-04T01:42:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 Processor -- start 2023-11-04T01:42:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.930+0000 7f6bc35ca640 1 -- start start 2023-11-04T01:42:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc14df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 0x7f6bbc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc14e450 con 0x7f6bbc15d690 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0c31b0 con 0x7f6bbc15d2b0 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc14d150 con 0x7f6bbc06f8f0 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 0x7f6bbc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 0x7f6bbc153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34746/0 (socket says 172.21.15.40:34746) 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 -- 172.21.15.40:0/1729515788 learned_addr learned my addr 172.21.15.40:0/1729515788 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc0b65640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1366640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 -- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 msgr2=0x7f6bbc14df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc14df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 -- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bbc15d2b0 msgr2=0x7f6bbc0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc0c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 -- 172.21.15.40:0/1729515788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009b30 con 0x7f6bbc15d690 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc0b65640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1b67640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 0x7f6bbc153260 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400afd0 tx=0x7f6bb400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004220 con 0x7f6bbc15d690 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4004380 con 0x7f6bbc15d690 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc14d430 con 0x7f6bbc15d690 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4003840 con 0x7f6bbc15d690 2023-11-04T01:42:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc14d9f0 con 0x7f6bbc15d690 2023-11-04T01:42:36.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc14dc10 con 0x7f6bbc15d690 2023-11-04T01:42:36.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6bb40039a0 con 0x7f6bbc15d690 2023-11-04T01:42:36.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bb1ffb640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ba00664a0 0x7f6ba0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f6bb4083cd0 con 0x7f6bbc15d690 2023-11-04T01:42:36.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.934+0000 7f6bc1366640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ba00664a0 0x7f6ba0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.938+0000 7f6bc1366640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ba00664a0 0x7f6ba0068960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80ae000 tx=0x7f6bb80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:36.938+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6bb4051020 con 0x7f6bbc15d690 2023-11-04T01:42:37.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.126+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bbc0744a0 con 0x7f6bbc15d690 2023-11-04T01:42:37.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.126+0000 7f6bb1ffb640 1 -- 172.21.15.40:0/1729515788 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f6bb4054640 con 0x7f6bbc15d690 2023-11-04T01:42:37.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:37.133 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2762938607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2762938607},{"type":"v1","addr":"172.21.15.91:6836","nonce":2762938607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/691913978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":691913978},{"type":"v1","addr":"172.21.15.91:6837","nonce":691913978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6129,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1724404647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1724404647},{"type":"v1","addr":"172.21.15.40:6833","nonce":1724404647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":6531,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3929422662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3929422662},{"type":"v1","addr":"172.21.15.40:6835","nonce":3929422662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[]} 2023-11-04T01:42:37.133 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 32 2023-11-04T01:42:37.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ba00664a0 msgr2=0x7f6ba0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ba00664a0 0x7f6ba0068960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80ae000 tx=0x7f6bb80a7070 comp rx=0 tx=0).stop 2023-11-04T01:42:37.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 msgr2=0x7f6bbc153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 0x7f6bbc153260 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400afd0 tx=0x7f6bb400ca20 comp rx=0 tx=0).stop 2023-11-04T01:42:37.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 shutdown_connections 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ba00664a0 0x7f6ba0068960 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bbc15d690 0x7f6bbc153260 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6bbc15d2b0 0x7f6bbc0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 --2- 172.21.15.40:0/1729515788 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6bbc06f8f0 0x7f6bbc14df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 >> 172.21.15.40:0/1729515788 conn(0x7f6bbc0cebb0 msgr2=0x7f6bbc15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 shutdown_connections 2023-11-04T01:42:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.130+0000 7f6bc35ca640 1 -- 172.21.15.40:0/1729515788 wait complete. 2023-11-04T01:42:37.151 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:42:37.151 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:42:37.151 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:42:37.151 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:37.152 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:37.152 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:42:37.152 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:42:37.152 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:37.152 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:42:37.152 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:42:37.153 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:42:37.153 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:37.153 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:42:37.153 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:42:37.153 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:42:37.153 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:37.162 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:42:37.163 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:37.164 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:42:37.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:42:37.166 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:42:37.166 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:42:37.168 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:42:37.168 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:42:37.207 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:37.207 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:37.208 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:42:37.208 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:37.210 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:42:37.210 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:37.211 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:42:37.211 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:37.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:42:37.267 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:42:37.272 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:42:37.280 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:42:37.280 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:42:37.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.322+0000 7fbe61810640 1 Processor -- start 2023-11-04T01:42:37.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.322+0000 7fbe61810640 1 -- start start 2023-11-04T01:42:37.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe5c0b4990 0x7fbe5c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbe5c0b74f0 0x7fbe5c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0b6070 con 0x7fbe5c0d0690 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0b8ed0 con 0x7fbe5c0b4990 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0b52b0 con 0x7fbe5c0b74f0 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe5c0b4990 0x7fbe5c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5a7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbe5c0d0690 0x7fbe5c0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57122/0 (socket says 172.21.15.40:57122) 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5a7fc640 1 -- 172.21.15.40:0/751490511 learned_addr learned my addr 172.21.15.40:0/751490511 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5b7fe640 1 --2- 172.21.15.40:0/751490511 >> v2:172.21.15.91:3300/0 conn(0x7fbe5c0b74f0 0x7fbe5c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5affd640 1 -- 172.21.15.40:0/751490511 >> v2:172.21.15.91:3300/0 conn(0x7fbe5c0b74f0 msgr2=0x7fbe5c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5affd640 1 --2- 172.21.15.40:0/751490511 >> v2:172.21.15.91:3300/0 conn(0x7fbe5c0b74f0 0x7fbe5c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5affd640 1 -- 172.21.15.40:0/751490511 >> v1:172.21.15.40:6789/0 conn(0x7fbe5c0d0690 legacy=0x7fbe5c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe59ffb640 1 -- 172.21.15.40:0/751490511 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919855412 0 0) 0x7fbe5c0b6070 con 0x7fbe5c0d0690 2023-11-04T01:42:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5affd640 1 -- 172.21.15.40:0/751490511 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0d1ce0 con 0x7fbe5c0b4990 2023-11-04T01:42:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5b7fe640 1 --2- 172.21.15.40:0/751490511 >> v2:172.21.15.91:3300/0 conn(0x7fbe5c0b74f0 0x7fbe5c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe5affd640 1 --2- 172.21.15.40:0/751490511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0b4990 0x7fbe5c0b4d70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c08c3b0 tx=0x7fbe4c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61dbc2213ddead29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe59ffb640 1 -- 172.21.15.40:0/751490511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0a8950 con 0x7fbe5c0b4990 2023-11-04T01:42:37.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe59ffb640 1 -- 172.21.15.40:0/751490511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c0a8ab0 con 0x7fbe5c0b4990 2023-11-04T01:42:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe59ffb640 1 -- 172.21.15.40:0/751490511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0a8e40 con 0x7fbe5c0b4990 2023-11-04T01:42:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- 172.21.15.40:0/751490511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0b4990 msgr2=0x7fbe5c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 --2- 172.21.15.40:0/751490511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0b4990 0x7fbe5c0b4d70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c08c3b0 tx=0x7fbe4c01ec50 comp rx=0 tx=0).stop 2023-11-04T01:42:37.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- 172.21.15.40:0/751490511 shutdown_connections 2023-11-04T01:42:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 --2- 172.21.15.40:0/751490511 >> v2:172.21.15.91:3300/0 conn(0x7fbe5c0b74f0 0x7fbe5c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 --2- 172.21.15.40:0/751490511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0b4990 0x7fbe5c0b4d70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- 172.21.15.40:0/751490511 >> 172.21.15.40:0/751490511 conn(0x7fbe5c0cf990 msgr2=0x7fbe5c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- 172.21.15.40:0/751490511 shutdown_connections 2023-11-04T01:42:37.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.326+0000 7fbe61810640 1 -- 172.21.15.40:0/751490511 wait complete. 2023-11-04T01:42:37.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 Processor -- start 2023-11-04T01:42:37.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- start start 2023-11-04T01:42:37.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe5c0b4990 0x7fbe5c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe5c0b74f0 0x7fbe5c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 0x7fbe5c0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1f2dd0 con 0x7fbe5c0d0690 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1f30b0 con 0x7fbe5c0b74f0 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1f3390 con 0x7fbe5c0b4990 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 0x7fbe5c0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 0x7fbe5c0ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42960/0 (socket says 172.21.15.40:42960) 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 -- 172.21.15.40:0/4059210670 learned_addr learned my addr 172.21.15.40:0/4059210670 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5a7fc640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe5c0b74f0 0x7fbe5c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5affd640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe5c0b4990 0x7fbe5c14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 -- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe5c0b4990 msgr2=0x7fbe5c14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe5c0b4990 0x7fbe5c14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 -- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe5c0b74f0 msgr2=0x7fbe5c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe5c0b74f0 0x7fbe5c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 -- 172.21.15.40:0/4059210670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009420 con 0x7fbe5c0d0690 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe5b7fe640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 0x7fbe5c0ccec0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fbe54007dc0 tx=0x7fbe5400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe540039a0 con 0x7fbe5c0d0690 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5400f040 con 0x7fbe5c0d0690 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c1f3670 con 0x7fbe5c0d0690 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54003d40 con 0x7fbe5c0d0690 2023-11-04T01:42:37.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c14c7e0 con 0x7fbe5c0d0690 2023-11-04T01:42:37.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c0744a0 con 0x7fbe5c0d0690 2023-11-04T01:42:37.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.330+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe54004030 con 0x7fbe5c0d0690 2023-11-04T01:42:37.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.334+0000 7fbe43fff640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe480664a0 0x7fbe48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.334+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fbe54084270 con 0x7fbe5c0d0690 2023-11-04T01:42:37.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.334+0000 7fbe5affd640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe480664a0 0x7fbe48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.334+0000 7fbe5affd640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe480664a0 0x7fbe48068960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0b2000 tx=0x7fbe4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.338+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe540515d0 con 0x7fbe5c0d0690 2023-11-04T01:42:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:37.502+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbe5c0cd9a0 con 0x7fbe5c0d0690 2023-11-04T01:42:38.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.606+0000 7fbe43fff640 1 -- 172.21.15.40:0/4059210670 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbe54054bf0 con 0x7fbe5c0d0690 2023-11-04T01:42:38.612 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-11-04T01:42:38.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe480664a0 msgr2=0x7fbe48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe480664a0 0x7fbe48068960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0b2000 tx=0x7fbe4c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 msgr2=0x7fbe5c0ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 0x7fbe5c0ccec0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fbe54007dc0 tx=0x7fbe5400d4a0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 shutdown_connections 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe480664a0 0x7fbe48068960 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe5c0d0690 0x7fbe5c0ccec0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe5c0b74f0 0x7fbe5c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 --2- 172.21.15.40:0/4059210670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe5c0b4990 0x7fbe5c14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 >> 172.21.15.40:0/4059210670 conn(0x7fbe5c0cf990 msgr2=0x7fbe5c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 shutdown_connections 2023-11-04T01:42:38.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.610+0000 7fbe61810640 1 -- 172.21.15.40:0/4059210670 wait complete. 2023-11-04T01:42:38.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:42:38.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 Processor -- start 2023-11-04T01:42:38.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 -- start start 2023-11-04T01:42:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380ccac0 0x7fe4380d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe4380cdd20 0x7fe4381617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43806ccf0 con 0x7fe4380ccea0 2023-11-04T01:42:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe438161d30 con 0x7fe4380cdd20 2023-11-04T01:42:38.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe44050b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43806d220 con 0x7fe4380ccac0 2023-11-04T01:42:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43eaa8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe4380cdd20 0x7fe4381617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43e2a7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380ccac0 0x7fe4380d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43daa6640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe4380ccea0 0x7fe4380cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:41950/0 (socket says 172.21.15.40:41950) 2023-11-04T01:42:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43daa6640 1 -- 172.21.15.40:0/2528427423 learned_addr learned my addr 172.21.15.40:0/2528427423 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:38.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43e2a7640 1 -- 172.21.15.40:0/2528427423 >> v2:172.21.15.91:3300/0 conn(0x7fe4380cdd20 msgr2=0x7fe4381617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43e2a7640 1 --2- 172.21.15.40:0/2528427423 >> v2:172.21.15.91:3300/0 conn(0x7fe4380cdd20 0x7fe4381617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43e2a7640 1 -- 172.21.15.40:0/2528427423 >> v1:172.21.15.91:6789/0 conn(0x7fe4380ccea0 legacy=0x7fe4380cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.750+0000 7fe43e2a7640 1 -- 172.21.15.40:0/2528427423 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43806c630 con 0x7fe4380ccac0 2023-11-04T01:42:38.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe43e2a7640 1 --2- 172.21.15.40:0/2528427423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380ccac0 0x7fe4380d06a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4340097c0 tx=0x7fe43401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7aa7ae6d42e855c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe43d2a5640 1 -- 172.21.15.40:0/2528427423 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340ab650 con 0x7fe4380ccac0 2023-11-04T01:42:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe43d2a5640 1 -- 172.21.15.40:0/2528427423 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4340ab7b0 con 0x7fe4380ccac0 2023-11-04T01:42:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe43d2a5640 1 -- 172.21.15.40:0/2528427423 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340abb40 con 0x7fe4380ccac0 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 -- 172.21.15.40:0/2528427423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380ccac0 msgr2=0x7fe4380d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 --2- 172.21.15.40:0/2528427423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380ccac0 0x7fe4380d06a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4340097c0 tx=0x7fe43401c450 comp rx=0 tx=0).stop 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 -- 172.21.15.40:0/2528427423 shutdown_connections 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 --2- 172.21.15.40:0/2528427423 >> v2:172.21.15.91:3300/0 conn(0x7fe4380cdd20 0x7fe4381617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 --2- 172.21.15.40:0/2528427423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380ccac0 0x7fe4380d06a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 -- 172.21.15.40:0/2528427423 >> 172.21.15.40:0/2528427423 conn(0x7fe438065dc0 msgr2=0x7fe4380661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 -- 172.21.15.40:0/2528427423 shutdown_connections 2023-11-04T01:42:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.754+0000 7fe44050b640 1 -- 172.21.15.40:0/2528427423 wait complete. 2023-11-04T01:42:38.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 Processor -- start 2023-11-04T01:42:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- start start 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380ccea0 0x7fe438156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 0x7fe4380b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380b21c0 0x7fe4380b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380b2650 con 0x7fe4380cdd20 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe438157510 con 0x7fe4380ccea0 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe438159010 con 0x7fe4380b21c0 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 0x7fe4380b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 0x7fe4380b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42966/0 (socket says 172.21.15.40:42966) 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 -- 172.21.15.40:0/1482061990 learned_addr learned my addr 172.21.15.40:0/1482061990 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:38.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43e2a7640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380ccea0 0x7fe438156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43eaa8640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380b21c0 0x7fe4380b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 -- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380b21c0 msgr2=0x7fe4380b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380b21c0 0x7fe4380b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 -- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380ccea0 msgr2=0x7fe438156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380ccea0 0x7fe438156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 -- 172.21.15.40:0/1482061990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434009420 con 0x7fe4380cdd20 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43e2a7640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380ccea0 0x7fe438156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe43daa6640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 0x7fe4380b1c80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe42800c500 tx=0x7fe42800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428005cf0 con 0x7fe4380cdd20 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428005e50 con 0x7fe4380cdd20 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4381592f0 con 0x7fe4380cdd20 2023-11-04T01:42:38.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4280072f0 con 0x7fe4380cdd20 2023-11-04T01:42:38.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380b3ae0 con 0x7fe4380cdd20 2023-11-04T01:42:38.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.758+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe438159810 con 0x7fe4380cdd20 2023-11-04T01:42:38.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.762+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe428007450 con 0x7fe4380cdd20 2023-11-04T01:42:38.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.762+0000 7fe42effd640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe41c0664a0 0x7fe41c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.762+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fe428083640 con 0x7fe4380cdd20 2023-11-04T01:42:38.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.762+0000 7fe43e2a7640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe41c0664a0 0x7fe41c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.762+0000 7fe43e2a7640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe41c0664a0 0x7fe41c068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe4340af000 tx=0x7fe4340a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.766+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe428050c30 con 0x7fe4380cdd20 2023-11-04T01:42:38.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe438159810 con 0x7fe4380cdd20 2023-11-04T01:42:38.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe42effd640 1 -- 172.21.15.40:0/1482061990 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe438159810 con 0x7fe4380cdd20 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg==", 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ==", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw==", 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ==", 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg==", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg==", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w==", 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.985 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g==", 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA==", 2023-11-04T01:42:38.986 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg==", 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w==", 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.988 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA==", 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q==", 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.989 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow r", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ==", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:42:38.990 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg==", 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.991 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw==", 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-11-04T01:42:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlYH5cAhAAAtiBIRwfeOo/LLvHf3APaQ==", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ==", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:42:38.993 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ==", 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.994 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:38.995 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-11-04T01:42:38.995 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:42:38.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe41c0664a0 msgr2=0x7fe41c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe41c0664a0 0x7fe41c068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe4340af000 tx=0x7fe4340a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 msgr2=0x7fe4380b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 0x7fe4380b1c80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe42800c500 tx=0x7fe42800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 shutdown_connections 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe41c0664a0 0x7fe41c068960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4380b21c0 0x7fe4380b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4380cdd20 0x7fe4380b1c80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 --2- 172.21.15.40:0/1482061990 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe4380ccea0 0x7fe438156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.974+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 >> 172.21.15.40:0/1482061990 conn(0x7fe438065dc0 msgr2=0x7fe43815be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.978+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 shutdown_connections 2023-11-04T01:42:38.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:38.978+0000 7fe44050b640 1 -- 172.21.15.40:0/1482061990 wait complete. 2023-11-04T01:42:38.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:39.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.114+0000 7f3d72cc4640 1 Processor -- start 2023-11-04T01:42:39.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d72cc4640 1 -- start start 2023-11-04T01:42:39.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d72cc4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3d6c15afd0 0x7f3d6c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d72cc4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 0x7f3d6c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d72cc4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c0c2670 con 0x7f3d6c0b0b70 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d72cc4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c070140 con 0x7f3d6c15afd0 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d72cc4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15fc90 con 0x7f3d6c06f8f0 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d71261640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3d6c0b0b70 0x7f3d6c0c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57138/0 (socket says 172.21.15.40:57138) 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d71261640 1 -- 172.21.15.40:0/2298506608 learned_addr learned my addr 172.21.15.40:0/2298506608 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 --2- 172.21.15.40:0/2298506608 >> v2:172.21.15.91:3300/0 conn(0x7f3d6c15afd0 0x7f3d6c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6bfff640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 0x7f3d6c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425952081 0 0) 0x7f3d6c0c2670 con 0x7f3d6c0b0b70 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d54003530 con 0x7f3d6c0b0b70 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820317569 0 0) 0x7f3d54003530 con 0x7f3d6c0b0b70 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 msgr2=0x7f3d6c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 0x7f3d6c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 >> v2:172.21.15.91:3300/0 conn(0x7f3d6c15afd0 msgr2=0x7f3d6c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 --2- 172.21.15.40:0/2298506608 >> v2:172.21.15.91:3300/0 conn(0x7f3d6c15afd0 0x7f3d6c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c06bc30 con 0x7f3d6c0b0b70 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3d64001a00 con 0x7f3d6c0b0b70 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 >> v1:172.21.15.40:6789/0 conn(0x7f3d6c0b0b70 legacy=0x7f3d6c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d54003980 0x7f3d54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 0x7f3d540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54004d10 0x7f3d54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c070140 con 0x7f3d54003980 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15fc90 con 0x7f3d54004d10 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400b990 con 0x7f3d6c06f8f0 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d54003980 0x7f3d54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d6bfff640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 0x7f3d540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 -- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 msgr2=0x7f3d540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c06f8f0 0x7f3d540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d71261640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54004d10 0x7f3d54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 -- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54004d10 msgr2=0x7f3d54005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54004d10 0x7f3d54005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d70a60640 1 -- 172.21.15.40:0/2298506608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54003530 con 0x7f3d54003980 2023-11-04T01:42:39.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.118+0000 7f3d71261640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54004d10 0x7f3d54005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d70a60640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d54003980 0x7f3d54003da0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009ae0 tx=0x7f3d5c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc25889397ec208 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0a6470 con 0x7f3d54003980 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c0a65d0 con 0x7f3d54003980 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d6b7fe640 1 -- 172.21.15.40:0/2298506608 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0a6980 con 0x7f3d54003980 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- 172.21.15.40:0/2298506608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d54003980 msgr2=0x7f3d54003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/2298506608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d54003980 0x7f3d54003da0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009ae0 tx=0x7f3d5c01ca90 comp rx=0 tx=0).stop 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 -- 172.21.15.40:0/2298506608 reap_dead start 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- 172.21.15.40:0/2298506608 shutdown_connections 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- 172.21.15.40:0/2298506608 >> 172.21.15.40:0/2298506608 conn(0x7f3d6c0cebb0 msgr2=0x7f3d6c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- 172.21.15.40:0/2298506608 shutdown_connections 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- 172.21.15.40:0/2298506608 wait complete. 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 Processor -- start 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- start start 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54003980 0x7f3d6c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c0c78c0 0x7f3d6c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 0x7f3d6c1611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15c730 con 0x7f3d6c15d460 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c157160 con 0x7f3d54003980 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d72cc4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15c980 con 0x7f3d6c0c78c0 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 0x7f3d6c1611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 0x7f3d6c1611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42986/0 (socket says 172.21.15.40:42986) 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 -- 172.21.15.40:0/1147080686 learned_addr learned my addr 172.21.15.40:0/1147080686 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:39.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d6bfff640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c0c78c0 0x7f3d6c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d70a60640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54003980 0x7f3d6c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 -- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c0c78c0 msgr2=0x7f3d6c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c0c78c0 0x7f3d6c14bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 -- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54003980 msgr2=0x7f3d6c156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54003980 0x7f3d6c156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 -- 172.21.15.40:0/1147080686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c15cc60 con 0x7f3d6c15d460 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d70a60640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54003980 0x7f3d6c156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d6bfff640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c0c78c0 0x7f3d6c14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.122+0000 7f3d71261640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 0x7f3d6c1611a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0ca3a0 tx=0x7f3d6400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64004d70 con 0x7f3d6c15d460 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6400bb80 con 0x7f3d6c15d460 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c15cf40 con 0x7f3d6c15d460 2023-11-04T01:42:39.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64007070 con 0x7f3d6c15d460 2023-11-04T01:42:39.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c14c4a0 con 0x7f3d6c15d460 2023-11-04T01:42:39.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c15d130 con 0x7f3d6c15d460 2023-11-04T01:42:39.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d640071d0 con 0x7f3d6c15d460 2023-11-04T01:42:39.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d697fa640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d580664a0 0x7f3d58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f3d640842e0 con 0x7f3d6c15d460 2023-11-04T01:42:39.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d70a60640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d580664a0 0x7f3d58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.126+0000 7f3d70a60640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d580664a0 0x7f3d58068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ad000 tx=0x7f3d5c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.130+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d64051690 con 0x7f3d6c15d460 2023-11-04T01:42:39.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.286+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d6c0744a0 con 0x7f3d6c15d460 2023-11-04T01:42:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d697fa640 1 -- 172.21.15.40:0/1147080686 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18042 (secure 0 0 0) 0x7f3d64054cb0 con 0x7f3d6c15d460 2023-11-04T01:42:39.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:39.295 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":75,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:38.606534+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d580664a0 msgr2=0x7f3d58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d580664a0 0x7f3d58068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ad000 tx=0x7f3d5c0046d0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 msgr2=0x7f3d6c1611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 0x7f3d6c1611a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0ca3a0 tx=0x7f3d6400b4a0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 shutdown_connections 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3d580664a0 0x7f3d58068960 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d6c15d460 0x7f3d6c1611a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3d6c0c78c0 0x7f3d6c14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 --2- 172.21.15.40:0/1147080686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3d54003980 0x7f3d6c156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.290+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 >> 172.21.15.40:0/1147080686 conn(0x7f3d6c0cebb0 msgr2=0x7f3d6c0af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.294+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 shutdown_connections 2023-11-04T01:42:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.294+0000 7f3d72cc4640 1 -- 172.21.15.40:0/1147080686 wait complete. 2023-11-04T01:42:39.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:39.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 Processor -- start 2023-11-04T01:42:39.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 -- start start 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c15af50 0x7fb23c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb23c0b32f0 0x7fb23c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c0cd830 con 0x7fb23c0cf4c0 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0b3780 con 0x7fb23c0b32f0 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb24310d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0cdad0 con 0x7fb23c15af50 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb23c0b32f0 0x7fb23c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb23c0b32f0 0x7fb23c0ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42992/0 (socket says 172.21.15.40:42992) 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 -- 172.21.15.40:0/2429985637 learned_addr learned my addr 172.21.15.40:0/2429985637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb240ea9640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c15af50 0x7fb23c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 -- 172.21.15.40:0/2429985637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c15af50 msgr2=0x7fb23c0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c15af50 0x7fb23c0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 -- 172.21.15.40:0/2429985637 >> v1:172.21.15.91:6789/0 conn(0x7fb23c0cf4c0 legacy=0x7fb23c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb23bfff640 1 -- 172.21.15.40:0/2429985637 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0cddb0 con 0x7fb23c0b32f0 2023-11-04T01:42:39.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.430+0000 7fb240ea9640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c15af50 0x7fb23c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23bfff640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0b32f0 0x7fb23c0ce8b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb230009870 tx=0x7fb23001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaa17249d06138f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23b7fe640 1 -- 172.21.15.40:0/2429985637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300ab650 con 0x7fb23c0b32f0 2023-11-04T01:42:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23b7fe640 1 -- 172.21.15.40:0/2429985637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300ab7b0 con 0x7fb23c0b32f0 2023-11-04T01:42:39.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23b7fe640 1 -- 172.21.15.40:0/2429985637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300abb40 con 0x7fb23c0b32f0 2023-11-04T01:42:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- 172.21.15.40:0/2429985637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0b32f0 msgr2=0x7fb23c0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0b32f0 0x7fb23c0ce8b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb230009870 tx=0x7fb23001c470 comp rx=0 tx=0).stop 2023-11-04T01:42:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- 172.21.15.40:0/2429985637 shutdown_connections 2023-11-04T01:42:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0b32f0 0x7fb23c0ce8b0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 --2- 172.21.15.40:0/2429985637 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c15af50 0x7fb23c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- 172.21.15.40:0/2429985637 >> 172.21.15.40:0/2429985637 conn(0x7fb23c065dc0 msgr2=0x7fb23c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- 172.21.15.40:0/2429985637 shutdown_connections 2023-11-04T01:42:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- 172.21.15.40:0/2429985637 wait complete. 2023-11-04T01:42:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 Processor -- start 2023-11-04T01:42:39.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- start start 2023-11-04T01:42:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c0cf4c0 0x7fb23c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 0x7fb23c163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c1584e0 0x7fb23c164450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0c4b80 con 0x7fb23c15af50 2023-11-04T01:42:39.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c164dd0 con 0x7fb23c0cf4c0 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb24310d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c165040 con 0x7fb23c1584e0 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 0x7fb23c163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 0x7fb23c163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43008/0 (socket says 172.21.15.40:43008) 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb23bfff640 1 -- 172.21.15.40:0/1280358850 learned_addr learned my addr 172.21.15.40:0/1280358850 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb2416aa640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c1584e0 0x7fb23c164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.434+0000 7fb240ea9640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c0cf4c0 0x7fb23c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb23bfff640 1 -- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c1584e0 msgr2=0x7fb23c164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb23bfff640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c1584e0 0x7fb23c164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb23bfff640 1 -- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c0cf4c0 msgr2=0x7fb23c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb23bfff640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c0cf4c0 0x7fb23c06bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb23bfff640 1 -- 172.21.15.40:0/1280358850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300094d0 con 0x7fb23c15af50 2023-11-04T01:42:39.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb23bfff640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 0x7fb23c163f10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb23001c2a0 tx=0x7fb23001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300b4800 con 0x7fb23c15af50 2023-11-04T01:42:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300b4960 con 0x7fb23c15af50 2023-11-04T01:42:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c165320 con 0x7fb23c15af50 2023-11-04T01:42:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300b4cf0 con 0x7fb23c15af50 2023-11-04T01:42:39.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c06c1c0 con 0x7fb23c15af50 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c0c4cf0 con 0x7fb23c15af50 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2300c7440 con 0x7fb23c15af50 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb2397fa640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2280664d0 0x7fb228068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fb23011f240 con 0x7fb23c15af50 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb240ea9640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2280664d0 0x7fb228068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.438+0000 7fb240ea9640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2280664d0 0x7fb228068990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00a950 tx=0x7fb22c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.442+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2300ec720 con 0x7fb23c15af50 2023-11-04T01:42:39.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.594+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb23c0675f0 con 0x7fb23c15af50 2023-11-04T01:42:39.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.594+0000 7fb2397fa640 1 -- 172.21.15.40:0/1280358850 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2300efd40 con 0x7fb23c15af50 2023-11-04T01:42:39.600 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:39.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2280664d0 msgr2=0x7fb228068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2280664d0 0x7fb228068990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00a950 tx=0x7fb22c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 msgr2=0x7fb23c163f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 0x7fb23c163f10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb23001c2a0 tx=0x7fb23001acb0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 shutdown_connections 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2280664d0 0x7fb228068990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb23c1584e0 0x7fb23c164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c15af50 0x7fb23c163f10 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 --2- 172.21.15.40:0/1280358850 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb23c0cf4c0 0x7fb23c06bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 >> 172.21.15.40:0/1280358850 conn(0x7fb23c065dc0 msgr2=0x7fb23c0b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 shutdown_connections 2023-11-04T01:42:39.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.598+0000 7fb24310d640 1 -- 172.21.15.40:0/1280358850 wait complete. 2023-11-04T01:42:39.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.726+0000 7f0de1ff2640 1 Processor -- start 2023-11-04T01:42:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.726+0000 7f0de1ff2640 1 -- start start 2023-11-04T01:42:39.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ddc0cfc80 0x7f0ddc0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc0b5e00 con 0x7f0ddc0cf810 2023-11-04T01:42:39.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc15d490 con 0x7f0ddc15d0b0 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0d1520 con 0x7f0ddc0cfc80 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ddc0cfc80 0x7f0ddc0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddaffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0ddc0cf810 0x7f0ddc0d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57148/0 (socket says 172.21.15.40:57148) 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddaffd640 1 -- 172.21.15.40:0/409839987 learned_addr learned my addr 172.21.15.40:0/409839987 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddbfff640 1 -- 172.21.15.40:0/409839987 >> v1:172.21.15.91:6789/0 conn(0x7f0ddc15d0b0 legacy=0x7f0ddc160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddbfff640 1 -- 172.21.15.40:0/409839987 >> v1:172.21.15.40:6789/0 conn(0x7f0ddc0cf810 legacy=0x7f0ddc0d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddbfff640 1 -- 172.21.15.40:0/409839987 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0b8930 con 0x7f0ddc0cfc80 2023-11-04T01:42:39.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0dda7fc640 1 -- 172.21.15.40:0/409839987 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466628122 0 0) 0x7f0ddc0b5e00 con 0x7f0ddc0cf810 2023-11-04T01:42:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0ddbfff640 1 --2- 172.21.15.40:0/409839987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc0d2050 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009d90 tx=0x7f0dd401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f69f289abbdd04d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0dda7fc640 1 -- 172.21.15.40:0/409839987 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40a59d0 con 0x7f0ddc0cfc80 2023-11-04T01:42:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0dda7fc640 1 -- 172.21.15.40:0/409839987 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40a5b30 con 0x7f0ddc0cfc80 2023-11-04T01:42:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0dda7fc640 1 -- 172.21.15.40:0/409839987 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40ad440 con 0x7f0ddc0cfc80 2023-11-04T01:42:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- 172.21.15.40:0/409839987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cfc80 msgr2=0x7f0ddc0d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/409839987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc0d2050 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009d90 tx=0x7f0dd401c910 comp rx=0 tx=0).stop 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- 172.21.15.40:0/409839987 shutdown_connections 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/409839987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc0d2050 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- 172.21.15.40:0/409839987 >> 172.21.15.40:0/409839987 conn(0x7f0ddc06a890 msgr2=0x7f0ddc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- 172.21.15.40:0/409839987 shutdown_connections 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.730+0000 7f0de1ff2640 1 -- 172.21.15.40:0/409839987 wait complete. 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 Processor -- start 2023-11-04T01:42:39.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- start start 2023-11-04T01:42:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 0x7f0ddc143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0ddc15d0b0 0x7f0ddc156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b3b50 con 0x7f0ddc0cf810 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b3e30 con 0x7f0ddc0cfc80 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b4110 con 0x7f0ddc15d0b0 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 0x7f0ddc143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 0x7f0ddc143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43036/0 (socket says 172.21.15.40:43036) 2023-11-04T01:42:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 -- 172.21.15.40:0/4110997929 learned_addr learned my addr 172.21.15.40:0/4110997929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddaffd640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddbfff640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0ddc15d0b0 0x7f0ddc156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 -- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0ddc15d0b0 msgr2=0x7f0ddc156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0ddc15d0b0 0x7f0ddc156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 -- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ddc0cfc80 msgr2=0x7f0ddc15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc15ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 -- 172.21.15.40:0/4110997929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009a70 con 0x7f0ddc0cf810 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0ddb7fe640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 0x7f0ddc143c30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00b410 tx=0x7f0dcc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004020 con 0x7f0ddc0cf810 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc004180 con 0x7f0ddc0cf810 2023-11-04T01:42:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011630 con 0x7f0ddc0cf810 2023-11-04T01:42:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0b43f0 con 0x7f0ddc0cf810 2023-11-04T01:42:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc144170 con 0x7f0ddc0cf810 2023-11-04T01:42:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.734+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc0d0e20 con 0x7f0ddc0cf810 2023-11-04T01:42:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.738+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0dcc011790 con 0x7f0ddc0cf810 2023-11-04T01:42:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.738+0000 7f0dc3fff640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0dc80664d0 0x7f0dc8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.738+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f0dcc083c00 con 0x7f0ddc0cf810 2023-11-04T01:42:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.738+0000 7f0ddaffd640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0dc80664d0 0x7f0dc8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.738+0000 7f0ddaffd640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0dc80664d0 0x7f0dc8068990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0b6350 tx=0x7f0dd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.742+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0dcc08a080 con 0x7f0ddc0cf810 2023-11-04T01:42:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.894+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f0ddc0744a0 con 0x7f0ddc0cf810 2023-11-04T01:42:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0dc3fff640 1 -- 172.21.15.40:0/4110997929 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v75) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0dcc0150a0 con 0x7f0ddc0cf810 2023-11-04T01:42:39.902 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0dc80664d0 msgr2=0x7f0dc8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0dc80664d0 0x7f0dc8068990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0b6350 tx=0x7f0dd0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 msgr2=0x7f0ddc143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 0x7f0ddc143c30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00b410 tx=0x7f0dcc00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 shutdown_connections 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0dc80664d0 0x7f0dc8068990 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0ddc15d0b0 0x7f0ddc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0ddc0cfc80 0x7f0ddc15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 --2- 172.21.15.40:0/4110997929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ddc0cf810 0x7f0ddc143c30 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 >> 172.21.15.40:0/4110997929 conn(0x7f0ddc06a890 msgr2=0x7f0ddc0b7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 shutdown_connections 2023-11-04T01:42:39.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:39.898+0000 7f0de1ff2640 1 -- 172.21.15.40:0/4110997929 wait complete. 2023-11-04T01:42:39.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 Processor -- start 2023-11-04T01:42:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 -- start start 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b015af50 0x7fc4b00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4b00cf4c0 0x7fc4b00d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00cd830 con 0x7fc4b00b32f0 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b00b3780 con 0x7fc4b00cf4c0 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b6619640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00cdad0 con 0x7fc4b015af50 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4b00cf4c0 0x7fc4b00d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4b00cf4c0 0x7fc4b00d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43040/0 (socket says 172.21.15.40:43040) 2023-11-04T01:42:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 -- 172.21.15.40:0/1117824252 learned_addr learned my addr 172.21.15.40:0/1117824252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4affff640 1 --2- 172.21.15.40:0/1117824252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b015af50 0x7fc4b00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 -- 172.21.15.40:0/1117824252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b015af50 msgr2=0x7fc4b00cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 --2- 172.21.15.40:0/1117824252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b015af50 0x7fc4b00cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 -- 172.21.15.40:0/1117824252 >> v1:172.21.15.91:6789/0 conn(0x7fc4b00b32f0 legacy=0x7fc4b00ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.042+0000 7fc4b4bb6640 1 -- 172.21.15.40:0/1117824252 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00cddb0 con 0x7fc4b00cf4c0 2023-11-04T01:42:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b4bb6640 1 --2- 172.21.15.40:0/1117824252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b00cf4c0 0x7fc4b00d0610 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f163966a3cc5c407 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4aeffd640 1 -- 172.21.15.40:0/1117824252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80aa430 con 0x7fc4b00cf4c0 2023-11-04T01:42:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4aeffd640 1 -- 172.21.15.40:0/1117824252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a80aa590 con 0x7fc4b00cf4c0 2023-11-04T01:42:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4aeffd640 1 -- 172.21.15.40:0/1117824252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80aa920 con 0x7fc4b00cf4c0 2023-11-04T01:42:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- 172.21.15.40:0/1117824252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b00cf4c0 msgr2=0x7fc4b00d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1117824252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b00cf4c0 0x7fc4b00d0610 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a801c4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- 172.21.15.40:0/1117824252 shutdown_connections 2023-11-04T01:42:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1117824252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b00cf4c0 0x7fc4b00d0610 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1117824252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b015af50 0x7fc4b00cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- 172.21.15.40:0/1117824252 >> 172.21.15.40:0/1117824252 conn(0x7fc4b0065dc0 msgr2=0x7fc4b00661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- 172.21.15.40:0/1117824252 shutdown_connections 2023-11-04T01:42:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- 172.21.15.40:0/1117824252 wait complete. 2023-11-04T01:42:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 Processor -- start 2023-11-04T01:42:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- start start 2023-11-04T01:42:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b00cf4c0 0x7fc4b0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 0x7fc4b01592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4b0159810 0x7fc4b015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0154870 con 0x7fc4b015af50 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0158230 con 0x7fc4b0159810 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b6619640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0158510 con 0x7fc4b00cf4c0 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 0x7fc4b01592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 0x7fc4b01592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43044/0 (socket says 172.21.15.40:43044) 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 -- 172.21.15.40:0/1555616524 learned_addr learned my addr 172.21.15.40:0/1555616524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b4bb6640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4b0159810 0x7fc4b015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4affff640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b00cf4c0 0x7fc4b0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 -- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b00cf4c0 msgr2=0x7fc4b0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b00cf4c0 0x7fc4b0154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 -- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4b0159810 msgr2=0x7fc4b015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4b0159810 0x7fc4b015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4af7fe640 1 -- 172.21.15.40:0/1555616524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80094d0 con 0x7fc4b015af50 2023-11-04T01:42:40.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4affff640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b00cf4c0 0x7fc4b0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.046+0000 7fc4b4bb6640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4b0159810 0x7fc4b015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4af7fe640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 0x7fc4b01592d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400c500 tx=0x7fc4a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4005220 con 0x7fc4b015af50 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4005380 con 0x7fc4b015af50 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b01587f0 con 0x7fc4b015af50 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4007270 con 0x7fc4b015af50 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b0158db0 con 0x7fc4b015af50 2023-11-04T01:42:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b0158fd0 con 0x7fc4b015af50 2023-11-04T01:42:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4a40073d0 con 0x7fc4b015af50 2023-11-04T01:42:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4acff9640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc49c0664a0 0x7fc49c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fc4a4083830 con 0x7fc4b015af50 2023-11-04T01:42:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4affff640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc49c0664a0 0x7fc49c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.050+0000 7fc4affff640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc49c0664a0 0x7fc49c068960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0007f00 tx=0x7fc4a0007450 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.054+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4a4050bf0 con 0x7fc4b015af50 2023-11-04T01:42:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.214+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc4b00675f0 con 0x7fc4b015af50 2023-11-04T01:42:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.214+0000 7fc4acff9640 1 -- 172.21.15.40:0/1555616524 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v75) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4a4054210 con 0x7fc4b015af50 2023-11-04T01:42:40.219 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc49c0664a0 msgr2=0x7fc49c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc49c0664a0 0x7fc49c068960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0007f00 tx=0x7fc4a0007450 comp rx=0 tx=0).stop 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 msgr2=0x7fc4b01592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 0x7fc4b01592d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400c500 tx=0x7fc4a400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 shutdown_connections 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc49c0664a0 0x7fc49c068960 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4b0159810 0x7fc4b015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b015af50 0x7fc4b01592d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 --2- 172.21.15.40:0/1555616524 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc4b00cf4c0 0x7fc4b0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 >> 172.21.15.40:0/1555616524 conn(0x7fc4b0065dc0 msgr2=0x7fc4b006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 shutdown_connections 2023-11-04T01:42:40.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.218+0000 7fc4b6619640 1 -- 172.21.15.40:0/1555616524 wait complete. 2023-11-04T01:42:40.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:40.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1e013d1640 1 Processor -- start 2023-11-04T01:42:40.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1e013d1640 1 -- start start 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1e013d1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1dfc165f90 0x7f1dfc168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1e013d1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc160cb0 con 0x7f1dfc0b26c0 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1e013d1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc06c390 con 0x7f1dfc06b580 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1e013d1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc160f50 con 0x7f1dfc165f90 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfaffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1dfc0b26c0 0x7f1dfc0b2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57154/0 (socket says 172.21.15.40:57154) 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfaffd640 1 -- 172.21.15.40:0/3379702077 learned_addr learned my addr 172.21.15.40:0/3379702077 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306217823 0 0) 0x7f1dfc160cb0 con 0x7f1dfc0b26c0 2023-11-04T01:42:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfb7fe640 1 --2- 172.21.15.40:0/3379702077 >> v2:172.21.15.91:3300/0 conn(0x7f1dfc165f90 0x7f1dfc168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de4003530 con 0x7f1dfc0b26c0 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461961029 0 0) 0x7f1de4003530 con 0x7f1dfc0b26c0 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 >> v2:172.21.15.91:3300/0 conn(0x7f1dfc165f90 msgr2=0x7f1dfc168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 --2- 172.21.15.40:0/3379702077 >> v2:172.21.15.91:3300/0 conn(0x7f1dfc165f90 0x7f1dfc168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 >> v1:172.21.15.91:6789/0 conn(0x7f1dfc06b580 legacy=0x7f1dfc06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc161230 con 0x7f1dfc0b26c0 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1dec001800 con 0x7f1dfc0b26c0 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 >> v1:172.21.15.40:6789/0 conn(0x7f1dfc0b26c0 legacy=0x7f1dfc0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1de4003980 0x7f1de4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1de40047d0 0x7f1de4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de4005190 0x7f1de400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc160f50 con 0x7f1de40047d0 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de400c030 con 0x7f1de4005190 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de400c1f0 con 0x7f1de4003980 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1de40047d0 0x7f1de4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfaffd640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1de4003980 0x7f1de4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfb7fe640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de4005190 0x7f1de400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1de4003980 msgr2=0x7f1de4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1de4003980 0x7f1de4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de4005190 msgr2=0x7f1de400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de4005190 0x7f1de400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/3379702077 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4003530 con 0x7f1de40047d0 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfb7fe640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de4005190 0x7f1de400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:40.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.350+0000 7f1dfb7fe640 1 -- 172.21.15.40:0/3379702077 reap_dead start 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1de40047d0 0x7f1de4004c50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1df0001780 tx=0x7f1df001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b62e91407dcf986 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00052d0 con 0x7f1de40047d0 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df00a7050 con 0x7f1de40047d0 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1df9ffb640 1 -- 172.21.15.40:0/3379702077 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0003600 con 0x7f1de40047d0 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- 172.21.15.40:0/3379702077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1de40047d0 msgr2=0x7f1de4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1de40047d0 0x7f1de4004c50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1df0001780 tx=0x7f1df001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- 172.21.15.40:0/3379702077 shutdown_connections 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 --2- 172.21.15.40:0/3379702077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1de40047d0 0x7f1de4004c50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- 172.21.15.40:0/3379702077 >> 172.21.15.40:0/3379702077 conn(0x7f1dfc09a030 msgr2=0x7f1dfc0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- 172.21.15.40:0/3379702077 shutdown_connections 2023-11-04T01:42:40.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- 172.21.15.40:0/3379702077 wait complete. 2023-11-04T01:42:40.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 Processor -- start 2023-11-04T01:42:40.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- start start 2023-11-04T01:42:40.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de40047d0 0x7f1dfc15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 0x7f1dfc06e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1dfc158d10 0x7f1dfc159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc06f130 con 0x7f1dfc1561b0 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1596d0 con 0x7f1de40047d0 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1e013d1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc0c56d0 con 0x7f1dfc158d10 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 0x7f1dfc06e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.354+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 0x7f1dfc06e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43058/0 (socket says 172.21.15.40:43058) 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/1820962765 learned_addr learned my addr 172.21.15.40:0/1820962765 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfb7fe640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1dfc158d10 0x7f1dfc159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfaffd640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de40047d0 0x7f1dfc15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1dfc158d10 msgr2=0x7f1dfc159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1dfc158d10 0x7f1dfc159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de40047d0 msgr2=0x7f1dfc15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de40047d0 0x7f1dfc15bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 -- 172.21.15.40:0/1820962765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc06e610 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfa7fc640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 0x7f1dfc06e0d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1df0005040 tx=0x7f1de4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0003e40 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0007030 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc0c53a0 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00073e0 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc06eb70 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc0744a0 con 0x7f1dfc1561b0 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1df0007540 con 0x7f1dfc1561b0 2023-11-04T01:42:40.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1de37fe640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1de80664d0 0x7f1de8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f1df011e2d0 con 0x7f1dfc1561b0 2023-11-04T01:42:40.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfaffd640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1de80664d0 0x7f1de8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.358+0000 7f1dfaffd640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1de80664d0 0x7f1de8068990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001ec0 tx=0x7f1dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.362+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1df00eb680 con 0x7f1dfc1561b0 2023-11-04T01:42:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.510+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f1dfc0c5810 con 0x7f1dfc1561b0 2023-11-04T01:42:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.510+0000 7f1de37fe640 1 -- 172.21.15.40:0/1820962765 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v75) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1df00eeca0 con 0x7f1dfc1561b0 2023-11-04T01:42:40.516 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:40.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1de80664d0 msgr2=0x7f1de8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1de80664d0 0x7f1de8068990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001ec0 tx=0x7f1dec009040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 msgr2=0x7f1dfc06e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 0x7f1dfc06e0d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1df0005040 tx=0x7f1de4005800 comp rx=0 tx=0).stop 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 shutdown_connections 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1de80664d0 0x7f1de8068990 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1dfc158d10 0x7f1dfc159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dfc1561b0 0x7f1dfc06e0d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 --2- 172.21.15.40:0/1820962765 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1de40047d0 0x7f1dfc15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 >> 172.21.15.40:0/1820962765 conn(0x7f1dfc09a030 msgr2=0x7f1dfc0d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 shutdown_connections 2023-11-04T01:42:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.514+0000 7f1e013d1640 1 -- 172.21.15.40:0/1820962765 wait complete. 2023-11-04T01:42:40.534 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:42:40.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f463d556640 1 Processor -- start 2023-11-04T01:42:40.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f463d556640 1 -- start start 2023-11-04T01:42:40.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f463d556640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f46380715d0 0x7f46380b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f463d556640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380c2670 con 0x7f46380b0b70 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f463d556640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463806bc30 con 0x7f463815afd0 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f463d556640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4638070140 con 0x7f46380715d0 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46380b0b70 0x7f463815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57164/0 (socket says 172.21.15.40:57164) 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 -- 172.21.15.40:0/1776073398 learned_addr learned my addr 172.21.15.40:0/1776073398 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46367fc640 1 --2- 172.21.15.40:0/1776073398 >> v2:172.21.15.91:3300/0 conn(0x7f46380715d0 0x7f46380b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649421126 0 0) 0x7f46380c2670 con 0x7f46380b0b70 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4624003530 con 0x7f46380b0b70 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245733053 0 0) 0x7f4624003530 con 0x7f46380b0b70 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 >> v2:172.21.15.91:3300/0 conn(0x7f46380715d0 msgr2=0x7f46380b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 --2- 172.21.15.40:0/1776073398 >> v2:172.21.15.91:3300/0 conn(0x7f46380715d0 0x7f46380b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 >> v1:172.21.15.91:6789/0 conn(0x7f463815afd0 legacy=0x7f463806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463806bf10 con 0x7f46380b0b70 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f4630001a00 con 0x7f46380b0b70 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 >> v1:172.21.15.40:6789/0 conn(0x7f46380b0b70 legacy=0x7f463815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624003980 0x7f4624003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46240047d0 0x7f4624004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4624005190 0x7f462400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638070140 con 0x7f4624005190 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462400c030 con 0x7f4624003980 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462400c1f0 con 0x7f46240047d0 2023-11-04T01:42:40.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4624005190 0x7f462400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46367fc640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46240047d0 0x7f4624004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f4636ffd640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624003980 0x7f4624003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 -- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46240047d0 msgr2=0x7f4624004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46240047d0 0x7f4624004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 -- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624003980 msgr2=0x7f4624003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624003980 0x7f4624003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.642+0000 7f46377fe640 1 -- 172.21.15.40:0/1776073398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624003530 con 0x7f4624005190 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 -- 172.21.15.40:0/1776073398 reap_dead start 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4624005190 0x7f462400b990 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f463000a820 tx=0x7f463001d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190539b26809606a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300072d0 con 0x7f4624005190 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46300a8070 con 0x7f4624005190 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f4635ffb640 1 -- 172.21.15.40:0/1776073398 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300076b0 con 0x7f4624005190 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- 172.21.15.40:0/1776073398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4624005190 msgr2=0x7f462400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4624005190 0x7f462400b990 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f463000a820 tx=0x7f463001d320 comp rx=0 tx=0).stop 2023-11-04T01:42:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- 172.21.15.40:0/1776073398 shutdown_connections 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 --2- 172.21.15.40:0/1776073398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4624005190 0x7f462400b990 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- 172.21.15.40:0/1776073398 >> 172.21.15.40:0/1776073398 conn(0x7f46380cebb0 msgr2=0x7f46380cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- 172.21.15.40:0/1776073398 shutdown_connections 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- 172.21.15.40:0/1776073398 wait complete. 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 Processor -- start 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- start start 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624005190 0x7f46380ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46380c8500 0x7f46380b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 0x7f4638150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638150640 con 0x7f463814fc50 2023-11-04T01:42:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c77f0 con 0x7f4624005190 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f463d556640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4638157910 con 0x7f46380c8500 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 0x7f4638150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 0x7f4638150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43080/0 (socket says 172.21.15.40:43080) 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 -- 172.21.15.40:0/1297478597 learned_addr learned my addr 172.21.15.40:0/1297478597 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46367fc640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46380c8500 0x7f46380b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f4636ffd640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624005190 0x7f46380ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 -- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46380c8500 msgr2=0x7f46380b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46380c8500 0x7f46380b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 -- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624005190 msgr2=0x7f46380ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624005190 0x7f46380ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f46377fe640 1 -- 172.21.15.40:0/1297478597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380ce6e0 con 0x7f463814fc50 2023-11-04T01:42:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.646+0000 7f4636ffd640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624005190 0x7f46380ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f46377fe640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 0x7f4638150100 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4630007040 tx=0x7f4624005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300019c0 con 0x7f463814fc50 2023-11-04T01:42:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4630007450 con 0x7f463814fc50 2023-11-04T01:42:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380c6040 con 0x7f463814fc50 2023-11-04T01:42:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630007800 con 0x7f463814fc50 2023-11-04T01:42:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46380c7d00 con 0x7f463814fc50 2023-11-04T01:42:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380744a0 con 0x7f463814fc50 2023-11-04T01:42:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f46300aa070 con 0x7f463814fc50 2023-11-04T01:42:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f462f7fe640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f46180664d0 0x7f4618068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f463011d700 con 0x7f463814fc50 2023-11-04T01:42:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f4636ffd640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f46180664d0 0x7f4618068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.650+0000 7f4636ffd640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f46180664d0 0x7f4618068990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f46380cade0 tx=0x7f4620009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.654+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46300eaa20 con 0x7f463814fc50 2023-11-04T01:42:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f463806cba0 con 0x7f463814fc50 2023-11-04T01:42:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f462f7fe640 1 -- 172.21.15.40:0/1297478597 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+287 (secure 0 0 0) 0x7f46300ee040 con 0x7f463814fc50 2023-11-04T01:42:40.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:40.811 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-11-04T01:42:40.811 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 6, 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "snap-test-pool" 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 11, 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "test_data_pool" 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:42:40.812 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 12, 2023-11-04T01:42:40.813 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:42:40.813 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:40.813 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f46180664d0 msgr2=0x7f4618068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f46180664d0 0x7f4618068990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f46380cade0 tx=0x7f4620009040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 msgr2=0x7f4638150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 0x7f4638150100 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f4630007040 tx=0x7f4624005800 comp rx=0 tx=0).stop 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 shutdown_connections 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f46180664d0 0x7f4618068990 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f463814fc50 0x7f4638150100 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f46380c8500 0x7f46380b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 --2- 172.21.15.40:0/1297478597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4624005190 0x7f46380ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 >> 172.21.15.40:0/1297478597 conn(0x7f46380cebb0 msgr2=0x7f46380ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 shutdown_connections 2023-11-04T01:42:40.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.806+0000 7f463d556640 1 -- 172.21.15.40:0/1297478597 wait complete. 2023-11-04T01:42:40.829 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:42:40.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:42:40.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 Processor -- start 2023-11-04T01:42:40.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 -- start start 2023-11-04T01:42:40.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fcca415ce30 0x7fcca40ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca41614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcca40cb440 0x7fcca40cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca4161010 con 0x7fcca40cb440 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40cbdf0 con 0x7fcca415ce30 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca93b4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40cd340 con 0x7fcca40cc630 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcca40cb440 0x7fcca40cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcca40cb440 0x7fcca40cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43094/0 (socket says 172.21.15.40:43094) 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 -- 172.21.15.40:0/2970740899 learned_addr learned my addr 172.21.15.40:0/2970740899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca2ffd640 1 --2- 172.21.15.40:0/2970740899 >> v2:172.21.15.91:3300/0 conn(0x7fcca415ce30 0x7fcca40ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca27fc640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca41614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 -- 172.21.15.40:0/2970740899 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 msgr2=0x7fcca41614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca41614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 -- 172.21.15.40:0/2970740899 >> v2:172.21.15.91:3300/0 conn(0x7fcca415ce30 msgr2=0x7fcca40ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 --2- 172.21.15.40:0/2970740899 >> v2:172.21.15.91:3300/0 conn(0x7fcca415ce30 0x7fcca40ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca37fe640 1 -- 172.21.15.40:0/2970740899 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40ccd80 con 0x7fcca40cb440 2023-11-04T01:42:40.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.954+0000 7fcca27fc640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca41614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:40.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca37fe640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca40cb8b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fcca406b1f0 tx=0x7fcc9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63087361f37ff9c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca1ffb640 1 -- 172.21.15.40:0/2970740899 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0aa5f0 con 0x7fcca40cb440 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca1ffb640 1 -- 172.21.15.40:0/2970740899 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0aa750 con 0x7fcca40cb440 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca1ffb640 1 -- 172.21.15.40:0/2970740899 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0aaae0 con 0x7fcca40cb440 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 -- 172.21.15.40:0/2970740899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 msgr2=0x7fcca40cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca40cb8b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fcca406b1f0 tx=0x7fcc9c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 -- 172.21.15.40:0/2970740899 shutdown_connections 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca40cb8b0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 --2- 172.21.15.40:0/2970740899 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca41614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 --2- 172.21.15.40:0/2970740899 >> v2:172.21.15.91:3300/0 conn(0x7fcca415ce30 0x7fcca40ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 -- 172.21.15.40:0/2970740899 >> 172.21.15.40:0/2970740899 conn(0x7fcca40b0630 msgr2=0x7fcca40b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 -- 172.21.15.40:0/2970740899 shutdown_connections 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.958+0000 7fcca93b4640 1 -- 172.21.15.40:0/2970740899 wait complete. 2023-11-04T01:42:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 Processor -- start 2023-11-04T01:42:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- start start 2023-11-04T01:42:40.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcca415ce30 0x7fcca4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4157190 con 0x7fcca40cb440 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415ab70 con 0x7fcca415ce30 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415ae50 con 0x7fcca40cc630 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca415b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43098/0 (socket says 172.21.15.40:43098) 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 -- 172.21.15.40:0/1745427112 learned_addr learned my addr 172.21.15.40:0/1745427112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca27fc640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca37fe640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcca415ce30 0x7fcca4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 -- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 msgr2=0x7fcca414cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca414cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 -- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcca415ce30 msgr2=0x7fcca4153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcca415ce30 0x7fcca4153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 -- 172.21.15.40:0/1745427112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0094d0 con 0x7fcca40cb440 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca2ffd640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca415b930 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e870 tx=0x7fcc9400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94009510 con 0x7fcca40cb440 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400eec0 con 0x7fcca40cb440 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400cb40 con 0x7fcca40cb440 2023-11-04T01:42:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca415b130 con 0x7fcca40cb440 2023-11-04T01:42:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca414d250 con 0x7fcca40cb440 2023-11-04T01:42:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca40744a0 con 0x7fcca40cb440 2023-11-04T01:42:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.962+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc9400ccc0 con 0x7fcca40cb440 2023-11-04T01:42:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.966+0000 7fcc9b7fe640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc840664a0 0x7fcc84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.966+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fcc94084030 con 0x7fcca40cb440 2023-11-04T01:42:40.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.966+0000 7fcca27fc640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc840664a0 0x7fcc84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.966+0000 7fcca27fc640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc840664a0 0x7fcc84068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcca4159600 tx=0x7fcc8c0039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:40.970+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc940513e0 con 0x7fcca40cb440 2023-11-04T01:42:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.118+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcca40ae000 con 0x7fcca40cb440 2023-11-04T01:42:41.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.622+0000 7fcc9b7fe640 1 -- 172.21.15.40:0/1745427112 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcc94054a00 con 0x7fcca40cb440 2023-11-04T01:42:41.628 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-11-04T01:42:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc840664a0 msgr2=0x7fcc84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc840664a0 0x7fcc84068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcca4159600 tx=0x7fcc8c0039a0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 msgr2=0x7fcca415b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca415b930 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e870 tx=0x7fcc9400ec70 comp rx=0 tx=0).stop 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 shutdown_connections 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fcc840664a0 0x7fcc84068960 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcca415ce30 0x7fcca4153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcca40cc630 0x7fcca414cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 --2- 172.21.15.40:0/1745427112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca40cb440 0x7fcca415b930 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 >> 172.21.15.40:0/1745427112 conn(0x7fcca40b0630 msgr2=0x7fcca40c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 shutdown_connections 2023-11-04T01:42:41.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.626+0000 7fcca93b4640 1 -- 172.21.15.40:0/1745427112 wait complete. 2023-11-04T01:42:41.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:42:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 Processor -- start 2023-11-04T01:42:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 -- start start 2023-11-04T01:42:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9048159f90 0x7f90480cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90480ce4c0 0x7f90480b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90480714c0 con 0x7f90480b0a20 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90480b0eb0 con 0x7f90480ce4c0 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f904f1d4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480711e0 con 0x7f9048159f90 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f9047fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90480ce4c0 0x7f90480b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f9047fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90480ce4c0 0x7f90480b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43114/0 (socket says 172.21.15.40:43114) 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.786+0000 7f9047fff640 1 -- 172.21.15.40:0/809228288 learned_addr learned my addr 172.21.15.40:0/809228288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904cf70640 1 --2- 172.21.15.40:0/809228288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9048159f90 0x7f90480cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f9047fff640 1 -- 172.21.15.40:0/809228288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9048159f90 msgr2=0x7f90480cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f9047fff640 1 --2- 172.21.15.40:0/809228288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9048159f90 0x7f90480cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f9047fff640 1 -- 172.21.15.40:0/809228288 >> v1:172.21.15.40:6789/0 conn(0x7f90480b0a20 legacy=0x7f90480c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f9047fff640 1 -- 172.21.15.40:0/809228288 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480cd4a0 con 0x7f90480ce4c0 2023-11-04T01:42:41.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f9047fff640 1 --2- 172.21.15.40:0/809228288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480ce4c0 0x7f90480b04e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f903c009870 tx=0x7f903c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c05fcdc6a595a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f90477fe640 1 -- 172.21.15.40:0/809228288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0ab680 con 0x7f90480ce4c0 2023-11-04T01:42:41.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f90477fe640 1 -- 172.21.15.40:0/809228288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c0ab7e0 con 0x7f90480ce4c0 2023-11-04T01:42:41.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f90477fe640 1 -- 172.21.15.40:0/809228288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0abb70 con 0x7f90480ce4c0 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 -- 172.21.15.40:0/809228288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480ce4c0 msgr2=0x7f90480b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 --2- 172.21.15.40:0/809228288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480ce4c0 0x7f90480b04e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f903c009870 tx=0x7f903c01c480 comp rx=0 tx=0).stop 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 -- 172.21.15.40:0/809228288 shutdown_connections 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 --2- 172.21.15.40:0/809228288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90480ce4c0 0x7f90480b04e0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 --2- 172.21.15.40:0/809228288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9048159f90 0x7f90480cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 -- 172.21.15.40:0/809228288 >> 172.21.15.40:0/809228288 conn(0x7f90480ce9e0 msgr2=0x7f90480cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 -- 172.21.15.40:0/809228288 shutdown_connections 2023-11-04T01:42:41.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.790+0000 7f904f1d4640 1 -- 172.21.15.40:0/809228288 wait complete. 2023-11-04T01:42:41.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 Processor -- start 2023-11-04T01:42:41.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 -- start start 2023-11-04T01:42:41.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90480b0a20 0x7f9048151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ce4c0 0x7f904815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 0x7f904815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9048151560 con 0x7f9048159f90 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904815c8c0 con 0x7f90480ce4c0 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904815cba0 con 0x7f90480b0a20 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 0x7f904815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 0x7f904815c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43130/0 (socket says 172.21.15.40:43130) 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 -- 172.21.15.40:0/1514192079 learned_addr learned my addr 172.21.15.40:0/1514192079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904cf70640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90480b0a20 0x7f9048151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f9047fff640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ce4c0 0x7f904815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 -- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90480b0a20 msgr2=0x7f9048151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90480b0a20 0x7f9048151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 -- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ce4c0 msgr2=0x7f904815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ce4c0 0x7f904815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 -- 172.21.15.40:0/1514192079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0094d0 con 0x7f9048159f90 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f9047fff640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ce4c0 0x7f904815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904cf70640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90480b0a20 0x7f9048151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904d771640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 0x7f904815c280 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f904000c730 tx=0x7f904000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040003b80 con 0x7f9048159f90 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040003ce0 con 0x7f9048159f90 2023-11-04T01:42:41.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904000aa30 con 0x7f9048159f90 2023-11-04T01:42:41.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904815ce80 con 0x7f9048159f90 2023-11-04T01:42:41.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.794+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90480c5ac0 con 0x7f9048159f90 2023-11-04T01:42:41.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.798+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90480c5cb0 con 0x7f9048159f90 2023-11-04T01:42:41.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.798+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f904000ab90 con 0x7f9048159f90 2023-11-04T01:42:41.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.798+0000 7f90457fa640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90340664a0 0x7f9034068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.798+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6290+0+0 (secure 0 0 0) 0x7f9040083e70 con 0x7f9048159f90 2023-11-04T01:42:41.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.798+0000 7f904cf70640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90340664a0 0x7f9034068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.798+0000 7f904cf70640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90340664a0 0x7f9034068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9038009840 tx=0x7f9038008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.802+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90400510a0 con 0x7f9048159f90 2023-11-04T01:42:41.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:41.962+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f90480744a0 con 0x7f9048159f90 2023-11-04T01:42:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.626+0000 7f90457fa640 1 -- 172.21.15.40:0/1514192079 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f90400546c0 con 0x7f9048159f90 2023-11-04T01:42:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90340664a0 msgr2=0x7f9034068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90340664a0 0x7f9034068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9038009840 tx=0x7f9038008040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 msgr2=0x7f904815c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 0x7f904815c280 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f904000c730 tx=0x7f904000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 shutdown_connections 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90340664a0 0x7f9034068960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9048159f90 0x7f904815c280 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90480ce4c0 0x7f904815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 --2- 172.21.15.40:0/1514192079 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90480b0a20 0x7f9048151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 >> 172.21.15.40:0/1514192079 conn(0x7f90480ce9e0 msgr2=0x7f904806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 shutdown_connections 2023-11-04T01:42:42.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.630+0000 7f904f1d4640 1 -- 172.21.15.40:0/1514192079 wait complete. 2023-11-04T01:42:42.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.798+0000 7fce1e09a640 1 Processor -- start 2023-11-04T01:42:42.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.798+0000 7fce1e09a640 1 -- start start 2023-11-04T01:42:42.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce1e09a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fce1815acb0 0x7fce1815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce1e09a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce1815c160 0x7fce180b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce1e09a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce180cb130 con 0x7fce180b0a50 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce1e09a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1815bd40 con 0x7fce1815c160 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce1e09a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1806fd80 con 0x7fce1815acb0 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce1815c160 0x7fce180b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce1815c160 0x7fce180b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43132/0 (socket says 172.21.15.40:43132) 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 -- 172.21.15.40:0/4219966550 learned_addr learned my addr 172.21.15.40:0/4219966550 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce17fff640 1 --1- 172.21.15.40:0/4219966550 >> v1:172.21.15.40:6789/0 conn(0x7fce180b0a50 0x7fce180ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57182/0 (socket says 172.21.15.40:57182) 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce177fe640 1 --2- 172.21.15.40:0/4219966550 >> v2:172.21.15.91:3300/0 conn(0x7fce1815acb0 0x7fce1815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 -- 172.21.15.40:0/4219966550 >> v2:172.21.15.91:3300/0 conn(0x7fce1815acb0 msgr2=0x7fce1815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 --2- 172.21.15.40:0/4219966550 >> v2:172.21.15.91:3300/0 conn(0x7fce1815acb0 0x7fce1815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 -- 172.21.15.40:0/4219966550 >> v1:172.21.15.40:6789/0 conn(0x7fce180b0a50 legacy=0x7fce180ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 -- 172.21.15.40:0/4219966550 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1815b680 con 0x7fce1815c160 2023-11-04T01:42:42.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce167fc640 1 -- 172.21.15.40:0/4219966550 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769986732 0 0) 0x7fce180cb130 con 0x7fce180b0a50 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce16ffd640 1 --2- 172.21.15.40:0/4219966550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815c160 0x7fce180b0510 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fce1806d550 tx=0x7fce0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3829fdac38f35646 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce167fc640 1 -- 172.21.15.40:0/4219966550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0ab610 con 0x7fce1815c160 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce167fc640 1 -- 172.21.15.40:0/4219966550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c0ab770 con 0x7fce1815c160 2023-11-04T01:42:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.802+0000 7fce167fc640 1 -- 172.21.15.40:0/4219966550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0abb00 con 0x7fce1815c160 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- 172.21.15.40:0/4219966550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815c160 msgr2=0x7fce180b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 --2- 172.21.15.40:0/4219966550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815c160 0x7fce180b0510 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fce1806d550 tx=0x7fce0c01c500 comp rx=0 tx=0).stop 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- 172.21.15.40:0/4219966550 shutdown_connections 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 --2- 172.21.15.40:0/4219966550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815c160 0x7fce180b0510 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 --2- 172.21.15.40:0/4219966550 >> v2:172.21.15.91:3300/0 conn(0x7fce1815acb0 0x7fce1815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- 172.21.15.40:0/4219966550 >> 172.21.15.40:0/4219966550 conn(0x7fce180cb510 msgr2=0x7fce180cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- 172.21.15.40:0/4219966550 shutdown_connections 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- 172.21.15.40:0/4219966550 wait complete. 2023-11-04T01:42:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 Processor -- start 2023-11-04T01:42:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- start start 2023-11-04T01:42:42.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce180b0a50 0x7fce1814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 0x7fce1815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce1815c160 0x7fce1814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180c8be0 con 0x7fce1815acb0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1815cb70 con 0x7fce180b0a50 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1814b7b0 con 0x7fce1815c160 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 0x7fce1815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 0x7fce1815c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43146/0 (socket says 172.21.15.40:43146) 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 -- 172.21.15.40:0/3002604828 learned_addr learned my addr 172.21.15.40:0/3002604828 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce177fe640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce180b0a50 0x7fce1814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce17fff640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce1815c160 0x7fce1814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 -- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce1815c160 msgr2=0x7fce1814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce1815c160 0x7fce1814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 -- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce180b0a50 msgr2=0x7fce1814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce180b0a50 0x7fce1814dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 -- 172.21.15.40:0/3002604828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0094d0 con 0x7fce1815acb0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce16ffd640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 0x7fce1815c630 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0ad040 tx=0x7fce0c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0b48c0 con 0x7fce1815acb0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c0b4a40 con 0x7fce1815acb0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1815cd80 con 0x7fce1815acb0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.806+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0b4df0 con 0x7fce1815acb0 2023-11-04T01:42:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1815d340 con 0x7fce1815acb0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce180744a0 con 0x7fce1815acb0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce0c0c8420 con 0x7fce1815acb0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fcdfffff640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce040664a0 0x7fce04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fce0c11ee90 con 0x7fce1815acb0 2023-11-04T01:42:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fce177fe640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce040664a0 0x7fce04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.810+0000 7fce177fe640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce040664a0 0x7fce04068960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce180c5b10 tx=0x7fce08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:42.814+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce0c0ebf50 con 0x7fce1815acb0 2023-11-04T01:42:43.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.006+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fce180cde30 con 0x7fce1815acb0 2023-11-04T01:42:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fcdfffff640 1 -- 172.21.15.40:0/3002604828 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7fce0c0ef570 con 0x7fce1815acb0 2023-11-04T01:42:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 13 and data pool 14 2023-11-04T01:42:43.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce040664a0 msgr2=0x7fce04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce040664a0 0x7fce04068960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce180c5b10 tx=0x7fce08008040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 msgr2=0x7fce1815c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 0x7fce1815c630 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0ad040 tx=0x7fce0c01ad40 comp rx=0 tx=0).stop 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 shutdown_connections 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce040664a0 0x7fce04068960 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce1815c160 0x7fce1814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce1815acb0 0x7fce1815c630 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 --2- 172.21.15.40:0/3002604828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce180b0a50 0x7fce1814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.918+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 >> 172.21.15.40:0/3002604828 conn(0x7fce180cb510 msgr2=0x7fce180afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.922+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 shutdown_connections 2023-11-04T01:42:43.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:43.922+0000 7fce1e09a640 1 -- 172.21.15.40:0/3002604828 wait complete. 2023-11-04T01:42:43.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:44.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.070+0000 7f6311bcb640 1 Processor -- start 2023-11-04T01:42:44.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.070+0000 7f6311bcb640 1 -- start start 2023-11-04T01:42:44.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.070+0000 7f6311bcb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.070+0000 7f6311bcb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f630c0d0ae0 0x7f630c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.070+0000 7f6311bcb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c0b6070 con 0x7f630c0b4990 2023-11-04T01:42:44.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0b8ed0 con 0x7f630c0d0ae0 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0d1ce0 con 0x7f630c0d0690 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f630c0d0ae0 0x7f630c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f630c0d0ae0 0x7f630c0b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43156/0 (socket says 172.21.15.40:43156) 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 -- 172.21.15.40:0/2602671767 learned_addr learned my addr 172.21.15.40:0/2602671767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630affd640 1 --2- 172.21.15.40:0/2602671767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 -- 172.21.15.40:0/2602671767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 msgr2=0x7f630c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 --2- 172.21.15.40:0/2602671767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 -- 172.21.15.40:0/2602671767 >> v1:172.21.15.91:6789/0 conn(0x7f630c0b4990 legacy=0x7f630c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 -- 172.21.15.40:0/2602671767 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0d1fc0 con 0x7f630c0d0ae0 2023-11-04T01:42:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630bfff640 1 --2- 172.21.15.40:0/2602671767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b6a20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6304009e50 tx=0x7f630401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ae597a5230fac8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630a7fc640 1 -- 172.21.15.40:0/2602671767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040af400 con 0x7f630c0d0ae0 2023-11-04T01:42:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630a7fc640 1 -- 172.21.15.40:0/2602671767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63040ab050 con 0x7f630c0d0ae0 2023-11-04T01:42:44.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f630a7fc640 1 -- 172.21.15.40:0/2602671767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040af780 con 0x7f630c0d0ae0 2023-11-04T01:42:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- 172.21.15.40:0/2602671767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 msgr2=0x7f630c0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 --2- 172.21.15.40:0/2602671767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b6a20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6304009e50 tx=0x7f630401f1c0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- 172.21.15.40:0/2602671767 shutdown_connections 2023-11-04T01:42:44.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 --2- 172.21.15.40:0/2602671767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b6a20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 --2- 172.21.15.40:0/2602671767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- 172.21.15.40:0/2602671767 >> 172.21.15.40:0/2602671767 conn(0x7f630c0cf990 msgr2=0x7f630c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- 172.21.15.40:0/2602671767 shutdown_connections 2023-11-04T01:42:44.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.074+0000 7f6311bcb640 1 -- 172.21.15.40:0/2602671767 wait complete. 2023-11-04T01:42:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 Processor -- start 2023-11-04T01:42:44.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 -- start start 2023-11-04T01:42:44.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f630c0b4990 0x7f630c151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0aa360 con 0x7f630c0d0ae0 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0a9a30 con 0x7f630c0b4990 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0a9d10 con 0x7f630c0d0690 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43164/0 (socket says 172.21.15.40:43164) 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 -- 172.21.15.40:0/1632716584 learned_addr learned my addr 172.21.15.40:0/1632716584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:44.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630b7fe640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f630c0b4990 0x7f630c151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630affd640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 -- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 msgr2=0x7f630c0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 -- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f630c0b4990 msgr2=0x7f630c151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f630c0b4990 0x7f630c151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 -- 172.21.15.40:0/1632716584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009b30 con 0x7f630c0d0ae0 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630b7fe640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f630c0b4990 0x7f630c151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f630bfff640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b3350 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f630401d870 tx=0x7f630401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040afde0 con 0x7f630c0d0ae0 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6304009510 con 0x7f630c0d0ae0 2023-11-04T01:42:44.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040b8640 con 0x7f630c0d0ae0 2023-11-04T01:42:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c0a9ff0 con 0x7f630c0d0ae0 2023-11-04T01:42:44.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.078+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c151790 con 0x7f630c0d0ae0 2023-11-04T01:42:44.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.082+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c0744a0 con 0x7f630c0d0ae0 2023-11-04T01:42:44.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.082+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63040b6040 con 0x7f630c0d0ae0 2023-11-04T01:42:44.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.082+0000 7f62f3fff640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62f80664a0 0x7f62f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.082+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f6304122d50 con 0x7f630c0d0ae0 2023-11-04T01:42:44.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.082+0000 7f630b7fe640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62f80664a0 0x7f62f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.082+0000 7f630b7fe640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62f80664a0 0x7f62f8068960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0098b0 tx=0x7f62fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.086+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63040efe10 con 0x7f630c0d0ae0 2023-11-04T01:42:44.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.246+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f630c0d3500 con 0x7f630c0d0ae0 2023-11-04T01:42:44.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f62f3fff640 1 -- 172.21.15.40:0/1632716584 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+21709 (secure 0 0 0) 0x7f63040b4090 con 0x7f630c0d0ae0 2023-11-04T01:42:44.254 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":78,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:43.011431+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62f80664a0 msgr2=0x7f62f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62f80664a0 0x7f62f8068960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0098b0 tx=0x7f62fc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:44.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 msgr2=0x7f630c0b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b3350 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f630401d870 tx=0x7f630401bf60 comp rx=0 tx=0).stop 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 shutdown_connections 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f62f80664a0 0x7f62f8068960 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630c0d0ae0 0x7f630c0b3350 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f630c0d0690 0x7f630c0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 --2- 172.21.15.40:0/1632716584 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f630c0b4990 0x7f630c151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 >> 172.21.15.40:0/1632716584 conn(0x7f630c0cf990 msgr2=0x7f630c0d3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 shutdown_connections 2023-11-04T01:42:44.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.250+0000 7f6311bcb640 1 -- 172.21.15.40:0/1632716584 wait complete. 2023-11-04T01:42:44.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.386+0000 7f769aafb640 1 Processor -- start 2023-11-04T01:42:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.386+0000 7f769aafb640 1 -- start start 2023-11-04T01:42:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f769aafb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f769415afd0 0x7f76940715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f769aafb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f769406f8f0 0x7f76940b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f769aafb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76940c2670 con 0x7f76940b0b70 2023-11-04T01:42:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f769aafb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7694070140 con 0x7f769406f8f0 2023-11-04T01:42:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f769aafb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769415fc90 con 0x7f769415afd0 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7699098640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f76940b0b70 0x7f76940c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57190/0 (socket says 172.21.15.40:57190) 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7699098640 1 -- 172.21.15.40:0/1393015412 learned_addr learned my addr 172.21.15.40:0/1393015412 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7693fff640 1 --2- 172.21.15.40:0/1393015412 >> v2:172.21.15.40:3300/0 conn(0x7f769406f8f0 0x7f76940b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7698897640 1 --2- 172.21.15.40:0/1393015412 >> v2:172.21.15.91:3300/0 conn(0x7f769415afd0 0x7f76940715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f76937fe640 1 -- 172.21.15.40:0/1393015412 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856062320 0 0) 0x7f76940c2670 con 0x7f76940b0b70 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f76937fe640 1 -- 172.21.15.40:0/1393015412 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7680003530 con 0x7f76940b0b70 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7693fff640 1 -- 172.21.15.40:0/1393015412 >> v2:172.21.15.91:3300/0 conn(0x7f769415afd0 msgr2=0x7f76940715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7693fff640 1 --2- 172.21.15.40:0/1393015412 >> v2:172.21.15.91:3300/0 conn(0x7f769415afd0 0x7f76940715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7693fff640 1 -- 172.21.15.40:0/1393015412 >> v1:172.21.15.40:6789/0 conn(0x7f76940b0b70 legacy=0x7f76940c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7693fff640 1 -- 172.21.15.40:0/1393015412 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769406bc30 con 0x7f769406f8f0 2023-11-04T01:42:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7698897640 1 --2- 172.21.15.40:0/1393015412 >> v2:172.21.15.91:3300/0 conn(0x7f769415afd0 0x7f76940715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f7693fff640 1 --2- 172.21.15.40:0/1393015412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940b0630 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f76940ce980 tx=0x7f767c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7426640d3884f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f76937fe640 1 -- 172.21.15.40:0/1393015412 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0ab600 con 0x7f769406f8f0 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f76937fe640 1 -- 172.21.15.40:0/1393015412 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c0a7050 con 0x7f769406f8f0 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.390+0000 7f76937fe640 1 -- 172.21.15.40:0/1393015412 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0ab980 con 0x7f769406f8f0 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1393015412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 msgr2=0x7f76940b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 --2- 172.21.15.40:0/1393015412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940b0630 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f76940ce980 tx=0x7f767c01c460 comp rx=0 tx=0).stop 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1393015412 shutdown_connections 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 --2- 172.21.15.40:0/1393015412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940b0630 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 --2- 172.21.15.40:0/1393015412 >> v2:172.21.15.91:3300/0 conn(0x7f769415afd0 0x7f76940715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1393015412 >> 172.21.15.40:0/1393015412 conn(0x7f76940cebb0 msgr2=0x7f76940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1393015412 shutdown_connections 2023-11-04T01:42:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1393015412 wait complete. 2023-11-04T01:42:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 Processor -- start 2023-11-04T01:42:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- start start 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76940b0b70 0x7f76941533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f769415afd0 0x7f7694153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940c79a0 con 0x7f769406f8f0 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694153e40 con 0x7f769415afd0 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76940c6d60 con 0x7f76940b0b70 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43170/0 (socket says 172.21.15.40:43170) 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 -- 172.21.15.40:0/1397697763 learned_addr learned my addr 172.21.15.40:0/1397697763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7693fff640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76940b0b70 0x7f76941533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 -- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76940b0b70 msgr2=0x7f76941533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76940b0b70 0x7f76941533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7699098640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f769415afd0 0x7f7694153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 -- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f769415afd0 msgr2=0x7f7694153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f769415afd0 0x7f7694153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 -- 172.21.15.40:0/1397697763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c009420 con 0x7f769406f8f0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f7698897640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940c8260 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f768400e810 tx=0x7f768400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400c8d0 con 0x7f769406f8f0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768400ca30 con 0x7f769406f8f0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76940c7000 con 0x7f769406f8f0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400cdc0 con 0x7f769406f8f0 2023-11-04T01:42:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.394+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76940c75c0 con 0x7f769406f8f0 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.398+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76940744a0 con 0x7f769406f8f0 2023-11-04T01:42:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.398+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7684013410 con 0x7f769406f8f0 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.398+0000 7f76917fa640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76740664d0 0x7f7674068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.398+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f7684084010 con 0x7f769406f8f0 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.398+0000 7f7693fff640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76740664d0 0x7f7674068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.398+0000 7f7693fff640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76740664d0 0x7f7674068990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f767c0ad000 tx=0x7f767c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.402+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7684051060 con 0x7f769406f8f0 2023-11-04T01:42:44.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.558+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f769406cba0 con 0x7f769406f8f0 2023-11-04T01:42:44.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f76917fa640 1 -- 172.21.15.40:0/1397697763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+21709 (secure 0 0 0) 0x7f7684009480 con 0x7f769406f8f0 2023-11-04T01:42:44.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:44.567 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":78,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:43.011431+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:44.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76740664d0 msgr2=0x7f7674068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76740664d0 0x7f7674068990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f767c0ad000 tx=0x7f767c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:44.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 msgr2=0x7f76940c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940c8260 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f768400e810 tx=0x7f768400ecd0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 shutdown_connections 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f76740664d0 0x7f7674068990 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f769415afd0 0x7f7694153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f76940b0b70 0x7f76941533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 --2- 172.21.15.40:0/1397697763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769406f8f0 0x7f76940c8260 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 >> 172.21.15.40:0/1397697763 conn(0x7f76940cebb0 msgr2=0x7f76940ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 shutdown_connections 2023-11-04T01:42:44.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.562+0000 7f769aafb640 1 -- 172.21.15.40:0/1397697763 wait complete. 2023-11-04T01:42:44.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:42:44.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.714+0000 7f18f724f640 1 Processor -- start 2023-11-04T01:42:44.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.714+0000 7f18f724f640 1 -- start start 2023-11-04T01:42:44.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f18f015acb0 0x7f18f015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18f00b0c20 0x7f18f00ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f00cb130 con 0x7f18f015c160 2023-11-04T01:42:44.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f015bd40 con 0x7f18f00b0c20 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f006fd80 con 0x7f18f015acb0 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f57ec640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18f00b0c20 0x7f18f00ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18effff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f18f015c160 0x7f18f00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57194/0 (socket says 172.21.15.40:57194) 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18effff640 1 -- 172.21.15.40:0/2486186448 learned_addr learned my addr 172.21.15.40:0/2486186448 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f4feb640 1 --2- 172.21.15.40:0/2486186448 >> v2:172.21.15.91:3300/0 conn(0x7f18f015acb0 0x7f18f015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f57ec640 1 -- 172.21.15.40:0/2486186448 >> v2:172.21.15.91:3300/0 conn(0x7f18f015acb0 msgr2=0x7f18f015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f57ec640 1 --2- 172.21.15.40:0/2486186448 >> v2:172.21.15.91:3300/0 conn(0x7f18f015acb0 0x7f18f015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f57ec640 1 -- 172.21.15.40:0/2486186448 >> v1:172.21.15.40:6789/0 conn(0x7f18f015c160 legacy=0x7f18f00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18ef7fe640 1 -- 172.21.15.40:0/2486186448 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153818485 0 0) 0x7f18f00cb130 con 0x7f18f015c160 2023-11-04T01:42:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f57ec640 1 -- 172.21.15.40:0/2486186448 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f015b680 con 0x7f18f00b0c20 2023-11-04T01:42:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f57ec640 1 --2- 172.21.15.40:0/2486186448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f00ca490 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097c0 tx=0x7f18e001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5492f8462788f395 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18ef7fe640 1 -- 172.21.15.40:0/2486186448 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00a7070 con 0x7f18f00b0c20 2023-11-04T01:42:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18ef7fe640 1 -- 172.21.15.40:0/2486186448 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00ab430 con 0x7f18f00b0c20 2023-11-04T01:42:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18ef7fe640 1 -- 172.21.15.40:0/2486186448 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00ab7c0 con 0x7f18f00b0c20 2023-11-04T01:42:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- 172.21.15.40:0/2486186448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 msgr2=0x7f18f00ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 --2- 172.21.15.40:0/2486186448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f00ca490 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097c0 tx=0x7f18e001c410 comp rx=0 tx=0).stop 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- 172.21.15.40:0/2486186448 shutdown_connections 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 --2- 172.21.15.40:0/2486186448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f00ca490 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 --2- 172.21.15.40:0/2486186448 >> v2:172.21.15.91:3300/0 conn(0x7f18f015acb0 0x7f18f015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- 172.21.15.40:0/2486186448 >> 172.21.15.40:0/2486186448 conn(0x7f18f00cb510 msgr2=0x7f18f00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- 172.21.15.40:0/2486186448 shutdown_connections 2023-11-04T01:42:44.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.718+0000 7f18f724f640 1 -- 172.21.15.40:0/2486186448 wait complete. 2023-11-04T01:42:44.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 Processor -- start 2023-11-04T01:42:44.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 -- start start 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f014aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f18f015acb0 0x7f18f01f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18f015c160 0x7f18f01f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00afee0 con 0x7f18f00b0c20 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00af310 con 0x7f18f015c160 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00af5b0 con 0x7f18f015acb0 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f014aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f014aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43202/0 (socket says 172.21.15.40:43202) 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 -- 172.21.15.40:0/1645631063 learned_addr learned my addr 172.21.15.40:0/1645631063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f57ec640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18f015c160 0x7f18f01f98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18effff640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f18f015acb0 0x7f18f01f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 -- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f18f015acb0 msgr2=0x7f18f01f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f18f015acb0 0x7f18f01f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 -- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18f015c160 msgr2=0x7f18f01f98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18f015c160 0x7f18f01f98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 -- 172.21.15.40:0/1645631063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0009420 con 0x7f18f00b0c20 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f57ec640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18f015c160 0x7f18f01f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18effff640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f18f015acb0 0x7f18f01f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:44.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f4feb640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f014aac0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f18e8007ef0 tx=0x7f18e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8014620 con 0x7f18f00b0c20 2023-11-04T01:42:44.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8014780 con 0x7f18f00b0c20 2023-11-04T01:42:44.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f00af890 con 0x7f18f00b0c20 2023-11-04T01:42:44.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8014b30 con 0x7f18f00b0c20 2023-11-04T01:42:44.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.722+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f00b0370 con 0x7f18f00b0c20 2023-11-04T01:42:44.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.726+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f00b05f0 con 0x7f18f00b0c20 2023-11-04T01:42:44.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.726+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18e8014c90 con 0x7f18f00b0c20 2023-11-04T01:42:44.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.726+0000 7f18ed7fa640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f18dc0664a0 0x7f18dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.726+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f18e8084c00 con 0x7f18f00b0c20 2023-11-04T01:42:44.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.726+0000 7f18effff640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f18dc0664a0 0x7f18dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.726+0000 7f18effff640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f18dc0664a0 0x7f18dc068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f18f00c5b10 tx=0x7f18e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.730+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18e808b080 con 0x7f18f00b0c20 2023-11-04T01:42:44.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:44.918+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f18f00744a0 con 0x7f18f00b0c20 2023-11-04T01:42:45.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.926+0000 7f18ed7fa640 1 -- 172.21.15.40:0/1645631063 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f18e8051ce0 con 0x7f18f00b0c20 2023-11-04T01:42:45.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.930+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f18dc0664a0 msgr2=0x7f18dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.930+0000 7f18f724f640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f18dc0664a0 0x7f18dc068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f18f00c5b10 tx=0x7f18e4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:45.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.930+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 msgr2=0x7f18f014aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.930+0000 7f18f724f640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f014aac0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f18e8007ef0 tx=0x7f18e800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 shutdown_connections 2023-11-04T01:42:45.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f18dc0664a0 0x7f18dc068960 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f18f015c160 0x7f18f01f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f18f015acb0 0x7f18f01f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 --2- 172.21.15.40:0/1645631063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f00b0c20 0x7f18f014aac0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 >> 172.21.15.40:0/1645631063 conn(0x7f18f00cb510 msgr2=0x7f18f01553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 shutdown_connections 2023-11-04T01:42:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:45.934+0000 7f18f724f640 1 -- 172.21.15.40:0/1645631063 wait complete. 2023-11-04T01:42:45.960 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:42:45.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:42:46.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc876a58640 1 Processor -- start 2023-11-04T01:42:46.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc876a58640 1 -- start start 2023-11-04T01:42:46.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc876a58640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc870070270 0x7fc8700cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc876a58640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87006a290 con 0x7fc8700ca0a0 2023-11-04T01:42:46.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc876a58640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8700cbba0 con 0x7fc87015aff0 2023-11-04T01:42:46.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc876a58640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc870071e90 con 0x7fc870070270 2023-11-04T01:42:46.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc86f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc8700ca0a0 0x7fc87006a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57202/0 (socket says 172.21.15.40:57202) 2023-11-04T01:42:46.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc86f7fe640 1 -- 172.21.15.40:0/80427568 learned_addr learned my addr 172.21.15.40:0/80427568 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc874ff5640 1 --2- 172.21.15.40:0/80427568 >> v2:172.21.15.91:3300/0 conn(0x7fc870070270 0x7fc8700cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200542288 0 0) 0x7fc87006a290 con 0x7fc8700ca0a0 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.086+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc85c003530 con 0x7fc8700ca0a0 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1598486966 0 0) 0x7fc85c003530 con 0x7fc8700ca0a0 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 >> v2:172.21.15.91:3300/0 conn(0x7fc870070270 msgr2=0x7fc8700cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 --2- 172.21.15.40:0/80427568 >> v2:172.21.15.91:3300/0 conn(0x7fc870070270 0x7fc8700cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 >> v1:172.21.15.91:6789/0 conn(0x7fc87015aff0 legacy=0x7fc8700c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870072170 con 0x7fc8700ca0a0 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fc858001680 con 0x7fc8700ca0a0 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 >> v1:172.21.15.40:6789/0 conn(0x7fc8700ca0a0 legacy=0x7fc87006a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc85c003980 0x7fc85c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0047d0 0x7fc85c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c005190 0x7fc85c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc870071e90 con 0x7fc85c003980 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00c030 con 0x7fc85c0047d0 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00c1f0 con 0x7fc85c005190 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc85c003980 0x7fc85c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86f7fe640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0047d0 0x7fc85c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc874ff5640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c005190 0x7fc85c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 -- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c005190 msgr2=0x7fc85c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c005190 0x7fc85c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 -- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0047d0 msgr2=0x7fc85c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc85c0047d0 0x7fc85c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 -- 172.21.15.40:0/80427568 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c003530 con 0x7fc85c003980 2023-11-04T01:42:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc874ff5640 1 -- 172.21.15.40:0/80427568 reap_dead start 2023-11-04T01:42:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86ffff640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc85c003980 0x7fc85c003da0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc860001780 tx=0x7fc86001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba91e4f6966c5b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600052d0 con 0x7fc85c003980 2023-11-04T01:42:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8600a7050 con 0x7fc85c003980 2023-11-04T01:42:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc86effd640 1 -- 172.21.15.40:0/80427568 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860003600 con 0x7fc85c003980 2023-11-04T01:42:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 -- 172.21.15.40:0/80427568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc85c003980 msgr2=0x7fc85c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc85c003980 0x7fc85c003da0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc860001780 tx=0x7fc86001c3d0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 -- 172.21.15.40:0/80427568 shutdown_connections 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 --2- 172.21.15.40:0/80427568 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc85c003980 0x7fc85c003da0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 -- 172.21.15.40:0/80427568 >> 172.21.15.40:0/80427568 conn(0x7fc8700b0e30 msgr2=0x7fc8700b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 -- 172.21.15.40:0/80427568 shutdown_connections 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.090+0000 7fc876a58640 1 -- 172.21.15.40:0/80427568 wait complete. 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 Processor -- start 2023-11-04T01:42:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- start start 2023-11-04T01:42:46.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c003980 0x7fc8700c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 0x7fc8700c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8700c6410 0x7fc8700c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700c89b0 con 0x7fc8700c8010 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700c8ef0 con 0x7fc8700c6410 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700c70b0 con 0x7fc85c003980 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 0x7fc8700c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 0x7fc8700c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43214/0 (socket says 172.21.15.40:43214) 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 -- 172.21.15.40:0/3535236849 learned_addr learned my addr 172.21.15.40:0/3535236849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86ffff640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c003980 0x7fc8700c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc874ff5640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8700c6410 0x7fc8700c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 -- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c003980 msgr2=0x7fc8700c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c003980 0x7fc8700c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 -- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8700c6410 msgr2=0x7fc8700c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8700c6410 0x7fc8700c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 -- 172.21.15.40:0/3535236849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700c7390 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc874ff5640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8700c6410 0x7fc8700c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86f7fe640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 0x7fc8700c8470 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc85800e7b0 tx=0x7fc85800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800c6c0 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85800c820 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8700c7670 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800cbd0 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8700c6dd0 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.094+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87015b5e0 con 0x7fc8700c8010 2023-11-04T01:42:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.098+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc85800cd30 con 0x7fc8700c8010 2023-11-04T01:42:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.098+0000 7fc86cff9640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8500664a0 0x7fc850068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.098+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc8580840d0 con 0x7fc8700c8010 2023-11-04T01:42:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.098+0000 7fc86ffff640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8500664a0 0x7fc850068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.098+0000 7fc86ffff640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8500664a0 0x7fc850068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc860001750 tx=0x7fc8600011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.102+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc87015b5e0 con 0x7fc8700c8010 2023-11-04T01:42:46.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.282+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc87015b5e0 con 0x7fc8700c8010 2023-11-04T01:42:46.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.938+0000 7fc86cff9640 1 -- 172.21.15.40:0/3535236849 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc87015b5e0 con 0x7fc8700c8010 2023-11-04T01:42:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8500664a0 msgr2=0x7fc850068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8500664a0 0x7fc850068960 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc860001750 tx=0x7fc8600011a0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 msgr2=0x7fc8700c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 0x7fc8700c8470 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc85800e7b0 tx=0x7fc85800ec70 comp rx=0 tx=0).stop 2023-11-04T01:42:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 shutdown_connections 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc8500664a0 0x7fc850068960 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc8700c6410 0x7fc8700c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8700c8010 0x7fc8700c8470 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 --2- 172.21.15.40:0/3535236849 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc85c003980 0x7fc8700c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 >> 172.21.15.40:0/3535236849 conn(0x7fc8700b0e30 msgr2=0x7fc8701586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 shutdown_connections 2023-11-04T01:42:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:46.942+0000 7fc876a58640 1 -- 172.21.15.40:0/3535236849 wait complete. 2023-11-04T01:42:46.966 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:42:46.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:47.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 Processor -- start 2023-11-04T01:42:47.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 -- start start 2023-11-04T01:42:47.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec2c15afd0 0x7fec2c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fec2c0b0d40 0x7fec2c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0c2670 con 0x7fec2c06f8f0 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c070140 con 0x7fec2c15afd0 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec3121e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c06c9f0 con 0x7fec2c0b0d40 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec2c15afd0 0x7fec2c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec2c15afd0 0x7fec2c0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43230/0 (socket says 172.21.15.40:43230) 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 -- 172.21.15.40:0/1165801062 learned_addr learned my addr 172.21.15.40:0/1165801062 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2b59e640 1 --2- 172.21.15.40:0/1165801062 >> v2:172.21.15.91:3300/0 conn(0x7fec2c0b0d40 0x7fec2c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 -- 172.21.15.40:0/1165801062 >> v2:172.21.15.91:3300/0 conn(0x7fec2c0b0d40 msgr2=0x7fec2c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 --2- 172.21.15.40:0/1165801062 >> v2:172.21.15.91:3300/0 conn(0x7fec2c0b0d40 0x7fec2c15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 -- 172.21.15.40:0/1165801062 >> v1:172.21.15.91:6789/0 conn(0x7fec2c06f8f0 legacy=0x7fec2c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2ad9d640 1 -- 172.21.15.40:0/1165801062 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c06bc30 con 0x7fec2c15afd0 2023-11-04T01:42:47.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.082+0000 7fec2b59e640 1 --2- 172.21.15.40:0/1165801062 >> v2:172.21.15.91:3300/0 conn(0x7fec2c0b0d40 0x7fec2c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:47.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec2ad9d640 1 --2- 172.21.15.40:0/1165801062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c0715d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fec2c06f7b0 tx=0x7fec2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3af89d00446afc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec29d9b640 1 -- 172.21.15.40:0/1165801062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec200aa430 con 0x7fec2c15afd0 2023-11-04T01:42:47.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec29d9b640 1 -- 172.21.15.40:0/1165801062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec200aa590 con 0x7fec2c15afd0 2023-11-04T01:42:47.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec29d9b640 1 -- 172.21.15.40:0/1165801062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec200aa920 con 0x7fec2c15afd0 2023-11-04T01:42:47.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- 172.21.15.40:0/1165801062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 msgr2=0x7fec2c0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 --2- 172.21.15.40:0/1165801062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c0715d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fec2c06f7b0 tx=0x7fec2001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- 172.21.15.40:0/1165801062 shutdown_connections 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 --2- 172.21.15.40:0/1165801062 >> v2:172.21.15.91:3300/0 conn(0x7fec2c0b0d40 0x7fec2c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 --2- 172.21.15.40:0/1165801062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c0715d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- 172.21.15.40:0/1165801062 >> 172.21.15.40:0/1165801062 conn(0x7fec2c0cebb0 msgr2=0x7fec2c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- 172.21.15.40:0/1165801062 shutdown_connections 2023-11-04T01:42:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- 172.21.15.40:0/1165801062 wait complete. 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 Processor -- start 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- start start 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec2c06f8f0 0x7fec2c0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec2c0b0d40 0x7fec2c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c153750 con 0x7fec2c15afd0 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0c82f0 con 0x7fec2c06f8f0 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec3121e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0c76e0 con 0x7fec2c0b0d40 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec2b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec2b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43242/0 (socket says 172.21.15.40:43242) 2023-11-04T01:42:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.086+0000 7fec2b59e640 1 -- 172.21.15.40:0/3867630818 learned_addr learned my addr 172.21.15.40:0/3867630818 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2ad9d640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec2c06f8f0 0x7fec2c0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2a59c640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec2c0b0d40 0x7fec2c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2b59e640 1 -- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec2c0b0d40 msgr2=0x7fec2c1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2b59e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec2c0b0d40 0x7fec2c1596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2b59e640 1 -- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec2c06f8f0 msgr2=0x7fec2c0c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2b59e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec2c06f8f0 0x7fec2c0c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2b59e640 1 -- 172.21.15.40:0/3867630818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200094d0 con 0x7fec2c15afd0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2b59e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c153210 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fec24007e40 tx=0x7fec2400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24015600 con 0x7fec2c15afd0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2400f040 con 0x7fec2c15afd0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0c79c0 con 0x7fec2c15afd0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240159a0 con 0x7fec2c15afd0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0c7f80 con 0x7fec2c15afd0 2023-11-04T01:42:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c0b0590 con 0x7fec2c15afd0 2023-11-04T01:42:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec2401e3b0 con 0x7fec2c15afd0 2023-11-04T01:42:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec137fe640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec180664a0 0x7fec18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fec240845f0 con 0x7fec2c15afd0 2023-11-04T01:42:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2ad9d640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec180664a0 0x7fec18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.090+0000 7fec2ad9d640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec180664a0 0x7fec18068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fec200ae000 tx=0x7fec200a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.094+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec24051630 con 0x7fec2c15afd0 2023-11-04T01:42:47.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec2c0c8460 con 0x7fec2c15afd0 2023-11-04T01:42:47.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec137fe640 1 -- 172.21.15.40:0/3867630818 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fec24054c50 con 0x7fec2c15afd0 2023-11-04T01:42:47.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:47.284 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:43.012180+0000","modified":"2023-11-04T01:42:46.287619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6645},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6645":{"gid":6645,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/3469878458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3469878458},{"type":"v1","addr":"172.21.15.91:6837","nonce":3469878458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:42:47.284 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 37 2023-11-04T01:42:47.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec180664a0 msgr2=0x7fec18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec180664a0 0x7fec18068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fec200ae000 tx=0x7fec200a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 msgr2=0x7fec2c153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c153210 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fec24007e40 tx=0x7fec2400d4a0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 shutdown_connections 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec180664a0 0x7fec18068960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec2c15afd0 0x7fec2c153210 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec2c0b0d40 0x7fec2c1596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 --2- 172.21.15.40:0/3867630818 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec2c06f8f0 0x7fec2c0c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.278+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 >> 172.21.15.40:0/3867630818 conn(0x7fec2c0cebb0 msgr2=0x7fec2c0afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.282+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 shutdown_connections 2023-11-04T01:42:47.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.282+0000 7fec3121e640 1 -- 172.21.15.40:0/3867630818 wait complete. 2023-11-04T01:42:47.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:47.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 Processor -- start 2023-11-04T01:42:47.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 -- start start 2023-11-04T01:42:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c5c0b4990 0x7f7c5c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c5c0d0690 0x7f7c5c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0d0ae0 0x7f7c5c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0b6070 con 0x7f7c5c0b4990 2023-11-04T01:42:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0b8ed0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c62adf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0b52b0 con 0x7f7c5c0d0ae0 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c5c0b4990 0x7f7c5c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c5c0b4990 0x7f7c5c0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36258/0 (socket says 172.21.15.40:36258) 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 -- 172.21.15.40:0/3884055639 learned_addr learned my addr 172.21.15.40:0/3884055639 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6107c640 1 --2- 172.21.15.40:0/3884055639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0d0ae0 0x7f7c5c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c5bfff640 1 --2- 172.21.15.40:0/3884055639 >> v2:172.21.15.91:3300/0 conn(0x7f7c5c0d0690 0x7f7c5c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 -- 172.21.15.40:0/3884055639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0d0ae0 msgr2=0x7f7c5c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 --2- 172.21.15.40:0/3884055639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0d0ae0 0x7f7c5c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 -- 172.21.15.40:0/3884055639 >> v2:172.21.15.91:3300/0 conn(0x7f7c5c0d0690 msgr2=0x7f7c5c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 --2- 172.21.15.40:0/3884055639 >> v2:172.21.15.91:3300/0 conn(0x7f7c5c0d0690 0x7f7c5c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 -- 172.21.15.40:0/3884055639 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0d1ce0 con 0x7f7c5c0b4990 2023-11-04T01:42:47.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c6087b640 1 --2- 172.21.15.40:0/3884055639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0b4990 0x7f7c5c0b4d70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c08c090 tx=0x7f7c4401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62466c8871e6a45c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c5b7fe640 1 -- 172.21.15.40:0/3884055639 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a89b0 con 0x7f7c5c0b4990 2023-11-04T01:42:47.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.414+0000 7f7c5b7fe640 1 -- 172.21.15.40:0/3884055639 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440a8b10 con 0x7f7c5c0b4990 2023-11-04T01:42:47.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5b7fe640 1 -- 172.21.15.40:0/3884055639 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a8ea0 con 0x7f7c5c0b4990 2023-11-04T01:42:47.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/3884055639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0b4990 msgr2=0x7f7c5c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- 172.21.15.40:0/3884055639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0b4990 0x7f7c5c0b4d70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c08c090 tx=0x7f7c4401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/3884055639 shutdown_connections 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- 172.21.15.40:0/3884055639 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0d0ae0 0x7f7c5c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- 172.21.15.40:0/3884055639 >> v2:172.21.15.91:3300/0 conn(0x7f7c5c0d0690 0x7f7c5c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- 172.21.15.40:0/3884055639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0b4990 0x7f7c5c0b4d70 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/3884055639 >> 172.21.15.40:0/3884055639 conn(0x7f7c5c0cf990 msgr2=0x7f7c5c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/3884055639 shutdown_connections 2023-11-04T01:42:47.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/3884055639 wait complete. 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 Processor -- start 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- start start 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0b4990 0x7f7c5c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 0x7f7c5c1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c5c0d0ae0 0x7f7c5c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c1f7b80 con 0x7f7c5c0d0690 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0caff0 con 0x7f7c5c0d0ae0 2023-11-04T01:42:47.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c0cb2d0 con 0x7f7c5c0b4990 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 0x7f7c5c1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 0x7f7c5c1f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36270/0 (socket says 172.21.15.40:36270) 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 -- 172.21.15.40:0/2712732911 learned_addr learned my addr 172.21.15.40:0/2712732911 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c6107c640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c5c0d0ae0 0x7f7c5c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c6087b640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0b4990 0x7f7c5c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 -- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0b4990 msgr2=0x7f7c5c0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0b4990 0x7f7c5c0cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 -- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c5c0d0ae0 msgr2=0x7f7c5c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c5c0d0ae0 0x7f7c5c06d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 -- 172.21.15.40:0/2712732911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440094d0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c5bfff640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 0x7f7c5c1f7640 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00d7d0 tx=0x7f7c4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0096a0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c009800 con 0x7f7c5c0d0690 2023-11-04T01:42:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c0cb5b0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c009bb0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.418+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c0cbb70 con 0x7f7c5c0d0690 2023-11-04T01:42:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.422+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c0744a0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.422+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c4c009d10 con 0x7f7c5c0d0690 2023-11-04T01:42:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.422+0000 7f7c597fa640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7c3c0664d0 0x7f7c3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.422+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f7c4c0849d0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.422+0000 7f7c6087b640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7c3c0664d0 0x7f7c3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.422+0000 7f7c6087b640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7c3c0664d0 0x7f7c3c068990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7c440b2000 tx=0x7f7c44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.426+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c4c051ab0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.582+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c5c0b5bb0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c597fa640 1 -- 172.21.15.40:0/2712732911 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21696 (secure 0 0 0) 0x7f7c4c0550d0 con 0x7f7c5c0d0690 2023-11-04T01:42:47.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:47.592 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":79,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:44.675142+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7c3c0664d0 msgr2=0x7f7c3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7c3c0664d0 0x7f7c3c068990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7c440b2000 tx=0x7f7c44008040 comp rx=0 tx=0).stop 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 msgr2=0x7f7c5c1f7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 0x7f7c5c1f7640 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00d7d0 tx=0x7f7c4c00dc90 comp rx=0 tx=0).stop 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 shutdown_connections 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7c3c0664d0 0x7f7c3c068990 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c5c0d0ae0 0x7f7c5c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c5c0d0690 0x7f7c5c1f7640 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 --2- 172.21.15.40:0/2712732911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7c5c0b4990 0x7f7c5c0cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 >> 172.21.15.40:0/2712732911 conn(0x7f7c5c0cf990 msgr2=0x7f7c5c0b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.586+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 shutdown_connections 2023-11-04T01:42:47.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.590+0000 7f7c62adf640 1 -- 172.21.15.40:0/2712732911 wait complete. 2023-11-04T01:42:47.611 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:42:47.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:47.620 INFO:tasks.ceph.mds.d.smithi091.stderr:2023-11-04T01:42:47.614+0000 7f4ad8d14640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 Processor -- start 2023-11-04T01:42:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 -- start start 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4ed815e340 0x7f4ed8065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ed806a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80cc740 con 0x7f4ed815a080 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed8066510 con 0x7f4ed815e340 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ede02f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806c300 con 0x7f4ed815e7f0 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4ed815a080 0x7f4ed815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45080/0 (socket says 172.21.15.40:45080) 2023-11-04T01:42:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed77fe640 1 -- 172.21.15.40:0/2799490048 learned_addr learned my addr 172.21.15.40:0/2799490048 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ed806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed6ffd640 1 --2- 172.21.15.40:0/2799490048 >> v2:172.21.15.91:3300/0 conn(0x7f4ed815e340 0x7f4ed8065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076823033 0 0) 0x7f4ed80cc740 con 0x7f4ed815a080 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec4005740 con 0x7f4ed815a080 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 591816488 0 0) 0x7f4ec4005740 con 0x7f4ed815a080 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 msgr2=0x7f4ed806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ed806a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 >> v2:172.21.15.91:3300/0 conn(0x7f4ed815e340 msgr2=0x7f4ed8065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 --2- 172.21.15.40:0/2799490048 >> v2:172.21.15.91:3300/0 conn(0x7f4ed815e340 0x7f4ed8065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed806c020 con 0x7f4ed815a080 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f4ec8001a00 con 0x7f4ed815a080 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 >> v1:172.21.15.40:6789/0 conn(0x7f4ed815a080 legacy=0x7f4ed815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ec4005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ec4006110 0x7f4ec40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ec40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8066510 con 0x7f4ec4006f20 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806c300 con 0x7f4ec4006110 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec400dba0 con 0x7f4ed815e7f0 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ec40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.722+0000 7f4ed77fe640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ec4005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed6ffd640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ec4006110 0x7f4ec40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 -- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 msgr2=0x7f4ec4005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ec4005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 -- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ec4006110 msgr2=0x7f4ec40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ec4006110 0x7f4ec40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 -- 172.21.15.40:0/2799490048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4005740 con 0x7f4ec4006f20 2023-11-04T01:42:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed77fe640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed815e7f0 0x7f4ec4005b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:47.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ec40073a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009ae0 tx=0x7f4ed001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db930647b4ba1a88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00a5640 con 0x7f4ec4006f20 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00a57a0 con 0x7f4ec4006f20 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed67fc640 1 -- 172.21.15.40:0/2799490048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00a5b50 con 0x7f4ec4006f20 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ede02f640 1 -- 172.21.15.40:0/2799490048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 msgr2=0x7f4ec40073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2799490048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ec40073a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009ae0 tx=0x7f4ed001c9f0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ed7fff640 1 -- 172.21.15.40:0/2799490048 reap_dead start 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ede02f640 1 -- 172.21.15.40:0/2799490048 shutdown_connections 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ede02f640 1 -- 172.21.15.40:0/2799490048 >> 172.21.15.40:0/2799490048 conn(0x7f4ed80716a0 msgr2=0x7f4ed8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ede02f640 1 -- 172.21.15.40:0/2799490048 shutdown_connections 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.726+0000 7f4ede02f640 1 -- 172.21.15.40:0/2799490048 wait complete. 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 Processor -- start 2023-11-04T01:42:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- start start 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ed80ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ed80b1890 0x7f4ed815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed8159430 0x7f4ed81598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8159df0 con 0x7f4ec4006f20 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80b1d10 con 0x7f4ed80b1890 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815af20 con 0x7f4ed8159430 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ed80ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ed80ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36278/0 (socket says 172.21.15.40:36278) 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 -- 172.21.15.40:0/2983220922 learned_addr learned my addr 172.21.15.40:0/2983220922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed8159430 0x7f4ed81598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed6ffd640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ed80b1890 0x7f4ed815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 -- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed8159430 msgr2=0x7f4ed81598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed8159430 0x7f4ed81598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 -- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ed80b1890 msgr2=0x7f4ed815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ed80b1890 0x7f4ed815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 -- 172.21.15.40:0/2983220922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed815b200 con 0x7f4ec4006f20 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed7fff640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed8159430 0x7f4ed81598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ed77fe640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ed80ad660 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005f80 tx=0x7f4ec800e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800ee20 con 0x7f4ec4006f20 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8004d80 con 0x7f4ec4006f20 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed815b4e0 con 0x7f4ec4006f20 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8014680 con 0x7f4ec4006f20 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed80af590 con 0x7f4ec4006f20 2023-11-04T01:42:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80675f0 con 0x7f4ec4006f20 2023-11-04T01:42:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ec80147e0 con 0x7f4ec4006f20 2023-11-04T01:42:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.730+0000 7f4ecffff640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4eb80664d0 0x7f4eb8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.734+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f4ec8084610 con 0x7f4ec4006f20 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.734+0000 7f4ed6ffd640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4eb80664d0 0x7f4eb8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.734+0000 7f4ed6ffd640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4eb80664d0 0x7f4eb8068990 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80cf450 tx=0x7f4ec0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.738+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ec8051710 con 0x7f4ec4006f20 2023-11-04T01:42:47.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.886+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ed806dcd0 con 0x7f4eb80664d0 2023-11-04T01:42:47.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.930+0000 7f4ecffff640 1 -- 172.21.15.40:0/2983220922 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530334 (secure 0 0 0) 0x7f4ec0012920 con 0x7f4eb80664d0 2023-11-04T01:42:47.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:47.945 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:47.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4eb80664d0 msgr2=0x7f4eb8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4eb80664d0 0x7f4eb8068990 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80cf450 tx=0x7f4ec0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:47.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 msgr2=0x7f4ed80ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ed80ad660 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005f80 tx=0x7f4ec800e5f0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 shutdown_connections 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4eb80664d0 0x7f4eb8068990 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4ed8159430 0x7f4ed81598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4ed80b1890 0x7f4ed815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 --2- 172.21.15.40:0/2983220922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ec4006f20 0x7f4ed80ad660 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 >> 172.21.15.40:0/2983220922 conn(0x7f4ed80716a0 msgr2=0x7f4ed80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 shutdown_connections 2023-11-04T01:42:47.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:47.938+0000 7f4ede02f640 1 -- 172.21.15.40:0/2983220922 wait complete. 2023-11-04T01:42:47.962 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-11-04T01:42:47.812210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254004,"kb_used_data":8684,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720716,"statfs":{"total":773094113280,"available":772834013184,"internally_reserved":0,"allocated":8892416,"data_stored":4702949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":78,"apply_latency_ms":78,"commit_latency_ns":78000000,"apply_latency_ns":78000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002728"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.739451+0000","last_change":"2023-11-04T01:42:43.735746+0000","last_active":"2023-11-04T01:42:43.739451+0000","last_peered":"2023-11-04T01:42:43.739451+0000","last_clean":"2023-11-04T01:42:43.739451+0000","last_became_active":"2023-11-04T01:42:43.734956+0000","last_became_peered":"2023-11-04T01:42:43.734956+0000","last_unstale":"2023-11-04T01:42:43.739451+0000","last_undegraded":"2023-11-04T01:42:43.739451+0000","last_fullsized":"2023-11-04T01:42:43.739451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:01.776290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696462+0000","last_change":"2023-11-04T01:42:43.722252+0000","last_active":"2023-11-04T01:42:44.696462+0000","last_peered":"2023-11-04T01:42:44.696462+0000","last_clean":"2023-11-04T01:42:44.696462+0000","last_became_active":"2023-11-04T01:42:43.721410+0000","last_became_peered":"2023-11-04T01:42:43.721410+0000","last_unstale":"2023-11-04T01:42:44.696462+0000","last_undegraded":"2023-11-04T01:42:44.696462+0000","last_fullsized":"2023-11-04T01:42:44.696462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:20.790399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.738318+0000","last_change":"2023-11-04T01:42:43.731946+0000","last_active":"2023-11-04T01:42:43.738318+0000","last_peered":"2023-11-04T01:42:43.738318+0000","last_clean":"2023-11-04T01:42:43.738318+0000","last_became_active":"2023-11-04T01:42:43.731105+0000","last_became_peered":"2023-11-04T01:42:43.731105+0000","last_unstale":"2023-11-04T01:42:43.738318+0000","last_undegraded":"2023-11-04T01:42:43.738318+0000","last_fullsized":"2023-11-04T01:42:43.738318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:51.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693757+0000","last_change":"2023-11-04T01:42:43.748982+0000","last_active":"2023-11-04T01:42:44.693757+0000","last_peered":"2023-11-04T01:42:44.693757+0000","last_clean":"2023-11-04T01:42:44.693757+0000","last_became_active":"2023-11-04T01:42:43.748410+0000","last_became_peered":"2023-11-04T01:42:43.748410+0000","last_unstale":"2023-11-04T01:42:44.693757+0000","last_undegraded":"2023-11-04T01:42:44.693757+0000","last_fullsized":"2023-11-04T01:42:44.693757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:54.908022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693063+0000","last_change":"2023-11-04T01:42:43.727104+0000","last_active":"2023-11-04T01:42:44.693063+0000","last_peered":"2023-11-04T01:42:44.693063+0000","last_clean":"2023-11-04T01:42:44.693063+0000","last_became_active":"2023-11-04T01:42:43.726387+0000","last_became_peered":"2023-11-04T01:42:43.726387+0000","last_unstale":"2023-11-04T01:42:44.693063+0000","last_undegraded":"2023-11-04T01:42:44.693063+0000","last_fullsized":"2023-11-04T01:42:44.693063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:24.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211239+0000","last_change":"2023-11-04T01:42:43.750679+0000","last_active":"2023-11-04T01:42:45.211239+0000","last_peered":"2023-11-04T01:42:45.211239+0000","last_clean":"2023-11-04T01:42:45.211239+0000","last_became_active":"2023-11-04T01:42:43.750147+0000","last_became_peered":"2023-11-04T01:42:43.750147+0000","last_unstale":"2023-11-04T01:42:45.211239+0000","last_undegraded":"2023-11-04T01:42:45.211239+0000","last_fullsized":"2023-11-04T01:42:45.211239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:01.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.730261+0000","last_change":"2023-11-04T01:42:43.722771+0000","last_active":"2023-11-04T01:42:43.730261+0000","last_peered":"2023-11-04T01:42:43.730261+0000","last_clean":"2023-11-04T01:42:43.730261+0000","last_became_active":"2023-11-04T01:42:43.721502+0000","last_became_peered":"2023-11-04T01:42:43.721502+0000","last_unstale":"2023-11-04T01:42:43.730261+0000","last_undegraded":"2023-11-04T01:42:43.730261+0000","last_fullsized":"2023-11-04T01:42:43.730261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:59:51.293018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.691802+0000","last_change":"2023-11-04T01:42:43.754318+0000","last_active":"2023-11-04T01:42:44.691802+0000","last_peered":"2023-11-04T01:42:44.691802+0000","last_clean":"2023-11-04T01:42:44.691802+0000","last_became_active":"2023-11-04T01:42:43.753575+0000","last_became_peered":"2023-11-04T01:42:43.753575+0000","last_unstale":"2023-11-04T01:42:44.691802+0000","last_undegraded":"2023-11-04T01:42:44.691802+0000","last_fullsized":"2023-11-04T01:42:44.691802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.572398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694819+0000","last_change":"2023-11-04T01:42:43.718401+0000","last_active":"2023-11-04T01:42:44.694819+0000","last_peered":"2023-11-04T01:42:44.694819+0000","last_clean":"2023-11-04T01:42:44.694819+0000","last_became_active":"2023-11-04T01:42:43.717603+0000","last_became_peered":"2023-11-04T01:42:43.717603+0000","last_unstale":"2023-11-04T01:42:44.694819+0000","last_undegraded":"2023-11-04T01:42:44.694819+0000","last_fullsized":"2023-11-04T01:42:44.694819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:11.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.754700+0000","last_change":"2023-11-04T01:42:43.748637+0000","last_active":"2023-11-04T01:42:43.754700+0000","last_peered":"2023-11-04T01:42:43.754700+0000","last_clean":"2023-11-04T01:42:43.754700+0000","last_became_active":"2023-11-04T01:42:43.747937+0000","last_became_peered":"2023-11-04T01:42:43.747937+0000","last_unstale":"2023-11-04T01:42:43.754700+0000","last_undegraded":"2023-11-04T01:42:43.754700+0000","last_fullsized":"2023-11-04T01:42:43.754700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:44.654327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696637+0000","last_change":"2023-11-04T01:42:43.733236+0000","last_active":"2023-11-04T01:42:44.696637+0000","last_peered":"2023-11-04T01:42:44.696637+0000","last_clean":"2023-11-04T01:42:44.696637+0000","last_became_active":"2023-11-04T01:42:43.732493+0000","last_became_peered":"2023-11-04T01:42:43.732493+0000","last_unstale":"2023-11-04T01:42:44.696637+0000","last_undegraded":"2023-11-04T01:42:44.696637+0000","last_fullsized":"2023-11-04T01:42:44.696637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:20.790399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.733503+0000","last_change":"2023-11-04T01:42:43.721444+0000","last_active":"2023-11-04T01:42:43.733503+0000","last_peered":"2023-11-04T01:42:43.733503+0000","last_clean":"2023-11-04T01:42:43.733503+0000","last_became_active":"2023-11-04T01:42:43.720537+0000","last_became_peered":"2023-11-04T01:42:43.720537+0000","last_unstale":"2023-11-04T01:42:43.733503+0000","last_undegraded":"2023-11-04T01:42:43.733503+0000","last_fullsized":"2023-11-04T01:42:43.733503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:31.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693184+0000","last_change":"2023-11-04T01:42:43.754845+0000","last_active":"2023-11-04T01:42:44.693184+0000","last_peered":"2023-11-04T01:42:44.693184+0000","last_clean":"2023-11-04T01:42:44.693184+0000","last_became_active":"2023-11-04T01:42:43.753509+0000","last_became_peered":"2023-11-04T01:42:43.753509+0000","last_unstale":"2023-11-04T01:42:44.693184+0000","last_undegraded":"2023-11-04T01:42:44.693184+0000","last_fullsized":"2023-11-04T01:42:44.693184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:57.842799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692641+0000","last_change":"2023-11-04T01:42:43.751523+0000","last_active":"2023-11-04T01:42:44.692641+0000","last_peered":"2023-11-04T01:42:44.692641+0000","last_clean":"2023-11-04T01:42:44.692641+0000","last_became_active":"2023-11-04T01:42:43.750992+0000","last_became_peered":"2023-11-04T01:42:43.750992+0000","last_unstale":"2023-11-04T01:42:44.692641+0000","last_undegraded":"2023-11-04T01:42:44.692641+0000","last_fullsized":"2023-11-04T01:42:44.692641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:31.410384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.691938+0000","last_change":"2023-11-04T01:42:43.750806+0000","last_active":"2023-11-04T01:42:44.691938+0000","last_peered":"2023-11-04T01:42:44.691938+0000","last_clean":"2023-11-04T01:42:44.691938+0000","last_became_active":"2023-11-04T01:42:43.750053+0000","last_became_peered":"2023-11-04T01:42:43.750053+0000","last_unstale":"2023-11-04T01:42:44.691938+0000","last_undegraded":"2023-11-04T01:42:44.691938+0000","last_fullsized":"2023-11-04T01:42:44.691938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:36.969595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.210568+0000","last_change":"2023-11-04T01:42:43.733214+0000","last_active":"2023-11-04T01:42:45.210568+0000","last_peered":"2023-11-04T01:42:45.210568+0000","last_clean":"2023-11-04T01:42:45.210568+0000","last_became_active":"2023-11-04T01:42:43.732358+0000","last_became_peered":"2023-11-04T01:42:43.732358+0000","last_unstale":"2023-11-04T01:42:45.210568+0000","last_undegraded":"2023-11-04T01:42:45.210568+0000","last_fullsized":"2023-11-04T01:42:45.210568+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:49.639293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212461+0000","last_change":"2023-11-04T01:42:43.729170+0000","last_active":"2023-11-04T01:42:45.212461+0000","last_peered":"2023-11-04T01:42:45.212461+0000","last_clean":"2023-11-04T01:42:45.212461+0000","last_became_active":"2023-11-04T01:42:43.726300+0000","last_became_peered":"2023-11-04T01:42:43.726300+0000","last_unstale":"2023-11-04T01:42:45.212461+0000","last_undegraded":"2023-11-04T01:42:45.212461+0000","last_fullsized":"2023-11-04T01:42:45.212461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:33.138848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.731068+0000","last_change":"2023-11-04T01:42:43.716702+0000","last_active":"2023-11-04T01:42:43.731068+0000","last_peered":"2023-11-04T01:42:43.731068+0000","last_clean":"2023-11-04T01:42:43.731068+0000","last_became_active":"2023-11-04T01:42:43.715046+0000","last_became_peered":"2023-11-04T01:42:43.715046+0000","last_unstale":"2023-11-04T01:42:43.731068+0000","last_undegraded":"2023-11-04T01:42:43.731068+0000","last_fullsized":"2023-11-04T01:42:43.731068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:23.833591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696802+0000","last_change":"2023-11-04T01:42:43.754340+0000","last_active":"2023-11-04T01:42:44.696802+0000","last_peered":"2023-11-04T01:42:44.696802+0000","last_clean":"2023-11-04T01:42:44.696802+0000","last_became_active":"2023-11-04T01:42:43.753657+0000","last_became_peered":"2023-11-04T01:42:43.753657+0000","last_unstale":"2023-11-04T01:42:44.696802+0000","last_undegraded":"2023-11-04T01:42:44.696802+0000","last_fullsized":"2023-11-04T01:42:44.696802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:06.345308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693950+0000","last_change":"2023-11-04T01:42:43.746608+0000","last_active":"2023-11-04T01:42:44.693950+0000","last_peered":"2023-11-04T01:42:44.693950+0000","last_clean":"2023-11-04T01:42:44.693950+0000","last_became_active":"2023-11-04T01:42:43.746006+0000","last_became_peered":"2023-11-04T01:42:43.746006+0000","last_unstale":"2023-11-04T01:42:44.693950+0000","last_undegraded":"2023-11-04T01:42:44.693950+0000","last_fullsized":"2023-11-04T01:42:44.693950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:15.201232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693670+0000","last_change":"2023-11-04T01:42:43.718711+0000","last_active":"2023-11-04T01:42:44.693670+0000","last_peered":"2023-11-04T01:42:44.693670+0000","last_clean":"2023-11-04T01:42:44.693670+0000","last_became_active":"2023-11-04T01:42:43.717638+0000","last_became_peered":"2023-11-04T01:42:43.717638+0000","last_unstale":"2023-11-04T01:42:44.693670+0000","last_undegraded":"2023-11-04T01:42:44.693670+0000","last_fullsized":"2023-11-04T01:42:44.693670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:57.842799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692845+0000","last_change":"2023-11-04T01:42:43.754967+0000","last_active":"2023-11-04T01:42:44.692845+0000","last_peered":"2023-11-04T01:42:44.692845+0000","last_clean":"2023-11-04T01:42:44.692845+0000","last_became_active":"2023-11-04T01:42:43.753889+0000","last_became_peered":"2023-11-04T01:42:43.753889+0000","last_unstale":"2023-11-04T01:42:44.692845+0000","last_undegraded":"2023-11-04T01:42:44.692845+0000","last_fullsized":"2023-11-04T01:42:44.692845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:36.969595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.216340+0000","last_change":"2023-11-04T01:42:43.754519+0000","last_active":"2023-11-04T01:42:45.216340+0000","last_peered":"2023-11-04T01:42:45.216340+0000","last_clean":"2023-11-04T01:42:45.216340+0000","last_became_active":"2023-11-04T01:42:43.753652+0000","last_became_peered":"2023-11-04T01:42:43.753652+0000","last_unstale":"2023-11-04T01:42:45.216340+0000","last_undegraded":"2023-11-04T01:42:45.216340+0000","last_fullsized":"2023-11-04T01:42:45.216340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:43.302108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.735852+0000","last_change":"2023-11-04T01:42:43.729872+0000","last_active":"2023-11-04T01:42:43.735852+0000","last_peered":"2023-11-04T01:42:43.735852+0000","last_clean":"2023-11-04T01:42:43.735852+0000","last_became_active":"2023-11-04T01:42:43.728958+0000","last_became_peered":"2023-11-04T01:42:43.728958+0000","last_unstale":"2023-11-04T01:42:43.735852+0000","last_undegraded":"2023-11-04T01:42:43.735852+0000","last_fullsized":"2023-11-04T01:42:43.735852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:01.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697301+0000","last_change":"2023-11-04T01:42:43.712091+0000","last_active":"2023-11-04T01:42:44.697301+0000","last_peered":"2023-11-04T01:42:44.697301+0000","last_clean":"2023-11-04T01:42:44.697301+0000","last_became_active":"2023-11-04T01:42:43.711259+0000","last_became_peered":"2023-11-04T01:42:43.711259+0000","last_unstale":"2023-11-04T01:42:44.697301+0000","last_undegraded":"2023-11-04T01:42:44.697301+0000","last_fullsized":"2023-11-04T01:42:44.697301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:06.345308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694462+0000","last_change":"2023-11-04T01:42:43.751897+0000","last_active":"2023-11-04T01:42:44.694462+0000","last_peered":"2023-11-04T01:42:44.694462+0000","last_clean":"2023-11-04T01:42:44.694462+0000","last_became_active":"2023-11-04T01:42:43.751165+0000","last_became_peered":"2023-11-04T01:42:43.751165+0000","last_unstale":"2023-11-04T01:42:44.694462+0000","last_undegraded":"2023-11-04T01:42:44.694462+0000","last_fullsized":"2023-11-04T01:42:44.694462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:15.201232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.715543+0000","last_change":"2023-11-04T01:42:43.706622+0000","last_active":"2023-11-04T01:42:43.715543+0000","last_peered":"2023-11-04T01:42:43.715543+0000","last_clean":"2023-11-04T01:42:43.715543+0000","last_became_active":"2023-11-04T01:42:43.705865+0000","last_became_peered":"2023-11-04T01:42:43.705865+0000","last_unstale":"2023-11-04T01:42:43.715543+0000","last_undegraded":"2023-11-04T01:42:43.715543+0000","last_fullsized":"2023-11-04T01:42:43.715543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:18:34.906455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694106+0000","last_change":"2023-11-04T01:42:43.726907+0000","last_active":"2023-11-04T01:42:44.694106+0000","last_peered":"2023-11-04T01:42:44.694106+0000","last_clean":"2023-11-04T01:42:44.694106+0000","last_became_active":"2023-11-04T01:42:43.726121+0000","last_became_peered":"2023-11-04T01:42:43.726121+0000","last_unstale":"2023-11-04T01:42:44.694106+0000","last_undegraded":"2023-11-04T01:42:44.694106+0000","last_fullsized":"2023-11-04T01:42:44.694106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:11.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.730328+0000","last_change":"2023-11-04T01:42:43.722903+0000","last_active":"2023-11-04T01:42:43.730328+0000","last_peered":"2023-11-04T01:42:43.730328+0000","last_clean":"2023-11-04T01:42:43.730328+0000","last_became_active":"2023-11-04T01:42:43.722125+0000","last_became_peered":"2023-11-04T01:42:43.722125+0000","last_unstale":"2023-11-04T01:42:43.730328+0000","last_undegraded":"2023-11-04T01:42:43.730328+0000","last_fullsized":"2023-11-04T01:42:43.730328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:25.401425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693205+0000","last_change":"2023-11-04T01:42:43.716549+0000","last_active":"2023-11-04T01:42:44.693205+0000","last_peered":"2023-11-04T01:42:44.693205+0000","last_clean":"2023-11-04T01:42:44.693205+0000","last_became_active":"2023-11-04T01:42:43.715757+0000","last_became_peered":"2023-11-04T01:42:43.715757+0000","last_unstale":"2023-11-04T01:42:44.693205+0000","last_undegraded":"2023-11-04T01:42:44.693205+0000","last_fullsized":"2023-11-04T01:42:44.693205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:44.245490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693210+0000","last_change":"2023-11-04T01:42:43.748737+0000","last_active":"2023-11-04T01:42:44.693210+0000","last_peered":"2023-11-04T01:42:44.693210+0000","last_clean":"2023-11-04T01:42:44.693210+0000","last_became_active":"2023-11-04T01:42:43.748204+0000","last_became_peered":"2023-11-04T01:42:43.748204+0000","last_unstale":"2023-11-04T01:42:44.693210+0000","last_undegraded":"2023-11-04T01:42:44.693210+0000","last_fullsized":"2023-11-04T01:42:44.693210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:11.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.210633+0000","last_change":"2023-11-04T01:42:43.726957+0000","last_active":"2023-11-04T01:42:45.210633+0000","last_peered":"2023-11-04T01:42:45.210633+0000","last_clean":"2023-11-04T01:42:45.210633+0000","last_became_active":"2023-11-04T01:42:43.724017+0000","last_became_peered":"2023-11-04T01:42:43.724017+0000","last_unstale":"2023-11-04T01:42:45.210633+0000","last_undegraded":"2023-11-04T01:42:45.210633+0000","last_fullsized":"2023-11-04T01:42:45.210633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:17.672541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.724901+0000","last_change":"2023-11-04T01:42:43.721936+0000","last_active":"2023-11-04T01:42:43.724901+0000","last_peered":"2023-11-04T01:42:43.724901+0000","last_clean":"2023-11-04T01:42:43.724901+0000","last_became_active":"2023-11-04T01:42:43.721227+0000","last_became_peered":"2023-11-04T01:42:43.721227+0000","last_unstale":"2023-11-04T01:42:43.724901+0000","last_undegraded":"2023-11-04T01:42:43.724901+0000","last_fullsized":"2023-11-04T01:42:43.724901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:22.685456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694208+0000","last_change":"2023-11-04T01:42:42.674154+0000","last_active":"2023-11-04T01:42:44.694208+0000","last_peered":"2023-11-04T01:42:44.694208+0000","last_clean":"2023-11-04T01:42:44.694208+0000","last_became_active":"2023-11-04T01:42:42.673762+0000","last_became_peered":"2023-11-04T01:42:42.673762+0000","last_unstale":"2023-11-04T01:42:44.694208+0000","last_undegraded":"2023-11-04T01:42:44.694208+0000","last_fullsized":"2023-11-04T01:42:44.694208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:19.791843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670549+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:42:42.670549+0000","last_peered":"2023-11-04T01:42:42.670549+0000","last_clean":"2023-11-04T01:42:42.670549+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:42:42.670549+0000","last_undegraded":"2023-11-04T01:42:42.670549+0000","last_fullsized":"2023-11-04T01:42:42.670549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.664401+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:42:42.664401+0000","last_peered":"2023-11-04T01:42:42.664401+0000","last_clean":"2023-11-04T01:42:42.664401+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:42:42.664401+0000","last_undegraded":"2023-11-04T01:42:42.664401+0000","last_fullsized":"2023-11-04T01:42:42.664401+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673461+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:42.673461+0000","last_peered":"2023-11-04T01:42:42.673461+0000","last_clean":"2023-11-04T01:42:42.673461+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:42.673461+0000","last_undegraded":"2023-11-04T01:42:42.673461+0000","last_fullsized":"2023-11-04T01:42:42.673461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.695144+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:43.695144+0000","last_peered":"2023-11-04T01:42:43.695144+0000","last_clean":"2023-11-04T01:42:43.695144+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:43.695144+0000","last_undegraded":"2023-11-04T01:42:43.695144+0000","last_fullsized":"2023-11-04T01:42:43.695144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693629+0000","last_change":"2023-11-04T01:42:43.727759+0000","last_active":"2023-11-04T01:42:44.693629+0000","last_peered":"2023-11-04T01:42:44.693629+0000","last_clean":"2023-11-04T01:42:44.693629+0000","last_became_active":"2023-11-04T01:42:43.725893+0000","last_became_peered":"2023-11-04T01:42:43.725893+0000","last_unstale":"2023-11-04T01:42:44.693629+0000","last_undegraded":"2023-11-04T01:42:44.693629+0000","last_fullsized":"2023-11-04T01:42:44.693629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:30.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692861+0000","last_change":"2023-11-04T01:42:42.673838+0000","last_active":"2023-11-04T01:42:44.692861+0000","last_peered":"2023-11-04T01:42:44.692861+0000","last_clean":"2023-11-04T01:42:44.692861+0000","last_became_active":"2023-11-04T01:42:42.673053+0000","last_became_peered":"2023-11-04T01:42:42.673053+0000","last_unstale":"2023-11-04T01:42:44.692861+0000","last_undegraded":"2023-11-04T01:42:44.692861+0000","last_fullsized":"2023-11-04T01:42:44.692861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:23.869218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652375+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:42:42.652375+0000","last_peered":"2023-11-04T01:42:42.652375+0000","last_clean":"2023-11-04T01:42:42.652375+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:42:42.652375+0000","last_undegraded":"2023-11-04T01:42:42.652375+0000","last_fullsized":"2023-11-04T01:42:42.652375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673354+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:42:42.673354+0000","last_peered":"2023-11-04T01:42:42.673354+0000","last_clean":"2023-11-04T01:42:42.673354+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:42:42.673354+0000","last_undegraded":"2023-11-04T01:42:42.673354+0000","last_fullsized":"2023-11-04T01:42:42.673354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714340+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:43.714340+0000","last_peered":"2023-11-04T01:42:43.714340+0000","last_clean":"2023-11-04T01:42:43.714340+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:43.714340+0000","last_undegraded":"2023-11-04T01:42:43.714340+0000","last_fullsized":"2023-11-04T01:42:43.714340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211959+0000","last_change":"2023-11-04T01:42:43.717599+0000","last_active":"2023-11-04T01:42:45.211959+0000","last_peered":"2023-11-04T01:42:45.211959+0000","last_clean":"2023-11-04T01:42:45.211959+0000","last_became_active":"2023-11-04T01:42:43.716739+0000","last_became_peered":"2023-11-04T01:42:43.716739+0000","last_unstale":"2023-11-04T01:42:45.211959+0000","last_undegraded":"2023-11-04T01:42:45.211959+0000","last_fullsized":"2023-11-04T01:42:45.211959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:01.776290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.679840+0000","last_change":"2023-11-04T01:42:42.671021+0000","last_active":"2023-11-04T01:42:43.679840+0000","last_peered":"2023-11-04T01:42:43.679840+0000","last_clean":"2023-11-04T01:42:43.679840+0000","last_became_active":"2023-11-04T01:42:42.670742+0000","last_became_peered":"2023-11-04T01:42:42.670742+0000","last_unstale":"2023-11-04T01:42:43.679840+0000","last_undegraded":"2023-11-04T01:42:43.679840+0000","last_fullsized":"2023-11-04T01:42:43.679840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:07.681391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649365+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:42:42.649365+0000","last_peered":"2023-11-04T01:42:42.649365+0000","last_clean":"2023-11-04T01:42:42.649365+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:42:42.649365+0000","last_undegraded":"2023-11-04T01:42:42.649365+0000","last_fullsized":"2023-11-04T01:42:42.649365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.710074+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:42:43.710074+0000","last_peered":"2023-11-04T01:42:43.710074+0000","last_clean":"2023-11-04T01:42:43.710074+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:42:43.710074+0000","last_undegraded":"2023-11-04T01:42:43.710074+0000","last_fullsized":"2023-11-04T01:42:43.710074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.669574+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:42.669574+0000","last_peered":"2023-11-04T01:42:42.669574+0000","last_clean":"2023-11-04T01:42:42.669574+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:42.669574+0000","last_undegraded":"2023-11-04T01:42:42.669574+0000","last_fullsized":"2023-11-04T01:42:42.669574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211242+0000","last_change":"2023-11-04T01:42:43.756137+0000","last_active":"2023-11-04T01:42:45.211242+0000","last_peered":"2023-11-04T01:42:45.211242+0000","last_clean":"2023-11-04T01:42:45.211242+0000","last_became_active":"2023-11-04T01:42:43.755528+0000","last_became_peered":"2023-11-04T01:42:43.755528+0000","last_unstale":"2023-11-04T01:42:45.211242+0000","last_undegraded":"2023-11-04T01:42:45.211242+0000","last_fullsized":"2023-11-04T01:42:45.211242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:51.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693175+0000","last_change":"2023-11-04T01:42:42.678047+0000","last_active":"2023-11-04T01:42:44.693175+0000","last_peered":"2023-11-04T01:42:44.693175+0000","last_clean":"2023-11-04T01:42:44.693175+0000","last_became_active":"2023-11-04T01:42:42.677219+0000","last_became_peered":"2023-11-04T01:42:42.677219+0000","last_unstale":"2023-11-04T01:42:44.693175+0000","last_undegraded":"2023-11-04T01:42:44.693175+0000","last_fullsized":"2023-11-04T01:42:44.693175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:43.241435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650920+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:42:42.650920+0000","last_peered":"2023-11-04T01:42:42.650920+0000","last_clean":"2023-11-04T01:42:42.650920+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:42:42.650920+0000","last_undegraded":"2023-11-04T01:42:42.650920+0000","last_fullsized":"2023-11-04T01:42:42.650920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650556+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:42:42.650556+0000","last_peered":"2023-11-04T01:42:42.650556+0000","last_clean":"2023-11-04T01:42:42.650556+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:42:42.650556+0000","last_undegraded":"2023-11-04T01:42:42.650556+0000","last_fullsized":"2023-11-04T01:42:42.650556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698707+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:43.698707+0000","last_peered":"2023-11-04T01:42:43.698707+0000","last_clean":"2023-11-04T01:42:43.698707+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:43.698707+0000","last_undegraded":"2023-11-04T01:42:43.698707+0000","last_fullsized":"2023-11-04T01:42:43.698707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692633+0000","last_change":"2023-11-04T01:42:43.721811+0000","last_active":"2023-11-04T01:42:44.692633+0000","last_peered":"2023-11-04T01:42:44.692633+0000","last_clean":"2023-11-04T01:42:44.692633+0000","last_became_active":"2023-11-04T01:42:43.721044+0000","last_became_peered":"2023-11-04T01:42:43.721044+0000","last_unstale":"2023-11-04T01:42:44.692633+0000","last_undegraded":"2023-11-04T01:42:44.692633+0000","last_fullsized":"2023-11-04T01:42:44.692633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:15.201232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.682129+0000","last_change":"2023-11-04T01:42:42.668666+0000","last_active":"2023-11-04T01:42:43.682129+0000","last_peered":"2023-11-04T01:42:43.682129+0000","last_clean":"2023-11-04T01:42:43.682129+0000","last_became_active":"2023-11-04T01:42:42.668392+0000","last_became_peered":"2023-11-04T01:42:42.668392+0000","last_unstale":"2023-11-04T01:42:43.682129+0000","last_undegraded":"2023-11-04T01:42:43.682129+0000","last_fullsized":"2023-11-04T01:42:43.682129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:39.079121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651465+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:42:42.651465+0000","last_peered":"2023-11-04T01:42:42.651465+0000","last_clean":"2023-11-04T01:42:42.651465+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:42:42.651465+0000","last_undegraded":"2023-11-04T01:42:42.651465+0000","last_fullsized":"2023-11-04T01:42:42.651465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.706891+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:42:43.706891+0000","last_peered":"2023-11-04T01:42:43.706891+0000","last_clean":"2023-11-04T01:42:43.706891+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:42:43.706891+0000","last_undegraded":"2023-11-04T01:42:43.706891+0000","last_fullsized":"2023-11-04T01:42:43.706891+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711607+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:43.711607+0000","last_peered":"2023-11-04T01:42:43.711607+0000","last_clean":"2023-11-04T01:42:43.711607+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:43.711607+0000","last_undegraded":"2023-11-04T01:42:43.711607+0000","last_fullsized":"2023-11-04T01:42:43.711607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.695619+0000","last_change":"2023-11-04T01:42:43.728588+0000","last_active":"2023-11-04T01:42:44.695619+0000","last_peered":"2023-11-04T01:42:44.695619+0000","last_clean":"2023-11-04T01:42:44.695619+0000","last_became_active":"2023-11-04T01:42:43.727993+0000","last_became_peered":"2023-11-04T01:42:43.727993+0000","last_unstale":"2023-11-04T01:42:44.695619+0000","last_undegraded":"2023-11-04T01:42:44.695619+0000","last_fullsized":"2023-11-04T01:42:44.695619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:30.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697321+0000","last_change":"2023-11-04T01:42:42.696926+0000","last_active":"2023-11-04T01:42:44.697321+0000","last_peered":"2023-11-04T01:42:44.697321+0000","last_clean":"2023-11-04T01:42:44.697321+0000","last_became_active":"2023-11-04T01:42:42.696170+0000","last_became_peered":"2023-11-04T01:42:42.696170+0000","last_unstale":"2023-11-04T01:42:44.697321+0000","last_undegraded":"2023-11-04T01:42:44.697321+0000","last_fullsized":"2023-11-04T01:42:44.697321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:13.014595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698587+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:42:43.698587+0000","last_peered":"2023-11-04T01:42:43.698587+0000","last_clean":"2023-11-04T01:42:43.698587+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:42:43.698587+0000","last_undegraded":"2023-11-04T01:42:43.698587+0000","last_fullsized":"2023-11-04T01:42:43.698587+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651837+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:42:42.651837+0000","last_peered":"2023-11-04T01:42:42.651837+0000","last_clean":"2023-11-04T01:42:42.651837+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:42:42.651837+0000","last_undegraded":"2023-11-04T01:42:42.651837+0000","last_fullsized":"2023-11-04T01:42:42.651837+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.668566+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:42.668566+0000","last_peered":"2023-11-04T01:42:42.668566+0000","last_clean":"2023-11-04T01:42:42.668566+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:42.668566+0000","last_undegraded":"2023-11-04T01:42:42.668566+0000","last_fullsized":"2023-11-04T01:42:42.668566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211961+0000","last_change":"2023-11-04T01:42:43.730080+0000","last_active":"2023-11-04T01:42:45.211961+0000","last_peered":"2023-11-04T01:42:45.211961+0000","last_clean":"2023-11-04T01:42:45.211961+0000","last_became_active":"2023-11-04T01:42:43.729260+0000","last_became_peered":"2023-11-04T01:42:43.729260+0000","last_unstale":"2023-11-04T01:42:45.211961+0000","last_undegraded":"2023-11-04T01:42:45.211961+0000","last_fullsized":"2023-11-04T01:42:45.211961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:01.132128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217747+0000","last_change":"2023-11-04T01:42:42.671374+0000","last_active":"2023-11-04T01:42:45.217747+0000","last_peered":"2023-11-04T01:42:45.217747+0000","last_clean":"2023-11-04T01:42:45.217747+0000","last_became_active":"2023-11-04T01:42:42.670622+0000","last_became_peered":"2023-11-04T01:42:42.670622+0000","last_unstale":"2023-11-04T01:42:45.217747+0000","last_undegraded":"2023-11-04T01:42:45.217747+0000","last_fullsized":"2023-11-04T01:42:45.217747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:01.745566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.701720+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:42:43.701720+0000","last_peered":"2023-11-04T01:42:43.701720+0000","last_clean":"2023-11-04T01:42:43.701720+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:42:43.701720+0000","last_undegraded":"2023-11-04T01:42:43.701720+0000","last_fullsized":"2023-11-04T01:42:43.701720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666809+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:42:42.666809+0000","last_peered":"2023-11-04T01:42:42.666809+0000","last_clean":"2023-11-04T01:42:42.666809+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:42:42.666809+0000","last_undegraded":"2023-11-04T01:42:42.666809+0000","last_fullsized":"2023-11-04T01:42:42.666809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.707145+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:43.707145+0000","last_peered":"2023-11-04T01:42:43.707145+0000","last_clean":"2023-11-04T01:42:43.707145+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:43.707145+0000","last_undegraded":"2023-11-04T01:42:43.707145+0000","last_fullsized":"2023-11-04T01:42:43.707145+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217400+0000","last_change":"2023-11-04T01:42:43.706305+0000","last_active":"2023-11-04T01:42:45.217400+0000","last_peered":"2023-11-04T01:42:45.217400+0000","last_clean":"2023-11-04T01:42:45.217400+0000","last_became_active":"2023-11-04T01:42:43.705460+0000","last_became_peered":"2023-11-04T01:42:43.705460+0000","last_unstale":"2023-11-04T01:42:45.217400+0000","last_undegraded":"2023-11-04T01:42:45.217400+0000","last_fullsized":"2023-11-04T01:42:45.217400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.572398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.940527+0000","last_change":"2023-11-04T01:42:42.686234+0000","last_active":"2023-11-04T01:42:43.940527+0000","last_peered":"2023-11-04T01:42:43.940527+0000","last_clean":"2023-11-04T01:42:43.940527+0000","last_became_active":"2023-11-04T01:42:42.685555+0000","last_became_peered":"2023-11-04T01:42:42.685555+0000","last_unstale":"2023-11-04T01:42:43.940527+0000","last_undegraded":"2023-11-04T01:42:43.940527+0000","last_fullsized":"2023-11-04T01:42:43.940527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:16.668487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696770+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:42:43.696770+0000","last_peered":"2023-11-04T01:42:43.696770+0000","last_clean":"2023-11-04T01:42:43.696770+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:42:43.696770+0000","last_undegraded":"2023-11-04T01:42:43.696770+0000","last_fullsized":"2023-11-04T01:42:43.696770+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652564+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:42:42.652564+0000","last_peered":"2023-11-04T01:42:42.652564+0000","last_clean":"2023-11-04T01:42:42.652564+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:42:42.652564+0000","last_undegraded":"2023-11-04T01:42:42.652564+0000","last_fullsized":"2023-11-04T01:42:42.652564+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.671143+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:42.671143+0000","last_peered":"2023-11-04T01:42:42.671143+0000","last_clean":"2023-11-04T01:42:42.671143+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:42.671143+0000","last_undegraded":"2023-11-04T01:42:42.671143+0000","last_fullsized":"2023-11-04T01:42:42.671143+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217267+0000","last_change":"2023-11-04T01:42:43.751728+0000","last_active":"2023-11-04T01:42:45.217267+0000","last_peered":"2023-11-04T01:42:45.217267+0000","last_clean":"2023-11-04T01:42:45.217267+0000","last_became_active":"2023-11-04T01:42:43.751024+0000","last_became_peered":"2023-11-04T01:42:43.751024+0000","last_unstale":"2023-11-04T01:42:45.217267+0000","last_undegraded":"2023-11-04T01:42:45.217267+0000","last_fullsized":"2023-11-04T01:42:45.217267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:20.430557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.215949+0000","last_change":"2023-11-04T01:42:42.665890+0000","last_active":"2023-11-04T01:42:45.215949+0000","last_peered":"2023-11-04T01:42:45.215949+0000","last_clean":"2023-11-04T01:42:45.215949+0000","last_became_active":"2023-11-04T01:42:42.665091+0000","last_became_peered":"2023-11-04T01:42:42.665091+0000","last_unstale":"2023-11-04T01:42:45.215949+0000","last_undegraded":"2023-11-04T01:42:45.215949+0000","last_fullsized":"2023-11-04T01:42:45.215949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:13.014595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.704986+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:42:43.704986+0000","last_peered":"2023-11-04T01:42:43.704986+0000","last_clean":"2023-11-04T01:42:43.704986+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:42:43.704986+0000","last_undegraded":"2023-11-04T01:42:43.704986+0000","last_fullsized":"2023-11-04T01:42:43.704986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.694946+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:42:43.694946+0000","last_peered":"2023-11-04T01:42:43.694946+0000","last_clean":"2023-11-04T01:42:43.694946+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:42:43.694946+0000","last_undegraded":"2023-11-04T01:42:43.694946+0000","last_fullsized":"2023-11-04T01:42:43.694946+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692960+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:43.692960+0000","last_peered":"2023-11-04T01:42:43.692960+0000","last_clean":"2023-11-04T01:42:43.692960+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:43.692960+0000","last_undegraded":"2023-11-04T01:42:43.692960+0000","last_fullsized":"2023-11-04T01:42:43.692960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211545+0000","last_change":"2023-11-04T01:42:43.730191+0000","last_active":"2023-11-04T01:42:45.211545+0000","last_peered":"2023-11-04T01:42:45.211545+0000","last_clean":"2023-11-04T01:42:45.211545+0000","last_became_active":"2023-11-04T01:42:43.723500+0000","last_became_peered":"2023-11-04T01:42:43.723500+0000","last_unstale":"2023-11-04T01:42:45.211545+0000","last_undegraded":"2023-11-04T01:42:45.211545+0000","last_fullsized":"2023-11-04T01:42:45.211545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:32.889149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.706079+0000","last_change":"2023-11-04T01:42:42.684704+0000","last_active":"2023-11-04T01:42:43.706079+0000","last_peered":"2023-11-04T01:42:43.706079+0000","last_clean":"2023-11-04T01:42:43.706079+0000","last_became_active":"2023-11-04T01:42:42.683951+0000","last_became_peered":"2023-11-04T01:42:42.683951+0000","last_unstale":"2023-11-04T01:42:43.706079+0000","last_undegraded":"2023-11-04T01:42:43.706079+0000","last_fullsized":"2023-11-04T01:42:43.706079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:48.635238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.689987+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:42:43.689987+0000","last_peered":"2023-11-04T01:42:43.689987+0000","last_clean":"2023-11-04T01:42:43.689987+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:42:43.689987+0000","last_undegraded":"2023-11-04T01:42:43.689987+0000","last_fullsized":"2023-11-04T01:42:43.689987+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.701932+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:42:43.701932+0000","last_peered":"2023-11-04T01:42:43.701932+0000","last_clean":"2023-11-04T01:42:43.701932+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:42:43.701932+0000","last_undegraded":"2023-11-04T01:42:43.701932+0000","last_fullsized":"2023-11-04T01:42:43.701932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652011+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:42.652011+0000","last_peered":"2023-11-04T01:42:42.652011+0000","last_clean":"2023-11-04T01:42:42.652011+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:42.652011+0000","last_undegraded":"2023-11-04T01:42:42.652011+0000","last_fullsized":"2023-11-04T01:42:42.652011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.732693+0000","last_change":"2023-11-04T01:42:43.721264+0000","last_active":"2023-11-04T01:42:43.732693+0000","last_peered":"2023-11-04T01:42:43.732693+0000","last_clean":"2023-11-04T01:42:43.732693+0000","last_became_active":"2023-11-04T01:42:43.720429+0000","last_became_peered":"2023-11-04T01:42:43.720429+0000","last_unstale":"2023-11-04T01:42:43.732693+0000","last_undegraded":"2023-11-04T01:42:43.732693+0000","last_fullsized":"2023-11-04T01:42:43.732693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:52.337126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211576+0000","last_change":"2023-11-04T01:42:42.693561+0000","last_active":"2023-11-04T01:42:45.211576+0000","last_peered":"2023-11-04T01:42:45.211576+0000","last_clean":"2023-11-04T01:42:45.211576+0000","last_became_active":"2023-11-04T01:42:42.693146+0000","last_became_peered":"2023-11-04T01:42:42.693146+0000","last_unstale":"2023-11-04T01:42:45.211576+0000","last_undegraded":"2023-11-04T01:42:45.211576+0000","last_fullsized":"2023-11-04T01:42:45.211576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:44.520778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714005+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:42:43.714005+0000","last_peered":"2023-11-04T01:42:43.714005+0000","last_clean":"2023-11-04T01:42:43.714005+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:42:43.714005+0000","last_undegraded":"2023-11-04T01:42:43.714005+0000","last_fullsized":"2023-11-04T01:42:43.714005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670760+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:42:42.670760+0000","last_peered":"2023-11-04T01:42:42.670760+0000","last_clean":"2023-11-04T01:42:42.670760+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:42:42.670760+0000","last_undegraded":"2023-11-04T01:42:42.670760+0000","last_fullsized":"2023-11-04T01:42:42.670760+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673229+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:42.673229+0000","last_peered":"2023-11-04T01:42:42.673229+0000","last_clean":"2023-11-04T01:42:42.673229+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:42.673229+0000","last_undegraded":"2023-11-04T01:42:42.673229+0000","last_fullsized":"2023-11-04T01:42:42.673229+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.756209+0000","last_change":"2023-11-04T01:42:43.753625+0000","last_active":"2023-11-04T01:42:43.756209+0000","last_peered":"2023-11-04T01:42:43.756209+0000","last_clean":"2023-11-04T01:42:43.756209+0000","last_became_active":"2023-11-04T01:42:43.752955+0000","last_became_peered":"2023-11-04T01:42:43.752955+0000","last_unstale":"2023-11-04T01:42:43.756209+0000","last_undegraded":"2023-11-04T01:42:43.756209+0000","last_fullsized":"2023-11-04T01:42:43.756209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:32.889149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694017+0000","last_change":"2023-11-04T01:42:42.671983+0000","last_active":"2023-11-04T01:42:44.694017+0000","last_peered":"2023-11-04T01:42:44.694017+0000","last_clean":"2023-11-04T01:42:44.694017+0000","last_became_active":"2023-11-04T01:42:42.671131+0000","last_became_peered":"2023-11-04T01:42:42.671131+0000","last_unstale":"2023-11-04T01:42:44.694017+0000","last_undegraded":"2023-11-04T01:42:44.694017+0000","last_fullsized":"2023-11-04T01:42:44.694017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:56.838744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698467+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:42:43.698467+0000","last_peered":"2023-11-04T01:42:43.698467+0000","last_clean":"2023-11-04T01:42:43.698467+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:42:43.698467+0000","last_undegraded":"2023-11-04T01:42:43.698467+0000","last_fullsized":"2023-11-04T01:42:43.698467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666439+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:42:42.666439+0000","last_peered":"2023-11-04T01:42:42.666439+0000","last_clean":"2023-11-04T01:42:42.666439+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:42:42.666439+0000","last_undegraded":"2023-11-04T01:42:42.666439+0000","last_fullsized":"2023-11-04T01:42:42.666439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696904+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:43.696904+0000","last_peered":"2023-11-04T01:42:43.696904+0000","last_clean":"2023-11-04T01:42:43.696904+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:43.696904+0000","last_undegraded":"2023-11-04T01:42:43.696904+0000","last_fullsized":"2023-11-04T01:42:43.696904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212307+0000","last_change":"2023-11-04T01:42:43.726057+0000","last_active":"2023-11-04T01:42:45.212307+0000","last_peered":"2023-11-04T01:42:45.212307+0000","last_clean":"2023-11-04T01:42:45.212307+0000","last_became_active":"2023-11-04T01:42:43.725259+0000","last_became_peered":"2023-11-04T01:42:43.725259+0000","last_unstale":"2023-11-04T01:42:45.212307+0000","last_undegraded":"2023-11-04T01:42:45.212307+0000","last_fullsized":"2023-11-04T01:42:45.212307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:25.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697529+0000","last_change":"2023-11-04T01:42:42.695015+0000","last_active":"2023-11-04T01:42:44.697529+0000","last_peered":"2023-11-04T01:42:44.697529+0000","last_clean":"2023-11-04T01:42:44.697529+0000","last_became_active":"2023-11-04T01:42:42.694379+0000","last_became_peered":"2023-11-04T01:42:42.694379+0000","last_unstale":"2023-11-04T01:42:44.697529+0000","last_undegraded":"2023-11-04T01:42:44.697529+0000","last_fullsized":"2023-11-04T01:42:44.697529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:01.745566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.686856+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:42:43.686856+0000","last_peered":"2023-11-04T01:42:43.686856+0000","last_clean":"2023-11-04T01:42:43.686856+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:42:43.686856+0000","last_undegraded":"2023-11-04T01:42:43.686856+0000","last_fullsized":"2023-11-04T01:42:43.686856+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.684434+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:42:43.684434+0000","last_peered":"2023-11-04T01:42:43.684434+0000","last_clean":"2023-11-04T01:42:43.684434+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:42:43.684434+0000","last_undegraded":"2023-11-04T01:42:43.684434+0000","last_fullsized":"2023-11-04T01:42:43.684434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714106+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:43.714106+0000","last_peered":"2023-11-04T01:42:43.714106+0000","last_clean":"2023-11-04T01:42:43.714106+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:43.714106+0000","last_undegraded":"2023-11-04T01:42:43.714106+0000","last_fullsized":"2023-11-04T01:42:43.714106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697646+0000","last_change":"2023-11-04T01:42:43.727962+0000","last_active":"2023-11-04T01:42:44.697646+0000","last_peered":"2023-11-04T01:42:44.697646+0000","last_clean":"2023-11-04T01:42:44.697646+0000","last_became_active":"2023-11-04T01:42:43.727300+0000","last_became_peered":"2023-11-04T01:42:43.727300+0000","last_unstale":"2023-11-04T01:42:44.697646+0000","last_undegraded":"2023-11-04T01:42:44.697646+0000","last_fullsized":"2023-11-04T01:42:44.697646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:59:14.632952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217097+0000","last_change":"2023-11-04T01:42:42.665588+0000","last_active":"2023-11-04T01:42:45.217097+0000","last_peered":"2023-11-04T01:42:45.217097+0000","last_clean":"2023-11-04T01:42:45.217097+0000","last_became_active":"2023-11-04T01:42:42.664840+0000","last_became_peered":"2023-11-04T01:42:42.664840+0000","last_unstale":"2023-11-04T01:42:45.217097+0000","last_undegraded":"2023-11-04T01:42:45.217097+0000","last_fullsized":"2023-11-04T01:42:45.217097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:25.587980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.687185+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:42:43.687185+0000","last_peered":"2023-11-04T01:42:43.687185+0000","last_clean":"2023-11-04T01:42:43.687185+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:42:43.687185+0000","last_undegraded":"2023-11-04T01:42:43.687185+0000","last_fullsized":"2023-11-04T01:42:43.687185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650801+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:42:42.650801+0000","last_peered":"2023-11-04T01:42:42.650801+0000","last_clean":"2023-11-04T01:42:42.650801+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:42:42.650801+0000","last_undegraded":"2023-11-04T01:42:42.650801+0000","last_fullsized":"2023-11-04T01:42:42.650801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651210+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:42.651210+0000","last_peered":"2023-11-04T01:42:42.651210+0000","last_clean":"2023-11-04T01:42:42.651210+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:42.651210+0000","last_undegraded":"2023-11-04T01:42:42.651210+0000","last_fullsized":"2023-11-04T01:42:42.651210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217642+0000","last_change":"2023-11-04T01:42:43.723303+0000","last_active":"2023-11-04T01:42:45.217642+0000","last_peered":"2023-11-04T01:42:45.217642+0000","last_clean":"2023-11-04T01:42:45.217642+0000","last_became_active":"2023-11-04T01:42:43.722575+0000","last_became_peered":"2023-11-04T01:42:43.722575+0000","last_unstale":"2023-11-04T01:42:45.217642+0000","last_undegraded":"2023-11-04T01:42:45.217642+0000","last_fullsized":"2023-11-04T01:42:45.217642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:31.410384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.943412+0000","last_change":"2023-11-04T01:42:42.684865+0000","last_active":"2023-11-04T01:42:43.943412+0000","last_peered":"2023-11-04T01:42:43.943412+0000","last_clean":"2023-11-04T01:42:43.943412+0000","last_became_active":"2023-11-04T01:42:42.684172+0000","last_became_peered":"2023-11-04T01:42:42.684172+0000","last_unstale":"2023-11-04T01:42:43.943412+0000","last_undegraded":"2023-11-04T01:42:43.943412+0000","last_fullsized":"2023-11-04T01:42:43.943412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:59.851086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.707830+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:42:43.707830+0000","last_peered":"2023-11-04T01:42:43.707830+0000","last_clean":"2023-11-04T01:42:43.707830+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:42:43.707830+0000","last_undegraded":"2023-11-04T01:42:43.707830+0000","last_fullsized":"2023-11-04T01:42:43.707830+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.690418+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:42:43.690418+0000","last_peered":"2023-11-04T01:42:43.690418+0000","last_clean":"2023-11-04T01:42:43.690418+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:42:43.690418+0000","last_undegraded":"2023-11-04T01:42:43.690418+0000","last_fullsized":"2023-11-04T01:42:43.690418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652314+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:42.652314+0000","last_peered":"2023-11-04T01:42:42.652314+0000","last_clean":"2023-11-04T01:42:42.652314+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:42.652314+0000","last_undegraded":"2023-11-04T01:42:42.652314+0000","last_fullsized":"2023-11-04T01:42:42.652314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212459+0000","last_change":"2023-11-04T01:42:43.720105+0000","last_active":"2023-11-04T01:42:45.212459+0000","last_peered":"2023-11-04T01:42:45.212459+0000","last_clean":"2023-11-04T01:42:45.212459+0000","last_became_active":"2023-11-04T01:42:43.719282+0000","last_became_peered":"2023-11-04T01:42:43.719282+0000","last_unstale":"2023-11-04T01:42:45.212459+0000","last_undegraded":"2023-11-04T01:42:45.212459+0000","last_fullsized":"2023-11-04T01:42:45.212459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:36:33.921263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696148+0000","last_change":"2023-11-04T01:42:42.688067+0000","last_active":"2023-11-04T01:42:44.696148+0000","last_peered":"2023-11-04T01:42:44.696148+0000","last_clean":"2023-11-04T01:42:44.696148+0000","last_became_active":"2023-11-04T01:42:42.686541+0000","last_became_peered":"2023-11-04T01:42:42.686541+0000","last_unstale":"2023-11-04T01:42:44.696148+0000","last_undegraded":"2023-11-04T01:42:44.696148+0000","last_fullsized":"2023-11-04T01:42:44.696148+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:19.426502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711953+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:42:43.711953+0000","last_peered":"2023-11-04T01:42:43.711953+0000","last_clean":"2023-11-04T01:42:43.711953+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:42:43.711953+0000","last_undegraded":"2023-11-04T01:42:43.711953+0000","last_fullsized":"2023-11-04T01:42:43.711953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.709604+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:42:43.709604+0000","last_peered":"2023-11-04T01:42:43.709604+0000","last_clean":"2023-11-04T01:42:43.709604+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:42:43.709604+0000","last_undegraded":"2023-11-04T01:42:43.709604+0000","last_fullsized":"2023-11-04T01:42:43.709604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.693954+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:43.693954+0000","last_peered":"2023-11-04T01:42:43.693954+0000","last_clean":"2023-11-04T01:42:43.693954+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:43.693954+0000","last_undegraded":"2023-11-04T01:42:43.693954+0000","last_fullsized":"2023-11-04T01:42:43.693954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211628+0000","last_change":"2023-11-04T01:42:43.749581+0000","last_active":"2023-11-04T01:42:45.211628+0000","last_peered":"2023-11-04T01:42:45.211628+0000","last_clean":"2023-11-04T01:42:45.211628+0000","last_became_active":"2023-11-04T01:42:43.748602+0000","last_became_peered":"2023-11-04T01:42:43.748602+0000","last_unstale":"2023-11-04T01:42:45.211628+0000","last_undegraded":"2023-11-04T01:42:45.211628+0000","last_fullsized":"2023-11-04T01:42:45.211628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:13.408437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711272+0000","last_change":"2023-11-04T01:42:42.687069+0000","last_active":"2023-11-04T01:42:43.711272+0000","last_peered":"2023-11-04T01:42:43.711272+0000","last_clean":"2023-11-04T01:42:43.711272+0000","last_became_active":"2023-11-04T01:42:42.686704+0000","last_became_peered":"2023-11-04T01:42:42.686704+0000","last_unstale":"2023-11-04T01:42:43.711272+0000","last_undegraded":"2023-11-04T01:42:43.711272+0000","last_fullsized":"2023-11-04T01:42:43.711272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:00.128073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.708090+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:42:43.708090+0000","last_peered":"2023-11-04T01:42:43.708090+0000","last_clean":"2023-11-04T01:42:43.708090+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:42:43.708090+0000","last_undegraded":"2023-11-04T01:42:43.708090+0000","last_fullsized":"2023-11-04T01:42:43.708090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650923+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:42:42.650923+0000","last_peered":"2023-11-04T01:42:42.650923+0000","last_clean":"2023-11-04T01:42:42.650923+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:42:42.650923+0000","last_undegraded":"2023-11-04T01:42:42.650923+0000","last_fullsized":"2023-11-04T01:42:42.650923+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666346+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:42.666346+0000","last_peered":"2023-11-04T01:42:42.666346+0000","last_clean":"2023-11-04T01:42:42.666346+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:42.666346+0000","last_undegraded":"2023-11-04T01:42:42.666346+0000","last_fullsized":"2023-11-04T01:42:42.666346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693178+0000","last_change":"2023-11-04T01:42:43.748391+0000","last_active":"2023-11-04T01:42:44.693178+0000","last_peered":"2023-11-04T01:42:44.693178+0000","last_clean":"2023-11-04T01:42:44.693178+0000","last_became_active":"2023-11-04T01:42:43.747586+0000","last_became_peered":"2023-11-04T01:42:43.747586+0000","last_unstale":"2023-11-04T01:42:44.693178+0000","last_undegraded":"2023-11-04T01:42:44.693178+0000","last_fullsized":"2023-11-04T01:42:44.693178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:44.245490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.705735+0000","last_change":"2023-11-04T01:42:42.690628+0000","last_active":"2023-11-04T01:42:43.705735+0000","last_peered":"2023-11-04T01:42:43.705735+0000","last_clean":"2023-11-04T01:42:43.705735+0000","last_became_active":"2023-11-04T01:42:42.689864+0000","last_became_peered":"2023-11-04T01:42:42.689864+0000","last_unstale":"2023-11-04T01:42:43.705735+0000","last_undegraded":"2023-11-04T01:42:43.705735+0000","last_fullsized":"2023-11-04T01:42:43.705735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:59:22.325103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.691429+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:42:43.691429+0000","last_peered":"2023-11-04T01:42:43.691429+0000","last_clean":"2023-11-04T01:42:43.691429+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:42:43.691429+0000","last_undegraded":"2023-11-04T01:42:43.691429+0000","last_fullsized":"2023-11-04T01:42:43.691429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670183+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:42:42.670183+0000","last_peered":"2023-11-04T01:42:42.670183+0000","last_clean":"2023-11-04T01:42:42.670183+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:42:42.670183+0000","last_undegraded":"2023-11-04T01:42:42.670183+0000","last_fullsized":"2023-11-04T01:42:42.670183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651660+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:42.651660+0000","last_peered":"2023-11-04T01:42:42.651660+0000","last_clean":"2023-11-04T01:42:42.651660+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:42.651660+0000","last_undegraded":"2023-11-04T01:42:42.651660+0000","last_fullsized":"2023-11-04T01:42:42.651660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.691820+0000","last_change":"2023-11-04T01:42:43.749377+0000","last_active":"2023-11-04T01:42:44.691820+0000","last_peered":"2023-11-04T01:42:44.691820+0000","last_clean":"2023-11-04T01:42:44.691820+0000","last_became_active":"2023-11-04T01:42:43.746165+0000","last_became_peered":"2023-11-04T01:42:43.746165+0000","last_unstale":"2023-11-04T01:42:44.691820+0000","last_undegraded":"2023-11-04T01:42:44.691820+0000","last_fullsized":"2023-11-04T01:42:44.691820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:31.410384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693308+0000","last_change":"2023-11-04T01:42:42.685655+0000","last_active":"2023-11-04T01:42:44.693308+0000","last_peered":"2023-11-04T01:42:44.693308+0000","last_clean":"2023-11-04T01:42:44.693308+0000","last_became_active":"2023-11-04T01:42:42.684892+0000","last_became_peered":"2023-11-04T01:42:42.684892+0000","last_unstale":"2023-11-04T01:42:44.693308+0000","last_undegraded":"2023-11-04T01:42:44.693308+0000","last_fullsized":"2023-11-04T01:42:44.693308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:19.791843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714006+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:42:43.714006+0000","last_peered":"2023-11-04T01:42:43.714006+0000","last_clean":"2023-11-04T01:42:43.714006+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:42:43.714006+0000","last_undegraded":"2023-11-04T01:42:43.714006+0000","last_fullsized":"2023-11-04T01:42:43.714006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.669962+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:42:42.669962+0000","last_peered":"2023-11-04T01:42:42.669962+0000","last_clean":"2023-11-04T01:42:42.669962+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:42:42.669962+0000","last_undegraded":"2023-11-04T01:42:42.669962+0000","last_fullsized":"2023-11-04T01:42:42.669962+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698300+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:43.698300+0000","last_peered":"2023-11-04T01:42:43.698300+0000","last_clean":"2023-11-04T01:42:43.698300+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:43.698300+0000","last_undegraded":"2023-11-04T01:42:43.698300+0000","last_fullsized":"2023-11-04T01:42:43.698300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.216850+0000","last_change":"2023-11-04T01:42:43.711716+0000","last_active":"2023-11-04T01:42:45.216850+0000","last_peered":"2023-11-04T01:42:45.216850+0000","last_clean":"2023-11-04T01:42:45.216850+0000","last_became_active":"2023-11-04T01:42:43.710928+0000","last_became_peered":"2023-11-04T01:42:43.710928+0000","last_unstale":"2023-11-04T01:42:45.216850+0000","last_undegraded":"2023-11-04T01:42:45.216850+0000","last_fullsized":"2023-11-04T01:42:45.216850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:20.795898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693023+0000","last_change":"2023-11-04T01:42:42.668700+0000","last_active":"2023-11-04T01:42:44.693023+0000","last_peered":"2023-11-04T01:42:44.693023+0000","last_clean":"2023-11-04T01:42:44.693023+0000","last_became_active":"2023-11-04T01:42:42.668293+0000","last_became_peered":"2023-11-04T01:42:42.668293+0000","last_unstale":"2023-11-04T01:42:44.693023+0000","last_undegraded":"2023-11-04T01:42:44.693023+0000","last_fullsized":"2023-11-04T01:42:44.693023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:13.014595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.713641+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:42:43.713641+0000","last_peered":"2023-11-04T01:42:43.713641+0000","last_clean":"2023-11-04T01:42:43.713641+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:42:43.713641+0000","last_undegraded":"2023-11-04T01:42:43.713641+0000","last_fullsized":"2023-11-04T01:42:43.713641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.687185+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:42:43.687185+0000","last_peered":"2023-11-04T01:42:43.687185+0000","last_clean":"2023-11-04T01:42:43.687185+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:42:43.687185+0000","last_undegraded":"2023-11-04T01:42:43.687185+0000","last_fullsized":"2023-11-04T01:42:43.687185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666922+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:42.666922+0000","last_peered":"2023-11-04T01:42:42.666922+0000","last_clean":"2023-11-04T01:42:42.666922+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:42.666922+0000","last_undegraded":"2023-11-04T01:42:42.666922+0000","last_fullsized":"2023-11-04T01:42:42.666922+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.752579+0000","last_change":"2023-11-04T01:42:43.749905+0000","last_active":"2023-11-04T01:42:43.752579+0000","last_peered":"2023-11-04T01:42:43.752579+0000","last_clean":"2023-11-04T01:42:43.752579+0000","last_became_active":"2023-11-04T01:42:43.749377+0000","last_became_peered":"2023-11-04T01:42:43.749377+0000","last_unstale":"2023-11-04T01:42:43.752579+0000","last_undegraded":"2023-11-04T01:42:43.752579+0000","last_fullsized":"2023-11-04T01:42:43.752579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:18.879566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.941423+0000","last_change":"2023-11-04T01:42:42.687078+0000","last_active":"2023-11-04T01:42:43.941423+0000","last_peered":"2023-11-04T01:42:43.941423+0000","last_clean":"2023-11-04T01:42:43.941423+0000","last_became_active":"2023-11-04T01:42:42.686361+0000","last_became_peered":"2023-11-04T01:42:42.686361+0000","last_unstale":"2023-11-04T01:42:43.941423+0000","last_undegraded":"2023-11-04T01:42:43.941423+0000","last_fullsized":"2023-11-04T01:42:43.941423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:27.929326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698364+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:42:43.698364+0000","last_peered":"2023-11-04T01:42:43.698364+0000","last_clean":"2023-11-04T01:42:43.698364+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:42:43.698364+0000","last_undegraded":"2023-11-04T01:42:43.698364+0000","last_fullsized":"2023-11-04T01:42:43.698364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.709984+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:42:43.709984+0000","last_peered":"2023-11-04T01:42:43.709984+0000","last_clean":"2023-11-04T01:42:43.709984+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:42:43.709984+0000","last_undegraded":"2023-11-04T01:42:43.709984+0000","last_fullsized":"2023-11-04T01:42:43.709984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.702267+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:43.702267+0000","last_peered":"2023-11-04T01:42:43.702267+0000","last_clean":"2023-11-04T01:42:43.702267+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:43.702267+0000","last_undegraded":"2023-11-04T01:42:43.702267+0000","last_fullsized":"2023-11-04T01:42:43.702267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212811+0000","last_change":"2023-11-04T01:42:43.726928+0000","last_active":"2023-11-04T01:42:45.212811+0000","last_peered":"2023-11-04T01:42:45.212811+0000","last_clean":"2023-11-04T01:42:45.212811+0000","last_became_active":"2023-11-04T01:42:43.723675+0000","last_became_peered":"2023-11-04T01:42:43.723675+0000","last_unstale":"2023-11-04T01:42:45.212811+0000","last_undegraded":"2023-11-04T01:42:45.212811+0000","last_fullsized":"2023-11-04T01:42:45.212811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:18.281438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.216837+0000","last_change":"2023-11-04T01:42:42.678387+0000","last_active":"2023-11-04T01:42:45.216837+0000","last_peered":"2023-11-04T01:42:45.216837+0000","last_clean":"2023-11-04T01:42:45.216837+0000","last_became_active":"2023-11-04T01:42:42.677579+0000","last_became_peered":"2023-11-04T01:42:42.677579+0000","last_unstale":"2023-11-04T01:42:45.216837+0000","last_undegraded":"2023-11-04T01:42:45.216837+0000","last_fullsized":"2023-11-04T01:42:45.216837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:43.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.702060+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:42:43.702060+0000","last_peered":"2023-11-04T01:42:43.702060+0000","last_clean":"2023-11-04T01:42:43.702060+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:42:43.702060+0000","last_undegraded":"2023-11-04T01:42:43.702060+0000","last_fullsized":"2023-11-04T01:42:43.702060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692409+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:42:43.692409+0000","last_peered":"2023-11-04T01:42:43.692409+0000","last_clean":"2023-11-04T01:42:43.692409+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:42:43.692409+0000","last_undegraded":"2023-11-04T01:42:43.692409+0000","last_fullsized":"2023-11-04T01:42:43.692409+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.708123+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:43.708123+0000","last_peered":"2023-11-04T01:42:43.708123+0000","last_clean":"2023-11-04T01:42:43.708123+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:43.708123+0000","last_undegraded":"2023-11-04T01:42:43.708123+0000","last_fullsized":"2023-11-04T01:42:43.708123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211648+0000","last_change":"2023-11-04T01:42:43.726416+0000","last_active":"2023-11-04T01:42:45.211648+0000","last_peered":"2023-11-04T01:42:45.211648+0000","last_clean":"2023-11-04T01:42:45.211648+0000","last_became_active":"2023-11-04T01:42:43.725514+0000","last_became_peered":"2023-11-04T01:42:43.725514+0000","last_unstale":"2023-11-04T01:42:45.211648+0000","last_undegraded":"2023-11-04T01:42:45.211648+0000","last_fullsized":"2023-11-04T01:42:45.211648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:23.833591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217468+0000","last_change":"2023-11-04T01:42:42.659965+0000","last_active":"2023-11-04T01:42:45.217468+0000","last_peered":"2023-11-04T01:42:45.217468+0000","last_clean":"2023-11-04T01:42:45.217468+0000","last_became_active":"2023-11-04T01:42:42.659198+0000","last_became_peered":"2023-11-04T01:42:42.659198+0000","last_unstale":"2023-11-04T01:42:45.217468+0000","last_undegraded":"2023-11-04T01:42:45.217468+0000","last_fullsized":"2023-11-04T01:42:45.217468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:25.419862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.709839+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:42:43.709839+0000","last_peered":"2023-11-04T01:42:43.709839+0000","last_clean":"2023-11-04T01:42:43.709839+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:42:43.709839+0000","last_undegraded":"2023-11-04T01:42:43.709839+0000","last_fullsized":"2023-11-04T01:42:43.709839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696302+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:42:43.696302+0000","last_peered":"2023-11-04T01:42:43.696302+0000","last_clean":"2023-11-04T01:42:43.696302+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:42:43.696302+0000","last_undegraded":"2023-11-04T01:42:43.696302+0000","last_fullsized":"2023-11-04T01:42:43.696302+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649925+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:42.649925+0000","last_peered":"2023-11-04T01:42:42.649925+0000","last_clean":"2023-11-04T01:42:42.649925+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:42.649925+0000","last_undegraded":"2023-11-04T01:42:42.649925+0000","last_fullsized":"2023-11-04T01:42:42.649925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212111+0000","last_change":"2023-11-04T01:42:43.717710+0000","last_active":"2023-11-04T01:42:45.212111+0000","last_peered":"2023-11-04T01:42:45.212111+0000","last_clean":"2023-11-04T01:42:45.212111+0000","last_became_active":"2023-11-04T01:42:43.716816+0000","last_became_peered":"2023-11-04T01:42:43.716816+0000","last_unstale":"2023-11-04T01:42:45.212111+0000","last_undegraded":"2023-11-04T01:42:45.212111+0000","last_fullsized":"2023-11-04T01:42:45.212111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:01.997777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694719+0000","last_change":"2023-11-04T01:42:42.688587+0000","last_active":"2023-11-04T01:42:44.694719+0000","last_peered":"2023-11-04T01:42:44.694719+0000","last_clean":"2023-11-04T01:42:44.694719+0000","last_became_active":"2023-11-04T01:42:42.687359+0000","last_became_peered":"2023-11-04T01:42:42.687359+0000","last_unstale":"2023-11-04T01:42:44.694719+0000","last_undegraded":"2023-11-04T01:42:44.694719+0000","last_fullsized":"2023-11-04T01:42:44.694719+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:42.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696564+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:42:43.696564+0000","last_peered":"2023-11-04T01:42:43.696564+0000","last_clean":"2023-11-04T01:42:43.696564+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:42:43.696564+0000","last_undegraded":"2023-11-04T01:42:43.696564+0000","last_fullsized":"2023-11-04T01:42:43.696564+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649808+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:42:42.649808+0000","last_peered":"2023-11-04T01:42:42.649808+0000","last_clean":"2023-11-04T01:42:42.649808+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:42:42.649808+0000","last_undegraded":"2023-11-04T01:42:42.649808+0000","last_fullsized":"2023-11-04T01:42:42.649808+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670912+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:42.670912+0000","last_peered":"2023-11-04T01:42:42.670912+0000","last_clean":"2023-11-04T01:42:42.670912+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:42.670912+0000","last_undegraded":"2023-11-04T01:42:42.670912+0000","last_fullsized":"2023-11-04T01:42:42.670912+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.754619+0000","last_change":"2023-11-04T01:42:43.747035+0000","last_active":"2023-11-04T01:42:43.754619+0000","last_peered":"2023-11-04T01:42:43.754619+0000","last_clean":"2023-11-04T01:42:43.754619+0000","last_became_active":"2023-11-04T01:42:43.746529+0000","last_became_peered":"2023-11-04T01:42:43.746529+0000","last_unstale":"2023-11-04T01:42:43.754619+0000","last_undegraded":"2023-11-04T01:42:43.754619+0000","last_fullsized":"2023-11-04T01:42:43.754619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:18.364070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692178+0000","last_change":"2023-11-04T01:42:42.660585+0000","last_active":"2023-11-04T01:42:44.692178+0000","last_peered":"2023-11-04T01:42:44.692178+0000","last_clean":"2023-11-04T01:42:44.692178+0000","last_became_active":"2023-11-04T01:42:42.660169+0000","last_became_peered":"2023-11-04T01:42:42.660169+0000","last_unstale":"2023-11-04T01:42:44.692178+0000","last_undegraded":"2023-11-04T01:42:44.692178+0000","last_fullsized":"2023-11-04T01:42:44.692178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:42.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.697699+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:42:43.697699+0000","last_peered":"2023-11-04T01:42:43.697699+0000","last_clean":"2023-11-04T01:42:43.697699+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:42:43.697699+0000","last_undegraded":"2023-11-04T01:42:43.697699+0000","last_fullsized":"2023-11-04T01:42:43.697699+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673094+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:42:42.673094+0000","last_peered":"2023-11-04T01:42:42.673094+0000","last_clean":"2023-11-04T01:42:42.673094+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:42:42.673094+0000","last_undegraded":"2023-11-04T01:42:42.673094+0000","last_fullsized":"2023-11-04T01:42:42.673094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714704+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:43.714704+0000","last_peered":"2023-11-04T01:42:43.714704+0000","last_clean":"2023-11-04T01:42:43.714704+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:43.714704+0000","last_undegraded":"2023-11-04T01:42:43.714704+0000","last_fullsized":"2023-11-04T01:42:43.714704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.732766+0000","last_change":"2023-11-04T01:42:43.718982+0000","last_active":"2023-11-04T01:42:43.732766+0000","last_peered":"2023-11-04T01:42:43.732766+0000","last_clean":"2023-11-04T01:42:43.732766+0000","last_became_active":"2023-11-04T01:42:43.718119+0000","last_became_peered":"2023-11-04T01:42:43.718119+0000","last_unstale":"2023-11-04T01:42:43.732766+0000","last_undegraded":"2023-11-04T01:42:43.732766+0000","last_fullsized":"2023-11-04T01:42:43.732766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:20.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"78'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692066+0000","last_change":"2023-11-04T01:42:42.658742+0000","last_active":"2023-11-04T01:42:44.692066+0000","last_peered":"2023-11-04T01:42:44.692066+0000","last_clean":"2023-11-04T01:42:44.692066+0000","last_became_active":"2023-11-04T01:42:42.658224+0000","last_became_peered":"2023-11-04T01:42:42.658224+0000","last_unstale":"2023-11-04T01:42:44.692066+0000","last_undegraded":"2023-11-04T01:42:44.692066+0000","last_fullsized":"2023-11-04T01:42:44.692066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:19.426502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692076+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:42:43.692076+0000","last_peered":"2023-11-04T01:42:43.692076+0000","last_clean":"2023-11-04T01:42:43.692076+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:42:43.692076+0000","last_undegraded":"2023-11-04T01:42:43.692076+0000","last_fullsized":"2023-11-04T01:42:43.692076+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.694181+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:42:43.694181+0000","last_peered":"2023-11-04T01:42:43.694181+0000","last_clean":"2023-11-04T01:42:43.694181+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:42:43.694181+0000","last_undegraded":"2023-11-04T01:42:43.694181+0000","last_fullsized":"2023-11-04T01:42:43.694181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652878+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:42.652878+0000","last_peered":"2023-11-04T01:42:42.652878+0000","last_clean":"2023-11-04T01:42:42.652878+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:42.652878+0000","last_undegraded":"2023-11-04T01:42:42.652878+0000","last_fullsized":"2023-11-04T01:42:42.652878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692583+0000","last_change":"2023-11-04T01:42:43.724939+0000","last_active":"2023-11-04T01:42:44.692583+0000","last_peered":"2023-11-04T01:42:44.692583+0000","last_clean":"2023-11-04T01:42:44.692583+0000","last_became_active":"2023-11-04T01:42:43.724100+0000","last_became_peered":"2023-11-04T01:42:43.724100+0000","last_unstale":"2023-11-04T01:42:44.692583+0000","last_undegraded":"2023-11-04T01:42:44.692583+0000","last_fullsized":"2023-11-04T01:42:44.692583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:24.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.943578+0000","last_change":"2023-11-04T01:42:42.690641+0000","last_active":"2023-11-04T01:42:43.943578+0000","last_peered":"2023-11-04T01:42:43.943578+0000","last_clean":"2023-11-04T01:42:43.943578+0000","last_became_active":"2023-11-04T01:42:42.689847+0000","last_became_peered":"2023-11-04T01:42:42.689847+0000","last_unstale":"2023-11-04T01:42:43.943578+0000","last_undegraded":"2023-11-04T01:42:43.943578+0000","last_fullsized":"2023-11-04T01:42:43.943578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:27.253450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.664522+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:42:42.664522+0000","last_peered":"2023-11-04T01:42:42.664522+0000","last_clean":"2023-11-04T01:42:42.664522+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:42:42.664522+0000","last_undegraded":"2023-11-04T01:42:42.664522+0000","last_fullsized":"2023-11-04T01:42:42.664522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650404+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:42:42.650404+0000","last_peered":"2023-11-04T01:42:42.650404+0000","last_clean":"2023-11-04T01:42:42.650404+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:42:42.650404+0000","last_undegraded":"2023-11-04T01:42:42.650404+0000","last_fullsized":"2023-11-04T01:42:42.650404+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.697916+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:43.697916+0000","last_peered":"2023-11-04T01:42:43.697916+0000","last_clean":"2023-11-04T01:42:43.697916+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:43.697916+0000","last_undegraded":"2023-11-04T01:42:43.697916+0000","last_fullsized":"2023-11-04T01:42:43.697916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692574+0000","last_change":"2023-11-04T01:42:43.716447+0000","last_active":"2023-11-04T01:42:44.692574+0000","last_peered":"2023-11-04T01:42:44.692574+0000","last_clean":"2023-11-04T01:42:44.692574+0000","last_became_active":"2023-11-04T01:42:43.715593+0000","last_became_peered":"2023-11-04T01:42:43.715593+0000","last_unstale":"2023-11-04T01:42:44.692574+0000","last_undegraded":"2023-11-04T01:42:44.692574+0000","last_fullsized":"2023-11-04T01:42:44.692574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.572398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211503+0000","last_change":"2023-11-04T01:42:42.690062+0000","last_active":"2023-11-04T01:42:45.211503+0000","last_peered":"2023-11-04T01:42:45.211503+0000","last_clean":"2023-11-04T01:42:45.211503+0000","last_became_active":"2023-11-04T01:42:42.689828+0000","last_became_peered":"2023-11-04T01:42:42.689828+0000","last_unstale":"2023-11-04T01:42:45.211503+0000","last_undegraded":"2023-11-04T01:42:45.211503+0000","last_fullsized":"2023-11-04T01:42:45.211503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:59.851086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.704487+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:42:43.704487+0000","last_peered":"2023-11-04T01:42:43.704487+0000","last_clean":"2023-11-04T01:42:43.704487+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:42:43.704487+0000","last_undegraded":"2023-11-04T01:42:43.704487+0000","last_fullsized":"2023-11-04T01:42:43.704487+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.686967+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:42:43.686967+0000","last_peered":"2023-11-04T01:42:43.686967+0000","last_clean":"2023-11-04T01:42:43.686967+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:42:43.686967+0000","last_undegraded":"2023-11-04T01:42:43.686967+0000","last_fullsized":"2023-11-04T01:42:43.686967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692286+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:43.692286+0000","last_peered":"2023-11-04T01:42:43.692286+0000","last_clean":"2023-11-04T01:42:43.692286+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:43.692286+0000","last_undegraded":"2023-11-04T01:42:43.692286+0000","last_fullsized":"2023-11-04T01:42:43.692286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.739454+0000","last_change":"2023-11-04T01:42:43.736350+0000","last_active":"2023-11-04T01:42:43.739454+0000","last_peered":"2023-11-04T01:42:43.739454+0000","last_clean":"2023-11-04T01:42:43.739454+0000","last_became_active":"2023-11-04T01:42:43.735588+0000","last_became_peered":"2023-11-04T01:42:43.735588+0000","last_unstale":"2023-11-04T01:42:43.739454+0000","last_undegraded":"2023-11-04T01:42:43.739454+0000","last_fullsized":"2023-11-04T01:42:43.739454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:13.408437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"78'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697090+0000","last_change":"2023-11-04T01:42:42.696074+0000","last_active":"2023-11-04T01:42:44.697090+0000","last_peered":"2023-11-04T01:42:44.697090+0000","last_clean":"2023-11-04T01:42:44.697090+0000","last_became_active":"2023-11-04T01:42:42.695509+0000","last_became_peered":"2023-11-04T01:42:42.695509+0000","last_unstale":"2023-11-04T01:42:44.697090+0000","last_undegraded":"2023-11-04T01:42:44.697090+0000","last_fullsized":"2023-11-04T01:42:44.697090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:27.206477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692034+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:42:43.692034+0000","last_peered":"2023-11-04T01:42:43.692034+0000","last_clean":"2023-11-04T01:42:43.692034+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:42:43.692034+0000","last_undegraded":"2023-11-04T01:42:43.692034+0000","last_fullsized":"2023-11-04T01:42:43.692034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692156+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:42:43.692156+0000","last_peered":"2023-11-04T01:42:43.692156+0000","last_clean":"2023-11-04T01:42:43.692156+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:42:43.692156+0000","last_undegraded":"2023-11-04T01:42:43.692156+0000","last_fullsized":"2023-11-04T01:42:43.692156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714801+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:43.714801+0000","last_peered":"2023-11-04T01:42:43.714801+0000","last_clean":"2023-11-04T01:42:43.714801+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:43.714801+0000","last_undegraded":"2023-11-04T01:42:43.714801+0000","last_fullsized":"2023-11-04T01:42:43.714801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.695183+0000","last_change":"2023-11-04T01:42:43.752631+0000","last_active":"2023-11-04T01:42:44.695183+0000","last_peered":"2023-11-04T01:42:44.695183+0000","last_clean":"2023-11-04T01:42:44.695183+0000","last_became_active":"2023-11-04T01:42:43.751829+0000","last_became_peered":"2023-11-04T01:42:43.751829+0000","last_unstale":"2023-11-04T01:42:44.695183+0000","last_undegraded":"2023-11-04T01:42:44.695183+0000","last_fullsized":"2023-11-04T01:42:44.695183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:30.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"78'6","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211921+0000","last_change":"2023-11-04T01:42:42.668513+0000","last_active":"2023-11-04T01:42:45.211921+0000","last_peered":"2023-11-04T01:42:45.211921+0000","last_clean":"2023-11-04T01:42:45.211921+0000","last_became_active":"2023-11-04T01:42:42.668106+0000","last_became_peered":"2023-11-04T01:42:42.668106+0000","last_unstale":"2023-11-04T01:42:45.211921+0000","last_undegraded":"2023-11-04T01:42:45.211921+0000","last_fullsized":"2023-11-04T01:42:45.211921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:27.929326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.689325+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:42:43.689325+0000","last_peered":"2023-11-04T01:42:43.689325+0000","last_clean":"2023-11-04T01:42:43.689325+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:42:43.689325+0000","last_undegraded":"2023-11-04T01:42:43.689325+0000","last_fullsized":"2023-11-04T01:42:43.689325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666108+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:42:42.666108+0000","last_peered":"2023-11-04T01:42:42.666108+0000","last_clean":"2023-11-04T01:42:42.666108+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:42:42.666108+0000","last_undegraded":"2023-11-04T01:42:42.666108+0000","last_fullsized":"2023-11-04T01:42:42.666108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.672392+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:42.672392+0000","last_peered":"2023-11-04T01:42:42.672392+0000","last_clean":"2023-11-04T01:42:42.672392+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:42.672392+0000","last_undegraded":"2023-11-04T01:42:42.672392+0000","last_fullsized":"2023-11-04T01:42:42.672392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693774+0000","last_change":"2023-11-04T01:42:43.733441+0000","last_active":"2023-11-04T01:42:44.693774+0000","last_peered":"2023-11-04T01:42:44.693774+0000","last_clean":"2023-11-04T01:42:44.693774+0000","last_became_active":"2023-11-04T01:42:43.732449+0000","last_became_peered":"2023-11-04T01:42:43.732449+0000","last_unstale":"2023-11-04T01:42:44.693774+0000","last_undegraded":"2023-11-04T01:42:44.693774+0000","last_fullsized":"2023-11-04T01:42:44.693774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:54.908022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697836+0000","last_change":"2023-11-04T01:42:42.672646+0000","last_active":"2023-11-04T01:42:44.697836+0000","last_peered":"2023-11-04T01:42:44.697836+0000","last_clean":"2023-11-04T01:42:44.697836+0000","last_became_active":"2023-11-04T01:42:42.671776+0000","last_became_peered":"2023-11-04T01:42:42.671776+0000","last_unstale":"2023-11-04T01:42:44.697836+0000","last_undegraded":"2023-11-04T01:42:44.697836+0000","last_fullsized":"2023-11-04T01:42:44.697836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:53.903967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.686221+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:42:43.686221+0000","last_peered":"2023-11-04T01:42:43.686221+0000","last_clean":"2023-11-04T01:42:43.686221+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:42:43.686221+0000","last_undegraded":"2023-11-04T01:42:43.686221+0000","last_fullsized":"2023-11-04T01:42:43.686221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649543+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:42:42.649543+0000","last_peered":"2023-11-04T01:42:42.649543+0000","last_clean":"2023-11-04T01:42:42.649543+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:42:42.649543+0000","last_undegraded":"2023-11-04T01:42:42.649543+0000","last_fullsized":"2023-11-04T01:42:42.649543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.668627+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:42.668627+0000","last_peered":"2023-11-04T01:42:42.668627+0000","last_clean":"2023-11-04T01:42:42.668627+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:42.668627+0000","last_undegraded":"2023-11-04T01:42:42.668627+0000","last_fullsized":"2023-11-04T01:42:42.668627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.733385+0000","last_change":"2023-11-04T01:42:43.727288+0000","last_active":"2023-11-04T01:42:43.733385+0000","last_peered":"2023-11-04T01:42:43.733385+0000","last_clean":"2023-11-04T01:42:43.733385+0000","last_became_active":"2023-11-04T01:42:43.726622+0000","last_became_peered":"2023-11-04T01:42:43.726622+0000","last_unstale":"2023-11-04T01:42:43.733385+0000","last_undegraded":"2023-11-04T01:42:43.733385+0000","last_fullsized":"2023-11-04T01:42:43.733385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:45.524833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711739+0000","last_change":"2023-11-04T01:42:42.668942+0000","last_active":"2023-11-04T01:42:43.711739+0000","last_peered":"2023-11-04T01:42:43.711739+0000","last_clean":"2023-11-04T01:42:43.711739+0000","last_became_active":"2023-11-04T01:42:42.667784+0000","last_became_peered":"2023-11-04T01:42:42.667784+0000","last_unstale":"2023-11-04T01:42:43.711739+0000","last_undegraded":"2023-11-04T01:42:43.711739+0000","last_fullsized":"2023-11-04T01:42:43.711739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:00.993722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696674+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:42:43.696674+0000","last_peered":"2023-11-04T01:42:43.696674+0000","last_clean":"2023-11-04T01:42:43.696674+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:42:43.696674+0000","last_undegraded":"2023-11-04T01:42:43.696674+0000","last_fullsized":"2023-11-04T01:42:43.696674+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.699085+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:42:43.699085+0000","last_peered":"2023-11-04T01:42:43.699085+0000","last_clean":"2023-11-04T01:42:43.699085+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:42:43.699085+0000","last_undegraded":"2023-11-04T01:42:43.699085+0000","last_fullsized":"2023-11-04T01:42:43.699085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.690037+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:43.690037+0000","last_peered":"2023-11-04T01:42:43.690037+0000","last_clean":"2023-11-04T01:42:43.690037+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:43.690037+0000","last_undegraded":"2023-11-04T01:42:43.690037+0000","last_fullsized":"2023-11-04T01:42:43.690037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":1027337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":1.042},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":0.872},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.91300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":1.1879999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":439129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.1990000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.077},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.2549999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.139}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.111}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":444276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":0.997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.123},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.94799999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.871},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.214}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.169}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2490000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":444436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.873},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.1879999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.746},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.01}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.94999999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.127},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.085}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":436913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.309},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.439}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":0.71499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":436913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":1.294}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":1.0629999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":1.008},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.226},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":1.1879999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.327},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.262}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":444346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.62},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1029599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.82399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":1.1379999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.2669999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.319}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:47.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 Processor -- start 2023-11-04T01:42:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 -- start start 2023-11-04T01:42:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d380715d0 0x7f9d380b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 0x7f9d3815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380c2670 con 0x7f9d3815afd0 2023-11-04T01:42:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d38070140 con 0x7f9d380715d0 2023-11-04T01:42:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.130+0000 7f9d3d4d9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d38071a60 con 0x7f9d380b0b70 2023-11-04T01:42:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d36ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9d3815afd0 0x7f9d3806f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45084/0 (socket says 172.21.15.40:45084) 2023-11-04T01:42:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d36ffd640 1 -- 172.21.15.40:0/4153625359 learned_addr learned my addr 172.21.15.40:0/4153625359 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090255524 0 0) 0x7f9d380c2670 con 0x7f9d3815afd0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d20003530 con 0x7f9d3815afd0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 --2- 172.21.15.40:0/4153625359 >> v2:172.21.15.91:3300/0 conn(0x7f9d380715d0 0x7f9d380b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d377fe640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 0x7f9d3815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249679728 0 0) 0x7f9d20003530 con 0x7f9d3815afd0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 msgr2=0x7f9d3815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 0x7f9d3815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 >> v2:172.21.15.91:3300/0 conn(0x7f9d380715d0 msgr2=0x7f9d380b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 --2- 172.21.15.40:0/4153625359 >> v2:172.21.15.91:3300/0 conn(0x7f9d380715d0 0x7f9d380b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3806bc30 con 0x7f9d3815afd0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9d2c001680 con 0x7f9d3815afd0 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 >> v1:172.21.15.40:6789/0 conn(0x7f9d3815afd0 legacy=0x7f9d3806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 0x7f9d20003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d20004d10 0x7f9d20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d38070140 con 0x7f9d20003f00 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2000b990 con 0x7f9d20004d10 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2000bad0 con 0x7f9d380b0b70 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d36ffd640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 0x7f9d20003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 -- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 msgr2=0x7f9d20003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d377fe640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d20004d10 0x7f9d20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d380b0b70 0x7f9d20003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 -- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d20004d10 msgr2=0x7f9d20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d20004d10 0x7f9d20005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 -- 172.21.15.40:0/4153625359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20003530 con 0x7f9d20003f00 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d367fc640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d200047d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009ae0 tx=0x7f9d2801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f754ec33f5f85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280a5680 con 0x7f9d20003f00 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d280a57e0 con 0x7f9d20003f00 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d35ffb640 1 -- 172.21.15.40:0/4153625359 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280a5b90 con 0x7f9d20003f00 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/4153625359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 msgr2=0x7f9d200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/4153625359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d200047d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009ae0 tx=0x7f9d2801ca30 comp rx=0 tx=0).stop 2023-11-04T01:42:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d377fe640 1 -- 172.21.15.40:0/4153625359 reap_dead start 2023-11-04T01:42:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/4153625359 shutdown_connections 2023-11-04T01:42:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.134+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/4153625359 >> 172.21.15.40:0/4153625359 conn(0x7f9d380cebb0 msgr2=0x7f9d380cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/4153625359 shutdown_connections 2023-11-04T01:42:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/4153625359 wait complete. 2023-11-04T01:42:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 Processor -- start 2023-11-04T01:42:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- start start 2023-11-04T01:42:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d381553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d381f0a40 0x7f9d381f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3815c110 0x7f9d3815c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d381f1b30 con 0x7f9d20003f00 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d38155900 con 0x7f9d3815c110 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d381f1400 con 0x7f9d381f0a40 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d381553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d381553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36296/0 (socket says 172.21.15.40:36296) 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 -- 172.21.15.40:0/3001837675 learned_addr learned my addr 172.21.15.40:0/3001837675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d377fe640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3815c110 0x7f9d3815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 -- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d381f0a40 msgr2=0x7f9d381f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d367fc640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d381f0a40 0x7f9d381f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d381f0a40 0x7f9d381f0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 -- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3815c110 msgr2=0x7f9d3815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3815c110 0x7f9d3815c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 -- 172.21.15.40:0/3001837675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3815ceb0 con 0x7f9d20003f00 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d377fe640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3815c110 0x7f9d3815c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d367fc640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d381f0a40 0x7f9d381f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d36ffd640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d381553c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c010bb0 tx=0x7f9d2c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c00ede0 con 0x7f9d20003f00 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0143a0 con 0x7f9d20003f00 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3815d190 con 0x7f9d20003f00 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c014750 con 0x7f9d20003f00 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d381f2080 con 0x7f9d20003f00 2023-11-04T01:42:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.138+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3815d380 con 0x7f9d20003f00 2023-11-04T01:42:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.142+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d2c0148b0 con 0x7f9d20003f00 2023-11-04T01:42:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.142+0000 7f9d1f7fe640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d240664d0 0x7f9d24068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.142+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f9d2c0872e0 con 0x7f9d20003f00 2023-11-04T01:42:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.142+0000 7f9d367fc640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d240664d0 0x7f9d24068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.142+0000 7f9d367fc640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d240664d0 0x7f9d24068990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d280af000 tx=0x7f9d280046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.146+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d2c0543c0 con 0x7f9d20003f00 2023-11-04T01:42:48.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.294+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d3806bf10 con 0x7f9d240664d0 2023-11-04T01:42:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.334+0000 7f9d1f7fe640 1 -- 172.21.15.40:0/3001837675 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530334 (secure 0 0 0) 0x7f9d280a5950 con 0x7f9d240664d0 2023-11-04T01:42:48.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:48.347 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:42:48.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d240664d0 msgr2=0x7f9d24068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d240664d0 0x7f9d24068990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d280af000 tx=0x7f9d280046d0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 msgr2=0x7f9d381553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d381553c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c010bb0 tx=0x7f9d2c00e4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 shutdown_connections 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d240664d0 0x7f9d24068990 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3815c110 0x7f9d3815c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d381f0a40 0x7f9d381f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 --2- 172.21.15.40:0/3001837675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d20003f00 0x7f9d381553c0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 >> 172.21.15.40:0/3001837675 conn(0x7f9d380cebb0 msgr2=0x7f9d380cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 shutdown_connections 2023-11-04T01:42:48.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.338+0000 7f9d3d4d9640 1 -- 172.21.15.40:0/3001837675 wait complete. 2023-11-04T01:42:48.362 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-11-04T01:42:47.812210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254004,"kb_used_data":8684,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720716,"statfs":{"total":773094113280,"available":772834013184,"internally_reserved":0,"allocated":8892416,"data_stored":4702949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":78,"apply_latency_ms":78,"commit_latency_ns":78000000,"apply_latency_ns":78000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002728"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.739451+0000","last_change":"2023-11-04T01:42:43.735746+0000","last_active":"2023-11-04T01:42:43.739451+0000","last_peered":"2023-11-04T01:42:43.739451+0000","last_clean":"2023-11-04T01:42:43.739451+0000","last_became_active":"2023-11-04T01:42:43.734956+0000","last_became_peered":"2023-11-04T01:42:43.734956+0000","last_unstale":"2023-11-04T01:42:43.739451+0000","last_undegraded":"2023-11-04T01:42:43.739451+0000","last_fullsized":"2023-11-04T01:42:43.739451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:01.776290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696462+0000","last_change":"2023-11-04T01:42:43.722252+0000","last_active":"2023-11-04T01:42:44.696462+0000","last_peered":"2023-11-04T01:42:44.696462+0000","last_clean":"2023-11-04T01:42:44.696462+0000","last_became_active":"2023-11-04T01:42:43.721410+0000","last_became_peered":"2023-11-04T01:42:43.721410+0000","last_unstale":"2023-11-04T01:42:44.696462+0000","last_undegraded":"2023-11-04T01:42:44.696462+0000","last_fullsized":"2023-11-04T01:42:44.696462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:20.790399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.738318+0000","last_change":"2023-11-04T01:42:43.731946+0000","last_active":"2023-11-04T01:42:43.738318+0000","last_peered":"2023-11-04T01:42:43.738318+0000","last_clean":"2023-11-04T01:42:43.738318+0000","last_became_active":"2023-11-04T01:42:43.731105+0000","last_became_peered":"2023-11-04T01:42:43.731105+0000","last_unstale":"2023-11-04T01:42:43.738318+0000","last_undegraded":"2023-11-04T01:42:43.738318+0000","last_fullsized":"2023-11-04T01:42:43.738318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:51.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693757+0000","last_change":"2023-11-04T01:42:43.748982+0000","last_active":"2023-11-04T01:42:44.693757+0000","last_peered":"2023-11-04T01:42:44.693757+0000","last_clean":"2023-11-04T01:42:44.693757+0000","last_became_active":"2023-11-04T01:42:43.748410+0000","last_became_peered":"2023-11-04T01:42:43.748410+0000","last_unstale":"2023-11-04T01:42:44.693757+0000","last_undegraded":"2023-11-04T01:42:44.693757+0000","last_fullsized":"2023-11-04T01:42:44.693757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:54.908022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693063+0000","last_change":"2023-11-04T01:42:43.727104+0000","last_active":"2023-11-04T01:42:44.693063+0000","last_peered":"2023-11-04T01:42:44.693063+0000","last_clean":"2023-11-04T01:42:44.693063+0000","last_became_active":"2023-11-04T01:42:43.726387+0000","last_became_peered":"2023-11-04T01:42:43.726387+0000","last_unstale":"2023-11-04T01:42:44.693063+0000","last_undegraded":"2023-11-04T01:42:44.693063+0000","last_fullsized":"2023-11-04T01:42:44.693063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:24.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211239+0000","last_change":"2023-11-04T01:42:43.750679+0000","last_active":"2023-11-04T01:42:45.211239+0000","last_peered":"2023-11-04T01:42:45.211239+0000","last_clean":"2023-11-04T01:42:45.211239+0000","last_became_active":"2023-11-04T01:42:43.750147+0000","last_became_peered":"2023-11-04T01:42:43.750147+0000","last_unstale":"2023-11-04T01:42:45.211239+0000","last_undegraded":"2023-11-04T01:42:45.211239+0000","last_fullsized":"2023-11-04T01:42:45.211239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:01.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.730261+0000","last_change":"2023-11-04T01:42:43.722771+0000","last_active":"2023-11-04T01:42:43.730261+0000","last_peered":"2023-11-04T01:42:43.730261+0000","last_clean":"2023-11-04T01:42:43.730261+0000","last_became_active":"2023-11-04T01:42:43.721502+0000","last_became_peered":"2023-11-04T01:42:43.721502+0000","last_unstale":"2023-11-04T01:42:43.730261+0000","last_undegraded":"2023-11-04T01:42:43.730261+0000","last_fullsized":"2023-11-04T01:42:43.730261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:59:51.293018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.691802+0000","last_change":"2023-11-04T01:42:43.754318+0000","last_active":"2023-11-04T01:42:44.691802+0000","last_peered":"2023-11-04T01:42:44.691802+0000","last_clean":"2023-11-04T01:42:44.691802+0000","last_became_active":"2023-11-04T01:42:43.753575+0000","last_became_peered":"2023-11-04T01:42:43.753575+0000","last_unstale":"2023-11-04T01:42:44.691802+0000","last_undegraded":"2023-11-04T01:42:44.691802+0000","last_fullsized":"2023-11-04T01:42:44.691802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.572398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694819+0000","last_change":"2023-11-04T01:42:43.718401+0000","last_active":"2023-11-04T01:42:44.694819+0000","last_peered":"2023-11-04T01:42:44.694819+0000","last_clean":"2023-11-04T01:42:44.694819+0000","last_became_active":"2023-11-04T01:42:43.717603+0000","last_became_peered":"2023-11-04T01:42:43.717603+0000","last_unstale":"2023-11-04T01:42:44.694819+0000","last_undegraded":"2023-11-04T01:42:44.694819+0000","last_fullsized":"2023-11-04T01:42:44.694819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:11.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.754700+0000","last_change":"2023-11-04T01:42:43.748637+0000","last_active":"2023-11-04T01:42:43.754700+0000","last_peered":"2023-11-04T01:42:43.754700+0000","last_clean":"2023-11-04T01:42:43.754700+0000","last_became_active":"2023-11-04T01:42:43.747937+0000","last_became_peered":"2023-11-04T01:42:43.747937+0000","last_unstale":"2023-11-04T01:42:43.754700+0000","last_undegraded":"2023-11-04T01:42:43.754700+0000","last_fullsized":"2023-11-04T01:42:43.754700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:36:44.654327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696637+0000","last_change":"2023-11-04T01:42:43.733236+0000","last_active":"2023-11-04T01:42:44.696637+0000","last_peered":"2023-11-04T01:42:44.696637+0000","last_clean":"2023-11-04T01:42:44.696637+0000","last_became_active":"2023-11-04T01:42:43.732493+0000","last_became_peered":"2023-11-04T01:42:43.732493+0000","last_unstale":"2023-11-04T01:42:44.696637+0000","last_undegraded":"2023-11-04T01:42:44.696637+0000","last_fullsized":"2023-11-04T01:42:44.696637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:20.790399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.733503+0000","last_change":"2023-11-04T01:42:43.721444+0000","last_active":"2023-11-04T01:42:43.733503+0000","last_peered":"2023-11-04T01:42:43.733503+0000","last_clean":"2023-11-04T01:42:43.733503+0000","last_became_active":"2023-11-04T01:42:43.720537+0000","last_became_peered":"2023-11-04T01:42:43.720537+0000","last_unstale":"2023-11-04T01:42:43.733503+0000","last_undegraded":"2023-11-04T01:42:43.733503+0000","last_fullsized":"2023-11-04T01:42:43.733503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:31.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693184+0000","last_change":"2023-11-04T01:42:43.754845+0000","last_active":"2023-11-04T01:42:44.693184+0000","last_peered":"2023-11-04T01:42:44.693184+0000","last_clean":"2023-11-04T01:42:44.693184+0000","last_became_active":"2023-11-04T01:42:43.753509+0000","last_became_peered":"2023-11-04T01:42:43.753509+0000","last_unstale":"2023-11-04T01:42:44.693184+0000","last_undegraded":"2023-11-04T01:42:44.693184+0000","last_fullsized":"2023-11-04T01:42:44.693184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:57.842799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692641+0000","last_change":"2023-11-04T01:42:43.751523+0000","last_active":"2023-11-04T01:42:44.692641+0000","last_peered":"2023-11-04T01:42:44.692641+0000","last_clean":"2023-11-04T01:42:44.692641+0000","last_became_active":"2023-11-04T01:42:43.750992+0000","last_became_peered":"2023-11-04T01:42:43.750992+0000","last_unstale":"2023-11-04T01:42:44.692641+0000","last_undegraded":"2023-11-04T01:42:44.692641+0000","last_fullsized":"2023-11-04T01:42:44.692641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:31.410384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.691938+0000","last_change":"2023-11-04T01:42:43.750806+0000","last_active":"2023-11-04T01:42:44.691938+0000","last_peered":"2023-11-04T01:42:44.691938+0000","last_clean":"2023-11-04T01:42:44.691938+0000","last_became_active":"2023-11-04T01:42:43.750053+0000","last_became_peered":"2023-11-04T01:42:43.750053+0000","last_unstale":"2023-11-04T01:42:44.691938+0000","last_undegraded":"2023-11-04T01:42:44.691938+0000","last_fullsized":"2023-11-04T01:42:44.691938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:36.969595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.210568+0000","last_change":"2023-11-04T01:42:43.733214+0000","last_active":"2023-11-04T01:42:45.210568+0000","last_peered":"2023-11-04T01:42:45.210568+0000","last_clean":"2023-11-04T01:42:45.210568+0000","last_became_active":"2023-11-04T01:42:43.732358+0000","last_became_peered":"2023-11-04T01:42:43.732358+0000","last_unstale":"2023-11-04T01:42:45.210568+0000","last_undegraded":"2023-11-04T01:42:45.210568+0000","last_fullsized":"2023-11-04T01:42:45.210568+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:49.639293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212461+0000","last_change":"2023-11-04T01:42:43.729170+0000","last_active":"2023-11-04T01:42:45.212461+0000","last_peered":"2023-11-04T01:42:45.212461+0000","last_clean":"2023-11-04T01:42:45.212461+0000","last_became_active":"2023-11-04T01:42:43.726300+0000","last_became_peered":"2023-11-04T01:42:43.726300+0000","last_unstale":"2023-11-04T01:42:45.212461+0000","last_undegraded":"2023-11-04T01:42:45.212461+0000","last_fullsized":"2023-11-04T01:42:45.212461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:33.138848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.731068+0000","last_change":"2023-11-04T01:42:43.716702+0000","last_active":"2023-11-04T01:42:43.731068+0000","last_peered":"2023-11-04T01:42:43.731068+0000","last_clean":"2023-11-04T01:42:43.731068+0000","last_became_active":"2023-11-04T01:42:43.715046+0000","last_became_peered":"2023-11-04T01:42:43.715046+0000","last_unstale":"2023-11-04T01:42:43.731068+0000","last_undegraded":"2023-11-04T01:42:43.731068+0000","last_fullsized":"2023-11-04T01:42:43.731068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:23.833591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696802+0000","last_change":"2023-11-04T01:42:43.754340+0000","last_active":"2023-11-04T01:42:44.696802+0000","last_peered":"2023-11-04T01:42:44.696802+0000","last_clean":"2023-11-04T01:42:44.696802+0000","last_became_active":"2023-11-04T01:42:43.753657+0000","last_became_peered":"2023-11-04T01:42:43.753657+0000","last_unstale":"2023-11-04T01:42:44.696802+0000","last_undegraded":"2023-11-04T01:42:44.696802+0000","last_fullsized":"2023-11-04T01:42:44.696802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:06.345308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693950+0000","last_change":"2023-11-04T01:42:43.746608+0000","last_active":"2023-11-04T01:42:44.693950+0000","last_peered":"2023-11-04T01:42:44.693950+0000","last_clean":"2023-11-04T01:42:44.693950+0000","last_became_active":"2023-11-04T01:42:43.746006+0000","last_became_peered":"2023-11-04T01:42:43.746006+0000","last_unstale":"2023-11-04T01:42:44.693950+0000","last_undegraded":"2023-11-04T01:42:44.693950+0000","last_fullsized":"2023-11-04T01:42:44.693950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:15.201232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693670+0000","last_change":"2023-11-04T01:42:43.718711+0000","last_active":"2023-11-04T01:42:44.693670+0000","last_peered":"2023-11-04T01:42:44.693670+0000","last_clean":"2023-11-04T01:42:44.693670+0000","last_became_active":"2023-11-04T01:42:43.717638+0000","last_became_peered":"2023-11-04T01:42:43.717638+0000","last_unstale":"2023-11-04T01:42:44.693670+0000","last_undegraded":"2023-11-04T01:42:44.693670+0000","last_fullsized":"2023-11-04T01:42:44.693670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:57.842799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692845+0000","last_change":"2023-11-04T01:42:43.754967+0000","last_active":"2023-11-04T01:42:44.692845+0000","last_peered":"2023-11-04T01:42:44.692845+0000","last_clean":"2023-11-04T01:42:44.692845+0000","last_became_active":"2023-11-04T01:42:43.753889+0000","last_became_peered":"2023-11-04T01:42:43.753889+0000","last_unstale":"2023-11-04T01:42:44.692845+0000","last_undegraded":"2023-11-04T01:42:44.692845+0000","last_fullsized":"2023-11-04T01:42:44.692845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:36.969595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.216340+0000","last_change":"2023-11-04T01:42:43.754519+0000","last_active":"2023-11-04T01:42:45.216340+0000","last_peered":"2023-11-04T01:42:45.216340+0000","last_clean":"2023-11-04T01:42:45.216340+0000","last_became_active":"2023-11-04T01:42:43.753652+0000","last_became_peered":"2023-11-04T01:42:43.753652+0000","last_unstale":"2023-11-04T01:42:45.216340+0000","last_undegraded":"2023-11-04T01:42:45.216340+0000","last_fullsized":"2023-11-04T01:42:45.216340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:43.302108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.735852+0000","last_change":"2023-11-04T01:42:43.729872+0000","last_active":"2023-11-04T01:42:43.735852+0000","last_peered":"2023-11-04T01:42:43.735852+0000","last_clean":"2023-11-04T01:42:43.735852+0000","last_became_active":"2023-11-04T01:42:43.728958+0000","last_became_peered":"2023-11-04T01:42:43.728958+0000","last_unstale":"2023-11-04T01:42:43.735852+0000","last_undegraded":"2023-11-04T01:42:43.735852+0000","last_fullsized":"2023-11-04T01:42:43.735852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:01.126608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697301+0000","last_change":"2023-11-04T01:42:43.712091+0000","last_active":"2023-11-04T01:42:44.697301+0000","last_peered":"2023-11-04T01:42:44.697301+0000","last_clean":"2023-11-04T01:42:44.697301+0000","last_became_active":"2023-11-04T01:42:43.711259+0000","last_became_peered":"2023-11-04T01:42:43.711259+0000","last_unstale":"2023-11-04T01:42:44.697301+0000","last_undegraded":"2023-11-04T01:42:44.697301+0000","last_fullsized":"2023-11-04T01:42:44.697301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:06.345308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694462+0000","last_change":"2023-11-04T01:42:43.751897+0000","last_active":"2023-11-04T01:42:44.694462+0000","last_peered":"2023-11-04T01:42:44.694462+0000","last_clean":"2023-11-04T01:42:44.694462+0000","last_became_active":"2023-11-04T01:42:43.751165+0000","last_became_peered":"2023-11-04T01:42:43.751165+0000","last_unstale":"2023-11-04T01:42:44.694462+0000","last_undegraded":"2023-11-04T01:42:44.694462+0000","last_fullsized":"2023-11-04T01:42:44.694462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:15.201232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.715543+0000","last_change":"2023-11-04T01:42:43.706622+0000","last_active":"2023-11-04T01:42:43.715543+0000","last_peered":"2023-11-04T01:42:43.715543+0000","last_clean":"2023-11-04T01:42:43.715543+0000","last_became_active":"2023-11-04T01:42:43.705865+0000","last_became_peered":"2023-11-04T01:42:43.705865+0000","last_unstale":"2023-11-04T01:42:43.715543+0000","last_undegraded":"2023-11-04T01:42:43.715543+0000","last_fullsized":"2023-11-04T01:42:43.715543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:18:34.906455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694106+0000","last_change":"2023-11-04T01:42:43.726907+0000","last_active":"2023-11-04T01:42:44.694106+0000","last_peered":"2023-11-04T01:42:44.694106+0000","last_clean":"2023-11-04T01:42:44.694106+0000","last_became_active":"2023-11-04T01:42:43.726121+0000","last_became_peered":"2023-11-04T01:42:43.726121+0000","last_unstale":"2023-11-04T01:42:44.694106+0000","last_undegraded":"2023-11-04T01:42:44.694106+0000","last_fullsized":"2023-11-04T01:42:44.694106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:11.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.730328+0000","last_change":"2023-11-04T01:42:43.722903+0000","last_active":"2023-11-04T01:42:43.730328+0000","last_peered":"2023-11-04T01:42:43.730328+0000","last_clean":"2023-11-04T01:42:43.730328+0000","last_became_active":"2023-11-04T01:42:43.722125+0000","last_became_peered":"2023-11-04T01:42:43.722125+0000","last_unstale":"2023-11-04T01:42:43.730328+0000","last_undegraded":"2023-11-04T01:42:43.730328+0000","last_fullsized":"2023-11-04T01:42:43.730328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:25.401425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693205+0000","last_change":"2023-11-04T01:42:43.716549+0000","last_active":"2023-11-04T01:42:44.693205+0000","last_peered":"2023-11-04T01:42:44.693205+0000","last_clean":"2023-11-04T01:42:44.693205+0000","last_became_active":"2023-11-04T01:42:43.715757+0000","last_became_peered":"2023-11-04T01:42:43.715757+0000","last_unstale":"2023-11-04T01:42:44.693205+0000","last_undegraded":"2023-11-04T01:42:44.693205+0000","last_fullsized":"2023-11-04T01:42:44.693205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:44.245490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693210+0000","last_change":"2023-11-04T01:42:43.748737+0000","last_active":"2023-11-04T01:42:44.693210+0000","last_peered":"2023-11-04T01:42:44.693210+0000","last_clean":"2023-11-04T01:42:44.693210+0000","last_became_active":"2023-11-04T01:42:43.748204+0000","last_became_peered":"2023-11-04T01:42:43.748204+0000","last_unstale":"2023-11-04T01:42:44.693210+0000","last_undegraded":"2023-11-04T01:42:44.693210+0000","last_fullsized":"2023-11-04T01:42:44.693210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:04:11.513353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.210633+0000","last_change":"2023-11-04T01:42:43.726957+0000","last_active":"2023-11-04T01:42:45.210633+0000","last_peered":"2023-11-04T01:42:45.210633+0000","last_clean":"2023-11-04T01:42:45.210633+0000","last_became_active":"2023-11-04T01:42:43.724017+0000","last_became_peered":"2023-11-04T01:42:43.724017+0000","last_unstale":"2023-11-04T01:42:45.210633+0000","last_undegraded":"2023-11-04T01:42:45.210633+0000","last_fullsized":"2023-11-04T01:42:45.210633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:17.672541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.724901+0000","last_change":"2023-11-04T01:42:43.721936+0000","last_active":"2023-11-04T01:42:43.724901+0000","last_peered":"2023-11-04T01:42:43.724901+0000","last_clean":"2023-11-04T01:42:43.724901+0000","last_became_active":"2023-11-04T01:42:43.721227+0000","last_became_peered":"2023-11-04T01:42:43.721227+0000","last_unstale":"2023-11-04T01:42:43.724901+0000","last_undegraded":"2023-11-04T01:42:43.724901+0000","last_fullsized":"2023-11-04T01:42:43.724901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:22.685456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694208+0000","last_change":"2023-11-04T01:42:42.674154+0000","last_active":"2023-11-04T01:42:44.694208+0000","last_peered":"2023-11-04T01:42:44.694208+0000","last_clean":"2023-11-04T01:42:44.694208+0000","last_became_active":"2023-11-04T01:42:42.673762+0000","last_became_peered":"2023-11-04T01:42:42.673762+0000","last_unstale":"2023-11-04T01:42:44.694208+0000","last_undegraded":"2023-11-04T01:42:44.694208+0000","last_fullsized":"2023-11-04T01:42:44.694208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:19.791843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670549+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:42:42.670549+0000","last_peered":"2023-11-04T01:42:42.670549+0000","last_clean":"2023-11-04T01:42:42.670549+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:42:42.670549+0000","last_undegraded":"2023-11-04T01:42:42.670549+0000","last_fullsized":"2023-11-04T01:42:42.670549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.664401+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:42:42.664401+0000","last_peered":"2023-11-04T01:42:42.664401+0000","last_clean":"2023-11-04T01:42:42.664401+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:42:42.664401+0000","last_undegraded":"2023-11-04T01:42:42.664401+0000","last_fullsized":"2023-11-04T01:42:42.664401+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673461+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:42:42.673461+0000","last_peered":"2023-11-04T01:42:42.673461+0000","last_clean":"2023-11-04T01:42:42.673461+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:42:42.673461+0000","last_undegraded":"2023-11-04T01:42:42.673461+0000","last_fullsized":"2023-11-04T01:42:42.673461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.695144+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:42:43.695144+0000","last_peered":"2023-11-04T01:42:43.695144+0000","last_clean":"2023-11-04T01:42:43.695144+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:42:43.695144+0000","last_undegraded":"2023-11-04T01:42:43.695144+0000","last_fullsized":"2023-11-04T01:42:43.695144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693629+0000","last_change":"2023-11-04T01:42:43.727759+0000","last_active":"2023-11-04T01:42:44.693629+0000","last_peered":"2023-11-04T01:42:44.693629+0000","last_clean":"2023-11-04T01:42:44.693629+0000","last_became_active":"2023-11-04T01:42:43.725893+0000","last_became_peered":"2023-11-04T01:42:43.725893+0000","last_unstale":"2023-11-04T01:42:44.693629+0000","last_undegraded":"2023-11-04T01:42:44.693629+0000","last_fullsized":"2023-11-04T01:42:44.693629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:30.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692861+0000","last_change":"2023-11-04T01:42:42.673838+0000","last_active":"2023-11-04T01:42:44.692861+0000","last_peered":"2023-11-04T01:42:44.692861+0000","last_clean":"2023-11-04T01:42:44.692861+0000","last_became_active":"2023-11-04T01:42:42.673053+0000","last_became_peered":"2023-11-04T01:42:42.673053+0000","last_unstale":"2023-11-04T01:42:44.692861+0000","last_undegraded":"2023-11-04T01:42:44.692861+0000","last_fullsized":"2023-11-04T01:42:44.692861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:23.869218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652375+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:42:42.652375+0000","last_peered":"2023-11-04T01:42:42.652375+0000","last_clean":"2023-11-04T01:42:42.652375+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:42:42.652375+0000","last_undegraded":"2023-11-04T01:42:42.652375+0000","last_fullsized":"2023-11-04T01:42:42.652375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673354+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:42:42.673354+0000","last_peered":"2023-11-04T01:42:42.673354+0000","last_clean":"2023-11-04T01:42:42.673354+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:42:42.673354+0000","last_undegraded":"2023-11-04T01:42:42.673354+0000","last_fullsized":"2023-11-04T01:42:42.673354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714340+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:42:43.714340+0000","last_peered":"2023-11-04T01:42:43.714340+0000","last_clean":"2023-11-04T01:42:43.714340+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:42:43.714340+0000","last_undegraded":"2023-11-04T01:42:43.714340+0000","last_fullsized":"2023-11-04T01:42:43.714340+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211959+0000","last_change":"2023-11-04T01:42:43.717599+0000","last_active":"2023-11-04T01:42:45.211959+0000","last_peered":"2023-11-04T01:42:45.211959+0000","last_clean":"2023-11-04T01:42:45.211959+0000","last_became_active":"2023-11-04T01:42:43.716739+0000","last_became_peered":"2023-11-04T01:42:43.716739+0000","last_unstale":"2023-11-04T01:42:45.211959+0000","last_undegraded":"2023-11-04T01:42:45.211959+0000","last_fullsized":"2023-11-04T01:42:45.211959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:01.776290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.679840+0000","last_change":"2023-11-04T01:42:42.671021+0000","last_active":"2023-11-04T01:42:43.679840+0000","last_peered":"2023-11-04T01:42:43.679840+0000","last_clean":"2023-11-04T01:42:43.679840+0000","last_became_active":"2023-11-04T01:42:42.670742+0000","last_became_peered":"2023-11-04T01:42:42.670742+0000","last_unstale":"2023-11-04T01:42:43.679840+0000","last_undegraded":"2023-11-04T01:42:43.679840+0000","last_fullsized":"2023-11-04T01:42:43.679840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:07.681391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649365+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:42:42.649365+0000","last_peered":"2023-11-04T01:42:42.649365+0000","last_clean":"2023-11-04T01:42:42.649365+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:42:42.649365+0000","last_undegraded":"2023-11-04T01:42:42.649365+0000","last_fullsized":"2023-11-04T01:42:42.649365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.710074+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:42:43.710074+0000","last_peered":"2023-11-04T01:42:43.710074+0000","last_clean":"2023-11-04T01:42:43.710074+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:42:43.710074+0000","last_undegraded":"2023-11-04T01:42:43.710074+0000","last_fullsized":"2023-11-04T01:42:43.710074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.669574+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:42:42.669574+0000","last_peered":"2023-11-04T01:42:42.669574+0000","last_clean":"2023-11-04T01:42:42.669574+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:42:42.669574+0000","last_undegraded":"2023-11-04T01:42:42.669574+0000","last_fullsized":"2023-11-04T01:42:42.669574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211242+0000","last_change":"2023-11-04T01:42:43.756137+0000","last_active":"2023-11-04T01:42:45.211242+0000","last_peered":"2023-11-04T01:42:45.211242+0000","last_clean":"2023-11-04T01:42:45.211242+0000","last_became_active":"2023-11-04T01:42:43.755528+0000","last_became_peered":"2023-11-04T01:42:43.755528+0000","last_unstale":"2023-11-04T01:42:45.211242+0000","last_undegraded":"2023-11-04T01:42:45.211242+0000","last_fullsized":"2023-11-04T01:42:45.211242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:51.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693175+0000","last_change":"2023-11-04T01:42:42.678047+0000","last_active":"2023-11-04T01:42:44.693175+0000","last_peered":"2023-11-04T01:42:44.693175+0000","last_clean":"2023-11-04T01:42:44.693175+0000","last_became_active":"2023-11-04T01:42:42.677219+0000","last_became_peered":"2023-11-04T01:42:42.677219+0000","last_unstale":"2023-11-04T01:42:44.693175+0000","last_undegraded":"2023-11-04T01:42:44.693175+0000","last_fullsized":"2023-11-04T01:42:44.693175+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:43.241435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650920+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:42:42.650920+0000","last_peered":"2023-11-04T01:42:42.650920+0000","last_clean":"2023-11-04T01:42:42.650920+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:42:42.650920+0000","last_undegraded":"2023-11-04T01:42:42.650920+0000","last_fullsized":"2023-11-04T01:42:42.650920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650556+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:42:42.650556+0000","last_peered":"2023-11-04T01:42:42.650556+0000","last_clean":"2023-11-04T01:42:42.650556+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:42:42.650556+0000","last_undegraded":"2023-11-04T01:42:42.650556+0000","last_fullsized":"2023-11-04T01:42:42.650556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698707+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:42:43.698707+0000","last_peered":"2023-11-04T01:42:43.698707+0000","last_clean":"2023-11-04T01:42:43.698707+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:42:43.698707+0000","last_undegraded":"2023-11-04T01:42:43.698707+0000","last_fullsized":"2023-11-04T01:42:43.698707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692633+0000","last_change":"2023-11-04T01:42:43.721811+0000","last_active":"2023-11-04T01:42:44.692633+0000","last_peered":"2023-11-04T01:42:44.692633+0000","last_clean":"2023-11-04T01:42:44.692633+0000","last_became_active":"2023-11-04T01:42:43.721044+0000","last_became_peered":"2023-11-04T01:42:43.721044+0000","last_unstale":"2023-11-04T01:42:44.692633+0000","last_undegraded":"2023-11-04T01:42:44.692633+0000","last_fullsized":"2023-11-04T01:42:44.692633+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:15:15.201232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.682129+0000","last_change":"2023-11-04T01:42:42.668666+0000","last_active":"2023-11-04T01:42:43.682129+0000","last_peered":"2023-11-04T01:42:43.682129+0000","last_clean":"2023-11-04T01:42:43.682129+0000","last_became_active":"2023-11-04T01:42:42.668392+0000","last_became_peered":"2023-11-04T01:42:42.668392+0000","last_unstale":"2023-11-04T01:42:43.682129+0000","last_undegraded":"2023-11-04T01:42:43.682129+0000","last_fullsized":"2023-11-04T01:42:43.682129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:33:39.079121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651465+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:42:42.651465+0000","last_peered":"2023-11-04T01:42:42.651465+0000","last_clean":"2023-11-04T01:42:42.651465+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:42:42.651465+0000","last_undegraded":"2023-11-04T01:42:42.651465+0000","last_fullsized":"2023-11-04T01:42:42.651465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.706891+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:42:43.706891+0000","last_peered":"2023-11-04T01:42:43.706891+0000","last_clean":"2023-11-04T01:42:43.706891+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:42:43.706891+0000","last_undegraded":"2023-11-04T01:42:43.706891+0000","last_fullsized":"2023-11-04T01:42:43.706891+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711607+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:42:43.711607+0000","last_peered":"2023-11-04T01:42:43.711607+0000","last_clean":"2023-11-04T01:42:43.711607+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:42:43.711607+0000","last_undegraded":"2023-11-04T01:42:43.711607+0000","last_fullsized":"2023-11-04T01:42:43.711607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.695619+0000","last_change":"2023-11-04T01:42:43.728588+0000","last_active":"2023-11-04T01:42:44.695619+0000","last_peered":"2023-11-04T01:42:44.695619+0000","last_clean":"2023-11-04T01:42:44.695619+0000","last_became_active":"2023-11-04T01:42:43.727993+0000","last_became_peered":"2023-11-04T01:42:43.727993+0000","last_unstale":"2023-11-04T01:42:44.695619+0000","last_undegraded":"2023-11-04T01:42:44.695619+0000","last_fullsized":"2023-11-04T01:42:44.695619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:30.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697321+0000","last_change":"2023-11-04T01:42:42.696926+0000","last_active":"2023-11-04T01:42:44.697321+0000","last_peered":"2023-11-04T01:42:44.697321+0000","last_clean":"2023-11-04T01:42:44.697321+0000","last_became_active":"2023-11-04T01:42:42.696170+0000","last_became_peered":"2023-11-04T01:42:42.696170+0000","last_unstale":"2023-11-04T01:42:44.697321+0000","last_undegraded":"2023-11-04T01:42:44.697321+0000","last_fullsized":"2023-11-04T01:42:44.697321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:13.014595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698587+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:42:43.698587+0000","last_peered":"2023-11-04T01:42:43.698587+0000","last_clean":"2023-11-04T01:42:43.698587+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:42:43.698587+0000","last_undegraded":"2023-11-04T01:42:43.698587+0000","last_fullsized":"2023-11-04T01:42:43.698587+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651837+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:42:42.651837+0000","last_peered":"2023-11-04T01:42:42.651837+0000","last_clean":"2023-11-04T01:42:42.651837+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:42:42.651837+0000","last_undegraded":"2023-11-04T01:42:42.651837+0000","last_fullsized":"2023-11-04T01:42:42.651837+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.668566+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:42:42.668566+0000","last_peered":"2023-11-04T01:42:42.668566+0000","last_clean":"2023-11-04T01:42:42.668566+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:42:42.668566+0000","last_undegraded":"2023-11-04T01:42:42.668566+0000","last_fullsized":"2023-11-04T01:42:42.668566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211961+0000","last_change":"2023-11-04T01:42:43.730080+0000","last_active":"2023-11-04T01:42:45.211961+0000","last_peered":"2023-11-04T01:42:45.211961+0000","last_clean":"2023-11-04T01:42:45.211961+0000","last_became_active":"2023-11-04T01:42:43.729260+0000","last_became_peered":"2023-11-04T01:42:43.729260+0000","last_unstale":"2023-11-04T01:42:45.211961+0000","last_undegraded":"2023-11-04T01:42:45.211961+0000","last_fullsized":"2023-11-04T01:42:45.211961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:01.132128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217747+0000","last_change":"2023-11-04T01:42:42.671374+0000","last_active":"2023-11-04T01:42:45.217747+0000","last_peered":"2023-11-04T01:42:45.217747+0000","last_clean":"2023-11-04T01:42:45.217747+0000","last_became_active":"2023-11-04T01:42:42.670622+0000","last_became_peered":"2023-11-04T01:42:42.670622+0000","last_unstale":"2023-11-04T01:42:45.217747+0000","last_undegraded":"2023-11-04T01:42:45.217747+0000","last_fullsized":"2023-11-04T01:42:45.217747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:01.745566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.701720+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:42:43.701720+0000","last_peered":"2023-11-04T01:42:43.701720+0000","last_clean":"2023-11-04T01:42:43.701720+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:42:43.701720+0000","last_undegraded":"2023-11-04T01:42:43.701720+0000","last_fullsized":"2023-11-04T01:42:43.701720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666809+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:42:42.666809+0000","last_peered":"2023-11-04T01:42:42.666809+0000","last_clean":"2023-11-04T01:42:42.666809+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:42:42.666809+0000","last_undegraded":"2023-11-04T01:42:42.666809+0000","last_fullsized":"2023-11-04T01:42:42.666809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.707145+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:42:43.707145+0000","last_peered":"2023-11-04T01:42:43.707145+0000","last_clean":"2023-11-04T01:42:43.707145+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:42:43.707145+0000","last_undegraded":"2023-11-04T01:42:43.707145+0000","last_fullsized":"2023-11-04T01:42:43.707145+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217400+0000","last_change":"2023-11-04T01:42:43.706305+0000","last_active":"2023-11-04T01:42:45.217400+0000","last_peered":"2023-11-04T01:42:45.217400+0000","last_clean":"2023-11-04T01:42:45.217400+0000","last_became_active":"2023-11-04T01:42:43.705460+0000","last_became_peered":"2023-11-04T01:42:43.705460+0000","last_unstale":"2023-11-04T01:42:45.217400+0000","last_undegraded":"2023-11-04T01:42:45.217400+0000","last_fullsized":"2023-11-04T01:42:45.217400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.572398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.940527+0000","last_change":"2023-11-04T01:42:42.686234+0000","last_active":"2023-11-04T01:42:43.940527+0000","last_peered":"2023-11-04T01:42:43.940527+0000","last_clean":"2023-11-04T01:42:43.940527+0000","last_became_active":"2023-11-04T01:42:42.685555+0000","last_became_peered":"2023-11-04T01:42:42.685555+0000","last_unstale":"2023-11-04T01:42:43.940527+0000","last_undegraded":"2023-11-04T01:42:43.940527+0000","last_fullsized":"2023-11-04T01:42:43.940527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:16.668487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696770+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:42:43.696770+0000","last_peered":"2023-11-04T01:42:43.696770+0000","last_clean":"2023-11-04T01:42:43.696770+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:42:43.696770+0000","last_undegraded":"2023-11-04T01:42:43.696770+0000","last_fullsized":"2023-11-04T01:42:43.696770+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652564+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:42:42.652564+0000","last_peered":"2023-11-04T01:42:42.652564+0000","last_clean":"2023-11-04T01:42:42.652564+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:42:42.652564+0000","last_undegraded":"2023-11-04T01:42:42.652564+0000","last_fullsized":"2023-11-04T01:42:42.652564+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.671143+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:42:42.671143+0000","last_peered":"2023-11-04T01:42:42.671143+0000","last_clean":"2023-11-04T01:42:42.671143+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:42:42.671143+0000","last_undegraded":"2023-11-04T01:42:42.671143+0000","last_fullsized":"2023-11-04T01:42:42.671143+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217267+0000","last_change":"2023-11-04T01:42:43.751728+0000","last_active":"2023-11-04T01:42:45.217267+0000","last_peered":"2023-11-04T01:42:45.217267+0000","last_clean":"2023-11-04T01:42:45.217267+0000","last_became_active":"2023-11-04T01:42:43.751024+0000","last_became_peered":"2023-11-04T01:42:43.751024+0000","last_unstale":"2023-11-04T01:42:45.217267+0000","last_undegraded":"2023-11-04T01:42:45.217267+0000","last_fullsized":"2023-11-04T01:42:45.217267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:20.430557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.215949+0000","last_change":"2023-11-04T01:42:42.665890+0000","last_active":"2023-11-04T01:42:45.215949+0000","last_peered":"2023-11-04T01:42:45.215949+0000","last_clean":"2023-11-04T01:42:45.215949+0000","last_became_active":"2023-11-04T01:42:42.665091+0000","last_became_peered":"2023-11-04T01:42:42.665091+0000","last_unstale":"2023-11-04T01:42:45.215949+0000","last_undegraded":"2023-11-04T01:42:45.215949+0000","last_fullsized":"2023-11-04T01:42:45.215949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:13.014595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.704986+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:42:43.704986+0000","last_peered":"2023-11-04T01:42:43.704986+0000","last_clean":"2023-11-04T01:42:43.704986+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:42:43.704986+0000","last_undegraded":"2023-11-04T01:42:43.704986+0000","last_fullsized":"2023-11-04T01:42:43.704986+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.694946+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:42:43.694946+0000","last_peered":"2023-11-04T01:42:43.694946+0000","last_clean":"2023-11-04T01:42:43.694946+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:42:43.694946+0000","last_undegraded":"2023-11-04T01:42:43.694946+0000","last_fullsized":"2023-11-04T01:42:43.694946+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692960+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:42:43.692960+0000","last_peered":"2023-11-04T01:42:43.692960+0000","last_clean":"2023-11-04T01:42:43.692960+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:42:43.692960+0000","last_undegraded":"2023-11-04T01:42:43.692960+0000","last_fullsized":"2023-11-04T01:42:43.692960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211545+0000","last_change":"2023-11-04T01:42:43.730191+0000","last_active":"2023-11-04T01:42:45.211545+0000","last_peered":"2023-11-04T01:42:45.211545+0000","last_clean":"2023-11-04T01:42:45.211545+0000","last_became_active":"2023-11-04T01:42:43.723500+0000","last_became_peered":"2023-11-04T01:42:43.723500+0000","last_unstale":"2023-11-04T01:42:45.211545+0000","last_undegraded":"2023-11-04T01:42:45.211545+0000","last_fullsized":"2023-11-04T01:42:45.211545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:32.889149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.706079+0000","last_change":"2023-11-04T01:42:42.684704+0000","last_active":"2023-11-04T01:42:43.706079+0000","last_peered":"2023-11-04T01:42:43.706079+0000","last_clean":"2023-11-04T01:42:43.706079+0000","last_became_active":"2023-11-04T01:42:42.683951+0000","last_became_peered":"2023-11-04T01:42:42.683951+0000","last_unstale":"2023-11-04T01:42:43.706079+0000","last_undegraded":"2023-11-04T01:42:43.706079+0000","last_fullsized":"2023-11-04T01:42:43.706079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:48.635238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.689987+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:42:43.689987+0000","last_peered":"2023-11-04T01:42:43.689987+0000","last_clean":"2023-11-04T01:42:43.689987+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:42:43.689987+0000","last_undegraded":"2023-11-04T01:42:43.689987+0000","last_fullsized":"2023-11-04T01:42:43.689987+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.701932+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:42:43.701932+0000","last_peered":"2023-11-04T01:42:43.701932+0000","last_clean":"2023-11-04T01:42:43.701932+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:42:43.701932+0000","last_undegraded":"2023-11-04T01:42:43.701932+0000","last_fullsized":"2023-11-04T01:42:43.701932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652011+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:42:42.652011+0000","last_peered":"2023-11-04T01:42:42.652011+0000","last_clean":"2023-11-04T01:42:42.652011+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:42:42.652011+0000","last_undegraded":"2023-11-04T01:42:42.652011+0000","last_fullsized":"2023-11-04T01:42:42.652011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.732693+0000","last_change":"2023-11-04T01:42:43.721264+0000","last_active":"2023-11-04T01:42:43.732693+0000","last_peered":"2023-11-04T01:42:43.732693+0000","last_clean":"2023-11-04T01:42:43.732693+0000","last_became_active":"2023-11-04T01:42:43.720429+0000","last_became_peered":"2023-11-04T01:42:43.720429+0000","last_unstale":"2023-11-04T01:42:43.732693+0000","last_undegraded":"2023-11-04T01:42:43.732693+0000","last_fullsized":"2023-11-04T01:42:43.732693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:52.337126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211576+0000","last_change":"2023-11-04T01:42:42.693561+0000","last_active":"2023-11-04T01:42:45.211576+0000","last_peered":"2023-11-04T01:42:45.211576+0000","last_clean":"2023-11-04T01:42:45.211576+0000","last_became_active":"2023-11-04T01:42:42.693146+0000","last_became_peered":"2023-11-04T01:42:42.693146+0000","last_unstale":"2023-11-04T01:42:45.211576+0000","last_undegraded":"2023-11-04T01:42:45.211576+0000","last_fullsized":"2023-11-04T01:42:45.211576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:44.520778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714005+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:42:43.714005+0000","last_peered":"2023-11-04T01:42:43.714005+0000","last_clean":"2023-11-04T01:42:43.714005+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:42:43.714005+0000","last_undegraded":"2023-11-04T01:42:43.714005+0000","last_fullsized":"2023-11-04T01:42:43.714005+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670760+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:42:42.670760+0000","last_peered":"2023-11-04T01:42:42.670760+0000","last_clean":"2023-11-04T01:42:42.670760+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:42:42.670760+0000","last_undegraded":"2023-11-04T01:42:42.670760+0000","last_fullsized":"2023-11-04T01:42:42.670760+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673229+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:42:42.673229+0000","last_peered":"2023-11-04T01:42:42.673229+0000","last_clean":"2023-11-04T01:42:42.673229+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:42:42.673229+0000","last_undegraded":"2023-11-04T01:42:42.673229+0000","last_fullsized":"2023-11-04T01:42:42.673229+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.756209+0000","last_change":"2023-11-04T01:42:43.753625+0000","last_active":"2023-11-04T01:42:43.756209+0000","last_peered":"2023-11-04T01:42:43.756209+0000","last_clean":"2023-11-04T01:42:43.756209+0000","last_became_active":"2023-11-04T01:42:43.752955+0000","last_became_peered":"2023-11-04T01:42:43.752955+0000","last_unstale":"2023-11-04T01:42:43.756209+0000","last_undegraded":"2023-11-04T01:42:43.756209+0000","last_fullsized":"2023-11-04T01:42:43.756209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:32.889149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694017+0000","last_change":"2023-11-04T01:42:42.671983+0000","last_active":"2023-11-04T01:42:44.694017+0000","last_peered":"2023-11-04T01:42:44.694017+0000","last_clean":"2023-11-04T01:42:44.694017+0000","last_became_active":"2023-11-04T01:42:42.671131+0000","last_became_peered":"2023-11-04T01:42:42.671131+0000","last_unstale":"2023-11-04T01:42:44.694017+0000","last_undegraded":"2023-11-04T01:42:44.694017+0000","last_fullsized":"2023-11-04T01:42:44.694017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:56.838744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698467+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:42:43.698467+0000","last_peered":"2023-11-04T01:42:43.698467+0000","last_clean":"2023-11-04T01:42:43.698467+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:42:43.698467+0000","last_undegraded":"2023-11-04T01:42:43.698467+0000","last_fullsized":"2023-11-04T01:42:43.698467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666439+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:42:42.666439+0000","last_peered":"2023-11-04T01:42:42.666439+0000","last_clean":"2023-11-04T01:42:42.666439+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:42:42.666439+0000","last_undegraded":"2023-11-04T01:42:42.666439+0000","last_fullsized":"2023-11-04T01:42:42.666439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696904+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:42:43.696904+0000","last_peered":"2023-11-04T01:42:43.696904+0000","last_clean":"2023-11-04T01:42:43.696904+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:42:43.696904+0000","last_undegraded":"2023-11-04T01:42:43.696904+0000","last_fullsized":"2023-11-04T01:42:43.696904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212307+0000","last_change":"2023-11-04T01:42:43.726057+0000","last_active":"2023-11-04T01:42:45.212307+0000","last_peered":"2023-11-04T01:42:45.212307+0000","last_clean":"2023-11-04T01:42:45.212307+0000","last_became_active":"2023-11-04T01:42:43.725259+0000","last_became_peered":"2023-11-04T01:42:43.725259+0000","last_unstale":"2023-11-04T01:42:45.212307+0000","last_undegraded":"2023-11-04T01:42:45.212307+0000","last_fullsized":"2023-11-04T01:42:45.212307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:25.495386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697529+0000","last_change":"2023-11-04T01:42:42.695015+0000","last_active":"2023-11-04T01:42:44.697529+0000","last_peered":"2023-11-04T01:42:44.697529+0000","last_clean":"2023-11-04T01:42:44.697529+0000","last_became_active":"2023-11-04T01:42:42.694379+0000","last_became_peered":"2023-11-04T01:42:42.694379+0000","last_unstale":"2023-11-04T01:42:44.697529+0000","last_undegraded":"2023-11-04T01:42:44.697529+0000","last_fullsized":"2023-11-04T01:42:44.697529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:01.745566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.686856+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:42:43.686856+0000","last_peered":"2023-11-04T01:42:43.686856+0000","last_clean":"2023-11-04T01:42:43.686856+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:42:43.686856+0000","last_undegraded":"2023-11-04T01:42:43.686856+0000","last_fullsized":"2023-11-04T01:42:43.686856+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.684434+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:42:43.684434+0000","last_peered":"2023-11-04T01:42:43.684434+0000","last_clean":"2023-11-04T01:42:43.684434+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:42:43.684434+0000","last_undegraded":"2023-11-04T01:42:43.684434+0000","last_fullsized":"2023-11-04T01:42:43.684434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714106+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:42:43.714106+0000","last_peered":"2023-11-04T01:42:43.714106+0000","last_clean":"2023-11-04T01:42:43.714106+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:42:43.714106+0000","last_undegraded":"2023-11-04T01:42:43.714106+0000","last_fullsized":"2023-11-04T01:42:43.714106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697646+0000","last_change":"2023-11-04T01:42:43.727962+0000","last_active":"2023-11-04T01:42:44.697646+0000","last_peered":"2023-11-04T01:42:44.697646+0000","last_clean":"2023-11-04T01:42:44.697646+0000","last_became_active":"2023-11-04T01:42:43.727300+0000","last_became_peered":"2023-11-04T01:42:43.727300+0000","last_unstale":"2023-11-04T01:42:44.697646+0000","last_undegraded":"2023-11-04T01:42:44.697646+0000","last_fullsized":"2023-11-04T01:42:44.697646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:59:14.632952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217097+0000","last_change":"2023-11-04T01:42:42.665588+0000","last_active":"2023-11-04T01:42:45.217097+0000","last_peered":"2023-11-04T01:42:45.217097+0000","last_clean":"2023-11-04T01:42:45.217097+0000","last_became_active":"2023-11-04T01:42:42.664840+0000","last_became_peered":"2023-11-04T01:42:42.664840+0000","last_unstale":"2023-11-04T01:42:45.217097+0000","last_undegraded":"2023-11-04T01:42:45.217097+0000","last_fullsized":"2023-11-04T01:42:45.217097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:25.587980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.687185+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:42:43.687185+0000","last_peered":"2023-11-04T01:42:43.687185+0000","last_clean":"2023-11-04T01:42:43.687185+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:42:43.687185+0000","last_undegraded":"2023-11-04T01:42:43.687185+0000","last_fullsized":"2023-11-04T01:42:43.687185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650801+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:42:42.650801+0000","last_peered":"2023-11-04T01:42:42.650801+0000","last_clean":"2023-11-04T01:42:42.650801+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:42:42.650801+0000","last_undegraded":"2023-11-04T01:42:42.650801+0000","last_fullsized":"2023-11-04T01:42:42.650801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651210+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:42:42.651210+0000","last_peered":"2023-11-04T01:42:42.651210+0000","last_clean":"2023-11-04T01:42:42.651210+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:42:42.651210+0000","last_undegraded":"2023-11-04T01:42:42.651210+0000","last_fullsized":"2023-11-04T01:42:42.651210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217642+0000","last_change":"2023-11-04T01:42:43.723303+0000","last_active":"2023-11-04T01:42:45.217642+0000","last_peered":"2023-11-04T01:42:45.217642+0000","last_clean":"2023-11-04T01:42:45.217642+0000","last_became_active":"2023-11-04T01:42:43.722575+0000","last_became_peered":"2023-11-04T01:42:43.722575+0000","last_unstale":"2023-11-04T01:42:45.217642+0000","last_undegraded":"2023-11-04T01:42:45.217642+0000","last_fullsized":"2023-11-04T01:42:45.217642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:31.410384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.943412+0000","last_change":"2023-11-04T01:42:42.684865+0000","last_active":"2023-11-04T01:42:43.943412+0000","last_peered":"2023-11-04T01:42:43.943412+0000","last_clean":"2023-11-04T01:42:43.943412+0000","last_became_active":"2023-11-04T01:42:42.684172+0000","last_became_peered":"2023-11-04T01:42:42.684172+0000","last_unstale":"2023-11-04T01:42:43.943412+0000","last_undegraded":"2023-11-04T01:42:43.943412+0000","last_fullsized":"2023-11-04T01:42:43.943412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:59.851086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.707830+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:42:43.707830+0000","last_peered":"2023-11-04T01:42:43.707830+0000","last_clean":"2023-11-04T01:42:43.707830+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:42:43.707830+0000","last_undegraded":"2023-11-04T01:42:43.707830+0000","last_fullsized":"2023-11-04T01:42:43.707830+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.690418+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:42:43.690418+0000","last_peered":"2023-11-04T01:42:43.690418+0000","last_clean":"2023-11-04T01:42:43.690418+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:42:43.690418+0000","last_undegraded":"2023-11-04T01:42:43.690418+0000","last_fullsized":"2023-11-04T01:42:43.690418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652314+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:42:42.652314+0000","last_peered":"2023-11-04T01:42:42.652314+0000","last_clean":"2023-11-04T01:42:42.652314+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:42:42.652314+0000","last_undegraded":"2023-11-04T01:42:42.652314+0000","last_fullsized":"2023-11-04T01:42:42.652314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212459+0000","last_change":"2023-11-04T01:42:43.720105+0000","last_active":"2023-11-04T01:42:45.212459+0000","last_peered":"2023-11-04T01:42:45.212459+0000","last_clean":"2023-11-04T01:42:45.212459+0000","last_became_active":"2023-11-04T01:42:43.719282+0000","last_became_peered":"2023-11-04T01:42:43.719282+0000","last_unstale":"2023-11-04T01:42:45.212459+0000","last_undegraded":"2023-11-04T01:42:45.212459+0000","last_fullsized":"2023-11-04T01:42:45.212459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:36:33.921263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.696148+0000","last_change":"2023-11-04T01:42:42.688067+0000","last_active":"2023-11-04T01:42:44.696148+0000","last_peered":"2023-11-04T01:42:44.696148+0000","last_clean":"2023-11-04T01:42:44.696148+0000","last_became_active":"2023-11-04T01:42:42.686541+0000","last_became_peered":"2023-11-04T01:42:42.686541+0000","last_unstale":"2023-11-04T01:42:44.696148+0000","last_undegraded":"2023-11-04T01:42:44.696148+0000","last_fullsized":"2023-11-04T01:42:44.696148+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:19.426502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711953+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:42:43.711953+0000","last_peered":"2023-11-04T01:42:43.711953+0000","last_clean":"2023-11-04T01:42:43.711953+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:42:43.711953+0000","last_undegraded":"2023-11-04T01:42:43.711953+0000","last_fullsized":"2023-11-04T01:42:43.711953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.709604+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:42:43.709604+0000","last_peered":"2023-11-04T01:42:43.709604+0000","last_clean":"2023-11-04T01:42:43.709604+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:42:43.709604+0000","last_undegraded":"2023-11-04T01:42:43.709604+0000","last_fullsized":"2023-11-04T01:42:43.709604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.693954+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:42:43.693954+0000","last_peered":"2023-11-04T01:42:43.693954+0000","last_clean":"2023-11-04T01:42:43.693954+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:42:43.693954+0000","last_undegraded":"2023-11-04T01:42:43.693954+0000","last_fullsized":"2023-11-04T01:42:43.693954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211628+0000","last_change":"2023-11-04T01:42:43.749581+0000","last_active":"2023-11-04T01:42:45.211628+0000","last_peered":"2023-11-04T01:42:45.211628+0000","last_clean":"2023-11-04T01:42:45.211628+0000","last_became_active":"2023-11-04T01:42:43.748602+0000","last_became_peered":"2023-11-04T01:42:43.748602+0000","last_unstale":"2023-11-04T01:42:45.211628+0000","last_undegraded":"2023-11-04T01:42:45.211628+0000","last_fullsized":"2023-11-04T01:42:45.211628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:13.408437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711272+0000","last_change":"2023-11-04T01:42:42.687069+0000","last_active":"2023-11-04T01:42:43.711272+0000","last_peered":"2023-11-04T01:42:43.711272+0000","last_clean":"2023-11-04T01:42:43.711272+0000","last_became_active":"2023-11-04T01:42:42.686704+0000","last_became_peered":"2023-11-04T01:42:42.686704+0000","last_unstale":"2023-11-04T01:42:43.711272+0000","last_undegraded":"2023-11-04T01:42:43.711272+0000","last_fullsized":"2023-11-04T01:42:43.711272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:00.128073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.708090+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:42:43.708090+0000","last_peered":"2023-11-04T01:42:43.708090+0000","last_clean":"2023-11-04T01:42:43.708090+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:42:43.708090+0000","last_undegraded":"2023-11-04T01:42:43.708090+0000","last_fullsized":"2023-11-04T01:42:43.708090+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650923+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:42:42.650923+0000","last_peered":"2023-11-04T01:42:42.650923+0000","last_clean":"2023-11-04T01:42:42.650923+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:42:42.650923+0000","last_undegraded":"2023-11-04T01:42:42.650923+0000","last_fullsized":"2023-11-04T01:42:42.650923+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666346+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:42:42.666346+0000","last_peered":"2023-11-04T01:42:42.666346+0000","last_clean":"2023-11-04T01:42:42.666346+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:42:42.666346+0000","last_undegraded":"2023-11-04T01:42:42.666346+0000","last_fullsized":"2023-11-04T01:42:42.666346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693178+0000","last_change":"2023-11-04T01:42:43.748391+0000","last_active":"2023-11-04T01:42:44.693178+0000","last_peered":"2023-11-04T01:42:44.693178+0000","last_clean":"2023-11-04T01:42:44.693178+0000","last_became_active":"2023-11-04T01:42:43.747586+0000","last_became_peered":"2023-11-04T01:42:43.747586+0000","last_unstale":"2023-11-04T01:42:44.693178+0000","last_undegraded":"2023-11-04T01:42:44.693178+0000","last_fullsized":"2023-11-04T01:42:44.693178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:44.245490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.705735+0000","last_change":"2023-11-04T01:42:42.690628+0000","last_active":"2023-11-04T01:42:43.705735+0000","last_peered":"2023-11-04T01:42:43.705735+0000","last_clean":"2023-11-04T01:42:43.705735+0000","last_became_active":"2023-11-04T01:42:42.689864+0000","last_became_peered":"2023-11-04T01:42:42.689864+0000","last_unstale":"2023-11-04T01:42:43.705735+0000","last_undegraded":"2023-11-04T01:42:43.705735+0000","last_fullsized":"2023-11-04T01:42:43.705735+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:59:22.325103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.691429+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:42:43.691429+0000","last_peered":"2023-11-04T01:42:43.691429+0000","last_clean":"2023-11-04T01:42:43.691429+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:42:43.691429+0000","last_undegraded":"2023-11-04T01:42:43.691429+0000","last_fullsized":"2023-11-04T01:42:43.691429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670183+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:42:42.670183+0000","last_peered":"2023-11-04T01:42:42.670183+0000","last_clean":"2023-11-04T01:42:42.670183+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:42:42.670183+0000","last_undegraded":"2023-11-04T01:42:42.670183+0000","last_fullsized":"2023-11-04T01:42:42.670183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.651660+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:42:42.651660+0000","last_peered":"2023-11-04T01:42:42.651660+0000","last_clean":"2023-11-04T01:42:42.651660+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:42:42.651660+0000","last_undegraded":"2023-11-04T01:42:42.651660+0000","last_fullsized":"2023-11-04T01:42:42.651660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.691820+0000","last_change":"2023-11-04T01:42:43.749377+0000","last_active":"2023-11-04T01:42:44.691820+0000","last_peered":"2023-11-04T01:42:44.691820+0000","last_clean":"2023-11-04T01:42:44.691820+0000","last_became_active":"2023-11-04T01:42:43.746165+0000","last_became_peered":"2023-11-04T01:42:43.746165+0000","last_unstale":"2023-11-04T01:42:44.691820+0000","last_undegraded":"2023-11-04T01:42:44.691820+0000","last_fullsized":"2023-11-04T01:42:44.691820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:31.410384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693308+0000","last_change":"2023-11-04T01:42:42.685655+0000","last_active":"2023-11-04T01:42:44.693308+0000","last_peered":"2023-11-04T01:42:44.693308+0000","last_clean":"2023-11-04T01:42:44.693308+0000","last_became_active":"2023-11-04T01:42:42.684892+0000","last_became_peered":"2023-11-04T01:42:42.684892+0000","last_unstale":"2023-11-04T01:42:44.693308+0000","last_undegraded":"2023-11-04T01:42:44.693308+0000","last_fullsized":"2023-11-04T01:42:44.693308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:19.791843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714006+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:42:43.714006+0000","last_peered":"2023-11-04T01:42:43.714006+0000","last_clean":"2023-11-04T01:42:43.714006+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:42:43.714006+0000","last_undegraded":"2023-11-04T01:42:43.714006+0000","last_fullsized":"2023-11-04T01:42:43.714006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.669962+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:42:42.669962+0000","last_peered":"2023-11-04T01:42:42.669962+0000","last_clean":"2023-11-04T01:42:42.669962+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:42:42.669962+0000","last_undegraded":"2023-11-04T01:42:42.669962+0000","last_fullsized":"2023-11-04T01:42:42.669962+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698300+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:42:43.698300+0000","last_peered":"2023-11-04T01:42:43.698300+0000","last_clean":"2023-11-04T01:42:43.698300+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:42:43.698300+0000","last_undegraded":"2023-11-04T01:42:43.698300+0000","last_fullsized":"2023-11-04T01:42:43.698300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.216850+0000","last_change":"2023-11-04T01:42:43.711716+0000","last_active":"2023-11-04T01:42:45.216850+0000","last_peered":"2023-11-04T01:42:45.216850+0000","last_clean":"2023-11-04T01:42:45.216850+0000","last_became_active":"2023-11-04T01:42:43.710928+0000","last_became_peered":"2023-11-04T01:42:43.710928+0000","last_unstale":"2023-11-04T01:42:45.216850+0000","last_undegraded":"2023-11-04T01:42:45.216850+0000","last_fullsized":"2023-11-04T01:42:45.216850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:20.795898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693023+0000","last_change":"2023-11-04T01:42:42.668700+0000","last_active":"2023-11-04T01:42:44.693023+0000","last_peered":"2023-11-04T01:42:44.693023+0000","last_clean":"2023-11-04T01:42:44.693023+0000","last_became_active":"2023-11-04T01:42:42.668293+0000","last_became_peered":"2023-11-04T01:42:42.668293+0000","last_unstale":"2023-11-04T01:42:44.693023+0000","last_undegraded":"2023-11-04T01:42:44.693023+0000","last_fullsized":"2023-11-04T01:42:44.693023+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:13.014595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.713641+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:42:43.713641+0000","last_peered":"2023-11-04T01:42:43.713641+0000","last_clean":"2023-11-04T01:42:43.713641+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:42:43.713641+0000","last_undegraded":"2023-11-04T01:42:43.713641+0000","last_fullsized":"2023-11-04T01:42:43.713641+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.687185+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:42:43.687185+0000","last_peered":"2023-11-04T01:42:43.687185+0000","last_clean":"2023-11-04T01:42:43.687185+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:42:43.687185+0000","last_undegraded":"2023-11-04T01:42:43.687185+0000","last_fullsized":"2023-11-04T01:42:43.687185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666922+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:42:42.666922+0000","last_peered":"2023-11-04T01:42:42.666922+0000","last_clean":"2023-11-04T01:42:42.666922+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:42:42.666922+0000","last_undegraded":"2023-11-04T01:42:42.666922+0000","last_fullsized":"2023-11-04T01:42:42.666922+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.752579+0000","last_change":"2023-11-04T01:42:43.749905+0000","last_active":"2023-11-04T01:42:43.752579+0000","last_peered":"2023-11-04T01:42:43.752579+0000","last_clean":"2023-11-04T01:42:43.752579+0000","last_became_active":"2023-11-04T01:42:43.749377+0000","last_became_peered":"2023-11-04T01:42:43.749377+0000","last_unstale":"2023-11-04T01:42:43.752579+0000","last_undegraded":"2023-11-04T01:42:43.752579+0000","last_fullsized":"2023-11-04T01:42:43.752579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:18.879566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.941423+0000","last_change":"2023-11-04T01:42:42.687078+0000","last_active":"2023-11-04T01:42:43.941423+0000","last_peered":"2023-11-04T01:42:43.941423+0000","last_clean":"2023-11-04T01:42:43.941423+0000","last_became_active":"2023-11-04T01:42:42.686361+0000","last_became_peered":"2023-11-04T01:42:42.686361+0000","last_unstale":"2023-11-04T01:42:43.941423+0000","last_undegraded":"2023-11-04T01:42:43.941423+0000","last_fullsized":"2023-11-04T01:42:43.941423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:27.929326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.698364+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:42:43.698364+0000","last_peered":"2023-11-04T01:42:43.698364+0000","last_clean":"2023-11-04T01:42:43.698364+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:42:43.698364+0000","last_undegraded":"2023-11-04T01:42:43.698364+0000","last_fullsized":"2023-11-04T01:42:43.698364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.709984+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:42:43.709984+0000","last_peered":"2023-11-04T01:42:43.709984+0000","last_clean":"2023-11-04T01:42:43.709984+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:42:43.709984+0000","last_undegraded":"2023-11-04T01:42:43.709984+0000","last_fullsized":"2023-11-04T01:42:43.709984+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.702267+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:42:43.702267+0000","last_peered":"2023-11-04T01:42:43.702267+0000","last_clean":"2023-11-04T01:42:43.702267+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:42:43.702267+0000","last_undegraded":"2023-11-04T01:42:43.702267+0000","last_fullsized":"2023-11-04T01:42:43.702267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212811+0000","last_change":"2023-11-04T01:42:43.726928+0000","last_active":"2023-11-04T01:42:45.212811+0000","last_peered":"2023-11-04T01:42:45.212811+0000","last_clean":"2023-11-04T01:42:45.212811+0000","last_became_active":"2023-11-04T01:42:43.723675+0000","last_became_peered":"2023-11-04T01:42:43.723675+0000","last_unstale":"2023-11-04T01:42:45.212811+0000","last_undegraded":"2023-11-04T01:42:45.212811+0000","last_fullsized":"2023-11-04T01:42:45.212811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:18.281438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.216837+0000","last_change":"2023-11-04T01:42:42.678387+0000","last_active":"2023-11-04T01:42:45.216837+0000","last_peered":"2023-11-04T01:42:45.216837+0000","last_clean":"2023-11-04T01:42:45.216837+0000","last_became_active":"2023-11-04T01:42:42.677579+0000","last_became_peered":"2023-11-04T01:42:42.677579+0000","last_unstale":"2023-11-04T01:42:45.216837+0000","last_undegraded":"2023-11-04T01:42:45.216837+0000","last_fullsized":"2023-11-04T01:42:45.216837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:43.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.702060+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:42:43.702060+0000","last_peered":"2023-11-04T01:42:43.702060+0000","last_clean":"2023-11-04T01:42:43.702060+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:42:43.702060+0000","last_undegraded":"2023-11-04T01:42:43.702060+0000","last_fullsized":"2023-11-04T01:42:43.702060+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692409+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:42:43.692409+0000","last_peered":"2023-11-04T01:42:43.692409+0000","last_clean":"2023-11-04T01:42:43.692409+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:42:43.692409+0000","last_undegraded":"2023-11-04T01:42:43.692409+0000","last_fullsized":"2023-11-04T01:42:43.692409+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.708123+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:42:43.708123+0000","last_peered":"2023-11-04T01:42:43.708123+0000","last_clean":"2023-11-04T01:42:43.708123+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:42:43.708123+0000","last_undegraded":"2023-11-04T01:42:43.708123+0000","last_fullsized":"2023-11-04T01:42:43.708123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211648+0000","last_change":"2023-11-04T01:42:43.726416+0000","last_active":"2023-11-04T01:42:45.211648+0000","last_peered":"2023-11-04T01:42:45.211648+0000","last_clean":"2023-11-04T01:42:45.211648+0000","last_became_active":"2023-11-04T01:42:43.725514+0000","last_became_peered":"2023-11-04T01:42:43.725514+0000","last_unstale":"2023-11-04T01:42:45.211648+0000","last_undegraded":"2023-11-04T01:42:45.211648+0000","last_fullsized":"2023-11-04T01:42:45.211648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:23.833591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.217468+0000","last_change":"2023-11-04T01:42:42.659965+0000","last_active":"2023-11-04T01:42:45.217468+0000","last_peered":"2023-11-04T01:42:45.217468+0000","last_clean":"2023-11-04T01:42:45.217468+0000","last_became_active":"2023-11-04T01:42:42.659198+0000","last_became_peered":"2023-11-04T01:42:42.659198+0000","last_unstale":"2023-11-04T01:42:45.217468+0000","last_undegraded":"2023-11-04T01:42:45.217468+0000","last_fullsized":"2023-11-04T01:42:45.217468+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:25.419862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.709839+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:42:43.709839+0000","last_peered":"2023-11-04T01:42:43.709839+0000","last_clean":"2023-11-04T01:42:43.709839+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:42:43.709839+0000","last_undegraded":"2023-11-04T01:42:43.709839+0000","last_fullsized":"2023-11-04T01:42:43.709839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696302+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:42:43.696302+0000","last_peered":"2023-11-04T01:42:43.696302+0000","last_clean":"2023-11-04T01:42:43.696302+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:42:43.696302+0000","last_undegraded":"2023-11-04T01:42:43.696302+0000","last_fullsized":"2023-11-04T01:42:43.696302+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649925+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:42:42.649925+0000","last_peered":"2023-11-04T01:42:42.649925+0000","last_clean":"2023-11-04T01:42:42.649925+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:42:42.649925+0000","last_undegraded":"2023-11-04T01:42:42.649925+0000","last_fullsized":"2023-11-04T01:42:42.649925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.212111+0000","last_change":"2023-11-04T01:42:43.717710+0000","last_active":"2023-11-04T01:42:45.212111+0000","last_peered":"2023-11-04T01:42:45.212111+0000","last_clean":"2023-11-04T01:42:45.212111+0000","last_became_active":"2023-11-04T01:42:43.716816+0000","last_became_peered":"2023-11-04T01:42:43.716816+0000","last_unstale":"2023-11-04T01:42:45.212111+0000","last_undegraded":"2023-11-04T01:42:45.212111+0000","last_fullsized":"2023-11-04T01:42:45.212111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:01.997777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.694719+0000","last_change":"2023-11-04T01:42:42.688587+0000","last_active":"2023-11-04T01:42:44.694719+0000","last_peered":"2023-11-04T01:42:44.694719+0000","last_clean":"2023-11-04T01:42:44.694719+0000","last_became_active":"2023-11-04T01:42:42.687359+0000","last_became_peered":"2023-11-04T01:42:42.687359+0000","last_unstale":"2023-11-04T01:42:44.694719+0000","last_undegraded":"2023-11-04T01:42:44.694719+0000","last_fullsized":"2023-11-04T01:42:44.694719+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:42.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696564+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:42:43.696564+0000","last_peered":"2023-11-04T01:42:43.696564+0000","last_clean":"2023-11-04T01:42:43.696564+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:42:43.696564+0000","last_undegraded":"2023-11-04T01:42:43.696564+0000","last_fullsized":"2023-11-04T01:42:43.696564+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649808+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:42:42.649808+0000","last_peered":"2023-11-04T01:42:42.649808+0000","last_clean":"2023-11-04T01:42:42.649808+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:42:42.649808+0000","last_undegraded":"2023-11-04T01:42:42.649808+0000","last_fullsized":"2023-11-04T01:42:42.649808+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.670912+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:42:42.670912+0000","last_peered":"2023-11-04T01:42:42.670912+0000","last_clean":"2023-11-04T01:42:42.670912+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:42:42.670912+0000","last_undegraded":"2023-11-04T01:42:42.670912+0000","last_fullsized":"2023-11-04T01:42:42.670912+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.754619+0000","last_change":"2023-11-04T01:42:43.747035+0000","last_active":"2023-11-04T01:42:43.754619+0000","last_peered":"2023-11-04T01:42:43.754619+0000","last_clean":"2023-11-04T01:42:43.754619+0000","last_became_active":"2023-11-04T01:42:43.746529+0000","last_became_peered":"2023-11-04T01:42:43.746529+0000","last_unstale":"2023-11-04T01:42:43.754619+0000","last_undegraded":"2023-11-04T01:42:43.754619+0000","last_fullsized":"2023-11-04T01:42:43.754619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:18.364070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692178+0000","last_change":"2023-11-04T01:42:42.660585+0000","last_active":"2023-11-04T01:42:44.692178+0000","last_peered":"2023-11-04T01:42:44.692178+0000","last_clean":"2023-11-04T01:42:44.692178+0000","last_became_active":"2023-11-04T01:42:42.660169+0000","last_became_peered":"2023-11-04T01:42:42.660169+0000","last_unstale":"2023-11-04T01:42:44.692178+0000","last_undegraded":"2023-11-04T01:42:44.692178+0000","last_fullsized":"2023-11-04T01:42:44.692178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:42.298053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.697699+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:42:43.697699+0000","last_peered":"2023-11-04T01:42:43.697699+0000","last_clean":"2023-11-04T01:42:43.697699+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:42:43.697699+0000","last_undegraded":"2023-11-04T01:42:43.697699+0000","last_fullsized":"2023-11-04T01:42:43.697699+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.673094+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:42:42.673094+0000","last_peered":"2023-11-04T01:42:42.673094+0000","last_clean":"2023-11-04T01:42:42.673094+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:42:42.673094+0000","last_undegraded":"2023-11-04T01:42:42.673094+0000","last_fullsized":"2023-11-04T01:42:42.673094+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714704+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:42:43.714704+0000","last_peered":"2023-11-04T01:42:43.714704+0000","last_clean":"2023-11-04T01:42:43.714704+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:42:43.714704+0000","last_undegraded":"2023-11-04T01:42:43.714704+0000","last_fullsized":"2023-11-04T01:42:43.714704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.732766+0000","last_change":"2023-11-04T01:42:43.718982+0000","last_active":"2023-11-04T01:42:43.732766+0000","last_peered":"2023-11-04T01:42:43.732766+0000","last_clean":"2023-11-04T01:42:43.732766+0000","last_became_active":"2023-11-04T01:42:43.718119+0000","last_became_peered":"2023-11-04T01:42:43.718119+0000","last_unstale":"2023-11-04T01:42:43.732766+0000","last_undegraded":"2023-11-04T01:42:43.732766+0000","last_fullsized":"2023-11-04T01:42:43.732766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:20.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"78'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692066+0000","last_change":"2023-11-04T01:42:42.658742+0000","last_active":"2023-11-04T01:42:44.692066+0000","last_peered":"2023-11-04T01:42:44.692066+0000","last_clean":"2023-11-04T01:42:44.692066+0000","last_became_active":"2023-11-04T01:42:42.658224+0000","last_became_peered":"2023-11-04T01:42:42.658224+0000","last_unstale":"2023-11-04T01:42:44.692066+0000","last_undegraded":"2023-11-04T01:42:44.692066+0000","last_fullsized":"2023-11-04T01:42:44.692066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:19.426502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692076+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:42:43.692076+0000","last_peered":"2023-11-04T01:42:43.692076+0000","last_clean":"2023-11-04T01:42:43.692076+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:42:43.692076+0000","last_undegraded":"2023-11-04T01:42:43.692076+0000","last_fullsized":"2023-11-04T01:42:43.692076+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.694181+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:42:43.694181+0000","last_peered":"2023-11-04T01:42:43.694181+0000","last_clean":"2023-11-04T01:42:43.694181+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:42:43.694181+0000","last_undegraded":"2023-11-04T01:42:43.694181+0000","last_fullsized":"2023-11-04T01:42:43.694181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.652878+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:42:42.652878+0000","last_peered":"2023-11-04T01:42:42.652878+0000","last_clean":"2023-11-04T01:42:42.652878+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:42:42.652878+0000","last_undegraded":"2023-11-04T01:42:42.652878+0000","last_fullsized":"2023-11-04T01:42:42.652878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692583+0000","last_change":"2023-11-04T01:42:43.724939+0000","last_active":"2023-11-04T01:42:44.692583+0000","last_peered":"2023-11-04T01:42:44.692583+0000","last_clean":"2023-11-04T01:42:44.692583+0000","last_became_active":"2023-11-04T01:42:43.724100+0000","last_became_peered":"2023-11-04T01:42:43.724100+0000","last_unstale":"2023-11-04T01:42:44.692583+0000","last_undegraded":"2023-11-04T01:42:44.692583+0000","last_fullsized":"2023-11-04T01:42:44.692583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:24.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"78'2","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.943578+0000","last_change":"2023-11-04T01:42:42.690641+0000","last_active":"2023-11-04T01:42:43.943578+0000","last_peered":"2023-11-04T01:42:43.943578+0000","last_clean":"2023-11-04T01:42:43.943578+0000","last_became_active":"2023-11-04T01:42:42.689847+0000","last_became_peered":"2023-11-04T01:42:42.689847+0000","last_unstale":"2023-11-04T01:42:43.943578+0000","last_undegraded":"2023-11-04T01:42:43.943578+0000","last_fullsized":"2023-11-04T01:42:43.943578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:27.253450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.664522+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:42:42.664522+0000","last_peered":"2023-11-04T01:42:42.664522+0000","last_clean":"2023-11-04T01:42:42.664522+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:42:42.664522+0000","last_undegraded":"2023-11-04T01:42:42.664522+0000","last_fullsized":"2023-11-04T01:42:42.664522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.650404+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:42:42.650404+0000","last_peered":"2023-11-04T01:42:42.650404+0000","last_clean":"2023-11-04T01:42:42.650404+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:42:42.650404+0000","last_undegraded":"2023-11-04T01:42:42.650404+0000","last_fullsized":"2023-11-04T01:42:42.650404+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.697916+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:42:43.697916+0000","last_peered":"2023-11-04T01:42:43.697916+0000","last_clean":"2023-11-04T01:42:43.697916+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:42:43.697916+0000","last_undegraded":"2023-11-04T01:42:43.697916+0000","last_fullsized":"2023-11-04T01:42:43.697916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.692574+0000","last_change":"2023-11-04T01:42:43.716447+0000","last_active":"2023-11-04T01:42:44.692574+0000","last_peered":"2023-11-04T01:42:44.692574+0000","last_clean":"2023-11-04T01:42:44.692574+0000","last_became_active":"2023-11-04T01:42:43.715593+0000","last_became_peered":"2023-11-04T01:42:43.715593+0000","last_unstale":"2023-11-04T01:42:44.692574+0000","last_undegraded":"2023-11-04T01:42:44.692574+0000","last_fullsized":"2023-11-04T01:42:44.692574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.572398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211503+0000","last_change":"2023-11-04T01:42:42.690062+0000","last_active":"2023-11-04T01:42:45.211503+0000","last_peered":"2023-11-04T01:42:45.211503+0000","last_clean":"2023-11-04T01:42:45.211503+0000","last_became_active":"2023-11-04T01:42:42.689828+0000","last_became_peered":"2023-11-04T01:42:42.689828+0000","last_unstale":"2023-11-04T01:42:45.211503+0000","last_undegraded":"2023-11-04T01:42:45.211503+0000","last_fullsized":"2023-11-04T01:42:45.211503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:59.851086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.704487+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:42:43.704487+0000","last_peered":"2023-11-04T01:42:43.704487+0000","last_clean":"2023-11-04T01:42:43.704487+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:42:43.704487+0000","last_undegraded":"2023-11-04T01:42:43.704487+0000","last_fullsized":"2023-11-04T01:42:43.704487+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.686967+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:42:43.686967+0000","last_peered":"2023-11-04T01:42:43.686967+0000","last_clean":"2023-11-04T01:42:43.686967+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:42:43.686967+0000","last_undegraded":"2023-11-04T01:42:43.686967+0000","last_fullsized":"2023-11-04T01:42:43.686967+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692286+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:42:43.692286+0000","last_peered":"2023-11-04T01:42:43.692286+0000","last_clean":"2023-11-04T01:42:43.692286+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:42:43.692286+0000","last_undegraded":"2023-11-04T01:42:43.692286+0000","last_fullsized":"2023-11-04T01:42:43.692286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.739454+0000","last_change":"2023-11-04T01:42:43.736350+0000","last_active":"2023-11-04T01:42:43.739454+0000","last_peered":"2023-11-04T01:42:43.739454+0000","last_clean":"2023-11-04T01:42:43.739454+0000","last_became_active":"2023-11-04T01:42:43.735588+0000","last_became_peered":"2023-11-04T01:42:43.735588+0000","last_unstale":"2023-11-04T01:42:43.739454+0000","last_undegraded":"2023-11-04T01:42:43.739454+0000","last_fullsized":"2023-11-04T01:42:43.739454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:13.408437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"78'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697090+0000","last_change":"2023-11-04T01:42:42.696074+0000","last_active":"2023-11-04T01:42:44.697090+0000","last_peered":"2023-11-04T01:42:44.697090+0000","last_clean":"2023-11-04T01:42:44.697090+0000","last_became_active":"2023-11-04T01:42:42.695509+0000","last_became_peered":"2023-11-04T01:42:42.695509+0000","last_unstale":"2023-11-04T01:42:44.697090+0000","last_undegraded":"2023-11-04T01:42:44.697090+0000","last_fullsized":"2023-11-04T01:42:44.697090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:27.206477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692034+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:42:43.692034+0000","last_peered":"2023-11-04T01:42:43.692034+0000","last_clean":"2023-11-04T01:42:43.692034+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:42:43.692034+0000","last_undegraded":"2023-11-04T01:42:43.692034+0000","last_fullsized":"2023-11-04T01:42:43.692034+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.692156+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:42:43.692156+0000","last_peered":"2023-11-04T01:42:43.692156+0000","last_clean":"2023-11-04T01:42:43.692156+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:42:43.692156+0000","last_undegraded":"2023-11-04T01:42:43.692156+0000","last_fullsized":"2023-11-04T01:42:43.692156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":56,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.714801+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:42:43.714801+0000","last_peered":"2023-11-04T01:42:43.714801+0000","last_clean":"2023-11-04T01:42:43.714801+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:42:43.714801+0000","last_undegraded":"2023-11-04T01:42:43.714801+0000","last_fullsized":"2023-11-04T01:42:43.714801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.695183+0000","last_change":"2023-11-04T01:42:43.752631+0000","last_active":"2023-11-04T01:42:44.695183+0000","last_peered":"2023-11-04T01:42:44.695183+0000","last_clean":"2023-11-04T01:42:44.695183+0000","last_became_active":"2023-11-04T01:42:43.751829+0000","last_became_peered":"2023-11-04T01:42:43.751829+0000","last_unstale":"2023-11-04T01:42:44.695183+0000","last_undegraded":"2023-11-04T01:42:44.695183+0000","last_fullsized":"2023-11-04T01:42:44.695183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:30.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"78'6","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:45.211921+0000","last_change":"2023-11-04T01:42:42.668513+0000","last_active":"2023-11-04T01:42:45.211921+0000","last_peered":"2023-11-04T01:42:45.211921+0000","last_clean":"2023-11-04T01:42:45.211921+0000","last_became_active":"2023-11-04T01:42:42.668106+0000","last_became_peered":"2023-11-04T01:42:42.668106+0000","last_unstale":"2023-11-04T01:42:45.211921+0000","last_undegraded":"2023-11-04T01:42:45.211921+0000","last_fullsized":"2023-11-04T01:42:45.211921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:43:27.929326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.689325+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:42:43.689325+0000","last_peered":"2023-11-04T01:42:43.689325+0000","last_clean":"2023-11-04T01:42:43.689325+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:42:43.689325+0000","last_undegraded":"2023-11-04T01:42:43.689325+0000","last_fullsized":"2023-11-04T01:42:43.689325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.666108+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:42:42.666108+0000","last_peered":"2023-11-04T01:42:42.666108+0000","last_clean":"2023-11-04T01:42:42.666108+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:42:42.666108+0000","last_undegraded":"2023-11-04T01:42:42.666108+0000","last_fullsized":"2023-11-04T01:42:42.666108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.672392+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:42:42.672392+0000","last_peered":"2023-11-04T01:42:42.672392+0000","last_clean":"2023-11-04T01:42:42.672392+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:42:42.672392+0000","last_undegraded":"2023-11-04T01:42:42.672392+0000","last_fullsized":"2023-11-04T01:42:42.672392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.693774+0000","last_change":"2023-11-04T01:42:43.733441+0000","last_active":"2023-11-04T01:42:44.693774+0000","last_peered":"2023-11-04T01:42:44.693774+0000","last_clean":"2023-11-04T01:42:44.693774+0000","last_became_active":"2023-11-04T01:42:43.732449+0000","last_became_peered":"2023-11-04T01:42:43.732449+0000","last_unstale":"2023-11-04T01:42:44.693774+0000","last_undegraded":"2023-11-04T01:42:44.693774+0000","last_fullsized":"2023-11-04T01:42:44.693774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:54.908022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:42:44.697836+0000","last_change":"2023-11-04T01:42:42.672646+0000","last_active":"2023-11-04T01:42:44.697836+0000","last_peered":"2023-11-04T01:42:44.697836+0000","last_clean":"2023-11-04T01:42:44.697836+0000","last_became_active":"2023-11-04T01:42:42.671776+0000","last_became_peered":"2023-11-04T01:42:42.671776+0000","last_unstale":"2023-11-04T01:42:44.697836+0000","last_undegraded":"2023-11-04T01:42:44.697836+0000","last_fullsized":"2023-11-04T01:42:44.697836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:53.903967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.686221+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:42:43.686221+0000","last_peered":"2023-11-04T01:42:43.686221+0000","last_clean":"2023-11-04T01:42:43.686221+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:42:43.686221+0000","last_undegraded":"2023-11-04T01:42:43.686221+0000","last_fullsized":"2023-11-04T01:42:43.686221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.649543+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:42:42.649543+0000","last_peered":"2023-11-04T01:42:42.649543+0000","last_clean":"2023-11-04T01:42:42.649543+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:42:42.649543+0000","last_undegraded":"2023-11-04T01:42:42.649543+0000","last_fullsized":"2023-11-04T01:42:42.649543+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-04T01:42:42.668627+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:42:42.668627+0000","last_peered":"2023-11-04T01:42:42.668627+0000","last_clean":"2023-11-04T01:42:42.668627+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:42:42.668627+0000","last_undegraded":"2023-11-04T01:42:42.668627+0000","last_fullsized":"2023-11-04T01:42:42.668627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.733385+0000","last_change":"2023-11-04T01:42:43.727288+0000","last_active":"2023-11-04T01:42:43.733385+0000","last_peered":"2023-11-04T01:42:43.733385+0000","last_clean":"2023-11-04T01:42:43.733385+0000","last_became_active":"2023-11-04T01:42:43.726622+0000","last_became_peered":"2023-11-04T01:42:43.726622+0000","last_unstale":"2023-11-04T01:42:43.733385+0000","last_undegraded":"2023-11-04T01:42:43.733385+0000","last_fullsized":"2023-11-04T01:42:43.733385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:42.626212+0000","last_clean_scrub_stamp":"2023-11-04T01:42:42.626212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:45.524833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.711739+0000","last_change":"2023-11-04T01:42:42.668942+0000","last_active":"2023-11-04T01:42:43.711739+0000","last_peered":"2023-11-04T01:42:43.711739+0000","last_clean":"2023-11-04T01:42:43.711739+0000","last_became_active":"2023-11-04T01:42:42.667784+0000","last_became_peered":"2023-11-04T01:42:42.667784+0000","last_unstale":"2023-11-04T01:42:43.711739+0000","last_undegraded":"2023-11-04T01:42:43.711739+0000","last_fullsized":"2023-11-04T01:42:43.711739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:41.622157+0000","last_clean_scrub_stamp":"2023-11-04T01:42:41.622157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:00.993722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.696674+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:42:43.696674+0000","last_peered":"2023-11-04T01:42:43.696674+0000","last_clean":"2023-11-04T01:42:43.696674+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:42:43.696674+0000","last_undegraded":"2023-11-04T01:42:43.696674+0000","last_fullsized":"2023-11-04T01:42:43.696674+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.699085+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:42:43.699085+0000","last_peered":"2023-11-04T01:42:43.699085+0000","last_clean":"2023-11-04T01:42:43.699085+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:42:43.699085+0000","last_undegraded":"2023-11-04T01:42:43.699085+0000","last_fullsized":"2023-11-04T01:42:43.699085+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:42:43.690037+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:42:43.690037+0000","last_peered":"2023-11-04T01:42:43.690037+0000","last_clean":"2023-11-04T01:42:43.690037+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:42:43.690037+0000","last_undegraded":"2023-11-04T01:42:43.690037+0000","last_fullsized":"2023-11-04T01:42:43.690037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1552384,"data_stored":1027337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85999999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1970000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.79400000000000004,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.83999999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.872,"15min":0.86899999999999999},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0840000000000001,"5min":1.258,"15min":1.258},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91100000000000003,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.282,"5min":1.286,"15min":1.286},"last":1.042},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.71899999999999997,"5min":0.623,"15min":0.623},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97099999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89400000000000002},"min":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.151,"5min":1.175,"15min":1.175},"last":0.872},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.208,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.91300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.98199999999999998,"15min":1},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1739999999999999,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0640000000000001,"15min":1.0620000000000001},"min":{"1min":0.72899999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.042,"15min":1.03},"min":{"1min":0.78200000000000003,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.323,"5min":1.409,"15min":1.409},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1240000000000001,"15min":1.117},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.222},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.409,"5min":1.47,"15min":1.47},"last":1.1879999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":439129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.58799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2010000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.1990000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.93999999999999995,"15min":0.93500000000000005},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.077},{"interface":"front","average":{"1min":0.997,"5min":0.996,"15min":0.996},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":1.2549999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95699999999999996,"15min":0.95299999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2589999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.94799999999999995,"15min":0.95599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.284,"5min":1.319,"15min":1.319},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1839999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.98699999999999999,"15min":0.98099999999999998},"min":{"1min":0.63300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1870000000000001,"5min":1.224,"15min":1.224},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.028,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.628,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1899999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.139}]},{"osd":5,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.028,"15min":1.028},"min":{"1min":0.85799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.337,"5min":1.694,"15min":1.694},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.292,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1259999999999999,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4390000000000001,"5min":1.649,"15min":1.649},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1679999999999999,"15min":1.181},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.427,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.111}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":444276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.79400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.141,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.85499999999999998},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.878,"15min":0.875},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.879,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1950000000000001,"5min":1.419,"15min":1.419},"last":0.997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.226,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.93400000000000005,"15min":0.93500000000000005},"min":{"1min":0.63700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.123},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0449999999999999,"15min":1.0529999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.2929999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.94799999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88600000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.495,"15min":0.495},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.871},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.64600000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1850000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.214}]},{"osd":6,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.2929999999999999,"5min":1.502,"15min":1.502},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0009999999999999,"15min":1.0029999999999999},"min":{"1min":0.67000000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3180000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.169}]},{"osd":7,"last update":"Sat Nov 4 01:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"min":{"1min":0.747,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.327,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.125,"15min":1.121},"min":{"1min":1.0049999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3660000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.2490000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":444436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.0009999999999999,"15min":1.0249999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3460000000000001,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.873},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89100000000000001,"15min":0.89500000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.264,"5min":1.3,"15min":1.3},"last":1.1879999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94499999999999995,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.302,"5min":1.605,"15min":1.605},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92300000000000004,"15min":0.92100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.55800000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.139,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.746},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.98599999999999999,"15min":0.99199999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.288,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.01}]},{"osd":3,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.242,"5min":1.488,"15min":1.488},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.998,"5min":1.02,"15min":1.024},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4139999999999999,"5min":1.996,"15min":1.996},"last":0.94999999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0880000000000001,"15min":1.101},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2809999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.127},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.077,"15min":1.0860000000000001},"min":{"1min":0.753,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4119999999999999,"5min":1.514,"15min":1.514},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1479999999999999},"min":{"1min":0.88900000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.353,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:41:49 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.88800000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.474,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.085}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":436913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.64700000000000002,"15min":0.66400000000000003},"min":{"1min":0.33700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95099999999999996,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.202,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.309},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.1080000000000001,"5min":1.623,"15min":1.623},"last":0.439}]},{"osd":2,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.69199999999999995,"15min":0.70799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0229999999999999,"5min":1.276,"15min":1.276},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0920000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.83699999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1850000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.872,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.319,"5min":1.806,"15min":1.806},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97499999999999998,"15min":0.96899999999999997},"min":{"1min":0.67400000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.006},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.327,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.014,"15min":1.0289999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.46,"5min":1.54,"15min":1.54},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0569999999999999,"15min":1.069},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.4570000000000001,"5min":1.73,"15min":1.73},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.0049999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3700000000000001,"5min":1.407,"15min":1.407},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.101,"15min":1.111},"min":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5780000000000001,"5min":1.732,"15min":1.732},"last":0.71499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":436913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.625,"15min":0.65100000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65100000000000002,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.68899999999999995,"15min":0.70499999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94199999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73299999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.747,"15min":0.77300000000000002},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.82799999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.76300000000000001,"15min":0.78200000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98999999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.748,"15min":0.76900000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.91100000000000003,"5min":1.111,"15min":1.111},"last":1.294}]},{"osd":4,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.96999999999999997,"15min":0.99099999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1120000000000001,"5min":1.534,"15min":1.534},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0389999999999999,"15min":1.0529999999999999},"min":{"1min":0.72199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.456,"5min":1.877,"15min":1.877},"last":1.0629999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.042,"15min":1.056},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2689999999999999,"5min":1.446,"15min":1.446},"last":1.008},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.0609999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.222,"5min":1.508,"15min":1.508},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.165,"15min":1.1950000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.226},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0920000000000001,"15min":1.1160000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.163,"5min":1.607,"15min":1.607},"last":1.1879999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.198,"15min":1.228},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.393,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.327},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2869999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.262}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":444346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0209999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66000000000000003,"15min":0.65500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2989999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.42999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.54500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1379999999999999,"5min":1.458,"15min":1.458},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68700000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.095,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.62},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.95699999999999996,"15min":0.94899999999999995},"min":{"1min":0.63,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4710000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.044,"15min":1.0449999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9379999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.085,"15min":1.0860000000000001},"min":{"1min":0.72999999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6339999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.90700000000000003,"15min":0.90000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5700000000000001,"5min":1.667,"15min":1.667},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.071,"15min":1.0629999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7809999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.1180000000000001,"15min":1.119},"min":{"1min":0.76700000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.532,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.01,"5min":0.98699999999999999,"15min":0.98299999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.716,"5min":1.994,"15min":1.994},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1029599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.59099999999999997,"15min":0.60199999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80900000000000005,"5min":1.135,"15min":1.135},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.335,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.82399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92400000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0409999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.441,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.016,"15min":1.03},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5920000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85599999999999998,"15min":0.84999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.59299999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2150000000000001,"5min":1.357,"15min":1.357},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2689999999999999,"5min":1.694,"15min":1.694},"last":1.1379999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.4039999999999999,"5min":1.782,"15min":1.782},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.056,"15min":1.0620000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":1.2669999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0780000000000001,"15min":1.083},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.796,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.96599999999999997,"15min":0.96399999999999997},"min":{"1min":0.64400000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.319}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:48.370 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:42:48.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:42:48.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7feea1260640 1 Processor -- start 2023-11-04T01:42:48.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7feea1260640 1 -- start start 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7feea1260640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fee9c0caad0 0x7fee9c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7feea1260640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c06fc10 con 0x7fee9c15af30 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7feea1260640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0c8fa0 con 0x7fee9c0c9cd0 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7feea1260640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0c9840 con 0x7fee9c0caad0 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7fee9ad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fee9c15af30 0x7fee9c0ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45094/0 (socket says 172.21.15.40:45094) 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7fee9ad9d640 1 -- 172.21.15.40:0/4155988252 learned_addr learned my addr 172.21.15.40:0/4155988252 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7fee9a59c640 1 --2- 172.21.15.40:0/4155988252 >> v2:172.21.15.91:3300/0 conn(0x7fee9c0caad0 0x7fee9c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303381509 0 0) 0x7fee9c06fc10 con 0x7fee9c15af30 2023-11-04T01:42:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee84003530 con 0x7fee9c15af30 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.534+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1258901707 0 0) 0x7fee84003530 con 0x7fee9c15af30 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 >> v2:172.21.15.91:3300/0 conn(0x7fee9c0caad0 msgr2=0x7fee9c0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 --2- 172.21.15.40:0/4155988252 >> v2:172.21.15.91:3300/0 conn(0x7fee9c0caad0 0x7fee9c0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 >> v1:172.21.15.91:6789/0 conn(0x7fee9c0c9cd0 legacy=0x7fee9c0ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c15b310 con 0x7fee9c15af30 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fee8c001680 con 0x7fee9c15af30 2023-11-04T01:42:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 >> v1:172.21.15.40:6789/0 conn(0x7fee9c15af30 legacy=0x7fee9c0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee84003980 0x7fee84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee840047d0 0x7fee84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee84005190 0x7fee8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c9840 con 0x7fee840047d0 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8400c130 con 0x7fee84005190 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8400c2f0 con 0x7fee84003980 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee840047d0 0x7fee84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9b59e640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee84005190 0x7fee8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9ad9d640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee84003980 0x7fee84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 -- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee84003980 msgr2=0x7fee84003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee84003980 0x7fee84003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 -- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee84005190 msgr2=0x7fee8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee84005190 0x7fee8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 -- 172.21.15.40:0/4155988252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84003530 con 0x7fee840047d0 2023-11-04T01:42:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9b59e640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee84005190 0x7fee8400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9b59e640 1 -- 172.21.15.40:0/4155988252 reap_dead start 2023-11-04T01:42:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9ad9d640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee84003980 0x7fee84003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee9a59c640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee840047d0 0x7fee84004c50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fee90009ab0 tx=0x7fee9001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f521398adcae47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900a55d0 con 0x7fee840047d0 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee900a5730 con 0x7fee840047d0 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7fee99d9b640 1 -- 172.21.15.40:0/4155988252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900a5ae0 con 0x7fee840047d0 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7feea1260640 1 -- 172.21.15.40:0/4155988252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee840047d0 msgr2=0x7fee84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7feea1260640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee840047d0 0x7fee84004c50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fee90009ab0 tx=0x7fee9001ca00 comp rx=0 tx=0).stop 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7feea1260640 1 -- 172.21.15.40:0/4155988252 shutdown_connections 2023-11-04T01:42:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7feea1260640 1 --2- 172.21.15.40:0/4155988252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee840047d0 0x7fee84004c50 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.538+0000 7feea1260640 1 -- 172.21.15.40:0/4155988252 >> 172.21.15.40:0/4155988252 conn(0x7fee9c0ce9e0 msgr2=0x7fee9c0cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- 172.21.15.40:0/4155988252 shutdown_connections 2023-11-04T01:42:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- 172.21.15.40:0/4155988252 wait complete. 2023-11-04T01:42:48.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 Processor -- start 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- start start 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee840047d0 0x7fee9c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 0x7fee9c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c0c7230 0x7fee9c0c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c6e10 con 0x7fee9c0c5a20 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c152b50 con 0x7fee9c0c7230 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c6190 con 0x7fee840047d0 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 0x7fee9c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 0x7fee9c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36314/0 (socket says 172.21.15.40:36314) 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 -- 172.21.15.40:0/2504221922 learned_addr learned my addr 172.21.15.40:0/2504221922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9b59e640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c0c7230 0x7fee9c0c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 -- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee840047d0 msgr2=0x7fee9c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee840047d0 0x7fee9c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 -- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c0c7230 msgr2=0x7fee9c0c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c0c7230 0x7fee9c0c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 -- 172.21.15.40:0/2504221922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0c6470 con 0x7fee9c0c5a20 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee9a59c640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 0x7fee9c152610 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fee9001c830 tx=0x7fee900197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000f000 con 0x7fee9c0c5a20 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee900ad440 con 0x7fee9c0c5a20 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c0c6750 con 0x7fee9c0c5a20 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900ad7f0 con 0x7fee9c0c5a20 2023-11-04T01:42:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c0c5ea0 con 0x7fee9c0c5a20 2023-11-04T01:42:48.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.542+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c0744a0 con 0x7fee9c0c5a20 2023-11-04T01:42:48.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.546+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee900b4070 con 0x7fee9c0c5a20 2023-11-04T01:42:48.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.546+0000 7fee837fe640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fee880664a0 0x7fee88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.546+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fee9011e0c0 con 0x7fee9c0c5a20 2023-11-04T01:42:48.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.546+0000 7fee9ad9d640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fee880664a0 0x7fee88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.546+0000 7fee9ad9d640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fee880664a0 0x7fee88068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee8c000fc0 tx=0x7fee8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.550+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee900eb1a0 con 0x7fee9c0c5a20 2023-11-04T01:42:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.762+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fee9c0c33c0 con 0x7fee9c0c5a20 2023-11-04T01:42:48.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.766+0000 7fee837fe640 1 -- 172.21.15.40:0/2504221922 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7fee900ad950 con 0x7fee9c0c5a20 2023-11-04T01:42:48.773 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-11-04T01:42:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:42:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2023-11-04T01:42:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2023-11-04T01:42:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:48.774 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fee880664a0 msgr2=0x7fee88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fee880664a0 0x7fee88068960 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee8c000fc0 tx=0x7fee8c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 msgr2=0x7fee9c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 0x7fee9c152610 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fee9001c830 tx=0x7fee900197a0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 shutdown_connections 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fee880664a0 0x7fee88068960 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fee9c0c7230 0x7fee9c0c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee9c0c5a20 0x7fee9c152610 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 --2- 172.21.15.40:0/2504221922 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fee840047d0 0x7fee9c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 >> 172.21.15.40:0/2504221922 conn(0x7fee9c0ce9e0 msgr2=0x7fee9c0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 shutdown_connections 2023-11-04T01:42:48.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.770+0000 7feea1260640 1 -- 172.21.15.40:0/2504221922 wait complete. 2023-11-04T01:42:48.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:48.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 Processor -- start 2023-11-04T01:42:48.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 -- start start 2023-11-04T01:42:48.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77700c9960 0x7f77700704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f77700b0c70 0x7f77700ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777006d2f0 con 0x7f77700c9960 2023-11-04T01:42:48.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77700ce110 con 0x7f77700b0c70 2023-11-04T01:42:48.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.910+0000 7f7774aac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700ce320 con 0x7f77700b0890 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77700c9960 0x7f77700704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77700c9960 0x7f77700704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36330/0 (socket says 172.21.15.40:36330) 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 -- 172.21.15.40:0/3264413776 learned_addr learned my addr 172.21.15.40:0/3264413776 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776e59c640 1 --2- 172.21.15.40:0/3264413776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776ed9d640 1 --2- 172.21.15.40:0/3264413776 >> v2:172.21.15.91:3300/0 conn(0x7f77700b0c70 0x7f77700ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 -- 172.21.15.40:0/3264413776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 msgr2=0x7f77700cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 --2- 172.21.15.40:0/3264413776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 -- 172.21.15.40:0/3264413776 >> v2:172.21.15.91:3300/0 conn(0x7f77700b0c70 msgr2=0x7f77700ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 --2- 172.21.15.40:0/3264413776 >> v2:172.21.15.91:3300/0 conn(0x7f77700b0c70 0x7f77700ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 -- 172.21.15.40:0/3264413776 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700ce600 con 0x7f77700c9960 2023-11-04T01:42:48.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776ed9d640 1 --2- 172.21.15.40:0/3264413776 >> v2:172.21.15.91:3300/0 conn(0x7f77700b0c70 0x7f77700ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776dd9b640 1 --2- 172.21.15.40:0/3264413776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77700704e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f77700c9df0 tx=0x7f776401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff940cbea35d37a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776d59a640 1 -- 172.21.15.40:0/3264413776 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776400b2d0 con 0x7f77700c9960 2023-11-04T01:42:48.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776d59a640 1 -- 172.21.15.40:0/3264413776 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776400b430 con 0x7f77700c9960 2023-11-04T01:42:48.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f776d59a640 1 -- 172.21.15.40:0/3264413776 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640a7c70 con 0x7f77700c9960 2023-11-04T01:42:48.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 -- 172.21.15.40:0/3264413776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 msgr2=0x7f77700704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 --2- 172.21.15.40:0/3264413776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77700704e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f77700c9df0 tx=0x7f776401eba0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 -- 172.21.15.40:0/3264413776 shutdown_connections 2023-11-04T01:42:48.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 --2- 172.21.15.40:0/3264413776 >> v2:172.21.15.91:3300/0 conn(0x7f77700b0c70 0x7f77700ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 --2- 172.21.15.40:0/3264413776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77700704e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 --2- 172.21.15.40:0/3264413776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 -- 172.21.15.40:0/3264413776 >> 172.21.15.40:0/3264413776 conn(0x7f77700cebb0 msgr2=0x7f77700cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 -- 172.21.15.40:0/3264413776 shutdown_connections 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.914+0000 7f7774aac640 1 -- 172.21.15.40:0/3264413776 wait complete. 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 Processor -- start 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- start start 2023-11-04T01:42:48.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77700b0c70 0x7f7770152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77701534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700b17b0 con 0x7f77700c9960 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7770152800 con 0x7f77700b0c70 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700b1a00 con 0x7f77700b0890 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77701534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77701534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36336/0 (socket says 172.21.15.40:36336) 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776e59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 -- 172.21.15.40:0/1509998341 learned_addr learned my addr 172.21.15.40:0/1509998341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776dd9b640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77700b0c70 0x7f7770152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 -- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 msgr2=0x7f77700b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 -- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77700b0c70 msgr2=0x7f7770152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77700b0c70 0x7f7770152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 -- 172.21.15.40:0/1509998341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776400bd40 con 0x7f77700c9960 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f776ed9d640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77701534a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f776800c7f0 tx=0x7f776800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768007820 con 0x7f77700c9960 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680079c0 con 0x7f77700c9960 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77700b1ce0 con 0x7f77700c9960 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768007d70 con 0x7f77700c9960 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77700b22a0 con 0x7f77700c9960 2023-11-04T01:42:48.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.918+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77700744a0 con 0x7f77700c9960 2023-11-04T01:42:48.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.922+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77680113f0 con 0x7f77700c9960 2023-11-04T01:42:48.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.922+0000 7f775effd640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77500664a0 0x7f7750068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.922+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f77680844d0 con 0x7f77700c9960 2023-11-04T01:42:48.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.922+0000 7f776e59c640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77500664a0 0x7f7750068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.922+0000 7f776e59c640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77500664a0 0x7f7750068960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f77700b3590 tx=0x7f7760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:48.926+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7768051660 con 0x7f77700c9960 2023-11-04T01:42:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77700b4b30 con 0x7f77700c9960 2023-11-04T01:42:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f775effd640 1 -- 172.21.15.40:0/1509998341 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f7768054c80 con 0x7f77700c9960 2023-11-04T01:42:49.127 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:49.127 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:43.012180+0000","modified":"2023-11-04T01:42:46.287619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6645},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6645":{"gid":6645,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/3469878458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3469878458},{"type":"v1","addr":"172.21.15.91:6837","nonce":3469878458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:42:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 37 2023-11-04T01:42:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77500664a0 msgr2=0x7f7750068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77500664a0 0x7f7750068960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f77700b3590 tx=0x7f7760008040 comp rx=0 tx=0).stop 2023-11-04T01:42:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 msgr2=0x7f77701534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77701534a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f776800c7f0 tx=0x7f776800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 shutdown_connections 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77500664a0 0x7f7750068960 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77700c9960 0x7f77701534a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77700b0c70 0x7f7770152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 --2- 172.21.15.40:0/1509998341 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77700b0890 0x7f77700b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 >> 172.21.15.40:0/1509998341 conn(0x7f77700cebb0 msgr2=0x7f77700cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 shutdown_connections 2023-11-04T01:42:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.122+0000 7f7774aac640 1 -- 172.21.15.40:0/1509998341 wait complete. 2023-11-04T01:42:49.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:42:43.012180+0000', 'modified': '2023-11-04T01:42:46.287619+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6645}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6645': {'gid': 6645, 'name': 'd', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.91:6837/3469878458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6835', 'nonce': 3469878458}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 3469878458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:42:49.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:42:49.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:42:49.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 Processor -- start 2023-11-04T01:42:49.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 -- start start 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b090 0x7fb97415f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb97415b470 0x7fb97406a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb974065fd0 0x7fb97406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97415fca0 con 0x7fb97415b470 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9740cbe40 con 0x7fb974065fd0 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb978ed5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740cc120 con 0x7fb97415b090 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb971d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb97415b470 0x7fb97406a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb971d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb97415b470 0x7fb97406a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36342/0 (socket says 172.21.15.40:36342) 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.678+0000 7fb971d9b640 1 -- 172.21.15.40:0/3048522239 learned_addr learned my addr 172.21.15.40:0/3048522239 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb97259c640 1 --2- 172.21.15.40:0/3048522239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b090 0x7fb97415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb972d9d640 1 --2- 172.21.15.40:0/3048522239 >> v2:172.21.15.91:3300/0 conn(0x7fb974065fd0 0x7fb97406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb971d9b640 1 -- 172.21.15.40:0/3048522239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b090 msgr2=0x7fb97415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3048522239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b090 0x7fb97415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb971d9b640 1 -- 172.21.15.40:0/3048522239 >> v2:172.21.15.91:3300/0 conn(0x7fb974065fd0 msgr2=0x7fb97406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3048522239 >> v2:172.21.15.91:3300/0 conn(0x7fb974065fd0 0x7fb97406a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb971d9b640 1 -- 172.21.15.40:0/3048522239 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740cc400 con 0x7fb97415b470 2023-11-04T01:42:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3048522239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97415b470 0x7fb97406a160 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb9740aec10 tx=0x7fb96801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea187d023347909 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb97159a640 1 -- 172.21.15.40:0/3048522239 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680aa5f0 con 0x7fb97415b470 2023-11-04T01:42:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb97159a640 1 -- 172.21.15.40:0/3048522239 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9680aa750 con 0x7fb97415b470 2023-11-04T01:42:49.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb97159a640 1 -- 172.21.15.40:0/3048522239 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680aaae0 con 0x7fb97415b470 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 -- 172.21.15.40:0/3048522239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97415b470 msgr2=0x7fb97406a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 --2- 172.21.15.40:0/3048522239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97415b470 0x7fb97406a160 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb9740aec10 tx=0x7fb96801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 -- 172.21.15.40:0/3048522239 shutdown_connections 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 --2- 172.21.15.40:0/3048522239 >> v2:172.21.15.91:3300/0 conn(0x7fb974065fd0 0x7fb97406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 --2- 172.21.15.40:0/3048522239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb97415b470 0x7fb97406a160 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 --2- 172.21.15.40:0/3048522239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b090 0x7fb97415f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 -- 172.21.15.40:0/3048522239 >> 172.21.15.40:0/3048522239 conn(0x7fb9740716a0 msgr2=0x7fb974071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 -- 172.21.15.40:0/3048522239 shutdown_connections 2023-11-04T01:42:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.682+0000 7fb978ed5640 1 -- 172.21.15.40:0/3048522239 wait complete. 2023-11-04T01:42:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 Processor -- start 2023-11-04T01:42:49.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 -- start start 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 0x7fb974156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb97415b090 0x7fb9741516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b470 0x7fb974151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97415a3b0 con 0x7fb974065fd0 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97415a690 con 0x7fb97415b090 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97415a970 con 0x7fb97415b470 2023-11-04T01:42:49.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 0x7fb974156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 0x7fb974156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36344/0 (socket says 172.21.15.40:36344) 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 -- 172.21.15.40:0/287587383 learned_addr learned my addr 172.21.15.40:0/287587383 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb971d9b640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb97415b090 0x7fb9741516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb972d9d640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b470 0x7fb974151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 -- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b470 msgr2=0x7fb974151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b470 0x7fb974151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 -- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb97415b090 msgr2=0x7fb9741516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb97415b090 0x7fb9741516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 -- 172.21.15.40:0/287587383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680094d0 con 0x7fb974065fd0 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb972d9d640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b470 0x7fb974151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb97259c640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 0x7fb974156cb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb96400efc0 tx=0x7fb96400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb962ffd640 1 -- 172.21.15.40:0/287587383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964014480 con 0x7fb974065fd0 2023-11-04T01:42:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb962ffd640 1 -- 172.21.15.40:0/287587383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96400f040 con 0x7fb974065fd0 2023-11-04T01:42:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97415ac50 con 0x7fb974065fd0 2023-11-04T01:42:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb962ffd640 1 -- 172.21.15.40:0/287587383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964014800 con 0x7fb974065fd0 2023-11-04T01:42:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.686+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9741571f0 con 0x7fb974065fd0 2023-11-04T01:42:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb962ffd640 1 -- 172.21.15.40:0/287587383 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb964014960 con 0x7fb974065fd0 2023-11-04T01:42:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb962ffd640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb9540664a0 0x7fb954068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb962ffd640 1 -- 172.21.15.40:0/287587383 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fb964084e80 con 0x7fb974065fd0 2023-11-04T01:42:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb971d9b640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb9540664a0 0x7fb954068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 Processor -- start 2023-11-04T01:42:49.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- start start 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb971d9b640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb9540664a0 0x7fb954068960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9680ae000 tx=0x7fb9680a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d19380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0ccc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0b97460 con 0x55e9a0d18fa0 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0b28690 con 0x55e9a0cccb40 2023-11-04T01:42:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0b25bc0 con 0x55e9a0d198c0 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d19380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d19380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36360/0 (socket says 172.21.15.40:36360) 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 -- 172.21.15.40:0/3895972726 learned_addr learned my addr 172.21.15.40:0/3895972726 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0ccc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb972d9d640 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 -- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 msgr2=0x55e9a0ccc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0ccc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 -- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 msgr2=0x55e9a0cccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 -- 172.21.15.40:0/3895972726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9a0819890 con 0x55e9a0d18fa0 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb972d9d640 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97259c640 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d19380 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb964052090 tx=0x7fb964055800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ddddc2469cf7c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb953fff640 1 -- 172.21.15.40:0/3895972726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96407cea0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb953fff640 1 -- 172.21.15.40:0/3895972726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96405de90 con 0x55e9a0d18fa0 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb953fff640 1 -- 172.21.15.40:0/3895972726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640522a0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- 172.21.15.40:0/3895972726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 msgr2=0x55e9a0d19380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d19380 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb964052090 tx=0x7fb964055800 comp rx=0 tx=0).stop 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- 172.21.15.40:0/3895972726 shutdown_connections 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0ccc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 --2- 172.21.15.40:0/3895972726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d19380 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- 172.21.15.40:0/3895972726 >> 172.21.15.40:0/3895972726 conn(0x55e9a0cf9d40 msgr2=0x55e9a0cfc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- 172.21.15.40:0/3895972726 shutdown_connections 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.690+0000 7fb97c002000 1 -- 172.21.15.40:0/3895972726 wait complete. 2023-11-04T01:42:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- start start 2023-11-04T01:42:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 Processor -- start 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0cd25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0cd2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0b214b0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0ad9aa0 con 0x55e9a0cccb40 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0adf940 con 0x55e9a0d198c0 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 10 client.0 _ll_register_callbacks cb 0x55e9a0cba460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0cd25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0cd25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36374/0 (socket says 172.21.15.40:36374) 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 -- 172.21.15.40:0/2869550725 learned_addr learned my addr 172.21.15.40:0/2869550725 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97259c640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb972d9d640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0cd2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 -- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 msgr2=0x55e9a0cd2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0cd2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 -- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 msgr2=0x55e9a0cd2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 -- 172.21.15.40:0/2869550725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9741571f0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb971d9b640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0cd25c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb96801c9b0 tx=0x7fb96801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91f0aefe594c474 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:42:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 1 -- 172.21.15.40:0/2869550725 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9680aad70 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9a0adee10 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 1 -- 172.21.15.40:0/2869550725 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fb9680a7070 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 1 -- 172.21.15.40:0/2869550725 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9680c1420 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 10 client.6798 fetch_fsmap learned FSMap version 37 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55e9a0ae21a0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 1 -- 172.21.15.40:0/2869550725 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9a0adee10 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 1 -- 172.21.15.40:0/2869550725 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb9680bd040 con 0x55e9a0d18fa0 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 10 client.6798 fetch_fsmap finished waiting for FSMap version 37 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 10 client.6798 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 20 client.6798 populate_metadata read hostname 'smithi040' 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d28240 0x55e9a0d2a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 4 client.6798 mds_command: new command op to 6645 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 --> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9a0b1fe00 con 0x55e9a0d28240 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97259c640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d28240 0x55e9a0d2a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb9517fa640 10 client.6798 ms_handle_connect on v2:172.21.15.91:6835/3469878458 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.694+0000 7fb97259c640 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d28240 0x55e9a0d2a630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d77e6a35faeb5a4 server_cookie=62323af716b31d5e in_seq=0 out_seq=0 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb9517fa640 1 -- 172.21.15.40:0/2869550725 <== mds.0 v2:172.21.15.91:6835/3469878458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9a0b1fe00 con 0x55e9a0d28240 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb9517fa640 10 client.6798 handle_command_reply: tid=0 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 client.6798 shutdown 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 msgr2=0x55e9a0cd25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0cd25c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb96801c9b0 tx=0x7fb96801ad10 comp rx=0 tx=0).stop 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 shutdown_connections 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d28240 0x55e9a0d2a630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0d198c0 0x55e9a0cd2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0cd25c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb9517fa640 0 client.6798 ms_handle_reset on v2:172.21.15.91:6835/3469878458 2023-11-04T01:42:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 --2- 172.21.15.40:0/2869550725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 >> 172.21.15.40:0/2869550725 conn(0x55e9a0cf9d40 msgr2=0x55e9a0cfc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 shutdown_connections 2023-11-04T01:42:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 1 -- 172.21.15.40:0/2869550725 wait complete. 2023-11-04T01:42:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.698+0000 7fb97c002000 20 client.6798 trim_cache size 0 max 16384 2023-11-04T01:42:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 Processor -- start 2023-11-04T01:42:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- start start 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0cd48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d2a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0ccc6f0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a07da940 con 0x55e9a0cccb40 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0cc6a70 con 0x55e9a0cf9d40 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d2a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d2a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36388/0 (socket says 172.21.15.40:36388) 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 -- 172.21.15.40:0/1829227048 learned_addr learned my addr 172.21.15.40:0/1829227048 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb971d9b640 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97259c640 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0cd48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 -- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 msgr2=0x55e9a0cd48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0cd48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 -- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 msgr2=0x55e9a0cd4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 -- 172.21.15.40:0/1829227048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9a0ac84a0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb971d9b640 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb972d9d640 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d2a630 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00f7b0 tx=0x7fb96c00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ec496ff5e2e815 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb960ff9640 1 -- 172.21.15.40:0/1829227048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c011a40 con 0x55e9a0d18fa0 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb960ff9640 1 -- 172.21.15.40:0/1829227048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00c040 con 0x55e9a0d18fa0 2023-11-04T01:42:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb960ff9640 1 -- 172.21.15.40:0/1829227048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c011e00 con 0x55e9a0d18fa0 2023-11-04T01:42:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- 172.21.15.40:0/1829227048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 msgr2=0x55e9a0d2a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d2a630 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00f7b0 tx=0x7fb96c00fc70 comp rx=0 tx=0).stop 2023-11-04T01:42:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- 172.21.15.40:0/1829227048 shutdown_connections 2023-11-04T01:42:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d2a630 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0cccb40 0x55e9a0cd4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 --2- 172.21.15.40:0/1829227048 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0cd48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.714+0000 7fb97c002000 1 -- 172.21.15.40:0/1829227048 >> 172.21.15.40:0/1829227048 conn(0x55e9a0ccbf20 msgr2=0x55e9a0d17f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- 172.21.15.40:0/1829227048 shutdown_connections 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- 172.21.15.40:0/1829227048 wait complete. 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- start start 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 Processor -- start 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 0x55e9a0d76e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0d77370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d778b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0b24010 con 0x55e9a0cccb40 2023-11-04T01:42:49.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0b1b7b0 con 0x55e9a0d18fa0 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9a0ae6d20 con 0x55e9a0cf9d40 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 10 client.0 _ll_register_callbacks cb 0x7fb964051ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 0x55e9a0d76e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 0x55e9a0d76e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36394/0 (socket says 172.21.15.40:36394) 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 -- 172.21.15.40:0/3070494092 learned_addr learned my addr 172.21.15.40:0/3070494092 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0d77370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb972d9d640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d778b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 -- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 msgr2=0x55e9a0d77370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0d77370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 -- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0d18fa0 msgr2=0x55e9a0d778b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d778b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 -- 172.21.15.40:0/3070494092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c00e040 con 0x55e9a0cccb40 2023-11-04T01:42:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0d77370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97259c640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 0x55e9a0d76e30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ef90 tx=0x7fb964000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19c71646542fe85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 1 -- 172.21.15.40:0/3070494092 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964078070 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 1 -- 172.21.15.40:0/3070494092 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fb964053f30 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9a0aebd10 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 1 -- 172.21.15.40:0/3070494092 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb964073040 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 10 client.6804 fetch_fsmap learned FSMap version 37 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55e9a0819cc0 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 1 -- 172.21.15.40:0/3070494092 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9a0aebd10 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 1 -- 172.21.15.40:0/3070494092 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb964063070 con 0x55e9a0cccb40 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 10 client.6804 fetch_fsmap finished waiting for FSMap version 37 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 10 client.6804 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:42:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 20 client.6804 populate_metadata read hostname 'smithi040' 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d198c0 0x55e9a0d77df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 4 client.6804 mds_command: new command op to 6645 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 --> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9a0b1a490 con 0x55e9a0d198c0 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d198c0 0x55e9a0d77df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb971d9b640 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d198c0 0x55e9a0d77df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66f925664229b35a server_cookie=3ec0b421bfe23b7f in_seq=0 out_seq=0 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.718+0000 7fb9517fa640 10 client.6804 ms_handle_connect on v2:172.21.15.91:6835/3469878458 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb9517fa640 1 -- 172.21.15.40:0/3070494092 <== mds.0 v2:172.21.15.91:6835/3469878458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e9a0b1a490 con 0x55e9a0d198c0 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb9517fa640 10 client.6804 handle_command_reply: tid=0 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 client.6804 shutdown 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 msgr2=0x55e9a0d76e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 0x55e9a0d76e30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ef90 tx=0x7fb964000f50 comp rx=0 tx=0).stop 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 shutdown_connections 2023-11-04T01:42:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:6835/3469878458,v1:172.21.15.91:6837/3469878458] conn(0x55e9a0d198c0 0x55e9a0d77df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e9a0d18fa0 0x55e9a0d778b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55e9a0cf9d40 0x55e9a0d77370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 --2- 172.21.15.40:0/3070494092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55e9a0cccb40 0x55e9a0d76e30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb9517fa640 0 client.6804 ms_handle_reset on v2:172.21.15.91:6835/3469878458 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 >> 172.21.15.40:0/3070494092 conn(0x55e9a0ccbf20 msgr2=0x55e9a0cd4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 shutdown_connections 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 1 -- 172.21.15.40:0/3070494092 wait complete. 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb97c002000 20 client.6804 trim_cache size 0 max 16384 2023-11-04T01:42:49.731 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 6645, 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 5.8016888169999996, 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 37, 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 79, 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 79, 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 12.443713101 2023-11-04T01:42:49.732 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb9540664a0 msgr2=0x7fb954068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb9540664a0 0x7fb954068960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9680ae000 tx=0x7fb9680a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 msgr2=0x7fb974156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 0x7fb974156cb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb96400efc0 tx=0x7fb96400c490 comp rx=0 tx=0).stop 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 shutdown_connections 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb9540664a0 0x7fb954068960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb97415b470 0x7fb974151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb97415b090 0x7fb9741516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 --2- 172.21.15.40:0/287587383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb974065fd0 0x7fb974156cb0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 >> 172.21.15.40:0/287587383 conn(0x7fb9740716a0 msgr2=0x7fb9740cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 shutdown_connections 2023-11-04T01:42:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.722+0000 7fb978ed5640 1 -- 172.21.15.40:0/287587383 wait complete. 2023-11-04T01:42:49.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:49.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 Processor -- start 2023-11-04T01:42:49.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 -- start start 2023-11-04T01:42:49.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feb9c15afd0 0x7feb9c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb9c0b0d40 0x7feb9c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0c2670 con 0x7feb9c06f8f0 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c070140 con 0x7feb9c0b0d40 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba3eae640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c06c9f0 con 0x7feb9c15afd0 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb9c0b0d40 0x7feb9c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb9c0b0d40 0x7feb9c15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36398/0 (socket says 172.21.15.40:36398) 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 -- 172.21.15.40:0/3916854928 learned_addr learned my addr 172.21.15.40:0/3916854928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba1c4a640 1 --2- 172.21.15.40:0/3916854928 >> v2:172.21.15.91:3300/0 conn(0x7feb9c15afd0 0x7feb9c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 -- 172.21.15.40:0/3916854928 >> v2:172.21.15.91:3300/0 conn(0x7feb9c15afd0 msgr2=0x7feb9c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 --2- 172.21.15.40:0/3916854928 >> v2:172.21.15.91:3300/0 conn(0x7feb9c15afd0 0x7feb9c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 -- 172.21.15.40:0/3916854928 >> v1:172.21.15.91:6789/0 conn(0x7feb9c06f8f0 legacy=0x7feb9c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.850+0000 7feba244b640 1 -- 172.21.15.40:0/3916854928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c06bc30 con 0x7feb9c0b0d40 2023-11-04T01:42:49.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba244b640 1 --2- 172.21.15.40:0/3916854928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0b0d40 0x7feb9c15ec80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ce980 tx=0x7feb9401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3643c1405c5d8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba0c48640 1 -- 172.21.15.40:0/3916854928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940a5820 con 0x7feb9c0b0d40 2023-11-04T01:42:49.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba0c48640 1 -- 172.21.15.40:0/3916854928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb940a5980 con 0x7feb9c0b0d40 2023-11-04T01:42:49.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba0c48640 1 -- 172.21.15.40:0/3916854928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940a5d10 con 0x7feb9c0b0d40 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 -- 172.21.15.40:0/3916854928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0b0d40 msgr2=0x7feb9c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 --2- 172.21.15.40:0/3916854928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0b0d40 0x7feb9c15ec80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ce980 tx=0x7feb9401c960 comp rx=0 tx=0).stop 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 -- 172.21.15.40:0/3916854928 shutdown_connections 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 --2- 172.21.15.40:0/3916854928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0b0d40 0x7feb9c15ec80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 --2- 172.21.15.40:0/3916854928 >> v2:172.21.15.91:3300/0 conn(0x7feb9c15afd0 0x7feb9c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 -- 172.21.15.40:0/3916854928 >> 172.21.15.40:0/3916854928 conn(0x7feb9c0cebb0 msgr2=0x7feb9c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 -- 172.21.15.40:0/3916854928 shutdown_connections 2023-11-04T01:42:49.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 -- 172.21.15.40:0/3916854928 wait complete. 2023-11-04T01:42:49.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 Processor -- start 2023-11-04T01:42:49.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.854+0000 7feba3eae640 1 -- start start 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 0x7feb9c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb9c0b0d40 0x7feb9c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb9c15afd0 0x7feb9c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1561d0 con 0x7feb9c06f8f0 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0ac960 con 0x7feb9c15afd0 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0acc40 con 0x7feb9c0b0d40 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 0x7feb9c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 0x7feb9c155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36404/0 (socket says 172.21.15.40:36404) 2023-11-04T01:42:49.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 -- 172.21.15.40:0/1231380911 learned_addr learned my addr 172.21.15.40:0/1231380911 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1449640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb9c0b0d40 0x7feb9c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba244b640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb9c15afd0 0x7feb9c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 -- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb9c0b0d40 msgr2=0x7feb9c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb9c0b0d40 0x7feb9c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 -- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb9c15afd0 msgr2=0x7feb9c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb9c15afd0 0x7feb9c153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 -- 172.21.15.40:0/1231380911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94009b30 con 0x7feb9c06f8f0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1449640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb9c0b0d40 0x7feb9c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1c4a640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 0x7feb9c155bf0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7feb9800d5f0 tx=0x7feb9800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980125f0 con 0x7feb9c06f8f0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98012750 con 0x7feb9c06f8f0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0acf20 con 0x7feb9c06f8f0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98012ae0 con 0x7feb9c06f8f0 2023-11-04T01:42:49.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0c42f0 con 0x7feb9c06f8f0 2023-11-04T01:42:49.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c06c4b0 con 0x7feb9c06f8f0 2023-11-04T01:42:49.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb98012c40 con 0x7feb9c06f8f0 2023-11-04T01:42:49.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feb927fc640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb800664d0 0x7feb80068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7feb98084760 con 0x7feb9c06f8f0 2023-11-04T01:42:49.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.858+0000 7feba1449640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb800664d0 0x7feb80068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.862+0000 7feba1449640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb800664d0 0x7feb80068990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0cd9b0 tx=0x7feb8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:49.862+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb9c06c4b0 con 0x7feb9c06f8f0 2023-11-04T01:42:50.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.114+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb9c06c4b0 con 0x7feb9c06f8f0 2023-11-04T01:42:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.114+0000 7feb927fc640 1 -- 172.21.15.40:0/1231380911 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7feb9c06c4b0 con 0x7feb9c06f8f0 2023-11-04T01:42:50.121 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb800664d0 msgr2=0x7feb80068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb800664d0 0x7feb80068990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0cd9b0 tx=0x7feb8c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 msgr2=0x7feb9c155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 0x7feb9c155bf0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7feb9800d5f0 tx=0x7feb9800dab0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 shutdown_connections 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb800664d0 0x7feb80068990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb9c15afd0 0x7feb9c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb9c0b0d40 0x7feb9c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 --2- 172.21.15.40:0/1231380911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c06f8f0 0x7feb9c155bf0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 >> 172.21.15.40:0/1231380911 conn(0x7feb9c0cebb0 msgr2=0x7feb9c0cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 shutdown_connections 2023-11-04T01:42:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:50.118+0000 7feba3eae640 1 -- 172.21.15.40:0/1231380911 wait complete. 2023-11-04T01:42:50.140 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:50.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:50.141 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:50.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.141 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:42:50.147 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:50.147 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:50.147 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:50.147 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.147 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:50.147 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42104sec preferred_lft 42104sec 2023-11-04T01:42:50.148 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:50.149 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:42:50.150 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.151 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:42:50.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.202 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:42:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:42:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:42:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:42:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:42:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:50.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.252 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:42:50.252 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:42:50.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:42:50.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:42:50.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:42:50.252 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.322 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:42:50.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:50.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:50.370 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:50.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:42:50.424 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:50.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:50.424 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:50.470 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:50.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:50.470 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:50.517 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:42:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:42:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:50.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.570 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:42:50.614 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:50.614 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:50.659 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:50.665 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:42:50.665 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:50.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.669 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:42:50.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:42:50.734+0000 7fdba09c7580 -1 init, newargv = 0x55ee7b3969c0 newargc=15 2023-11-04T01:42:50.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[53983]: starting ceph client 2023-11-04T01:42:50.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[53983]: starting fuse 2023-11-04T01:42:51.816 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:51.824 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:42:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:42:51.826 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:51.827 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:51.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:51.828 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:42:51.874 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:42:51.874 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:42:51.875 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:51.876 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:42:52.002 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.53983.asok 2023-11-04T01:42:52.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:52.015 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53983.asok 2023-11-04T01:42:52.015 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:52.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.53983.asok status 2023-11-04T01:42:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:52.220 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:42:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:42:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:42:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "53983", 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 6819, 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 6819 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2504024324 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2504024324 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.6819 192.168.0.1:0/2504024324", 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2504024324", 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:42:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 37, 2023-11-04T01:42:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 79, 2023-11-04T01:42:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:42:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:42:52.223 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:42:52.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:52.243 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:52.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:52.243 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:52.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:52.295 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:42:52.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:52.302 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:52.302 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:52.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:52.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:52.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:52.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:42:52.534 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:42:52.534 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:42:52.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:52.534 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-04T01:42:52.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-04T01:42:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea74018640 1 Processor -- start 2023-11-04T01:42:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea74018640 1 -- start start 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea74018640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea6c0cf860 0x7fea6c0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea74018640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0d0ed0 con 0x7fea6c15cfc0 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea74018640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0d01a0 con 0x7fea6c0cdf00 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea74018640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c0d1da0 con 0x7fea6c0cf860 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea71db4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fea6c15cfc0 0x7fea6c15deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45110/0 (socket says 172.21.15.40:45110) 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea71db4640 1 -- 172.21.15.40:0/1140515850 learned_addr learned my addr 172.21.15.40:0/1140515850 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.722+0000 7fea725b5640 1 --2- 172.21.15.40:0/1140515850 >> v2:172.21.15.40:3300/0 conn(0x7fea6c0cf860 0x7fea6c0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea70db2640 1 -- 172.21.15.40:0/1140515850 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143846617 0 0) 0x7fea6c0d0ed0 con 0x7fea6c15cfc0 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea70db2640 1 -- 172.21.15.40:0/1140515850 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea58003530 con 0x7fea6c15cfc0 2023-11-04T01:42:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea725b5640 1 -- 172.21.15.40:0/1140515850 >> v1:172.21.15.91:6789/0 conn(0x7fea6c0cdf00 legacy=0x7fea6c15e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea725b5640 1 -- 172.21.15.40:0/1140515850 >> v1:172.21.15.40:6789/0 conn(0x7fea6c15cfc0 legacy=0x7fea6c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea725b5640 1 -- 172.21.15.40:0/1140515850 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c15ed30 con 0x7fea6c0cf860 2023-11-04T01:42:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea725b5640 1 --2- 172.21.15.40:0/1140515850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c0cfc60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fea64009d90 tx=0x7fea6401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ea9324131cadd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea70db2640 1 -- 172.21.15.40:0/1140515850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640a5900 con 0x7fea6c0cf860 2023-11-04T01:42:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea70db2640 1 -- 172.21.15.40:0/1140515850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea640a5a60 con 0x7fea6c0cf860 2023-11-04T01:42:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea70db2640 1 -- 172.21.15.40:0/1140515850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640a5df0 con 0x7fea6c0cf860 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 -- 172.21.15.40:0/1140515850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 msgr2=0x7fea6c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 --2- 172.21.15.40:0/1140515850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c0cfc60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fea64009d90 tx=0x7fea6401c950 comp rx=0 tx=0).stop 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 -- 172.21.15.40:0/1140515850 shutdown_connections 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 --2- 172.21.15.40:0/1140515850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c0cfc60 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 -- 172.21.15.40:0/1140515850 >> 172.21.15.40:0/1140515850 conn(0x7fea6c06a8b0 msgr2=0x7fea6c06acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 -- 172.21.15.40:0/1140515850 shutdown_connections 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.726+0000 7fea74018640 1 -- 172.21.15.40:0/1140515850 wait complete. 2023-11-04T01:42:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 Processor -- start 2023-11-04T01:42:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- start start 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea6c0cdf00 0x7fea6c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c15cfc0 0x7fea6c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1568e0 con 0x7fea6c0cf860 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c14eda0 con 0x7fea6c15cfc0 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c14b090 con 0x7fea6c0cdf00 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c1563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36422/0 (socket says 172.21.15.40:36422) 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 -- 172.21.15.40:0/2139180710 learned_addr learned my addr 172.21.15.40:0/2139180710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea71db4640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea6c0cdf00 0x7fea6c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea725b5640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c15cfc0 0x7fea6c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 -- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea6c0cdf00 msgr2=0x7fea6c14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea6c0cdf00 0x7fea6c14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 -- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c15cfc0 msgr2=0x7fea6c14a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c15cfc0 0x7fea6c14a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 -- 172.21.15.40:0/2139180710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009a70 con 0x7fea6c0cf860 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea725b5640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c15cfc0 0x7fea6c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea715b3640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c1563a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c500 tx=0x7fea5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c005220 con 0x7fea6c0cf860 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c005380 con 0x7fea6c0cf860 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c14e190 con 0x7fea6c0cf860 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c007270 con 0x7fea6c0cf860 2023-11-04T01:42:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c14e750 con 0x7fea6c0cf860 2023-11-04T01:42:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.730+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c0744a0 con 0x7fea6c0cf860 2023-11-04T01:42:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.734+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea5c0073d0 con 0x7fea6c0cf860 2023-11-04T01:42:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.734+0000 7fea627fc640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fea500664d0 0x7fea50068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.734+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fea5c083b90 con 0x7fea6c0cf860 2023-11-04T01:42:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.734+0000 7fea71db4640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fea500664d0 0x7fea50068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.734+0000 7fea71db4640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fea500664d0 0x7fea50068990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fea680011f0 tx=0x7fea68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.738+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea5c050bf0 con 0x7fea6c0cf860 2023-11-04T01:42:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:52.930+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea6c15e6a0 con 0x7fea6c0cf860 2023-11-04T01:42:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.922+0000 7fea627fc640 1 -- 172.21.15.40:0/2139180710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fea5c054210 con 0x7fea6c0cf860 2023-11-04T01:42:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:disabled new snapshots 2023-11-04T01:42:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fea500664d0 msgr2=0x7fea50068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fea500664d0 0x7fea50068990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fea680011f0 tx=0x7fea68009040 comp rx=0 tx=0).stop 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 msgr2=0x7fea6c1563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c1563a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c500 tx=0x7fea5c00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 shutdown_connections 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fea500664d0 0x7fea50068990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fea6c15cfc0 0x7fea6c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0cf860 0x7fea6c1563a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 --2- 172.21.15.40:0/2139180710 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fea6c0cdf00 0x7fea6c14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 >> 172.21.15.40:0/2139180710 conn(0x7fea6c06a8b0 msgr2=0x7fea6c153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 shutdown_connections 2023-11-04T01:42:53.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:53.926+0000 7fea74018640 1 -- 172.21.15.40:0/2139180710 wait complete. 2023-11-04T01:42:53.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:53.956 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:42:53.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:53.970 INFO:teuthology.orchestra.run.smithi040.stderr:mkdir: cannot create directory 'test-allow-snaps/.snap/snap00': Operation not permitted 2023-11-04T01:42:53.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:42:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 Processor -- start 2023-11-04T01:42:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 -- start start 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f11940b2730 0x7f11940ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 0x7f11940b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940b0580 con 0x7f11940cedc0 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940b0050 con 0x7f11940b2730 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.146+0000 7f1199c86640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119415e650 con 0x7f119406b980 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f11940cedc0 0x7f119406b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45122/0 (socket says 172.21.15.40:45122) 2023-11-04T01:42:54.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 -- 172.21.15.40:0/1234528960 learned_addr learned my addr 172.21.15.40:0/1234528960 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11937fe640 1 --2- 172.21.15.40:0/1234528960 >> v2:172.21.15.91:3300/0 conn(0x7f11940b2730 0x7f11940ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1193fff640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 0x7f11940b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167578494 0 0) 0x7f11940b0580 con 0x7f11940cedc0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c003530 con 0x7f11940cedc0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 400188047 0 0) 0x7f117c003530 con 0x7f11940cedc0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 msgr2=0x7f11940b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 0x7f11940b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 >> v2:172.21.15.91:3300/0 conn(0x7f11940b2730 msgr2=0x7f11940ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 --2- 172.21.15.40:0/1234528960 >> v2:172.21.15.91:3300/0 conn(0x7f11940b2730 0x7f11940ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940d08b0 con 0x7f11940cedc0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1188001680 con 0x7f11940cedc0 2023-11-04T01:42:54.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 >> v1:172.21.15.40:6789/0 conn(0x7f11940cedc0 legacy=0x7f119406b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f117c003980 0x7f117c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f117c0047d0 0x7f117c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 0x7f117c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940b0050 con 0x7f117c0047d0 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119415e650 con 0x7f117c003980 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c00b990 con 0x7f119406b980 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f117c0047d0 0x7f117c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11937fe640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f117c003980 0x7f117c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1193fff640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 0x7f117c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 -- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 msgr2=0x7f117c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f119406b980 0x7f117c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 -- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f117c003980 msgr2=0x7f117c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f117c003980 0x7f117c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 -- 172.21.15.40:0/1234528960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c003530 con 0x7f117c0047d0 2023-11-04T01:42:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f1192ffd640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f117c0047d0 0x7f117c004c50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f118800c240 tx=0x7f118801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8430203dd66b1d69 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880058e0 con 0x7f117c0047d0 2023-11-04T01:42:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188005a40 con 0x7f117c0047d0 2023-11-04T01:42:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.150+0000 7f11927fc640 1 -- 172.21.15.40:0/1234528960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188005e30 con 0x7f117c0047d0 2023-11-04T01:42:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/1234528960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f117c0047d0 msgr2=0x7f117c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 --2- 172.21.15.40:0/1234528960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f117c0047d0 0x7f117c004c50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f118800c240 tx=0x7f118801f3b0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1193fff640 1 -- 172.21.15.40:0/1234528960 reap_dead start 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/1234528960 shutdown_connections 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/1234528960 >> 172.21.15.40:0/1234528960 conn(0x7f119406dcf0 msgr2=0x7f119406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/1234528960 shutdown_connections 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/1234528960 wait complete. 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 Processor -- start 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- start start 2023-11-04T01:42:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f117c0047d0 0x7f1194152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 0x7f11940b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11940b55f0 0x7f11940c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940b5b00 con 0x7f11940c48c0 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940b5de0 con 0x7f11940b55f0 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11940b60c0 con 0x7f117c0047d0 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 0x7f11940b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 0x7f11940b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36446/0 (socket says 172.21.15.40:36446) 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 -- 172.21.15.40:0/2723526267 learned_addr learned my addr 172.21.15.40:0/2723526267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f11937fe640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f117c0047d0 0x7f1194152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1193fff640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11940b55f0 0x7f11940c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 -- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f117c0047d0 msgr2=0x7f1194152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f117c0047d0 0x7f1194152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 -- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11940b55f0 msgr2=0x7f11940c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11940b55f0 0x7f11940c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 -- 172.21.15.40:0/2723526267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940b63a0 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1193fff640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11940b55f0 0x7f11940c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f11937fe640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f117c0047d0 0x7f1194152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1192ffd640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 0x7f11940b50b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f118800c240 tx=0x7f117c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880b7070 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188001440 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11940b6680 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188007090 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.154+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11940c6ac0 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.158+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11940b6840 con 0x7f11940c48c0 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.158+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1188007210 con 0x7f11940c48c0 2023-11-04T01:42:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.158+0000 7f117bfff640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11800664a0 0x7f1180068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.158+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f1188120fc0 con 0x7f11940c48c0 2023-11-04T01:42:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.158+0000 7f11937fe640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11800664a0 0x7f1180068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.158+0000 7f11937fe640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11800664a0 0x7f1180068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1184009a20 tx=0x7f1184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.162+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11880ee000 con 0x7f11940c48c0 2023-11-04T01:42:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.354+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f119406b060 con 0x7f11940c48c0 2023-11-04T01:42:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.978+0000 7f117bfff640 1 -- 172.21.15.40:0/2723526267 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v39) v1 ==== 167+0+0 (secure 0 0 0) 0x7f11880f1620 con 0x7f11940c48c0 2023-11-04T01:42:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:enabled new snapshots 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11800664a0 msgr2=0x7f1180068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11800664a0 0x7f1180068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1184009a20 tx=0x7f1184008040 comp rx=0 tx=0).stop 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 msgr2=0x7f11940b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 0x7f11940b50b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f118800c240 tx=0x7f117c005800 comp rx=0 tx=0).stop 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 shutdown_connections 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11800664a0 0x7f1180068960 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11940b55f0 0x7f11940c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11940c48c0 0x7f11940b50b0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 --2- 172.21.15.40:0/2723526267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f117c0047d0 0x7f1194152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 >> 172.21.15.40:0/2723526267 conn(0x7f119406dcf0 msgr2=0x7f119415c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 shutdown_connections 2023-11-04T01:42:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:54.982+0000 7f1199c86640 1 -- 172.21.15.40:0/2723526267 wait complete. 2023-11-04T01:42:55.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:55.013 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:42:55.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:55.034 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-04T01:42:55.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:55.100 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-04T01:42:55.153 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:55.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:55.244 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:55.287 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:55.288 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:42:55.288 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:55.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:55.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 Processor -- start 2023-11-04T01:42:55.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 -- start start 2023-11-04T01:42:55.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f162c0cdea0 0x7f162c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0ccee0 con 0x7f162c0ca400 2023-11-04T01:42:55.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c15a5d0 con 0x7f162c0cdea0 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f1631c18640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c0ca900 con 0x7f162c15a1f0 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f162c0cdea0 0x7f162c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f162c0cdea0 0x7f162c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36456/0 (socket says 172.21.15.40:36456) 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 -- 172.21.15.40:0/528293050 learned_addr learned my addr 172.21.15.40:0/528293050 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162b7fe640 1 --2- 172.21.15.40:0/528293050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 -- 172.21.15.40:0/528293050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 msgr2=0x7f162c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 --2- 172.21.15.40:0/528293050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 -- 172.21.15.40:0/528293050 >> v1:172.21.15.91:6789/0 conn(0x7f162c0ca400 legacy=0x7f162c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.466+0000 7f162affd640 1 -- 172.21.15.40:0/528293050 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0cabe0 con 0x7f162c0cdea0 2023-11-04T01:42:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f162affd640 1 --2- 172.21.15.40:0/528293050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c0cdea0 0x7f162c0b0630 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1620009870 tx=0x7f162001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38091110d6856d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f162a7fc640 1 -- 172.21.15.40:0/528293050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200aa670 con 0x7f162c0cdea0 2023-11-04T01:42:55.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f162a7fc640 1 -- 172.21.15.40:0/528293050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16200aa7d0 con 0x7f162c0cdea0 2023-11-04T01:42:55.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f162a7fc640 1 -- 172.21.15.40:0/528293050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200aab60 con 0x7f162c0cdea0 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- 172.21.15.40:0/528293050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c0cdea0 msgr2=0x7f162c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 --2- 172.21.15.40:0/528293050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c0cdea0 0x7f162c0b0630 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1620009870 tx=0x7f162001c510 comp rx=0 tx=0).stop 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- 172.21.15.40:0/528293050 shutdown_connections 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 --2- 172.21.15.40:0/528293050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c0cdea0 0x7f162c0b0630 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 --2- 172.21.15.40:0/528293050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- 172.21.15.40:0/528293050 >> 172.21.15.40:0/528293050 conn(0x7f162c0cebb0 msgr2=0x7f162c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- 172.21.15.40:0/528293050 shutdown_connections 2023-11-04T01:42:55.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- 172.21.15.40:0/528293050 wait complete. 2023-11-04T01:42:55.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 Processor -- start 2023-11-04T01:42:55.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- start start 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f162c0ca400 0x7f162c148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 0x7f162c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c14f720 con 0x7f162c148900 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1500f0 con 0x7f162c0ca400 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f1631c18640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1575a0 con 0x7f162c15a1f0 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f162bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 0x7f162c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.470+0000 7f162bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 0x7f162c06ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36460/0 (socket says 172.21.15.40:36460) 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 -- 172.21.15.40:0/3704441218 learned_addr learned my addr 172.21.15.40:0/3704441218 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:55.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162affd640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162b7fe640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f162c0ca400 0x7f162c148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 -- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 msgr2=0x7f162c14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 -- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f162c0ca400 msgr2=0x7f162c148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f162c0ca400 0x7f162c148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 -- 172.21.15.40:0/3704441218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200094d0 con 0x7f162c148900 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162affd640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162bfff640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 0x7f162c06ba90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f162400c430 tx=0x7f162400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624005220 con 0x7f162c148900 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624005380 con 0x7f162c148900 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c157840 con 0x7f162c148900 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624007270 con 0x7f162c148900 2023-11-04T01:42:55.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c1599e0 con 0x7f162c148900 2023-11-04T01:42:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c153500 con 0x7f162c148900 2023-11-04T01:42:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16240073d0 con 0x7f162c148900 2023-11-04T01:42:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1613fff640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16180664a0 0x7f1618068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f1624083780 con 0x7f162c148900 2023-11-04T01:42:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162b7fe640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16180664a0 0x7f1618068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.474+0000 7f162b7fe640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16180664a0 0x7f1618068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f161c003ab0 tx=0x7f161c009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.478+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f16240507d0 con 0x7f162c148900 2023-11-04T01:42:55.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.634+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f162c0744a0 con 0x7f162c148900 2023-11-04T01:42:55.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.638+0000 7f1613fff640 1 -- 172.21.15.40:0/3704441218 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21696 (secure 0 0 0) 0x7f1624053df0 con 0x7f162c148900 2023-11-04T01:42:55.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:55.645 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":79,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:44.675142+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:55.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16180664a0 msgr2=0x7f1618068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16180664a0 0x7f1618068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f161c003ab0 tx=0x7f161c009830 comp rx=0 tx=0).stop 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 msgr2=0x7f162c06ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 0x7f162c06ba90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f162400c430 tx=0x7f162400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 shutdown_connections 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16180664a0 0x7f1618068960 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162c148900 0x7f162c06ba90 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f162c15a1f0 0x7f162c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 --2- 172.21.15.40:0/3704441218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f162c0ca400 0x7f162c148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 >> 172.21.15.40:0/3704441218 conn(0x7f162c0cebb0 msgr2=0x7f162c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 shutdown_connections 2023-11-04T01:42:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.642+0000 7f1631c18640 1 -- 172.21.15.40:0/3704441218 wait complete. 2023-11-04T01:42:55.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:41.165148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:42.005968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:55.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 Processor -- start 2023-11-04T01:42:55.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 -- start start 2023-11-04T01:42:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f047015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f047015c160 0x7f04700b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f04700b0a50 0x7f04700ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047015bd40 con 0x7f047015c160 2023-11-04T01:42:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047006fd80 con 0x7f04700b0a50 2023-11-04T01:42:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f04748c0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700b0ee0 con 0x7f047015acb0 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f047015c160 0x7f04700b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f047015c160 0x7f04700b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36464/0 (socket says 172.21.15.40:36464) 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 -- 172.21.15.40:0/1216116067 learned_addr learned my addr 172.21.15.40:0/1216116067 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046ed9d640 1 --2- 172.21.15.40:0/1216116067 >> v2:172.21.15.91:3300/0 conn(0x7f04700b0a50 0x7f04700ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 -- 172.21.15.40:0/1216116067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 msgr2=0x7f047015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046e59c640 1 --2- 172.21.15.40:0/1216116067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f047015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 --2- 172.21.15.40:0/1216116067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f047015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 -- 172.21.15.40:0/1216116067 >> v2:172.21.15.91:3300/0 conn(0x7f04700b0a50 msgr2=0x7f04700ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 --2- 172.21.15.40:0/1216116067 >> v2:172.21.15.91:3300/0 conn(0x7f04700b0a50 0x7f04700ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046dd9b640 1 -- 172.21.15.40:0/1216116067 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04700cb130 con 0x7f047015c160 2023-11-04T01:42:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.790+0000 7f046ed9d640 1 --2- 172.21.15.40:0/1216116067 >> v2:172.21.15.91:3300/0 conn(0x7f04700b0a50 0x7f04700ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f046dd9b640 1 --2- 172.21.15.40:0/1216116067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047015c160 0x7f04700b0510 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f047006d5c0 tx=0x7f045801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a88ee18bd6fd3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f046d59a640 1 -- 172.21.15.40:0/1216116067 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580aa5f0 con 0x7f047015c160 2023-11-04T01:42:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f046d59a640 1 -- 172.21.15.40:0/1216116067 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04580aa750 con 0x7f047015c160 2023-11-04T01:42:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f046d59a640 1 -- 172.21.15.40:0/1216116067 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580aaae0 con 0x7f047015c160 2023-11-04T01:42:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 -- 172.21.15.40:0/1216116067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047015c160 msgr2=0x7f04700b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 --2- 172.21.15.40:0/1216116067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047015c160 0x7f04700b0510 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f047006d5c0 tx=0x7f045801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 -- 172.21.15.40:0/1216116067 shutdown_connections 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 --2- 172.21.15.40:0/1216116067 >> v2:172.21.15.91:3300/0 conn(0x7f04700b0a50 0x7f04700ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 --2- 172.21.15.40:0/1216116067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047015c160 0x7f04700b0510 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 --2- 172.21.15.40:0/1216116067 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f047015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 -- 172.21.15.40:0/1216116067 >> 172.21.15.40:0/1216116067 conn(0x7f04700cb510 msgr2=0x7f04700cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 -- 172.21.15.40:0/1216116067 shutdown_connections 2023-11-04T01:42:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 -- 172.21.15.40:0/1216116067 wait complete. 2023-11-04T01:42:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 Processor -- start 2023-11-04T01:42:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.794+0000 7f04748c0640 1 -- start start 2023-11-04T01:42:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 0x7f04700ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f04701524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f047015c160 0x7f04700c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700c6f30 con 0x7f04700b0a50 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04701540e0 con 0x7f047015c160 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0470154c00 con 0x7f047015acb0 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 0x7f04700ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 0x7f04700ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36476/0 (socket says 172.21.15.40:36476) 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 -- 172.21.15.40:0/2310774860 learned_addr learned my addr 172.21.15.40:0/2310774860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046ed9d640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f047015c160 0x7f04700c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046dd9b640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f04701524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 -- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 msgr2=0x7f04701524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f04701524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 -- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f047015c160 msgr2=0x7f04700c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f047015c160 0x7f04700c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 -- 172.21.15.40:0/2310774860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580094d0 con 0x7f04700b0a50 2023-11-04T01:42:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f046e59c640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 0x7f04700ca370 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f046800ce10 tx=0x7f046800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468003ba0 con 0x7f04700b0a50 2023-11-04T01:42:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0468003d00 con 0x7f04700b0a50 2023-11-04T01:42:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04700c8a80 con 0x7f04700b0a50 2023-11-04T01:42:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468004240 con 0x7f04700b0a50 2023-11-04T01:42:55.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04701545b0 con 0x7f04700b0a50 2023-11-04T01:42:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04700744a0 con 0x7f04700b0a50 2023-11-04T01:42:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04680043a0 con 0x7f04700b0a50 2023-11-04T01:42:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f0466ffd640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f04500664a0 0x7f0450068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.798+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f0468012070 con 0x7f04700b0a50 2023-11-04T01:42:55.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.802+0000 7f046dd9b640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f04500664a0 0x7f0450068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.802+0000 7f046dd9b640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f04500664a0 0x7f0450068960 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f04580ae000 tx=0x7f04580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.806+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0468051c70 con 0x7f04700b0a50 2023-11-04T01:42:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.958+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04700cde30 con 0x7f04700b0a50 2023-11-04T01:42:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f0466ffd640 1 -- 172.21.15.40:0/2310774860 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0468055290 con 0x7f04700b0a50 2023-11-04T01:42:55.966 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f04500664a0 msgr2=0x7f0450068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f04500664a0 0x7f0450068960 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f04580ae000 tx=0x7f04580a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 msgr2=0x7f04700ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 0x7f04700ca370 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f046800ce10 tx=0x7f046800a660 comp rx=0 tx=0).stop 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 shutdown_connections 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f04500664a0 0x7f0450068960 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f047015c160 0x7f04700c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f047015acb0 0x7f04701524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 --2- 172.21.15.40:0/2310774860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04700b0a50 0x7f04700ca370 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 >> 172.21.15.40:0/2310774860 conn(0x7f04700cb510 msgr2=0x7f047015c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 shutdown_connections 2023-11-04T01:42:55.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:55.962+0000 7f04748c0640 1 -- 172.21.15.40:0/2310774860 wait complete. 2023-11-04T01:42:55.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:56.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.094+0000 7f00ed841640 1 Processor -- start 2023-11-04T01:42:56.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.094+0000 7f00ed841640 1 -- start start 2023-11-04T01:42:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00ed841640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f00e8159f00 0x7f00e80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00ed841640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 0x7f00e80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00ed841640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80b3c10 con 0x7f00e8070b40 2023-11-04T01:42:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00ed841640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e80cdb70 con 0x7f00e8159f00 2023-11-04T01:42:56.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00ed841640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80cde50 con 0x7f00e806de30 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 0x7f00e80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f00e8159f00 0x7f00e80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 0x7f00e80b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:55150/0 (socket says 172.21.15.40:55150) 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 -- 172.21.15.40:0/1213536707 learned_addr learned my addr 172.21.15.40:0/1213536707 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 -- 172.21.15.40:0/1213536707 >> v2:172.21.15.91:3300/0 conn(0x7f00e8159f00 msgr2=0x7f00e80719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 --2- 172.21.15.40:0/1213536707 >> v2:172.21.15.91:3300/0 conn(0x7f00e8159f00 0x7f00e80719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 -- 172.21.15.40:0/1213536707 >> v1:172.21.15.91:6789/0 conn(0x7f00e8070b40 legacy=0x7f00e80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 -- 172.21.15.40:0/1213536707 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e815a2e0 con 0x7f00e806de30 2023-11-04T01:42:56.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e67fc640 1 --2- 172.21.15.40:0/1213536707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 0x7f00e80b36d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00b920 tx=0x7f00dc01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bfcbaef8ab84ebe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e5ffb640 1 -- 172.21.15.40:0/1213536707 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0a5960 con 0x7f00e806de30 2023-11-04T01:42:56.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e5ffb640 1 -- 172.21.15.40:0/1213536707 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0a5ac0 con 0x7f00e806de30 2023-11-04T01:42:56.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.098+0000 7f00e5ffb640 1 -- 172.21.15.40:0/1213536707 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0a5e50 con 0x7f00e806de30 2023-11-04T01:42:56.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/1213536707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 msgr2=0x7f00e80b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 --2- 172.21.15.40:0/1213536707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 0x7f00e80b36d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00b920 tx=0x7f00dc01c920 comp rx=0 tx=0).stop 2023-11-04T01:42:56.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/1213536707 shutdown_connections 2023-11-04T01:42:56.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 --2- 172.21.15.40:0/1213536707 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e806de30 0x7f00e80b36d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 --2- 172.21.15.40:0/1213536707 >> v2:172.21.15.91:3300/0 conn(0x7f00e8159f00 0x7f00e80719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/1213536707 >> 172.21.15.40:0/1213536707 conn(0x7f00e80cfc70 msgr2=0x7f00e80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/1213536707 shutdown_connections 2023-11-04T01:42:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/1213536707 wait complete. 2023-11-04T01:42:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 Processor -- start 2023-11-04T01:42:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- start start 2023-11-04T01:42:56.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e8070b40 0x7f00e815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 0x7f00e815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e815a500 0x7f00e814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e815aa70 con 0x7f00e8159f00 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e815d4f0 con 0x7f00e8070b40 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e815af20 con 0x7f00e815a500 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 0x7f00e815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 0x7f00e815cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36490/0 (socket says 172.21.15.40:36490) 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 -- 172.21.15.40:0/2049993705 learned_addr learned my addr 172.21.15.40:0/2049993705 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e6ffd640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e8070b40 0x7f00e815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e77fe640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e815a500 0x7f00e814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 -- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e815a500 msgr2=0x7f00e814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e815a500 0x7f00e814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 -- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e8070b40 msgr2=0x7f00e815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e8070b40 0x7f00e815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 -- 172.21.15.40:0/2049993705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc00b580 con 0x7f00e8159f00 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00e67fc640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 0x7f00e815cfb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f00dc01a550 tx=0x7f00dc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0aee20 con 0x7f00e8159f00 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0b8420 con 0x7f00e8159f00 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b87d0 con 0x7f00e8159f00 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e815b200 con 0x7f00e8159f00 2023-11-04T01:42:56.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.102+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e814bfa0 con 0x7f00e8159f00 2023-11-04T01:42:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.106+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e814c190 con 0x7f00e8159f00 2023-11-04T01:42:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.106+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00dc0b4040 con 0x7f00e8159f00 2023-11-04T01:42:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.106+0000 7f00cffff640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00d40664d0 0x7f00d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.106+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f00dc11f940 con 0x7f00e8159f00 2023-11-04T01:42:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.106+0000 7f00e6ffd640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00d40664d0 0x7f00d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.106+0000 7f00e6ffd640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00d40664d0 0x7f00d4068990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f00e8155ff0 tx=0x7f00d800f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.110+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00dc0ec980 con 0x7f00e8159f00 2023-11-04T01:42:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.262+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f00e80675f0 con 0x7f00e8159f00 2023-11-04T01:42:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00cffff640 1 -- 172.21.15.40:0/2049993705 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f00dc0effa0 con 0x7f00e8159f00 2023-11-04T01:42:56.270 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:56.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00d40664d0 msgr2=0x7f00d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00d40664d0 0x7f00d4068990 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f00e8155ff0 tx=0x7f00d800f040 comp rx=0 tx=0).stop 2023-11-04T01:42:56.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 msgr2=0x7f00e815cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 0x7f00e815cfb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f00dc01a550 tx=0x7f00dc0196c0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 shutdown_connections 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00d40664d0 0x7f00d4068990 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00e815a500 0x7f00e814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e8159f00 0x7f00e815cfb0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 --2- 172.21.15.40:0/2049993705 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00e8070b40 0x7f00e815ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 >> 172.21.15.40:0/2049993705 conn(0x7f00e80cfc70 msgr2=0x7f00e806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 shutdown_connections 2023-11-04T01:42:56.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.266+0000 7f00ed841640 1 -- 172.21.15.40:0/2049993705 wait complete. 2023-11-04T01:42:56.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:56.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 Processor -- start 2023-11-04T01:42:56.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 -- start start 2023-11-04T01:42:56.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbefc0cecc0 0x7fbefc06d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0cbb30 con 0x7fbefc0d18a0 2023-11-04T01:42:56.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc0cbe10 con 0x7fbefc0cecc0 2023-11-04T01:42:56.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbf00c01640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0cc0f0 con 0x7fbefc15ae20 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbefc0cecc0 0x7fbefc06d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:55170/0 (socket says 172.21.15.40:55170) 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 -- 172.21.15.40:0/1201050380 learned_addr learned my addr 172.21.15.40:0/1201050380 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 -- 172.21.15.40:0/1201050380 >> v2:172.21.15.91:3300/0 conn(0x7fbefc0cecc0 msgr2=0x7fbefc06d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 --2- 172.21.15.40:0/1201050380 >> v2:172.21.15.91:3300/0 conn(0x7fbefc0cecc0 0x7fbefc06d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 -- 172.21.15.40:0/1201050380 >> v1:172.21.15.91:6789/0 conn(0x7fbefc0d18a0 legacy=0x7fbefc0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.414+0000 7fbefa59c640 1 -- 172.21.15.40:0/1201050380 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0cc3d0 con 0x7fbefc15ae20 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbefa59c640 1 --2- 172.21.15.40:0/1201050380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0ce780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbeec006fd0 tx=0x7fbeec01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1047c921f0acdc2e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbef9d9b640 1 -- 172.21.15.40:0/1201050380 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0a8a10 con 0x7fbefc15ae20 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbef9d9b640 1 -- 172.21.15.40:0/1201050380 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec0a8b70 con 0x7fbefc15ae20 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbef9d9b640 1 -- 172.21.15.40:0/1201050380 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0b0440 con 0x7fbefc15ae20 2023-11-04T01:42:56.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 -- 172.21.15.40:0/1201050380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 msgr2=0x7fbefc0ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1201050380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0ce780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbeec006fd0 tx=0x7fbeec01ed10 comp rx=0 tx=0).stop 2023-11-04T01:42:56.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 -- 172.21.15.40:0/1201050380 shutdown_connections 2023-11-04T01:42:56.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1201050380 >> v2:172.21.15.91:3300/0 conn(0x7fbefc0cecc0 0x7fbefc06d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1201050380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0ce780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 -- 172.21.15.40:0/1201050380 >> 172.21.15.40:0/1201050380 conn(0x7fbefc09a030 msgr2=0x7fbefc0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 -- 172.21.15.40:0/1201050380 shutdown_connections 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 -- 172.21.15.40:0/1201050380 wait complete. 2023-11-04T01:42:56.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 Processor -- start 2023-11-04T01:42:56.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.418+0000 7fbf00c01640 1 -- start start 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 0x7fbefc15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbefc15e200 0x7fbefc0c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0c7330 con 0x7fbefc0cecc0 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc15bd10 con 0x7fbefc15e200 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc15b700 con 0x7fbefc15ae20 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 0x7fbefc15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 0x7fbefc15dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36498/0 (socket says 172.21.15.40:36498) 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 -- 172.21.15.40:0/1758220370 learned_addr learned my addr 172.21.15.40:0/1758220370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef1d9b640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefad9d640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbefc15e200 0x7fbefc0c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 -- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 msgr2=0x7fbefc0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 -- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbefc15e200 msgr2=0x7fbefc0c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbefc15e200 0x7fbefc0c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 -- 172.21.15.40:0/1758220370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec009480 con 0x7fbefc0cecc0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbefa59c640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 0x7fbefc15dcc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbeec01d3c0 tx=0x7fbeec01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0a8a10 con 0x7fbefc0cecc0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec003620 con 0x7fbefc0cecc0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc0c7050 con 0x7fbefc0cecc0 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0039b0 con 0x7fbefc0cecc0 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc151700 con 0x7fbefc0cecc0 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc15b560 con 0x7fbefc0cecc0 2023-11-04T01:42:56.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbeec003b10 con 0x7fbefc0cecc0 2023-11-04T01:42:56.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef37fe640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664d0 0x7fbedc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fbeec121e00 con 0x7fbefc0cecc0 2023-11-04T01:42:56.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.422+0000 7fbef1d9b640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664d0 0x7fbedc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.426+0000 7fbef1d9b640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664d0 0x7fbedc068990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0c5840 tx=0x7fbee4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.426+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbefc15b560 con 0x7fbefc0cecc0 2023-11-04T01:42:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.578+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fbefc15b560 con 0x7fbefc0cecc0 2023-11-04T01:42:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.578+0000 7fbef37fe640 1 -- 172.21.15.40:0/1758220370 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbefc15b560 con 0x7fbefc0cecc0 2023-11-04T01:42:56.584 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:56.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664d0 msgr2=0x7fbedc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664d0 0x7fbedc068990 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0c5840 tx=0x7fbee4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:56.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 msgr2=0x7fbefc15dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 0x7fbefc15dcc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbeec01d3c0 tx=0x7fbeec01bab0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 shutdown_connections 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664d0 0x7fbedc068990 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbefc15e200 0x7fbefc0c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbefc15ae20 0x7fbefc0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 --2- 172.21.15.40:0/1758220370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbefc0cecc0 0x7fbefc15dcc0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 >> 172.21.15.40:0/1758220370 conn(0x7fbefc09a030 msgr2=0x7fbefc0afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 shutdown_connections 2023-11-04T01:42:56.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.582+0000 7fbf00c01640 1 -- 172.21.15.40:0/1758220370 wait complete. 2023-11-04T01:42:56.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:56.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 Processor -- start 2023-11-04T01:42:56.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 -- start start 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 0x7f530c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f530c146510 0x7f530c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c161760 con 0x7f530c06a6a0 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c06ab30 con 0x7f530c146510 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f5311dc2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c161a40 con 0x7f530c1438e0 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f530c06a6a0 0x7f530c070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45128/0 (socket says 172.21.15.40:45128) 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 -- 172.21.15.40:0/2519470519 learned_addr learned my addr 172.21.15.40:0/2519470519 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530b7fe640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 0x7f530c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530affd640 1 --2- 172.21.15.40:0/2519470519 >> v2:172.21.15.91:3300/0 conn(0x7f530c146510 0x7f530c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699719860 0 0) 0x7f530c161760 con 0x7f530c06a6a0 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f4003530 con 0x7f530c06a6a0 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 143535909 0 0) 0x7f52f4003530 con 0x7f530c06a6a0 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 msgr2=0x7f530c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 0x7f530c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 >> v2:172.21.15.91:3300/0 conn(0x7f530c146510 msgr2=0x7f530c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 --2- 172.21.15.40:0/2519470519 >> v2:172.21.15.91:3300/0 conn(0x7f530c146510 0x7f530c06a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c0d0790 con 0x7f530c06a6a0 2023-11-04T01:42:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f5304001a00 con 0x7f530c06a6a0 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 >> v1:172.21.15.40:6789/0 conn(0x7f530c06a6a0 legacy=0x7f530c070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4003980 0x7f52f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 0x7f52f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f4004d10 0x7f52f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c06ab30 con 0x7f52f4004d10 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c161a40 con 0x7f52f4003980 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f400b9c0 con 0x7f530c1438e0 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f4004d10 0x7f52f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530b7fe640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4003980 0x7f52f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530affd640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 0x7f52f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 -- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 msgr2=0x7f52f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1438e0 0x7f52f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 -- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4003980 msgr2=0x7f52f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4003980 0x7f52f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.710+0000 7f530bfff640 1 -- 172.21.15.40:0/2519470519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4003530 con 0x7f52f4004d10 2023-11-04T01:42:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f530bfff640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f4004d10 0x7f52f4005190 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f530400a810 tx=0x7f530401fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b74e6c9a1e62d56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040aa620 con 0x7f52f4004d10 2023-11-04T01:42:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040aa7a0 con 0x7f52f4004d10 2023-11-04T01:42:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f530a7fc640 1 -- 172.21.15.40:0/2519470519 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040aab50 con 0x7f52f4004d10 2023-11-04T01:42:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 -- 172.21.15.40:0/2519470519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f4004d10 msgr2=0x7f52f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 --2- 172.21.15.40:0/2519470519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f4004d10 0x7f52f4005190 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f530400a810 tx=0x7f530401fa80 comp rx=0 tx=0).stop 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f530bfff640 1 -- 172.21.15.40:0/2519470519 reap_dead start 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 -- 172.21.15.40:0/2519470519 shutdown_connections 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 -- 172.21.15.40:0/2519470519 >> 172.21.15.40:0/2519470519 conn(0x7f530c0cfc70 msgr2=0x7f530c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 -- 172.21.15.40:0/2519470519 shutdown_connections 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 -- 172.21.15.40:0/2519470519 wait complete. 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 Processor -- start 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.714+0000 7f5311dc2640 1 -- start start 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4004d10 0x7f530c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 0x7f530c13d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1395a0 0x7f530c139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c15c5b0 con 0x7f530c13d090 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c13b740 con 0x7f52f4004d10 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1387e0 con 0x7f530c1395a0 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 0x7f530c13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 0x7f530c13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36516/0 (socket says 172.21.15.40:36516) 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 -- 172.21.15.40:0/1629235586 learned_addr learned my addr 172.21.15.40:0/1629235586 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530b7fe640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4004d10 0x7f530c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530bfff640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1395a0 0x7f530c139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 -- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1395a0 msgr2=0x7f530c139a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1395a0 0x7f530c139a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 -- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4004d10 msgr2=0x7f530c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4004d10 0x7f530c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 -- 172.21.15.40:0/1629235586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c138ac0 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530affd640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 0x7f530c13d510 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5300011660 tx=0x7f5300011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000f9c0 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000fb20 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c138da0 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000fe90 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c144020 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c0cf420 con 0x7f530c13d090 2023-11-04T01:42:56.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5300015460 con 0x7f530c13d090 2023-11-04T01:42:56.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f52f3fff640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52f80664a0 0x7f52f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f5300084b20 con 0x7f530c13d090 2023-11-04T01:42:56.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.718+0000 7f530b7fe640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52f80664a0 0x7f52f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.722+0000 7f530b7fe640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52f80664a0 0x7f52f8068960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f530c0b4c30 tx=0x7f52fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.722+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5300051cb0 con 0x7f530c13d090 2023-11-04T01:42:56.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f530c0675f0 con 0x7f530c13d090 2023-11-04T01:42:56.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f52f3fff640 1 -- 172.21.15.40:0/1629235586 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f53000552d0 con 0x7f530c13d090 2023-11-04T01:42:56.879 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52f80664a0 msgr2=0x7f52f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52f80664a0 0x7f52f8068960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f530c0b4c30 tx=0x7f52fc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 msgr2=0x7f530c13d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 0x7f530c13d510 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5300011660 tx=0x7f5300011b20 comp rx=0 tx=0).stop 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 shutdown_connections 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52f80664a0 0x7f52f8068960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f530c1395a0 0x7f530c139a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f530c13d090 0x7f530c13d510 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 --2- 172.21.15.40:0/1629235586 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52f4004d10 0x7f530c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 >> 172.21.15.40:0/1629235586 conn(0x7f530c0cfc70 msgr2=0x7f530c15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 shutdown_connections 2023-11-04T01:42:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:56.874+0000 7f5311dc2640 1 -- 172.21.15.40:0/1629235586 wait complete. 2023-11-04T01:42:56.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:57.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.018+0000 7fd7aabad640 1 Processor -- start 2023-11-04T01:42:57.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.018+0000 7fd7aabad640 1 -- start start 2023-11-04T01:42:57.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.018+0000 7fd7aabad640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7aabad640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd7a406d160 0x7fd7a40cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7aabad640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a406c0c0 con 0x7fd7a415dd80 2023-11-04T01:42:57.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7aabad640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a4071200 con 0x7fd7a406d160 2023-11-04T01:42:57.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7aabad640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a406c3a0 con 0x7fd7a415af70 2023-11-04T01:42:57.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd7a406d160 0x7fd7a40cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a914a640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd7a415dd80 0x7fd7a415e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:57068/0 (socket says 172.21.15.40:57068) 2023-11-04T01:42:57.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a914a640 1 -- 172.21.15.40:0/405385334 learned_addr learned my addr 172.21.15.40:0/405385334 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:57.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a8949640 1 --2- 172.21.15.40:0/405385334 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a8949640 1 -- 172.21.15.40:0/405385334 >> v2:172.21.15.91:3300/0 conn(0x7fd7a406d160 msgr2=0x7fd7a40cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a8949640 1 --2- 172.21.15.40:0/405385334 >> v2:172.21.15.91:3300/0 conn(0x7fd7a406d160 0x7fd7a40cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a8949640 1 -- 172.21.15.40:0/405385334 >> v1:172.21.15.91:6789/0 conn(0x7fd7a415dd80 legacy=0x7fd7a415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a8949640 1 -- 172.21.15.40:0/405385334 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a406c680 con 0x7fd7a415af70 2023-11-04T01:42:57.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a8949640 1 --2- 172.21.15.40:0/405385334 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40cdaa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7980097c0 tx=0x7fd79801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68c55199c1ccd695 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a37fe640 1 -- 172.21.15.40:0/405385334 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7980ab600 con 0x7fd7a415af70 2023-11-04T01:42:57.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a37fe640 1 -- 172.21.15.40:0/405385334 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7980a7050 con 0x7fd7a415af70 2023-11-04T01:42:57.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.022+0000 7fd7a37fe640 1 -- 172.21.15.40:0/405385334 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7980ab980 con 0x7fd7a415af70 2023-11-04T01:42:57.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- 172.21.15.40:0/405385334 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 msgr2=0x7fd7a40cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 --2- 172.21.15.40:0/405385334 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40cdaa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7980097c0 tx=0x7fd79801c480 comp rx=0 tx=0).stop 2023-11-04T01:42:57.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- 172.21.15.40:0/405385334 shutdown_connections 2023-11-04T01:42:57.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 --2- 172.21.15.40:0/405385334 >> v2:172.21.15.91:3300/0 conn(0x7fd7a406d160 0x7fd7a40cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 --2- 172.21.15.40:0/405385334 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40cdaa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- 172.21.15.40:0/405385334 >> 172.21.15.40:0/405385334 conn(0x7fd7a40cb510 msgr2=0x7fd7a40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- 172.21.15.40:0/405385334 shutdown_connections 2023-11-04T01:42:57.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- 172.21.15.40:0/405385334 wait complete. 2023-11-04T01:42:57.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 Processor -- start 2023-11-04T01:42:57.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- start start 2023-11-04T01:42:57.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7a406d160 0x7fd7a41f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 0x7fd7a40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40c2fb0 con 0x7fd7a415dd80 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40c3290 con 0x7fd7a406d160 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7aabad640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a40c3570 con 0x7fd7a415af70 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7a914a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 0x7fd7a40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7a914a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 0x7fd7a40b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36520/0 (socket says 172.21.15.40:36520) 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7a8949640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7a406d160 0x7fd7a41f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7a914a640 1 -- 172.21.15.40:0/808697741 learned_addr learned my addr 172.21.15.40:0/808697741 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.026+0000 7fd7a3fff640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a914a640 1 -- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 msgr2=0x7fd7a40b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a914a640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a914a640 1 -- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7a406d160 msgr2=0x7fd7a41f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a914a640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7a406d160 0x7fd7a41f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a914a640 1 -- 172.21.15.40:0/808697741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798009420 con 0x7fd7a415dd80 2023-11-04T01:42:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a914a640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 0x7fd7a40b3600 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00ca80 tx=0x7fd79c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c00ac30 con 0x7fd7a415dd80 2023-11-04T01:42:57.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c00ad90 con 0x7fd7a415dd80 2023-11-04T01:42:57.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a40c3850 con 0x7fd7a415dd80 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c012600 con 0x7fd7a415dd80 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a41f5740 con 0x7fd7a415dd80 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a40c3d70 con 0x7fd7a415dd80 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd79c007070 con 0x7fd7a415dd80 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a17fa640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd7880664a0 0x7fd788068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fd79c083fd0 con 0x7fd7a415dd80 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a8949640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd7880664a0 0x7fd788068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.030+0000 7fd7a8949640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd7880664a0 0x7fd788068960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd7980ad000 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.034+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7a40c3d70 con 0x7fd7a415dd80 2023-11-04T01:42:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7a40c3d70 con 0x7fd7a415dd80 2023-11-04T01:42:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7a17fa640 1 -- 172.21.15.40:0/808697741 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7a40c3d70 con 0x7fd7a415dd80 2023-11-04T01:42:57.191 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:57.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd7880664a0 msgr2=0x7fd788068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd7880664a0 0x7fd788068960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd7980ad000 tx=0x7fd798008040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 msgr2=0x7fd7a40b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 0x7fd7a40b3600 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00ca80 tx=0x7fd79c00cf40 comp rx=0 tx=0).stop 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 shutdown_connections 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd7880664a0 0x7fd788068960 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a415dd80 0x7fd7a40b3600 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd7a415af70 0x7fd7a40b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 --2- 172.21.15.40:0/808697741 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd7a406d160 0x7fd7a41f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 >> 172.21.15.40:0/808697741 conn(0x7fd7a40cb510 msgr2=0x7fd7a40ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 shutdown_connections 2023-11-04T01:42:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.186+0000 7fd7aabad640 1 -- 172.21.15.40:0/808697741 wait complete. 2023-11-04T01:42:57.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:57.204 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:57.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:57.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbfddb6640 1 Processor -- start 2023-11-04T01:42:57.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbfddb6640 1 -- start start 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbfddb6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 0x7fdbf8165a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbfddb6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf806d280 con 0x7fdbf80c4130 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbfddb6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf806ccc0 con 0x7fdbf80cb330 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbfddb6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80d0280 con 0x7fdbf80cdc40 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdbf80c4130 0x7fdbf80cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48026/0 (socket says 172.21.15.40:48026) 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 -- 172.21.15.40:0/4027284208 learned_addr learned my addr 172.21.15.40:0/4027284208 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf6ffd640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 0x7fdbf8165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327626795 0 0) 0x7fdbf806d280 con 0x7fdbf80c4130 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe0003530 con 0x7fdbf80c4130 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816531746 0 0) 0x7fdbe0003530 con 0x7fdbf80c4130 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 msgr2=0x7fdbf8165a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 0x7fdbf8165a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 >> v1:172.21.15.91:6789/0 conn(0x7fdbf80cb330 legacy=0x7fdbf80d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf806cfa0 con 0x7fdbf80c4130 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fdbe8001800 con 0x7fdbf80c4130 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 >> v1:172.21.15.40:6789/0 conn(0x7fdbf80c4130 legacy=0x7fdbf80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbe00039b0 0x7fdbe0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbe00047d0 0x7fdbe0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 0x7fdbe00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80d0280 con 0x7fdbe00039b0 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe000bac0 con 0x7fdbe00047d0 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe000bc80 con 0x7fdbf80cdc40 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbe00039b0 0x7fdbe0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf7fff640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 0x7fdbe00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf6ffd640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbe00047d0 0x7fdbe0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 -- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 msgr2=0x7fdbe00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf80cdc40 0x7fdbe00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 -- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbe00047d0 msgr2=0x7fdbe0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbe00047d0 0x7fdbe0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.394+0000 7fdbf77fe640 1 -- 172.21.15.40:0/4027284208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0003530 con 0x7fdbe00039b0 2023-11-04T01:42:57.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbe00039b0 0x7fdbe0003dd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800c210 tx=0x7fdbe801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60b931b6ba3568e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80070d0 con 0x7fdbe00039b0 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8007250 con 0x7fdbe00039b0 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf67fc640 1 -- 172.21.15.40:0/4027284208 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8007600 con 0x7fdbe00039b0 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- 172.21.15.40:0/4027284208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbe00039b0 msgr2=0x7fdbe0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/4027284208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbe00039b0 0x7fdbe0003dd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800c210 tx=0x7fdbe801cbd0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf7fff640 1 -- 172.21.15.40:0/4027284208 reap_dead start 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- 172.21.15.40:0/4027284208 shutdown_connections 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- 172.21.15.40:0/4027284208 >> 172.21.15.40:0/4027284208 conn(0x7fdbf8065dc0 msgr2=0x7fdbf80661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- 172.21.15.40:0/4027284208 shutdown_connections 2023-11-04T01:42:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- 172.21.15.40:0/4027284208 wait complete. 2023-11-04T01:42:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 Processor -- start 2023-11-04T01:42:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- start start 2023-11-04T01:42:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf815bcb0 0x7fdbf8166170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf81666b0 0x7fdbf8161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 0x7fdbf8162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8166b30 con 0x7fdbf8162380 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80c66a0 con 0x7fdbf815bcb0 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbfddb6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80c5600 con 0x7fdbf81666b0 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 0x7fdbf8162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 0x7fdbf8162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44474/0 (socket says 172.21.15.40:44474) 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf7fff640 1 -- 172.21.15.40:0/1051290634 learned_addr learned my addr 172.21.15.40:0/1051290634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf815bcb0 0x7fdbf8166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.398+0000 7fdbf6ffd640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf81666b0 0x7fdbf8161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf7fff640 1 -- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf81666b0 msgr2=0x7fdbf8161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf7fff640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf81666b0 0x7fdbf8161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf7fff640 1 -- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf815bcb0 msgr2=0x7fdbf8166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf7fff640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf815bcb0 0x7fdbf8166170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf7fff640 1 -- 172.21.15.40:0/1051290634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf80c58e0 con 0x7fdbf8162380 2023-11-04T01:42:57.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf7fff640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 0x7fdbf8162800 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0004750 tx=0x7fdbf000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0003980 con 0x7fdbf8162380 2023-11-04T01:42:57.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0003ae0 con 0x7fdbf8162380 2023-11-04T01:42:57.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0003e90 con 0x7fdbf8162380 2023-11-04T01:42:57.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf80c5bc0 con 0x7fdbf8162380 2023-11-04T01:42:57.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf80c6180 con 0x7fdbf8162380 2023-11-04T01:42:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf80675f0 con 0x7fdbf8162380 2023-11-04T01:42:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbf00050d0 con 0x7fdbf8162380 2023-11-04T01:42:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbdffff640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdbe40664a0 0x7fdbe4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fdbf0084000 con 0x7fdbf8162380 2023-11-04T01:42:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdbe40664a0 0x7fdbe4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.402+0000 7fdbf77fe640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdbe40664a0 0x7fdbe4068960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80aa000 tx=0x7fdbe80b0040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.406+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbf00510e0 con 0x7fdbf8162380 2023-11-04T01:42:57.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.558+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbf80b6c60 con 0x7fdbf8162380 2023-11-04T01:42:57.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbdffff640 1 -- 172.21.15.40:0/1051290634 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbf0054700 con 0x7fdbf8162380 2023-11-04T01:42:57.566 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:42:57.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdbe40664a0 msgr2=0x7fdbe4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdbe40664a0 0x7fdbe4068960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80aa000 tx=0x7fdbe80b0040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 msgr2=0x7fdbf8162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 0x7fdbf8162800 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0004750 tx=0x7fdbf000ec10 comp rx=0 tx=0).stop 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 shutdown_connections 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdbe40664a0 0x7fdbe4068960 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbf8162380 0x7fdbf8162800 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdbf81666b0 0x7fdbf8161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 --2- 172.21.15.40:0/1051290634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbf815bcb0 0x7fdbf8166170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 >> 172.21.15.40:0/1051290634 conn(0x7fdbf8065dc0 msgr2=0x7fdbf80d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 shutdown_connections 2023-11-04T01:42:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.562+0000 7fdbfddb6640 1 -- 172.21.15.40:0/1051290634 wait complete. 2023-11-04T01:42:57.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 Processor -- start 2023-11-04T01:42:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 -- start start 2023-11-04T01:42:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e700d0690 0x7f2e700b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2e700d0ae0 0x7f2e700b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e700b6070 con 0x7f2e700b4990 2023-11-04T01:42:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700b8ed0 con 0x7f2e700d0690 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e763f2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700d1ce0 con 0x7f2e700d0ae0 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e700d0690 0x7f2e700b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e700d0690 0x7f2e700b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44488/0 (socket says 172.21.15.40:44488) 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/2652594015 learned_addr learned my addr 172.21.15.40:0/2652594015 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e7498f640 1 --2- 172.21.15.40:0/2652594015 >> v2:172.21.15.91:3300/0 conn(0x7f2e700d0ae0 0x7f2e700b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/2652594015 >> v2:172.21.15.91:3300/0 conn(0x7f2e700d0ae0 msgr2=0x7f2e700b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 --2- 172.21.15.40:0/2652594015 >> v2:172.21.15.91:3300/0 conn(0x7f2e700d0ae0 0x7f2e700b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/2652594015 >> v1:172.21.15.91:6789/0 conn(0x7f2e700b4990 legacy=0x7f2e700b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.702+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/2652594015 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700d1fc0 con 0x7f2e700d0690 2023-11-04T01:42:57.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 --2- 172.21.15.40:0/2652594015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b64e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2e70067730 tx=0x7f2e5801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b4b0ce44b7e4ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6effd640 1 -- 172.21.15.40:0/2652594015 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580af400 con 0x7f2e700d0690 2023-11-04T01:42:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6effd640 1 -- 172.21.15.40:0/2652594015 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580ab050 con 0x7f2e700d0690 2023-11-04T01:42:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6effd640 1 -- 172.21.15.40:0/2652594015 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580af780 con 0x7f2e700d0690 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- 172.21.15.40:0/2652594015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 msgr2=0x7f2e700b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 --2- 172.21.15.40:0/2652594015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b64e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2e70067730 tx=0x7f2e5801f180 comp rx=0 tx=0).stop 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- 172.21.15.40:0/2652594015 shutdown_connections 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 --2- 172.21.15.40:0/2652594015 >> v2:172.21.15.91:3300/0 conn(0x7f2e700d0ae0 0x7f2e700b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 --2- 172.21.15.40:0/2652594015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b64e0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- 172.21.15.40:0/2652594015 >> 172.21.15.40:0/2652594015 conn(0x7f2e700cf990 msgr2=0x7f2e700cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- 172.21.15.40:0/2652594015 shutdown_connections 2023-11-04T01:42:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- 172.21.15.40:0/2652594015 wait complete. 2023-11-04T01:42:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 Processor -- start 2023-11-04T01:42:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- start start 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e700b4990 0x7f2e7015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e700d0ae0 0x7f2e700b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7015f660 con 0x7f2e700d0690 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7015e5c0 con 0x7f2e700d0ae0 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7015e8a0 con 0x7f2e700b4990 2023-11-04T01:42:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44494/0 (socket says 172.21.15.40:44494) 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/48558842 learned_addr learned my addr 172.21.15.40:0/48558842 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6ffff640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e700b4990 0x7f2e7015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e7498f640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e700d0ae0 0x7f2e700b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e700b4990 msgr2=0x7f2e7015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e700b4990 0x7f2e7015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e700d0ae0 msgr2=0x7f2e700b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e700d0ae0 0x7f2e700b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 -- 172.21.15.40:0/48558842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58009b30 con 0x7f2e700d0690 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6ffff640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e700b4990 0x7f2e7015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6f7fe640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b63e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2e5801cdb0 tx=0x7f2e5801bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580afe60 con 0x7f2e700d0690 2023-11-04T01:42:57.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58009510 con 0x7f2e700d0690 2023-11-04T01:42:57.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.706+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7015eb80 con 0x7f2e700d0690 2023-11-04T01:42:57.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580ba680 con 0x7f2e700d0690 2023-11-04T01:42:57.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7015f140 con 0x7f2e700d0690 2023-11-04T01:42:57.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7015f330 con 0x7f2e700d0690 2023-11-04T01:42:57.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e580b6040 con 0x7f2e700d0690 2023-11-04T01:42:57.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e6cff9640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e500664a0 0x7f2e50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f2e58122fe0 con 0x7f2e700d0690 2023-11-04T01:42:57.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.710+0000 7f2e6ffff640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e500664a0 0x7f2e50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.714+0000 7f2e6ffff640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e500664a0 0x7f2e50068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2e700b6fa0 tx=0x7f2e68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.714+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e580f00e0 con 0x7f2e700d0690 2023-11-04T01:42:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.886+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e700744a0 con 0x7f2e700d0690 2023-11-04T01:42:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.886+0000 7f2e6cff9640 1 -- 172.21.15.40:0/48558842 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e580f3700 con 0x7f2e700d0690 2023-11-04T01:42:57.891 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-11-04T01:42:57.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e500664a0 msgr2=0x7f2e50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e500664a0 0x7f2e50068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2e700b6fa0 tx=0x7f2e68008040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 msgr2=0x7f2e700b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b63e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2e5801cdb0 tx=0x7f2e5801bf20 comp rx=0 tx=0).stop 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 shutdown_connections 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2e500664a0 0x7f2e50068960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2e700d0ae0 0x7f2e700b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e700d0690 0x7f2e700b63e0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 --2- 172.21.15.40:0/48558842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2e700b4990 0x7f2e7015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 >> 172.21.15.40:0/48558842 conn(0x7f2e700cf990 msgr2=0x7f2e700b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 shutdown_connections 2023-11-04T01:42:57.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57.890+0000 7f2e763f2640 1 -- 172.21.15.40:0/48558842 wait complete. 2023-11-04T01:42:57.911 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:42:57.911 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:57.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:57.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[53983]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:57.972 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:42:57.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:57.972 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:57.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:42:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:57.983 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:42:57.983 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:57.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:57.990 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:42:57.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:57.990 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:42:58.039 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:42:58.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:58.041 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:42:58.041 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:58.046 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:58.046 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:42:58.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:58.047 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:42:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:42:58.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:58.095 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:42:58.095 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:58.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:58.100 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:42:58.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:58.101 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:42:58.150 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:42:58.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:58.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 Processor -- start 2023-11-04T01:42:58.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 -- start start 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa4840c2670 0x7fa4840b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840b0fc0 con 0x7fa48415b290 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48406c740 con 0x7fa4840c2670 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa48b487640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415b670 con 0x7fa4840b0b70 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa488a22640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa4840c2670 0x7fa4840b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:51094/0 (socket says 172.21.15.40:51094) 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 -- 172.21.15.40:0/1074463732 learned_addr learned my addr 172.21.15.40:0/1074463732 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa488a22640 1 --2- 172.21.15.40:0/1074463732 >> v2:172.21.15.91:3300/0 conn(0x7fa4840c2670 0x7fa4840b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52814/0 (socket says 172.21.15.40:52814) 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 -- 172.21.15.40:0/1074463732 >> v2:172.21.15.91:3300/0 conn(0x7fa4840c2670 msgr2=0x7fa4840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 --2- 172.21.15.40:0/1074463732 >> v2:172.21.15.91:3300/0 conn(0x7fa4840c2670 0x7fa4840b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 -- 172.21.15.40:0/1074463732 >> v1:172.21.15.91:6789/0 conn(0x7fa48415b290 legacy=0x7fa48406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.278+0000 7fa489a24640 1 -- 172.21.15.40:0/1074463732 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48406bb30 con 0x7fa4840b0b70 2023-11-04T01:42:58.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa489a24640 1 --2- 172.21.15.40:0/1074463732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415eee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009870 tx=0x7fa47c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd0dbb692ce8a30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa47bfff640 1 -- 172.21.15.40:0/1074463732 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0ab680 con 0x7fa4840b0b70 2023-11-04T01:42:58.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa47bfff640 1 -- 172.21.15.40:0/1074463732 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0ab7e0 con 0x7fa4840b0b70 2023-11-04T01:42:58.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa47bfff640 1 -- 172.21.15.40:0/1074463732 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0abb70 con 0x7fa4840b0b70 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 -- 172.21.15.40:0/1074463732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 msgr2=0x7fa48415eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 --2- 172.21.15.40:0/1074463732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415eee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009870 tx=0x7fa47c01c480 comp rx=0 tx=0).stop 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 -- 172.21.15.40:0/1074463732 shutdown_connections 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 --2- 172.21.15.40:0/1074463732 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415eee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 --2- 172.21.15.40:0/1074463732 >> v2:172.21.15.91:3300/0 conn(0x7fa4840c2670 0x7fa4840b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 -- 172.21.15.40:0/1074463732 >> 172.21.15.40:0/1074463732 conn(0x7fa4840cebb0 msgr2=0x7fa4840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 -- 172.21.15.40:0/1074463732 shutdown_connections 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.282+0000 7fa48b487640 1 -- 172.21.15.40:0/1074463732 wait complete. 2023-11-04T01:42:58.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 Processor -- start 2023-11-04T01:42:58.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- start start 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4840c2670 0x7fa4840c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 0x7fa484152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841535c0 con 0x7fa48415b290 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415ca50 con 0x7fa4840c2670 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840c3fa0 con 0x7fa4840b0b70 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 0x7fa484152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 0x7fa484152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44498/0 (socket says 172.21.15.40:44498) 2023-11-04T01:42:58.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 -- 172.21.15.40:0/4066318680 learned_addr learned my addr 172.21.15.40:0/4066318680 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489223640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa488a22640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4840c2670 0x7fa4840c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 -- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 msgr2=0x7fa48415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 -- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4840c2670 msgr2=0x7fa4840c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4840c2670 0x7fa4840c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 -- 172.21.15.40:0/4066318680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0094d0 con 0x7fa48415b290 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa488a22640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4840c2670 0x7fa4840c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa489a24640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 0x7fa484152530 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0ad040 tx=0x7fa47c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0b4800 con 0x7fa48415b290 2023-11-04T01:42:58.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0b4960 con 0x7fa48415b290 2023-11-04T01:42:58.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa484152a70 con 0x7fa48415b290 2023-11-04T01:42:58.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0b4d10 con 0x7fa48415b290 2023-11-04T01:42:58.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48415c120 con 0x7fa48415b290 2023-11-04T01:42:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48415cbe0 con 0x7fa48415b290 2023-11-04T01:42:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.286+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa47c0b3380 con 0x7fa48415b290 2023-11-04T01:42:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.290+0000 7fa479ffb640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4680664a0 0x7fa468068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.290+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa47c11ec50 con 0x7fa48415b290 2023-11-04T01:42:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.290+0000 7fa489223640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4680664a0 0x7fa468068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.290+0000 7fa489223640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4680664a0 0x7fa468068960 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa4800012f0 tx=0x7fa480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.294+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa47c0ebcd0 con 0x7fa48415b290 2023-11-04T01:42:58.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.482+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4840744a0 con 0x7fa48415b290 2023-11-04T01:42:58.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa479ffb640 1 -- 172.21.15.40:0/4066318680 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fa47c11e090 con 0x7fa48415b290 2023-11-04T01:42:58.490 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:58.491 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:43.012180+0000","modified":"2023-11-04T01:42:54.358226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6645},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6645":{"gid":6645,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/3469878458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3469878458},{"type":"v1","addr":"172.21.15.91:6837","nonce":3469878458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:42:58.491 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2023-11-04T01:42:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4680664a0 msgr2=0x7fa468068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4680664a0 0x7fa468068960 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa4800012f0 tx=0x7fa480009040 comp rx=0 tx=0).stop 2023-11-04T01:42:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 msgr2=0x7fa484152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 0x7fa484152530 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0ad040 tx=0x7fa47c01acc0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 shutdown_connections 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4680664a0 0x7fa468068960 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48415b290 0x7fa484152530 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa4840c2670 0x7fa4840c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 --2- 172.21.15.40:0/4066318680 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4840b0b70 0x7fa48415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 >> 172.21.15.40:0/4066318680 conn(0x7fa4840cebb0 msgr2=0x7fa4841561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 shutdown_connections 2023-11-04T01:42:58.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.486+0000 7fa48b487640 1 -- 172.21.15.40:0/4066318680 wait complete. 2023-11-04T01:42:58.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:58.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 Processor -- start 2023-11-04T01:42:58.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 -- start start 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70900b1e10 0x7f70900ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f709006ace0 0x7f709015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709015b360 con 0x7f709015af80 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7090071880 con 0x7f70900b1e10 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f7094be0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7090071b60 con 0x7f709006ace0 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70900b1e10 0x7f70900ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708e59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f709015af80 0x7f70900b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48030/0 (socket says 172.21.15.40:48030) 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708e59c640 1 -- 172.21.15.40:0/473267616 learned_addr learned my addr 172.21.15.40:0/473267616 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708ed9d640 1 --2- 172.21.15.40:0/473267616 >> v2:172.21.15.91:3300/0 conn(0x7f709006ace0 0x7f709015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708d59a640 1 -- 172.21.15.40:0/473267616 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249789201 0 0) 0x7f709015b360 con 0x7f709015af80 2023-11-04T01:42:58.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708d59a640 1 -- 172.21.15.40:0/473267616 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7078003530 con 0x7f709015af80 2023-11-04T01:42:58.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708dd9b640 1 -- 172.21.15.40:0/473267616 >> v2:172.21.15.91:3300/0 conn(0x7f709006ace0 msgr2=0x7f709015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708dd9b640 1 --2- 172.21.15.40:0/473267616 >> v2:172.21.15.91:3300/0 conn(0x7f709006ace0 0x7f709015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708dd9b640 1 -- 172.21.15.40:0/473267616 >> v1:172.21.15.40:6789/0 conn(0x7f709015af80 legacy=0x7f70900b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.630+0000 7f708dd9b640 1 -- 172.21.15.40:0/473267616 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709006a200 con 0x7f70900b1e10 2023-11-04T01:42:58.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f708dd9b640 1 --2- 172.21.15.40:0/473267616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70900b1e10 0x7f70900ca1c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f70900c6bd0 tx=0x7f708401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1742eede79954154 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f708d59a640 1 -- 172.21.15.40:0/473267616 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840ab600 con 0x7f70900b1e10 2023-11-04T01:42:58.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f708d59a640 1 -- 172.21.15.40:0/473267616 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70840a7050 con 0x7f70900b1e10 2023-11-04T01:42:58.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f708d59a640 1 -- 172.21.15.40:0/473267616 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840ab980 con 0x7f70900b1e10 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 -- 172.21.15.40:0/473267616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70900b1e10 msgr2=0x7f70900ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 --2- 172.21.15.40:0/473267616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70900b1e10 0x7f70900ca1c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f70900c6bd0 tx=0x7f708401c3d0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 -- 172.21.15.40:0/473267616 shutdown_connections 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 --2- 172.21.15.40:0/473267616 >> v2:172.21.15.91:3300/0 conn(0x7f709006ace0 0x7f709015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 --2- 172.21.15.40:0/473267616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70900b1e10 0x7f70900ca1c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 -- 172.21.15.40:0/473267616 >> 172.21.15.40:0/473267616 conn(0x7f709006e760 msgr2=0x7f709006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 -- 172.21.15.40:0/473267616 shutdown_connections 2023-11-04T01:42:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 -- 172.21.15.40:0/473267616 wait complete. 2023-11-04T01:42:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 Processor -- start 2023-11-04T01:42:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.634+0000 7f7094be0640 1 -- start start 2023-11-04T01:42:58.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f709006ace0 0x7f70901558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70900b1e10 0x7f7090155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 0x7f7090161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090156790 con 0x7f709015af80 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901655b0 con 0x7f70900b1e10 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7090155e20 con 0x7f709006ace0 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 0x7f7090161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 0x7f7090161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44516/0 (socket says 172.21.15.40:44516) 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 -- 172.21.15.40:0/4066648459 learned_addr learned my addr 172.21.15.40:0/4066648459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708dd9b640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70900b1e10 0x7f7090155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708e59c640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f709006ace0 0x7f70901558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 -- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f709006ace0 msgr2=0x7f70901558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f709006ace0 0x7f70901558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 -- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70900b1e10 msgr2=0x7f7090155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70900b1e10 0x7f7090155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 -- 172.21.15.40:0/4066648459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084009420 con 0x7f709015af80 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708dd9b640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70900b1e10 0x7f7090155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708ed9d640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 0x7f7090161fe0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f708800d830 tx=0x7f708800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800b6c0 con 0x7f709015af80 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708800b820 con 0x7f709015af80 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800bbd0 con 0x7f709015af80 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090156530 con 0x7f709015af80 2023-11-04T01:42:58.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7090164f60 con 0x7f709015af80 2023-11-04T01:42:58.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090165760 con 0x7f709015af80 2023-11-04T01:42:58.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f708801e460 con 0x7f709015af80 2023-11-04T01:42:58.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f707effd640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70700664d0 0x7f7070068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f7088084a50 con 0x7f709015af80 2023-11-04T01:42:58.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.638+0000 7f708e59c640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70700664d0 0x7f7070068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.642+0000 7f708e59c640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70700664d0 0x7f7070068990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7080001570 tx=0x7f7080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.642+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7090165760 con 0x7f709015af80 2023-11-04T01:42:58.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.806+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7090165760 con 0x7f709015af80 2023-11-04T01:42:58.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.806+0000 7f707effd640 1 -- 172.21.15.40:0/4066648459 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21696 (secure 0 0 0) 0x7f7090165760 con 0x7f709015af80 2023-11-04T01:42:58.813 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:42:58.813 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":79,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:44.675142+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:58.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70700664d0 msgr2=0x7f7070068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70700664d0 0x7f7070068990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7080001570 tx=0x7f7080009040 comp rx=0 tx=0).stop 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 msgr2=0x7f7090161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 0x7f7090161fe0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f708800d830 tx=0x7f708800dcf0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 shutdown_connections 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70700664d0 0x7f7070068990 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f709015af80 0x7f7090161fe0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f70900b1e10 0x7f7090155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 --2- 172.21.15.40:0/4066648459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f709006ace0 0x7f70901558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 >> 172.21.15.40:0/4066648459 conn(0x7f709006e760 msgr2=0x7f7090156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 shutdown_connections 2023-11-04T01:42:58.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.810+0000 7f7094be0640 1 -- 172.21.15.40:0/4066648459 wait complete. 2023-11-04T01:42:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:41.165148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:42.005968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:58.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:58.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 Processor -- start 2023-11-04T01:42:58.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 -- start start 2023-11-04T01:42:58.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b880ce1b0 0x7f9b8815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b8806d160 0x7f9b8815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815e800 con 0x7f9b8815af70 2023-11-04T01:42:58.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b88071200 con 0x7f9b8806d160 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8e4d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8806c0c0 con 0x7f9b880ce1b0 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8ca72640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b8806d160 0x7f9b8815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b87fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9b8815af70 0x7f9b880cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48034/0 (socket says 172.21.15.40:48034) 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b87fff640 1 -- 172.21.15.40:0/1124218365 learned_addr learned my addr 172.21.15.40:0/1124218365 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b877fe640 1 --2- 172.21.15.40:0/1124218365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b880ce1b0 0x7f9b8815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8ca72640 1 -- 172.21.15.40:0/1124218365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b880ce1b0 msgr2=0x7f9b8815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8ca72640 1 --2- 172.21.15.40:0/1124218365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b880ce1b0 0x7f9b8815dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b86ffd640 1 -- 172.21.15.40:0/1124218365 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948892556 0 0) 0x7f9b8815e800 con 0x7f9b8815af70 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8ca72640 1 -- 172.21.15.40:0/1124218365 >> v1:172.21.15.40:6789/0 conn(0x7f9b8815af70 legacy=0x7f9b880cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.954+0000 7f9b8ca72640 1 -- 172.21.15.40:0/1124218365 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8806c3a0 con 0x7f9b8806d160 2023-11-04T01:42:58.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8ca72640 1 --2- 172.21.15.40:0/1124218365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8806d160 0x7f9b8815e2c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b8001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c817eac814248d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b86ffd640 1 -- 172.21.15.40:0/1124218365 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800a5900 con 0x7f9b8806d160 2023-11-04T01:42:58.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b86ffd640 1 -- 172.21.15.40:0/1124218365 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b800a5a60 con 0x7f9b8806d160 2023-11-04T01:42:58.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b86ffd640 1 -- 172.21.15.40:0/1124218365 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800a5df0 con 0x7f9b8806d160 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/1124218365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8806d160 msgr2=0x7f9b8815e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/1124218365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8806d160 0x7f9b8815e2c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009d90 tx=0x7f9b8001c950 comp rx=0 tx=0).stop 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/1124218365 shutdown_connections 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/1124218365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8806d160 0x7f9b8815e2c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/1124218365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b880ce1b0 0x7f9b8815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/1124218365 >> 172.21.15.40:0/1124218365 conn(0x7f9b880cb510 msgr2=0x7f9b880cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/1124218365 shutdown_connections 2023-11-04T01:42:58.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/1124218365 wait complete. 2023-11-04T01:42:58.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 Processor -- start 2023-11-04T01:42:58.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- start start 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b8806d160 0x7f9b880af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 0x7f9b880ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b8815af70 0x7f9b880ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881f89a0 con 0x7f9b880ce1b0 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880b03e0 con 0x7f9b8806d160 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.958+0000 7f9b8e4d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880b06c0 con 0x7f9b8815af70 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 0x7f9b880ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 0x7f9b880ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44524/0 (socket says 172.21.15.40:44524) 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 -- 172.21.15.40:0/3514534158 learned_addr learned my addr 172.21.15.40:0/3514534158 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b8ca72640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b8815af70 0x7f9b880ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b87fff640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b8806d160 0x7f9b880af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 -- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b8815af70 msgr2=0x7f9b880ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b8815af70 0x7f9b880ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 -- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b8806d160 msgr2=0x7f9b880af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b8806d160 0x7f9b880af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 -- 172.21.15.40:0/3514534158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009a70 con 0x7f9b880ce1b0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b8ca72640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b8815af70 0x7f9b880ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b877fe640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 0x7f9b880ac8c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00c7f0 tx=0x7f9b7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c004220 con 0x7f9b880ce1b0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c0043a0 con 0x7f9b880ce1b0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c004510 con 0x7f9b880ce1b0 2023-11-04T01:42:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880b09a0 con 0x7f9b880ce1b0 2023-11-04T01:42:58.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b880b0f60 con 0x7f9b880ce1b0 2023-11-04T01:42:58.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b880744a0 con 0x7f9b880ce1b0 2023-11-04T01:42:58.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b7c003a70 con 0x7f9b880ce1b0 2023-11-04T01:42:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b84ff9640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b740664a0 0x7f9b74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f9b7c084250 con 0x7f9b880ce1b0 2023-11-04T01:42:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b87fff640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b740664a0 0x7f9b74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.962+0000 7f9b87fff640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b740664a0 0x7f9b74068960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9b78000f70 tx=0x7f9b78007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:58.966+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b7c0512a0 con 0x7f9b880ce1b0 2023-11-04T01:42:59.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.126+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b8815c260 con 0x7f9b880ce1b0 2023-11-04T01:42:59.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.126+0000 7f9b84ff9640 1 -- 172.21.15.40:0/3514534158 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b7c0548c0 con 0x7f9b880ce1b0 2023-11-04T01:42:59.132 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b740664a0 msgr2=0x7f9b74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b740664a0 0x7f9b74068960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9b78000f70 tx=0x7f9b78007c10 comp rx=0 tx=0).stop 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 msgr2=0x7f9b880ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 0x7f9b880ac8c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00c7f0 tx=0x7f9b7c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 shutdown_connections 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9b740664a0 0x7f9b74068960 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9b8815af70 0x7f9b880ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b880ce1b0 0x7f9b880ac8c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 --2- 172.21.15.40:0/3514534158 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9b8806d160 0x7f9b880af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 >> 172.21.15.40:0/3514534158 conn(0x7f9b880cb510 msgr2=0x7f9b88157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 shutdown_connections 2023-11-04T01:42:59.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.130+0000 7f9b8e4d5640 1 -- 172.21.15.40:0/3514534158 wait complete. 2023-11-04T01:42:59.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 Processor -- start 2023-11-04T01:42:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 -- start start 2023-11-04T01:42:59.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f4c159e90 0x7f5f4c0cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5f4c0b15a0 0x7f5f4c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c15e960 con 0x7f5f4c070af0 2023-11-04T01:42:59.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ced40 con 0x7f5f4c159e90 2023-11-04T01:42:59.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f53166640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ca7e0 con 0x7f5f4c0b15a0 2023-11-04T01:42:59.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f4c159e90 0x7f5f4c0cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f4c159e90 0x7f5f4c0cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44528/0 (socket says 172.21.15.40:44528) 2023-11-04T01:42:59.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 -- 172.21.15.40:0/3248117094 learned_addr learned my addr 172.21.15.40:0/3248117094 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/3248117094 >> v2:172.21.15.91:3300/0 conn(0x7f5f4c0b15a0 0x7f5f4c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 -- 172.21.15.40:0/3248117094 >> v2:172.21.15.91:3300/0 conn(0x7f5f4c0b15a0 msgr2=0x7f5f4c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 --2- 172.21.15.40:0/3248117094 >> v2:172.21.15.91:3300/0 conn(0x7f5f4c0b15a0 0x7f5f4c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 -- 172.21.15.40:0/3248117094 >> v1:172.21.15.91:6789/0 conn(0x7f5f4c070af0 legacy=0x7f5f4c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.278+0000 7f5f50f02640 1 -- 172.21.15.40:0/3248117094 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0b1f40 con 0x7f5f4c159e90 2023-11-04T01:42:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f50f02640 1 --2- 172.21.15.40:0/3248117094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c159e90 0x7f5f4c0cd990 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c072320 tx=0x7f5f3c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2285da3c795eb1b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f4b7fe640 1 -- 172.21.15.40:0/3248117094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0ab5f0 con 0x7f5f4c159e90 2023-11-04T01:42:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f4b7fe640 1 -- 172.21.15.40:0/3248117094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0ab750 con 0x7f5f4c159e90 2023-11-04T01:42:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f4b7fe640 1 -- 172.21.15.40:0/3248117094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0abae0 con 0x7f5f4c159e90 2023-11-04T01:42:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- 172.21.15.40:0/3248117094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c159e90 msgr2=0x7f5f4c0cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 --2- 172.21.15.40:0/3248117094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c159e90 0x7f5f4c0cd990 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c072320 tx=0x7f5f3c01c500 comp rx=0 tx=0).stop 2023-11-04T01:42:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- 172.21.15.40:0/3248117094 shutdown_connections 2023-11-04T01:42:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 --2- 172.21.15.40:0/3248117094 >> v2:172.21.15.91:3300/0 conn(0x7f5f4c0b15a0 0x7f5f4c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 --2- 172.21.15.40:0/3248117094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c159e90 0x7f5f4c0cd990 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- 172.21.15.40:0/3248117094 >> 172.21.15.40:0/3248117094 conn(0x7f5f4c0cc5a0 msgr2=0x7f5f4c0cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- 172.21.15.40:0/3248117094 shutdown_connections 2023-11-04T01:42:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- 172.21.15.40:0/3248117094 wait complete. 2023-11-04T01:42:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 Processor -- start 2023-11-04T01:42:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- start start 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 0x7f5f4c0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f4c0b15a0 0x7f5f4c0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f4c159e90 0x7f5f4c154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c8790 con 0x7f5f4c070af0 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c8a70 con 0x7f5f4c159e90 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f53166640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c8d50 con 0x7f5f4c0b15a0 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f50f02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 0x7f5f4c0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f50f02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 0x7f5f4c0b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44536/0 (socket says 172.21.15.40:44536) 2023-11-04T01:42:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.282+0000 7f5f50f02640 1 -- 172.21.15.40:0/583688563 learned_addr learned my addr 172.21.15.40:0/583688563 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f4c0b15a0 0x7f5f4c0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f51703640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f4c159e90 0x7f5f4c154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f50f02640 1 -- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f4c0b15a0 msgr2=0x7f5f4c0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f50f02640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f4c0b15a0 0x7f5f4c0c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f50f02640 1 -- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f4c159e90 msgr2=0x7f5f4c154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f50f02640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f4c159e90 0x7f5f4c154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f50f02640 1 -- 172.21.15.40:0/583688563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0094d0 con 0x7f5f4c070af0 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f51703640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f4c159e90 0x7f5f4c154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f50f02640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 0x7f5f4c0b3100 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c019110 tx=0x7f5f3c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0be5f0 con 0x7f5f4c070af0 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0be770 con 0x7f5f4c070af0 2023-11-04T01:42:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c0c9030 con 0x7f5f4c070af0 2023-11-04T01:42:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0beb20 con 0x7f5f4c070af0 2023-11-04T01:42:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c0b5050 con 0x7f5f4c070af0 2023-11-04T01:42:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c0744a0 con 0x7f5f4c070af0 2023-11-04T01:42:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f3c0b43f0 con 0x7f5f4c070af0 2023-11-04T01:42:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f497fa640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f380664d0 0x7f5f38068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f5f3c0a8050 con 0x7f5f4c070af0 2023-11-04T01:42:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f380664d0 0x7f5f38068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.286+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f380664d0 0x7f5f38068990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ae440 tx=0x7f5f40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.290+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5f3c0ebeb0 con 0x7f5f4c070af0 2023-11-04T01:42:59.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.446+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f5f4c0b5aa0 con 0x7f5f4c070af0 2023-11-04T01:42:59.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.446+0000 7f5f497fa640 1 -- 172.21.15.40:0/583688563 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5f3c0c40a0 con 0x7f5f4c070af0 2023-11-04T01:42:59.452 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f380664d0 msgr2=0x7f5f38068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f380664d0 0x7f5f38068990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ae440 tx=0x7f5f40008040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 msgr2=0x7f5f4c0b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 0x7f5f4c0b3100 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c019110 tx=0x7f5f3c01ad40 comp rx=0 tx=0).stop 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 shutdown_connections 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f380664d0 0x7f5f38068990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f4c159e90 0x7f5f4c154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f4c0b15a0 0x7f5f4c0c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 --2- 172.21.15.40:0/583688563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f4c070af0 0x7f5f4c0b3100 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 >> 172.21.15.40:0/583688563 conn(0x7f5f4c0cc5a0 msgr2=0x7f5f4c1587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 shutdown_connections 2023-11-04T01:42:59.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.450+0000 7f5f53166640 1 -- 172.21.15.40:0/583688563 wait complete. 2023-11-04T01:42:59.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:59.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 Processor -- start 2023-11-04T01:42:59.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 -- start start 2023-11-04T01:42:59.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ecc15af50 0x7f2ecc0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc0b32f0 0x7f2ecc0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2ecc0cf4c0 0x7f2ecc0cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0b3780 con 0x7f2ecc15af50 2023-11-04T01:42:59.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0cd830 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ed09ef640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0cdad0 con 0x7f2ecc0b32f0 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ecc15af50 0x7f2ecc0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ecc15af50 0x7f2ecc0cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44542/0 (socket says 172.21.15.40:44542) 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 -- 172.21.15.40:0/2302319540 learned_addr learned my addr 172.21.15.40:0/2302319540 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ecad9d640 1 --2- 172.21.15.40:0/2302319540 >> v2:172.21.15.91:3300/0 conn(0x7f2ecc0cf4c0 0x7f2ecc0cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2ec9d9b640 1 --2- 172.21.15.40:0/2302319540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc0b32f0 0x7f2ecc0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 -- 172.21.15.40:0/2302319540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc0b32f0 msgr2=0x7f2ecc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 --2- 172.21.15.40:0/2302319540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc0b32f0 0x7f2ecc0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 -- 172.21.15.40:0/2302319540 >> v2:172.21.15.91:3300/0 conn(0x7f2ecc0cf4c0 msgr2=0x7f2ecc0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 --2- 172.21.15.40:0/2302319540 >> v2:172.21.15.91:3300/0 conn(0x7f2ecc0cf4c0 0x7f2ecc0cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.590+0000 7f2eca59c640 1 -- 172.21.15.40:0/2302319540 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc0cddb0 con 0x7f2ecc15af50 2023-11-04T01:42:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 --2- 172.21.15.40:0/2302319540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc15af50 0x7f2ecc0cb330 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0716d0 tx=0x7f2ebc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2077abae9f72d24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ec959a640 1 -- 172.21.15.40:0/2302319540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0ab650 con 0x7f2ecc15af50 2023-11-04T01:42:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ec959a640 1 -- 172.21.15.40:0/2302319540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0ab7b0 con 0x7f2ecc15af50 2023-11-04T01:42:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ec959a640 1 -- 172.21.15.40:0/2302319540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0abb40 con 0x7f2ecc15af50 2023-11-04T01:42:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- 172.21.15.40:0/2302319540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc15af50 msgr2=0x7f2ecc0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/2302319540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc15af50 0x7f2ecc0cb330 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0716d0 tx=0x7f2ebc01c470 comp rx=0 tx=0).stop 2023-11-04T01:42:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- 172.21.15.40:0/2302319540 shutdown_connections 2023-11-04T01:42:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/2302319540 >> v2:172.21.15.91:3300/0 conn(0x7f2ecc0cf4c0 0x7f2ecc0cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/2302319540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc0b32f0 0x7f2ecc0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/2302319540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc15af50 0x7f2ecc0cb330 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- 172.21.15.40:0/2302319540 >> 172.21.15.40:0/2302319540 conn(0x7f2ecc065dc0 msgr2=0x7f2ecc0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- 172.21.15.40:0/2302319540 shutdown_connections 2023-11-04T01:42:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- 172.21.15.40:0/2302319540 wait complete. 2023-11-04T01:42:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 Processor -- start 2023-11-04T01:42:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- start start 2023-11-04T01:42:59.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 0x7f2ecc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc15af50 0x7f2ecc0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ecc0b5bd0 0x7f2ecc0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0cab90 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0ca5d0 con 0x7f2ecc0b5bd0 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ed09ef640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0ca8b0 con 0x7f2ecc15af50 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 0x7f2ecc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 0x7f2ecc0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44552/0 (socket says 172.21.15.40:44552) 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 -- 172.21.15.40:0/3282178434 learned_addr learned my addr 172.21.15.40:0/3282178434 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ecad9d640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ecc0b5bd0 0x7f2ecc0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2ec9d9b640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc15af50 0x7f2ecc0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 -- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc15af50 msgr2=0x7f2ecc0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc15af50 0x7f2ecc0c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 -- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ecc0b5bd0 msgr2=0x7f2ecc0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ecc0b5bd0 0x7f2ecc0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.594+0000 7f2eca59c640 1 -- 172.21.15.40:0/3282178434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009470 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2eca59c640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 0x7f2ecc0c9ef0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0ad040 tx=0x7f2ebc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b4800 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0b4960 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b4cd0 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc15c500 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc0b6060 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc0675f0 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ebc0aa430 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ebaffd640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2eac0664a0 0x7f2eac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f2ebc11f100 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ec9d9b640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2eac0664a0 0x7f2eac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.598+0000 7f2ec9d9b640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2eac0664a0 0x7f2eac068960 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc1f8ac0 tx=0x7f2ec0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.602+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ebc0ec260 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.762+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f2ecc073270 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.762+0000 7f2ebaffd640 1 -- 172.21.15.40:0/3282178434 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ebc0ef880 con 0x7f2ecc0cf4c0 2023-11-04T01:42:59.768 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:42:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2eac0664a0 msgr2=0x7f2eac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2eac0664a0 0x7f2eac068960 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc1f8ac0 tx=0x7f2ec0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 msgr2=0x7f2ecc0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 0x7f2ecc0c9ef0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0ad040 tx=0x7f2ebc01acb0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 shutdown_connections 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2eac0664a0 0x7f2eac068960 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ecc0b5bd0 0x7f2ecc0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ecc15af50 0x7f2ecc0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 --2- 172.21.15.40:0/3282178434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ecc0cf4c0 0x7f2ecc0c9ef0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 >> 172.21.15.40:0/3282178434 conn(0x7f2ecc065dc0 msgr2=0x7f2ecc06c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 shutdown_connections 2023-11-04T01:42:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.766+0000 7f2ed09ef640 1 -- 172.21.15.40:0/3282178434 wait complete. 2023-11-04T01:42:59.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56ce351640 1 Processor -- start 2023-11-04T01:42:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56ce351640 1 -- start start 2023-11-04T01:42:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56ce351640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56c806a870 0x7f56c80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56ce351640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c8161760 con 0x7f56c8146510 2023-11-04T01:42:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56ce351640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c8161a40 con 0x7f56c81438e0 2023-11-04T01:42:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56ce351640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c80d0790 con 0x7f56c806a870 2023-11-04T01:42:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56c8146510 0x7f56c806cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48038/0 (socket says 172.21.15.40:48038) 2023-11-04T01:42:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 -- 172.21.15.40:0/3822952778 learned_addr learned my addr 172.21.15.40:0/3822952778 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:42:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c77fe640 1 --2- 172.21.15.40:0/3822952778 >> v2:172.21.15.91:3300/0 conn(0x7f56c806a870 0x7f56c80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771965231 0 0) 0x7f56c8161760 con 0x7f56c8146510 2023-11-04T01:42:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b0003530 con 0x7f56c8146510 2023-11-04T01:42:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243399931 0 0) 0x7f56b0003530 con 0x7f56c8146510 2023-11-04T01:42:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 >> v2:172.21.15.91:3300/0 conn(0x7f56c806a870 msgr2=0x7f56c80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 --2- 172.21.15.40:0/3822952778 >> v2:172.21.15.91:3300/0 conn(0x7f56c806a870 0x7f56c80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 >> v1:172.21.15.91:6789/0 conn(0x7f56c81438e0 legacy=0x7f56c806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80d0a00 con 0x7f56c8146510 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f56c0001a00 con 0x7f56c8146510 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 >> v1:172.21.15.40:6789/0 conn(0x7f56c8146510 legacy=0x7f56c806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b0003980 0x7f56b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b00047d0 0x7f56b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b0005190 0x7f56b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80d0790 con 0x7f56b0005190 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b000c130 con 0x7f56b0003980 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b000c2f0 con 0x7f56b00047d0 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b0005190 0x7f56b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c77fe640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b00047d0 0x7f56b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c7fff640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b0003980 0x7f56b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 -- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b00047d0 msgr2=0x7f56b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b00047d0 0x7f56b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 -- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b0003980 msgr2=0x7f56b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b0003980 0x7f56b0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56cc8ee640 1 -- 172.21.15.40:0/3822952778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0003530 con 0x7f56b0005190 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c7fff640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56b0003980 0x7f56b0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.906+0000 7f56c77fe640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b00047d0 0x7f56b0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56cc8ee640 1 -- 172.21.15.40:0/3822952778 reap_dead start 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56cc8ee640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b0005190 0x7f56b000b990 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f56c000a7f0 tx=0x7f56c001fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acd1d30353ba542 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c00aa690 con 0x7f56b0005190 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c00aa7f0 con 0x7f56b0005190 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56c6ffd640 1 -- 172.21.15.40:0/3822952778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c00aaba0 con 0x7f56b0005190 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 -- 172.21.15.40:0/3822952778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b0005190 msgr2=0x7f56b000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b0005190 0x7f56b000b990 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f56c000a7f0 tx=0x7f56c001fa60 comp rx=0 tx=0).stop 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 -- 172.21.15.40:0/3822952778 shutdown_connections 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 --2- 172.21.15.40:0/3822952778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b0005190 0x7f56b000b990 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 -- 172.21.15.40:0/3822952778 >> 172.21.15.40:0/3822952778 conn(0x7f56c80cfc70 msgr2=0x7f56c80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 -- 172.21.15.40:0/3822952778 shutdown_connections 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 -- 172.21.15.40:0/3822952778 wait complete. 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 Processor -- start 2023-11-04T01:42:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.910+0000 7f56ce351640 1 -- start start 2023-11-04T01:42:59.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b0005190 0x7f56c814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 0x7f56c80b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56c80b5140 0x7f56c813a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c81516f0 con 0x7f56c8150ec0 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80b3b60 con 0x7f56c80b5140 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80b3e40 con 0x7f56b0005190 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 0x7f56c80b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 0x7f56c80b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44568/0 (socket says 172.21.15.40:44568) 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 -- 172.21.15.40:0/527054314 learned_addr learned my addr 172.21.15.40:0/527054314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c7fff640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b0005190 0x7f56c814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56cc8ee640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56c80b5140 0x7f56c813a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 -- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b0005190 msgr2=0x7f56c814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b0005190 0x7f56c814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 -- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56c80b5140 msgr2=0x7f56c813a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56c80b5140 0x7f56c813a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 -- 172.21.15.40:0/527054314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80b4120 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c77fe640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 0x7f56c80b4c00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f56bc010890 tx=0x7f56bc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc004220 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc004380 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc00eba0 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c80b4400 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c814b8b0 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80675f0 con 0x7f56c8150ec0 2023-11-04T01:42:59.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56bc00ed00 con 0x7f56c8150ec0 2023-11-04T01:42:59.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c4ff9640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56b40664d0 0x7f56b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f56bc084150 con 0x7f56c8150ec0 2023-11-04T01:42:59.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.914+0000 7f56c7fff640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56b40664d0 0x7f56b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.918+0000 7f56c7fff640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56b40664d0 0x7f56b4068990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f56b8007fd0 tx=0x7f56b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:42:59.918+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56bc051100 con 0x7f56c8150ec0 2023-11-04T01:43:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f56c8071b50 con 0x7f56c8150ec0 2023-11-04T01:43:00.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56c4ff9640 1 -- 172.21.15.40:0/527054314 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f56bc0044f0 con 0x7f56c8150ec0 2023-11-04T01:43:00.082 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56b40664d0 msgr2=0x7f56b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56b40664d0 0x7f56b4068990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f56b8007fd0 tx=0x7f56b8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 msgr2=0x7f56c80b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 0x7f56c80b4c00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f56bc010890 tx=0x7f56bc010d50 comp rx=0 tx=0).stop 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 shutdown_connections 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f56b40664d0 0x7f56b4068990 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56c80b5140 0x7f56c813a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56c8150ec0 0x7f56c80b4c00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 --2- 172.21.15.40:0/527054314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f56b0005190 0x7f56c814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 >> 172.21.15.40:0/527054314 conn(0x7f56c80cfc70 msgr2=0x7f56c80d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 shutdown_connections 2023-11-04T01:43:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.078+0000 7f56ce351640 1 -- 172.21.15.40:0/527054314 wait complete. 2023-11-04T01:43:00.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f290d313640 1 Processor -- start 2023-11-04T01:43:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f290d313640 1 -- start start 2023-11-04T01:43:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f290d313640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 0x7f29080cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f290d313640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29080cd830 con 0x7f29080cf4c0 2023-11-04T01:43:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f290d313640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29080cdad0 con 0x7f29080b32f0 2023-11-04T01:43:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f290d313640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080b3780 con 0x7f290815af50 2023-11-04T01:43:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29077fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f29080cf4c0 0x7f29080d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48040/0 (socket says 172.21.15.40:48040) 2023-11-04T01:43:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29077fe640 1 -- 172.21.15.40:0/1552848200 learned_addr learned my addr 172.21.15.40:0/1552848200 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2906ffd640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 0x7f29080cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450301437 0 0) 0x7f29080cd830 con 0x7f29080cf4c0 2023-11-04T01:43:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f4003530 con 0x7f29080cf4c0 2023-11-04T01:43:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2463636908 0 0) 0x7f28f4003530 con 0x7f29080cf4c0 2023-11-04T01:43:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 msgr2=0x7f29080cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 0x7f29080cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 >> v1:172.21.15.91:6789/0 conn(0x7f29080b32f0 legacy=0x7f29080ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080cddb0 con 0x7f29080cf4c0 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f28f8001680 con 0x7f29080cf4c0 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 >> v1:172.21.15.40:6789/0 conn(0x7f29080cf4c0 legacy=0x7f29080d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28f40039b0 0x7f28f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f40047d0 0x7f28f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 0x7f28f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29080b3780 con 0x7f28f40047d0 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f400bac0 con 0x7f28f40039b0 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f400bc80 con 0x7f290815af50 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29067fc640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f40047d0 0x7f28f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2906ffd640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28f40039b0 0x7f28f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29077fe640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 0x7f28f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29067fc640 1 -- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 msgr2=0x7f28f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29067fc640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f290815af50 0x7f28f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29067fc640 1 -- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28f40039b0 msgr2=0x7f28f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29067fc640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28f40039b0 0x7f28f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f29067fc640 1 -- 172.21.15.40:0/1552848200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4003530 con 0x7f28f40047d0 2023-11-04T01:43:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.218+0000 7f2906ffd640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28f40039b0 0x7f28f4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f29067fc640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f40047d0 0x7f28f4004c50 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f28f0001780 tx=0x7f28f001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef52937def5be40b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00052d0 con 0x7f28f40047d0 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00a7050 con 0x7f28f40047d0 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f2905ffb640 1 -- 172.21.15.40:0/1552848200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0003600 con 0x7f28f40047d0 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f290d313640 1 -- 172.21.15.40:0/1552848200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f40047d0 msgr2=0x7f28f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f290d313640 1 --2- 172.21.15.40:0/1552848200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f40047d0 0x7f28f4004c50 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f28f0001780 tx=0x7f28f001c400 comp rx=0 tx=0).stop 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f29077fe640 1 -- 172.21.15.40:0/1552848200 reap_dead start 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f290d313640 1 -- 172.21.15.40:0/1552848200 shutdown_connections 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f290d313640 1 -- 172.21.15.40:0/1552848200 >> 172.21.15.40:0/1552848200 conn(0x7f2908065dc0 msgr2=0x7f29080661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f290d313640 1 -- 172.21.15.40:0/1552848200 shutdown_connections 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.222+0000 7f290d313640 1 -- 172.21.15.40:0/1552848200 wait complete. 2023-11-04T01:43:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 Processor -- start 2023-11-04T01:43:00.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- start start 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28f40047d0 0x7f2908157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 0x7f29080c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29080c6d60 0x7f29081f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081f3c10 con 0x7f290815be60 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29080c71e0 con 0x7f29080c6d60 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080c82c0 con 0x7f28f40047d0 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 0x7f29080c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 0x7f29080c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44586/0 (socket says 172.21.15.40:44586) 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 -- 172.21.15.40:0/3657058977 learned_addr learned my addr 172.21.15.40:0/3657058977 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f2906ffd640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28f40047d0 0x7f2908157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29077fe640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29080c6d60 0x7f29081f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 -- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28f40047d0 msgr2=0x7f2908157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28f40047d0 0x7f2908157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 -- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29080c6d60 msgr2=0x7f29081f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29080c6d60 0x7f29081f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 -- 172.21.15.40:0/3657058977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290815cd10 con 0x7f290815be60 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f29067fc640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 0x7f29080c6820 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f28f001c8e0 tx=0x7f28f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0007100 con 0x7f290815be60 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0007280 con 0x7f290815be60 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290815cff0 con 0x7f290815be60 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0007630 con 0x7f290815be60 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29080c7f50 con 0x7f290815be60 2023-11-04T01:43:00.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290815e7b0 con 0x7f290815be60 2023-11-04T01:43:00.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28f00067e0 con 0x7f290815be60 2023-11-04T01:43:00.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.226+0000 7f28ff7fe640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28e80664a0 0x7f28e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.230+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f28f011e450 con 0x7f290815be60 2023-11-04T01:43:00.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.230+0000 7f2906ffd640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28e80664a0 0x7f28e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.230+0000 7f2906ffd640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28e80664a0 0x7f28e8068960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f29000075a0 tx=0x7f290000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.234+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28f00eb4a0 con 0x7f290815be60 2023-11-04T01:43:00.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.386+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29080c7d90 con 0x7f290815be60 2023-11-04T01:43:00.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f28ff7fe640 1 -- 172.21.15.40:0/3657058977 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28f00eeac0 con 0x7f290815be60 2023-11-04T01:43:00.394 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:00.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28e80664a0 msgr2=0x7f28e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28e80664a0 0x7f28e8068960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f29000075a0 tx=0x7f290000b040 comp rx=0 tx=0).stop 2023-11-04T01:43:00.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 msgr2=0x7f29080c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 0x7f29080c6820 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f28f001c8e0 tx=0x7f28f4005800 comp rx=0 tx=0).stop 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 shutdown_connections 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28e80664a0 0x7f28e8068960 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f29080c6d60 0x7f29081f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f290815be60 0x7f29080c6820 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 --2- 172.21.15.40:0/3657058977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28f40047d0 0x7f2908157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 >> 172.21.15.40:0/3657058977 conn(0x7f2908065dc0 msgr2=0x7f29080b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 shutdown_connections 2023-11-04T01:43:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.390+0000 7f290d313640 1 -- 172.21.15.40:0/3657058977 wait complete. 2023-11-04T01:43:00.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.534+0000 7f5141f4d640 1 Processor -- start 2023-11-04T01:43:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f5141f4d640 1 -- start start 2023-11-04T01:43:00.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f5141f4d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c144840 0x7f513c15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f5141f4d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f513c070b40 0x7f513c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f5141f4d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c06cc10 con 0x7f513c0b54d0 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f5141f4d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c0b5960 con 0x7f513c070b40 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f5141f4d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c071d10 con 0x7f513c144840 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f513c070b40 0x7f513c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f513c070b40 0x7f513c0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44590/0 (socket says 172.21.15.40:44590) 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f513c0b54d0 0x7f513c06a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48046/0 (socket says 172.21.15.40:48046) 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 -- 172.21.15.40:0/3972607779 learned_addr learned my addr 172.21.15.40:0/3972607779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513b7fe640 1 --2- 172.21.15.40:0/3972607779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c144840 0x7f513c15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 -- 172.21.15.40:0/3972607779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c144840 msgr2=0x7f513c15f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 --2- 172.21.15.40:0/3972607779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c144840 0x7f513c15f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 -- 172.21.15.40:0/3972607779 >> v1:172.21.15.40:6789/0 conn(0x7f513c0b54d0 legacy=0x7f513c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513affd640 1 -- 172.21.15.40:0/3972607779 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c15fb20 con 0x7f513c070b40 2023-11-04T01:43:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.538+0000 7f513a7fc640 1 -- 172.21.15.40:0/3972607779 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973757792 0 0) 0x7f513c06cc10 con 0x7f513c0b54d0 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513affd640 1 --2- 172.21.15.40:0/3972607779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c070b40 0x7f513c0b4f90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5130009870 tx=0x7f513001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff39ca95d963294b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513a7fc640 1 -- 172.21.15.40:0/3972607779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300ac600 con 0x7f513c070b40 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513a7fc640 1 -- 172.21.15.40:0/3972607779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51300a8050 con 0x7f513c070b40 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513a7fc640 1 -- 172.21.15.40:0/3972607779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300ac980 con 0x7f513c070b40 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- 172.21.15.40:0/3972607779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c070b40 msgr2=0x7f513c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 --2- 172.21.15.40:0/3972607779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c070b40 0x7f513c0b4f90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5130009870 tx=0x7f513001c480 comp rx=0 tx=0).stop 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- 172.21.15.40:0/3972607779 shutdown_connections 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 --2- 172.21.15.40:0/3972607779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c070b40 0x7f513c0b4f90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 --2- 172.21.15.40:0/3972607779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c144840 0x7f513c15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- 172.21.15.40:0/3972607779 >> 172.21.15.40:0/3972607779 conn(0x7f513c0cfc70 msgr2=0x7f513c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- 172.21.15.40:0/3972607779 shutdown_connections 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- 172.21.15.40:0/3972607779 wait complete. 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 Processor -- start 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- start start 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f513c070b40 0x7f513c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c0b54d0 0x7f513c137550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 0x7f513c13f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c137a90 con 0x7f513c144840 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c152e20 con 0x7f513c070b40 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f5141f4d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c153100 con 0x7f513c0b54d0 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 0x7f513c13f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 0x7f513c13f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44600/0 (socket says 172.21.15.40:44600) 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 -- 172.21.15.40:0/1061139994 learned_addr learned my addr 172.21.15.40:0/1061139994 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513affd640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c0b54d0 0x7f513c137550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 -- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c0b54d0 msgr2=0x7f513c137550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513b7fe640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f513c070b40 0x7f513c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c0b54d0 0x7f513c137550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 -- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f513c070b40 msgr2=0x7f513c152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f513c070b40 0x7f513c152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 -- 172.21.15.40:0/1061139994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300094d0 con 0x7f513c144840 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.542+0000 7f513bfff640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 0x7f513c13f110 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c3e0 tx=0x7f512c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0074e0 con 0x7f513c144840 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c007660 con 0x7f513c144840 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c004a30 con 0x7f513c144840 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c1533e0 con 0x7f513c144840 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c1539a0 con 0x7f513c144840 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c0675f0 con 0x7f513c144840 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f512c004b90 con 0x7f513c144840 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5123fff640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f51280664d0 0x7f5128068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f512c083ff0 con 0x7f513c144840 2023-11-04T01:43:00.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f513b7fe640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f51280664d0 0x7f5128068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.546+0000 7f513b7fe640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f51280664d0 0x7f5128068990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5134009f30 tx=0x7f513400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.550+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f512c0b5090 con 0x7f513c144840 2023-11-04T01:43:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.698+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f513c0cf9e0 con 0x7f513c144840 2023-11-04T01:43:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.698+0000 7f5123fff640 1 -- 172.21.15.40:0/1061139994 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f512c054b00 con 0x7f513c144840 2023-11-04T01:43:00.704 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f51280664d0 msgr2=0x7f5128068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f51280664d0 0x7f5128068990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5134009f30 tx=0x7f513400b040 comp rx=0 tx=0).stop 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 msgr2=0x7f513c13f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 0x7f513c13f110 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c3e0 tx=0x7f512c00c8a0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 shutdown_connections 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f51280664d0 0x7f5128068990 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c144840 0x7f513c13f110 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f513c0b54d0 0x7f513c137550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 --2- 172.21.15.40:0/1061139994 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f513c070b40 0x7f513c152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 >> 172.21.15.40:0/1061139994 conn(0x7f513c0cfc70 msgr2=0x7f513c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 shutdown_connections 2023-11-04T01:43:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.702+0000 7f5141f4d640 1 -- 172.21.15.40:0/1061139994 wait complete. 2023-11-04T01:43:00.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:00.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 Processor -- start 2023-11-04T01:43:00.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 -- start start 2023-11-04T01:43:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17200b4990 0x7f17200b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f17200b74f0 0x7f17200cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17200b6070 con 0x7f17200d0690 2023-11-04T01:43:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200b8ed0 con 0x7f17200b4990 2023-11-04T01:43:00.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f1726046640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200b52b0 con 0x7f17200b74f0 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17200b4990 0x7f17200b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17200b4990 0x7f17200b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44614/0 (socket says 172.21.15.40:44614) 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 -- 172.21.15.40:0/997323627 learned_addr learned my addr 172.21.15.40:0/997323627 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 -- 172.21.15.40:0/997323627 >> v2:172.21.15.91:3300/0 conn(0x7f17200b74f0 msgr2=0x7f17200cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 --2- 172.21.15.40:0/997323627 >> v2:172.21.15.91:3300/0 conn(0x7f17200b74f0 0x7f17200cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 -- 172.21.15.40:0/997323627 >> v1:172.21.15.91:6789/0 conn(0x7f17200d0690 legacy=0x7f17200cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 -- 172.21.15.40:0/997323627 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200d1ce0 con 0x7f17200b4990 2023-11-04T01:43:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171f7fe640 1 --2- 172.21.15.40:0/997323627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200b4990 0x7f17200b4d70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f172008c3b0 tx=0x7f171001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e554834289b8682 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.830+0000 7f171effd640 1 -- 172.21.15.40:0/997323627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100a89b0 con 0x7f17200b4990 2023-11-04T01:43:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171effd640 1 -- 172.21.15.40:0/997323627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17100a8b10 con 0x7f17200b4990 2023-11-04T01:43:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171effd640 1 -- 172.21.15.40:0/997323627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100a8ea0 con 0x7f17200b4990 2023-11-04T01:43:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/997323627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200b4990 msgr2=0x7f17200b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 --2- 172.21.15.40:0/997323627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200b4990 0x7f17200b4d70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f172008c3b0 tx=0x7f171001ecb0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/997323627 shutdown_connections 2023-11-04T01:43:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 --2- 172.21.15.40:0/997323627 >> v2:172.21.15.91:3300/0 conn(0x7f17200b74f0 0x7f17200cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 --2- 172.21.15.40:0/997323627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200b4990 0x7f17200b4d70 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/997323627 >> 172.21.15.40:0/997323627 conn(0x7f17200cf990 msgr2=0x7f17200cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/997323627 shutdown_connections 2023-11-04T01:43:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/997323627 wait complete. 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 Processor -- start 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- start start 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17200b4990 0x7f1720150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17200b74f0 0x7f17201f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 0x7f17201f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172015ee80 con 0x7f17200d0690 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200cb320 con 0x7f17200b74f0 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1720157a60 con 0x7f17200b4990 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 0x7f17201f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 0x7f17201f6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44622/0 (socket says 172.21.15.40:44622) 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 -- 172.21.15.40:0/2625979269 learned_addr learned my addr 172.21.15.40:0/2625979269 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1717fff640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17200b74f0 0x7f17201f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171f7fe640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17200b4990 0x7f1720150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 -- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17200b4990 msgr2=0x7f1720150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17200b4990 0x7f1720150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 -- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17200b74f0 msgr2=0x7f17201f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17200b74f0 0x7f17201f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 -- 172.21.15.40:0/2625979269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100094d0 con 0x7f17200d0690 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171f7fe640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17200b4990 0x7f1720150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171ffff640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 0x7f17201f6920 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f171800b9e0 tx=0x7f171800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800cb20 con 0x7f17200d0690 2023-11-04T01:43:00.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800cca0 con 0x7f17200d0690 2023-11-04T01:43:00.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718014680 con 0x7f17200d0690 2023-11-04T01:43:00.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17200ca9f0 con 0x7f17200d0690 2023-11-04T01:43:00.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.834+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17200cafb0 con 0x7f17200d0690 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.838+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17200cb4d0 con 0x7f17200d0690 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.838+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f171801d3b0 con 0x7f17200d0690 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.838+0000 7f171cff9640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17000664a0 0x7f1700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.838+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f17180841e0 con 0x7f17200d0690 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.838+0000 7f171f7fe640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17000664a0 0x7f1700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.838+0000 7f171f7fe640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17000664a0 0x7f1700068960 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f17100b2000 tx=0x7f1710008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:00.842+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17200cb4d0 con 0x7f17200d0690 2023-11-04T01:43:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.022+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17200d1f90 con 0x7f17200d0690 2023-11-04T01:43:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.022+0000 7f171cff9640 1 -- 172.21.15.40:0/2625979269 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f1718051220 con 0x7f17200d0690 2023-11-04T01:43:01.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:01.029 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:43.012180+0000","modified":"2023-11-04T01:42:54.358226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6645},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6645":{"gid":6645,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/3469878458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3469878458},{"type":"v1","addr":"172.21.15.91:6837","nonce":3469878458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2023-11-04T01:43:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17000664a0 msgr2=0x7f1700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17000664a0 0x7f1700068960 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f17100b2000 tx=0x7f1710008040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 msgr2=0x7f17201f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 0x7f17201f6920 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f171800b9e0 tx=0x7f171800bea0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 shutdown_connections 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17000664a0 0x7f1700068960 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17200d0690 0x7f17201f6920 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17200b74f0 0x7f17201f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 --2- 172.21.15.40:0/2625979269 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17200b4990 0x7f1720150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 >> 172.21.15.40:0/2625979269 conn(0x7f17200cf990 msgr2=0x7f17200b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 shutdown_connections 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.026+0000 7f1726046640 1 -- 172.21.15.40:0/2625979269 wait complete. 2023-11-04T01:43:01.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.158+0000 7f49c9f6b640 1 Processor -- start 2023-11-04T01:43:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.158+0000 7f49c9f6b640 1 -- start start 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c9f6b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c9f6b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49c40b0d40 0x7f49c415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c9f6b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40c2670 con 0x7f49c406f8f0 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c9f6b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c4070140 con 0x7f49c40b0d40 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c9f6b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c406c9f0 con 0x7f49c415afd0 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49c40b0d40 0x7f49c415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f49c40b0d40 0x7f49c415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:52972/0 (socket says 172.21.15.40:52972) 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:51242/0 (socket says 172.21.15.40:51242) 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c3fff640 1 -- 172.21.15.40:0/1911209019 learned_addr learned my addr 172.21.15.40:0/1911209019 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 -- 172.21.15.40:0/1911209019 >> v2:172.21.15.91:3300/0 conn(0x7f49c40b0d40 msgr2=0x7f49c415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 --2- 172.21.15.40:0/1911209019 >> v2:172.21.15.91:3300/0 conn(0x7f49c40b0d40 0x7f49c415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 -- 172.21.15.40:0/1911209019 >> v1:172.21.15.91:6789/0 conn(0x7f49c406f8f0 legacy=0x7f49c40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 -- 172.21.15.40:0/1911209019 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c406bc30 con 0x7f49c415afd0 2023-11-04T01:43:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c37fe640 1 --2- 172.21.15.40:0/1911209019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40715d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009d90 tx=0x7f49b401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d1b1c182938c338 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c27fc640 1 -- 172.21.15.40:0/1911209019 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40a59e0 con 0x7f49c415afd0 2023-11-04T01:43:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c27fc640 1 -- 172.21.15.40:0/1911209019 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40a5b40 con 0x7f49c415afd0 2023-11-04T01:43:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.162+0000 7f49c27fc640 1 -- 172.21.15.40:0/1911209019 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ad440 con 0x7f49c415afd0 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/1911209019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 msgr2=0x7f49c40715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/1911209019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40715d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009d90 tx=0x7f49b401c920 comp rx=0 tx=0).stop 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/1911209019 shutdown_connections 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/1911209019 >> v2:172.21.15.91:3300/0 conn(0x7f49c40b0d40 0x7f49c415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/1911209019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40715d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/1911209019 >> 172.21.15.40:0/1911209019 conn(0x7f49c40cebb0 msgr2=0x7f49c40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/1911209019 shutdown_connections 2023-11-04T01:43:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/1911209019 wait complete. 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 Processor -- start 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- start start 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 0x7f49c40b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c40b0d40 0x7f49c4152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c415d470 con 0x7f49c406f8f0 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b2490 con 0x7f49c40b0d40 2023-11-04T01:43:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c415c7f0 con 0x7f49c415afd0 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 0x7f49c40b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 0x7f49c40b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44632/0 (socket says 172.21.15.40:44632) 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 -- 172.21.15.40:0/2254678412 learned_addr learned my addr 172.21.15.40:0/2254678412 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c3fff640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c2ffd640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c40b0d40 0x7f49c4152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 -- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 msgr2=0x7f49c40ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 -- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c40b0d40 msgr2=0x7f49c4152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c40b0d40 0x7f49c4152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 -- 172.21.15.40:0/2254678412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009a70 con 0x7f49c406f8f0 2023-11-04T01:43:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c3fff640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c37fe640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 0x7f49c40b1f50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f49b401a550 tx=0x7f49b40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4009450 con 0x7f49c406f8f0 2023-11-04T01:43:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40adbd0 con 0x7f49c406f8f0 2023-11-04T01:43:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c415cad0 con 0x7f49c406f8f0 2023-11-04T01:43:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40b8420 con 0x7f49c406f8f0 2023-11-04T01:43:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c415d090 con 0x7f49c406f8f0 2023-11-04T01:43:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.166+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4068310 con 0x7f49c406f8f0 2023-11-04T01:43:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.170+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49b40b8580 con 0x7f49c406f8f0 2023-11-04T01:43:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.170+0000 7f49abfff640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49b00664a0 0x7f49b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.170+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f49b411f8b0 con 0x7f49c406f8f0 2023-11-04T01:43:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.170+0000 7f49c2ffd640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49b00664a0 0x7f49b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.170+0000 7f49c2ffd640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49b00664a0 0x7f49b0068960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f49c40ae2e0 tx=0x7f49b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.174+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f49b40ec900 con 0x7f49c406f8f0 2023-11-04T01:43:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.330+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c40744a0 con 0x7f49c406f8f0 2023-11-04T01:43:01.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49abfff640 1 -- 172.21.15.40:0/2254678412 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21696 (secure 0 0 0) 0x7f49b40eff20 con 0x7f49c406f8f0 2023-11-04T01:43:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:01.339 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":79,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:44.675142+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49b00664a0 msgr2=0x7f49b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49b00664a0 0x7f49b0068960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f49c40ae2e0 tx=0x7f49b8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 msgr2=0x7f49c40b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 0x7f49c40b1f50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f49b401a550 tx=0x7f49b40196c0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 shutdown_connections 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f49b00664a0 0x7f49b0068960 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f49c415afd0 0x7f49c40ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f49c40b0d40 0x7f49c4152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 --2- 172.21.15.40:0/2254678412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49c406f8f0 0x7f49c40b1f50 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 >> 172.21.15.40:0/2254678412 conn(0x7f49c40cebb0 msgr2=0x7f49c40cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 shutdown_connections 2023-11-04T01:43:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.334+0000 7f49c9f6b640 1 -- 172.21.15.40:0/2254678412 wait complete. 2023-11-04T01:43:01.359 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:43:01.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:01.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.470+0000 7f1774815640 1 Processor -- start 2023-11-04T01:43:01.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f1774815640 1 -- start start 2023-11-04T01:43:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f1774815640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1770159a50 0x7f17700cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f1774815640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1770159e30 con 0x7f17700ce720 2023-11-04T01:43:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f1774815640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700ccfd0 con 0x7f177006c1a0 2023-11-04T01:43:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f1774815640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700cd2b0 con 0x7f1770159a50 2023-11-04T01:43:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176dd9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f17700ce720 0x7f177006ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48052/0 (socket says 172.21.15.40:48052) 2023-11-04T01:43:01.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176dd9b640 1 -- 172.21.15.40:0/502580132 learned_addr learned my addr 172.21.15.40:0/502580132 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176e59c640 1 --2- 172.21.15.40:0/502580132 >> v2:172.21.15.91:3300/0 conn(0x7f1770159a50 0x7f17700cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210645393 0 0) 0x7f1760001120 con 0x7f17700ce720 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1758004640 con 0x7f17700ce720 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581627199 0 0) 0x7f1758004640 con 0x7f17700ce720 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 >> v2:172.21.15.91:3300/0 conn(0x7f1770159a50 msgr2=0x7f17700cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 --2- 172.21.15.40:0/502580132 >> v2:172.21.15.91:3300/0 conn(0x7f1770159a50 0x7f17700cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 >> v1:172.21.15.91:6789/0 conn(0x7f177006c1a0 legacy=0x7f177006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700cd590 con 0x7f17700ce720 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1760001810 con 0x7f17700ce720 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 >> v1:172.21.15.40:6789/0 conn(0x7f17700ce720 legacy=0x7f177006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1758004a90 0x7f1758004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17580058e0 0x7f1758005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17580062a0 0x7f175800caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700cd2b0 con 0x7f17580062a0 2023-11-04T01:43:01.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175800d150 con 0x7f17580058e0 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175800d310 con 0x7f1758004a90 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176ed9d640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17580062a0 0x7f175800caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176dd9b640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17580058e0 0x7f1758005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176e59c640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1758004a90 0x7f1758004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176ed9d640 1 -- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1758004a90 msgr2=0x7f1758004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176ed9d640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1758004a90 0x7f1758004eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176ed9d640 1 -- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17580058e0 msgr2=0x7f1758005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176ed9d640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17580058e0 0x7f1758005d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176ed9d640 1 -- 172.21.15.40:0/502580132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758004640 con 0x7f17580062a0 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.474+0000 7f176dd9b640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17580058e0 0x7f1758005d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 -- 172.21.15.40:0/502580132 reap_dead start 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17580062a0 0x7f175800caa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f177006dc00 tx=0x7f176801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdb69bdfc8a33d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768003b80 con 0x7f17580062a0 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768003ce0 con 0x7f17580062a0 2023-11-04T01:43:01.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176d59a640 1 -- 172.21.15.40:0/502580132 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768005310 con 0x7f17580062a0 2023-11-04T01:43:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- 172.21.15.40:0/502580132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17580062a0 msgr2=0x7f175800caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17580062a0 0x7f175800caa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f177006dc00 tx=0x7f176801c700 comp rx=0 tx=0).stop 2023-11-04T01:43:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- 172.21.15.40:0/502580132 shutdown_connections 2023-11-04T01:43:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 --2- 172.21.15.40:0/502580132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17580062a0 0x7f175800caa0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- 172.21.15.40:0/502580132 >> 172.21.15.40:0/502580132 conn(0x7f17700cebb0 msgr2=0x7f17700cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- 172.21.15.40:0/502580132 shutdown_connections 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- 172.21.15.40:0/502580132 wait complete. 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 Processor -- start 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- start start 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17580062a0 0x7f17701f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f177015c120 0x7f177015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 0x7f17700b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1770156330 con 0x7f17700b3b70 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177015cae0 con 0x7f177015c120 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f1774815640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17701f3130 con 0x7f17580062a0 2023-11-04T01:43:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 0x7f17700b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 0x7f17700b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44644/0 (socket says 172.21.15.40:44644) 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 -- 172.21.15.40:0/2126455111 learned_addr learned my addr 172.21.15.40:0/2126455111 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176dd9b640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f177015c120 0x7f177015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176e59c640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17580062a0 0x7f17701f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 -- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17580062a0 msgr2=0x7f17701f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17580062a0 0x7f17701f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 -- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f177015c120 msgr2=0x7f177015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f177015c120 0x7f177015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.478+0000 7f176ed9d640 1 -- 172.21.15.40:0/2126455111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17701f2b70 con 0x7f17700b3b70 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f176ed9d640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 0x7f17700b3fd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f176801cfa0 tx=0x7f1758006910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768006d60 con 0x7f17700b3b70 2023-11-04T01:43:01.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768007dc0 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680a86a0 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17701f2e50 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700b4510 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17700744a0 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17680a8800 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f175effd640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1750066490 0x7f1750068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f176811da90 con 0x7f17700b3b70 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f176e59c640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1750066490 0x7f1750068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.482+0000 7f176e59c640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1750066490 0x7f1750068950 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1764009a30 tx=0x7f1764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.486+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17680eab70 con 0x7f17700b3b70 2023-11-04T01:43:01.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.674+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17700b4b30 con 0x7f17700b3b70 2023-11-04T01:43:01.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.674+0000 7f175effd640 1 -- 172.21.15.40:0/2126455111 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f17680ee190 con 0x7f17700b3b70 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:43.012180+0000","modified":"2023-11-04T01:42:54.358226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6645},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6645":{"gid":6645,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/3469878458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3469878458},{"type":"v1","addr":"172.21.15.91:6837","nonce":3469878458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2023-11-04T01:43:01.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1750066490 msgr2=0x7f1750068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1750066490 0x7f1750068950 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1764009a30 tx=0x7f1764008040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 msgr2=0x7f17700b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 0x7f17700b3fd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f176801cfa0 tx=0x7f1758006910 comp rx=0 tx=0).stop 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 shutdown_connections 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1750066490 0x7f1750068950 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17700b3b70 0x7f17700b3fd0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f177015c120 0x7f177015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 --2- 172.21.15.40:0/2126455111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f17580062a0 0x7f17701f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 >> 172.21.15.40:0/2126455111 conn(0x7f17700cebb0 msgr2=0x7f1770155160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 shutdown_connections 2023-11-04T01:43:01.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.678+0000 7f1774815640 1 -- 172.21.15.40:0/2126455111 wait complete. 2023-11-04T01:43:01.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:01.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.814+0000 7f68a40d4640 1 Processor -- start 2023-11-04T01:43:01.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.814+0000 7f68a40d4640 1 -- start start 2023-11-04T01:43:01.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a40d4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f689c0d0690 0x7f689c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a40d4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f689c0d0ae0 0x7f689c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a40d4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c0b6070 con 0x7f689c0b4990 2023-11-04T01:43:01.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a40d4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0b8ed0 con 0x7f689c0d0690 2023-11-04T01:43:01.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a40d4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0d1ce0 con 0x7f689c0d0ae0 2023-11-04T01:43:01.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a1e70640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f689c0b4990 0x7f689c0b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48066/0 (socket says 172.21.15.40:48066) 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a1e70640 1 -- 172.21.15.40:0/2780813804 learned_addr learned my addr 172.21.15.40:0/2780813804 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a166f640 1 --2- 172.21.15.40:0/2780813804 >> v2:172.21.15.40:3300/0 conn(0x7f689c0d0690 0x7f689c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a2671640 1 --2- 172.21.15.40:0/2780813804 >> v2:172.21.15.91:3300/0 conn(0x7f689c0d0ae0 0x7f689c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a0e6e640 1 -- 172.21.15.40:0/2780813804 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206679732 0 0) 0x7f689c0b6070 con 0x7f689c0b4990 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a0e6e640 1 -- 172.21.15.40:0/2780813804 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6888003530 con 0x7f689c0b4990 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a166f640 1 -- 172.21.15.40:0/2780813804 >> v2:172.21.15.91:3300/0 conn(0x7f689c0d0ae0 msgr2=0x7f689c0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a166f640 1 --2- 172.21.15.40:0/2780813804 >> v2:172.21.15.91:3300/0 conn(0x7f689c0d0ae0 0x7f689c0b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a166f640 1 -- 172.21.15.40:0/2780813804 >> v1:172.21.15.40:6789/0 conn(0x7f689c0b4990 legacy=0x7f689c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a166f640 1 -- 172.21.15.40:0/2780813804 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c0d1fc0 con 0x7f689c0d0690 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.818+0000 7f68a2671640 1 --2- 172.21.15.40:0/2780813804 >> v2:172.21.15.91:3300/0 conn(0x7f689c0d0ae0 0x7f689c0b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a166f640 1 --2- 172.21.15.40:0/2780813804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0690 0x7f689c0b64e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f689c067730 tx=0x7f689801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db292b916b4cd3e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a0e6e640 1 -- 172.21.15.40:0/2780813804 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980a8950 con 0x7f689c0d0690 2023-11-04T01:43:01.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a0e6e640 1 -- 172.21.15.40:0/2780813804 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980a8ab0 con 0x7f689c0d0690 2023-11-04T01:43:01.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a0e6e640 1 -- 172.21.15.40:0/2780813804 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980a8e40 con 0x7f689c0d0690 2023-11-04T01:43:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- 172.21.15.40:0/2780813804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0690 msgr2=0x7f689c0b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 --2- 172.21.15.40:0/2780813804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0690 0x7f689c0b64e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f689c067730 tx=0x7f689801ec50 comp rx=0 tx=0).stop 2023-11-04T01:43:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- 172.21.15.40:0/2780813804 shutdown_connections 2023-11-04T01:43:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 --2- 172.21.15.40:0/2780813804 >> v2:172.21.15.91:3300/0 conn(0x7f689c0d0ae0 0x7f689c0b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 --2- 172.21.15.40:0/2780813804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0690 0x7f689c0b64e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- 172.21.15.40:0/2780813804 >> 172.21.15.40:0/2780813804 conn(0x7f689c0cf990 msgr2=0x7f689c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- 172.21.15.40:0/2780813804 shutdown_connections 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- 172.21.15.40:0/2780813804 wait complete. 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 Processor -- start 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- start start 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f689c0b4990 0x7f689c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f689c0d0690 0x7f689c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 0x7f689c1f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c15fe10 con 0x7f689c0d0ae0 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c1584b0 con 0x7f689c0d0690 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a40d4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c158790 con 0x7f689c0b4990 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 0x7f689c1f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 0x7f689c1f3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44660/0 (socket says 172.21.15.40:44660) 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 -- 172.21.15.40:0/1770826481 learned_addr learned my addr 172.21.15.40:0/1770826481 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a166f640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f689c0d0690 0x7f689c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a1e70640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f689c0b4990 0x7f689c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 -- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f689c0b4990 msgr2=0x7f689c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f689c0b4990 0x7f689c15f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 -- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f689c0d0690 msgr2=0x7f689c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f689c0d0690 0x7f689c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.822+0000 7f68a2671640 1 -- 172.21.15.40:0/1770826481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898009420 con 0x7f689c0d0ae0 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a166f640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f689c0d0690 0x7f689c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a2671640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 0x7f689c1f3d80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f689400cea0 tx=0x7f689400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894003ba0 con 0x7f689c0d0ae0 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894003d20 con 0x7f689c0d0ae0 2023-11-04T01:43:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c158a70 con 0x7f689c0d0ae0 2023-11-04T01:43:01.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400d880 con 0x7f689c0d0ae0 2023-11-04T01:43:01.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c15d850 con 0x7f689c0d0ae0 2023-11-04T01:43:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c15da40 con 0x7f689c0d0ae0 2023-11-04T01:43:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f689400d9e0 con 0x7f689c0d0ae0 2023-11-04T01:43:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68927fc640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f6894084be0 con 0x7f689c0d0ae0 2023-11-04T01:43:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a1e70640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.826+0000 7f68a1e70640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f688c0011f0 tx=0x7f688c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:01.830+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6894051c30 con 0x7f689c0d0ae0 2023-11-04T01:43:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.018+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f689c0744a0 con 0x7f689c0d0ae0 2023-11-04T01:43:02.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68927fc640 1 -- 172.21.15.40:0/1770826481 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f6894055250 con 0x7f689c0d0ae0 2023-11-04T01:43:02.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:02.031 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:43.012180+0000","modified":"2023-11-04T01:42:54.358226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6645},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6645":{"gid":6645,"name":"d","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.91:6837/3469878458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3469878458},{"type":"v1","addr":"172.21.15.91:6837","nonce":3469878458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 39 2023-11-04T01:43:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 msgr2=0x7f6880068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f688c0011f0 tx=0x7f688c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 msgr2=0x7f689c1f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 0x7f689c1f3d80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f689400cea0 tx=0x7f689400cf90 comp rx=0 tx=0).stop 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 shutdown_connections 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68800664a0 0x7f6880068960 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f689c0d0ae0 0x7f689c1f3d80 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f689c0d0690 0x7f689c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 --2- 172.21.15.40:0/1770826481 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f689c0b4990 0x7f689c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 >> 172.21.15.40:0/1770826481 conn(0x7f689c0cf990 msgr2=0x7f689c15b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 shutdown_connections 2023-11-04T01:43:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.026+0000 7f68a40d4640 1 -- 172.21.15.40:0/1770826481 wait complete. 2023-11-04T01:43:02.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 Processor -- start 2023-11-04T01:43:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 -- start start 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbeac15afd0 0x7fbeac0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbeac0b0d40 0x7fbeac15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac0c2670 con 0x7fbeac06f8f0 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac070140 con 0x7fbeac0b0d40 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.162+0000 7fbeb1099640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac06c9f0 con 0x7fbeac15afd0 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbeac0b0d40 0x7fbeac15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeaa59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbeac06f8f0 0x7fbeac0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48082/0 (socket says 172.21.15.40:48082) 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbeac0b0d40 0x7fbeac15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44666/0 (socket says 172.21.15.40:44666) 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeaa59c640 1 -- 172.21.15.40:0/3393806232 learned_addr learned my addr 172.21.15.40:0/3393806232 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeaad9d640 1 --2- 172.21.15.40:0/3393806232 >> v2:172.21.15.91:3300/0 conn(0x7fbeac15afd0 0x7fbeac0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 -- 172.21.15.40:0/3393806232 >> v2:172.21.15.91:3300/0 conn(0x7fbeac15afd0 msgr2=0x7fbeac0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 --2- 172.21.15.40:0/3393806232 >> v2:172.21.15.91:3300/0 conn(0x7fbeac15afd0 0x7fbeac0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 -- 172.21.15.40:0/3393806232 >> v1:172.21.15.40:6789/0 conn(0x7fbeac06f8f0 legacy=0x7fbeac0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbea9d9b640 1 -- 172.21.15.40:0/3393806232 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979756675 0 0) 0x7fbeac0c2670 con 0x7fbeac06f8f0 2023-11-04T01:43:02.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 -- 172.21.15.40:0/3393806232 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac06bc30 con 0x7fbeac0b0d40 2023-11-04T01:43:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeab59e640 1 --2- 172.21.15.40:0/3393806232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac15ec80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0ce980 tx=0x7fbea401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef4cd2b57c24b22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbea9d9b640 1 -- 172.21.15.40:0/3393806232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40a59a0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbea9d9b640 1 -- 172.21.15.40:0/3393806232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea40a5b00 con 0x7fbeac0b0d40 2023-11-04T01:43:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbea9d9b640 1 -- 172.21.15.40:0/3393806232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40a5e90 con 0x7fbeac0b0d40 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 -- 172.21.15.40:0/3393806232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 msgr2=0x7fbeac15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 --2- 172.21.15.40:0/3393806232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac15ec80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0ce980 tx=0x7fbea401c8e0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 -- 172.21.15.40:0/3393806232 shutdown_connections 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 --2- 172.21.15.40:0/3393806232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac15ec80 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 --2- 172.21.15.40:0/3393806232 >> v2:172.21.15.91:3300/0 conn(0x7fbeac15afd0 0x7fbeac0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 -- 172.21.15.40:0/3393806232 >> 172.21.15.40:0/3393806232 conn(0x7fbeac0cebb0 msgr2=0x7fbeac0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 -- 172.21.15.40:0/3393806232 shutdown_connections 2023-11-04T01:43:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.166+0000 7fbeb1099640 1 -- 172.21.15.40:0/3393806232 wait complete. 2023-11-04T01:43:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 Processor -- start 2023-11-04T01:43:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- start start 2023-11-04T01:43:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbeac06f8f0 0x7fbeac15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbeac15afd0 0x7fbeac1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac158f20 con 0x7fbeac0b0d40 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac15bcc0 con 0x7fbeac06f8f0 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac1585f0 con 0x7fbeac15afd0 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac14cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44670/0 (socket says 172.21.15.40:44670) 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 -- 172.21.15.40:0/2953757249 learned_addr learned my addr 172.21.15.40:0/2953757249 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaad9d640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbeac06f8f0 0x7fbeac15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeab59e640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbeac15afd0 0x7fbeac1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 -- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbeac15afd0 msgr2=0x7fbeac1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbeac15afd0 0x7fbeac1521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 -- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbeac06f8f0 msgr2=0x7fbeac15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbeac06f8f0 0x7fbeac15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 -- 172.21.15.40:0/2953757249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009a70 con 0x7fbeac0b0d40 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeaa59c640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac14cc50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fbea00011f0 tx=0x7fbea000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea00074e0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0007640 con 0x7fbeac0b0d40 2023-11-04T01:43:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0004a10 con 0x7fbeac0b0d40 2023-11-04T01:43:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac1588d0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac1535a0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.170+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac0744a0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.174+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbea0004b70 con 0x7fbeac0b0d40 2023-11-04T01:43:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.174+0000 7fbe937fe640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe980664a0 0x7fbe98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.174+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fbea0083610 con 0x7fbeac0b0d40 2023-11-04T01:43:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.174+0000 7fbeaad9d640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe980664a0 0x7fbe98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.174+0000 7fbeaad9d640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe980664a0 0x7fbe98068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0b12d0 tx=0x7fbe9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.178+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbea00505c0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.334+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbeac06cba0 con 0x7fbeac0b0d40 2023-11-04T01:43:02.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbe937fe640 1 -- 172.21.15.40:0/2953757249 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21696 (secure 0 0 0) 0x7fbea0018090 con 0x7fbeac0b0d40 2023-11-04T01:43:02.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:02.343 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":79,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:42:44.675142+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:41.165148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:42.005968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe980664a0 msgr2=0x7fbe98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe980664a0 0x7fbe98068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0b12d0 tx=0x7fbe9c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 msgr2=0x7fbeac14cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac14cc50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fbea00011f0 tx=0x7fbea000c9b0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 shutdown_connections 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe980664a0 0x7fbe98068960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbeac15afd0 0x7fbeac1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0b0d40 0x7fbeac14cc50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 --2- 172.21.15.40:0/2953757249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbeac06f8f0 0x7fbeac15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 >> 172.21.15.40:0/2953757249 conn(0x7fbeac0cebb0 msgr2=0x7fbeac0c3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 shutdown_connections 2023-11-04T01:43:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.338+0000 7fbeb1099640 1 -- 172.21.15.40:0/2953757249 wait complete. 2023-11-04T01:43:02.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:43:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 Processor -- start 2023-11-04T01:43:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 -- start start 2023-11-04T01:43:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f312415b290 0x7f312406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f31240b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312406c740 con 0x7f312406fe30 2023-11-04T01:43:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312415b670 con 0x7f312415b290 2023-11-04T01:43:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f312a04b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312406bb30 con 0x7f31240c2670 2023-11-04T01:43:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f31237fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f312415b290 0x7f312406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3123fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f312406fe30 0x7f31240c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:54660/0 (socket says 172.21.15.40:54660) 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f31237fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f312415b290 0x7f312406f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:53070/0 (socket says 172.21.15.40:53070) 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3122ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f31240b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3123fff640 1 -- 172.21.15.40:0/2608390497 learned_addr learned my addr 172.21.15.40:0/2608390497 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3122ffd640 1 -- 172.21.15.40:0/2608390497 >> v2:172.21.15.91:3300/0 conn(0x7f312415b290 msgr2=0x7f312406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3122ffd640 1 --2- 172.21.15.40:0/2608390497 >> v2:172.21.15.91:3300/0 conn(0x7f312415b290 0x7f312406f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3122ffd640 1 -- 172.21.15.40:0/2608390497 >> v1:172.21.15.91:6789/0 conn(0x7f312406fe30 legacy=0x7f31240c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.478+0000 7f3122ffd640 1 -- 172.21.15.40:0/2608390497 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312406be10 con 0x7f31240c2670 2023-11-04T01:43:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f3122ffd640 1 --2- 172.21.15.40:0/2608390497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f31240b0630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31180097c0 tx=0x7f311801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26353f22cab391f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f31227fc640 1 -- 172.21.15.40:0/2608390497 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31180ab600 con 0x7f31240c2670 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f31227fc640 1 -- 172.21.15.40:0/2608390497 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31180a7050 con 0x7f31240c2670 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f31227fc640 1 -- 172.21.15.40:0/2608390497 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31180ab980 con 0x7f31240c2670 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 -- 172.21.15.40:0/2608390497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 msgr2=0x7f31240b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 --2- 172.21.15.40:0/2608390497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f31240b0630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31180097c0 tx=0x7f311801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 -- 172.21.15.40:0/2608390497 shutdown_connections 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 --2- 172.21.15.40:0/2608390497 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f31240b0630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 --2- 172.21.15.40:0/2608390497 >> v2:172.21.15.91:3300/0 conn(0x7f312415b290 0x7f312406f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 -- 172.21.15.40:0/2608390497 >> 172.21.15.40:0/2608390497 conn(0x7f31240cebb0 msgr2=0x7f31240cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 -- 172.21.15.40:0/2608390497 shutdown_connections 2023-11-04T01:43:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 -- 172.21.15.40:0/2608390497 wait complete. 2023-11-04T01:43:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 Processor -- start 2023-11-04T01:43:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.482+0000 7f312a04b640 1 -- start start 2023-11-04T01:43:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312406fe30 0x7f3124159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f3124158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 0x7f31240c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124152f20 con 0x7f312415b290 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124159190 con 0x7f312406fe30 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3124159430 con 0x7f31240c2670 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 0x7f31240c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 0x7f31240c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44684/0 (socket says 172.21.15.40:44684) 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 -- 172.21.15.40:0/3450814237 learned_addr learned my addr 172.21.15.40:0/3450814237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f31237fe640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312406fe30 0x7f3124159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3122ffd640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f3124158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 -- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 msgr2=0x7f3124158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f3124158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 -- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312406fe30 msgr2=0x7f3124159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312406fe30 0x7f3124159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 -- 172.21.15.40:0/3450814237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118009420 con 0x7f312415b290 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f3123fff640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 0x7f31240c90b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f311c00cbc0 tx=0x7f311c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c00ad40 con 0x7f312415b290 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c012400 con 0x7f312415b290 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31241528d0 con 0x7f312415b290 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c00aea0 con 0x7f312415b290 2023-11-04T01:43:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31240c95f0 con 0x7f312415b290 2023-11-04T01:43:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31240744a0 con 0x7f312415b290 2023-11-04T01:43:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f311c007070 con 0x7f312415b290 2023-11-04T01:43:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f310bfff640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31100664d0 0x7f3110068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f311c0840c0 con 0x7f312415b290 2023-11-04T01:43:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.486+0000 7f31237fe640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31100664d0 0x7f3110068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.490+0000 7f31237fe640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31100664d0 0x7f3110068990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3114009ac0 tx=0x7f3114009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.490+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f311c0511c0 con 0x7f312415b290 2023-11-04T01:43:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.682+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f31240718c0 con 0x7f312415b290 2023-11-04T01:43:02.688 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:43:02.682+0000 7fde30135640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:43:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f310bfff640 1 -- 172.21.15.40:0/3450814237 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f311c0547e0 con 0x7f312415b290 2023-11-04T01:43:02.691 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:43:02.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31100664d0 msgr2=0x7f3110068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31100664d0 0x7f3110068990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3114009ac0 tx=0x7f3114009190 comp rx=0 tx=0).stop 2023-11-04T01:43:02.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 msgr2=0x7f31240c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 0x7f31240c90b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f311c00cbc0 tx=0x7f311c00a430 comp rx=0 tx=0).stop 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 shutdown_connections 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31100664d0 0x7f3110068990 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312415b290 0x7f31240c90b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31240c2670 0x7f3124158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 --2- 172.21.15.40:0/3450814237 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f312406fe30 0x7f3124159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 >> 172.21.15.40:0/3450814237 conn(0x7f31240cebb0 msgr2=0x7f31240af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 shutdown_connections 2023-11-04T01:43:02.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.686+0000 7f312a04b640 1 -- 172.21.15.40:0/3450814237 wait complete. 2023-11-04T01:43:02.705 INFO:tasks.ceph.mds.d.smithi091.stderr: -2813> 2023-11-04T01:42:47.614+0000 7f4ad8d14640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:02.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:43:02.776 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:43:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.838+0000 7fe8d81d8640 1 Processor -- start 2023-11-04T01:43:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.838+0000 7fe8d81d8640 1 -- start start 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.838+0000 7fe8d81d8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8d015d0b0 0x7fe8d0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d00b5e00 con 0x7fe8d00cff20 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d015d490 con 0x7fe8d01610f0 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00d1520 con 0x7fe8d015d0b0 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d5f74640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8d015d0b0 0x7fe8d0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d6775640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe8d00cff20 0x7fe8d00d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48092/0 (socket says 172.21.15.40:48092) 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d6775640 1 -- 172.21.15.40:0/3748483821 learned_addr learned my addr 172.21.15.40:0/3748483821 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d5f74640 1 -- 172.21.15.40:0/3748483821 >> v1:172.21.15.91:6789/0 conn(0x7fe8d01610f0 legacy=0x7fe8d00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d5f74640 1 -- 172.21.15.40:0/3748483821 >> v1:172.21.15.40:6789/0 conn(0x7fe8d00cff20 legacy=0x7fe8d00d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d5f74640 1 -- 172.21.15.40:0/3748483821 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00b8930 con 0x7fe8d015d0b0 2023-11-04T01:43:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d4f72640 1 -- 172.21.15.40:0/3748483821 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351511753 0 0) 0x7fe8d00b5e00 con 0x7fe8d00cff20 2023-11-04T01:43:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d5f74640 1 --2- 172.21.15.40:0/3748483821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d0160bb0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00097c0 tx=0x7fe8c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310227f74513e99d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d4f72640 1 -- 172.21.15.40:0/3748483821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00ab640 con 0x7fe8d015d0b0 2023-11-04T01:43:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d4f72640 1 -- 172.21.15.40:0/3748483821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c00a7070 con 0x7fe8d015d0b0 2023-11-04T01:43:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d4f72640 1 -- 172.21.15.40:0/3748483821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00ab9c0 con 0x7fe8d015d0b0 2023-11-04T01:43:02.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- 172.21.15.40:0/3748483821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 msgr2=0x7fe8d0160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/3748483821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d0160bb0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00097c0 tx=0x7fe8c001c440 comp rx=0 tx=0).stop 2023-11-04T01:43:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- 172.21.15.40:0/3748483821 shutdown_connections 2023-11-04T01:43:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/3748483821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d0160bb0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- 172.21.15.40:0/3748483821 >> 172.21.15.40:0/3748483821 conn(0x7fe8d006a890 msgr2=0x7fe8d006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- 172.21.15.40:0/3748483821 shutdown_connections 2023-11-04T01:43:02.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.842+0000 7fe8d81d8640 1 -- 172.21.15.40:0/3748483821 wait complete. 2023-11-04T01:43:02.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 Processor -- start 2023-11-04T01:43:02.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- start start 2023-11-04T01:43:02.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8d00cff20 0x7fe8d0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe8d01610f0 0x7fe8d015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b29d0 con 0x7fe8d015d0b0 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b2c70 con 0x7fe8d00cff20 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00b2f50 con 0x7fe8d01610f0 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d015d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44712/0 (socket says 172.21.15.40:44712) 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 -- 172.21.15.40:0/1010841724 learned_addr learned my addr 172.21.15.40:0/1010841724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5f74640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8d00cff20 0x7fe8d0156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d6775640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe8d01610f0 0x7fe8d015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 -- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe8d01610f0 msgr2=0x7fe8d015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe8d01610f0 0x7fe8d015dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 -- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8d00cff20 msgr2=0x7fe8d0156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8d00cff20 0x7fe8d0156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 -- 172.21.15.40:0/1010841724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0009420 con 0x7fe8d015d0b0 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d6775640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe8d01610f0 0x7fe8d015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5f74640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8d00cff20 0x7fe8d0156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d5773640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d015d7b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400ba50 tx=0x7fe8c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400cbe0 con 0x7fe8d015d0b0 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c400cd80 con 0x7fe8d015d0b0 2023-11-04T01:43:02.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4014680 con 0x7fe8d015d0b0 2023-11-04T01:43:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d00b3230 con 0x7fe8d015d0b0 2023-11-04T01:43:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0157140 con 0x7fe8d015d0b0 2023-11-04T01:43:02.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.846+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d006b710 con 0x7fe8d015d0b0 2023-11-04T01:43:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.850+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8c40147e0 con 0x7fe8d015d0b0 2023-11-04T01:43:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.850+0000 7fe8ce7fc640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe8bc0664a0 0x7fe8bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.850+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6914+0+0 (secure 0 0 0) 0x7fe8c40841e0 con 0x7fe8d015d0b0 2023-11-04T01:43:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.850+0000 7fe8d5f74640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe8bc0664a0 0x7fe8bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.850+0000 7fe8d5f74640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe8bc0664a0 0x7fe8bc068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00af000 tx=0x7fe8c00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:02.854+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8c4051240 con 0x7fe8d015d0b0 2023-11-04T01:43:03.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.050+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe8d00744a0 con 0x7fe8d015d0b0 2023-11-04T01:43:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.690+0000 7fe8ce7fc640 1 -- 172.21.15.40:0/1010841724 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe8c4054860 con 0x7fe8d015d0b0 2023-11-04T01:43:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe8bc0664a0 msgr2=0x7fe8bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe8bc0664a0 0x7fe8bc068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00af000 tx=0x7fe8c00a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 msgr2=0x7fe8d015d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d015d7b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400ba50 tx=0x7fe8c400bf10 comp rx=0 tx=0).stop 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 shutdown_connections 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe8bc0664a0 0x7fe8bc068960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe8d01610f0 0x7fe8d015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8d015d0b0 0x7fe8d015d7b0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 --2- 172.21.15.40:0/1010841724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8d00cff20 0x7fe8d0156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 >> 172.21.15.40:0/1010841724 conn(0x7fe8d006a890 msgr2=0x7fe8d00cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 shutdown_connections 2023-11-04T01:43:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.694+0000 7fe8d81d8640 1 -- 172.21.15.40:0/1010841724 wait complete. 2023-11-04T01:43:03.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:43:03.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 Processor -- start 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 -- start start 2023-11-04T01:43:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4240ca440 0x7fa42415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa42406b320 0x7fa42406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4240cb220 con 0x7fa42415ae60 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42415ea00 con 0x7fa4240ca440 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42b8e0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42415b240 con 0x7fa42406b320 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42967c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa42415ae60 0x7fa4240cab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48094/0 (socket says 172.21.15.40:48094) 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.850+0000 7fa42967c640 1 -- 172.21.15.40:0/1013491827 learned_addr learned my addr 172.21.15.40:0/1013491827 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa428e7b640 1 --2- 172.21.15.40:0/1013491827 >> v2:172.21.15.40:3300/0 conn(0x7fa4240ca440 0x7fa42415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa429e7d640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa42406b320 0x7fa42406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa41bfff640 1 -- 172.21.15.40:0/1013491827 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693549547 0 0) 0x7fa420001120 con 0x7fa42415ae60 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa41bfff640 1 -- 172.21.15.40:0/1013491827 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa410003530 con 0x7fa42415ae60 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa428e7b640 1 -- 172.21.15.40:0/1013491827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa42406b320 msgr2=0x7fa42406b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa428e7b640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa42406b320 0x7fa42406b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa428e7b640 1 -- 172.21.15.40:0/1013491827 >> v1:172.21.15.40:6789/0 conn(0x7fa42415ae60 legacy=0x7fa4240cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa428e7b640 1 -- 172.21.15.40:0/1013491827 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42406cda0 con 0x7fa4240ca440 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa429e7d640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa42406b320 0x7fa42406b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa428e7b640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4240ca440 0x7fa42415f190 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097c0 tx=0x7fa41401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5424d0e92aed55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa41bfff640 1 -- 172.21.15.40:0/1013491827 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140ab650 con 0x7fa4240ca440 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa41bfff640 1 -- 172.21.15.40:0/1013491827 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4140ab7b0 con 0x7fa4240ca440 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa41bfff640 1 -- 172.21.15.40:0/1013491827 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140abb40 con 0x7fa4240ca440 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa42b8e0640 1 -- 172.21.15.40:0/1013491827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4240ca440 msgr2=0x7fa42415f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.854+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4240ca440 0x7fa42415f190 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097c0 tx=0x7fa41401c450 comp rx=0 tx=0).stop 2023-11-04T01:43:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- 172.21.15.40:0/1013491827 shutdown_connections 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa42406b320 0x7fa42406b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/1013491827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4240ca440 0x7fa42415f190 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- 172.21.15.40:0/1013491827 >> 172.21.15.40:0/1013491827 conn(0x7fa4240b0630 msgr2=0x7fa4240b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- 172.21.15.40:0/1013491827 shutdown_connections 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- 172.21.15.40:0/1013491827 wait complete. 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 Processor -- start 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- start start 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42406b320 0x7fa4240b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4240ca440 0x7fa4240ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 0x7fa4241f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240b2bd0 con 0x7fa42415ae60 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240cd480 con 0x7fa42406b320 2023-11-04T01:43:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240cd720 con 0x7fa4240ca440 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 0x7fa4241f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 0x7fa4241f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44734/0 (socket says 172.21.15.40:44734) 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 -- 172.21.15.40:0/2462661123 learned_addr learned my addr 172.21.15.40:0/2462661123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42967c640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42406b320 0x7fa4240b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa428e7b640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4240ca440 0x7fa4240ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 -- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4240ca440 msgr2=0x7fa4240ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4240ca440 0x7fa4240ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 -- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42406b320 msgr2=0x7fa4240b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42406b320 0x7fa4240b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 -- 172.21.15.40:0/2462661123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa414009420 con 0x7fa42415ae60 2023-11-04T01:43:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa429e7d640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 0x7fa4241f8d00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa41c007df0 tx=0x7fa41c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0039a0 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00f040 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4240cda00 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c003d40 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.858+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4240cdfc0 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.862+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4240744a0 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.862+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa41c004030 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.862+0000 7fa419ffb640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4080664d0 0x7fa408068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.862+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6914+0+0 (secure 0 0 0) 0x7fa41c084610 con 0x7fa42415ae60 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.862+0000 7fa42967c640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4080664d0 0x7fa408068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.862+0000 7fa42967c640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4080664d0 0x7fa408068990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa420001280 tx=0x7fa420009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:03.866+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa41c0515b0 con 0x7fa42415ae60 2023-11-04T01:43:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.026+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa42406c8b0 con 0x7fa42415ae60 2023-11-04T01:43:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.698+0000 7fa419ffb640 1 -- 172.21.15.40:0/2462661123 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa41c054bd0 con 0x7fa42415ae60 2023-11-04T01:43:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:43:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4080664d0 msgr2=0x7fa408068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4080664d0 0x7fa408068990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa420001280 tx=0x7fa420009040 comp rx=0 tx=0).stop 2023-11-04T01:43:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 msgr2=0x7fa4241f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 0x7fa4241f8d00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa41c007df0 tx=0x7fa41c00d4a0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 shutdown_connections 2023-11-04T01:43:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa4080664d0 0x7fa408068990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa42415ae60 0x7fa4241f8d00 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa4240ca440 0x7fa4240ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 --2- 172.21.15.40:0/2462661123 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa42406b320 0x7fa4240b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 >> 172.21.15.40:0/2462661123 conn(0x7fa4240b0630 msgr2=0x7fa4240cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 shutdown_connections 2023-11-04T01:43:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.702+0000 7fa42b8e0640 1 -- 172.21.15.40:0/2462661123 wait complete. 2023-11-04T01:43:04.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:43:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.862+0000 7fdddc025640 1 Processor -- start 2023-11-04T01:43:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.862+0000 7fdddc025640 1 -- start start 2023-11-04T01:43:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fdddc025640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fddd40cae40 0x7fddd40cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fdddc025640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd40cb300 0x7fddd415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fdddc025640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40b2e20 con 0x7fddd415b2c0 2023-11-04T01:43:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fdddc025640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40ce0a0 con 0x7fddd40cae40 2023-11-04T01:43:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fdddc025640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40cd190 con 0x7fddd40cb300 2023-11-04T01:43:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd9dc1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fddd415b2c0 0x7fddd40cd450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48100/0 (socket says 172.21.15.40:48100) 2023-11-04T01:43:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd9dc1640 1 -- 172.21.15.40:0/4021627734 learned_addr learned my addr 172.21.15.40:0/4021627734 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddda5c2640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd40cb300 0x7fddd415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd95c0640 1 --2- 172.21.15.40:0/4021627734 >> v2:172.21.15.91:3300/0 conn(0x7fddd40cae40 0x7fddd40cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd8dbf640 1 -- 172.21.15.40:0/4021627734 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796654536 0 0) 0x7fddd40b2e20 con 0x7fddd415b2c0 2023-11-04T01:43:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd8dbf640 1 -- 172.21.15.40:0/4021627734 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc0003530 con 0x7fddd415b2c0 2023-11-04T01:43:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd8dbf640 1 -- 172.21.15.40:0/4021627734 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279651887 0 0) 0x7fddc0003530 con 0x7fddd415b2c0 2023-11-04T01:43:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd95c0640 1 -- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd40cb300 msgr2=0x7fddd415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd95c0640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd40cb300 0x7fddd415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd95c0640 1 -- 172.21.15.40:0/4021627734 >> v1:172.21.15.40:6789/0 conn(0x7fddd415b2c0 legacy=0x7fddd40cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddd95c0640 1 -- 172.21.15.40:0/4021627734 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40b27d0 con 0x7fddd40cae40 2023-11-04T01:43:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.866+0000 7fddda5c2640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd40cb300 0x7fddd415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fddd95c0640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd40cae40 0x7fddd40cdb60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097c0 tx=0x7fddc401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f943e2cdcab51a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fddd8dbf640 1 -- 172.21.15.40:0/4021627734 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40ccf90 con 0x7fddd40cae40 2023-11-04T01:43:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fddd8dbf640 1 -- 172.21.15.40:0/4021627734 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40a7050 con 0x7fddd40cae40 2023-11-04T01:43:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fddd8dbf640 1 -- 172.21.15.40:0/4021627734 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0001680 con 0x7fddd40cae40 2023-11-04T01:43:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd40cae40 msgr2=0x7fddd40cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd40cae40 0x7fddd40cdb60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097c0 tx=0x7fddc401c370 comp rx=0 tx=0).stop 2023-11-04T01:43:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- 172.21.15.40:0/4021627734 shutdown_connections 2023-11-04T01:43:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd40cb300 0x7fddd415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 --2- 172.21.15.40:0/4021627734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd40cae40 0x7fddd40cdb60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- 172.21.15.40:0/4021627734 >> 172.21.15.40:0/4021627734 conn(0x7fddd406dcf0 msgr2=0x7fddd406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- 172.21.15.40:0/4021627734 shutdown_connections 2023-11-04T01:43:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- 172.21.15.40:0/4021627734 wait complete. 2023-11-04T01:43:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 Processor -- start 2023-11-04T01:43:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- start start 2023-11-04T01:43:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 0x7fddd414a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd415b2c0 0x7fddd40b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd41521a0 0x7fddd4159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40c46a0 con 0x7fddd40cb300 2023-11-04T01:43:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd41526f0 con 0x7fddd415b2c0 2023-11-04T01:43:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fdddc025640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd41529d0 con 0x7fddd41521a0 2023-11-04T01:43:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.870+0000 7fddd9dc1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 0x7fddd414a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddda5c2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd41521a0 0x7fddd4159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddda5c2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd41521a0 0x7fddd4159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:51362/0 (socket says 172.21.15.40:51362) 2023-11-04T01:43:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd95c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd415b2c0 0x7fddd40b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddda5c2640 1 -- 172.21.15.40:0/3501015786 learned_addr learned my addr 172.21.15.40:0/3501015786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 0x7fddd414a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44748/0 (socket says 172.21.15.40:44748) 2023-11-04T01:43:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 -- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd41521a0 msgr2=0x7fddd4159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd41521a0 0x7fddd4159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 -- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd415b2c0 msgr2=0x7fddd40b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd415b2c0 0x7fddd40b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 -- 172.21.15.40:0/3501015786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009a70 con 0x7fddd40cb300 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd9dc1640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 0x7fddd414a460 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c550 tx=0x7fddd000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0005cf0 con 0x7fddd40cb300 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd00011e0 con 0x7fddd40cb300 2023-11-04T01:43:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc4009420 con 0x7fddd40cb300 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00072b0 con 0x7fddd40cb300 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4152f90 con 0x7fddd40cb300 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd40675f0 con 0x7fddd40cb300 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fddd0007410 con 0x7fddd40cb300 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddca7fc640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fddb80664a0 0x7fddb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6448+0+0 (secure 0 0 0) 0x7fddd0083650 con 0x7fddd40cb300 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.874+0000 7fddd95c0640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fddb80664a0 0x7fddb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.878+0000 7fddd95c0640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fddb80664a0 0x7fddb8068960 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ad000 tx=0x7fddc40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:04.878+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fddd0050930 con 0x7fddd40cb300 2023-11-04T01:43:05.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.038+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fddd40ce1f0 con 0x7fddd40cb300 2023-11-04T01:43:05.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.702+0000 7fddca7fc640 1 -- 172.21.15.40:0/3501015786 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7fddd00170d0 con 0x7fddd40cb300 2023-11-04T01:43:05.708 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-11-04T01:43:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fddb80664a0 msgr2=0x7fddb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fddb80664a0 0x7fddb8068960 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ad000 tx=0x7fddc40a6000 comp rx=0 tx=0).stop 2023-11-04T01:43:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 msgr2=0x7fddd414a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 0x7fddd414a460 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c550 tx=0x7fddd000ca10 comp rx=0 tx=0).stop 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 shutdown_connections 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fddb80664a0 0x7fddb8068960 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fddd41521a0 0x7fddd4159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fddd415b2c0 0x7fddd40b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 --2- 172.21.15.40:0/3501015786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd40cb300 0x7fddd414a460 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 >> 172.21.15.40:0/3501015786 conn(0x7fddd406dcf0 msgr2=0x7fddd40b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 shutdown_connections 2023-11-04T01:43:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.706+0000 7fdddc025640 1 -- 172.21.15.40:0/3501015786 wait complete. 2023-11-04T01:43:05.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:43:05.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedcbc78640 1 Processor -- start 2023-11-04T01:43:05.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedcbc78640 1 -- start start 2023-11-04T01:43:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedcbc78640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 0x7fedc4168040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedcbc78640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc406c010 con 0x7fedc415d290 2023-11-04T01:43:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedcbc78640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40ac960 con 0x7fedc40b0c20 2023-11-04T01:43:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedcbc78640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4161cc0 con 0x7fedc406ba10 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9a14640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fedc415d290 0x7fedc40b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48102/0 (socket says 172.21.15.40:48102) 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9a14640 1 -- 172.21.15.40:0/2964189729 learned_addr learned my addr 172.21.15.40:0/2964189729 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedca215640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 0x7fedc4168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642221214 0 0) 0x7fedc406c010 con 0x7fedc415d290 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb0003530 con 0x7fedc415d290 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1526771213 0 0) 0x7fedb0003530 con 0x7fedc415d290 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 msgr2=0x7fedc4168040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 0x7fedc4168040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 >> v1:172.21.15.91:6789/0 conn(0x7fedc40b0c20 legacy=0x7fedc406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40acc40 con 0x7fedc415d290 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fedc0001a00 con 0x7fedc415d290 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 >> v1:172.21.15.40:6789/0 conn(0x7fedc415d290 legacy=0x7fedc40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 0x7fedb00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedb0003fe0 0x7fedb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb0004d10 0x7fedb0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4161cc0 con 0x7fedb0003fe0 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb000bb50 con 0x7fedb0004d10 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb000bd10 con 0x7fedc406ba10 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9213640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedb0003fe0 0x7fedb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9a14640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 0x7fedb00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedca215640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb0004d10 0x7fedb0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9213640 1 -- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 msgr2=0x7fedb00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9213640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedc406ba10 0x7fedb00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9213640 1 -- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb0004d10 msgr2=0x7fedb0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9213640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedb0004d10 0x7fedb0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.870+0000 7fedc9213640 1 -- 172.21.15.40:0/2964189729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0003530 con 0x7fedb0003fe0 2023-11-04T01:43:05.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedc9213640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedb0003fe0 0x7fedb00047d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fedb4001780 tx=0x7fedb401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06ede677bdea6b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40052d0 con 0x7fedb0003fe0 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb40a7050 con 0x7fedb0003fe0 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedc8a12640 1 -- 172.21.15.40:0/2964189729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4003600 con 0x7fedb0003fe0 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 -- 172.21.15.40:0/2964189729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedb0003fe0 msgr2=0x7fedb00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 --2- 172.21.15.40:0/2964189729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedb0003fe0 0x7fedb00047d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fedb4001780 tx=0x7fedb401c400 comp rx=0 tx=0).stop 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedca215640 1 -- 172.21.15.40:0/2964189729 reap_dead start 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 -- 172.21.15.40:0/2964189729 shutdown_connections 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 -- 172.21.15.40:0/2964189729 >> 172.21.15.40:0/2964189729 conn(0x7fedc40cb510 msgr2=0x7fedc40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 -- 172.21.15.40:0/2964189729 shutdown_connections 2023-11-04T01:43:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 -- 172.21.15.40:0/2964189729 wait complete. 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 Processor -- start 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.874+0000 7fedcbc78640 1 -- start start 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedb0003fe0 0x7fedc4151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 0x7fedc406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedc4156790 0x7fedc4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4157150 con 0x7fedc41e8410 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40701c0 con 0x7fedc4156790 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40704a0 con 0x7fedb0003fe0 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 0x7fedc406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 0x7fedc406f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44770/0 (socket says 172.21.15.40:44770) 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 -- 172.21.15.40:0/1968372099 learned_addr learned my addr 172.21.15.40:0/1968372099 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedca215640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedc4156790 0x7fedc4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9a14640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedb0003fe0 0x7fedc4151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 -- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedb0003fe0 msgr2=0x7fedc4151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedb0003fe0 0x7fedc4151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 -- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedc4156790 msgr2=0x7fedc4156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedc4156790 0x7fedc4156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 -- 172.21.15.40:0/1968372099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4070780 con 0x7fedc41e8410 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9a14640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedb0003fe0 0x7fedc4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9213640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 0x7fedc406f8c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fedb4005040 tx=0x7fedb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40ba070 con 0x7fedc41e8410 2023-11-04T01:43:05.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4000ee0 con 0x7fedc41e8410 2023-11-04T01:43:05.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc40b26a0 con 0x7fedc41e8410 2023-11-04T01:43:05.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4007680 con 0x7fedc41e8410 2023-11-04T01:43:05.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc406fe00 con 0x7fedc41e8410 2023-11-04T01:43:05.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc406cbd0 con 0x7fedc41e8410 2023-11-04T01:43:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fedb40067e0 con 0x7fedc41e8410 2023-11-04T01:43:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedba7fc640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feda80664a0 0x7feda8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fedb411e820 con 0x7fedc41e8410 2023-11-04T01:43:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.878+0000 7fedc9a14640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feda80664a0 0x7feda8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.882+0000 7fedc9a14640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feda80664a0 0x7feda8068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fedc0001bb0 tx=0x7fedc0004b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:05.882+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fedb40ebc60 con 0x7fedc41e8410 2023-11-04T01:43:06.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.038+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fedc40744a0 con 0x7fedc41e8410 2023-11-04T01:43:06.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.050+0000 7fedba7fc640 1 -- 172.21.15.40:0/1968372099 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fedb40ef280 con 0x7fedc41e8410 2023-11-04T01:43:06.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feda80664a0 msgr2=0x7feda8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feda80664a0 0x7feda8068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fedc0001bb0 tx=0x7fedc0004b70 comp rx=0 tx=0).stop 2023-11-04T01:43:06.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 msgr2=0x7fedc406f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 0x7fedc406f8c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fedb4005040 tx=0x7fedb0005800 comp rx=0 tx=0).stop 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 shutdown_connections 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feda80664a0 0x7feda8068960 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fedc4156790 0x7fedc4156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedc41e8410 0x7fedc406f8c0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 --2- 172.21.15.40:0/1968372099 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fedb0003fe0 0x7fedc4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 >> 172.21.15.40:0/1968372099 conn(0x7fedc40cb510 msgr2=0x7fedc415c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 shutdown_connections 2023-11-04T01:43:06.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.054+0000 7fedcbc78640 1 -- 172.21.15.40:0/1968372099 wait complete. 2023-11-04T01:43:06.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:43:06.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 Processor -- start 2023-11-04T01:43:06.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 -- start start 2023-11-04T01:43:06.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d8415b320 0x7f8d8406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8d8406fe30 0x7f8d840b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8406bb30 con 0x7f8d840b0b70 2023-11-04T01:43:06.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8406c7b0 con 0x7f8d8415b320 2023-11-04T01:43:06.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d89dd3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840b1000 con 0x7f8d8406fe30 2023-11-04T01:43:06.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d8415b320 0x7f8d8406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d8415b320 0x7f8d8406f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44784/0 (socket says 172.21.15.40:44784) 2023-11-04T01:43:06.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 -- 172.21.15.40:0/1442500224 learned_addr learned my addr 172.21.15.40:0/1442500224 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:06.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d7bfff640 1 --2- 172.21.15.40:0/1442500224 >> v2:172.21.15.91:3300/0 conn(0x7f8d8406fe30 0x7f8d840b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 -- 172.21.15.40:0/1442500224 >> v2:172.21.15.91:3300/0 conn(0x7f8d8406fe30 msgr2=0x7f8d840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 --2- 172.21.15.40:0/1442500224 >> v2:172.21.15.91:3300/0 conn(0x7f8d8406fe30 0x7f8d840b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 -- 172.21.15.40:0/1442500224 >> v1:172.21.15.91:6789/0 conn(0x7f8d840b0b70 legacy=0x7f8d840c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.198+0000 7f8d837fe640 1 -- 172.21.15.40:0/1442500224 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8406be10 con 0x7f8d8415b320 2023-11-04T01:43:06.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d837fe640 1 --2- 172.21.15.40:0/1442500224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d8415b320 0x7f8d8406f8f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8d840cea40 tx=0x7f8d7401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf586a950e1c212e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d82ffd640 1 -- 172.21.15.40:0/1442500224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d740ad660 con 0x7f8d8415b320 2023-11-04T01:43:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d82ffd640 1 -- 172.21.15.40:0/1442500224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d740ad7c0 con 0x7f8d8415b320 2023-11-04T01:43:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d82ffd640 1 -- 172.21.15.40:0/1442500224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d740adb50 con 0x7f8d8415b320 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 -- 172.21.15.40:0/1442500224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d8415b320 msgr2=0x7f8d8406f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/1442500224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d8415b320 0x7f8d8406f8f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8d840cea40 tx=0x7f8d7401c440 comp rx=0 tx=0).stop 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 -- 172.21.15.40:0/1442500224 shutdown_connections 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/1442500224 >> v2:172.21.15.91:3300/0 conn(0x7f8d8406fe30 0x7f8d840b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/1442500224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d8415b320 0x7f8d8406f8f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 -- 172.21.15.40:0/1442500224 >> 172.21.15.40:0/1442500224 conn(0x7f8d840cebb0 msgr2=0x7f8d840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 -- 172.21.15.40:0/1442500224 shutdown_connections 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.202+0000 7f8d89dd3640 1 -- 172.21.15.40:0/1442500224 wait complete. 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 Processor -- start 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- start start 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8d8406fe30 0x7f8d8414ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 0x7f8d840cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d8414cf90 0x7f8d8414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414e660 con 0x7f8d840b0b70 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414cdb0 con 0x7f8d8414cf90 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414bf70 con 0x7f8d8406fe30 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 0x7f8d840cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 0x7f8d840cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44796/0 (socket says 172.21.15.40:44796) 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 -- 172.21.15.40:0/2122348789 learned_addr learned my addr 172.21.15.40:0/2122348789 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d837fe640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8d8406fe30 0x7f8d8414ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d83fff640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d8414cf90 0x7f8d8414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 -- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8d8406fe30 msgr2=0x7f8d8414ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8d8406fe30 0x7f8d8414ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 -- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d8414cf90 msgr2=0x7f8d8414ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d8414cf90 0x7f8d8414ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 -- 172.21.15.40:0/2122348789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740094d0 con 0x7f8d840b0b70 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d7bfff640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 0x7f8d840cac20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e960 tx=0x7f8d6c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c009690 con 0x7f8d840b0b70 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00ca00 con 0x7f8d840b0b70 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8414c1a0 con 0x7f8d840b0b70 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00cd70 con 0x7f8d840b0b70 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8414c760 con 0x7f8d840b0b70 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.206+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d84158060 con 0x7f8d840b0b70 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.210+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d6c013470 con 0x7f8d840b0b70 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.210+0000 7f8d80ff9640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8d640664a0 0x7f8d64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.210+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f8d6c0848e0 con 0x7f8d840b0b70 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.210+0000 7f8d837fe640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8d640664a0 0x7f8d64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.210+0000 7f8d837fe640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8d640664a0 0x7f8d64068960 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8d740af000 tx=0x7f8d74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.214+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d6c051c80 con 0x7f8d840b0b70 2023-11-04T01:43:06.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:06.426+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f8d84158060 con 0x7f8d840b0b70 2023-11-04T01:43:07.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d80ff9640 1 -- 172.21.15.40:0/2122348789 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v196) v1 ==== 148+0+0 (secure 0 0 0) 0x7f8d84158060 con 0x7f8d840b0b70 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8d640664a0 msgr2=0x7f8d64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8d640664a0 0x7f8d64068960 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8d740af000 tx=0x7f8d74008040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 msgr2=0x7f8d840cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 0x7f8d840cac20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e960 tx=0x7f8d6c00ee20 comp rx=0 tx=0).stop 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 shutdown_connections 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8d640664a0 0x7f8d64068960 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d8414cf90 0x7f8d8414ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d840b0b70 0x7f8d840cac20 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 --2- 172.21.15.40:0/2122348789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8d8406fe30 0x7f8d8414ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 >> 172.21.15.40:0/2122348789 conn(0x7f8d840cebb0 msgr2=0x7f8d841539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 shutdown_connections 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.046+0000 7f8d89dd3640 1 -- 172.21.15.40:0/2122348789 wait complete. 2023-11-04T01:43:07.074 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-04T01:43:07.074 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-04T01:43:07.074 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:43:07.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:07.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 Processor -- start 2023-11-04T01:43:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 -- start start 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f551c159a50 0x7f551c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c159e30 con 0x7f551c0ce720 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c0ccfd0 con 0x7f551c159a50 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f552451f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0cd2b0 con 0x7f551c06c1a0 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f551c159a50 0x7f551c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f551c159a50 0x7f551c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44812/0 (socket says 172.21.15.40:44812) 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 -- 172.21.15.40:0/353816806 learned_addr learned my addr 172.21.15.40:0/353816806 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f5522abc640 1 --2- 172.21.15.40:0/353816806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 -- 172.21.15.40:0/353816806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 msgr2=0x7f551c06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 --2- 172.21.15.40:0/353816806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c06fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 -- 172.21.15.40:0/353816806 >> v1:172.21.15.91:6789/0 conn(0x7f551c0ce720 legacy=0x7f551c06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.198+0000 7f55222bb640 1 -- 172.21.15.40:0/353816806 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0cd590 con 0x7f551c159a50 2023-11-04T01:43:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f55222bb640 1 --2- 172.21.15.40:0/353816806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c159a50 0x7f551c0cc6f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5518006fd0 tx=0x7f5518021180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d174f96f677f833 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f55212b9640 1 -- 172.21.15.40:0/353816806 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518004030 con 0x7f551c159a50 2023-11-04T01:43:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f55212b9640 1 -- 172.21.15.40:0/353816806 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180ad030 con 0x7f551c159a50 2023-11-04T01:43:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f55212b9640 1 -- 172.21.15.40:0/353816806 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518004410 con 0x7f551c159a50 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- 172.21.15.40:0/353816806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c159a50 msgr2=0x7f551c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 --2- 172.21.15.40:0/353816806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c159a50 0x7f551c0cc6f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5518006fd0 tx=0x7f5518021180 comp rx=0 tx=0).stop 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- 172.21.15.40:0/353816806 shutdown_connections 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 --2- 172.21.15.40:0/353816806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c06fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 --2- 172.21.15.40:0/353816806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c159a50 0x7f551c0cc6f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- 172.21.15.40:0/353816806 >> 172.21.15.40:0/353816806 conn(0x7f551c0cebb0 msgr2=0x7f551c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- 172.21.15.40:0/353816806 shutdown_connections 2023-11-04T01:43:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- 172.21.15.40:0/353816806 wait complete. 2023-11-04T01:43:07.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 Processor -- start 2023-11-04T01:43:07.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- start start 2023-11-04T01:43:07.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 0x7f551c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f551c159a50 0x7f551c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1560f0 con 0x7f551c0ce720 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1562e0 con 0x7f551c159a50 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.202+0000 7f552451f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1565c0 con 0x7f551c06c1a0 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 0x7f551c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 0x7f551c0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44822/0 (socket says 172.21.15.40:44822) 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 -- 172.21.15.40:0/2399110874 learned_addr learned my addr 172.21.15.40:0/2399110874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f55222bb640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5522abc640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f551c159a50 0x7f551c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 -- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 msgr2=0x7f551c0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 -- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f551c159a50 msgr2=0x7f551c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f551c159a50 0x7f551c155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 -- 172.21.15.40:0/2399110874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551800b780 con 0x7f551c0ce720 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5521aba640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 0x7f551c0c81d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f550c00c410 tx=0x7f550c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c011790 con 0x7f551c0ce720 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0118f0 con 0x7f551c0ce720 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c1568a0 con 0x7f551c0ce720 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c011ce0 con 0x7f551c0ce720 2023-11-04T01:43:07.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c156e60 con 0x7f551c0ce720 2023-11-04T01:43:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c0caba0 con 0x7f551c0ce720 2023-11-04T01:43:07.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f550c01c460 con 0x7f551c0ce720 2023-11-04T01:43:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5512ffd640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55000664a0 0x7f5500068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f550c083d20 con 0x7f551c0ce720 2023-11-04T01:43:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f55222bb640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55000664a0 0x7f5500068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.206+0000 7f55222bb640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55000664a0 0x7f5500068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f55180b4000 tx=0x7f55180ac000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.210+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f550c088070 con 0x7f551c0ce720 2023-11-04T01:43:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.370+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f551c0744a0 con 0x7f551c0ce720 2023-11-04T01:43:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.370+0000 7f5512ffd640 1 -- 172.21.15.40:0/2399110874 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18215 (secure 0 0 0) 0x7f550c051030 con 0x7f551c0ce720 2023-11-04T01:43:07.378 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:07.378 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":82,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:43:05.703506+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.91:6837/3469878458":"2023-11-05T01:43:02.687229+0000","172.21.15.91:6835/3469878458":"2023-11-05T01:43:02.687229+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55000664a0 msgr2=0x7f5500068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55000664a0 0x7f5500068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f55180b4000 tx=0x7f55180ac000 comp rx=0 tx=0).stop 2023-11-04T01:43:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 msgr2=0x7f551c0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 0x7f551c0c81d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f550c00c410 tx=0x7f550c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 shutdown_connections 2023-11-04T01:43:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55000664a0 0x7f5500068960 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f551c159a50 0x7f551c155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551c0ce720 0x7f551c0c81d0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 --2- 172.21.15.40:0/2399110874 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f551c06c1a0 0x7f551c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 >> 172.21.15.40:0/2399110874 conn(0x7f551c0cebb0 msgr2=0x7f551c1550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 shutdown_connections 2023-11-04T01:43:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.374+0000 7f552451f640 1 -- 172.21.15.40:0/2399110874 wait complete. 2023-11-04T01:43:07.397 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:07.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.522+0000 7fce80ba6640 1 Processor -- start 2023-11-04T01:43:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.522+0000 7fce80ba6640 1 -- start start 2023-11-04T01:43:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce80ba6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce7c0b0c20 0x7fce7c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce80ba6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c0cb130 con 0x7fce7c15acb0 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce80ba6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c15b680 con 0x7fce7c15c160 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce80ba6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c15bd40 con 0x7fce7c0b0c20 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce79d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce7c0b0c20 0x7fce7c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce7a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fce7c15acb0 0x7fce7c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44160/0 (socket says 172.21.15.40:44160) 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce7a59c640 1 -- 172.21.15.40:0/990565993 learned_addr learned my addr 172.21.15.40:0/990565993 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce79d9b640 1 -- 172.21.15.40:0/990565993 >> v1:172.21.15.91:6789/0 conn(0x7fce7c15c160 legacy=0x7fce7c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce79d9b640 1 -- 172.21.15.40:0/990565993 >> v1:172.21.15.40:6789/0 conn(0x7fce7c15acb0 legacy=0x7fce7c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce7959a640 1 -- 172.21.15.40:0/990565993 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037742759 0 0) 0x7fce7c0cb130 con 0x7fce7c15acb0 2023-11-04T01:43:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce79d9b640 1 -- 172.21.15.40:0/990565993 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c15b960 con 0x7fce7c0b0c20 2023-11-04T01:43:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce79d9b640 1 --2- 172.21.15.40:0/990565993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c0b0c20 0x7fce7c15b090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fce640097c0 tx=0x7fce6401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd6192ddac691f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce7959a640 1 -- 172.21.15.40:0/990565993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64004230 con 0x7fce7c0b0c20 2023-11-04T01:43:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce7959a640 1 -- 172.21.15.40:0/990565993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce640a7050 con 0x7fce7c0b0c20 2023-11-04T01:43:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.526+0000 7fce7959a640 1 -- 172.21.15.40:0/990565993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64003620 con 0x7fce7c0b0c20 2023-11-04T01:43:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/990565993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c0b0c20 msgr2=0x7fce7c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 --2- 172.21.15.40:0/990565993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c0b0c20 0x7fce7c15b090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fce640097c0 tx=0x7fce6401c440 comp rx=0 tx=0).stop 2023-11-04T01:43:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/990565993 shutdown_connections 2023-11-04T01:43:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 --2- 172.21.15.40:0/990565993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c0b0c20 0x7fce7c15b090 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/990565993 >> 172.21.15.40:0/990565993 conn(0x7fce7c0cb510 msgr2=0x7fce7c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/990565993 shutdown_connections 2023-11-04T01:43:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/990565993 wait complete. 2023-11-04T01:43:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 Processor -- start 2023-11-04T01:43:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- start start 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce7c0b0c20 0x7fce7c147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 0x7fce7c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce7c15c160 0x7fce7c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c14f310 con 0x7fce7c15acb0 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c06b9a0 con 0x7fce7c15c160 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c06bc80 con 0x7fce7c0b0c20 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 0x7fce7c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 0x7fce7c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44648/0 (socket says 172.21.15.40:44648) 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 -- 172.21.15.40:0/1016487424 learned_addr learned my addr 172.21.15.40:0/1016487424 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce7ad9d640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce7c15c160 0x7fce7c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 -- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce7c0b0c20 msgr2=0x7fce7c147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce7a59c640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce7c0b0c20 0x7fce7c147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce7c0b0c20 0x7fce7c147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 -- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce7c15c160 msgr2=0x7fce7c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce7c15c160 0x7fce7c0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 -- 172.21.15.40:0/1016487424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64009420 con 0x7fce7c15acb0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce7ad9d640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce7c15c160 0x7fce7c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce79d9b640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 0x7fce7c0ac8c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fce640ae040 tx=0x7fce640191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640ab640 con 0x7fce7c15acb0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce640ab7a0 con 0x7fce7c15acb0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c06bf60 con 0x7fce7c15acb0 2023-11-04T01:43:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640abb10 con 0x7fce7c15acb0 2023-11-04T01:43:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.530+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c15f680 con 0x7fce7c15acb0 2023-11-04T01:43:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.534+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c0744a0 con 0x7fce7c15acb0 2023-11-04T01:43:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.534+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce640b2040 con 0x7fce7c15acb0 2023-11-04T01:43:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.534+0000 7fce72ffd640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce5c0664d0 0x7fce5c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.534+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fce6411e520 con 0x7fce7c15acb0 2023-11-04T01:43:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.534+0000 7fce7a59c640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce5c0664d0 0x7fce5c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.534+0000 7fce7a59c640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce5c0664d0 0x7fce5c068990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0012f0 tx=0x7fce6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.538+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce640eb8e0 con 0x7fce7c15acb0 2023-11-04T01:43:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.694+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce7c0cde30 con 0x7fce7c15acb0 2023-11-04T01:43:07.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.694+0000 7fce72ffd640 1 -- 172.21.15.40:0/1016487424 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce64006e20 con 0x7fce7c15acb0 2023-11-04T01:43:07.701 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:43:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce5c0664d0 msgr2=0x7fce5c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce5c0664d0 0x7fce5c068990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0012f0 tx=0x7fce6c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 msgr2=0x7fce7c0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 0x7fce7c0ac8c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fce640ae040 tx=0x7fce640191e0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 shutdown_connections 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce5c0664d0 0x7fce5c068990 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce7c15c160 0x7fce7c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce7c15acb0 0x7fce7c0ac8c0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 --2- 172.21.15.40:0/1016487424 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce7c0b0c20 0x7fce7c147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 >> 172.21.15.40:0/1016487424 conn(0x7fce7c0cb510 msgr2=0x7fce7c0c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 shutdown_connections 2023-11-04T01:43:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.698+0000 7fce80ba6640 1 -- 172.21.15.40:0/1016487424 wait complete. 2023-11-04T01:43:07.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:07.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.842+0000 7feb64873640 1 Processor -- start 2023-11-04T01:43:07.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.842+0000 7feb64873640 1 -- start start 2023-11-04T01:43:07.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb64873640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 0x7feb600ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb64873640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feb60070970 0x7feb600cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb64873640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6006d050 con 0x7feb600ca540 2023-11-04T01:43:07.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb64873640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb600ca9a0 con 0x7feb60070970 2023-11-04T01:43:07.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb64873640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb600c9520 con 0x7feb60159e30 2023-11-04T01:43:07.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feb600ca540 0x7feb60070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44176/0 (socket says 172.21.15.40:44176) 2023-11-04T01:43:07.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 -- 172.21.15.40:0/1474850588 learned_addr learned my addr 172.21.15.40:0/1474850588 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:07.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280753268 0 0) 0x7feb6006d050 con 0x7feb600ca540 2023-11-04T01:43:07.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5e59c640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 0x7feb600ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb48003530 con 0x7feb600ca540 2023-11-04T01:43:07.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5ed9d640 1 --2- 172.21.15.40:0/1474850588 >> v2:172.21.15.91:3300/0 conn(0x7feb60070970 0x7feb600cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3827101283 0 0) 0x7feb48003530 con 0x7feb600ca540 2023-11-04T01:43:07.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 msgr2=0x7feb600ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 0x7feb600ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 >> v2:172.21.15.91:3300/0 conn(0x7feb60070970 msgr2=0x7feb600cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 --2- 172.21.15.40:0/1474850588 >> v2:172.21.15.91:3300/0 conn(0x7feb60070970 0x7feb600cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600c9800 con 0x7feb600ca540 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7feb54001680 con 0x7feb600ca540 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 >> v1:172.21.15.40:6789/0 conn(0x7feb600ca540 legacy=0x7feb60070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb48003980 0x7feb48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb480047d0 0x7feb48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 0x7feb48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb600c9520 con 0x7feb480047d0 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4800b990 con 0x7feb48003980 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4800bad0 con 0x7feb60159e30 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb480047d0 0x7feb48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5ed9d640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 0x7feb48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5e59c640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb48003980 0x7feb48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 -- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 msgr2=0x7feb48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60159e30 0x7feb48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 -- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb48003980 msgr2=0x7feb48003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb48003980 0x7feb48003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.846+0000 7feb5dd9b640 1 -- 172.21.15.40:0/1474850588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48003530 con 0x7feb480047d0 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb480047d0 0x7feb48004c50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c160 tx=0x7feb5401f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf95f6f31ed09ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540a8c10 con 0x7feb480047d0 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb540a8d70 con 0x7feb480047d0 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5d59a640 1 -- 172.21.15.40:0/1474850588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54005b20 con 0x7feb480047d0 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/1474850588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb480047d0 msgr2=0x7feb48004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 --2- 172.21.15.40:0/1474850588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb480047d0 0x7feb48004c50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c160 tx=0x7feb5401f290 comp rx=0 tx=0).stop 2023-11-04T01:43:07.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5ed9d640 1 -- 172.21.15.40:0/1474850588 reap_dead start 2023-11-04T01:43:07.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/1474850588 shutdown_connections 2023-11-04T01:43:07.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/1474850588 >> 172.21.15.40:0/1474850588 conn(0x7feb600cb510 msgr2=0x7feb600cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/1474850588 shutdown_connections 2023-11-04T01:43:07.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/1474850588 wait complete. 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 Processor -- start 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- start start 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb480047d0 0x7feb600b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 0x7feb60150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60150ba0 0x7feb60158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb600b1cb0 con 0x7feb600aed30 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb600b1f50 con 0x7feb480047d0 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb600b2230 con 0x7feb60150ba0 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 0x7feb60150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 0x7feb60150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44672/0 (socket says 172.21.15.40:44672) 2023-11-04T01:43:07.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 -- 172.21.15.40:0/3153490062 learned_addr learned my addr 172.21.15.40:0/3153490062 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5ed9d640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60150ba0 0x7feb60158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5e59c640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb480047d0 0x7feb600b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 -- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60150ba0 msgr2=0x7feb60158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60150ba0 0x7feb60158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 -- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb480047d0 msgr2=0x7feb600b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb480047d0 0x7feb600b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 -- 172.21.15.40:0/3153490062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600b2510 con 0x7feb600aed30 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5e59c640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb480047d0 0x7feb600b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb5dd9b640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 0x7feb60150660 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7feb54000c10 tx=0x7feb48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540048b0 con 0x7feb600aed30 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb54004a10 con 0x7feb600aed30 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb600b27f0 con 0x7feb600aed30 2023-11-04T01:43:07.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54004dc0 con 0x7feb600aed30 2023-11-04T01:43:07.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.850+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb600b47b0 con 0x7feb600aed30 2023-11-04T01:43:07.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.854+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb600744a0 con 0x7feb600aed30 2023-11-04T01:43:07.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.854+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb540b8070 con 0x7feb600aed30 2023-11-04T01:43:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.854+0000 7feb4effd640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb40066460 0x7feb40068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.854+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7feb54120ea0 con 0x7feb600aed30 2023-11-04T01:43:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.854+0000 7feb5e59c640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb40066460 0x7feb40068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.854+0000 7feb5e59c640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb40066460 0x7feb40068920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feb50009f60 tx=0x7feb5000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:07.858+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb540ee260 con 0x7feb600aed30 2023-11-04T01:43:08.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.010+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7feb6006b930 con 0x7feb600aed30 2023-11-04T01:43:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.010+0000 7feb4effd640 1 -- 172.21.15.40:0/3153490062 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7feb540f1880 con 0x7feb600aed30 2023-11-04T01:43:08.017 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb40066460 msgr2=0x7feb40068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb40066460 0x7feb40068920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feb50009f60 tx=0x7feb5000b040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 msgr2=0x7feb60150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 0x7feb60150660 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7feb54000c10 tx=0x7feb48005800 comp rx=0 tx=0).stop 2023-11-04T01:43:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 shutdown_connections 2023-11-04T01:43:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feb40066460 0x7feb40068920 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feb60150ba0 0x7feb60158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb600aed30 0x7feb60150660 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 --2- 172.21.15.40:0/3153490062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feb480047d0 0x7feb600b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 >> 172.21.15.40:0/3153490062 conn(0x7feb600cb510 msgr2=0x7feb600ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 shutdown_connections 2023-11-04T01:43:08.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.014+0000 7feb64873640 1 -- 172.21.15.40:0/3153490062 wait complete. 2023-11-04T01:43:08.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:08.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f96fdb640 1 Processor -- start 2023-11-04T01:43:08.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f96fdb640 1 -- start start 2023-11-04T01:43:08.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f96fdb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f9015acb0 0x7f5f9015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f96fdb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900cb130 con 0x7f5f9015c160 2023-11-04T01:43:08.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f96fdb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9015b680 con 0x7f5f900b0c20 2023-11-04T01:43:08.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f96fdb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9015bd40 con 0x7f5f9015acb0 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f94d77640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f9015acb0 0x7f5f9015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f8ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5f9015c160 0x7f5f900b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44188/0 (socket says 172.21.15.40:44188) 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f8ffff640 1 -- 172.21.15.40:0/1890092816 learned_addr learned my addr 172.21.15.40:0/1890092816 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f94d77640 1 -- 172.21.15.40:0/1890092816 >> v1:172.21.15.91:6789/0 conn(0x7f5f900b0c20 legacy=0x7f5f900ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f94d77640 1 -- 172.21.15.40:0/1890092816 >> v1:172.21.15.40:6789/0 conn(0x7f5f9015c160 legacy=0x7f5f900b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f94d77640 1 -- 172.21.15.40:0/1890092816 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9015b960 con 0x7f5f9015acb0 2023-11-04T01:43:08.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f8f7fe640 1 -- 172.21.15.40:0/1890092816 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549728121 0 0) 0x7f5f900cb130 con 0x7f5f9015c160 2023-11-04T01:43:08.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.162+0000 7f5f94d77640 1 --2- 172.21.15.40:0/1890092816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015acb0 0x7f5f9015b090 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5f800097f0 tx=0x7f5f8001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f8554ca16f79e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8f7fe640 1 -- 172.21.15.40:0/1890092816 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80004230 con 0x7f5f9015acb0 2023-11-04T01:43:08.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8f7fe640 1 -- 172.21.15.40:0/1890092816 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f800a7050 con 0x7f5f9015acb0 2023-11-04T01:43:08.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8f7fe640 1 -- 172.21.15.40:0/1890092816 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80003620 con 0x7f5f9015acb0 2023-11-04T01:43:08.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1890092816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015acb0 msgr2=0x7f5f9015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1890092816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015acb0 0x7f5f9015b090 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f5f800097f0 tx=0x7f5f8001c440 comp rx=0 tx=0).stop 2023-11-04T01:43:08.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1890092816 shutdown_connections 2023-11-04T01:43:08.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1890092816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015acb0 0x7f5f9015b090 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1890092816 >> 172.21.15.40:0/1890092816 conn(0x7f5f900cb510 msgr2=0x7f5f900cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1890092816 shutdown_connections 2023-11-04T01:43:08.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1890092816 wait complete. 2023-11-04T01:43:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 Processor -- start 2023-11-04T01:43:08.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- start start 2023-11-04T01:43:08.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f900b0c20 0x7f5f900c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f9015acb0 0x7f5f900af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 0x7f5f900af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90150f60 con 0x7f5f9015c160 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90153b40 con 0x7f5f900b0c20 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c5920 con 0x7f5f9015acb0 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 0x7f5f900af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 0x7f5f900af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44686/0 (socket says 172.21.15.40:44686) 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 -- 172.21.15.40:0/1360910101 learned_addr learned my addr 172.21.15.40:0/1360910101 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f94d77640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f900b0c20 0x7f5f900c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8ffff640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f9015acb0 0x7f5f900af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 -- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f9015acb0 msgr2=0x7f5f900af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f9015acb0 0x7f5f900af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 -- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f900b0c20 msgr2=0x7f5f900c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f900b0c20 0x7f5f900c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 -- 172.21.15.40:0/1360910101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009420 con 0x7f5f9015c160 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f94d77640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f900b0c20 0x7f5f900c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f95578640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 0x7f5f900af600 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800be60 tx=0x7f5f8800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88014440 con 0x7f5f9015c160 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f880145a0 con 0x7f5f9015c160 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88014990 con 0x7f5f9015c160 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90153fd0 con 0x7f5f9015c160 2023-11-04T01:43:08.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.166+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f901534f0 con 0x7f5f9015c160 2023-11-04T01:43:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.170+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f90153cb0 con 0x7f5f9015c160 2023-11-04T01:43:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.170+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f8801d3b0 con 0x7f5f9015c160 2023-11-04T01:43:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.170+0000 7f5f8d7fa640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f700664a0 0x7f5f70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.170+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f5f88084070 con 0x7f5f9015c160 2023-11-04T01:43:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.170+0000 7f5f94d77640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f700664a0 0x7f5f70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.170+0000 7f5f94d77640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f700664a0 0x7f5f70068960 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5f800ad000 tx=0x7f5f80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.178+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5f88051430 con 0x7f5f9015c160 2023-11-04T01:43:08.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.330+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f5f900744a0 con 0x7f5f9015c160 2023-11-04T01:43:08.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.330+0000 7f5f8d7fa640 1 -- 172.21.15.40:0/1360910101 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v82) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5f88054a50 con 0x7f5f9015c160 2023-11-04T01:43:08.337 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:08.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f700664a0 msgr2=0x7f5f70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f700664a0 0x7f5f70068960 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5f800ad000 tx=0x7f5f80008040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 msgr2=0x7f5f900af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 0x7f5f900af600 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800be60 tx=0x7f5f8800bf50 comp rx=0 tx=0).stop 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 shutdown_connections 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5f700664a0 0x7f5f70068960 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f9015c160 0x7f5f900af600 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5f9015acb0 0x7f5f900af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 --2- 172.21.15.40:0/1360910101 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f900b0c20 0x7f5f900c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 >> 172.21.15.40:0/1360910101 conn(0x7f5f900cb510 msgr2=0x7f5f900ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 shutdown_connections 2023-11-04T01:43:08.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.334+0000 7f5f96fdb640 1 -- 172.21.15.40:0/1360910101 wait complete. 2023-11-04T01:43:08.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 Processor -- start 2023-11-04T01:43:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 -- start start 2023-11-04T01:43:08.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae2c15acb0 0x7fae2c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fae2c0b0c20 0x7fae2c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c0cb130 con 0x7fae2c15c160 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c15bd40 con 0x7fae2c15acb0 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae308ee640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c06fd80 con 0x7fae2c0b0c20 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae2c15acb0 0x7fae2c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae29d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae2c15c160 0x7fae2c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44190/0 (socket says 172.21.15.40:44190) 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae29d9b640 1 -- 172.21.15.40:0/1700765382 learned_addr learned my addr 172.21.15.40:0/1700765382 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2ad9d640 1 --2- 172.21.15.40:0/1700765382 >> v2:172.21.15.91:3300/0 conn(0x7fae2c0b0c20 0x7fae2c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2a59c640 1 -- 172.21.15.40:0/1700765382 >> v2:172.21.15.91:3300/0 conn(0x7fae2c0b0c20 msgr2=0x7fae2c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2a59c640 1 --2- 172.21.15.40:0/1700765382 >> v2:172.21.15.91:3300/0 conn(0x7fae2c0b0c20 0x7fae2c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2a59c640 1 -- 172.21.15.40:0/1700765382 >> v1:172.21.15.40:6789/0 conn(0x7fae2c15c160 legacy=0x7fae2c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2a59c640 1 -- 172.21.15.40:0/1700765382 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c15b680 con 0x7fae2c15acb0 2023-11-04T01:43:08.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.466+0000 7fae2959a640 1 -- 172.21.15.40:0/1700765382 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201150106 0 0) 0x7fae2c0cb130 con 0x7fae2c15c160 2023-11-04T01:43:08.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae2a59c640 1 --2- 172.21.15.40:0/1700765382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15acb0 0x7fae2c15b090 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0097c0 tx=0x7fae1c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f47319e5904d22 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae2959a640 1 -- 172.21.15.40:0/1700765382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0a7070 con 0x7fae2c15acb0 2023-11-04T01:43:08.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae2959a640 1 -- 172.21.15.40:0/1700765382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c0ab430 con 0x7fae2c15acb0 2023-11-04T01:43:08.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae2959a640 1 -- 172.21.15.40:0/1700765382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0ab7c0 con 0x7fae2c15acb0 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 -- 172.21.15.40:0/1700765382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15acb0 msgr2=0x7fae2c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 --2- 172.21.15.40:0/1700765382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15acb0 0x7fae2c15b090 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0097c0 tx=0x7fae1c01c410 comp rx=0 tx=0).stop 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 -- 172.21.15.40:0/1700765382 shutdown_connections 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 --2- 172.21.15.40:0/1700765382 >> v2:172.21.15.91:3300/0 conn(0x7fae2c0b0c20 0x7fae2c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 --2- 172.21.15.40:0/1700765382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15acb0 0x7fae2c15b090 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 -- 172.21.15.40:0/1700765382 >> 172.21.15.40:0/1700765382 conn(0x7fae2c0cb510 msgr2=0x7fae2c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 -- 172.21.15.40:0/1700765382 shutdown_connections 2023-11-04T01:43:08.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 -- 172.21.15.40:0/1700765382 wait complete. 2023-11-04T01:43:08.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 Processor -- start 2023-11-04T01:43:08.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.470+0000 7fae308ee640 1 -- start start 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae2c0b0c20 0x7fae2c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fae2c15acb0 0x7fae2c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 0x7fae2c0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c157c50 con 0x7fae2c15c160 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c157420 con 0x7fae2c0b0c20 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c156e60 con 0x7fae2c15acb0 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 0x7fae2c0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 0x7fae2c0b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44692/0 (socket says 172.21.15.40:44692) 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 -- 172.21.15.40:0/4271040478 learned_addr learned my addr 172.21.15.40:0/4271040478 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 -- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fae2c15acb0 msgr2=0x7fae2c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fae2c15acb0 0x7fae2c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 -- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae2c0b0c20 msgr2=0x7fae2c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2a59c640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae2c0b0c20 0x7fae2c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae2c0b0c20 0x7fae2c151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 -- 172.21.15.40:0/4271040478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c009420 con 0x7fae2c15c160 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2ad9d640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 0x7fae2c0b2580 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fae24007e10 tx=0x7fae2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24014620 con 0x7fae2c15c160 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240147a0 con 0x7fae2c15c160 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c157140 con 0x7fae2c15c160 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae24014b50 con 0x7fae2c15c160 2023-11-04T01:43:08.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c1519d0 con 0x7fae2c15c160 2023-11-04T01:43:08.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c157d90 con 0x7fae2c15c160 2023-11-04T01:43:08.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae24014cb0 con 0x7fae2c15c160 2023-11-04T01:43:08.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae1affd640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fae0c0664d0 0x7fae0c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fae240848f0 con 0x7fae2c15c160 2023-11-04T01:43:08.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2a59c640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fae0c0664d0 0x7fae0c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.474+0000 7fae2a59c640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fae0c0664d0 0x7fae0c068990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0af000 tx=0x7fae1c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.478+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fae2c157d90 con 0x7fae2c15c160 2023-11-04T01:43:08.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.626+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fae2c157d90 con 0x7fae2c15c160 2023-11-04T01:43:08.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.626+0000 7fae1affd640 1 -- 172.21.15.40:0/4271040478 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7fae2c157d90 con 0x7fae2c15c160 2023-11-04T01:43:08.632 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:08.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.626+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fae0c0664d0 msgr2=0x7fae0c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.626+0000 7fae308ee640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fae0c0664d0 0x7fae0c068990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0af000 tx=0x7fae1c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.626+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 msgr2=0x7fae2c0b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.626+0000 7fae308ee640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 0x7fae2c0b2580 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fae24007e10 tx=0x7fae2400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 shutdown_connections 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fae0c0664d0 0x7fae0c068990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae2c15c160 0x7fae2c0b2580 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fae2c15acb0 0x7fae2c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 --2- 172.21.15.40:0/4271040478 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae2c0b0c20 0x7fae2c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 >> 172.21.15.40:0/4271040478 conn(0x7fae2c0cb510 msgr2=0x7fae2c0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 shutdown_connections 2023-11-04T01:43:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.630+0000 7fae308ee640 1 -- 172.21.15.40:0/4271040478 wait complete. 2023-11-04T01:43:08.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-04T01:43:08.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68fcab3640 1 Processor -- start 2023-11-04T01:43:08.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68fcab3640 1 -- start start 2023-11-04T01:43:08.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68fcab3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68f8070bf0 0x7f68f80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68fcab3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80c4fb0 con 0x7f68f815d170 2023-11-04T01:43:08.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68fcab3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80711b0 con 0x7f68f806a160 2023-11-04T01:43:08.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68fcab3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f8071490 con 0x7f68f8070bf0 2023-11-04T01:43:08.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f68f815d170 0x7f68f80ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44198/0 (socket says 172.21.15.40:44198) 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f659c640 1 -- 172.21.15.40:0/3758826941 learned_addr learned my addr 172.21.15.40:0/3758826941 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f5d9b640 1 --2- 172.21.15.40:0/3758826941 >> v2:172.21.15.40:3300/0 conn(0x7f68f8070bf0 0x7f68f80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f559a640 1 -- 172.21.15.40:0/3758826941 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241461913 0 0) 0x7f68f80c4fb0 con 0x7f68f815d170 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f559a640 1 -- 172.21.15.40:0/3758826941 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e0003530 con 0x7f68f815d170 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f5d9b640 1 -- 172.21.15.40:0/3758826941 >> v1:172.21.15.91:6789/0 conn(0x7f68f806a160 legacy=0x7f68f80c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f5d9b640 1 -- 172.21.15.40:0/3758826941 >> v1:172.21.15.40:6789/0 conn(0x7f68f815d170 legacy=0x7f68f80ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f559a640 1 -- 172.21.15.40:0/3758826941 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835536604 0 0) 0x7f68e0003530 con 0x7f68f815d170 2023-11-04T01:43:08.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.762+0000 7f68f5d9b640 1 -- 172.21.15.40:0/3758826941 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8071770 con 0x7f68f8070bf0 2023-11-04T01:43:08.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68f5d9b640 1 --2- 172.21.15.40:0/3758826941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f8070bf0 0x7f68f80ca390 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097c0 tx=0x7f68ec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7c123e0f36c39b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68f559a640 1 -- 172.21.15.40:0/3758826941 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0001a00 con 0x7f68f8070bf0 2023-11-04T01:43:08.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68f559a640 1 -- 172.21.15.40:0/3758826941 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec0a7050 con 0x7f68f8070bf0 2023-11-04T01:43:08.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68f559a640 1 -- 172.21.15.40:0/3758826941 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0ab600 con 0x7f68f8070bf0 2023-11-04T01:43:08.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 -- 172.21.15.40:0/3758826941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f8070bf0 msgr2=0x7f68f80ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 --2- 172.21.15.40:0/3758826941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f8070bf0 0x7f68f80ca390 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097c0 tx=0x7f68ec01c370 comp rx=0 tx=0).stop 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 -- 172.21.15.40:0/3758826941 shutdown_connections 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 --2- 172.21.15.40:0/3758826941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f8070bf0 0x7f68f80ca390 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 -- 172.21.15.40:0/3758826941 >> 172.21.15.40:0/3758826941 conn(0x7f68f80cfc00 msgr2=0x7f68f80d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 -- 172.21.15.40:0/3758826941 shutdown_connections 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 -- 172.21.15.40:0/3758826941 wait complete. 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 Processor -- start 2023-11-04T01:43:08.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 -- start start 2023-11-04T01:43:08.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 0x7f68f814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.766+0000 7f68fcab3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68f8070bf0 0x7f68f8150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68f815d170 0x7f68f8147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f814bfc0 con 0x7f68f806a160 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f814b3d0 con 0x7f68f8070bf0 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8150a60 con 0x7f68f815d170 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 0x7f68f814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 0x7f68f814fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44702/0 (socket says 172.21.15.40:44702) 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 -- 172.21.15.40:0/1589118563 learned_addr learned my addr 172.21.15.40:0/1589118563 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f6d9d640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68f815d170 0x7f68f8147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 -- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68f815d170 msgr2=0x7f68f8147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f5d9b640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68f8070bf0 0x7f68f8150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68f815d170 0x7f68f8147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 -- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68f8070bf0 msgr2=0x7f68f8150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68f8070bf0 0x7f68f8150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 -- 172.21.15.40:0/1589118563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec009420 con 0x7f68f806a160 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f659c640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 0x7f68f814fd20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f68f0001570 tx=0x7f68f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000ce20 con 0x7f68f806a160 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0012400 con 0x7f68f806a160 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f806ab00 con 0x7f68f806a160 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f00127f0 con 0x7f68f806a160 2023-11-04T01:43:08.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f814b900 con 0x7f68f806a160 2023-11-04T01:43:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f80675f0 con 0x7f68f806a160 2023-11-04T01:43:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68f0007070 con 0x7f68f806a160 2023-11-04T01:43:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68e6ffd640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f68f0084150 con 0x7f68f806a160 2023-11-04T01:43:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f5d9b640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.770+0000 7f68f5d9b640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0ad000 tx=0x7f68ec0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.774+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68f0051470 con 0x7f68f806a160 2023-11-04T01:43:08.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:08.986+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7f68f80d0a30 con 0x7f68f806a160 2023-11-04T01:43:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.058+0000 7f68e6ffd640 1 -- 172.21.15.40:0/1589118563 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v198) v1 ==== 142+0+0 (secure 0 0 0) 0x7f68f0054a90 con 0x7f68f806a160 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.058+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 msgr2=0x7f68d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.058+0000 7f68fcab3640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0ad000 tx=0x7f68ec0a6000 comp rx=0 tx=0).stop 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 msgr2=0x7f68f814fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 0x7f68f814fd20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f68f0001570 tx=0x7f68f000a430 comp rx=0 tx=0).stop 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 shutdown_connections 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f68d80664a0 0x7f68d8068960 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f68f815d170 0x7f68f8147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f68f8070bf0 0x7f68f8150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 --2- 172.21.15.40:0/1589118563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68f806a160 0x7f68f814fd20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 >> 172.21.15.40:0/1589118563 conn(0x7f68f80cfc00 msgr2=0x7f68f8157d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 shutdown_connections 2023-11-04T01:43:09.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.062+0000 7f68fcab3640 1 -- 172.21.15.40:0/1589118563 wait complete. 2023-11-04T01:43:09.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:43:09.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 Processor -- start 2023-11-04T01:43:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 -- start start 2023-11-04T01:43:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 0x7f7a8c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 0x7f7a8c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c161760 con 0x7f7a8c1438e0 2023-11-04T01:43:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c161a40 con 0x7f7a8c06a870 2023-11-04T01:43:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a92883640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0d0790 con 0x7f7a8c146510 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a8b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 0x7f7a8c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a90e20640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 0x7f7a8c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a8b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 0x7f7a8c0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:59412/0 (socket says 172.21.15.40:59412) 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a8b7fe640 1 -- 172.21.15.40:0/1823398222 learned_addr learned my addr 172.21.15.40:0/1823398222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a90e20640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 0x7f7a8c06cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:38950/0 (socket says 172.21.15.40:38950) 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a8bfff640 1 --1- 172.21.15.40:0/1823398222 >> v1:172.21.15.91:6789/0 conn(0x7f7a8c1438e0 0x7f7a8c06a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:54360/0 (socket says 172.21.15.40:54360) 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a90e20640 1 -- 172.21.15.40:0/1823398222 >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 msgr2=0x7f7a8c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a90e20640 1 --2- 172.21.15.40:0/1823398222 >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 0x7f7a8c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a90e20640 1 -- 172.21.15.40:0/1823398222 >> v1:172.21.15.91:6789/0 conn(0x7f7a8c1438e0 legacy=0x7f7a8c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a90e20640 1 -- 172.21.15.40:0/1823398222 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0d0a00 con 0x7f7a8c146510 2023-11-04T01:43:09.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.210+0000 7f7a8b7fe640 1 --2- 172.21.15.40:0/1823398222 >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 0x7f7a8c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:09.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a90e20640 1 --2- 172.21.15.40:0/1823398222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 0x7f7a8c06cca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097c0 tx=0x7f7a8401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e096871bf2a9d8f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a8affd640 1 -- 172.21.15.40:0/1823398222 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840ab600 con 0x7f7a8c146510 2023-11-04T01:43:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a8affd640 1 -- 172.21.15.40:0/1823398222 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a840a7050 con 0x7f7a8c146510 2023-11-04T01:43:09.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a8affd640 1 -- 172.21.15.40:0/1823398222 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840ab980 con 0x7f7a8c146510 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 -- 172.21.15.40:0/1823398222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 msgr2=0x7f7a8c06cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 --2- 172.21.15.40:0/1823398222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 0x7f7a8c06cca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097c0 tx=0x7f7a8401c3f0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 -- 172.21.15.40:0/1823398222 shutdown_connections 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 --2- 172.21.15.40:0/1823398222 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c146510 0x7f7a8c06cca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 --2- 172.21.15.40:0/1823398222 >> v2:172.21.15.91:3300/0 conn(0x7f7a8c06a870 0x7f7a8c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 -- 172.21.15.40:0/1823398222 >> 172.21.15.40:0/1823398222 conn(0x7f7a8c0cfc70 msgr2=0x7f7a8c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 -- 172.21.15.40:0/1823398222 shutdown_connections 2023-11-04T01:43:09.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.214+0000 7f7a92883640 1 -- 172.21.15.40:0/1823398222 wait complete. 2023-11-04T01:43:09.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 Processor -- start 2023-11-04T01:43:09.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 -- start start 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 0x7f7a8c15f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c1438e0 0x7f7a8c163300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a8c146510 0x7f7a8c0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b4a90 con 0x7f7a8c06a870 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b3ec0 con 0x7f7a8c146510 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b4160 con 0x7f7a8c1438e0 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 0x7f7a8c15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 0x7f7a8c15f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44704/0 (socket says 172.21.15.40:44704) 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 -- 172.21.15.40:0/3677570440 learned_addr learned my addr 172.21.15.40:0/3677570440 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8b7fe640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c1438e0 0x7f7a8c163300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a90e20640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a8c146510 0x7f7a8c0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 -- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c1438e0 msgr2=0x7f7a8c163300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c1438e0 0x7f7a8c163300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 -- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a8c146510 msgr2=0x7f7a8c0b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a8c146510 0x7f7a8c0b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 -- 172.21.15.40:0/3677570440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740094d0 con 0x7f7a8c06a870 2023-11-04T01:43:09.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a8bfff640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 0x7f7a8c15f740 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c790 tx=0x7f7a7c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00cea0 con 0x7f7a8c06a870 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00a640 con 0x7f7a8c06a870 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00a9b0 con 0x7f7a8c06a870 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a84009420 con 0x7f7a8c06a870 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.218+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c0b4720 con 0x7f7a8c06a870 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.222+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c0675f0 con 0x7f7a8c06a870 2023-11-04T01:43:09.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.222+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a7c00ab10 con 0x7f7a8c06a870 2023-11-04T01:43:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.222+0000 7f7a88ff9640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a6c0664a0 0x7f7a6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.222+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f7a7c083750 con 0x7f7a8c06a870 2023-11-04T01:43:09.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.222+0000 7f7a8b7fe640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a6c0664a0 0x7f7a6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.222+0000 7f7a8b7fe640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a6c0664a0 0x7f7a6c068960 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c1604e0 tx=0x7f7a74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.226+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a7c050b20 con 0x7f7a8c06a870 2023-11-04T01:43:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.382+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7a8c071b50 con 0x7f7a8c06a870 2023-11-04T01:43:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.386+0000 7f7a88ff9640 1 -- 172.21.15.40:0/3677570440 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a7c054140 con 0x7f7a8c06a870 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a6c0664a0 msgr2=0x7f7a6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a6c0664a0 0x7f7a6c068960 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c1604e0 tx=0x7f7a74008040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 msgr2=0x7f7a8c15f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 0x7f7a8c15f740 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c790 tx=0x7f7a7c00cc50 comp rx=0 tx=0).stop 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 shutdown_connections 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7a6c0664a0 0x7f7a6c068960 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7a8c146510 0x7f7a8c0b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7a8c1438e0 0x7f7a8c163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 --2- 172.21.15.40:0/3677570440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8c06a870 0x7f7a8c15f740 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 >> 172.21.15.40:0/3677570440 conn(0x7f7a8c0cfc70 msgr2=0x7f7a8c13bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 shutdown_connections 2023-11-04T01:43:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.390+0000 7f7a92883640 1 -- 172.21.15.40:0/3677570440 wait complete. 2023-11-04T01:43:09.412 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:43:09.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:09.463 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:09.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:43:09.523 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:43:09.523 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:09.528 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:43:09.528 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:09.534 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:43:09.534 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:09.574 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:43:09.574 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.582 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:09.582 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:43:09.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:09.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 Processor -- start 2023-11-04T01:43:09.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 -- start start 2023-11-04T01:43:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe41415afd0 0x7fe4140715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4140b0d40 0x7fe41415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140c2670 con 0x7fe41406f8f0 2023-11-04T01:43:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe414070140 con 0x7fe4140b0d40 2023-11-04T01:43:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe41ac89640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41406c9f0 con 0x7fe41415afd0 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4140b0d40 0x7fe41415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4140b0d40 0x7fe41415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44718/0 (socket says 172.21.15.40:44718) 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 -- 172.21.15.40:0/3949227864 learned_addr learned my addr 172.21.15.40:0/3949227864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe418a25640 1 --2- 172.21.15.40:0/3949227864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe41415afd0 0x7fe4140715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 -- 172.21.15.40:0/3949227864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe41415afd0 msgr2=0x7fe4140715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 --2- 172.21.15.40:0/3949227864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe41415afd0 0x7fe4140715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 -- 172.21.15.40:0/3949227864 >> v1:172.21.15.91:6789/0 conn(0x7fe41406f8f0 legacy=0x7fe4140b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.746+0000 7fe419226640 1 -- 172.21.15.40:0/3949227864 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41406bc30 con 0x7fe4140b0d40 2023-11-04T01:43:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe419226640 1 --2- 172.21.15.40:0/3949227864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4140b0d40 0x7fe41415ec80 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0098a0 tx=0x7fe40c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd425407c62f83b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe4137fe640 1 -- 172.21.15.40:0/3949227864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0ab670 con 0x7fe4140b0d40 2023-11-04T01:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe4137fe640 1 -- 172.21.15.40:0/3949227864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0ab7d0 con 0x7fe4140b0d40 2023-11-04T01:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe4137fe640 1 -- 172.21.15.40:0/3949227864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0abb60 con 0x7fe4140b0d40 2023-11-04T01:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- 172.21.15.40:0/3949227864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4140b0d40 msgr2=0x7fe41415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 --2- 172.21.15.40:0/3949227864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4140b0d40 0x7fe41415ec80 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0098a0 tx=0x7fe40c01c4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- 172.21.15.40:0/3949227864 shutdown_connections 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 --2- 172.21.15.40:0/3949227864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4140b0d40 0x7fe41415ec80 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 --2- 172.21.15.40:0/3949227864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe41415afd0 0x7fe4140715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- 172.21.15.40:0/3949227864 >> 172.21.15.40:0/3949227864 conn(0x7fe4140cebb0 msgr2=0x7fe4140cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- 172.21.15.40:0/3949227864 shutdown_connections 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- 172.21.15.40:0/3949227864 wait complete. 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 Processor -- start 2023-11-04T01:43:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- start start 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe41406f8f0 0x7fe4140b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4140b0d40 0x7fe41415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 0x7fe4140af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415c970 con 0x7fe41415afd0 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415c0f0 con 0x7fe41406f8f0 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.750+0000 7fe41ac89640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415c3b0 con 0x7fe4140b0d40 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 0x7fe4140af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 0x7fe4140af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44730/0 (socket says 172.21.15.40:44730) 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 -- 172.21.15.40:0/714053128 learned_addr learned my addr 172.21.15.40:0/714053128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe418a25640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe41406f8f0 0x7fe4140b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe413fff640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4140b0d40 0x7fe41415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 -- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4140b0d40 msgr2=0x7fe41415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4140b0d40 0x7fe41415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 -- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe41406f8f0 msgr2=0x7fe4140b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe41406f8f0 0x7fe4140b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 -- 172.21.15.40:0/714053128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0094d0 con 0x7fe41415afd0 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe413fff640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4140b0d40 0x7fe41415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe418a25640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe41406f8f0 0x7fe4140b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe419226640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 0x7fe4140af150 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0ad040 tx=0x7fe40c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0b4800 con 0x7fe41415afd0 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c0b4960 con 0x7fe41415afd0 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41415c690 con 0x7fe41415afd0 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0b4cf0 con 0x7fe41415afd0 2023-11-04T01:43:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4140b4580 con 0x7fe41415afd0 2023-11-04T01:43:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4140744a0 con 0x7fe41415afd0 2023-11-04T01:43:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe40c0c7390 con 0x7fe41415afd0 2023-11-04T01:43:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe4117fa640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3f40664a0 0x7fe3f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fe40c11eae0 con 0x7fe41415afd0 2023-11-04T01:43:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.754+0000 7fe418a25640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3f40664a0 0x7fe3f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.758+0000 7fe418a25640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3f40664a0 0x7fe3f4068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe404009f50 tx=0x7fe40400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.758+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe40c0ebdf0 con 0x7fe41415afd0 2023-11-04T01:43:09.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.946+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4140b0060 con 0x7fe41415afd0 2023-11-04T01:43:09.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.946+0000 7fe4117fa640 1 -- 172.21.15.40:0/714053128 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3696 (secure 0 0 0) 0x7fe40c0ef410 con 0x7fe41415afd0 2023-11-04T01:43:09.953 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:09.953 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3911021107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6835","nonce":3911021107},{"type":"v1","addr":"172.21.15.91:6837","nonce":3911021107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6630,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/4179839459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4179839459},{"type":"v1","addr":"172.21.15.40:6833","nonce":4179839459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6633,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/802398855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":802398855},{"type":"v1","addr":"172.21.15.40:6835","nonce":802398855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6836/2855366917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":2855366917},{"type":"v1","addr":"172.21.15.91:6836","nonce":2855366917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[]} 2023-11-04T01:43:09.953 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 41 2023-11-04T01:43:09.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3f40664a0 msgr2=0x7fe3f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3f40664a0 0x7fe3f4068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe404009f50 tx=0x7fe40400b040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 msgr2=0x7fe4140af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 0x7fe4140af150 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0ad040 tx=0x7fe40c01acf0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 shutdown_connections 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3f40664a0 0x7fe3f4068960 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe41415afd0 0x7fe4140af150 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe4140b0d40 0x7fe41415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 --2- 172.21.15.40:0/714053128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe41406f8f0 0x7fe4140b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 >> 172.21.15.40:0/714053128 conn(0x7fe4140cebb0 msgr2=0x7fe4140cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 shutdown_connections 2023-11-04T01:43:09.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:09.950+0000 7fe41ac89640 1 -- 172.21.15.40:0/714053128 wait complete. 2023-11-04T01:43:09.970 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:43:09.970 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:43:09.971 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:43:09.971 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:09.971 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:43:09.971 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:43:09.971 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:43:09.971 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:09.971 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:43:09.972 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:43:09.972 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:43:09.972 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:09.972 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:43:09.972 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:43:09.972 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:43:09.972 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:09.980 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:43:09.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:43:09.982 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:43:09.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:43:09.985 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:43:09.986 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:43:09.986 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:43:09.986 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:43:10.027 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:43:10.028 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:10.029 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:43:10.029 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:10.031 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:43:10.032 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:10.032 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:43:10.033 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:10.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:43:10.084 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:43:10.099 INFO:tasks.ceph.mds.d.smithi091.stdout:starting mds.d at 2023-11-04T01:43:10.104 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:43:10.119 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:43:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 Processor -- start 2023-11-04T01:43:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 -- start start 2023-11-04T01:43:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd9c806cc60 0x7fd9c80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9c806d040 0x7fd9c80b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c806f480 con 0x7fd9c80ce920 2023-11-04T01:43:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80ce7c0 con 0x7fd9c806d040 2023-11-04T01:43:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cfe2a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c8070490 con 0x7fd9c806cc60 2023-11-04T01:43:10.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cd3c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9c806d040 0x7fd9c80b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9ce3c7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9c80ce920 0x7fd9c815c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44200/0 (socket says 172.21.15.40:44200) 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9ce3c7640 1 -- 172.21.15.40:0/3493969020 learned_addr learned my addr 172.21.15.40:0/3493969020 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cdbc6640 1 --2- 172.21.15.40:0/3493969020 >> v2:172.21.15.91:3300/0 conn(0x7fd9c806cc60 0x7fd9c80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cd3c5640 1 -- 172.21.15.40:0/3493969020 >> v2:172.21.15.91:3300/0 conn(0x7fd9c806cc60 msgr2=0x7fd9c80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cd3c5640 1 --2- 172.21.15.40:0/3493969020 >> v2:172.21.15.91:3300/0 conn(0x7fd9c806cc60 0x7fd9c80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cd3c5640 1 -- 172.21.15.40:0/3493969020 >> v1:172.21.15.40:6789/0 conn(0x7fd9c80ce920 legacy=0x7fd9c815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9cd3c5640 1 -- 172.21.15.40:0/3493969020 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c806c280 con 0x7fd9c806d040 2023-11-04T01:43:10.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.150+0000 7fd9ccbc4640 1 -- 172.21.15.40:0/3493969020 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497383576 0 0) 0x7fd9c806f480 con 0x7fd9c80ce920 2023-11-04T01:43:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cd3c5640 1 --2- 172.21.15.40:0/3493969020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806d040 0x7fd9c80b27d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80d0cb0 tx=0x7fd9b801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e65772df57e5f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9ccbc4640 1 -- 172.21.15.40:0/3493969020 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80ab600 con 0x7fd9c806d040 2023-11-04T01:43:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9ccbc4640 1 -- 172.21.15.40:0/3493969020 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80a7050 con 0x7fd9c806d040 2023-11-04T01:43:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9ccbc4640 1 -- 172.21.15.40:0/3493969020 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80ab980 con 0x7fd9c806d040 2023-11-04T01:43:10.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3493969020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806d040 msgr2=0x7fd9c80b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3493969020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806d040 0x7fd9c80b27d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80d0cb0 tx=0x7fd9b801c460 comp rx=0 tx=0).stop 2023-11-04T01:43:10.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3493969020 shutdown_connections 2023-11-04T01:43:10.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3493969020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806d040 0x7fd9c80b27d0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3493969020 >> v2:172.21.15.91:3300/0 conn(0x7fd9c806cc60 0x7fd9c80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3493969020 >> 172.21.15.40:0/3493969020 conn(0x7fd9c80cd7d0 msgr2=0x7fd9c80cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3493969020 shutdown_connections 2023-11-04T01:43:10.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3493969020 wait complete. 2023-11-04T01:43:10.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 Processor -- start 2023-11-04T01:43:10.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- start start 2023-11-04T01:43:10.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 0x7fd9c80cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9c806d040 0x7fd9c81551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9c80ce920 0x7fd9c80c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c8330 con 0x7fd9c806cc60 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8158230 con 0x7fd9c806d040 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cfe2a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c815b220 con 0x7fd9c80ce920 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 0x7fd9c80cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 0x7fd9c80cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44788/0 (socket says 172.21.15.40:44788) 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 -- 172.21.15.40:0/3881205696 learned_addr learned my addr 172.21.15.40:0/3881205696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cd3c5640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9c806d040 0x7fd9c81551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9ce3c7640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9c80ce920 0x7fd9c80c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 -- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9c80ce920 msgr2=0x7fd9c80c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9c80ce920 0x7fd9c80c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 -- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9c806d040 msgr2=0x7fd9c81551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9c806d040 0x7fd9c81551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 -- 172.21.15.40:0/3881205696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009420 con 0x7fd9c806cc60 2023-11-04T01:43:10.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9ce3c7640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9c80ce920 0x7fd9c80c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.154+0000 7fd9cdbc6640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 0x7fd9c80cab10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007ef0 tx=0x7fd9bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc014620 con 0x7fd9c806cc60 2023-11-04T01:43:10.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc014780 con 0x7fd9c806cc60 2023-11-04T01:43:10.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c815b500 con 0x7fd9c806cc60 2023-11-04T01:43:10.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc014b30 con 0x7fd9c806cc60 2023-11-04T01:43:10.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c80c7fc0 con 0x7fd9c806cc60 2023-11-04T01:43:10.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c80c7e00 con 0x7fd9c806cc60 2023-11-04T01:43:10.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9bc014c90 con 0x7fd9c806cc60 2023-11-04T01:43:10.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9c67fc640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9b40664a0 0x7fd9b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fd9bc085740 con 0x7fd9c806cc60 2023-11-04T01:43:10.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9cd3c5640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9b40664a0 0x7fd9b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.158+0000 7fd9cd3c5640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9b40664a0 0x7fd9b4068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ad000 tx=0x7fd9b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.162+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9bc052b50 con 0x7fd9c806cc60 2023-11-04T01:43:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:10.322+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd9c80744a0 con 0x7fd9c806cc60 2023-11-04T01:43:11.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.422+0000 7fd9c67fc640 1 -- 172.21.15.40:0/3881205696 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd9bc056170 con 0x7fd9c806cc60 2023-11-04T01:43:11.430 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-11-04T01:43:11.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9b40664a0 msgr2=0x7fd9b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9b40664a0 0x7fd9b4068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ad000 tx=0x7fd9b8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 msgr2=0x7fd9c80cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 0x7fd9c80cab10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007ef0 tx=0x7fd9bc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 shutdown_connections 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd9b40664a0 0x7fd9b4068960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9c80ce920 0x7fd9c80c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd9c806d040 0x7fd9c81551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 --2- 172.21.15.40:0/3881205696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c806cc60 0x7fd9c80cab10 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 >> 172.21.15.40:0/3881205696 conn(0x7fd9c80cd7d0 msgr2=0x7fd9c80cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 shutdown_connections 2023-11-04T01:43:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.430+0000 7fd9cfe2a640 1 -- 172.21.15.40:0/3881205696 wait complete. 2023-11-04T01:43:11.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:43:11.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.578+0000 7f2d69eb2640 1 Processor -- start 2023-11-04T01:43:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.578+0000 7f2d69eb2640 1 -- start start 2023-11-04T01:43:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d69eb2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2d6415afd0 0x7f2d640715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d69eb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d6406f8f0 0x7f2d640b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d69eb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d640b0b70 0x7f2d640c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d69eb2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d64070140 con 0x7f2d6406f8f0 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d69eb2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640b1000 con 0x7f2d6415afd0 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d69eb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6406c9f0 con 0x7f2d640b0b70 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d6406f8f0 0x7f2d640b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d6406f8f0 0x7f2d640b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44802/0 (socket says 172.21.15.40:44802) 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 -- 172.21.15.40:0/3084150061 learned_addr learned my addr 172.21.15.40:0/3084150061 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d637fe640 1 --2- 172.21.15.40:0/3084150061 >> v2:172.21.15.91:3300/0 conn(0x7f2d6415afd0 0x7f2d640715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d63fff640 1 --2- 172.21.15.40:0/3084150061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d640b0b70 0x7f2d640c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 -- 172.21.15.40:0/3084150061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d640b0b70 msgr2=0x7f2d640c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 --2- 172.21.15.40:0/3084150061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d640b0b70 0x7f2d640c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 -- 172.21.15.40:0/3084150061 >> v2:172.21.15.91:3300/0 conn(0x7f2d6415afd0 msgr2=0x7f2d640715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 --2- 172.21.15.40:0/3084150061 >> v2:172.21.15.91:3300/0 conn(0x7f2d6415afd0 0x7f2d640715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d5bfff640 1 -- 172.21.15.40:0/3084150061 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640c2670 con 0x7f2d6406f8f0 2023-11-04T01:43:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.582+0000 7f2d637fe640 1 --2- 172.21.15.40:0/3084150061 >> v2:172.21.15.91:3300/0 conn(0x7f2d6415afd0 0x7f2d640715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 --2- 172.21.15.40:0/3084150061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d6406f8f0 0x7f2d640b0630 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2d640ce980 tx=0x7f2d4c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e7419fb76f4553 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d62ffd640 1 -- 172.21.15.40:0/3084150061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0ab600 con 0x7f2d6406f8f0 2023-11-04T01:43:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d62ffd640 1 -- 172.21.15.40:0/3084150061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0a7050 con 0x7f2d6406f8f0 2023-11-04T01:43:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d62ffd640 1 -- 172.21.15.40:0/3084150061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0ab980 con 0x7f2d6406f8f0 2023-11-04T01:43:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- 172.21.15.40:0/3084150061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d6406f8f0 msgr2=0x7f2d640b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/3084150061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d6406f8f0 0x7f2d640b0630 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2d640ce980 tx=0x7f2d4c01c210 comp rx=0 tx=0).stop 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- 172.21.15.40:0/3084150061 shutdown_connections 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/3084150061 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d640b0b70 0x7f2d640c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/3084150061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d6406f8f0 0x7f2d640b0630 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/3084150061 >> v2:172.21.15.91:3300/0 conn(0x7f2d6415afd0 0x7f2d640715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- 172.21.15.40:0/3084150061 >> 172.21.15.40:0/3084150061 conn(0x7f2d640cebb0 msgr2=0x7f2d640cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- 172.21.15.40:0/3084150061 shutdown_connections 2023-11-04T01:43:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- 172.21.15.40:0/3084150061 wait complete. 2023-11-04T01:43:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 Processor -- start 2023-11-04T01:43:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- start start 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d6406f8f0 0x7f2d6413e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 0x7f2d640c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d6415afd0 0x7f2d640b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6414f390 con 0x7f2d640b0b70 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640b3a60 con 0x7f2d6415afd0 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d69eb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640b3d40 con 0x7f2d6406f8f0 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 0x7f2d640c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 0x7f2d640c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44814/0 (socket says 172.21.15.40:44814) 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 -- 172.21.15.40:0/2733575786 learned_addr learned my addr 172.21.15.40:0/2733575786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d637fe640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d6406f8f0 0x7f2d6413e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d63fff640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d6415afd0 0x7f2d640b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 -- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d6406f8f0 msgr2=0x7f2d6413e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d6406f8f0 0x7f2d6413e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 -- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d6415afd0 msgr2=0x7f2d640b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d6415afd0 0x7f2d640b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.586+0000 7f2d5bfff640 1 -- 172.21.15.40:0/2733575786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0094d0 con 0x7f2d640b0b70 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d5bfff640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 0x7f2d640c6f00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ae040 tx=0x7f2d4c01aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b6620 con 0x7f2d640b0b70 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0abe90 con 0x7f2d640b0b70 2023-11-04T01:43:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6414f630 con 0x7f2d640b0b70 2023-11-04T01:43:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b69c0 con 0x7f2d640b0b70 2023-11-04T01:43:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d64150af0 con 0x7f2d640b0b70 2023-11-04T01:43:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d640744a0 con 0x7f2d640b0b70 2023-11-04T01:43:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d4c0b2040 con 0x7f2d640b0b70 2023-11-04T01:43:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d60ff9640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d440664a0 0x7f2d44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7f2d4c11e170 con 0x7f2d640b0b70 2023-11-04T01:43:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d637fe640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d440664a0 0x7f2d44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.590+0000 7f2d637fe640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d440664a0 0x7f2d44068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009950 tx=0x7f2d54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.594+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d4c0eb3d0 con 0x7f2d640b0b70 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.806+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2d6406cba0 con 0x7f2d640b0b70 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.806+0000 7f2d60ff9640 1 -- 172.21.15.40:0/2733575786 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2d4c0ee9f0 con 0x7f2d640b0b70 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlbrFKGRAASazR1Bp7kYxhjPH9hCJ6vg==", 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVl0rABKBAAPxveq7HshZHhVFk+OdvJFQ==", 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlUZXOIRAA07iXObBR1kk/z+jIbVt+zw==", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:43:11.815 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlNdTRMBAA6oLqGWY0YaJMcUnBBCd8UQ==", 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC2oEVlSJdiAhAAapF/RX35jb5FSsopwNghQg==", 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC5oEVljg9KChAADcS3+VNV2xf4fL/sMXq5Zg==", 2023-11-04T01:43:11.817 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC8oEVlXWfRExAAfs1gt3DPGiYfHiUX8UNx/w==", 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.818 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/oEVl9sM1HhAAlEALfUHbbusqRxKKWjPT9g==", 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-11-04T01:43:11.819 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDFoEVlP59sHxAAYuXPjA33ZkH9uapffOABhA==", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDIoEVl0RvVJhAAkCrdMRxCBq4pI08mebQ/sg==", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.820 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDLoEVlkfn5LhAAbXcHP1pu2/kRDmWXVdYV4w==", 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.821 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDOoEVlBPaTOBAAQrgJeKVSHLb2AAwmSyccMA==", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q==", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.822 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow r", 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVljjVhAxAAMZM21HIsJnxFBOBLYTXCXQ==", 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.823 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlfwBnABAAuQas4IResAp91kwnXY6blg==", 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-11-04T01:43:11.824 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCzoEVlYjyICBAAebataOyYcVSP/H4S6q+/jw==", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlYH5cAhAAAtiBIRwfeOo/LLvHf3APaQ==", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-11-04T01:43:11.825 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlLnMWFhAANY0+MMGmLCQKLs/ILOeHfQ==", 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:11.826 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCyoEVlGsBlExAAkm/qgM7XNW1MvzCPShaUWQ==", 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-11-04T01:43:11.827 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:43:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d440664a0 msgr2=0x7f2d44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d440664a0 0x7f2d44068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009950 tx=0x7f2d54008040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 msgr2=0x7f2d640c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 0x7f2d640c6f00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ae040 tx=0x7f2d4c01aa50 comp rx=0 tx=0).stop 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 shutdown_connections 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d440664a0 0x7f2d44068960 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d6415afd0 0x7f2d640b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d640b0b70 0x7f2d640c6f00 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 --2- 172.21.15.40:0/2733575786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d6406f8f0 0x7f2d6413e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 >> 172.21.15.40:0/2733575786 conn(0x7f2d640cebb0 msgr2=0x7f2d640c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 shutdown_connections 2023-11-04T01:43:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.810+0000 7f2d69eb2640 1 -- 172.21.15.40:0/2733575786 wait complete. 2023-11-04T01:43:11.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.938+0000 7f366625d640 1 Processor -- start 2023-11-04T01:43:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.938+0000 7f366625d640 1 -- start start 2023-11-04T01:43:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36600d0690 0x7f36600b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f36600d0ae0 0x7f36600b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36600b6070 con 0x7f36600b4990 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600b8ed0 con 0x7f36600d0690 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600d1ce0 con 0x7f36600d0ae0 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36600d0690 0x7f36600b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36600d0690 0x7f36600b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44824/0 (socket says 172.21.15.40:44824) 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 -- 172.21.15.40:0/2162106624 learned_addr learned my addr 172.21.15.40:0/2162106624 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365ffff640 1 --2- 172.21.15.40:0/2162106624 >> v2:172.21.15.91:3300/0 conn(0x7f36600d0ae0 0x7f36600b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 -- 172.21.15.40:0/2162106624 >> v2:172.21.15.91:3300/0 conn(0x7f36600d0ae0 msgr2=0x7f36600b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 --2- 172.21.15.40:0/2162106624 >> v2:172.21.15.91:3300/0 conn(0x7f36600d0ae0 0x7f36600b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 -- 172.21.15.40:0/2162106624 >> v1:172.21.15.91:6789/0 conn(0x7f36600b4990 legacy=0x7f36600b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 -- 172.21.15.40:0/2162106624 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600d1fc0 con 0x7f36600d0690 2023-11-04T01:43:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365effd640 1 --2- 172.21.15.40:0/2162106624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600d0690 0x7f36600b64e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3660067730 tx=0x7f365401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98aed501198b7d72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365e7fc640 1 -- 172.21.15.40:0/2162106624 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540a89f0 con 0x7f36600d0690 2023-11-04T01:43:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365e7fc640 1 -- 172.21.15.40:0/2162106624 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36540a8b50 con 0x7f36600d0690 2023-11-04T01:43:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f365e7fc640 1 -- 172.21.15.40:0/2162106624 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540b0440 con 0x7f36600d0690 2023-11-04T01:43:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- 172.21.15.40:0/2162106624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600d0690 msgr2=0x7f36600b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 --2- 172.21.15.40:0/2162106624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600d0690 0x7f36600b64e0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3660067730 tx=0x7f365401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- 172.21.15.40:0/2162106624 shutdown_connections 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 --2- 172.21.15.40:0/2162106624 >> v2:172.21.15.91:3300/0 conn(0x7f36600d0ae0 0x7f36600b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 --2- 172.21.15.40:0/2162106624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600d0690 0x7f36600b64e0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- 172.21.15.40:0/2162106624 >> 172.21.15.40:0/2162106624 conn(0x7f36600cf990 msgr2=0x7f36600cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- 172.21.15.40:0/2162106624 shutdown_connections 2023-11-04T01:43:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.942+0000 7f366625d640 1 -- 172.21.15.40:0/2162106624 wait complete. 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 Processor -- start 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- start start 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 0x7f36600ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36600d0690 0x7f36600caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36600d0ae0 0x7f36600cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600cb470 con 0x7f36600b4990 2023-11-04T01:43:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366015db50 con 0x7f36600d0ae0 2023-11-04T01:43:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366015d570 con 0x7f36600d0690 2023-11-04T01:43:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 0x7f36600ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 0x7f36600ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44830/0 (socket says 172.21.15.40:44830) 2023-11-04T01:43:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 -- 172.21.15.40:0/3632430677 learned_addr learned my addr 172.21.15.40:0/3632430677 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365ffff640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36600d0ae0 0x7f36600cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365effd640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36600d0690 0x7f36600caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 -- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36600d0690 msgr2=0x7f36600caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36600d0690 0x7f36600caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 -- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36600d0ae0 msgr2=0x7f36600cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36600d0ae0 0x7f36600cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 -- 172.21.15.40:0/3632430677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36540094d0 con 0x7f36600b4990 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365ffff640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36600d0ae0 0x7f36600cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f365f7fe640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 0x7f36600ca9f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f365000c800 tx=0x7f365000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650003b80 con 0x7f36600b4990 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650003ce0 con 0x7f36600b4990 2023-11-04T01:43:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36601f2640 con 0x7f36600b4990 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000aa90 con 0x7f36600b4990 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366015d7e0 con 0x7f36600b4990 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36600744a0 con 0x7f36600b4990 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.946+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f365000abf0 con 0x7f36600b4990 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.950+0000 7f3647fff640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f364c0664a0 0x7f364c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.950+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7f3650083d90 con 0x7f36600b4990 2023-11-04T01:43:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.950+0000 7f365effd640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f364c0664a0 0x7f364c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.950+0000 7f365effd640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f364c0664a0 0x7f364c068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f36540b2000 tx=0x7f36540aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:11.954+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3650051120 con 0x7f36600b4990 2023-11-04T01:43:12.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.114+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36600d39e0 con 0x7f36600b4990 2023-11-04T01:43:12.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.114+0000 7f3647fff640 1 -- 172.21.15.40:0/3632430677 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18086 (secure 0 0 0) 0x7f3650054740 con 0x7f36600b4990 2023-11-04T01:43:12.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:12.121 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":87,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:43:11.424418+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f364c0664a0 msgr2=0x7f364c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f364c0664a0 0x7f364c068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f36540b2000 tx=0x7f36540aa070 comp rx=0 tx=0).stop 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 msgr2=0x7f36600ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 0x7f36600ca9f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f365000c800 tx=0x7f365000ccc0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 shutdown_connections 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f364c0664a0 0x7f364c068960 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f36600d0ae0 0x7f36600cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f36600d0690 0x7f36600caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 --2- 172.21.15.40:0/3632430677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36600b4990 0x7f36600ca9f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 >> 172.21.15.40:0/3632430677 conn(0x7f36600cf990 msgr2=0x7f36600b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 shutdown_connections 2023-11-04T01:43:12.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.118+0000 7f366625d640 1 -- 172.21.15.40:0/3632430677 wait complete. 2023-11-04T01:43:12.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:12.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:12.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 Processor -- start 2023-11-04T01:43:12.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 -- start start 2023-11-04T01:43:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f38c415acb0 0x7f38c415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c40cb130 con 0x7f38c415c160 2023-11-04T01:43:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c415bd40 con 0x7f38c415acb0 2023-11-04T01:43:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38cbd9c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c406fd80 con 0x7f38c40b0c20 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f38c415acb0 0x7f38c415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38ca339640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f38c415acb0 0x7f38c415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:59536/0 (socket says 172.21.15.40:59536) 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38ca339640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:39028/0 (socket says 172.21.15.40:39028) 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 -- 172.21.15.40:0/3040186193 learned_addr learned my addr 172.21.15.40:0/3040186193 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9337640 1 --1- 172.21.15.40:0/3040186193 >> v1:172.21.15.91:6789/0 conn(0x7f38c415c160 0x7f38c40b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:54402/0 (socket says 172.21.15.40:54402) 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 -- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 msgr2=0x7f38c40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 --2- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 -- 172.21.15.40:0/3040186193 >> v1:172.21.15.91:6789/0 conn(0x7f38c415c160 legacy=0x7f38c40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38c9b38640 1 -- 172.21.15.40:0/3040186193 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c415b680 con 0x7f38c415acb0 2023-11-04T01:43:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.262+0000 7f38ca339640 1 --2- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38c9b38640 1 --2- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415acb0 0x7f38c415b090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009870 tx=0x7f38bc01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4be5f1e49ca2d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38c8b36640 1 -- 172.21.15.40:0/3040186193 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0a95f0 con 0x7f38c415acb0 2023-11-04T01:43:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38c8b36640 1 -- 172.21.15.40:0/3040186193 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc0a9750 con 0x7f38c415acb0 2023-11-04T01:43:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38c8b36640 1 -- 172.21.15.40:0/3040186193 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0a9ae0 con 0x7f38c415acb0 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415acb0 msgr2=0x7f38c415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415acb0 0x7f38c415b090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009870 tx=0x7f38bc01c510 comp rx=0 tx=0).stop 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3040186193 shutdown_connections 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3040186193 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415acb0 0x7f38c415b090 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3040186193 >> 172.21.15.40:0/3040186193 conn(0x7f38c40cb510 msgr2=0x7f38c40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3040186193 shutdown_connections 2023-11-04T01:43:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.266+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3040186193 wait complete. 2023-11-04T01:43:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 Processor -- start 2023-11-04T01:43:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- start start 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 0x7f38c415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415c160 0x7f38c414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40b3a30 con 0x7f38c415acb0 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c5d00 con 0x7f38c415c160 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c5fe0 con 0x7f38c40b0c20 2023-11-04T01:43:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 0x7f38c415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 0x7f38c415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44838/0 (socket says 172.21.15.40:44838) 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 -- 172.21.15.40:0/3875109755 learned_addr learned my addr 172.21.15.40:0/3875109755 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9b38640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38ca339640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415c160 0x7f38c414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 -- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 msgr2=0x7f38c40b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 -- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415c160 msgr2=0x7f38c414b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415c160 0x7f38c414b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 -- 172.21.15.40:0/3875109755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009a70 con 0x7f38c415acb0 2023-11-04T01:43:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38c9337640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 0x7f38c415cdf0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c430 tx=0x7f38b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b40074e0 con 0x7f38c415acb0 2023-11-04T01:43:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4007640 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc0094d0 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4004a10 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c40c65a0 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.270+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c40744a0 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.274+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f38b4004b70 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.274+0000 7f38ba7fc640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f38a80664a0 0x7f38a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.274+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7f38b40839a0 con 0x7f38c415acb0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.274+0000 7f38c9b38640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f38a80664a0 0x7f38a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.274+0000 7f38c9b38640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f38a80664a0 0x7f38a8068960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0ae000 tx=0x7f38bc0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.278+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38b4050d20 con 0x7f38c415acb0 2023-11-04T01:43:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.426+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38c40cba00 con 0x7f38c415acb0 2023-11-04T01:43:12.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38ba7fc640 1 -- 172.21.15.40:0/3875109755 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38b4054340 con 0x7f38c415acb0 2023-11-04T01:43:12.438 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f38a80664a0 msgr2=0x7f38a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f38a80664a0 0x7f38a8068960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0ae000 tx=0x7f38bc0b3040 comp rx=0 tx=0).stop 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 msgr2=0x7f38c415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 0x7f38c415cdf0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c430 tx=0x7f38b400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 shutdown_connections 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f38a80664a0 0x7f38a8068960 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f38c415c160 0x7f38c414b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38c415acb0 0x7f38c415cdf0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 --2- 172.21.15.40:0/3875109755 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f38c40b0c20 0x7f38c40b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 >> 172.21.15.40:0/3875109755 conn(0x7f38c40cb510 msgr2=0x7f38c415dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 shutdown_connections 2023-11-04T01:43:12.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.434+0000 7f38cbd9c640 1 -- 172.21.15.40:0/3875109755 wait complete. 2023-11-04T01:43:12.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:12.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 Processor -- start 2023-11-04T01:43:12.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 -- start start 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fada015acb0 0x7fada015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fada00b0c20 0x7fada00ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada00cb130 con 0x7fada015c160 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada015bd40 con 0x7fada015acb0 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fada5cf5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada006fd80 con 0x7fada00b0c20 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fada015acb0 0x7fada015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad96ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fada015c160 0x7fada00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44208/0 (socket says 172.21.15.40:44208) 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fada015acb0 0x7fada015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44840/0 (socket says 172.21.15.40:44840) 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad96ffd640 1 -- 172.21.15.40:0/3547916689 learned_addr learned my addr 172.21.15.40:0/3547916689 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9ffff640 1 --2- 172.21.15.40:0/3547916689 >> v2:172.21.15.91:3300/0 conn(0x7fada00b0c20 0x7fada00ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9f7fe640 1 -- 172.21.15.40:0/3547916689 >> v2:172.21.15.91:3300/0 conn(0x7fada00b0c20 msgr2=0x7fada00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9f7fe640 1 --2- 172.21.15.40:0/3547916689 >> v2:172.21.15.91:3300/0 conn(0x7fada00b0c20 0x7fada00ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9f7fe640 1 -- 172.21.15.40:0/3547916689 >> v1:172.21.15.40:6789/0 conn(0x7fada015c160 legacy=0x7fada00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.578+0000 7fad9f7fe640 1 -- 172.21.15.40:0/3547916689 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada015b680 con 0x7fada015acb0 2023-11-04T01:43:12.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad9f7fe640 1 --2- 172.21.15.40:0/3547916689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada015b090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fad900097c0 tx=0x7fad9001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeecb3c4b06d4b83 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad9effd640 1 -- 172.21.15.40:0/3547916689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900a7070 con 0x7fada015acb0 2023-11-04T01:43:12.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad9effd640 1 -- 172.21.15.40:0/3547916689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad900ab430 con 0x7fada015acb0 2023-11-04T01:43:12.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad9effd640 1 -- 172.21.15.40:0/3547916689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900ab7c0 con 0x7fada015acb0 2023-11-04T01:43:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- 172.21.15.40:0/3547916689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 msgr2=0x7fada015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3547916689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada015b090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fad900097c0 tx=0x7fad9001c410 comp rx=0 tx=0).stop 2023-11-04T01:43:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- 172.21.15.40:0/3547916689 shutdown_connections 2023-11-04T01:43:12.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3547916689 >> v2:172.21.15.91:3300/0 conn(0x7fada00b0c20 0x7fada00ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3547916689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada015b090 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- 172.21.15.40:0/3547916689 >> 172.21.15.40:0/3547916689 conn(0x7fada00cb510 msgr2=0x7fada00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- 172.21.15.40:0/3547916689 shutdown_connections 2023-11-04T01:43:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- 172.21.15.40:0/3547916689 wait complete. 2023-11-04T01:43:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 Processor -- start 2023-11-04T01:43:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- start start 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada00b0c20 0x7fada0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fada015c160 0x7fada00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada006b300 con 0x7fada015acb0 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01fa6e0 con 0x7fada00b0c20 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fada5cf5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada01f9db0 con 0x7fada015c160 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada00c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44846/0 (socket says 172.21.15.40:44846) 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad96ffd640 1 -- 172.21.15.40:0/3535111418 learned_addr learned my addr 172.21.15.40:0/3535111418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad9f7fe640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada00b0c20 0x7fada0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.582+0000 7fad9ffff640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fada015c160 0x7fada00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad96ffd640 1 -- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fada015c160 msgr2=0x7fada00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad96ffd640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fada015c160 0x7fada00ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad96ffd640 1 -- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada00b0c20 msgr2=0x7fada0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad96ffd640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada00b0c20 0x7fada0151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad96ffd640 1 -- 172.21.15.40:0/3535111418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009420 con 0x7fada015acb0 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad96ffd640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada00c6550 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c430 tx=0x7fad8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88005cf0 con 0x7fada015acb0 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88005e50 con 0x7fada015acb0 2023-11-04T01:43:12.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880072d0 con 0x7fada015acb0 2023-11-04T01:43:12.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada01fa090 con 0x7fada015acb0 2023-11-04T01:43:12.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada00c6a90 con 0x7fada015acb0 2023-11-04T01:43:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada01fa820 con 0x7fada015acb0 2023-11-04T01:43:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad88007430 con 0x7fada015acb0 2023-11-04T01:43:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9cff9640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fad800664a0 0x7fad80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7fad88083360 con 0x7fada015acb0 2023-11-04T01:43:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9f7fe640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fad800664a0 0x7fad80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.586+0000 7fad9f7fe640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fad800664a0 0x7fad80068960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad900af000 tx=0x7fad900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.590+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad88050830 con 0x7fada015acb0 2023-11-04T01:43:12.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.746+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fada00744a0 con 0x7fada015acb0 2023-11-04T01:43:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.746+0000 7fad9cff9640 1 -- 172.21.15.40:0/3535111418 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7fad88053e50 con 0x7fada015acb0 2023-11-04T01:43:12.752 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fad800664a0 msgr2=0x7fad80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fad800664a0 0x7fad80068960 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad900af000 tx=0x7fad900a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 msgr2=0x7fada00c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada00c6550 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c430 tx=0x7fad8800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 shutdown_connections 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fad800664a0 0x7fad80068960 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fada015c160 0x7fada00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fada015acb0 0x7fada00c6550 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 --2- 172.21.15.40:0/3535111418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fada00b0c20 0x7fada0151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 >> 172.21.15.40:0/3535111418 conn(0x7fada00cb510 msgr2=0x7fada00b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 shutdown_connections 2023-11-04T01:43:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.750+0000 7fada5cf5640 1 -- 172.21.15.40:0/3535111418 wait complete. 2023-11-04T01:43:12.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.886+0000 7f9bc8fd8640 1 Processor -- start 2023-11-04T01:43:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.886+0000 7f9bc8fd8640 1 -- start start 2023-11-04T01:43:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc8fd8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9bc40cb610 0x7f9bc406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc8fd8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bc406a870 0x7f9bc415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc8fd8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc4160bd0 con 0x7f9bc4071ac0 2023-11-04T01:43:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc8fd8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40ce160 con 0x7f9bc406a870 2023-11-04T01:43:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc8fd8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc406e5d0 con 0x7f9bc40cb610 2023-11-04T01:43:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bc406a870 0x7f9bc415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bc406a870 0x7f9bc415c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44862/0 (socket says 172.21.15.40:44862) 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1770975735 learned_addr learned my addr 172.21.15.40:0/1770975735 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc259c640 1 --2- 172.21.15.40:0/1770975735 >> v2:172.21.15.91:3300/0 conn(0x7f9bc40cb610 0x7f9bc406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1770975735 >> v2:172.21.15.91:3300/0 conn(0x7f9bc40cb610 msgr2=0x7f9bc406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 --2- 172.21.15.40:0/1770975735 >> v2:172.21.15.91:3300/0 conn(0x7f9bc40cb610 0x7f9bc406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1770975735 >> v1:172.21.15.40:6789/0 conn(0x7f9bc4071ac0 legacy=0x7f9bc406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1770975735 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4160e20 con 0x7f9bc406a870 2023-11-04T01:43:12.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc159a640 1 -- 172.21.15.40:0/1770975735 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808092587 0 0) 0x7f9bc4160bd0 con 0x7f9bc4071ac0 2023-11-04T01:43:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc2d9d640 1 --2- 172.21.15.40:0/1770975735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc406a870 0x7f9bc415c7a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40b2680 tx=0x7f9bb401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23348eec1292ca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc159a640 1 -- 172.21.15.40:0/1770975735 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc415d4f0 con 0x7f9bc406a870 2023-11-04T01:43:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc159a640 1 -- 172.21.15.40:0/1770975735 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40a7050 con 0x7f9bc406a870 2023-11-04T01:43:12.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.890+0000 7f9bc159a640 1 -- 172.21.15.40:0/1770975735 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40ab820 con 0x7f9bc406a870 2023-11-04T01:43:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1770975735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc406a870 msgr2=0x7f9bc415c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1770975735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc406a870 0x7f9bc415c7a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40b2680 tx=0x7f9bb401c3e0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1770975735 shutdown_connections 2023-11-04T01:43:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1770975735 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc406a870 0x7f9bc415c7a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1770975735 >> v2:172.21.15.91:3300/0 conn(0x7f9bc40cb610 0x7f9bc406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1770975735 >> 172.21.15.40:0/1770975735 conn(0x7f9bc40cc5a0 msgr2=0x7f9bc40cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1770975735 shutdown_connections 2023-11-04T01:43:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1770975735 wait complete. 2023-11-04T01:43:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 Processor -- start 2023-11-04T01:43:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- start start 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bc406a870 0x7f9bc40c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bc4071ac0 0x7f9bc40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 0x7f9bc40c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40c2f50 con 0x7f9bc40cb610 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc415e240 con 0x7f9bc4071ac0 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40c73e0 con 0x7f9bc406a870 2023-11-04T01:43:12.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 0x7f9bc40c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 0x7f9bc40c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44864/0 (socket says 172.21.15.40:44864) 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1095605261 learned_addr learned my addr 172.21.15.40:0/1095605261 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc259c640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bc406a870 0x7f9bc40c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bc406a870 msgr2=0x7f9bc40c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bc406a870 0x7f9bc40c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bc4071ac0 msgr2=0x7f9bc40c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc1d9b640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bc4071ac0 0x7f9bc40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bc4071ac0 0x7f9bc40c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 -- 172.21.15.40:0/1095605261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40094d0 con 0x7f9bc40cb610 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc2d9d640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 0x7f9bc40c44b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ae040 tx=0x7f9bb4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40b6470 con 0x7f9bc40cb610 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40b65d0 con 0x7f9bc40cb610 2023-11-04T01:43:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40b6940 con 0x7f9bc40cb610 2023-11-04T01:43:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc40c9ba0 con 0x7f9bc40cb610 2023-11-04T01:43:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.894+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc415e7c0 con 0x7f9bc40cb610 2023-11-04T01:43:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.898+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc415e9b0 con 0x7f9bc40cb610 2023-11-04T01:43:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.898+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bb40b2070 con 0x7f9bc40cb610 2023-11-04T01:43:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.898+0000 7f9bbaffd640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ba40664a0 0x7f9ba4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.898+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7f9bb411e540 con 0x7f9bc40cb610 2023-11-04T01:43:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.898+0000 7f9bc259c640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ba40664a0 0x7f9ba4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.898+0000 7f9bc259c640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ba40664a0 0x7f9ba4068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009f30 tx=0x7f9bbc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:12.902+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9bb40eb8d0 con 0x7f9bc40cb610 2023-11-04T01:43:13.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f9bc40744a0 con 0x7f9bc40cb610 2023-11-04T01:43:13.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bbaffd640 1 -- 172.21.15.40:0/1095605261 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9bb40b00a0 con 0x7f9bc40cb610 2023-11-04T01:43:13.065 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ba40664a0 msgr2=0x7f9ba4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ba40664a0 0x7f9ba4068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009f30 tx=0x7f9bbc00b040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 msgr2=0x7f9bc40c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 0x7f9bc40c44b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ae040 tx=0x7f9bb4019180 comp rx=0 tx=0).stop 2023-11-04T01:43:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 shutdown_connections 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ba40664a0 0x7f9ba4068960 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc40cb610 0x7f9bc40c44b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bc4071ac0 0x7f9bc40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 --2- 172.21.15.40:0/1095605261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bc406a870 0x7f9bc40c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 >> 172.21.15.40:0/1095605261 conn(0x7f9bc40cc5a0 msgr2=0x7f9bc40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 shutdown_connections 2023-11-04T01:43:13.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.058+0000 7f9bc8fd8640 1 -- 172.21.15.40:0/1095605261 wait complete. 2023-11-04T01:43:13.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 Processor -- start 2023-11-04T01:43:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 -- start start 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff88006de30 0x7ff8800719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff880071250 0x7ff8800b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8800b3c10 con 0x7ff880159f00 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800cdb70 con 0x7ff880071250 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff888432640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800cde50 con 0x7ff88006de30 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8869cf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff880071250 0x7ff8800b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8861ce640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff880159f00 0x7ff880070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44226/0 (socket says 172.21.15.40:44226) 2023-11-04T01:43:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8861ce640 1 -- 172.21.15.40:0/1675359056 learned_addr learned my addr 172.21.15.40:0/1675359056 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8859cd640 1 --2- 172.21.15.40:0/1675359056 >> v2:172.21.15.91:3300/0 conn(0x7ff88006de30 0x7ff8800719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8869cf640 1 -- 172.21.15.40:0/1675359056 >> v2:172.21.15.91:3300/0 conn(0x7ff88006de30 msgr2=0x7ff8800719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8869cf640 1 --2- 172.21.15.40:0/1675359056 >> v2:172.21.15.91:3300/0 conn(0x7ff88006de30 0x7ff8800719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8851cc640 1 -- 172.21.15.40:0/1675359056 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944249405 0 0) 0x7ff8800b3c10 con 0x7ff880159f00 2023-11-04T01:43:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8869cf640 1 -- 172.21.15.40:0/1675359056 >> v1:172.21.15.40:6789/0 conn(0x7ff880159f00 legacy=0x7ff880070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.202+0000 7ff8869cf640 1 -- 172.21.15.40:0/1675359056 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88015a2e0 con 0x7ff880071250 2023-11-04T01:43:13.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8869cf640 1 --2- 172.21.15.40:0/1675359056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880071250 0x7ff8800b36d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff88006ca50 tx=0x7ff87801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bbfb971c165a1c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8851cc640 1 -- 172.21.15.40:0/1675359056 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780ac600 con 0x7ff880071250 2023-11-04T01:43:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8851cc640 1 -- 172.21.15.40:0/1675359056 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8780a8050 con 0x7ff880071250 2023-11-04T01:43:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8851cc640 1 -- 172.21.15.40:0/1675359056 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780ac980 con 0x7ff880071250 2023-11-04T01:43:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- 172.21.15.40:0/1675359056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880071250 msgr2=0x7ff8800b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 --2- 172.21.15.40:0/1675359056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880071250 0x7ff8800b36d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff88006ca50 tx=0x7ff87801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- 172.21.15.40:0/1675359056 shutdown_connections 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 --2- 172.21.15.40:0/1675359056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880071250 0x7ff8800b36d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 --2- 172.21.15.40:0/1675359056 >> v2:172.21.15.91:3300/0 conn(0x7ff88006de30 0x7ff8800719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- 172.21.15.40:0/1675359056 >> 172.21.15.40:0/1675359056 conn(0x7ff8800cfc70 msgr2=0x7ff8800d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- 172.21.15.40:0/1675359056 shutdown_connections 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- 172.21.15.40:0/1675359056 wait complete. 2023-11-04T01:43:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 Processor -- start 2023-11-04T01:43:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- start start 2023-11-04T01:43:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff880071250 0x7ff8801f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 0x7ff880149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff88006d080 0x7ff8801f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8801f6050 con 0x7ff880159f00 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8801f32c0 con 0x7ff880071250 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88006d510 con 0x7ff88006d080 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 0x7ff880149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 0x7ff880149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44896/0 (socket says 172.21.15.40:44896) 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 -- 172.21.15.40:0/1648440195 learned_addr learned my addr 172.21.15.40:0/1648440195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8861ce640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff880071250 0x7ff8801f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8869cf640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff88006d080 0x7ff8801f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 -- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff88006d080 msgr2=0x7ff8801f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff88006d080 0x7ff8801f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 -- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff880071250 msgr2=0x7ff8801f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff880071250 0x7ff8801f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 -- 172.21.15.40:0/1648440195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009420 con 0x7ff880159f00 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff8859cd640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 0x7ff880149890 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c7f0 tx=0x7ff87400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874004220 con 0x7ff880159f00 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8740043a0 con 0x7ff880159f00 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.206+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88006d7b0 con 0x7ff880159f00 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874004510 con 0x7ff880159f00 2023-11-04T01:43:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8801f5990 con 0x7ff880159f00 2023-11-04T01:43:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8801f6190 con 0x7ff880159f00 2023-11-04T01:43:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff874003a70 con 0x7ff880159f00 2023-11-04T01:43:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff87effd640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff86c0664a0 0x7ff86c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7ff874083ec0 con 0x7ff880159f00 2023-11-04T01:43:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff8861ce640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff86c0664a0 0x7ff86c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.210+0000 7ff8861ce640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff86c0664a0 0x7ff86c068960 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff870007fd0 tx=0x7ff870009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.214+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8801f6190 con 0x7ff880159f00 2023-11-04T01:43:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.366+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff8801f6190 con 0x7ff880159f00 2023-11-04T01:43:13.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff87effd640 1 -- 172.21.15.40:0/1648440195 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v87) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff8801f6190 con 0x7ff880159f00 2023-11-04T01:43:13.374 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:43:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff86c0664a0 msgr2=0x7ff86c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff86c0664a0 0x7ff86c068960 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff870007fd0 tx=0x7ff870009040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 msgr2=0x7ff880149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 0x7ff880149890 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff87400c7f0 tx=0x7ff87400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 shutdown_connections 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff86c0664a0 0x7ff86c068960 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff88006d080 0x7ff8801f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff880159f00 0x7ff880149890 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 --2- 172.21.15.40:0/1648440195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff880071250 0x7ff8801f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 >> 172.21.15.40:0/1648440195 conn(0x7ff8800cfc70 msgr2=0x7ff880157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 shutdown_connections 2023-11-04T01:43:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.370+0000 7ff888432640 1 -- 172.21.15.40:0/1648440195 wait complete. 2023-11-04T01:43:13.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:43:13.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 Processor -- start 2023-11-04T01:43:13.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 -- start start 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd5415afd0 0x7efd540715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efd540b0d40 0x7efd5415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd540c2670 con 0x7efd5406f8f0 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd54070140 con 0x7efd5415afd0 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd5a01d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5406c9f0 con 0x7efd540b0d40 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd5415afd0 0x7efd540715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd5415afd0 0x7efd540715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44910/0 (socket says 172.21.15.40:44910) 2023-11-04T01:43:13.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 -- 172.21.15.40:0/835389264 learned_addr learned my addr 172.21.15.40:0/835389264 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd53fff640 1 --2- 172.21.15.40:0/835389264 >> v2:172.21.15.91:3300/0 conn(0x7efd540b0d40 0x7efd5415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 -- 172.21.15.40:0/835389264 >> v2:172.21.15.91:3300/0 conn(0x7efd540b0d40 msgr2=0x7efd5415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 --2- 172.21.15.40:0/835389264 >> v2:172.21.15.91:3300/0 conn(0x7efd540b0d40 0x7efd5415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 -- 172.21.15.40:0/835389264 >> v1:172.21.15.40:6789/0 conn(0x7efd5406f8f0 legacy=0x7efd540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 -- 172.21.15.40:0/835389264 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5406bc30 con 0x7efd5415afd0 2023-11-04T01:43:13.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd53fff640 1 --2- 172.21.15.40:0/835389264 >> v2:172.21.15.91:3300/0 conn(0x7efd540b0d40 0x7efd5415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd537fe640 1 --2- 172.21.15.40:0/835389264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5415afd0 0x7efd540715d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7efd5406f7b0 tx=0x7efd4401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f284f0cfa1ab9561 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd527fc640 1 -- 172.21.15.40:0/835389264 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440aa430 con 0x7efd5415afd0 2023-11-04T01:43:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd527fc640 1 -- 172.21.15.40:0/835389264 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd440aa590 con 0x7efd5415afd0 2023-11-04T01:43:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.510+0000 7efd527fc640 1 -- 172.21.15.40:0/835389264 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440aa920 con 0x7efd5415afd0 2023-11-04T01:43:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/835389264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5415afd0 msgr2=0x7efd540715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 --2- 172.21.15.40:0/835389264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5415afd0 0x7efd540715d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7efd5406f7b0 tx=0x7efd4401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/835389264 shutdown_connections 2023-11-04T01:43:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 --2- 172.21.15.40:0/835389264 >> v2:172.21.15.91:3300/0 conn(0x7efd540b0d40 0x7efd5415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 --2- 172.21.15.40:0/835389264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5415afd0 0x7efd540715d0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/835389264 >> 172.21.15.40:0/835389264 conn(0x7efd540cebb0 msgr2=0x7efd540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/835389264 shutdown_connections 2023-11-04T01:43:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/835389264 wait complete. 2023-11-04T01:43:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 Processor -- start 2023-11-04T01:43:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- start start 2023-11-04T01:43:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 0x7efd540b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd540b0d40 0x7efd540cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd5415afd0 0x7efd540b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd540b4780 con 0x7efd5406f8f0 2023-11-04T01:43:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd541f6a40 con 0x7efd540b0d40 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd541f5ec0 con 0x7efd5415afd0 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 0x7efd540b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 0x7efd540b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44922/0 (socket says 172.21.15.40:44922) 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 -- 172.21.15.40:0/2587642766 learned_addr learned my addr 172.21.15.40:0/2587642766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 -- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd5415afd0 msgr2=0x7efd540b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd5415afd0 0x7efd540b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 -- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd540b0d40 msgr2=0x7efd540cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd52ffd640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd540b0d40 0x7efd540cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd540b0d40 0x7efd540cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 -- 172.21.15.40:0/2587642766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd440094d0 con 0x7efd5406f8f0 2023-11-04T01:43:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd537fe640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 0x7efd540b3650 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7efd440190e0 tx=0x7efd4401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440b3800 con 0x7efd5406f8f0 2023-11-04T01:43:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd440b3960 con 0x7efd5406f8f0 2023-11-04T01:43:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440b3d10 con 0x7efd5406f8f0 2023-11-04T01:43:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd541f61a0 con 0x7efd5406f8f0 2023-11-04T01:43:13.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.514+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd541f6760 con 0x7efd5406f8f0 2023-11-04T01:43:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.518+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd540744a0 con 0x7efd5406f8f0 2023-11-04T01:43:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.518+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd440b2380 con 0x7efd5406f8f0 2023-11-04T01:43:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.518+0000 7efd3bfff640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd400664a0 0x7efd40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.518+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7efd4411e4b0 con 0x7efd5406f8f0 2023-11-04T01:43:13.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.518+0000 7efd52ffd640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd400664a0 0x7efd40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.518+0000 7efd52ffd640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd400664a0 0x7efd40068960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efd540cd530 tx=0x7efd48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.522+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd440eb8e0 con 0x7efd5406f8f0 2023-11-04T01:43:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.678+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd5406cba0 con 0x7efd5406f8f0 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.678+0000 7efd3bfff640 1 -- 172.21.15.40:0/2587642766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+287 (secure 0 0 0) 0x7efd440eef00 con 0x7efd5406f8f0 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 6, 2023-11-04T01:43:13.685 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "snap-test-pool" 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 11, 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "test_data_pool" 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 12, 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:13.686 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-11-04T01:43:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd400664a0 msgr2=0x7efd40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd400664a0 0x7efd40068960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efd540cd530 tx=0x7efd48009040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 msgr2=0x7efd540b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 0x7efd540b3650 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7efd440190e0 tx=0x7efd4401ad10 comp rx=0 tx=0).stop 2023-11-04T01:43:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 shutdown_connections 2023-11-04T01:43:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efd400664a0 0x7efd40068960 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efd5415afd0 0x7efd540b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efd540b0d40 0x7efd540cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 --2- 172.21.15.40:0/2587642766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd5406f8f0 0x7efd540b3650 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 >> 172.21.15.40:0/2587642766 conn(0x7efd540cebb0 msgr2=0x7efd541577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 shutdown_connections 2023-11-04T01:43:13.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.682+0000 7efd5a01d640 1 -- 172.21.15.40:0/2587642766 wait complete. 2023-11-04T01:43:13.704 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:43:13.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:43:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.826+0000 7f4b9d1a4640 1 Processor -- start 2023-11-04T01:43:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.826+0000 7f4b9d1a4640 1 -- start start 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.826+0000 7f4b9d1a4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b980ca440 0x7f4b9815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980cb220 con 0x7f4b9815ae60 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9815ea00 con 0x7f4b9806b320 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9815b240 con 0x7f4b980ca440 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b980ca440 0x7f4b9815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b96d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4b9815ae60 0x7f4b980cab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44236/0 (socket says 172.21.15.40:44236) 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b96d9d640 1 -- 172.21.15.40:0/1420313980 learned_addr learned my addr 172.21.15.40:0/1420313980 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9659c640 1 -- 172.21.15.40:0/1420313980 >> v1:172.21.15.91:6789/0 conn(0x7f4b9806b320 legacy=0x7f4b9806b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9659c640 1 -- 172.21.15.40:0/1420313980 >> v1:172.21.15.40:6789/0 conn(0x7f4b9815ae60 legacy=0x7f4b980cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9659c640 1 -- 172.21.15.40:0/1420313980 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9806cda0 con 0x7f4b980ca440 2023-11-04T01:43:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b95d9b640 1 -- 172.21.15.40:0/1420313980 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351499022 0 0) 0x7f4b88001120 con 0x7f4b9815ae60 2023-11-04T01:43:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9659c640 1 --2- 172.21.15.40:0/1420313980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b980ca440 0x7f4b9815f190 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4b800097c0 tx=0x7f4b8001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46cb45a47ba3e84 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b95d9b640 1 -- 172.21.15.40:0/1420313980 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800ab650 con 0x7f4b980ca440 2023-11-04T01:43:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b95d9b640 1 -- 172.21.15.40:0/1420313980 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b800ab7b0 con 0x7f4b980ca440 2023-11-04T01:43:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b95d9b640 1 -- 172.21.15.40:0/1420313980 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b800abb40 con 0x7f4b980ca440 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/1420313980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b980ca440 msgr2=0x7f4b9815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/1420313980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b980ca440 0x7f4b9815f190 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4b800097c0 tx=0x7f4b8001c450 comp rx=0 tx=0).stop 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/1420313980 shutdown_connections 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/1420313980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b980ca440 0x7f4b9815f190 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/1420313980 >> 172.21.15.40:0/1420313980 conn(0x7f4b980b0630 msgr2=0x7f4b980b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/1420313980 shutdown_connections 2023-11-04T01:43:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.830+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/1420313980 wait complete. 2023-11-04T01:43:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 Processor -- start 2023-11-04T01:43:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- start start 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 0x7f4b980c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b980ca440 0x7f4b981664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b9815ae60 0x7f4b98143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980c22f0 con 0x7f4b9806b320 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98164ca0 con 0x7f4b980ca440 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980cc6d0 con 0x7f4b9815ae60 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 0x7f4b980c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 0x7f4b980c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44940/0 (socket says 172.21.15.40:44940) 2023-11-04T01:43:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 -- 172.21.15.40:0/399173289 learned_addr learned my addr 172.21.15.40:0/399173289 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9759e640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b9815ae60 0x7f4b98143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9659c640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b980ca440 0x7f4b981664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 -- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b9815ae60 msgr2=0x7f4b98143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b9815ae60 0x7f4b98143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 -- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b980ca440 msgr2=0x7f4b981664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b980ca440 0x7f4b981664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 -- 172.21.15.40:0/399173289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009420 con 0x7f4b9806b320 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b96d9d640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 0x7f4b980c1850 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800c410 tx=0x7f4b8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880074e0 con 0x7f4b9806b320 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88007640 con 0x7f4b9806b320 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b980cc9b0 con 0x7f4b9806b320 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88004a30 con 0x7f4b9806b320 2023-11-04T01:43:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b980c1d90 con 0x7f4b9806b320 2023-11-04T01:43:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.834+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b980cced0 con 0x7f4b9806b320 2023-11-04T01:43:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.838+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b88004b90 con 0x7f4b9806b320 2023-11-04T01:43:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.838+0000 7f4b8f7fe640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.838+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5948+0+0 (secure 0 0 0) 0x7f4b88083c50 con 0x7f4b9806b320 2023-11-04T01:43:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.838+0000 7f4b9659c640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.838+0000 7f4b9659c640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b78066470 0x7f4b78068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b800af000 tx=0x7f4b800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.842+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b980cced0 con 0x7f4b9806b320 2023-11-04T01:43:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:13.994+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4b980cb220 con 0x7f4b9806b320 2023-11-04T01:43:14.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.090+0000 7f4b8f7fe640 1 -- 172.21.15.40:0/399173289 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v88) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4b980cb220 con 0x7f4b9806b320 2023-11-04T01:43:14.096 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-11-04T01:43:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b78066470 msgr2=0x7f4b78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b78066470 0x7f4b78068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b800af000 tx=0x7f4b800a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 msgr2=0x7f4b980c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 0x7f4b980c1850 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800c410 tx=0x7f4b8800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 shutdown_connections 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4b78066470 0x7f4b78068930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4b9815ae60 0x7f4b98143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b980ca440 0x7f4b981664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 --2- 172.21.15.40:0/399173289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b9806b320 0x7f4b980c1850 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 >> 172.21.15.40:0/399173289 conn(0x7f4b980b0630 msgr2=0x7f4b980b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 shutdown_connections 2023-11-04T01:43:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.094+0000 7f4b9d1a4640 1 -- 172.21.15.40:0/399173289 wait complete. 2023-11-04T01:43:14.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:43:14.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0002595640 1 Processor -- start 2023-11-04T01:43:14.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0002595640 1 -- start start 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0002595640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efffc0b04e0 0x7efffc0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0002595640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0714c0 con 0x7efffc0c91b0 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0002595640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0711e0 con 0x7efffc159f90 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0002595640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc0b0eb0 con 0x7efffc0b04e0 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0000b32640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efffc0c91b0 0x7efffc070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44246/0 (socket says 172.21.15.40:44246) 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7f0000b32640 1 -- 172.21.15.40:0/2496881323 learned_addr learned my addr 172.21.15.40:0/2496881323 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7efffb7fe640 1 --2- 172.21.15.40:0/2496881323 >> v2:172.21.15.91:3300/0 conn(0x7efffc0b04e0 0x7efffc0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829395805 0 0) 0x7efffc0714c0 con 0x7efffc0c91b0 2023-11-04T01:43:14.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.254+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe8003530 con 0x7efffc0c91b0 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 891624021 0 0) 0x7effe8003530 con 0x7efffc0c91b0 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 >> v2:172.21.15.91:3300/0 conn(0x7efffc0b04e0 msgr2=0x7efffc0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 --2- 172.21.15.40:0/2496881323 >> v2:172.21.15.91:3300/0 conn(0x7efffc0b04e0 0x7efffc0b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 >> v1:172.21.15.91:6789/0 conn(0x7efffc159f90 legacy=0x7efffc0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0cd4a0 con 0x7efffc0c91b0 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7efff4001a00 con 0x7efffc0c91b0 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 >> v1:172.21.15.40:6789/0 conn(0x7efffc0c91b0 legacy=0x7efffc070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80039d0 0x7effe8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effe80047d0 0x7effe8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effe80051e0 0x7effe800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0b0eb0 con 0x7effe80051e0 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe800c130 con 0x7effe80039d0 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe800c2f0 con 0x7effe80047d0 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effe80051e0 0x7effe800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffbfff640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80039d0 0x7effe8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffb7fe640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effe80047d0 0x7effe8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 -- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effe80047d0 msgr2=0x7effe8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7effe80047d0 0x7effe8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 -- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80039d0 msgr2=0x7effe8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80039d0 0x7effe8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 -- 172.21.15.40:0/2496881323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8003530 con 0x7effe80051e0 2023-11-04T01:43:14.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 -- 172.21.15.40:0/2496881323 reap_dead start 2023-11-04T01:43:14.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0000b32640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effe80051e0 0x7effe800b990 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efff4002240 tx=0x7efff401f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3ce5c9e7343ed7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40b0070 con 0x7effe80051e0 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff40ac430 con 0x7effe80051e0 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7efffaffd640 1 -- 172.21.15.40:0/2496881323 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40ac7e0 con 0x7effe80051e0 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 -- 172.21.15.40:0/2496881323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effe80051e0 msgr2=0x7effe800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effe80051e0 0x7effe800b990 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efff4002240 tx=0x7efff401f980 comp rx=0 tx=0).stop 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 -- 172.21.15.40:0/2496881323 shutdown_connections 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 --2- 172.21.15.40:0/2496881323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effe80051e0 0x7effe800b990 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 -- 172.21.15.40:0/2496881323 >> 172.21.15.40:0/2496881323 conn(0x7efffc0ce9e0 msgr2=0x7efffc0cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 -- 172.21.15.40:0/2496881323 shutdown_connections 2023-11-04T01:43:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.258+0000 7f0002595640 1 -- 172.21.15.40:0/2496881323 wait complete. 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 Processor -- start 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- start start 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80051e0 0x7efffc1f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 0x7efffc1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efffc0c6550 0x7efffc0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1f4360 con 0x7efffc15a370 2023-11-04T01:43:14.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc15a8c0 con 0x7effe80051e0 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc15aba0 con 0x7efffc0c6550 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 0x7efffc1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 0x7efffc1f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44958/0 (socket says 172.21.15.40:44958) 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 -- 172.21.15.40:0/2703550001 learned_addr learned my addr 172.21.15.40:0/2703550001 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffbfff640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80051e0 0x7efffc1f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0000b32640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efffc0c6550 0x7efffc0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 -- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efffc0c6550 msgr2=0x7efffc0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efffc0c6550 0x7efffc0ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 -- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80051e0 msgr2=0x7efffc1f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80051e0 0x7efffc1f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 -- 172.21.15.40:0/2703550001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc15ae80 con 0x7efffc15a370 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efffb7fe640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 0x7efffc1f3e20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7effec011590 tx=0x7effec011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec015870 con 0x7efffc15a370 2023-11-04T01:43:14.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec0159d0 con 0x7efffc15a370 2023-11-04T01:43:14.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc15b160 con 0x7efffc15a370 2023-11-04T01:43:14.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec015d40 con 0x7efffc15a370 2023-11-04T01:43:14.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc0c69d0 con 0x7efffc15a370 2023-11-04T01:43:14.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.262+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc0744a0 con 0x7efffc15a370 2023-11-04T01:43:14.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.266+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7effec013400 con 0x7efffc15a370 2023-11-04T01:43:14.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.266+0000 7efff8ff9640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7effdc0664a0 0x7effdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.266+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6318+0+0 (secure 0 0 0) 0x7effec084730 con 0x7efffc15a370 2023-11-04T01:43:14.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.266+0000 7efffbfff640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7effdc0664a0 0x7effdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.266+0000 7efffbfff640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7effdc0664a0 0x7effdc068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effe4007fd0 tx=0x7effe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.270+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7effec0519e0 con 0x7efffc15a370 2023-11-04T01:43:14.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:14.426+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efffc15ace0 con 0x7efffc15a370 2023-11-04T01:43:15.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.093+0000 7efff8ff9640 1 -- 172.21.15.40:0/2703550001 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v89) v1 ==== 170+0+0 (secure 0 0 0) 0x7efffc15ace0 con 0x7efffc15a370 2023-11-04T01:43:15.101 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-11-04T01:43:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7effdc0664a0 msgr2=0x7effdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7effdc0664a0 0x7effdc068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effe4007fd0 tx=0x7effe4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 msgr2=0x7efffc1f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 0x7efffc1f3e20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7effec011590 tx=0x7effec011a50 comp rx=0 tx=0).stop 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 shutdown_connections 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7effdc0664a0 0x7effdc068960 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efffc0c6550 0x7efffc0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efffc15a370 0x7efffc1f3e20 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 --2- 172.21.15.40:0/2703550001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7effe80051e0 0x7efffc1f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 >> 172.21.15.40:0/2703550001 conn(0x7efffc0ce9e0 msgr2=0x7efffc15e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 shutdown_connections 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.097+0000 7f0002595640 1 -- 172.21.15.40:0/2703550001 wait complete. 2023-11-04T01:43:15.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:43:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 Processor -- start 2023-11-04T01:43:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 -- start start 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a3015acb0 0x7f1a3015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a300b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a300cb130 con 0x7f1a300b0a50 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3015bd40 con 0x7f1a3015acb0 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a36d6b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3006fd80 con 0x7f1a3015c160 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a34b07640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a3015acb0 0x7f1a3015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a35308640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1a300b0a50 0x7f1a300ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44252/0 (socket says 172.21.15.40:44252) 2023-11-04T01:43:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a35308640 1 -- 172.21.15.40:0/3627606751 learned_addr learned my addr 172.21.15.40:0/3627606751 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a2ffff640 1 --2- 172.21.15.40:0/3627606751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a300b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.281+0000 7f1a34b07640 1 -- 172.21.15.40:0/3627606751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 msgr2=0x7f1a300b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a34b07640 1 --2- 172.21.15.40:0/3627606751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a300b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a34b07640 1 -- 172.21.15.40:0/3627606751 >> v1:172.21.15.40:6789/0 conn(0x7f1a300b0a50 legacy=0x7f1a300ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a34b07640 1 -- 172.21.15.40:0/3627606751 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3015b680 con 0x7f1a3015acb0 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a2f7fe640 1 -- 172.21.15.40:0/3627606751 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502036812 0 0) 0x7f1a300cb130 con 0x7f1a300b0a50 2023-11-04T01:43:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a34b07640 1 --2- 172.21.15.40:0/3627606751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3015acb0 0x7f1a3015b090 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f1a200097c0 tx=0x7f1a2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29b6d6709ed0f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a2f7fe640 1 -- 172.21.15.40:0/3627606751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200ad640 con 0x7f1a3015acb0 2023-11-04T01:43:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a2f7fe640 1 -- 172.21.15.40:0/3627606751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a200ad7a0 con 0x7f1a3015acb0 2023-11-04T01:43:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a2f7fe640 1 -- 172.21.15.40:0/3627606751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200adb30 con 0x7f1a3015acb0 2023-11-04T01:43:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 -- 172.21.15.40:0/3627606751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3015acb0 msgr2=0x7f1a3015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/3627606751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3015acb0 0x7f1a3015b090 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f1a200097c0 tx=0x7f1a2001c480 comp rx=0 tx=0).stop 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 -- 172.21.15.40:0/3627606751 shutdown_connections 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/3627606751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a300b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/3627606751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3015acb0 0x7f1a3015b090 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 -- 172.21.15.40:0/3627606751 >> 172.21.15.40:0/3627606751 conn(0x7f1a300cb510 msgr2=0x7f1a300cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 -- 172.21.15.40:0/3627606751 shutdown_connections 2023-11-04T01:43:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.285+0000 7f1a36d6b640 1 -- 172.21.15.40:0/3627606751 wait complete. 2023-11-04T01:43:15.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 Processor -- start 2023-11-04T01:43:15.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 -- start start 2023-11-04T01:43:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 0x7f1a300c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a3015acb0 0x7f1a301f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a301f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300b3f40 con 0x7f1a300b0a50 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a30154070 con 0x7f1a3015acb0 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300b3c60 con 0x7f1a3015c160 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 0x7f1a300c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 0x7f1a300c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44974/0 (socket says 172.21.15.40:44974) 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 -- 172.21.15.40:0/2183853189 learned_addr learned my addr 172.21.15.40:0/2183853189 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a35308640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a301f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a2ffff640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a3015acb0 0x7f1a301f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 -- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 msgr2=0x7f1a301f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a301f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 -- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a3015acb0 msgr2=0x7f1a301f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a3015acb0 0x7f1a301f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 -- 172.21.15.40:0/2183853189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009420 con 0x7f1a300b0a50 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a35308640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a301f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a2ffff640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a3015acb0 0x7f1a301f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a34b07640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 0x7f1a300c6060 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f1a200b0040 tx=0x7f1a20019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200b6820 con 0x7f1a300b0a50 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a200a6040 con 0x7f1a300b0a50 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200b6bc0 con 0x7f1a300b0a50 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a30153a20 con 0x7f1a300b0a50 2023-11-04T01:43:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.289+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a30148390 con 0x7f1a300b0a50 2023-11-04T01:43:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.293+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a300744a0 con 0x7f1a300b0a50 2023-11-04T01:43:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.293+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a200b4040 con 0x7f1a300b0a50 2023-11-04T01:43:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.293+0000 7f1a2d7fa640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a1c0664a0 0x7f1a1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.293+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6700+0+0 (secure 0 0 0) 0x7f1a2011e710 con 0x7f1a300b0a50 2023-11-04T01:43:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.293+0000 7f1a2ffff640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a1c0664a0 0x7f1a1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.293+0000 7f1a2ffff640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a1c0664a0 0x7f1a1c068960 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1a30152890 tx=0x7f1a24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.297+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a200eb7c0 con 0x7f1a300b0a50 2023-11-04T01:43:15.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:15.485+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1a300cde30 con 0x7f1a300b0a50 2023-11-04T01:43:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.161+0000 7f1a2d7fa640 1 -- 172.21.15.40:0/2183853189 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1a200eede0 con 0x7f1a300b0a50 2023-11-04T01:43:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 15 and data pool 16 2023-11-04T01:43:16.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a1c0664a0 msgr2=0x7f1a1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a1c0664a0 0x7f1a1c068960 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1a30152890 tx=0x7f1a24008040 comp rx=0 tx=0).stop 2023-11-04T01:43:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 msgr2=0x7f1a300c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 0x7f1a300c6060 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f1a200b0040 tx=0x7f1a20019220 comp rx=0 tx=0).stop 2023-11-04T01:43:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 shutdown_connections 2023-11-04T01:43:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1a1c0664a0 0x7f1a1c068960 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1a3015c160 0x7f1a301f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a3015acb0 0x7f1a301f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 --2- 172.21.15.40:0/2183853189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a300b0a50 0x7f1a300c6060 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.177+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 >> 172.21.15.40:0/2183853189 conn(0x7f1a300cb510 msgr2=0x7f1a300ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.181+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 shutdown_connections 2023-11-04T01:43:16.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.181+0000 7f1a36d6b640 1 -- 172.21.15.40:0/2183853189 wait complete. 2023-11-04T01:43:16.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:16.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 Processor -- start 2023-11-04T01:43:16.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 -- start start 2023-11-04T01:43:16.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb415afd0 0x7f2fb40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2fb406f8f0 0x7f2fb40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb40c2670 con 0x7f2fb40b0b70 2023-11-04T01:43:16.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb4070140 con 0x7f2fb406f8f0 2023-11-04T01:43:16.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fbbcde640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb415fc90 con 0x7f2fb415afd0 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2fb406f8f0 0x7f2fb40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2fb406f8f0 0x7f2fb40b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44978/0 (socket says 172.21.15.40:44978) 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 -- 172.21.15.40:0/3131615571 learned_addr learned my addr 172.21.15.40:0/3131615571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9a7a640 1 --2- 172.21.15.40:0/3131615571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb415afd0 0x7f2fb40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 -- 172.21.15.40:0/3131615571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb415afd0 msgr2=0x7f2fb40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 --2- 172.21.15.40:0/3131615571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb415afd0 0x7f2fb40715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 -- 172.21.15.40:0/3131615571 >> v1:172.21.15.91:6789/0 conn(0x7f2fb40b0b70 legacy=0x7f2fb40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.329+0000 7f2fb9279640 1 -- 172.21.15.40:0/3131615571 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb406bc30 con 0x7f2fb406f8f0 2023-11-04T01:43:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fb9279640 1 --2- 172.21.15.40:0/3131615571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb406f8f0 0x7f2fb40b0630 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009870 tx=0x7f2fa401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8982ec733ed98ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fb8a78640 1 -- 172.21.15.40:0/3131615571 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40ab600 con 0x7f2fb406f8f0 2023-11-04T01:43:16.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fb8a78640 1 -- 172.21.15.40:0/3131615571 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa40a7050 con 0x7f2fb406f8f0 2023-11-04T01:43:16.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fb8a78640 1 -- 172.21.15.40:0/3131615571 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40ab980 con 0x7f2fb406f8f0 2023-11-04T01:43:16.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 -- 172.21.15.40:0/3131615571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb406f8f0 msgr2=0x7f2fb40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/3131615571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb406f8f0 0x7f2fb40b0630 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009870 tx=0x7f2fa401c500 comp rx=0 tx=0).stop 2023-11-04T01:43:16.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 -- 172.21.15.40:0/3131615571 shutdown_connections 2023-11-04T01:43:16.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/3131615571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb406f8f0 0x7f2fb40b0630 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/3131615571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb415afd0 0x7f2fb40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 -- 172.21.15.40:0/3131615571 >> 172.21.15.40:0/3131615571 conn(0x7f2fb40cebb0 msgr2=0x7f2fb40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 -- 172.21.15.40:0/3131615571 shutdown_connections 2023-11-04T01:43:16.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.333+0000 7f2fbbcde640 1 -- 172.21.15.40:0/3131615571 wait complete. 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 Processor -- start 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- start start 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb406f8f0 0x7f2fb40ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 0x7f2fb41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb415afd0 0x7f2fb40ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4156150 con 0x7f2fb40b0b70 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4155580 con 0x7f2fb415afd0 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4155820 con 0x7f2fb406f8f0 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 0x7f2fb41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 0x7f2fb41597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44982/0 (socket says 172.21.15.40:44982) 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 -- 172.21.15.40:0/439760434 learned_addr learned my addr 172.21.15.40:0/439760434 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9a7a640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb406f8f0 0x7f2fb40ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fba27b640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb415afd0 0x7f2fb40ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 -- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb406f8f0 msgr2=0x7f2fb40ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb406f8f0 0x7f2fb40ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 -- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb415afd0 msgr2=0x7f2fb40ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb415afd0 0x7f2fb40ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 -- 172.21.15.40:0/439760434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40094d0 con 0x7f2fb40b0b70 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fb9279640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 0x7f2fb41597d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40ae040 tx=0x7f2fa401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40b6620 con 0x7f2fb40b0b70 2023-11-04T01:43:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa40abe90 con 0x7f2fb40b0b70 2023-11-04T01:43:16.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb4155b00 con 0x7f2fb40b0b70 2023-11-04T01:43:16.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40b69e0 con 0x7f2fb40b0b70 2023-11-04T01:43:16.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb40ce650 con 0x7f2fb40b0b70 2023-11-04T01:43:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb40744a0 con 0x7f2fb40b0b70 2023-11-04T01:43:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.337+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fa40b2040 con 0x7f2fb40b0b70 2023-11-04T01:43:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.341+0000 7f2faa7fc640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f980664a0 0x7f2f98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.341+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f2fa411e5c0 con 0x7f2fb40b0b70 2023-11-04T01:43:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.341+0000 7f2fb9a7a640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f980664a0 0x7f2f98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.341+0000 7f2fb9a7a640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f980664a0 0x7f2f98068960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b9d0 tx=0x7f2fb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.345+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fa40eb600 con 0x7f2fb40b0b70 2023-11-04T01:43:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.501+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fb40744a0 con 0x7f2fb40b0b70 2023-11-04T01:43:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.501+0000 7f2faa7fc640 1 -- 172.21.15.40:0/439760434 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+21741 (secure 0 0 0) 0x7f2fa40eec20 con 0x7f2fb40b0b70 2023-11-04T01:43:16.510 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:16.510 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":90,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:43:15.492740+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f980664a0 msgr2=0x7f2f98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f980664a0 0x7f2f98068960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b9d0 tx=0x7f2fb0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 msgr2=0x7f2fb41597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 0x7f2fb41597d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40ae040 tx=0x7f2fa401ad40 comp rx=0 tx=0).stop 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 shutdown_connections 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f980664a0 0x7f2f98068960 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb415afd0 0x7f2fb40ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40b0b70 0x7f2fb41597d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 --2- 172.21.15.40:0/439760434 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2fb406f8f0 0x7f2fb40ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 >> 172.21.15.40:0/439760434 conn(0x7f2fb40cebb0 msgr2=0x7f2fb40c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 shutdown_connections 2023-11-04T01:43:16.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.505+0000 7f2fbbcde640 1 -- 172.21.15.40:0/439760434 wait complete. 2023-11-04T01:43:16.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:16.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 Processor -- start 2023-11-04T01:43:16.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 -- start start 2023-11-04T01:43:16.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fed1c0715d0 0x7fed1c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 0x7fed1c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c0c2670 con 0x7fed1c15afd0 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c070140 con 0x7fed1c0715d0 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed2150b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c071a60 con 0x7fed1c0b0b70 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fed1c15afd0 0x7fed1c06f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44266/0 (socket says 172.21.15.40:44266) 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1affd640 1 -- 172.21.15.40:0/2535230647 learned_addr learned my addr 172.21.15.40:0/2535230647 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1b7fe640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 0x7fed1c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/2535230647 >> v2:172.21.15.91:3300/0 conn(0x7fed1c0715d0 0x7fed1c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226263774 0 0) 0x7fed1c0c2670 con 0x7fed1c15afd0 2023-11-04T01:43:16.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed04003530 con 0x7fed1c15afd0 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219528811 0 0) 0x7fed04003530 con 0x7fed1c15afd0 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 msgr2=0x7fed1c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 0x7fed1c15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 >> v2:172.21.15.91:3300/0 conn(0x7fed1c0715d0 msgr2=0x7fed1c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 --2- 172.21.15.40:0/2535230647 >> v2:172.21.15.91:3300/0 conn(0x7fed1c0715d0 0x7fed1c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c06bc30 con 0x7fed1c15afd0 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fed0c001680 con 0x7fed1c15afd0 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 >> v1:172.21.15.40:6789/0 conn(0x7fed1c15afd0 legacy=0x7fed1c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 0x7fed04003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed04003f00 0x7fed040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04004d10 0x7fed04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c070140 con 0x7fed04003f00 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0400b990 con 0x7fed04004d10 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0400bad0 con 0x7fed1c0b0b70 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed04003f00 0x7fed040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1affd640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 0x7fed04003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1b7fe640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04004d10 0x7fed04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 -- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 msgr2=0x7fed04003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c0b0b70 0x7fed04003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 -- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04004d10 msgr2=0x7fed04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04004d10 0x7fed04005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.641+0000 7fed1a7fc640 1 -- 172.21.15.40:0/2535230647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04003530 con 0x7fed04003f00 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed04003f00 0x7fed040047d0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fed10009ae0 tx=0x7fed1001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56ee3c4909e1b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100a5570 con 0x7fed04003f00 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed100a56d0 con 0x7fed04003f00 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed19ffb640 1 -- 172.21.15.40:0/2535230647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100a5a80 con 0x7fed04003f00 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 -- 172.21.15.40:0/2535230647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed04003f00 msgr2=0x7fed040047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 --2- 172.21.15.40:0/2535230647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed04003f00 0x7fed040047d0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fed10009ae0 tx=0x7fed1001ca30 comp rx=0 tx=0).stop 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed1b7fe640 1 -- 172.21.15.40:0/2535230647 reap_dead start 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 -- 172.21.15.40:0/2535230647 shutdown_connections 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 -- 172.21.15.40:0/2535230647 >> 172.21.15.40:0/2535230647 conn(0x7fed1c0cebb0 msgr2=0x7fed1c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 -- 172.21.15.40:0/2535230647 shutdown_connections 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 -- 172.21.15.40:0/2535230647 wait complete. 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 Processor -- start 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.645+0000 7fed2150b640 1 -- start start 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04003f00 0x7fed1c0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 0x7fed1c0c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c1f0390 0x7fed1c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0c6f40 con 0x7fed1c0c8880 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0c7220 con 0x7fed04003f00 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0c7500 con 0x7fed1c1f0390 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 0x7fed1c0c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 0x7fed1c0c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45000/0 (socket says 172.21.15.40:45000) 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 -- 172.21.15.40:0/591601085 learned_addr learned my addr 172.21.15.40:0/591601085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1affd640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04003f00 0x7fed1c0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1b7fe640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c1f0390 0x7fed1c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 -- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c1f0390 msgr2=0x7fed1c1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c1f0390 0x7fed1c1f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 -- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04003f00 msgr2=0x7fed1c0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04003f00 0x7fed1c0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 -- 172.21.15.40:0/591601085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c0c77e0 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1affd640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04003f00 0x7fed1c0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1a7fc640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 0x7fed1c0c6640 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fed10009ae0 tx=0x7fed04005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100be070 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10004020 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10004390 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c0c7ac0 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c1f0d50 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c0744a0 con 0x7fed1c0c8880 2023-11-04T01:43:16.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed100b4040 con 0x7fed1c0c8880 2023-11-04T01:43:16.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed037fe640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fed080664a0 0x7fed08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fed1011dbe0 con 0x7fed1c0c8880 2023-11-04T01:43:16.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.649+0000 7fed1affd640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fed080664a0 0x7fed08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.653+0000 7fed1affd640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fed080664a0 0x7fed08068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001060 tx=0x7fed0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.657+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fed100eadd0 con 0x7fed1c0c8880 2023-11-04T01:43:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.813+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed1c06cba0 con 0x7fed1c0c8880 2023-11-04T01:43:16.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed037fe640 1 -- 172.21.15.40:0/591601085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+21741 (secure 0 0 0) 0x7fed100044f0 con 0x7fed1c0c8880 2023-11-04T01:43:16.822 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:16.822 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":90,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:43:15.492740+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:16.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fed080664a0 msgr2=0x7fed08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fed080664a0 0x7fed08068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001060 tx=0x7fed0c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:16.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 msgr2=0x7fed1c0c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 0x7fed1c0c6640 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fed10009ae0 tx=0x7fed04005800 comp rx=0 tx=0).stop 2023-11-04T01:43:16.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 shutdown_connections 2023-11-04T01:43:16.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fed080664a0 0x7fed08068960 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed1c1f0390 0x7fed1c1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed1c0c8880 0x7fed1c0c6640 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 --2- 172.21.15.40:0/591601085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed04003f00 0x7fed1c0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 >> 172.21.15.40:0/591601085 conn(0x7fed1c0cebb0 msgr2=0x7fed1c0c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 shutdown_connections 2023-11-04T01:43:16.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.817+0000 7fed2150b640 1 -- 172.21.15.40:0/591601085 wait complete. 2023-11-04T01:43:16.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:43:16.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 Processor -- start 2023-11-04T01:43:16.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 -- start start 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc99815acb0 0x7fc99815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc99815c160 0x7fc9980b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9980b0a50 0x7fc9980ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99815bd40 con 0x7fc99815c160 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99806fd80 con 0x7fc99815acb0 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc99d96d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980b0ee0 con 0x7fc9980b0a50 2023-11-04T01:43:16.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc9967fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc99815c160 0x7fc9980b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc9967fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc99815c160 0x7fc9980b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45004/0 (socket says 172.21.15.40:45004) 2023-11-04T01:43:16.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc9967fc640 1 -- 172.21.15.40:0/1380442769 learned_addr learned my addr 172.21.15.40:0/1380442769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:16.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc9977fe640 1 --2- 172.21.15.40:0/1380442769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9980b0a50 0x7fc9980ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.965+0000 7fc996ffd640 1 --2- 172.21.15.40:0/1380442769 >> v2:172.21.15.91:3300/0 conn(0x7fc99815acb0 0x7fc99815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc9967fc640 1 -- 172.21.15.40:0/1380442769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9980b0a50 msgr2=0x7fc9980ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc9967fc640 1 --2- 172.21.15.40:0/1380442769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9980b0a50 0x7fc9980ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc9967fc640 1 -- 172.21.15.40:0/1380442769 >> v2:172.21.15.91:3300/0 conn(0x7fc99815acb0 msgr2=0x7fc99815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc9967fc640 1 --2- 172.21.15.40:0/1380442769 >> v2:172.21.15.91:3300/0 conn(0x7fc99815acb0 0x7fc99815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc9967fc640 1 -- 172.21.15.40:0/1380442769 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980cb130 con 0x7fc99815c160 2023-11-04T01:43:16.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc996ffd640 1 --2- 172.21.15.40:0/1380442769 >> v2:172.21.15.91:3300/0 conn(0x7fc99815acb0 0x7fc99815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:16.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc9967fc640 1 --2- 172.21.15.40:0/1380442769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99815c160 0x7fc9980b0510 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc99806d550 tx=0x7fc98c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a43293155805487 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc995ffb640 1 -- 172.21.15.40:0/1380442769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0aa5f0 con 0x7fc99815c160 2023-11-04T01:43:16.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc995ffb640 1 -- 172.21.15.40:0/1380442769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0aa750 con 0x7fc99815c160 2023-11-04T01:43:16.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc995ffb640 1 -- 172.21.15.40:0/1380442769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0aaae0 con 0x7fc99815c160 2023-11-04T01:43:16.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 -- 172.21.15.40:0/1380442769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99815c160 msgr2=0x7fc9980b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1380442769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99815c160 0x7fc9980b0510 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc99806d550 tx=0x7fc98c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 -- 172.21.15.40:0/1380442769 shutdown_connections 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1380442769 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9980b0a50 0x7fc9980ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1380442769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc99815c160 0x7fc9980b0510 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1380442769 >> v2:172.21.15.91:3300/0 conn(0x7fc99815acb0 0x7fc99815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.969+0000 7fc99d96d640 1 -- 172.21.15.40:0/1380442769 >> 172.21.15.40:0/1380442769 conn(0x7fc9980cb510 msgr2=0x7fc9980cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- 172.21.15.40:0/1380442769 shutdown_connections 2023-11-04T01:43:16.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- 172.21.15.40:0/1380442769 wait complete. 2023-11-04T01:43:16.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 Processor -- start 2023-11-04T01:43:16.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- start start 2023-11-04T01:43:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 0x7fc99814bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc99815acb0 0x7fc9980c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc99815c160 0x7fc9980c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980c7da0 con 0x7fc9980b0a50 2023-11-04T01:43:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980b3320 con 0x7fc99815acb0 2023-11-04T01:43:16.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980c7ff0 con 0x7fc99815c160 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 0x7fc99814bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 0x7fc99814bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45010/0 (socket says 172.21.15.40:45010) 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 -- 172.21.15.40:0/1473164344 learned_addr learned my addr 172.21.15.40:0/1473164344 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc9977fe640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc99815c160 0x7fc9980c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc9967fc640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc99815acb0 0x7fc9980c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 -- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc99815c160 msgr2=0x7fc9980c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc99815c160 0x7fc9980c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 -- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc99815acb0 msgr2=0x7fc9980c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc99815acb0 0x7fc9980c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 -- 172.21.15.40:0/1473164344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0094d0 con 0x7fc9980b0a50 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc996ffd640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 0x7fc99814bbc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc98800e810 tx=0x7fc98800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800c8d0 con 0x7fc9980b0a50 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800ca30 con 0x7fc9980b0a50 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9980c82d0 con 0x7fc9980b0a50 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800cde0 con 0x7fc9980b0a50 2023-11-04T01:43:16.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.973+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9980c8890 con 0x7fc9980b0a50 2023-11-04T01:43:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.977+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9980744a0 con 0x7fc9980b0a50 2023-11-04T01:43:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.977+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc988013410 con 0x7fc9980b0a50 2023-11-04T01:43:16.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.977+0000 7fc97ffff640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9840664a0 0x7fc984068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.977+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fc988083fd0 con 0x7fc9980b0a50 2023-11-04T01:43:16.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.977+0000 7fc9967fc640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9840664a0 0x7fc984068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.977+0000 7fc9967fc640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9840664a0 0x7fc984068960 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0ae000 tx=0x7fc98c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:16.981+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc988051150 con 0x7fc9980b0a50 2023-11-04T01:43:17.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:17.177+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc9980cde30 con 0x7fc9980b0a50 2023-11-04T01:43:18.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.177+0000 7fc97ffff640 1 -- 172.21.15.40:0/1473164344 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc988054770 con 0x7fc9980b0a50 2023-11-04T01:43:18.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9840664a0 msgr2=0x7fc984068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9840664a0 0x7fc984068960 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0ae000 tx=0x7fc98c0b5040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 msgr2=0x7fc99814bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 0x7fc99814bbc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc98800e810 tx=0x7fc98800ecd0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 shutdown_connections 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9840664a0 0x7fc984068960 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc99815c160 0x7fc9980c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc99815acb0 0x7fc9980c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 --2- 172.21.15.40:0/1473164344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9980b0a50 0x7fc99814bbc0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 >> 172.21.15.40:0/1473164344 conn(0x7fc9980cb510 msgr2=0x7fc99815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 shutdown_connections 2023-11-04T01:43:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.181+0000 7fc99d96d640 1 -- 172.21.15.40:0/1473164344 wait complete. 2023-11-04T01:43:18.209 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:43:18.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:43:18.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 Processor -- start 2023-11-04T01:43:18.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 -- start start 2023-11-04T01:43:18.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6de815d290 0x7f6de80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6de80b0a50 0x7f6de806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80b0eb0 con 0x7f6de806b840 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de8161cc0 con 0x7f6de80b0a50 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6df03ab640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80c90e0 con 0x7f6de815d290 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6dee948640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6de806b840 0x7f6de80cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60958/0 (socket says 172.21.15.40:60958) 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded946640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6de80b0a50 0x7f6de806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6dee948640 1 -- 172.21.15.40:0/74238630 learned_addr learned my addr 172.21.15.40:0/74238630 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded145640 1 -- 172.21.15.40:0/74238630 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443112693 0 0) 0x7f6de80b0eb0 con 0x7f6de806b840 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6dee147640 1 --2- 172.21.15.40:0/74238630 >> v2:172.21.15.91:3300/0 conn(0x7f6de815d290 0x7f6de80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded145640 1 -- 172.21.15.40:0/74238630 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd4003530 con 0x7f6de806b840 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded946640 1 -- 172.21.15.40:0/74238630 >> v2:172.21.15.91:3300/0 conn(0x7f6de815d290 msgr2=0x7f6de80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded946640 1 --2- 172.21.15.40:0/74238630 >> v2:172.21.15.91:3300/0 conn(0x7f6de815d290 0x7f6de80b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded946640 1 -- 172.21.15.40:0/74238630 >> v1:172.21.15.40:6789/0 conn(0x7f6de806b840 legacy=0x7f6de80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.333+0000 7f6ded946640 1 -- 172.21.15.40:0/74238630 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de806c010 con 0x7f6de80b0a50 2023-11-04T01:43:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6ded946640 1 --2- 172.21.15.40:0/74238630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de80b0a50 0x7f6de806b300 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6de806da90 tx=0x7f6dd801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed3ad2e5ad42c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6ded145640 1 -- 172.21.15.40:0/74238630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80a58c0 con 0x7f6de80b0a50 2023-11-04T01:43:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6ded145640 1 -- 172.21.15.40:0/74238630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd80a5a20 con 0x7f6de80b0a50 2023-11-04T01:43:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6ded145640 1 -- 172.21.15.40:0/74238630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80a5db0 con 0x7f6de80b0a50 2023-11-04T01:43:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 -- 172.21.15.40:0/74238630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de80b0a50 msgr2=0x7f6de806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 --2- 172.21.15.40:0/74238630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de80b0a50 0x7f6de806b300 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6de806da90 tx=0x7f6dd801c8e0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 -- 172.21.15.40:0/74238630 shutdown_connections 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 --2- 172.21.15.40:0/74238630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de80b0a50 0x7f6de806b300 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 --2- 172.21.15.40:0/74238630 >> v2:172.21.15.91:3300/0 conn(0x7f6de815d290 0x7f6de80b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 -- 172.21.15.40:0/74238630 >> 172.21.15.40:0/74238630 conn(0x7f6de80cb510 msgr2=0x7f6de80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 -- 172.21.15.40:0/74238630 shutdown_connections 2023-11-04T01:43:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 -- 172.21.15.40:0/74238630 wait complete. 2023-11-04T01:43:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 Processor -- start 2023-11-04T01:43:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 -- start start 2023-11-04T01:43:18.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.337+0000 7f6df03ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 0x7f6de8154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6de80b0a50 0x7f6de8152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6de815d290 0x7f6de80af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80c8a10 con 0x7f6de806b840 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80b00b0 con 0x7f6de80b0a50 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80b2cb0 con 0x7f6de815d290 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 0x7f6de8154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 0x7f6de8154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44904/0 (socket says 172.21.15.40:44904) 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 -- 172.21.15.40:0/4055286879 learned_addr learned my addr 172.21.15.40:0/4055286879 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6ded946640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6de80b0a50 0x7f6de8152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee948640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6de815d290 0x7f6de80af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 -- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6de815d290 msgr2=0x7f6de80af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6de815d290 0x7f6de80af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 -- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6de80b0a50 msgr2=0x7f6de8152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6de80b0a50 0x7f6de8152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 -- 172.21.15.40:0/4055286879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8009a70 con 0x7f6de806b840 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6dee147640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 0x7f6de8154dd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000d5f0 tx=0x7f6dd000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00125f0 con 0x7f6de806b840 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0012750 con 0x7f6de806b840 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de80b3140 con 0x7f6de806b840 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0012ae0 con 0x7f6de806b840 2023-11-04T01:43:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80b0300 con 0x7f6de806b840 2023-11-04T01:43:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de80744a0 con 0x7f6de806b840 2023-11-04T01:43:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6dd0012c40 con 0x7f6de806b840 2023-11-04T01:43:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6de6ffd640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6dc80664a0 0x7f6dc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f6dd0084730 con 0x7f6de806b840 2023-11-04T01:43:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.341+0000 7f6ded946640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6dc80664a0 0x7f6dc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.345+0000 7f6ded946640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6dc80664a0 0x7f6dc8068960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80af000 tx=0x7f6dd80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.345+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6dd0051800 con 0x7f6de806b840 2023-11-04T01:43:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:18.541+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6de80ade30 con 0x7f6de806b840 2023-11-04T01:43:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.201+0000 7f6de6ffd640 1 -- 172.21.15.40:0/4055286879 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6dd0054e20 con 0x7f6de806b840 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.201+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6dc80664a0 msgr2=0x7f6dc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.201+0000 7f6df03ab640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6dc80664a0 0x7f6dc8068960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80af000 tx=0x7f6dd80a7070 comp rx=0 tx=0).stop 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 msgr2=0x7f6de8154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 0x7f6de8154dd0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000d5f0 tx=0x7f6dd000dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 shutdown_connections 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6dc80664a0 0x7f6dc8068960 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6de815d290 0x7f6de80af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6de80b0a50 0x7f6de8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 --2- 172.21.15.40:0/4055286879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6de806b840 0x7f6de8154dd0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 >> 172.21.15.40:0/4055286879 conn(0x7f6de80cb510 msgr2=0x7f6de80c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 shutdown_connections 2023-11-04T01:43:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.205+0000 7f6df03ab640 1 -- 172.21.15.40:0/4055286879 wait complete. 2023-11-04T01:43:19.230 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:43:19.230 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:19.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 Processor -- start 2023-11-04T01:43:19.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 -- start start 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f898c15b470 0x7f898c15f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 0x7f898c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c0cbe40 con 0x7f898c15b090 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c15fca0 con 0x7f898c15b470 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f89922b9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0cc120 con 0x7f898c06a870 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f898c15b090 0x7f898c06a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60974/0 (socket says 172.21.15.40:60974) 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 -- 172.21.15.40:0/1951471149 learned_addr learned my addr 172.21.15.40:0/1951471149 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417248038 0 0) 0x7f898c0cbe40 con 0x7f898c15b090 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8974003530 con 0x7f898c15b090 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898b7fe640 1 --2- 172.21.15.40:0/1951471149 >> v2:172.21.15.91:3300/0 conn(0x7f898c15b470 0x7f898c15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f8990856640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 0x7f898c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 83597172 0 0) 0x7f8974003530 con 0x7f898c15b090 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 msgr2=0x7f898c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 0x7f898c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 >> v2:172.21.15.91:3300/0 conn(0x7f898c15b470 msgr2=0x7f898c15f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 --2- 172.21.15.40:0/1951471149 >> v2:172.21.15.91:3300/0 conn(0x7f898c15b470 0x7f898c15f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0cc400 con 0x7f898c15b090 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8984001a20 con 0x7f898c15b090 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 >> v1:172.21.15.40:6789/0 conn(0x7f898c15b090 legacy=0x7f898c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8974003980 0x7f8974003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 0x7f89740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c15fca0 con 0x7f8974003980 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0cc120 con 0x7f8974004d10 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897400ba90 con 0x7f898c06a870 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898b7fe640 1 --2- 172.21.15.40:0/1951471149 >> v2:172.21.15.91:3300/0 conn(0x7f898c15b470 0x7f898c15f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8974003980 0x7f8974003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f8990856640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898b7fe640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 0x7f89740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 -- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 msgr2=0x7f89740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c06a870 0x7f89740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 -- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974004d10 msgr2=0x7f8974005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.349+0000 7f898bfff640 1 -- 172.21.15.40:0/1951471149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974003530 con 0x7f8974003980 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f898bfff640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8974003980 0x7f8974003da0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f898400a850 tx=0x7f898401d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea45f9918affe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840ad630 con 0x7f8974003980 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89840a8070 con 0x7f8974003980 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f898affd640 1 -- 172.21.15.40:0/1951471149 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840ad9f0 con 0x7f8974003980 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 -- 172.21.15.40:0/1951471149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8974003980 msgr2=0x7f8974003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 --2- 172.21.15.40:0/1951471149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8974003980 0x7f8974003da0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f898400a850 tx=0x7f898401d310 comp rx=0 tx=0).stop 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f8990856640 1 -- 172.21.15.40:0/1951471149 reap_dead start 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 -- 172.21.15.40:0/1951471149 shutdown_connections 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 -- 172.21.15.40:0/1951471149 >> 172.21.15.40:0/1951471149 conn(0x7f898c0716a0 msgr2=0x7f898c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 -- 172.21.15.40:0/1951471149 shutdown_connections 2023-11-04T01:43:19.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 -- 172.21.15.40:0/1951471149 wait complete. 2023-11-04T01:43:19.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 Processor -- start 2023-11-04T01:43:19.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.353+0000 7f89922b9640 1 -- start start 2023-11-04T01:43:19.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974003980 0x7f898c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c0c81c0 0x7f898c0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 0x7f898c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c155300 con 0x7f898c0c8640 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0add60 con 0x7f8974003980 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0c7d30 con 0x7f898c0c81c0 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 0x7f898c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 0x7f898c0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44924/0 (socket says 172.21.15.40:44924) 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 -- 172.21.15.40:0/1682008093 learned_addr learned my addr 172.21.15.40:0/1682008093 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f898b7fe640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c0c81c0 0x7f898c0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f898bfff640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974003980 0x7f898c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 -- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c0c81c0 msgr2=0x7f898c0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c0c81c0 0x7f898c0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 -- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974003980 msgr2=0x7f898c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974003980 0x7f898c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 -- 172.21.15.40:0/1682008093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0c7120 con 0x7f898c0c8640 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8990856640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 0x7f898c0c6a30 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f898c070260 tx=0x7f897c014f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c004500 con 0x7f898c0c8640 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c013040 con 0x7f898c0c8640 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c0c7400 con 0x7f898c0c8640 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c003880 con 0x7f898c0c8640 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c0c79c0 con 0x7f898c0c8640 2023-11-04T01:43:19.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c0675f0 con 0x7f898c0c8640 2023-11-04T01:43:19.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f897c0039e0 con 0x7f898c0c8640 2023-11-04T01:43:19.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8988ff9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f89780664d0 0x7f8978068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f897c0885c0 con 0x7f898c0c8640 2023-11-04T01:43:19.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.357+0000 7f898bfff640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f89780664d0 0x7f8978068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.361+0000 7f898bfff640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f89780664d0 0x7f8978068990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f89840ad000 tx=0x7f8984001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.361+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f897c055580 con 0x7f898c0c8640 2023-11-04T01:43:19.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.553+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f898c0c7e70 con 0x7f898c0c8640 2023-11-04T01:43:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.553+0000 7f8988ff9640 1 -- 172.21.15.40:0/1682008093 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f897c017340 con 0x7f898c0c8640 2023-11-04T01:43:19.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:19.561 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:18.546352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:19.562 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 47 2023-11-04T01:43:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f89780664d0 msgr2=0x7f8978068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f89780664d0 0x7f8978068990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f89840ad000 tx=0x7f8984001e20 comp rx=0 tx=0).stop 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 msgr2=0x7f898c0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 0x7f898c0c6a30 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f898c070260 tx=0x7f897c014f60 comp rx=0 tx=0).stop 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 shutdown_connections 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f89780664d0 0x7f8978068990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f898c0c8640 0x7f898c0c6a30 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f898c0c81c0 0x7f898c0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 --2- 172.21.15.40:0/1682008093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8974003980 0x7f898c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 >> 172.21.15.40:0/1682008093 conn(0x7f898c0716a0 msgr2=0x7f898c15a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 shutdown_connections 2023-11-04T01:43:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.557+0000 7f89922b9640 1 -- 172.21.15.40:0/1682008093 wait complete. 2023-11-04T01:43:19.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:19.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 Processor -- start 2023-11-04T01:43:19.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 -- start start 2023-11-04T01:43:19.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd8c40c2670 0x7fd8c40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c40b0b70 0x7fd8c415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c40b0fc0 con 0x7fd8c415b290 2023-11-04T01:43:19.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c406c740 con 0x7fd8c40c2670 2023-11-04T01:43:19.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8ca5db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c415b670 con 0x7fd8c40b0b70 2023-11-04T01:43:19.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c37fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd8c40c2670 0x7fd8c40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c3fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd8c415b290 0x7fd8c406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:45520/0 (socket says 172.21.15.40:45520) 2023-11-04T01:43:19.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c8b78640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c40b0b70 0x7fd8c415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c3fff640 1 -- 172.21.15.40:0/580624715 learned_addr learned my addr 172.21.15.40:0/580624715 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:19.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c37fe640 1 -- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c40b0b70 msgr2=0x7fd8c415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c37fe640 1 --2- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c40b0b70 0x7fd8c415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c37fe640 1 -- 172.21.15.40:0/580624715 >> v1:172.21.15.91:6789/0 conn(0x7fd8c415b290 legacy=0x7fd8c406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.693+0000 7fd8c37fe640 1 -- 172.21.15.40:0/580624715 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c406bb30 con 0x7fd8c40c2670 2023-11-04T01:43:19.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8c37fe640 1 --2- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40c2670 0x7fd8c40b0630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80097c0 tx=0x7fd8b801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcf226bcc7d55cc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8c2ffd640 1 -- 172.21.15.40:0/580624715 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80ac620 con 0x7fd8c40c2670 2023-11-04T01:43:19.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8c2ffd640 1 -- 172.21.15.40:0/580624715 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80ac780 con 0x7fd8c40c2670 2023-11-04T01:43:19.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8c2ffd640 1 -- 172.21.15.40:0/580624715 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80acb10 con 0x7fd8c40c2670 2023-11-04T01:43:19.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 -- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40c2670 msgr2=0x7fd8c40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40c2670 0x7fd8c40b0630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80097c0 tx=0x7fd8b801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 -- 172.21.15.40:0/580624715 shutdown_connections 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c40b0b70 0x7fd8c415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/580624715 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40c2670 0x7fd8c40b0630 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 -- 172.21.15.40:0/580624715 >> 172.21.15.40:0/580624715 conn(0x7fd8c40cebb0 msgr2=0x7fd8c40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 -- 172.21.15.40:0/580624715 shutdown_connections 2023-11-04T01:43:19.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 -- 172.21.15.40:0/580624715 wait complete. 2023-11-04T01:43:19.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 Processor -- start 2023-11-04T01:43:19.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.697+0000 7fd8ca5db640 1 -- start start 2023-11-04T01:43:19.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40b0b70 0x7fd8c414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 0x7fd8c415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c415b290 0x7fd8c41365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414a740 con 0x7fd8c40c2670 2023-11-04T01:43:19.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414e6f0 con 0x7fd8c40b0b70 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414e9d0 con 0x7fd8c415b290 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 0x7fd8c415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 0x7fd8c415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44928/0 (socket says 172.21.15.40:44928) 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 -- 172.21.15.40:0/2549438190 learned_addr learned my addr 172.21.15.40:0/2549438190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c3fff640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40b0b70 0x7fd8c414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c8b78640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c415b290 0x7fd8c41365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 -- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c415b290 msgr2=0x7fd8c41365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c415b290 0x7fd8c41365e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 -- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40b0b70 msgr2=0x7fd8c414a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40b0b70 0x7fd8c414a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 -- 172.21.15.40:0/2549438190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8009420 con 0x7fd8c40c2670 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c3fff640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40b0b70 0x7fd8c414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:19.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c37fe640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 0x7fd8c415e2b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80af040 tx=0x7fd8b8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b5410 con 0x7fd8c40c2670 2023-11-04T01:43:19.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80b5590 con 0x7fd8c40c2670 2023-11-04T01:43:19.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b5940 con 0x7fd8c40c2670 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c414ecb0 con 0x7fd8c40c2670 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c414f270 con 0x7fd8c40c2670 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c40744a0 con 0x7fd8c40c2670 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.701+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8b80b3040 con 0x7fd8c40c2670 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.705+0000 7fd8c0ff9640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8b00664a0 0x7fd8b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.705+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fd8b811e430 con 0x7fd8c40c2670 2023-11-04T01:43:19.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.705+0000 7fd8c3fff640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8b00664a0 0x7fd8b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.705+0000 7fd8c3fff640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8b00664a0 0x7fd8b0068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005890 tx=0x7fd8b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.709+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8b80eb3f0 con 0x7fd8c40c2670 2023-11-04T01:43:19.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.865+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8c40718c0 con 0x7fd8c40c2670 2023-11-04T01:43:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8c0ff9640 1 -- 172.21.15.40:0/2549438190 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+21728 (secure 0 0 0) 0x7fd8b80eea10 con 0x7fd8c40c2670 2023-11-04T01:43:19.874 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:19.874 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":91,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:43:17.131738+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8b00664a0 msgr2=0x7fd8b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8b00664a0 0x7fd8b0068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4005890 tx=0x7fd8b4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 msgr2=0x7fd8c415e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 0x7fd8c415e2b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80af040 tx=0x7fd8b8019160 comp rx=0 tx=0).stop 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 shutdown_connections 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8b00664a0 0x7fd8b0068960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8c415b290 0x7fd8c41365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8c40c2670 0x7fd8c415e2b0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 --2- 172.21.15.40:0/2549438190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8c40b0b70 0x7fd8c414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 >> 172.21.15.40:0/2549438190 conn(0x7fd8c40cebb0 msgr2=0x7fd8c40b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 shutdown_connections 2023-11-04T01:43:19.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:19.869+0000 7fd8ca5db640 1 -- 172.21.15.40:0/2549438190 wait complete. 2023-11-04T01:43:19.895 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:43:19.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c7d677640 1 Processor -- start 2023-11-04T01:43:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c7d677640 1 -- start start 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c7d677640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c780703c0 0x7f3c78165f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c7d677640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c780c99d0 con 0x7f3c7815f320 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c7d677640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7806b9a0 con 0x7f3c7815aff0 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c7d677640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780c9c90 con 0x7f3c780703c0 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c767fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c7815f320 0x7f3c7806a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60988/0 (socket says 172.21.15.40:60988) 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c777fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c780703c0 0x7f3c78165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c767fc640 1 -- 172.21.15.40:0/2199817871 learned_addr learned my addr 172.21.15.40:0/2199817871 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c75ffb640 1 -- 172.21.15.40:0/2199817871 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980160148 0 0) 0x7f3c780c99d0 con 0x7f3c7815f320 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c75ffb640 1 -- 172.21.15.40:0/2199817871 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c64003530 con 0x7f3c7815f320 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c777fe640 1 -- 172.21.15.40:0/2199817871 >> v1:172.21.15.91:6789/0 conn(0x7f3c7815aff0 legacy=0x7f3c7815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c777fe640 1 -- 172.21.15.40:0/2199817871 >> v1:172.21.15.40:6789/0 conn(0x7f3c7815f320 legacy=0x7f3c7806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c777fe640 1 -- 172.21.15.40:0/2199817871 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780c9f70 con 0x7f3c780703c0 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.005+0000 7f3c777fe640 1 --2- 172.21.15.40:0/2199817871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78165f40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3c680097c0 tx=0x7f3c6801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9b45660f67feb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c75ffb640 1 -- 172.21.15.40:0/2199817871 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680ac600 con 0x7f3c780703c0 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c75ffb640 1 -- 172.21.15.40:0/2199817871 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680a8050 con 0x7f3c780703c0 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c75ffb640 1 -- 172.21.15.40:0/2199817871 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680ac960 con 0x7f3c780703c0 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/2199817871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 msgr2=0x7f3c78165f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 --2- 172.21.15.40:0/2199817871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78165f40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3c680097c0 tx=0x7f3c6801c380 comp rx=0 tx=0).stop 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/2199817871 shutdown_connections 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 --2- 172.21.15.40:0/2199817871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78165f40 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/2199817871 >> 172.21.15.40:0/2199817871 conn(0x7f3c780b0e70 msgr2=0x7f3c780b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/2199817871 shutdown_connections 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/2199817871 wait complete. 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 Processor -- start 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- start start 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3c7815aff0 0x7f3c780c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c7815f320 0x7f3c78153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780c53f0 con 0x7f3c780703c0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78155320 con 0x7f3c7815f320 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78155600 con 0x7f3c7815aff0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44936/0 (socket says 172.21.15.40:44936) 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 -- 172.21.15.40:0/1403842513 learned_addr learned my addr 172.21.15.40:0/1403842513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c777fe640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c7815f320 0x7f3c78153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 -- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3c7815aff0 msgr2=0x7f3c780c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3c7815aff0 0x7f3c780c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 -- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c7815f320 msgr2=0x7f3c78153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c7815f320 0x7f3c78153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 -- 172.21.15.40:0/1403842513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68009420 con 0x7f3c780703c0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c76ffd640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78154c20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c7d0 tx=0x7f3c7000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000aa50 con 0x7f3c780703c0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000abb0 con 0x7f3c780703c0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c781558e0 con 0x7f3c780703c0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70012420 con 0x7f3c780703c0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.009+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c78155ea0 con 0x7f3c780703c0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.013+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c781560c0 con 0x7f3c780703c0 2023-11-04T01:43:20.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.013+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c70012580 con 0x7f3c780703c0 2023-11-04T01:43:20.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.013+0000 7f3c6f7fe640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3c580664a0 0x7f3c58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.013+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f3c70084540 con 0x7f3c780703c0 2023-11-04T01:43:20.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.013+0000 7f3c767fc640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3c580664a0 0x7f3c58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.013+0000 7f3c767fc640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3c580664a0 0x7f3c58068960 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3c60007fd0 tx=0x7f3c60007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.017+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c70051500 con 0x7f3c780703c0 2023-11-04T01:43:20.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.173+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c780744a0 con 0x7f3c580664a0 2023-11-04T01:43:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.213+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/1403842513 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525035 (secure 0 0 0) 0x7f3c780744a0 con 0x7f3c580664a0 2023-11-04T01:43:20.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3c580664a0 msgr2=0x7f3c58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3c580664a0 0x7f3c58068960 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3c60007fd0 tx=0x7f3c60007940 comp rx=0 tx=0).stop 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 msgr2=0x7f3c78154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78154c20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c7d0 tx=0x7f3c7000cc90 comp rx=0 tx=0).stop 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 shutdown_connections 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3c580664a0 0x7f3c58068960 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3c7815f320 0x7f3c78153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3c7815aff0 0x7f3c780c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 --2- 172.21.15.40:0/1403842513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c780703c0 0x7f3c78154c20 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 >> 172.21.15.40:0/1403842513 conn(0x7f3c780b0e70 msgr2=0x7f3c780c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 shutdown_connections 2023-11-04T01:43:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.221+0000 7f3c7d677640 1 -- 172.21.15.40:0/1403842513 wait complete. 2023-11-04T01:43:20.247 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-11-04T01:43:19.825567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259080,"kb_used_data":9632,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715640,"statfs":{"total":773094113280,"available":772828815360,"internally_reserved":0,"allocated":9863168,"data_stored":5225124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726884"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117008+0000","last_change":"2023-11-04T01:43:15.117008+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117008+0000","last_undegraded":"2023-11-04T01:43:15.117008+0000","last_fullsized":"2023-11-04T01:43:15.117008+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131236+0000","last_change":"2023-11-04T01:43:15.131236+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131236+0000","last_undegraded":"2023-11-04T01:43:15.131236+0000","last_fullsized":"2023-11-04T01:43:15.131236+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118764+0000","last_change":"2023-11-04T01:43:15.118764+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118764+0000","last_undegraded":"2023-11-04T01:43:15.118764+0000","last_fullsized":"2023-11-04T01:43:15.118764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.130569+0000","last_change":"2023-11-04T01:43:15.130569+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.130569+0000","last_undegraded":"2023-11-04T01:43:15.130569+0000","last_fullsized":"2023-11-04T01:43:15.130569+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.149804+0000","last_change":"2023-11-04T01:43:15.149804+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.149804+0000","last_undegraded":"2023-11-04T01:43:15.149804+0000","last_fullsized":"2023-11-04T01:43:15.149804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125131+0000","last_change":"2023-11-04T01:43:15.125131+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125131+0000","last_undegraded":"2023-11-04T01:43:15.125131+0000","last_fullsized":"2023-11-04T01:43:15.125131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.124944+0000","last_change":"2023-11-04T01:43:15.124944+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.124944+0000","last_undegraded":"2023-11-04T01:43:15.124944+0000","last_fullsized":"2023-11-04T01:43:15.124944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.127761+0000","last_change":"2023-11-04T01:43:15.127761+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.127761+0000","last_undegraded":"2023-11-04T01:43:15.127761+0000","last_fullsized":"2023-11-04T01:43:15.127761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125044+0000","last_change":"2023-11-04T01:43:15.125044+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125044+0000","last_undegraded":"2023-11-04T01:43:15.125044+0000","last_fullsized":"2023-11-04T01:43:15.125044+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.147747+0000","last_change":"2023-11-04T01:43:15.147747+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.147747+0000","last_undegraded":"2023-11-04T01:43:15.147747+0000","last_fullsized":"2023-11-04T01:43:15.147747+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.111907+0000","last_change":"2023-11-04T01:43:15.111907+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.111907+0000","last_undegraded":"2023-11-04T01:43:15.111907+0000","last_fullsized":"2023-11-04T01:43:15.111907+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110469+0000","last_change":"2023-11-04T01:43:15.110469+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110469+0000","last_undegraded":"2023-11-04T01:43:15.110469+0000","last_fullsized":"2023-11-04T01:43:15.110469+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119196+0000","last_change":"2023-11-04T01:43:15.119196+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119196+0000","last_undegraded":"2023-11-04T01:43:15.119196+0000","last_fullsized":"2023-11-04T01:43:15.119196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119331+0000","last_change":"2023-11-04T01:43:15.119331+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119331+0000","last_undegraded":"2023-11-04T01:43:15.119331+0000","last_fullsized":"2023-11-04T01:43:15.119331+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.129288+0000","last_change":"2023-11-04T01:43:15.129288+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.129288+0000","last_undegraded":"2023-11-04T01:43:15.129288+0000","last_fullsized":"2023-11-04T01:43:15.129288+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.132136+0000","last_change":"2023-11-04T01:43:15.132136+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.132136+0000","last_undegraded":"2023-11-04T01:43:15.132136+0000","last_fullsized":"2023-11-04T01:43:15.132136+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116352+0000","last_change":"2023-11-04T01:43:15.116352+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116352+0000","last_undegraded":"2023-11-04T01:43:15.116352+0000","last_fullsized":"2023-11-04T01:43:15.116352+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125071+0000","last_change":"2023-11-04T01:43:15.125071+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125071+0000","last_undegraded":"2023-11-04T01:43:15.125071+0000","last_fullsized":"2023-11-04T01:43:15.125071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118123+0000","last_change":"2023-11-04T01:43:15.118123+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118123+0000","last_undegraded":"2023-11-04T01:43:15.118123+0000","last_fullsized":"2023-11-04T01:43:15.118123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109148+0000","last_change":"2023-11-04T01:43:15.109148+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109148+0000","last_undegraded":"2023-11-04T01:43:15.109148+0000","last_fullsized":"2023-11-04T01:43:15.109148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122192+0000","last_change":"2023-11-04T01:43:15.122192+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122192+0000","last_undegraded":"2023-11-04T01:43:15.122192+0000","last_fullsized":"2023-11-04T01:43:15.122192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.146557+0000","last_change":"2023-11-04T01:43:15.146557+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.146557+0000","last_undegraded":"2023-11-04T01:43:15.146557+0000","last_fullsized":"2023-11-04T01:43:15.146557+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117462+0000","last_change":"2023-11-04T01:43:15.117462+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117462+0000","last_undegraded":"2023-11-04T01:43:15.117462+0000","last_fullsized":"2023-11-04T01:43:15.117462+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148901+0000","last_change":"2023-11-04T01:43:15.148901+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148901+0000","last_undegraded":"2023-11-04T01:43:15.148901+0000","last_fullsized":"2023-11-04T01:43:15.148901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114154+0000","last_change":"2023-11-04T01:43:15.114154+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114154+0000","last_undegraded":"2023-11-04T01:43:15.114154+0000","last_fullsized":"2023-11-04T01:43:15.114154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114738+0000","last_change":"2023-11-04T01:43:15.114738+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114738+0000","last_undegraded":"2023-11-04T01:43:15.114738+0000","last_fullsized":"2023-11-04T01:43:15.114738+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113282+0000","last_change":"2023-11-04T01:43:15.113282+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113282+0000","last_undegraded":"2023-11-04T01:43:15.113282+0000","last_fullsized":"2023-11-04T01:43:15.113282+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.138778+0000","last_change":"2023-11-04T01:43:15.138778+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.138778+0000","last_undegraded":"2023-11-04T01:43:15.138778+0000","last_fullsized":"2023-11-04T01:43:15.138778+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122902+0000","last_change":"2023-11-04T01:43:15.122902+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122902+0000","last_undegraded":"2023-11-04T01:43:15.122902+0000","last_fullsized":"2023-11-04T01:43:15.122902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110550+0000","last_change":"2023-11-04T01:43:15.110550+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110550+0000","last_undegraded":"2023-11-04T01:43:15.110550+0000","last_fullsized":"2023-11-04T01:43:15.110550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123664+0000","last_change":"2023-11-04T01:43:15.123664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123664+0000","last_undegraded":"2023-11-04T01:43:15.123664+0000","last_fullsized":"2023-11-04T01:43:15.123664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126727+0000","last_change":"2023-11-04T01:43:15.126727+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126727+0000","last_undegraded":"2023-11-04T01:43:15.126727+0000","last_fullsized":"2023-11-04T01:43:15.126727+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113823+0000","last_change":"2023-11-04T01:43:15.113823+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113823+0000","last_undegraded":"2023-11-04T01:43:15.113823+0000","last_fullsized":"2023-11-04T01:43:15.113823+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159528+0000","last_change":"2023-11-04T01:43:15.157943+0000","last_active":"2023-11-04T01:43:15.159528+0000","last_peered":"2023-11-04T01:43:15.159528+0000","last_clean":"2023-11-04T01:43:15.159528+0000","last_became_active":"2023-11-04T01:43:15.157543+0000","last_became_peered":"2023-11-04T01:43:15.157543+0000","last_unstale":"2023-11-04T01:43:15.159528+0000","last_undegraded":"2023-11-04T01:43:15.159528+0000","last_fullsized":"2023-11-04T01:43:15.159528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:54.891988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116221+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:43:14.116221+0000","last_peered":"2023-11-04T01:43:14.116221+0000","last_clean":"2023-11-04T01:43:14.116221+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:43:14.116221+0000","last_undegraded":"2023-11-04T01:43:14.116221+0000","last_fullsized":"2023-11-04T01:43:14.116221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108469+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:43:14.108469+0000","last_peered":"2023-11-04T01:43:14.108469+0000","last_clean":"2023-11-04T01:43:14.108469+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:43:14.108469+0000","last_undegraded":"2023-11-04T01:43:14.108469+0000","last_fullsized":"2023-11-04T01:43:14.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114862+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:43:14.114862+0000","last_peered":"2023-11-04T01:43:14.114862+0000","last_clean":"2023-11-04T01:43:14.114862+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:43:14.114862+0000","last_undegraded":"2023-11-04T01:43:14.114862+0000","last_fullsized":"2023-11-04T01:43:14.114862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111391+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:43:14.111391+0000","last_peered":"2023-11-04T01:43:14.111391+0000","last_clean":"2023-11-04T01:43:14.111391+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:43:14.111391+0000","last_undegraded":"2023-11-04T01:43:14.111391+0000","last_fullsized":"2023-11-04T01:43:14.111391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114458+0000","last_change":"2023-11-04T01:43:15.114458+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114458+0000","last_undegraded":"2023-11-04T01:43:15.114458+0000","last_fullsized":"2023-11-04T01:43:15.114458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137760+0000","last_change":"2023-11-04T01:43:15.134346+0000","last_active":"2023-11-04T01:43:15.137760+0000","last_peered":"2023-11-04T01:43:15.137760+0000","last_clean":"2023-11-04T01:43:15.137760+0000","last_became_active":"2023-11-04T01:43:15.133897+0000","last_became_peered":"2023-11-04T01:43:15.133897+0000","last_unstale":"2023-11-04T01:43:15.137760+0000","last_undegraded":"2023-11-04T01:43:15.137760+0000","last_fullsized":"2023-11-04T01:43:15.137760+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:29.175532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107341+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:43:14.107341+0000","last_peered":"2023-11-04T01:43:14.107341+0000","last_clean":"2023-11-04T01:43:14.107341+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:43:14.107341+0000","last_undegraded":"2023-11-04T01:43:14.107341+0000","last_fullsized":"2023-11-04T01:43:14.107341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117178+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:43:14.117178+0000","last_peered":"2023-11-04T01:43:14.117178+0000","last_clean":"2023-11-04T01:43:14.117178+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:43:14.117178+0000","last_undegraded":"2023-11-04T01:43:14.117178+0000","last_fullsized":"2023-11-04T01:43:14.117178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111700+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:43:14.111700+0000","last_peered":"2023-11-04T01:43:14.111700+0000","last_clean":"2023-11-04T01:43:14.111700+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:43:14.111700+0000","last_undegraded":"2023-11-04T01:43:14.111700+0000","last_fullsized":"2023-11-04T01:43:14.111700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114664+0000","last_change":"2023-11-04T01:43:15.114664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114664+0000","last_undegraded":"2023-11-04T01:43:15.114664+0000","last_fullsized":"2023-11-04T01:43:15.114664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159555+0000","last_change":"2023-11-04T01:43:15.158367+0000","last_active":"2023-11-04T01:43:15.159555+0000","last_peered":"2023-11-04T01:43:15.159555+0000","last_clean":"2023-11-04T01:43:15.159555+0000","last_became_active":"2023-11-04T01:43:15.157718+0000","last_became_peered":"2023-11-04T01:43:15.157718+0000","last_unstale":"2023-11-04T01:43:15.159555+0000","last_undegraded":"2023-11-04T01:43:15.159555+0000","last_fullsized":"2023-11-04T01:43:15.159555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:03.434277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099606+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:43:14.099606+0000","last_peered":"2023-11-04T01:43:14.099606+0000","last_clean":"2023-11-04T01:43:14.099606+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:43:14.099606+0000","last_undegraded":"2023-11-04T01:43:14.099606+0000","last_fullsized":"2023-11-04T01:43:14.099606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109161+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:43:14.109161+0000","last_peered":"2023-11-04T01:43:14.109161+0000","last_clean":"2023-11-04T01:43:14.109161+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:43:14.109161+0000","last_undegraded":"2023-11-04T01:43:14.109161+0000","last_fullsized":"2023-11-04T01:43:14.109161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116648+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:43:14.116648+0000","last_peered":"2023-11-04T01:43:14.116648+0000","last_clean":"2023-11-04T01:43:14.116648+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:43:14.116648+0000","last_undegraded":"2023-11-04T01:43:14.116648+0000","last_fullsized":"2023-11-04T01:43:14.116648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116181+0000","last_change":"2023-11-04T01:43:15.116181+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116181+0000","last_undegraded":"2023-11-04T01:43:15.116181+0000","last_fullsized":"2023-11-04T01:43:15.116181+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168810+0000","last_change":"2023-11-04T01:43:15.162827+0000","last_active":"2023-11-04T01:43:15.168810+0000","last_peered":"2023-11-04T01:43:15.168810+0000","last_clean":"2023-11-04T01:43:15.168810+0000","last_became_active":"2023-11-04T01:43:15.162272+0000","last_became_peered":"2023-11-04T01:43:15.162272+0000","last_unstale":"2023-11-04T01:43:15.168810+0000","last_undegraded":"2023-11-04T01:43:15.168810+0000","last_fullsized":"2023-11-04T01:43:15.168810+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.577222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100017+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:43:14.100017+0000","last_peered":"2023-11-04T01:43:14.100017+0000","last_clean":"2023-11-04T01:43:14.100017+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:43:14.100017+0000","last_undegraded":"2023-11-04T01:43:14.100017+0000","last_fullsized":"2023-11-04T01:43:14.100017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100057+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:43:14.100057+0000","last_peered":"2023-11-04T01:43:14.100057+0000","last_clean":"2023-11-04T01:43:14.100057+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:43:14.100057+0000","last_undegraded":"2023-11-04T01:43:14.100057+0000","last_fullsized":"2023-11-04T01:43:14.100057+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.105693+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:43:15.105693+0000","last_peered":"2023-11-04T01:43:15.105693+0000","last_clean":"2023-11-04T01:43:15.105693+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:43:15.105693+0000","last_undegraded":"2023-11-04T01:43:15.105693+0000","last_fullsized":"2023-11-04T01:43:15.105693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116753+0000","last_change":"2023-11-04T01:43:15.116753+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116753+0000","last_undegraded":"2023-11-04T01:43:15.116753+0000","last_fullsized":"2023-11-04T01:43:15.116753+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.151563+0000","last_change":"2023-11-04T01:43:15.146655+0000","last_active":"2023-11-04T01:43:15.151563+0000","last_peered":"2023-11-04T01:43:15.151563+0000","last_clean":"2023-11-04T01:43:15.151563+0000","last_became_active":"2023-11-04T01:43:15.145780+0000","last_became_peered":"2023-11-04T01:43:15.145780+0000","last_unstale":"2023-11-04T01:43:15.151563+0000","last_undegraded":"2023-11-04T01:43:15.151563+0000","last_fullsized":"2023-11-04T01:43:15.151563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:02.611764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107489+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:43:14.107489+0000","last_peered":"2023-11-04T01:43:14.107489+0000","last_clean":"2023-11-04T01:43:14.107489+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:43:14.107489+0000","last_undegraded":"2023-11-04T01:43:14.107489+0000","last_fullsized":"2023-11-04T01:43:14.107489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113762+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:43:14.113762+0000","last_peered":"2023-11-04T01:43:14.113762+0000","last_clean":"2023-11-04T01:43:14.113762+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:43:14.113762+0000","last_undegraded":"2023-11-04T01:43:14.113762+0000","last_fullsized":"2023-11-04T01:43:14.113762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111706+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:43:14.111706+0000","last_peered":"2023-11-04T01:43:14.111706+0000","last_clean":"2023-11-04T01:43:14.111706+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:43:14.111706+0000","last_undegraded":"2023-11-04T01:43:14.111706+0000","last_fullsized":"2023-11-04T01:43:14.111706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125629+0000","last_change":"2023-11-04T01:43:15.125629+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125629+0000","last_undegraded":"2023-11-04T01:43:15.125629+0000","last_fullsized":"2023-11-04T01:43:15.125629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.165914+0000","last_change":"2023-11-04T01:43:15.148592+0000","last_active":"2023-11-04T01:43:15.165914+0000","last_peered":"2023-11-04T01:43:15.165914+0000","last_clean":"2023-11-04T01:43:15.165914+0000","last_became_active":"2023-11-04T01:43:15.147892+0000","last_became_peered":"2023-11-04T01:43:15.147892+0000","last_unstale":"2023-11-04T01:43:15.165914+0000","last_undegraded":"2023-11-04T01:43:15.165914+0000","last_fullsized":"2023-11-04T01:43:15.165914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:55.779518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112657+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:43:14.112657+0000","last_peered":"2023-11-04T01:43:14.112657+0000","last_clean":"2023-11-04T01:43:14.112657+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:43:14.112657+0000","last_undegraded":"2023-11-04T01:43:14.112657+0000","last_fullsized":"2023-11-04T01:43:14.112657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108116+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:43:14.108116+0000","last_peered":"2023-11-04T01:43:14.108116+0000","last_clean":"2023-11-04T01:43:14.108116+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:43:14.108116+0000","last_undegraded":"2023-11-04T01:43:14.108116+0000","last_fullsized":"2023-11-04T01:43:14.108116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108640+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:43:14.108640+0000","last_peered":"2023-11-04T01:43:14.108640+0000","last_clean":"2023-11-04T01:43:14.108640+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:43:14.108640+0000","last_undegraded":"2023-11-04T01:43:14.108640+0000","last_fullsized":"2023-11-04T01:43:14.108640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123961+0000","last_change":"2023-11-04T01:43:15.123961+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123961+0000","last_undegraded":"2023-11-04T01:43:15.123961+0000","last_fullsized":"2023-11-04T01:43:15.123961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.150022+0000","last_change":"2023-11-04T01:43:15.146312+0000","last_active":"2023-11-04T01:43:15.150022+0000","last_peered":"2023-11-04T01:43:15.150022+0000","last_clean":"2023-11-04T01:43:15.150022+0000","last_became_active":"2023-11-04T01:43:15.145470+0000","last_became_peered":"2023-11-04T01:43:15.145470+0000","last_unstale":"2023-11-04T01:43:15.150022+0000","last_undegraded":"2023-11-04T01:43:15.150022+0000","last_fullsized":"2023-11-04T01:43:15.150022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:06.918241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112960+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:43:14.112960+0000","last_peered":"2023-11-04T01:43:14.112960+0000","last_clean":"2023-11-04T01:43:14.112960+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:43:14.112960+0000","last_undegraded":"2023-11-04T01:43:14.112960+0000","last_fullsized":"2023-11-04T01:43:14.112960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107704+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:43:14.107704+0000","last_peered":"2023-11-04T01:43:14.107704+0000","last_clean":"2023-11-04T01:43:14.107704+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:43:14.107704+0000","last_undegraded":"2023-11-04T01:43:14.107704+0000","last_fullsized":"2023-11-04T01:43:14.107704+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113790+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:43:14.113790+0000","last_peered":"2023-11-04T01:43:14.113790+0000","last_clean":"2023-11-04T01:43:14.113790+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:43:14.113790+0000","last_undegraded":"2023-11-04T01:43:14.113790+0000","last_fullsized":"2023-11-04T01:43:14.113790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148519+0000","last_change":"2023-11-04T01:43:15.148519+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148519+0000","last_undegraded":"2023-11-04T01:43:15.148519+0000","last_fullsized":"2023-11-04T01:43:15.148519+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168590+0000","last_change":"2023-11-04T01:43:15.164771+0000","last_active":"2023-11-04T01:43:15.168590+0000","last_peered":"2023-11-04T01:43:15.168590+0000","last_clean":"2023-11-04T01:43:15.168590+0000","last_became_active":"2023-11-04T01:43:15.164172+0000","last_became_peered":"2023-11-04T01:43:15.164172+0000","last_unstale":"2023-11-04T01:43:15.168590+0000","last_undegraded":"2023-11-04T01:43:15.168590+0000","last_fullsized":"2023-11-04T01:43:15.168590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:50.337311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.120061+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:43:14.120061+0000","last_peered":"2023-11-04T01:43:14.120061+0000","last_clean":"2023-11-04T01:43:14.120061+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:43:14.120061+0000","last_undegraded":"2023-11-04T01:43:14.120061+0000","last_fullsized":"2023-11-04T01:43:14.120061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107402+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:43:14.107402+0000","last_peered":"2023-11-04T01:43:14.107402+0000","last_clean":"2023-11-04T01:43:14.107402+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:43:14.107402+0000","last_undegraded":"2023-11-04T01:43:14.107402+0000","last_fullsized":"2023-11-04T01:43:14.107402+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116779+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:43:14.116779+0000","last_peered":"2023-11-04T01:43:14.116779+0000","last_clean":"2023-11-04T01:43:14.116779+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:43:14.116779+0000","last_undegraded":"2023-11-04T01:43:14.116779+0000","last_fullsized":"2023-11-04T01:43:14.116779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119517+0000","last_change":"2023-11-04T01:43:15.119517+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119517+0000","last_undegraded":"2023-11-04T01:43:15.119517+0000","last_fullsized":"2023-11-04T01:43:15.119517+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166008+0000","last_change":"2023-11-04T01:43:15.162799+0000","last_active":"2023-11-04T01:43:15.166008+0000","last_peered":"2023-11-04T01:43:15.166008+0000","last_clean":"2023-11-04T01:43:15.166008+0000","last_became_active":"2023-11-04T01:43:15.162068+0000","last_became_peered":"2023-11-04T01:43:15.162068+0000","last_unstale":"2023-11-04T01:43:15.166008+0000","last_undegraded":"2023-11-04T01:43:15.166008+0000","last_fullsized":"2023-11-04T01:43:15.166008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108667+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:43:14.108667+0000","last_peered":"2023-11-04T01:43:14.108667+0000","last_clean":"2023-11-04T01:43:14.108667+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:43:14.108667+0000","last_undegraded":"2023-11-04T01:43:14.108667+0000","last_fullsized":"2023-11-04T01:43:14.108667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111179+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:43:14.111179+0000","last_peered":"2023-11-04T01:43:14.111179+0000","last_clean":"2023-11-04T01:43:14.111179+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:43:14.111179+0000","last_undegraded":"2023-11-04T01:43:14.111179+0000","last_fullsized":"2023-11-04T01:43:14.111179+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108691+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:43:14.108691+0000","last_peered":"2023-11-04T01:43:14.108691+0000","last_clean":"2023-11-04T01:43:14.108691+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:43:14.108691+0000","last_undegraded":"2023-11-04T01:43:14.108691+0000","last_fullsized":"2023-11-04T01:43:14.108691+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.121012+0000","last_change":"2023-11-04T01:43:15.121012+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.121012+0000","last_undegraded":"2023-11-04T01:43:15.121012+0000","last_fullsized":"2023-11-04T01:43:15.121012+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137807+0000","last_change":"2023-11-04T01:43:15.132590+0000","last_active":"2023-11-04T01:43:15.137807+0000","last_peered":"2023-11-04T01:43:15.137807+0000","last_clean":"2023-11-04T01:43:15.137807+0000","last_became_active":"2023-11-04T01:43:15.132101+0000","last_became_peered":"2023-11-04T01:43:15.132101+0000","last_unstale":"2023-11-04T01:43:15.137807+0000","last_undegraded":"2023-11-04T01:43:15.137807+0000","last_fullsized":"2023-11-04T01:43:15.137807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:14.252075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117896+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:43:14.117896+0000","last_peered":"2023-11-04T01:43:14.117896+0000","last_clean":"2023-11-04T01:43:14.117896+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:43:14.117896+0000","last_undegraded":"2023-11-04T01:43:14.117896+0000","last_fullsized":"2023-11-04T01:43:14.117896+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113028+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:43:14.113028+0000","last_peered":"2023-11-04T01:43:14.113028+0000","last_clean":"2023-11-04T01:43:14.113028+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:43:14.113028+0000","last_undegraded":"2023-11-04T01:43:14.113028+0000","last_fullsized":"2023-11-04T01:43:14.113028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108235+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:43:14.108235+0000","last_peered":"2023-11-04T01:43:14.108235+0000","last_clean":"2023-11-04T01:43:14.108235+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:43:14.108235+0000","last_undegraded":"2023-11-04T01:43:14.108235+0000","last_fullsized":"2023-11-04T01:43:14.108235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131096+0000","last_change":"2023-11-04T01:43:15.131096+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131096+0000","last_undegraded":"2023-11-04T01:43:15.131096+0000","last_fullsized":"2023-11-04T01:43:15.131096+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168718+0000","last_change":"2023-11-04T01:43:15.161698+0000","last_active":"2023-11-04T01:43:15.168718+0000","last_peered":"2023-11-04T01:43:15.168718+0000","last_clean":"2023-11-04T01:43:15.168718+0000","last_became_active":"2023-11-04T01:43:15.161055+0000","last_became_peered":"2023-11-04T01:43:15.161055+0000","last_unstale":"2023-11-04T01:43:15.168718+0000","last_undegraded":"2023-11-04T01:43:15.168718+0000","last_fullsized":"2023-11-04T01:43:15.168718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:30.109736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109650+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:43:14.109650+0000","last_peered":"2023-11-04T01:43:14.109650+0000","last_clean":"2023-11-04T01:43:14.109650+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:43:14.109650+0000","last_undegraded":"2023-11-04T01:43:14.109650+0000","last_fullsized":"2023-11-04T01:43:14.109650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116385+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:43:14.116385+0000","last_peered":"2023-11-04T01:43:14.116385+0000","last_clean":"2023-11-04T01:43:14.116385+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:43:14.116385+0000","last_undegraded":"2023-11-04T01:43:14.116385+0000","last_fullsized":"2023-11-04T01:43:14.116385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114820+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:43:14.114820+0000","last_peered":"2023-11-04T01:43:14.114820+0000","last_clean":"2023-11-04T01:43:14.114820+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:43:14.114820+0000","last_undegraded":"2023-11-04T01:43:14.114820+0000","last_fullsized":"2023-11-04T01:43:14.114820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.112748+0000","last_change":"2023-11-04T01:43:15.112748+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.112748+0000","last_undegraded":"2023-11-04T01:43:15.112748+0000","last_fullsized":"2023-11-04T01:43:15.112748+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138676+0000","last_change":"2023-11-04T01:43:15.133081+0000","last_active":"2023-11-04T01:43:15.138676+0000","last_peered":"2023-11-04T01:43:15.138676+0000","last_clean":"2023-11-04T01:43:15.138676+0000","last_became_active":"2023-11-04T01:43:15.132291+0000","last_became_peered":"2023-11-04T01:43:15.132291+0000","last_unstale":"2023-11-04T01:43:15.138676+0000","last_undegraded":"2023-11-04T01:43:15.138676+0000","last_fullsized":"2023-11-04T01:43:15.138676+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:49.142953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112522+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:43:14.112522+0000","last_peered":"2023-11-04T01:43:14.112522+0000","last_clean":"2023-11-04T01:43:14.112522+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:43:14.112522+0000","last_undegraded":"2023-11-04T01:43:14.112522+0000","last_fullsized":"2023-11-04T01:43:14.112522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115564+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:43:14.115564+0000","last_peered":"2023-11-04T01:43:14.115564+0000","last_clean":"2023-11-04T01:43:14.115564+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:43:14.115564+0000","last_undegraded":"2023-11-04T01:43:14.115564+0000","last_fullsized":"2023-11-04T01:43:14.115564+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111422+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:43:14.111422+0000","last_peered":"2023-11-04T01:43:14.111422+0000","last_clean":"2023-11-04T01:43:14.111422+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:43:14.111422+0000","last_undegraded":"2023-11-04T01:43:14.111422+0000","last_fullsized":"2023-11-04T01:43:14.111422+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.115396+0000","last_change":"2023-11-04T01:43:15.115396+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.115396+0000","last_undegraded":"2023-11-04T01:43:15.115396+0000","last_fullsized":"2023-11-04T01:43:15.115396+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158653+0000","last_change":"2023-11-04T01:43:15.153802+0000","last_active":"2023-11-04T01:43:15.158653+0000","last_peered":"2023-11-04T01:43:15.158653+0000","last_clean":"2023-11-04T01:43:15.158653+0000","last_became_active":"2023-11-04T01:43:15.153029+0000","last_became_peered":"2023-11-04T01:43:15.153029+0000","last_unstale":"2023-11-04T01:43:15.158653+0000","last_undegraded":"2023-11-04T01:43:15.158653+0000","last_fullsized":"2023-11-04T01:43:15.158653+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118424+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:43:14.118424+0000","last_peered":"2023-11-04T01:43:14.118424+0000","last_clean":"2023-11-04T01:43:14.118424+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:43:14.118424+0000","last_undegraded":"2023-11-04T01:43:14.118424+0000","last_fullsized":"2023-11-04T01:43:14.118424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118204+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:43:14.118204+0000","last_peered":"2023-11-04T01:43:14.118204+0000","last_clean":"2023-11-04T01:43:14.118204+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:43:14.118204+0000","last_undegraded":"2023-11-04T01:43:14.118204+0000","last_fullsized":"2023-11-04T01:43:14.118204+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109890+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:43:14.109890+0000","last_peered":"2023-11-04T01:43:14.109890+0000","last_clean":"2023-11-04T01:43:14.109890+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:43:14.109890+0000","last_undegraded":"2023-11-04T01:43:14.109890+0000","last_fullsized":"2023-11-04T01:43:14.109890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109995+0000","last_change":"2023-11-04T01:43:15.109995+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109995+0000","last_undegraded":"2023-11-04T01:43:15.109995+0000","last_fullsized":"2023-11-04T01:43:15.109995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142716+0000","last_change":"2023-11-04T01:43:15.134863+0000","last_active":"2023-11-04T01:43:15.142716+0000","last_peered":"2023-11-04T01:43:15.142716+0000","last_clean":"2023-11-04T01:43:15.142716+0000","last_became_active":"2023-11-04T01:43:15.134171+0000","last_became_peered":"2023-11-04T01:43:15.134171+0000","last_unstale":"2023-11-04T01:43:15.142716+0000","last_undegraded":"2023-11-04T01:43:15.142716+0000","last_fullsized":"2023-11-04T01:43:15.142716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:18.996637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119278+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:43:14.119278+0000","last_peered":"2023-11-04T01:43:14.119278+0000","last_clean":"2023-11-04T01:43:14.119278+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:43:14.119278+0000","last_undegraded":"2023-11-04T01:43:14.119278+0000","last_fullsized":"2023-11-04T01:43:14.119278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100321+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:43:14.100321+0000","last_peered":"2023-11-04T01:43:14.100321+0000","last_clean":"2023-11-04T01:43:14.100321+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:43:14.100321+0000","last_undegraded":"2023-11-04T01:43:14.100321+0000","last_fullsized":"2023-11-04T01:43:14.100321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126384+0000","last_change":"2023-11-04T01:43:15.126384+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126384+0000","last_undegraded":"2023-11-04T01:43:15.126384+0000","last_fullsized":"2023-11-04T01:43:15.126384+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168735+0000","last_change":"2023-11-04T01:43:15.162032+0000","last_active":"2023-11-04T01:43:15.168735+0000","last_peered":"2023-11-04T01:43:15.168735+0000","last_clean":"2023-11-04T01:43:15.168735+0000","last_became_active":"2023-11-04T01:43:15.161515+0000","last_became_peered":"2023-11-04T01:43:15.161515+0000","last_unstale":"2023-11-04T01:43:15.168735+0000","last_undegraded":"2023-11-04T01:43:15.168735+0000","last_fullsized":"2023-11-04T01:43:15.168735+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:41.610070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114393+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:43:14.114393+0000","last_peered":"2023-11-04T01:43:14.114393+0000","last_clean":"2023-11-04T01:43:14.114393+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:43:14.114393+0000","last_undegraded":"2023-11-04T01:43:14.114393+0000","last_fullsized":"2023-11-04T01:43:14.114393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118113+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:43:14.118113+0000","last_peered":"2023-11-04T01:43:14.118113+0000","last_clean":"2023-11-04T01:43:14.118113+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:43:14.118113+0000","last_undegraded":"2023-11-04T01:43:14.118113+0000","last_fullsized":"2023-11-04T01:43:14.118113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108402+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:43:14.108402+0000","last_peered":"2023-11-04T01:43:14.108402+0000","last_clean":"2023-11-04T01:43:14.108402+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:43:14.108402+0000","last_undegraded":"2023-11-04T01:43:14.108402+0000","last_fullsized":"2023-11-04T01:43:14.108402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109597+0000","last_change":"2023-11-04T01:43:15.109597+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109597+0000","last_undegraded":"2023-11-04T01:43:15.109597+0000","last_fullsized":"2023-11-04T01:43:15.109597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.164067+0000","last_change":"2023-11-04T01:43:15.163139+0000","last_active":"2023-11-04T01:43:15.164067+0000","last_peered":"2023-11-04T01:43:15.164067+0000","last_clean":"2023-11-04T01:43:15.164067+0000","last_became_active":"2023-11-04T01:43:15.162805+0000","last_became_peered":"2023-11-04T01:43:15.162805+0000","last_unstale":"2023-11-04T01:43:15.164067+0000","last_undegraded":"2023-11-04T01:43:15.164067+0000","last_fullsized":"2023-11-04T01:43:15.164067+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114608+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:43:14.114608+0000","last_peered":"2023-11-04T01:43:14.114608+0000","last_clean":"2023-11-04T01:43:14.114608+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:43:14.114608+0000","last_undegraded":"2023-11-04T01:43:14.114608+0000","last_fullsized":"2023-11-04T01:43:14.114608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111316+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:43:14.111316+0000","last_peered":"2023-11-04T01:43:14.111316+0000","last_clean":"2023-11-04T01:43:14.111316+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:43:14.111316+0000","last_undegraded":"2023-11-04T01:43:14.111316+0000","last_fullsized":"2023-11-04T01:43:14.111316+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110722+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:43:14.110722+0000","last_peered":"2023-11-04T01:43:14.110722+0000","last_clean":"2023-11-04T01:43:14.110722+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:43:14.110722+0000","last_undegraded":"2023-11-04T01:43:14.110722+0000","last_fullsized":"2023-11-04T01:43:14.110722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116197+0000","last_change":"2023-11-04T01:43:15.116197+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116197+0000","last_undegraded":"2023-11-04T01:43:15.116197+0000","last_fullsized":"2023-11-04T01:43:15.116197+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166093+0000","last_change":"2023-11-04T01:43:15.162310+0000","last_active":"2023-11-04T01:43:15.166093+0000","last_peered":"2023-11-04T01:43:15.166093+0000","last_clean":"2023-11-04T01:43:15.166093+0000","last_became_active":"2023-11-04T01:43:15.161776+0000","last_became_peered":"2023-11-04T01:43:15.161776+0000","last_unstale":"2023-11-04T01:43:15.166093+0000","last_undegraded":"2023-11-04T01:43:15.166093+0000","last_fullsized":"2023-11-04T01:43:15.166093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:34.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111021+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:43:14.111021+0000","last_peered":"2023-11-04T01:43:14.111021+0000","last_clean":"2023-11-04T01:43:14.111021+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:43:14.111021+0000","last_undegraded":"2023-11-04T01:43:14.111021+0000","last_fullsized":"2023-11-04T01:43:14.111021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100192+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:43:14.100192+0000","last_peered":"2023-11-04T01:43:14.100192+0000","last_clean":"2023-11-04T01:43:14.100192+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:43:14.100192+0000","last_undegraded":"2023-11-04T01:43:14.100192+0000","last_fullsized":"2023-11-04T01:43:14.100192+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115598+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:43:14.115598+0000","last_peered":"2023-11-04T01:43:14.115598+0000","last_clean":"2023-11-04T01:43:14.115598+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:43:14.115598+0000","last_undegraded":"2023-11-04T01:43:14.115598+0000","last_fullsized":"2023-11-04T01:43:14.115598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113922+0000","last_change":"2023-11-04T01:43:15.113922+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113922+0000","last_undegraded":"2023-11-04T01:43:15.113922+0000","last_fullsized":"2023-11-04T01:43:15.113922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142152+0000","last_change":"2023-11-04T01:43:15.128193+0000","last_active":"2023-11-04T01:43:15.142152+0000","last_peered":"2023-11-04T01:43:15.142152+0000","last_clean":"2023-11-04T01:43:15.142152+0000","last_became_active":"2023-11-04T01:43:15.127462+0000","last_became_peered":"2023-11-04T01:43:15.127462+0000","last_unstale":"2023-11-04T01:43:15.142152+0000","last_undegraded":"2023-11-04T01:43:15.142152+0000","last_fullsized":"2023-11-04T01:43:15.142152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111119+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:43:14.111119+0000","last_peered":"2023-11-04T01:43:14.111119+0000","last_clean":"2023-11-04T01:43:14.111119+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:43:14.111119+0000","last_undegraded":"2023-11-04T01:43:14.111119+0000","last_fullsized":"2023-11-04T01:43:14.111119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116285+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:43:14.116285+0000","last_peered":"2023-11-04T01:43:14.116285+0000","last_clean":"2023-11-04T01:43:14.116285+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:43:14.116285+0000","last_undegraded":"2023-11-04T01:43:14.116285+0000","last_fullsized":"2023-11-04T01:43:14.116285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108139+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:43:14.108139+0000","last_peered":"2023-11-04T01:43:14.108139+0000","last_clean":"2023-11-04T01:43:14.108139+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:43:14.108139+0000","last_undegraded":"2023-11-04T01:43:14.108139+0000","last_fullsized":"2023-11-04T01:43:14.108139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123886+0000","last_change":"2023-11-04T01:43:15.123886+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123886+0000","last_undegraded":"2023-11-04T01:43:15.123886+0000","last_fullsized":"2023-11-04T01:43:15.123886+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154872+0000","last_change":"2023-11-04T01:43:15.150032+0000","last_active":"2023-11-04T01:43:15.154872+0000","last_peered":"2023-11-04T01:43:15.154872+0000","last_clean":"2023-11-04T01:43:15.154872+0000","last_became_active":"2023-11-04T01:43:15.149310+0000","last_became_peered":"2023-11-04T01:43:15.149310+0000","last_unstale":"2023-11-04T01:43:15.154872+0000","last_undegraded":"2023-11-04T01:43:15.154872+0000","last_fullsized":"2023-11-04T01:43:15.154872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109441+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:43:14.109441+0000","last_peered":"2023-11-04T01:43:14.109441+0000","last_clean":"2023-11-04T01:43:14.109441+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:43:14.109441+0000","last_undegraded":"2023-11-04T01:43:14.109441+0000","last_fullsized":"2023-11-04T01:43:14.109441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116067+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:43:14.116067+0000","last_peered":"2023-11-04T01:43:14.116067+0000","last_clean":"2023-11-04T01:43:14.116067+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:43:14.116067+0000","last_undegraded":"2023-11-04T01:43:14.116067+0000","last_fullsized":"2023-11-04T01:43:14.116067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111682+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:43:14.111682+0000","last_peered":"2023-11-04T01:43:14.111682+0000","last_clean":"2023-11-04T01:43:14.111682+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:43:14.111682+0000","last_undegraded":"2023-11-04T01:43:14.111682+0000","last_fullsized":"2023-11-04T01:43:14.111682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117930+0000","last_change":"2023-11-04T01:43:15.117930+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117930+0000","last_undegraded":"2023-11-04T01:43:15.117930+0000","last_fullsized":"2023-11-04T01:43:15.117930+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.155517+0000","last_change":"2023-11-04T01:43:15.131252+0000","last_active":"2023-11-04T01:43:15.155517+0000","last_peered":"2023-11-04T01:43:15.155517+0000","last_clean":"2023-11-04T01:43:15.155517+0000","last_became_active":"2023-11-04T01:43:15.130633+0000","last_became_peered":"2023-11-04T01:43:15.130633+0000","last_unstale":"2023-11-04T01:43:15.155517+0000","last_undegraded":"2023-11-04T01:43:15.155517+0000","last_fullsized":"2023-11-04T01:43:15.155517+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:11.208100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109235+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:43:14.109235+0000","last_peered":"2023-11-04T01:43:14.109235+0000","last_clean":"2023-11-04T01:43:14.109235+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:43:14.109235+0000","last_undegraded":"2023-11-04T01:43:14.109235+0000","last_fullsized":"2023-11-04T01:43:14.109235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118717+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:43:14.118717+0000","last_peered":"2023-11-04T01:43:14.118717+0000","last_clean":"2023-11-04T01:43:14.118717+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:43:14.118717+0000","last_undegraded":"2023-11-04T01:43:14.118717+0000","last_fullsized":"2023-11-04T01:43:14.118717+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107822+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:43:14.107822+0000","last_peered":"2023-11-04T01:43:14.107822+0000","last_clean":"2023-11-04T01:43:14.107822+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:43:14.107822+0000","last_undegraded":"2023-11-04T01:43:14.107822+0000","last_fullsized":"2023-11-04T01:43:14.107822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113784+0000","last_change":"2023-11-04T01:43:15.113784+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113784+0000","last_undegraded":"2023-11-04T01:43:15.113784+0000","last_fullsized":"2023-11-04T01:43:15.113784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.163000+0000","last_change":"2023-11-04T01:43:15.161411+0000","last_active":"2023-11-04T01:43:15.163000+0000","last_peered":"2023-11-04T01:43:15.163000+0000","last_clean":"2023-11-04T01:43:15.163000+0000","last_became_active":"2023-11-04T01:43:15.160976+0000","last_became_peered":"2023-11-04T01:43:15.160976+0000","last_unstale":"2023-11-04T01:43:15.163000+0000","last_undegraded":"2023-11-04T01:43:15.163000+0000","last_fullsized":"2023-11-04T01:43:15.163000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:37.815400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112546+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:43:14.112546+0000","last_peered":"2023-11-04T01:43:14.112546+0000","last_clean":"2023-11-04T01:43:14.112546+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:43:14.112546+0000","last_undegraded":"2023-11-04T01:43:14.112546+0000","last_fullsized":"2023-11-04T01:43:14.112546+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109027+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:43:14.109027+0000","last_peered":"2023-11-04T01:43:14.109027+0000","last_clean":"2023-11-04T01:43:14.109027+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:43:14.109027+0000","last_undegraded":"2023-11-04T01:43:14.109027+0000","last_fullsized":"2023-11-04T01:43:14.109027+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113105+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:43:14.113105+0000","last_peered":"2023-11-04T01:43:14.113105+0000","last_clean":"2023-11-04T01:43:14.113105+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:43:14.113105+0000","last_undegraded":"2023-11-04T01:43:14.113105+0000","last_fullsized":"2023-11-04T01:43:14.113105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117691+0000","last_change":"2023-11-04T01:43:15.117691+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117691+0000","last_undegraded":"2023-11-04T01:43:15.117691+0000","last_fullsized":"2023-11-04T01:43:15.117691+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154249+0000","last_change":"2023-11-04T01:43:15.149053+0000","last_active":"2023-11-04T01:43:15.154249+0000","last_peered":"2023-11-04T01:43:15.154249+0000","last_clean":"2023-11-04T01:43:15.154249+0000","last_became_active":"2023-11-04T01:43:15.148336+0000","last_became_peered":"2023-11-04T01:43:15.148336+0000","last_unstale":"2023-11-04T01:43:15.154249+0000","last_undegraded":"2023-11-04T01:43:15.154249+0000","last_fullsized":"2023-11-04T01:43:15.154249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:00.891242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112892+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:43:14.112892+0000","last_peered":"2023-11-04T01:43:14.112892+0000","last_clean":"2023-11-04T01:43:14.112892+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:43:14.112892+0000","last_undegraded":"2023-11-04T01:43:14.112892+0000","last_fullsized":"2023-11-04T01:43:14.112892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108367+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:43:14.108367+0000","last_peered":"2023-11-04T01:43:14.108367+0000","last_clean":"2023-11-04T01:43:14.108367+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:43:14.108367+0000","last_undegraded":"2023-11-04T01:43:14.108367+0000","last_fullsized":"2023-11-04T01:43:14.108367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110382+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:43:14.110382+0000","last_peered":"2023-11-04T01:43:14.110382+0000","last_clean":"2023-11-04T01:43:14.110382+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:43:14.110382+0000","last_undegraded":"2023-11-04T01:43:14.110382+0000","last_fullsized":"2023-11-04T01:43:14.110382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109220+0000","last_change":"2023-11-04T01:43:15.109220+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109220+0000","last_undegraded":"2023-11-04T01:43:15.109220+0000","last_fullsized":"2023-11-04T01:43:15.109220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.152844+0000","last_change":"2023-11-04T01:43:15.143691+0000","last_active":"2023-11-04T01:43:15.152844+0000","last_peered":"2023-11-04T01:43:15.152844+0000","last_clean":"2023-11-04T01:43:15.152844+0000","last_became_active":"2023-11-04T01:43:15.142954+0000","last_became_peered":"2023-11-04T01:43:15.142954+0000","last_unstale":"2023-11-04T01:43:15.152844+0000","last_undegraded":"2023-11-04T01:43:15.152844+0000","last_fullsized":"2023-11-04T01:43:15.152844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108953+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:43:14.108953+0000","last_peered":"2023-11-04T01:43:14.108953+0000","last_clean":"2023-11-04T01:43:14.108953+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:43:14.108953+0000","last_undegraded":"2023-11-04T01:43:14.108953+0000","last_fullsized":"2023-11-04T01:43:14.108953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111231+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:43:14.111231+0000","last_peered":"2023-11-04T01:43:14.111231+0000","last_clean":"2023-11-04T01:43:14.111231+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:43:14.111231+0000","last_undegraded":"2023-11-04T01:43:14.111231+0000","last_fullsized":"2023-11-04T01:43:14.111231+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113065+0000","last_change":"2023-11-04T01:43:15.113065+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113065+0000","last_undegraded":"2023-11-04T01:43:15.113065+0000","last_fullsized":"2023-11-04T01:43:15.113065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.156331+0000","last_change":"2023-11-04T01:43:15.152965+0000","last_active":"2023-11-04T01:43:15.156331+0000","last_peered":"2023-11-04T01:43:15.156331+0000","last_clean":"2023-11-04T01:43:15.156331+0000","last_became_active":"2023-11-04T01:43:15.152534+0000","last_became_peered":"2023-11-04T01:43:15.152534+0000","last_unstale":"2023-11-04T01:43:15.156331+0000","last_undegraded":"2023-11-04T01:43:15.156331+0000","last_fullsized":"2023-11-04T01:43:15.156331+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119750+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:43:14.119750+0000","last_peered":"2023-11-04T01:43:14.119750+0000","last_clean":"2023-11-04T01:43:14.119750+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:43:14.119750+0000","last_undegraded":"2023-11-04T01:43:14.119750+0000","last_fullsized":"2023-11-04T01:43:14.119750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099498+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:43:14.099498+0000","last_peered":"2023-11-04T01:43:14.099498+0000","last_clean":"2023-11-04T01:43:14.099498+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:43:14.099498+0000","last_undegraded":"2023-11-04T01:43:14.099498+0000","last_fullsized":"2023-11-04T01:43:14.099498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116611+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:43:14.116611+0000","last_peered":"2023-11-04T01:43:14.116611+0000","last_clean":"2023-11-04T01:43:14.116611+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:43:14.116611+0000","last_undegraded":"2023-11-04T01:43:14.116611+0000","last_fullsized":"2023-11-04T01:43:14.116611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109576+0000","last_change":"2023-11-04T01:43:15.109576+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109576+0000","last_undegraded":"2023-11-04T01:43:15.109576+0000","last_fullsized":"2023-11-04T01:43:15.109576+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158609+0000","last_change":"2023-11-04T01:43:15.153656+0000","last_active":"2023-11-04T01:43:15.158609+0000","last_peered":"2023-11-04T01:43:15.158609+0000","last_clean":"2023-11-04T01:43:15.158609+0000","last_became_active":"2023-11-04T01:43:15.152300+0000","last_became_peered":"2023-11-04T01:43:15.152300+0000","last_unstale":"2023-11-04T01:43:15.158609+0000","last_undegraded":"2023-11-04T01:43:15.158609+0000","last_fullsized":"2023-11-04T01:43:15.158609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110748+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:43:14.110748+0000","last_peered":"2023-11-04T01:43:14.110748+0000","last_clean":"2023-11-04T01:43:14.110748+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:43:14.110748+0000","last_undegraded":"2023-11-04T01:43:14.110748+0000","last_fullsized":"2023-11-04T01:43:14.110748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116019+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:43:14.116019+0000","last_peered":"2023-11-04T01:43:14.116019+0000","last_clean":"2023-11-04T01:43:14.116019+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:43:14.116019+0000","last_undegraded":"2023-11-04T01:43:14.116019+0000","last_fullsized":"2023-11-04T01:43:14.116019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109874+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:43:14.109874+0000","last_peered":"2023-11-04T01:43:14.109874+0000","last_clean":"2023-11-04T01:43:14.109874+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:43:14.109874+0000","last_undegraded":"2023-11-04T01:43:14.109874+0000","last_fullsized":"2023-11-04T01:43:14.109874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.128023+0000","last_change":"2023-11-04T01:43:15.128023+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.128023+0000","last_undegraded":"2023-11-04T01:43:15.128023+0000","last_fullsized":"2023-11-04T01:43:15.128023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.157296+0000","last_change":"2023-11-04T01:43:15.153690+0000","last_active":"2023-11-04T01:43:15.157296+0000","last_peered":"2023-11-04T01:43:15.157296+0000","last_clean":"2023-11-04T01:43:15.157296+0000","last_became_active":"2023-11-04T01:43:15.153389+0000","last_became_peered":"2023-11-04T01:43:15.153389+0000","last_unstale":"2023-11-04T01:43:15.157296+0000","last_undegraded":"2023-11-04T01:43:15.157296+0000","last_fullsized":"2023-11-04T01:43:15.157296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:22.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107451+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:43:14.107451+0000","last_peered":"2023-11-04T01:43:14.107451+0000","last_clean":"2023-11-04T01:43:14.107451+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:43:14.107451+0000","last_undegraded":"2023-11-04T01:43:14.107451+0000","last_fullsized":"2023-11-04T01:43:14.107451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110287+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:43:14.110287+0000","last_peered":"2023-11-04T01:43:14.110287+0000","last_clean":"2023-11-04T01:43:14.110287+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:43:14.110287+0000","last_undegraded":"2023-11-04T01:43:14.110287+0000","last_fullsized":"2023-11-04T01:43:14.110287+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107987+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:43:14.107987+0000","last_peered":"2023-11-04T01:43:14.107987+0000","last_clean":"2023-11-04T01:43:14.107987+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:43:14.107987+0000","last_undegraded":"2023-11-04T01:43:14.107987+0000","last_fullsized":"2023-11-04T01:43:14.107987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118300+0000","last_change":"2023-11-04T01:43:15.118300+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118300+0000","last_undegraded":"2023-11-04T01:43:15.118300+0000","last_fullsized":"2023-11-04T01:43:15.118300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138678+0000","last_change":"2023-11-04T01:43:15.134623+0000","last_active":"2023-11-04T01:43:15.138678+0000","last_peered":"2023-11-04T01:43:15.138678+0000","last_clean":"2023-11-04T01:43:15.138678+0000","last_became_active":"2023-11-04T01:43:15.133876+0000","last_became_peered":"2023-11-04T01:43:15.133876+0000","last_unstale":"2023-11-04T01:43:15.138678+0000","last_undegraded":"2023-11-04T01:43:15.138678+0000","last_fullsized":"2023-11-04T01:43:15.138678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:27.147417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108626+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:43:14.108626+0000","last_peered":"2023-11-04T01:43:14.108626+0000","last_clean":"2023-11-04T01:43:14.108626+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:43:14.108626+0000","last_undegraded":"2023-11-04T01:43:14.108626+0000","last_fullsized":"2023-11-04T01:43:14.108626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099976+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:43:14.099976+0000","last_peered":"2023-11-04T01:43:14.099976+0000","last_clean":"2023-11-04T01:43:14.099976+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:43:14.099976+0000","last_undegraded":"2023-11-04T01:43:14.099976+0000","last_fullsized":"2023-11-04T01:43:14.099976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110859+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:43:14.110859+0000","last_peered":"2023-11-04T01:43:14.110859+0000","last_clean":"2023-11-04T01:43:14.110859+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:43:14.110859+0000","last_undegraded":"2023-11-04T01:43:14.110859+0000","last_fullsized":"2023-11-04T01:43:14.110859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114081+0000","last_change":"2023-11-04T01:43:15.114081+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114081+0000","last_undegraded":"2023-11-04T01:43:15.114081+0000","last_fullsized":"2023-11-04T01:43:15.114081+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.160210+0000","last_change":"2023-11-04T01:43:15.153163+0000","last_active":"2023-11-04T01:43:15.160210+0000","last_peered":"2023-11-04T01:43:15.160210+0000","last_clean":"2023-11-04T01:43:15.160210+0000","last_became_active":"2023-11-04T01:43:15.152277+0000","last_became_peered":"2023-11-04T01:43:15.152277+0000","last_unstale":"2023-11-04T01:43:15.160210+0000","last_undegraded":"2023-11-04T01:43:15.160210+0000","last_fullsized":"2023-11-04T01:43:15.160210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:44.866182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113707+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:43:14.113707+0000","last_peered":"2023-11-04T01:43:14.113707+0000","last_clean":"2023-11-04T01:43:14.113707+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:43:14.113707+0000","last_undegraded":"2023-11-04T01:43:14.113707+0000","last_fullsized":"2023-11-04T01:43:14.113707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118557+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:43:14.118557+0000","last_peered":"2023-11-04T01:43:14.118557+0000","last_clean":"2023-11-04T01:43:14.118557+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:43:14.118557+0000","last_undegraded":"2023-11-04T01:43:14.118557+0000","last_fullsized":"2023-11-04T01:43:14.118557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107665+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:43:14.107665+0000","last_peered":"2023-11-04T01:43:14.107665+0000","last_clean":"2023-11-04T01:43:14.107665+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:43:14.107665+0000","last_undegraded":"2023-11-04T01:43:14.107665+0000","last_fullsized":"2023-11-04T01:43:14.107665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114506+0000","last_change":"2023-11-04T01:43:15.114506+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114506+0000","last_undegraded":"2023-11-04T01:43:15.114506+0000","last_fullsized":"2023-11-04T01:43:15.114506+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154886+0000","last_change":"2023-11-04T01:43:15.152417+0000","last_active":"2023-11-04T01:43:15.154886+0000","last_peered":"2023-11-04T01:43:15.154886+0000","last_clean":"2023-11-04T01:43:15.154886+0000","last_became_active":"2023-11-04T01:43:15.149079+0000","last_became_peered":"2023-11-04T01:43:15.149079+0000","last_unstale":"2023-11-04T01:43:15.154886+0000","last_undegraded":"2023-11-04T01:43:15.154886+0000","last_fullsized":"2023-11-04T01:43:15.154886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:04.346894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109057+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:43:14.109057+0000","last_peered":"2023-11-04T01:43:14.109057+0000","last_clean":"2023-11-04T01:43:14.109057+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:43:14.109057+0000","last_undegraded":"2023-11-04T01:43:14.109057+0000","last_fullsized":"2023-11-04T01:43:14.109057+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108086+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:43:14.108086+0000","last_peered":"2023-11-04T01:43:14.108086+0000","last_clean":"2023-11-04T01:43:14.108086+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:43:14.108086+0000","last_undegraded":"2023-11-04T01:43:14.108086+0000","last_fullsized":"2023-11-04T01:43:14.108086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.131026+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:43:15.131026+0000","last_peered":"2023-11-04T01:43:15.131026+0000","last_clean":"2023-11-04T01:43:15.131026+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:43:15.131026+0000","last_undegraded":"2023-11-04T01:43:15.131026+0000","last_fullsized":"2023-11-04T01:43:15.131026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.142934+0000","last_change":"2023-11-04T01:43:15.142934+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.142934+0000","last_undegraded":"2023-11-04T01:43:15.142934+0000","last_fullsized":"2023-11-04T01:43:15.142934+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.135294+0000","last_change":"2023-11-04T01:43:15.130147+0000","last_active":"2023-11-04T01:43:15.135294+0000","last_peered":"2023-11-04T01:43:15.135294+0000","last_clean":"2023-11-04T01:43:15.135294+0000","last_became_active":"2023-11-04T01:43:15.129434+0000","last_became_peered":"2023-11-04T01:43:15.129434+0000","last_unstale":"2023-11-04T01:43:15.135294+0000","last_undegraded":"2023-11-04T01:43:15.135294+0000","last_fullsized":"2023-11-04T01:43:15.135294+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:32.080511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117861+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:43:14.117861+0000","last_peered":"2023-11-04T01:43:14.117861+0000","last_clean":"2023-11-04T01:43:14.117861+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:43:14.117861+0000","last_undegraded":"2023-11-04T01:43:14.117861+0000","last_fullsized":"2023-11-04T01:43:14.117861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115367+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:43:14.115367+0000","last_peered":"2023-11-04T01:43:14.115367+0000","last_clean":"2023-11-04T01:43:14.115367+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:43:14.115367+0000","last_undegraded":"2023-11-04T01:43:14.115367+0000","last_fullsized":"2023-11-04T01:43:14.115367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108850+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:43:14.108850+0000","last_peered":"2023-11-04T01:43:14.108850+0000","last_clean":"2023-11-04T01:43:14.108850+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:43:14.108850+0000","last_undegraded":"2023-11-04T01:43:14.108850+0000","last_fullsized":"2023-11-04T01:43:14.108850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114286+0000","last_change":"2023-11-04T01:43:15.114286+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114286+0000","last_undegraded":"2023-11-04T01:43:15.114286+0000","last_fullsized":"2023-11-04T01:43:15.114286+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.149051+0000","last_change":"2023-11-04T01:43:15.144364+0000","last_active":"2023-11-04T01:43:15.149051+0000","last_peered":"2023-11-04T01:43:15.149051+0000","last_clean":"2023-11-04T01:43:15.149051+0000","last_became_active":"2023-11-04T01:43:15.138867+0000","last_became_peered":"2023-11-04T01:43:15.138867+0000","last_unstale":"2023-11-04T01:43:15.149051+0000","last_undegraded":"2023-11-04T01:43:15.149051+0000","last_fullsized":"2023-11-04T01:43:15.149051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:12.573389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119429+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:43:14.119429+0000","last_peered":"2023-11-04T01:43:14.119429+0000","last_clean":"2023-11-04T01:43:14.119429+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:43:14.119429+0000","last_undegraded":"2023-11-04T01:43:14.119429+0000","last_fullsized":"2023-11-04T01:43:14.119429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099681+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:43:14.099681+0000","last_peered":"2023-11-04T01:43:14.099681+0000","last_clean":"2023-11-04T01:43:14.099681+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:43:14.099681+0000","last_undegraded":"2023-11-04T01:43:14.099681+0000","last_fullsized":"2023-11-04T01:43:14.099681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115795+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:43:14.115795+0000","last_peered":"2023-11-04T01:43:14.115795+0000","last_clean":"2023-11-04T01:43:14.115795+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:43:14.115795+0000","last_undegraded":"2023-11-04T01:43:14.115795+0000","last_fullsized":"2023-11-04T01:43:14.115795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.144585+0000","last_change":"2023-11-04T01:43:15.144585+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.144585+0000","last_undegraded":"2023-11-04T01:43:15.144585+0000","last_fullsized":"2023-11-04T01:43:15.144585+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168837+0000","last_change":"2023-11-04T01:43:15.162848+0000","last_active":"2023-11-04T01:43:15.168837+0000","last_peered":"2023-11-04T01:43:15.168837+0000","last_clean":"2023-11-04T01:43:15.168837+0000","last_became_active":"2023-11-04T01:43:15.161007+0000","last_became_peered":"2023-11-04T01:43:15.161007+0000","last_unstale":"2023-11-04T01:43:15.168837+0000","last_undegraded":"2023-11-04T01:43:15.168837+0000","last_fullsized":"2023-11-04T01:43:15.168837+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:44.148187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119952+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:43:14.119952+0000","last_peered":"2023-11-04T01:43:14.119952+0000","last_clean":"2023-11-04T01:43:14.119952+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:43:14.119952+0000","last_undegraded":"2023-11-04T01:43:14.119952+0000","last_fullsized":"2023-11-04T01:43:14.119952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111915+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:43:14.111915+0000","last_peered":"2023-11-04T01:43:14.111915+0000","last_clean":"2023-11-04T01:43:14.111915+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:43:14.111915+0000","last_undegraded":"2023-11-04T01:43:14.111915+0000","last_fullsized":"2023-11-04T01:43:14.111915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114455+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:43:14.114455+0000","last_peered":"2023-11-04T01:43:14.114455+0000","last_clean":"2023-11-04T01:43:14.114455+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:43:14.114455+0000","last_undegraded":"2023-11-04T01:43:14.114455+0000","last_fullsized":"2023-11-04T01:43:14.114455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1675264,"data_stored":1094075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":1.139,"15min":0.95999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":29.603000000000002,"5min":29.603000000000002,"15min":29.603000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.59099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.355,"5min":1.454,"15min":1.454},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96599999999999997,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.129}]},{"osd":2,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.96999999999999997,"15min":0.92700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.008},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.63500000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.2450000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89800000000000002,"15min":0.89700000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":2.0760000000000001,"5min":1.1819999999999999,"15min":1.03},"min":{"1min":0.70999999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":25.791,"5min":25.791,"15min":25.791},"last":1.097}]},{"osd":4,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98599999999999999,"15min":1.0009999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.70099999999999996},{"interface":"front","average":{"1min":2.0910000000000002,"5min":1.27,"15min":1.131},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":25.696999999999999,"5min":25.696999999999999,"15min":25.696999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.129,"15min":1.0589999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":11.064,"5min":11.064,"15min":11.064},"last":1.075},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.1630000000000003,"5min":4.1630000000000003,"15min":4.1630000000000003},"last":1.155}]},{"osd":6,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1200000000000001,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2250000000000001,"15min":1.226},"min":{"1min":0.88500000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":511073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.165,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2210000000000001,"5min":1.347,"15min":1.347},"last":1.1240000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.262,"5min":1.395,"15min":1.395},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2270000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.95399999999999996},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2010000000000001,"5min":1.319,"15min":1.319},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1950000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98199999999999998},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.079,"15min":1.103},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3879999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.03,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.694,"15min":1.694},"last":1.04},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1259999999999999,"15min":1.1359999999999999},"min":{"1min":0.76700000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.083}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.1120000000000001,"15min":1.1160000000000001},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3109999999999999,"5min":1.649,"15min":1.649},"last":1.329},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1499999999999999,"15min":1.175},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.409,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79700000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.23,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.504,"5min":0.5,"15min":0.5},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.262},"last":0.51400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.85599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.419,"15min":1.419},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.76100000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2490000000000001,"5min":1.252,"15min":1.252},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.046},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.58599999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4159999999999999,"5min":1.502,"15min":1.502},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2270000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.383,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.107,"15min":1.115},"min":{"1min":0.68799999999999994,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3280000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0189999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":1.016},"min":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3939999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3},"last":0.51700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91700000000000004,"15min":0.94499999999999995},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.101,"5min":1.605,"15min":1.605},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.62}]},{"osd":2,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.234,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.446,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96599999999999997,"15min":0.97299999999999998},"min":{"1min":0.68100000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.488,"15min":1.488},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.296,"5min":1.996,"15min":1.996},"last":1.119}]},{"osd":5,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.077,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4830000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0649999999999999,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2889999999999999,"5min":1.514,"15min":1.514},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1419999999999999},"min":{"1min":0.70599999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.349,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.161,"15min":1.169},"min":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.4339999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2150000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.147,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65600000000000003,"15min":0.68200000000000005},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.171,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.74199999999999999},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.623,"15min":1.623},"last":1.1419999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.70099999999999996},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0069999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95999999999999996,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.395,"5min":1.806,"15min":1.806},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.67300000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.425,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.196}]},{"osd":6,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.54,"15min":1.54},"last":1.093},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.5720000000000001,"5min":1.73,"15min":1.73},"last":1.407}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.361,"5min":1.407,"15min":1.407},"last":1.25},{"interface":"front","average":{"1min":1.044,"5min":1.0860000000000001,"15min":1.1060000000000001},"min":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.419,"5min":1.732,"15min":1.732},"last":1.224}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.64600000000000002},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1040000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.103,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":1.29,"15min":1.29},"last":1.327}]},{"osd":3,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.77700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.125,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.175},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.98099999999999998},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1399999999999999,"5min":1.534,"15min":1.534},"last":1.5269999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.022,"15min":1.0469999999999999},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.21,"5min":1.877,"15min":1.877},"last":1.4490000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.012,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.25,"5min":1.446,"15min":1.446},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.034,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.143,"15min":1.1870000000000001},"min":{"1min":0.73299999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0379999999999998,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.78}]},{"osd":7,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.583},{"interface":"front","average":{"1min":1.071,"5min":1.1060000000000001,"15min":1.1439999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4630000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.8919999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.67300000000000004,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.05,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.629}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.379,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7929999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.0309999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86099999999999999,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.012,"15min":0.96699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":1.1519999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.077,"15min":1.056},"min":{"1min":0.61099999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.077,"15min":1.083},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5449999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1220000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92500000000000004,"15min":0.90600000000000003},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.099},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1220000000000001,"15min":1.0800000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.9199999999999999,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":1.2609999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1040000000000001,"15min":1.1140000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.226},{"interface":"front","average":{"1min":1.034,"5min":0.998,"15min":0.98699999999999999},"min":{"1min":0.68799999999999994,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9850000000000001,"5min":1.994,"15min":1.994},"last":1.198}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1687552,"data_stored":1101441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75800000000000001,"5min":1.135,"15min":1.135},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.624}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.27,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.026},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2470000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.68999999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1399999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.014},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.71699999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2170000000000001,"5min":1.694,"15min":1.694},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.745,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.298,"5min":1.782,"15min":1.782},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5229999999999999,"5min":1.903,"15min":1.903},"last":0.96399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.0800000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5920000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.653,"15min":1.653},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:20.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:20.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 Processor -- start 2023-11-04T01:43:20.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 -- start start 2023-11-04T01:43:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3b1415afb0 0x7f3b140b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cb400 0x7f3b140cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b140cd6d0 0x7f3b140cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1415b390 con 0x7f3b140cd6d0 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140d0a60 con 0x7f3b1415afb0 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b1a2d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140d04a0 con 0x7f3b140cb400 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b140cd6d0 0x7f3b140cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b140cd6d0 0x7f3b140cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44952/0 (socket says 172.21.15.40:44952) 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 -- 172.21.15.40:0/1030922878 learned_addr learned my addr 172.21.15.40:0/1030922878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b13fff640 1 --2- 172.21.15.40:0/1030922878 >> v2:172.21.15.91:3300/0 conn(0x7f3b1415afb0 0x7f3b140b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b137fe640 1 --2- 172.21.15.40:0/1030922878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cb400 0x7f3b140cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 -- 172.21.15.40:0/1030922878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cb400 msgr2=0x7f3b140cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 --2- 172.21.15.40:0/1030922878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cb400 0x7f3b140cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 -- 172.21.15.40:0/1030922878 >> v2:172.21.15.91:3300/0 conn(0x7f3b1415afb0 msgr2=0x7f3b140b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 --2- 172.21.15.40:0/1030922878 >> v2:172.21.15.91:3300/0 conn(0x7f3b1415afb0 0x7f3b140b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.413+0000 7f3b18872640 1 -- 172.21.15.40:0/1030922878 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140d0780 con 0x7f3b140cd6d0 2023-11-04T01:43:20.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 --2- 172.21.15.40:0/1030922878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b140cd6d0 0x7f3b140cdae0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3b14066da0 tx=0x7f3b0c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b400f70a86b48e5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b12ffd640 1 -- 172.21.15.40:0/1030922878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0a5790 con 0x7f3b140cd6d0 2023-11-04T01:43:20.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b12ffd640 1 -- 172.21.15.40:0/1030922878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c0a58f0 con 0x7f3b140cd6d0 2023-11-04T01:43:20.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b12ffd640 1 -- 172.21.15.40:0/1030922878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0a5c80 con 0x7f3b140cd6d0 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1030922878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b140cd6d0 msgr2=0x7f3b140cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1030922878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b140cd6d0 0x7f3b140cdae0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3b14066da0 tx=0x7f3b0c01c910 comp rx=0 tx=0).stop 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1030922878 shutdown_connections 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1030922878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b140cd6d0 0x7f3b140cdae0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1030922878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cb400 0x7f3b140cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1030922878 >> v2:172.21.15.91:3300/0 conn(0x7f3b1415afb0 0x7f3b140b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1030922878 >> 172.21.15.40:0/1030922878 conn(0x7f3b14065dc0 msgr2=0x7f3b140661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1030922878 shutdown_connections 2023-11-04T01:43:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1030922878 wait complete. 2023-11-04T01:43:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 Processor -- start 2023-11-04T01:43:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- start start 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b140cb400 0x7f3b1414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cd6d0 0x7f3b14152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 0x7f3b1414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14153010 con 0x7f3b1415afb0 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1414b3d0 con 0x7f3b140cb400 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b1a2d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140caac0 con 0x7f3b140cd6d0 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 0x7f3b1414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 0x7f3b1414ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44964/0 (socket says 172.21.15.40:44964) 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 -- 172.21.15.40:0/1789643535 learned_addr learned my addr 172.21.15.40:0/1789643535 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b137fe640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cd6d0 0x7f3b14152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b13fff640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b140cb400 0x7f3b1414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 -- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cd6d0 msgr2=0x7f3b14152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cd6d0 0x7f3b14152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 -- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b140cb400 msgr2=0x7f3b1414cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b140cb400 0x7f3b1414cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 -- 172.21.15.40:0/1789643535 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c009b30 con 0x7f3b1415afb0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b18872640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 0x7f3b1414ae90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0af040 tx=0x7f3b0c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.417+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0b8670 con 0x7f3b1415afb0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c0b87d0 con 0x7f3b1415afb0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b140cada0 con 0x7f3b1415afb0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0b8b60 con 0x7f3b1415afb0 2023-11-04T01:43:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1415b570 con 0x7f3b1415afb0 2023-11-04T01:43:20.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140675f0 con 0x7f3b1415afb0 2023-11-04T01:43:20.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b0c0b8cc0 con 0x7f3b1415afb0 2023-11-04T01:43:20.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b10ff9640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3b000664a0 0x7f3b00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f3b0c11f8d0 con 0x7f3b1415afb0 2023-11-04T01:43:20.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b13fff640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3b000664a0 0x7f3b00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.421+0000 7f3b13fff640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3b000664a0 0x7f3b00068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400b930 tx=0x7f3b04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.425+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3b0c0eca60 con 0x7f3b1415afb0 2023-11-04T01:43:20.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.577+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b140ce020 con 0x7f3b000664a0 2023-11-04T01:43:20.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.617+0000 7f3b10ff9640 1 -- 172.21.15.40:0/1789643535 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525035 (secure 0 0 0) 0x7f3b0400f860 con 0x7f3b000664a0 2023-11-04T01:43:20.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:20.631 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:43:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3b000664a0 msgr2=0x7f3b00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3b000664a0 0x7f3b00068960 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400b930 tx=0x7f3b04008040 comp rx=0 tx=0).stop 2023-11-04T01:43:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 msgr2=0x7f3b1414ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 0x7f3b1414ae90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0af040 tx=0x7f3b0c0196b0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 shutdown_connections 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3b000664a0 0x7f3b00068960 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1415afb0 0x7f3b1414ae90 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3b140cd6d0 0x7f3b14152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 --2- 172.21.15.40:0/1789643535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3b140cb400 0x7f3b1414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 >> 172.21.15.40:0/1789643535 conn(0x7f3b14065dc0 msgr2=0x7f3b1415a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 shutdown_connections 2023-11-04T01:43:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.621+0000 7f3b1a2d5640 1 -- 172.21.15.40:0/1789643535 wait complete. 2023-11-04T01:43:20.649 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-11-04T01:43:19.825567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259080,"kb_used_data":9632,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715640,"statfs":{"total":773094113280,"available":772828815360,"internally_reserved":0,"allocated":9863168,"data_stored":5225124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726884"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117008+0000","last_change":"2023-11-04T01:43:15.117008+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117008+0000","last_undegraded":"2023-11-04T01:43:15.117008+0000","last_fullsized":"2023-11-04T01:43:15.117008+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131236+0000","last_change":"2023-11-04T01:43:15.131236+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131236+0000","last_undegraded":"2023-11-04T01:43:15.131236+0000","last_fullsized":"2023-11-04T01:43:15.131236+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118764+0000","last_change":"2023-11-04T01:43:15.118764+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118764+0000","last_undegraded":"2023-11-04T01:43:15.118764+0000","last_fullsized":"2023-11-04T01:43:15.118764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.130569+0000","last_change":"2023-11-04T01:43:15.130569+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.130569+0000","last_undegraded":"2023-11-04T01:43:15.130569+0000","last_fullsized":"2023-11-04T01:43:15.130569+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.149804+0000","last_change":"2023-11-04T01:43:15.149804+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.149804+0000","last_undegraded":"2023-11-04T01:43:15.149804+0000","last_fullsized":"2023-11-04T01:43:15.149804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125131+0000","last_change":"2023-11-04T01:43:15.125131+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125131+0000","last_undegraded":"2023-11-04T01:43:15.125131+0000","last_fullsized":"2023-11-04T01:43:15.125131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.124944+0000","last_change":"2023-11-04T01:43:15.124944+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.124944+0000","last_undegraded":"2023-11-04T01:43:15.124944+0000","last_fullsized":"2023-11-04T01:43:15.124944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.127761+0000","last_change":"2023-11-04T01:43:15.127761+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.127761+0000","last_undegraded":"2023-11-04T01:43:15.127761+0000","last_fullsized":"2023-11-04T01:43:15.127761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125044+0000","last_change":"2023-11-04T01:43:15.125044+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125044+0000","last_undegraded":"2023-11-04T01:43:15.125044+0000","last_fullsized":"2023-11-04T01:43:15.125044+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.147747+0000","last_change":"2023-11-04T01:43:15.147747+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.147747+0000","last_undegraded":"2023-11-04T01:43:15.147747+0000","last_fullsized":"2023-11-04T01:43:15.147747+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.111907+0000","last_change":"2023-11-04T01:43:15.111907+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.111907+0000","last_undegraded":"2023-11-04T01:43:15.111907+0000","last_fullsized":"2023-11-04T01:43:15.111907+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110469+0000","last_change":"2023-11-04T01:43:15.110469+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110469+0000","last_undegraded":"2023-11-04T01:43:15.110469+0000","last_fullsized":"2023-11-04T01:43:15.110469+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119196+0000","last_change":"2023-11-04T01:43:15.119196+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119196+0000","last_undegraded":"2023-11-04T01:43:15.119196+0000","last_fullsized":"2023-11-04T01:43:15.119196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119331+0000","last_change":"2023-11-04T01:43:15.119331+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119331+0000","last_undegraded":"2023-11-04T01:43:15.119331+0000","last_fullsized":"2023-11-04T01:43:15.119331+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.129288+0000","last_change":"2023-11-04T01:43:15.129288+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.129288+0000","last_undegraded":"2023-11-04T01:43:15.129288+0000","last_fullsized":"2023-11-04T01:43:15.129288+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.132136+0000","last_change":"2023-11-04T01:43:15.132136+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.132136+0000","last_undegraded":"2023-11-04T01:43:15.132136+0000","last_fullsized":"2023-11-04T01:43:15.132136+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116352+0000","last_change":"2023-11-04T01:43:15.116352+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116352+0000","last_undegraded":"2023-11-04T01:43:15.116352+0000","last_fullsized":"2023-11-04T01:43:15.116352+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125071+0000","last_change":"2023-11-04T01:43:15.125071+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125071+0000","last_undegraded":"2023-11-04T01:43:15.125071+0000","last_fullsized":"2023-11-04T01:43:15.125071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118123+0000","last_change":"2023-11-04T01:43:15.118123+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118123+0000","last_undegraded":"2023-11-04T01:43:15.118123+0000","last_fullsized":"2023-11-04T01:43:15.118123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109148+0000","last_change":"2023-11-04T01:43:15.109148+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109148+0000","last_undegraded":"2023-11-04T01:43:15.109148+0000","last_fullsized":"2023-11-04T01:43:15.109148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122192+0000","last_change":"2023-11-04T01:43:15.122192+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122192+0000","last_undegraded":"2023-11-04T01:43:15.122192+0000","last_fullsized":"2023-11-04T01:43:15.122192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.146557+0000","last_change":"2023-11-04T01:43:15.146557+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.146557+0000","last_undegraded":"2023-11-04T01:43:15.146557+0000","last_fullsized":"2023-11-04T01:43:15.146557+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117462+0000","last_change":"2023-11-04T01:43:15.117462+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117462+0000","last_undegraded":"2023-11-04T01:43:15.117462+0000","last_fullsized":"2023-11-04T01:43:15.117462+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148901+0000","last_change":"2023-11-04T01:43:15.148901+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148901+0000","last_undegraded":"2023-11-04T01:43:15.148901+0000","last_fullsized":"2023-11-04T01:43:15.148901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114154+0000","last_change":"2023-11-04T01:43:15.114154+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114154+0000","last_undegraded":"2023-11-04T01:43:15.114154+0000","last_fullsized":"2023-11-04T01:43:15.114154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114738+0000","last_change":"2023-11-04T01:43:15.114738+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114738+0000","last_undegraded":"2023-11-04T01:43:15.114738+0000","last_fullsized":"2023-11-04T01:43:15.114738+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113282+0000","last_change":"2023-11-04T01:43:15.113282+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113282+0000","last_undegraded":"2023-11-04T01:43:15.113282+0000","last_fullsized":"2023-11-04T01:43:15.113282+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.138778+0000","last_change":"2023-11-04T01:43:15.138778+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.138778+0000","last_undegraded":"2023-11-04T01:43:15.138778+0000","last_fullsized":"2023-11-04T01:43:15.138778+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122902+0000","last_change":"2023-11-04T01:43:15.122902+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122902+0000","last_undegraded":"2023-11-04T01:43:15.122902+0000","last_fullsized":"2023-11-04T01:43:15.122902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110550+0000","last_change":"2023-11-04T01:43:15.110550+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110550+0000","last_undegraded":"2023-11-04T01:43:15.110550+0000","last_fullsized":"2023-11-04T01:43:15.110550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123664+0000","last_change":"2023-11-04T01:43:15.123664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123664+0000","last_undegraded":"2023-11-04T01:43:15.123664+0000","last_fullsized":"2023-11-04T01:43:15.123664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126727+0000","last_change":"2023-11-04T01:43:15.126727+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126727+0000","last_undegraded":"2023-11-04T01:43:15.126727+0000","last_fullsized":"2023-11-04T01:43:15.126727+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113823+0000","last_change":"2023-11-04T01:43:15.113823+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113823+0000","last_undegraded":"2023-11-04T01:43:15.113823+0000","last_fullsized":"2023-11-04T01:43:15.113823+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159528+0000","last_change":"2023-11-04T01:43:15.157943+0000","last_active":"2023-11-04T01:43:15.159528+0000","last_peered":"2023-11-04T01:43:15.159528+0000","last_clean":"2023-11-04T01:43:15.159528+0000","last_became_active":"2023-11-04T01:43:15.157543+0000","last_became_peered":"2023-11-04T01:43:15.157543+0000","last_unstale":"2023-11-04T01:43:15.159528+0000","last_undegraded":"2023-11-04T01:43:15.159528+0000","last_fullsized":"2023-11-04T01:43:15.159528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:54.891988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116221+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:43:14.116221+0000","last_peered":"2023-11-04T01:43:14.116221+0000","last_clean":"2023-11-04T01:43:14.116221+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:43:14.116221+0000","last_undegraded":"2023-11-04T01:43:14.116221+0000","last_fullsized":"2023-11-04T01:43:14.116221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108469+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:43:14.108469+0000","last_peered":"2023-11-04T01:43:14.108469+0000","last_clean":"2023-11-04T01:43:14.108469+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:43:14.108469+0000","last_undegraded":"2023-11-04T01:43:14.108469+0000","last_fullsized":"2023-11-04T01:43:14.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114862+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:43:14.114862+0000","last_peered":"2023-11-04T01:43:14.114862+0000","last_clean":"2023-11-04T01:43:14.114862+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:43:14.114862+0000","last_undegraded":"2023-11-04T01:43:14.114862+0000","last_fullsized":"2023-11-04T01:43:14.114862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111391+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:43:14.111391+0000","last_peered":"2023-11-04T01:43:14.111391+0000","last_clean":"2023-11-04T01:43:14.111391+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:43:14.111391+0000","last_undegraded":"2023-11-04T01:43:14.111391+0000","last_fullsized":"2023-11-04T01:43:14.111391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114458+0000","last_change":"2023-11-04T01:43:15.114458+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114458+0000","last_undegraded":"2023-11-04T01:43:15.114458+0000","last_fullsized":"2023-11-04T01:43:15.114458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137760+0000","last_change":"2023-11-04T01:43:15.134346+0000","last_active":"2023-11-04T01:43:15.137760+0000","last_peered":"2023-11-04T01:43:15.137760+0000","last_clean":"2023-11-04T01:43:15.137760+0000","last_became_active":"2023-11-04T01:43:15.133897+0000","last_became_peered":"2023-11-04T01:43:15.133897+0000","last_unstale":"2023-11-04T01:43:15.137760+0000","last_undegraded":"2023-11-04T01:43:15.137760+0000","last_fullsized":"2023-11-04T01:43:15.137760+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:29.175532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107341+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:43:14.107341+0000","last_peered":"2023-11-04T01:43:14.107341+0000","last_clean":"2023-11-04T01:43:14.107341+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:43:14.107341+0000","last_undegraded":"2023-11-04T01:43:14.107341+0000","last_fullsized":"2023-11-04T01:43:14.107341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117178+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:43:14.117178+0000","last_peered":"2023-11-04T01:43:14.117178+0000","last_clean":"2023-11-04T01:43:14.117178+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:43:14.117178+0000","last_undegraded":"2023-11-04T01:43:14.117178+0000","last_fullsized":"2023-11-04T01:43:14.117178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111700+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:43:14.111700+0000","last_peered":"2023-11-04T01:43:14.111700+0000","last_clean":"2023-11-04T01:43:14.111700+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:43:14.111700+0000","last_undegraded":"2023-11-04T01:43:14.111700+0000","last_fullsized":"2023-11-04T01:43:14.111700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114664+0000","last_change":"2023-11-04T01:43:15.114664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114664+0000","last_undegraded":"2023-11-04T01:43:15.114664+0000","last_fullsized":"2023-11-04T01:43:15.114664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159555+0000","last_change":"2023-11-04T01:43:15.158367+0000","last_active":"2023-11-04T01:43:15.159555+0000","last_peered":"2023-11-04T01:43:15.159555+0000","last_clean":"2023-11-04T01:43:15.159555+0000","last_became_active":"2023-11-04T01:43:15.157718+0000","last_became_peered":"2023-11-04T01:43:15.157718+0000","last_unstale":"2023-11-04T01:43:15.159555+0000","last_undegraded":"2023-11-04T01:43:15.159555+0000","last_fullsized":"2023-11-04T01:43:15.159555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:03.434277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099606+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:43:14.099606+0000","last_peered":"2023-11-04T01:43:14.099606+0000","last_clean":"2023-11-04T01:43:14.099606+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:43:14.099606+0000","last_undegraded":"2023-11-04T01:43:14.099606+0000","last_fullsized":"2023-11-04T01:43:14.099606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109161+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:43:14.109161+0000","last_peered":"2023-11-04T01:43:14.109161+0000","last_clean":"2023-11-04T01:43:14.109161+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:43:14.109161+0000","last_undegraded":"2023-11-04T01:43:14.109161+0000","last_fullsized":"2023-11-04T01:43:14.109161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116648+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:43:14.116648+0000","last_peered":"2023-11-04T01:43:14.116648+0000","last_clean":"2023-11-04T01:43:14.116648+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:43:14.116648+0000","last_undegraded":"2023-11-04T01:43:14.116648+0000","last_fullsized":"2023-11-04T01:43:14.116648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116181+0000","last_change":"2023-11-04T01:43:15.116181+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116181+0000","last_undegraded":"2023-11-04T01:43:15.116181+0000","last_fullsized":"2023-11-04T01:43:15.116181+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168810+0000","last_change":"2023-11-04T01:43:15.162827+0000","last_active":"2023-11-04T01:43:15.168810+0000","last_peered":"2023-11-04T01:43:15.168810+0000","last_clean":"2023-11-04T01:43:15.168810+0000","last_became_active":"2023-11-04T01:43:15.162272+0000","last_became_peered":"2023-11-04T01:43:15.162272+0000","last_unstale":"2023-11-04T01:43:15.168810+0000","last_undegraded":"2023-11-04T01:43:15.168810+0000","last_fullsized":"2023-11-04T01:43:15.168810+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.577222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100017+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:43:14.100017+0000","last_peered":"2023-11-04T01:43:14.100017+0000","last_clean":"2023-11-04T01:43:14.100017+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:43:14.100017+0000","last_undegraded":"2023-11-04T01:43:14.100017+0000","last_fullsized":"2023-11-04T01:43:14.100017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100057+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:43:14.100057+0000","last_peered":"2023-11-04T01:43:14.100057+0000","last_clean":"2023-11-04T01:43:14.100057+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:43:14.100057+0000","last_undegraded":"2023-11-04T01:43:14.100057+0000","last_fullsized":"2023-11-04T01:43:14.100057+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.105693+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:43:15.105693+0000","last_peered":"2023-11-04T01:43:15.105693+0000","last_clean":"2023-11-04T01:43:15.105693+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:43:15.105693+0000","last_undegraded":"2023-11-04T01:43:15.105693+0000","last_fullsized":"2023-11-04T01:43:15.105693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116753+0000","last_change":"2023-11-04T01:43:15.116753+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116753+0000","last_undegraded":"2023-11-04T01:43:15.116753+0000","last_fullsized":"2023-11-04T01:43:15.116753+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.151563+0000","last_change":"2023-11-04T01:43:15.146655+0000","last_active":"2023-11-04T01:43:15.151563+0000","last_peered":"2023-11-04T01:43:15.151563+0000","last_clean":"2023-11-04T01:43:15.151563+0000","last_became_active":"2023-11-04T01:43:15.145780+0000","last_became_peered":"2023-11-04T01:43:15.145780+0000","last_unstale":"2023-11-04T01:43:15.151563+0000","last_undegraded":"2023-11-04T01:43:15.151563+0000","last_fullsized":"2023-11-04T01:43:15.151563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:02.611764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107489+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:43:14.107489+0000","last_peered":"2023-11-04T01:43:14.107489+0000","last_clean":"2023-11-04T01:43:14.107489+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:43:14.107489+0000","last_undegraded":"2023-11-04T01:43:14.107489+0000","last_fullsized":"2023-11-04T01:43:14.107489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113762+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:43:14.113762+0000","last_peered":"2023-11-04T01:43:14.113762+0000","last_clean":"2023-11-04T01:43:14.113762+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:43:14.113762+0000","last_undegraded":"2023-11-04T01:43:14.113762+0000","last_fullsized":"2023-11-04T01:43:14.113762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111706+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:43:14.111706+0000","last_peered":"2023-11-04T01:43:14.111706+0000","last_clean":"2023-11-04T01:43:14.111706+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:43:14.111706+0000","last_undegraded":"2023-11-04T01:43:14.111706+0000","last_fullsized":"2023-11-04T01:43:14.111706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125629+0000","last_change":"2023-11-04T01:43:15.125629+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125629+0000","last_undegraded":"2023-11-04T01:43:15.125629+0000","last_fullsized":"2023-11-04T01:43:15.125629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.165914+0000","last_change":"2023-11-04T01:43:15.148592+0000","last_active":"2023-11-04T01:43:15.165914+0000","last_peered":"2023-11-04T01:43:15.165914+0000","last_clean":"2023-11-04T01:43:15.165914+0000","last_became_active":"2023-11-04T01:43:15.147892+0000","last_became_peered":"2023-11-04T01:43:15.147892+0000","last_unstale":"2023-11-04T01:43:15.165914+0000","last_undegraded":"2023-11-04T01:43:15.165914+0000","last_fullsized":"2023-11-04T01:43:15.165914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:55.779518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112657+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:43:14.112657+0000","last_peered":"2023-11-04T01:43:14.112657+0000","last_clean":"2023-11-04T01:43:14.112657+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:43:14.112657+0000","last_undegraded":"2023-11-04T01:43:14.112657+0000","last_fullsized":"2023-11-04T01:43:14.112657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108116+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:43:14.108116+0000","last_peered":"2023-11-04T01:43:14.108116+0000","last_clean":"2023-11-04T01:43:14.108116+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:43:14.108116+0000","last_undegraded":"2023-11-04T01:43:14.108116+0000","last_fullsized":"2023-11-04T01:43:14.108116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108640+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:43:14.108640+0000","last_peered":"2023-11-04T01:43:14.108640+0000","last_clean":"2023-11-04T01:43:14.108640+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:43:14.108640+0000","last_undegraded":"2023-11-04T01:43:14.108640+0000","last_fullsized":"2023-11-04T01:43:14.108640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123961+0000","last_change":"2023-11-04T01:43:15.123961+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123961+0000","last_undegraded":"2023-11-04T01:43:15.123961+0000","last_fullsized":"2023-11-04T01:43:15.123961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.150022+0000","last_change":"2023-11-04T01:43:15.146312+0000","last_active":"2023-11-04T01:43:15.150022+0000","last_peered":"2023-11-04T01:43:15.150022+0000","last_clean":"2023-11-04T01:43:15.150022+0000","last_became_active":"2023-11-04T01:43:15.145470+0000","last_became_peered":"2023-11-04T01:43:15.145470+0000","last_unstale":"2023-11-04T01:43:15.150022+0000","last_undegraded":"2023-11-04T01:43:15.150022+0000","last_fullsized":"2023-11-04T01:43:15.150022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:06.918241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112960+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:43:14.112960+0000","last_peered":"2023-11-04T01:43:14.112960+0000","last_clean":"2023-11-04T01:43:14.112960+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:43:14.112960+0000","last_undegraded":"2023-11-04T01:43:14.112960+0000","last_fullsized":"2023-11-04T01:43:14.112960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107704+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:43:14.107704+0000","last_peered":"2023-11-04T01:43:14.107704+0000","last_clean":"2023-11-04T01:43:14.107704+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:43:14.107704+0000","last_undegraded":"2023-11-04T01:43:14.107704+0000","last_fullsized":"2023-11-04T01:43:14.107704+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113790+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:43:14.113790+0000","last_peered":"2023-11-04T01:43:14.113790+0000","last_clean":"2023-11-04T01:43:14.113790+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:43:14.113790+0000","last_undegraded":"2023-11-04T01:43:14.113790+0000","last_fullsized":"2023-11-04T01:43:14.113790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148519+0000","last_change":"2023-11-04T01:43:15.148519+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148519+0000","last_undegraded":"2023-11-04T01:43:15.148519+0000","last_fullsized":"2023-11-04T01:43:15.148519+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168590+0000","last_change":"2023-11-04T01:43:15.164771+0000","last_active":"2023-11-04T01:43:15.168590+0000","last_peered":"2023-11-04T01:43:15.168590+0000","last_clean":"2023-11-04T01:43:15.168590+0000","last_became_active":"2023-11-04T01:43:15.164172+0000","last_became_peered":"2023-11-04T01:43:15.164172+0000","last_unstale":"2023-11-04T01:43:15.168590+0000","last_undegraded":"2023-11-04T01:43:15.168590+0000","last_fullsized":"2023-11-04T01:43:15.168590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:50.337311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.120061+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:43:14.120061+0000","last_peered":"2023-11-04T01:43:14.120061+0000","last_clean":"2023-11-04T01:43:14.120061+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:43:14.120061+0000","last_undegraded":"2023-11-04T01:43:14.120061+0000","last_fullsized":"2023-11-04T01:43:14.120061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107402+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:43:14.107402+0000","last_peered":"2023-11-04T01:43:14.107402+0000","last_clean":"2023-11-04T01:43:14.107402+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:43:14.107402+0000","last_undegraded":"2023-11-04T01:43:14.107402+0000","last_fullsized":"2023-11-04T01:43:14.107402+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116779+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:43:14.116779+0000","last_peered":"2023-11-04T01:43:14.116779+0000","last_clean":"2023-11-04T01:43:14.116779+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:43:14.116779+0000","last_undegraded":"2023-11-04T01:43:14.116779+0000","last_fullsized":"2023-11-04T01:43:14.116779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119517+0000","last_change":"2023-11-04T01:43:15.119517+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119517+0000","last_undegraded":"2023-11-04T01:43:15.119517+0000","last_fullsized":"2023-11-04T01:43:15.119517+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166008+0000","last_change":"2023-11-04T01:43:15.162799+0000","last_active":"2023-11-04T01:43:15.166008+0000","last_peered":"2023-11-04T01:43:15.166008+0000","last_clean":"2023-11-04T01:43:15.166008+0000","last_became_active":"2023-11-04T01:43:15.162068+0000","last_became_peered":"2023-11-04T01:43:15.162068+0000","last_unstale":"2023-11-04T01:43:15.166008+0000","last_undegraded":"2023-11-04T01:43:15.166008+0000","last_fullsized":"2023-11-04T01:43:15.166008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108667+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:43:14.108667+0000","last_peered":"2023-11-04T01:43:14.108667+0000","last_clean":"2023-11-04T01:43:14.108667+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:43:14.108667+0000","last_undegraded":"2023-11-04T01:43:14.108667+0000","last_fullsized":"2023-11-04T01:43:14.108667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111179+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:43:14.111179+0000","last_peered":"2023-11-04T01:43:14.111179+0000","last_clean":"2023-11-04T01:43:14.111179+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:43:14.111179+0000","last_undegraded":"2023-11-04T01:43:14.111179+0000","last_fullsized":"2023-11-04T01:43:14.111179+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108691+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:43:14.108691+0000","last_peered":"2023-11-04T01:43:14.108691+0000","last_clean":"2023-11-04T01:43:14.108691+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:43:14.108691+0000","last_undegraded":"2023-11-04T01:43:14.108691+0000","last_fullsized":"2023-11-04T01:43:14.108691+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.121012+0000","last_change":"2023-11-04T01:43:15.121012+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.121012+0000","last_undegraded":"2023-11-04T01:43:15.121012+0000","last_fullsized":"2023-11-04T01:43:15.121012+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137807+0000","last_change":"2023-11-04T01:43:15.132590+0000","last_active":"2023-11-04T01:43:15.137807+0000","last_peered":"2023-11-04T01:43:15.137807+0000","last_clean":"2023-11-04T01:43:15.137807+0000","last_became_active":"2023-11-04T01:43:15.132101+0000","last_became_peered":"2023-11-04T01:43:15.132101+0000","last_unstale":"2023-11-04T01:43:15.137807+0000","last_undegraded":"2023-11-04T01:43:15.137807+0000","last_fullsized":"2023-11-04T01:43:15.137807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:14.252075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117896+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:43:14.117896+0000","last_peered":"2023-11-04T01:43:14.117896+0000","last_clean":"2023-11-04T01:43:14.117896+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:43:14.117896+0000","last_undegraded":"2023-11-04T01:43:14.117896+0000","last_fullsized":"2023-11-04T01:43:14.117896+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113028+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:43:14.113028+0000","last_peered":"2023-11-04T01:43:14.113028+0000","last_clean":"2023-11-04T01:43:14.113028+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:43:14.113028+0000","last_undegraded":"2023-11-04T01:43:14.113028+0000","last_fullsized":"2023-11-04T01:43:14.113028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108235+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:43:14.108235+0000","last_peered":"2023-11-04T01:43:14.108235+0000","last_clean":"2023-11-04T01:43:14.108235+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:43:14.108235+0000","last_undegraded":"2023-11-04T01:43:14.108235+0000","last_fullsized":"2023-11-04T01:43:14.108235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131096+0000","last_change":"2023-11-04T01:43:15.131096+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131096+0000","last_undegraded":"2023-11-04T01:43:15.131096+0000","last_fullsized":"2023-11-04T01:43:15.131096+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168718+0000","last_change":"2023-11-04T01:43:15.161698+0000","last_active":"2023-11-04T01:43:15.168718+0000","last_peered":"2023-11-04T01:43:15.168718+0000","last_clean":"2023-11-04T01:43:15.168718+0000","last_became_active":"2023-11-04T01:43:15.161055+0000","last_became_peered":"2023-11-04T01:43:15.161055+0000","last_unstale":"2023-11-04T01:43:15.168718+0000","last_undegraded":"2023-11-04T01:43:15.168718+0000","last_fullsized":"2023-11-04T01:43:15.168718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:30.109736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109650+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:43:14.109650+0000","last_peered":"2023-11-04T01:43:14.109650+0000","last_clean":"2023-11-04T01:43:14.109650+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:43:14.109650+0000","last_undegraded":"2023-11-04T01:43:14.109650+0000","last_fullsized":"2023-11-04T01:43:14.109650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116385+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:43:14.116385+0000","last_peered":"2023-11-04T01:43:14.116385+0000","last_clean":"2023-11-04T01:43:14.116385+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:43:14.116385+0000","last_undegraded":"2023-11-04T01:43:14.116385+0000","last_fullsized":"2023-11-04T01:43:14.116385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114820+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:43:14.114820+0000","last_peered":"2023-11-04T01:43:14.114820+0000","last_clean":"2023-11-04T01:43:14.114820+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:43:14.114820+0000","last_undegraded":"2023-11-04T01:43:14.114820+0000","last_fullsized":"2023-11-04T01:43:14.114820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.112748+0000","last_change":"2023-11-04T01:43:15.112748+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.112748+0000","last_undegraded":"2023-11-04T01:43:15.112748+0000","last_fullsized":"2023-11-04T01:43:15.112748+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138676+0000","last_change":"2023-11-04T01:43:15.133081+0000","last_active":"2023-11-04T01:43:15.138676+0000","last_peered":"2023-11-04T01:43:15.138676+0000","last_clean":"2023-11-04T01:43:15.138676+0000","last_became_active":"2023-11-04T01:43:15.132291+0000","last_became_peered":"2023-11-04T01:43:15.132291+0000","last_unstale":"2023-11-04T01:43:15.138676+0000","last_undegraded":"2023-11-04T01:43:15.138676+0000","last_fullsized":"2023-11-04T01:43:15.138676+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:49.142953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112522+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:43:14.112522+0000","last_peered":"2023-11-04T01:43:14.112522+0000","last_clean":"2023-11-04T01:43:14.112522+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:43:14.112522+0000","last_undegraded":"2023-11-04T01:43:14.112522+0000","last_fullsized":"2023-11-04T01:43:14.112522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115564+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:43:14.115564+0000","last_peered":"2023-11-04T01:43:14.115564+0000","last_clean":"2023-11-04T01:43:14.115564+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:43:14.115564+0000","last_undegraded":"2023-11-04T01:43:14.115564+0000","last_fullsized":"2023-11-04T01:43:14.115564+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111422+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:43:14.111422+0000","last_peered":"2023-11-04T01:43:14.111422+0000","last_clean":"2023-11-04T01:43:14.111422+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:43:14.111422+0000","last_undegraded":"2023-11-04T01:43:14.111422+0000","last_fullsized":"2023-11-04T01:43:14.111422+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.115396+0000","last_change":"2023-11-04T01:43:15.115396+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.115396+0000","last_undegraded":"2023-11-04T01:43:15.115396+0000","last_fullsized":"2023-11-04T01:43:15.115396+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158653+0000","last_change":"2023-11-04T01:43:15.153802+0000","last_active":"2023-11-04T01:43:15.158653+0000","last_peered":"2023-11-04T01:43:15.158653+0000","last_clean":"2023-11-04T01:43:15.158653+0000","last_became_active":"2023-11-04T01:43:15.153029+0000","last_became_peered":"2023-11-04T01:43:15.153029+0000","last_unstale":"2023-11-04T01:43:15.158653+0000","last_undegraded":"2023-11-04T01:43:15.158653+0000","last_fullsized":"2023-11-04T01:43:15.158653+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118424+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:43:14.118424+0000","last_peered":"2023-11-04T01:43:14.118424+0000","last_clean":"2023-11-04T01:43:14.118424+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:43:14.118424+0000","last_undegraded":"2023-11-04T01:43:14.118424+0000","last_fullsized":"2023-11-04T01:43:14.118424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118204+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:43:14.118204+0000","last_peered":"2023-11-04T01:43:14.118204+0000","last_clean":"2023-11-04T01:43:14.118204+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:43:14.118204+0000","last_undegraded":"2023-11-04T01:43:14.118204+0000","last_fullsized":"2023-11-04T01:43:14.118204+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109890+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:43:14.109890+0000","last_peered":"2023-11-04T01:43:14.109890+0000","last_clean":"2023-11-04T01:43:14.109890+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:43:14.109890+0000","last_undegraded":"2023-11-04T01:43:14.109890+0000","last_fullsized":"2023-11-04T01:43:14.109890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109995+0000","last_change":"2023-11-04T01:43:15.109995+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109995+0000","last_undegraded":"2023-11-04T01:43:15.109995+0000","last_fullsized":"2023-11-04T01:43:15.109995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142716+0000","last_change":"2023-11-04T01:43:15.134863+0000","last_active":"2023-11-04T01:43:15.142716+0000","last_peered":"2023-11-04T01:43:15.142716+0000","last_clean":"2023-11-04T01:43:15.142716+0000","last_became_active":"2023-11-04T01:43:15.134171+0000","last_became_peered":"2023-11-04T01:43:15.134171+0000","last_unstale":"2023-11-04T01:43:15.142716+0000","last_undegraded":"2023-11-04T01:43:15.142716+0000","last_fullsized":"2023-11-04T01:43:15.142716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:18.996637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119278+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:43:14.119278+0000","last_peered":"2023-11-04T01:43:14.119278+0000","last_clean":"2023-11-04T01:43:14.119278+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:43:14.119278+0000","last_undegraded":"2023-11-04T01:43:14.119278+0000","last_fullsized":"2023-11-04T01:43:14.119278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100321+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:43:14.100321+0000","last_peered":"2023-11-04T01:43:14.100321+0000","last_clean":"2023-11-04T01:43:14.100321+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:43:14.100321+0000","last_undegraded":"2023-11-04T01:43:14.100321+0000","last_fullsized":"2023-11-04T01:43:14.100321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126384+0000","last_change":"2023-11-04T01:43:15.126384+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126384+0000","last_undegraded":"2023-11-04T01:43:15.126384+0000","last_fullsized":"2023-11-04T01:43:15.126384+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168735+0000","last_change":"2023-11-04T01:43:15.162032+0000","last_active":"2023-11-04T01:43:15.168735+0000","last_peered":"2023-11-04T01:43:15.168735+0000","last_clean":"2023-11-04T01:43:15.168735+0000","last_became_active":"2023-11-04T01:43:15.161515+0000","last_became_peered":"2023-11-04T01:43:15.161515+0000","last_unstale":"2023-11-04T01:43:15.168735+0000","last_undegraded":"2023-11-04T01:43:15.168735+0000","last_fullsized":"2023-11-04T01:43:15.168735+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:41.610070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114393+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:43:14.114393+0000","last_peered":"2023-11-04T01:43:14.114393+0000","last_clean":"2023-11-04T01:43:14.114393+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:43:14.114393+0000","last_undegraded":"2023-11-04T01:43:14.114393+0000","last_fullsized":"2023-11-04T01:43:14.114393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118113+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:43:14.118113+0000","last_peered":"2023-11-04T01:43:14.118113+0000","last_clean":"2023-11-04T01:43:14.118113+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:43:14.118113+0000","last_undegraded":"2023-11-04T01:43:14.118113+0000","last_fullsized":"2023-11-04T01:43:14.118113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108402+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:43:14.108402+0000","last_peered":"2023-11-04T01:43:14.108402+0000","last_clean":"2023-11-04T01:43:14.108402+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:43:14.108402+0000","last_undegraded":"2023-11-04T01:43:14.108402+0000","last_fullsized":"2023-11-04T01:43:14.108402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109597+0000","last_change":"2023-11-04T01:43:15.109597+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109597+0000","last_undegraded":"2023-11-04T01:43:15.109597+0000","last_fullsized":"2023-11-04T01:43:15.109597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.164067+0000","last_change":"2023-11-04T01:43:15.163139+0000","last_active":"2023-11-04T01:43:15.164067+0000","last_peered":"2023-11-04T01:43:15.164067+0000","last_clean":"2023-11-04T01:43:15.164067+0000","last_became_active":"2023-11-04T01:43:15.162805+0000","last_became_peered":"2023-11-04T01:43:15.162805+0000","last_unstale":"2023-11-04T01:43:15.164067+0000","last_undegraded":"2023-11-04T01:43:15.164067+0000","last_fullsized":"2023-11-04T01:43:15.164067+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114608+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:43:14.114608+0000","last_peered":"2023-11-04T01:43:14.114608+0000","last_clean":"2023-11-04T01:43:14.114608+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:43:14.114608+0000","last_undegraded":"2023-11-04T01:43:14.114608+0000","last_fullsized":"2023-11-04T01:43:14.114608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111316+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:43:14.111316+0000","last_peered":"2023-11-04T01:43:14.111316+0000","last_clean":"2023-11-04T01:43:14.111316+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:43:14.111316+0000","last_undegraded":"2023-11-04T01:43:14.111316+0000","last_fullsized":"2023-11-04T01:43:14.111316+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110722+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:43:14.110722+0000","last_peered":"2023-11-04T01:43:14.110722+0000","last_clean":"2023-11-04T01:43:14.110722+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:43:14.110722+0000","last_undegraded":"2023-11-04T01:43:14.110722+0000","last_fullsized":"2023-11-04T01:43:14.110722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116197+0000","last_change":"2023-11-04T01:43:15.116197+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116197+0000","last_undegraded":"2023-11-04T01:43:15.116197+0000","last_fullsized":"2023-11-04T01:43:15.116197+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166093+0000","last_change":"2023-11-04T01:43:15.162310+0000","last_active":"2023-11-04T01:43:15.166093+0000","last_peered":"2023-11-04T01:43:15.166093+0000","last_clean":"2023-11-04T01:43:15.166093+0000","last_became_active":"2023-11-04T01:43:15.161776+0000","last_became_peered":"2023-11-04T01:43:15.161776+0000","last_unstale":"2023-11-04T01:43:15.166093+0000","last_undegraded":"2023-11-04T01:43:15.166093+0000","last_fullsized":"2023-11-04T01:43:15.166093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:34.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111021+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:43:14.111021+0000","last_peered":"2023-11-04T01:43:14.111021+0000","last_clean":"2023-11-04T01:43:14.111021+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:43:14.111021+0000","last_undegraded":"2023-11-04T01:43:14.111021+0000","last_fullsized":"2023-11-04T01:43:14.111021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100192+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:43:14.100192+0000","last_peered":"2023-11-04T01:43:14.100192+0000","last_clean":"2023-11-04T01:43:14.100192+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:43:14.100192+0000","last_undegraded":"2023-11-04T01:43:14.100192+0000","last_fullsized":"2023-11-04T01:43:14.100192+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115598+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:43:14.115598+0000","last_peered":"2023-11-04T01:43:14.115598+0000","last_clean":"2023-11-04T01:43:14.115598+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:43:14.115598+0000","last_undegraded":"2023-11-04T01:43:14.115598+0000","last_fullsized":"2023-11-04T01:43:14.115598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113922+0000","last_change":"2023-11-04T01:43:15.113922+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113922+0000","last_undegraded":"2023-11-04T01:43:15.113922+0000","last_fullsized":"2023-11-04T01:43:15.113922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142152+0000","last_change":"2023-11-04T01:43:15.128193+0000","last_active":"2023-11-04T01:43:15.142152+0000","last_peered":"2023-11-04T01:43:15.142152+0000","last_clean":"2023-11-04T01:43:15.142152+0000","last_became_active":"2023-11-04T01:43:15.127462+0000","last_became_peered":"2023-11-04T01:43:15.127462+0000","last_unstale":"2023-11-04T01:43:15.142152+0000","last_undegraded":"2023-11-04T01:43:15.142152+0000","last_fullsized":"2023-11-04T01:43:15.142152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111119+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:43:14.111119+0000","last_peered":"2023-11-04T01:43:14.111119+0000","last_clean":"2023-11-04T01:43:14.111119+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:43:14.111119+0000","last_undegraded":"2023-11-04T01:43:14.111119+0000","last_fullsized":"2023-11-04T01:43:14.111119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116285+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:43:14.116285+0000","last_peered":"2023-11-04T01:43:14.116285+0000","last_clean":"2023-11-04T01:43:14.116285+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:43:14.116285+0000","last_undegraded":"2023-11-04T01:43:14.116285+0000","last_fullsized":"2023-11-04T01:43:14.116285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108139+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:43:14.108139+0000","last_peered":"2023-11-04T01:43:14.108139+0000","last_clean":"2023-11-04T01:43:14.108139+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:43:14.108139+0000","last_undegraded":"2023-11-04T01:43:14.108139+0000","last_fullsized":"2023-11-04T01:43:14.108139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123886+0000","last_change":"2023-11-04T01:43:15.123886+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123886+0000","last_undegraded":"2023-11-04T01:43:15.123886+0000","last_fullsized":"2023-11-04T01:43:15.123886+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154872+0000","last_change":"2023-11-04T01:43:15.150032+0000","last_active":"2023-11-04T01:43:15.154872+0000","last_peered":"2023-11-04T01:43:15.154872+0000","last_clean":"2023-11-04T01:43:15.154872+0000","last_became_active":"2023-11-04T01:43:15.149310+0000","last_became_peered":"2023-11-04T01:43:15.149310+0000","last_unstale":"2023-11-04T01:43:15.154872+0000","last_undegraded":"2023-11-04T01:43:15.154872+0000","last_fullsized":"2023-11-04T01:43:15.154872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109441+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:43:14.109441+0000","last_peered":"2023-11-04T01:43:14.109441+0000","last_clean":"2023-11-04T01:43:14.109441+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:43:14.109441+0000","last_undegraded":"2023-11-04T01:43:14.109441+0000","last_fullsized":"2023-11-04T01:43:14.109441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116067+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:43:14.116067+0000","last_peered":"2023-11-04T01:43:14.116067+0000","last_clean":"2023-11-04T01:43:14.116067+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:43:14.116067+0000","last_undegraded":"2023-11-04T01:43:14.116067+0000","last_fullsized":"2023-11-04T01:43:14.116067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111682+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:43:14.111682+0000","last_peered":"2023-11-04T01:43:14.111682+0000","last_clean":"2023-11-04T01:43:14.111682+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:43:14.111682+0000","last_undegraded":"2023-11-04T01:43:14.111682+0000","last_fullsized":"2023-11-04T01:43:14.111682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117930+0000","last_change":"2023-11-04T01:43:15.117930+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117930+0000","last_undegraded":"2023-11-04T01:43:15.117930+0000","last_fullsized":"2023-11-04T01:43:15.117930+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.155517+0000","last_change":"2023-11-04T01:43:15.131252+0000","last_active":"2023-11-04T01:43:15.155517+0000","last_peered":"2023-11-04T01:43:15.155517+0000","last_clean":"2023-11-04T01:43:15.155517+0000","last_became_active":"2023-11-04T01:43:15.130633+0000","last_became_peered":"2023-11-04T01:43:15.130633+0000","last_unstale":"2023-11-04T01:43:15.155517+0000","last_undegraded":"2023-11-04T01:43:15.155517+0000","last_fullsized":"2023-11-04T01:43:15.155517+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:11.208100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109235+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:43:14.109235+0000","last_peered":"2023-11-04T01:43:14.109235+0000","last_clean":"2023-11-04T01:43:14.109235+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:43:14.109235+0000","last_undegraded":"2023-11-04T01:43:14.109235+0000","last_fullsized":"2023-11-04T01:43:14.109235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118717+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:43:14.118717+0000","last_peered":"2023-11-04T01:43:14.118717+0000","last_clean":"2023-11-04T01:43:14.118717+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:43:14.118717+0000","last_undegraded":"2023-11-04T01:43:14.118717+0000","last_fullsized":"2023-11-04T01:43:14.118717+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107822+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:43:14.107822+0000","last_peered":"2023-11-04T01:43:14.107822+0000","last_clean":"2023-11-04T01:43:14.107822+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:43:14.107822+0000","last_undegraded":"2023-11-04T01:43:14.107822+0000","last_fullsized":"2023-11-04T01:43:14.107822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113784+0000","last_change":"2023-11-04T01:43:15.113784+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113784+0000","last_undegraded":"2023-11-04T01:43:15.113784+0000","last_fullsized":"2023-11-04T01:43:15.113784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.163000+0000","last_change":"2023-11-04T01:43:15.161411+0000","last_active":"2023-11-04T01:43:15.163000+0000","last_peered":"2023-11-04T01:43:15.163000+0000","last_clean":"2023-11-04T01:43:15.163000+0000","last_became_active":"2023-11-04T01:43:15.160976+0000","last_became_peered":"2023-11-04T01:43:15.160976+0000","last_unstale":"2023-11-04T01:43:15.163000+0000","last_undegraded":"2023-11-04T01:43:15.163000+0000","last_fullsized":"2023-11-04T01:43:15.163000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:37.815400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112546+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:43:14.112546+0000","last_peered":"2023-11-04T01:43:14.112546+0000","last_clean":"2023-11-04T01:43:14.112546+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:43:14.112546+0000","last_undegraded":"2023-11-04T01:43:14.112546+0000","last_fullsized":"2023-11-04T01:43:14.112546+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109027+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:43:14.109027+0000","last_peered":"2023-11-04T01:43:14.109027+0000","last_clean":"2023-11-04T01:43:14.109027+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:43:14.109027+0000","last_undegraded":"2023-11-04T01:43:14.109027+0000","last_fullsized":"2023-11-04T01:43:14.109027+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113105+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:43:14.113105+0000","last_peered":"2023-11-04T01:43:14.113105+0000","last_clean":"2023-11-04T01:43:14.113105+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:43:14.113105+0000","last_undegraded":"2023-11-04T01:43:14.113105+0000","last_fullsized":"2023-11-04T01:43:14.113105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117691+0000","last_change":"2023-11-04T01:43:15.117691+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117691+0000","last_undegraded":"2023-11-04T01:43:15.117691+0000","last_fullsized":"2023-11-04T01:43:15.117691+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154249+0000","last_change":"2023-11-04T01:43:15.149053+0000","last_active":"2023-11-04T01:43:15.154249+0000","last_peered":"2023-11-04T01:43:15.154249+0000","last_clean":"2023-11-04T01:43:15.154249+0000","last_became_active":"2023-11-04T01:43:15.148336+0000","last_became_peered":"2023-11-04T01:43:15.148336+0000","last_unstale":"2023-11-04T01:43:15.154249+0000","last_undegraded":"2023-11-04T01:43:15.154249+0000","last_fullsized":"2023-11-04T01:43:15.154249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:00.891242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112892+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:43:14.112892+0000","last_peered":"2023-11-04T01:43:14.112892+0000","last_clean":"2023-11-04T01:43:14.112892+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:43:14.112892+0000","last_undegraded":"2023-11-04T01:43:14.112892+0000","last_fullsized":"2023-11-04T01:43:14.112892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108367+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:43:14.108367+0000","last_peered":"2023-11-04T01:43:14.108367+0000","last_clean":"2023-11-04T01:43:14.108367+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:43:14.108367+0000","last_undegraded":"2023-11-04T01:43:14.108367+0000","last_fullsized":"2023-11-04T01:43:14.108367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110382+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:43:14.110382+0000","last_peered":"2023-11-04T01:43:14.110382+0000","last_clean":"2023-11-04T01:43:14.110382+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:43:14.110382+0000","last_undegraded":"2023-11-04T01:43:14.110382+0000","last_fullsized":"2023-11-04T01:43:14.110382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109220+0000","last_change":"2023-11-04T01:43:15.109220+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109220+0000","last_undegraded":"2023-11-04T01:43:15.109220+0000","last_fullsized":"2023-11-04T01:43:15.109220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.152844+0000","last_change":"2023-11-04T01:43:15.143691+0000","last_active":"2023-11-04T01:43:15.152844+0000","last_peered":"2023-11-04T01:43:15.152844+0000","last_clean":"2023-11-04T01:43:15.152844+0000","last_became_active":"2023-11-04T01:43:15.142954+0000","last_became_peered":"2023-11-04T01:43:15.142954+0000","last_unstale":"2023-11-04T01:43:15.152844+0000","last_undegraded":"2023-11-04T01:43:15.152844+0000","last_fullsized":"2023-11-04T01:43:15.152844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108953+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:43:14.108953+0000","last_peered":"2023-11-04T01:43:14.108953+0000","last_clean":"2023-11-04T01:43:14.108953+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:43:14.108953+0000","last_undegraded":"2023-11-04T01:43:14.108953+0000","last_fullsized":"2023-11-04T01:43:14.108953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111231+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:43:14.111231+0000","last_peered":"2023-11-04T01:43:14.111231+0000","last_clean":"2023-11-04T01:43:14.111231+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:43:14.111231+0000","last_undegraded":"2023-11-04T01:43:14.111231+0000","last_fullsized":"2023-11-04T01:43:14.111231+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113065+0000","last_change":"2023-11-04T01:43:15.113065+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113065+0000","last_undegraded":"2023-11-04T01:43:15.113065+0000","last_fullsized":"2023-11-04T01:43:15.113065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.156331+0000","last_change":"2023-11-04T01:43:15.152965+0000","last_active":"2023-11-04T01:43:15.156331+0000","last_peered":"2023-11-04T01:43:15.156331+0000","last_clean":"2023-11-04T01:43:15.156331+0000","last_became_active":"2023-11-04T01:43:15.152534+0000","last_became_peered":"2023-11-04T01:43:15.152534+0000","last_unstale":"2023-11-04T01:43:15.156331+0000","last_undegraded":"2023-11-04T01:43:15.156331+0000","last_fullsized":"2023-11-04T01:43:15.156331+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119750+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:43:14.119750+0000","last_peered":"2023-11-04T01:43:14.119750+0000","last_clean":"2023-11-04T01:43:14.119750+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:43:14.119750+0000","last_undegraded":"2023-11-04T01:43:14.119750+0000","last_fullsized":"2023-11-04T01:43:14.119750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099498+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:43:14.099498+0000","last_peered":"2023-11-04T01:43:14.099498+0000","last_clean":"2023-11-04T01:43:14.099498+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:43:14.099498+0000","last_undegraded":"2023-11-04T01:43:14.099498+0000","last_fullsized":"2023-11-04T01:43:14.099498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116611+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:43:14.116611+0000","last_peered":"2023-11-04T01:43:14.116611+0000","last_clean":"2023-11-04T01:43:14.116611+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:43:14.116611+0000","last_undegraded":"2023-11-04T01:43:14.116611+0000","last_fullsized":"2023-11-04T01:43:14.116611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109576+0000","last_change":"2023-11-04T01:43:15.109576+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109576+0000","last_undegraded":"2023-11-04T01:43:15.109576+0000","last_fullsized":"2023-11-04T01:43:15.109576+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158609+0000","last_change":"2023-11-04T01:43:15.153656+0000","last_active":"2023-11-04T01:43:15.158609+0000","last_peered":"2023-11-04T01:43:15.158609+0000","last_clean":"2023-11-04T01:43:15.158609+0000","last_became_active":"2023-11-04T01:43:15.152300+0000","last_became_peered":"2023-11-04T01:43:15.152300+0000","last_unstale":"2023-11-04T01:43:15.158609+0000","last_undegraded":"2023-11-04T01:43:15.158609+0000","last_fullsized":"2023-11-04T01:43:15.158609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110748+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:43:14.110748+0000","last_peered":"2023-11-04T01:43:14.110748+0000","last_clean":"2023-11-04T01:43:14.110748+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:43:14.110748+0000","last_undegraded":"2023-11-04T01:43:14.110748+0000","last_fullsized":"2023-11-04T01:43:14.110748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116019+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:43:14.116019+0000","last_peered":"2023-11-04T01:43:14.116019+0000","last_clean":"2023-11-04T01:43:14.116019+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:43:14.116019+0000","last_undegraded":"2023-11-04T01:43:14.116019+0000","last_fullsized":"2023-11-04T01:43:14.116019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109874+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:43:14.109874+0000","last_peered":"2023-11-04T01:43:14.109874+0000","last_clean":"2023-11-04T01:43:14.109874+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:43:14.109874+0000","last_undegraded":"2023-11-04T01:43:14.109874+0000","last_fullsized":"2023-11-04T01:43:14.109874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.128023+0000","last_change":"2023-11-04T01:43:15.128023+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.128023+0000","last_undegraded":"2023-11-04T01:43:15.128023+0000","last_fullsized":"2023-11-04T01:43:15.128023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.157296+0000","last_change":"2023-11-04T01:43:15.153690+0000","last_active":"2023-11-04T01:43:15.157296+0000","last_peered":"2023-11-04T01:43:15.157296+0000","last_clean":"2023-11-04T01:43:15.157296+0000","last_became_active":"2023-11-04T01:43:15.153389+0000","last_became_peered":"2023-11-04T01:43:15.153389+0000","last_unstale":"2023-11-04T01:43:15.157296+0000","last_undegraded":"2023-11-04T01:43:15.157296+0000","last_fullsized":"2023-11-04T01:43:15.157296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:22.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107451+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:43:14.107451+0000","last_peered":"2023-11-04T01:43:14.107451+0000","last_clean":"2023-11-04T01:43:14.107451+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:43:14.107451+0000","last_undegraded":"2023-11-04T01:43:14.107451+0000","last_fullsized":"2023-11-04T01:43:14.107451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110287+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:43:14.110287+0000","last_peered":"2023-11-04T01:43:14.110287+0000","last_clean":"2023-11-04T01:43:14.110287+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:43:14.110287+0000","last_undegraded":"2023-11-04T01:43:14.110287+0000","last_fullsized":"2023-11-04T01:43:14.110287+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107987+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:43:14.107987+0000","last_peered":"2023-11-04T01:43:14.107987+0000","last_clean":"2023-11-04T01:43:14.107987+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:43:14.107987+0000","last_undegraded":"2023-11-04T01:43:14.107987+0000","last_fullsized":"2023-11-04T01:43:14.107987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118300+0000","last_change":"2023-11-04T01:43:15.118300+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118300+0000","last_undegraded":"2023-11-04T01:43:15.118300+0000","last_fullsized":"2023-11-04T01:43:15.118300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138678+0000","last_change":"2023-11-04T01:43:15.134623+0000","last_active":"2023-11-04T01:43:15.138678+0000","last_peered":"2023-11-04T01:43:15.138678+0000","last_clean":"2023-11-04T01:43:15.138678+0000","last_became_active":"2023-11-04T01:43:15.133876+0000","last_became_peered":"2023-11-04T01:43:15.133876+0000","last_unstale":"2023-11-04T01:43:15.138678+0000","last_undegraded":"2023-11-04T01:43:15.138678+0000","last_fullsized":"2023-11-04T01:43:15.138678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:27.147417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108626+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:43:14.108626+0000","last_peered":"2023-11-04T01:43:14.108626+0000","last_clean":"2023-11-04T01:43:14.108626+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:43:14.108626+0000","last_undegraded":"2023-11-04T01:43:14.108626+0000","last_fullsized":"2023-11-04T01:43:14.108626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099976+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:43:14.099976+0000","last_peered":"2023-11-04T01:43:14.099976+0000","last_clean":"2023-11-04T01:43:14.099976+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:43:14.099976+0000","last_undegraded":"2023-11-04T01:43:14.099976+0000","last_fullsized":"2023-11-04T01:43:14.099976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110859+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:43:14.110859+0000","last_peered":"2023-11-04T01:43:14.110859+0000","last_clean":"2023-11-04T01:43:14.110859+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:43:14.110859+0000","last_undegraded":"2023-11-04T01:43:14.110859+0000","last_fullsized":"2023-11-04T01:43:14.110859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114081+0000","last_change":"2023-11-04T01:43:15.114081+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114081+0000","last_undegraded":"2023-11-04T01:43:15.114081+0000","last_fullsized":"2023-11-04T01:43:15.114081+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.160210+0000","last_change":"2023-11-04T01:43:15.153163+0000","last_active":"2023-11-04T01:43:15.160210+0000","last_peered":"2023-11-04T01:43:15.160210+0000","last_clean":"2023-11-04T01:43:15.160210+0000","last_became_active":"2023-11-04T01:43:15.152277+0000","last_became_peered":"2023-11-04T01:43:15.152277+0000","last_unstale":"2023-11-04T01:43:15.160210+0000","last_undegraded":"2023-11-04T01:43:15.160210+0000","last_fullsized":"2023-11-04T01:43:15.160210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:44.866182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113707+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:43:14.113707+0000","last_peered":"2023-11-04T01:43:14.113707+0000","last_clean":"2023-11-04T01:43:14.113707+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:43:14.113707+0000","last_undegraded":"2023-11-04T01:43:14.113707+0000","last_fullsized":"2023-11-04T01:43:14.113707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118557+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:43:14.118557+0000","last_peered":"2023-11-04T01:43:14.118557+0000","last_clean":"2023-11-04T01:43:14.118557+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:43:14.118557+0000","last_undegraded":"2023-11-04T01:43:14.118557+0000","last_fullsized":"2023-11-04T01:43:14.118557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107665+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:43:14.107665+0000","last_peered":"2023-11-04T01:43:14.107665+0000","last_clean":"2023-11-04T01:43:14.107665+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:43:14.107665+0000","last_undegraded":"2023-11-04T01:43:14.107665+0000","last_fullsized":"2023-11-04T01:43:14.107665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114506+0000","last_change":"2023-11-04T01:43:15.114506+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114506+0000","last_undegraded":"2023-11-04T01:43:15.114506+0000","last_fullsized":"2023-11-04T01:43:15.114506+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154886+0000","last_change":"2023-11-04T01:43:15.152417+0000","last_active":"2023-11-04T01:43:15.154886+0000","last_peered":"2023-11-04T01:43:15.154886+0000","last_clean":"2023-11-04T01:43:15.154886+0000","last_became_active":"2023-11-04T01:43:15.149079+0000","last_became_peered":"2023-11-04T01:43:15.149079+0000","last_unstale":"2023-11-04T01:43:15.154886+0000","last_undegraded":"2023-11-04T01:43:15.154886+0000","last_fullsized":"2023-11-04T01:43:15.154886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:04.346894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109057+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:43:14.109057+0000","last_peered":"2023-11-04T01:43:14.109057+0000","last_clean":"2023-11-04T01:43:14.109057+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:43:14.109057+0000","last_undegraded":"2023-11-04T01:43:14.109057+0000","last_fullsized":"2023-11-04T01:43:14.109057+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108086+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:43:14.108086+0000","last_peered":"2023-11-04T01:43:14.108086+0000","last_clean":"2023-11-04T01:43:14.108086+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:43:14.108086+0000","last_undegraded":"2023-11-04T01:43:14.108086+0000","last_fullsized":"2023-11-04T01:43:14.108086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.131026+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:43:15.131026+0000","last_peered":"2023-11-04T01:43:15.131026+0000","last_clean":"2023-11-04T01:43:15.131026+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:43:15.131026+0000","last_undegraded":"2023-11-04T01:43:15.131026+0000","last_fullsized":"2023-11-04T01:43:15.131026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.142934+0000","last_change":"2023-11-04T01:43:15.142934+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.142934+0000","last_undegraded":"2023-11-04T01:43:15.142934+0000","last_fullsized":"2023-11-04T01:43:15.142934+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.135294+0000","last_change":"2023-11-04T01:43:15.130147+0000","last_active":"2023-11-04T01:43:15.135294+0000","last_peered":"2023-11-04T01:43:15.135294+0000","last_clean":"2023-11-04T01:43:15.135294+0000","last_became_active":"2023-11-04T01:43:15.129434+0000","last_became_peered":"2023-11-04T01:43:15.129434+0000","last_unstale":"2023-11-04T01:43:15.135294+0000","last_undegraded":"2023-11-04T01:43:15.135294+0000","last_fullsized":"2023-11-04T01:43:15.135294+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:32.080511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117861+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:43:14.117861+0000","last_peered":"2023-11-04T01:43:14.117861+0000","last_clean":"2023-11-04T01:43:14.117861+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:43:14.117861+0000","last_undegraded":"2023-11-04T01:43:14.117861+0000","last_fullsized":"2023-11-04T01:43:14.117861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115367+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:43:14.115367+0000","last_peered":"2023-11-04T01:43:14.115367+0000","last_clean":"2023-11-04T01:43:14.115367+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:43:14.115367+0000","last_undegraded":"2023-11-04T01:43:14.115367+0000","last_fullsized":"2023-11-04T01:43:14.115367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108850+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:43:14.108850+0000","last_peered":"2023-11-04T01:43:14.108850+0000","last_clean":"2023-11-04T01:43:14.108850+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:43:14.108850+0000","last_undegraded":"2023-11-04T01:43:14.108850+0000","last_fullsized":"2023-11-04T01:43:14.108850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114286+0000","last_change":"2023-11-04T01:43:15.114286+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114286+0000","last_undegraded":"2023-11-04T01:43:15.114286+0000","last_fullsized":"2023-11-04T01:43:15.114286+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.149051+0000","last_change":"2023-11-04T01:43:15.144364+0000","last_active":"2023-11-04T01:43:15.149051+0000","last_peered":"2023-11-04T01:43:15.149051+0000","last_clean":"2023-11-04T01:43:15.149051+0000","last_became_active":"2023-11-04T01:43:15.138867+0000","last_became_peered":"2023-11-04T01:43:15.138867+0000","last_unstale":"2023-11-04T01:43:15.149051+0000","last_undegraded":"2023-11-04T01:43:15.149051+0000","last_fullsized":"2023-11-04T01:43:15.149051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:12.573389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119429+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:43:14.119429+0000","last_peered":"2023-11-04T01:43:14.119429+0000","last_clean":"2023-11-04T01:43:14.119429+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:43:14.119429+0000","last_undegraded":"2023-11-04T01:43:14.119429+0000","last_fullsized":"2023-11-04T01:43:14.119429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099681+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:43:14.099681+0000","last_peered":"2023-11-04T01:43:14.099681+0000","last_clean":"2023-11-04T01:43:14.099681+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:43:14.099681+0000","last_undegraded":"2023-11-04T01:43:14.099681+0000","last_fullsized":"2023-11-04T01:43:14.099681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115795+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:43:14.115795+0000","last_peered":"2023-11-04T01:43:14.115795+0000","last_clean":"2023-11-04T01:43:14.115795+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:43:14.115795+0000","last_undegraded":"2023-11-04T01:43:14.115795+0000","last_fullsized":"2023-11-04T01:43:14.115795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.144585+0000","last_change":"2023-11-04T01:43:15.144585+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.144585+0000","last_undegraded":"2023-11-04T01:43:15.144585+0000","last_fullsized":"2023-11-04T01:43:15.144585+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168837+0000","last_change":"2023-11-04T01:43:15.162848+0000","last_active":"2023-11-04T01:43:15.168837+0000","last_peered":"2023-11-04T01:43:15.168837+0000","last_clean":"2023-11-04T01:43:15.168837+0000","last_became_active":"2023-11-04T01:43:15.161007+0000","last_became_peered":"2023-11-04T01:43:15.161007+0000","last_unstale":"2023-11-04T01:43:15.168837+0000","last_undegraded":"2023-11-04T01:43:15.168837+0000","last_fullsized":"2023-11-04T01:43:15.168837+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:44.148187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119952+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:43:14.119952+0000","last_peered":"2023-11-04T01:43:14.119952+0000","last_clean":"2023-11-04T01:43:14.119952+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:43:14.119952+0000","last_undegraded":"2023-11-04T01:43:14.119952+0000","last_fullsized":"2023-11-04T01:43:14.119952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111915+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:43:14.111915+0000","last_peered":"2023-11-04T01:43:14.111915+0000","last_clean":"2023-11-04T01:43:14.111915+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:43:14.111915+0000","last_undegraded":"2023-11-04T01:43:14.111915+0000","last_fullsized":"2023-11-04T01:43:14.111915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114455+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:43:14.114455+0000","last_peered":"2023-11-04T01:43:14.114455+0000","last_clean":"2023-11-04T01:43:14.114455+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:43:14.114455+0000","last_undegraded":"2023-11-04T01:43:14.114455+0000","last_fullsized":"2023-11-04T01:43:14.114455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1675264,"data_stored":1094075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":1.139,"15min":0.95999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":29.603000000000002,"5min":29.603000000000002,"15min":29.603000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.59099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.355,"5min":1.454,"15min":1.454},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96599999999999997,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.129}]},{"osd":2,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.96999999999999997,"15min":0.92700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.008},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.63500000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.2450000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89800000000000002,"15min":0.89700000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":2.0760000000000001,"5min":1.1819999999999999,"15min":1.03},"min":{"1min":0.70999999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":25.791,"5min":25.791,"15min":25.791},"last":1.097}]},{"osd":4,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98599999999999999,"15min":1.0009999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.70099999999999996},{"interface":"front","average":{"1min":2.0910000000000002,"5min":1.27,"15min":1.131},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":25.696999999999999,"5min":25.696999999999999,"15min":25.696999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.129,"15min":1.0589999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":11.064,"5min":11.064,"15min":11.064},"last":1.075},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.1630000000000003,"5min":4.1630000000000003,"15min":4.1630000000000003},"last":1.155}]},{"osd":6,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1200000000000001,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2250000000000001,"15min":1.226},"min":{"1min":0.88500000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":511073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.165,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2210000000000001,"5min":1.347,"15min":1.347},"last":1.1240000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.262,"5min":1.395,"15min":1.395},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2270000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.95399999999999996},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2010000000000001,"5min":1.319,"15min":1.319},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1950000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98199999999999998},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.079,"15min":1.103},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3879999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.03,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.694,"15min":1.694},"last":1.04},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1259999999999999,"15min":1.1359999999999999},"min":{"1min":0.76700000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.083}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.1120000000000001,"15min":1.1160000000000001},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3109999999999999,"5min":1.649,"15min":1.649},"last":1.329},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1499999999999999,"15min":1.175},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.409,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79700000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.23,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.504,"5min":0.5,"15min":0.5},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.262},"last":0.51400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.85599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.419,"15min":1.419},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.76100000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2490000000000001,"5min":1.252,"15min":1.252},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.046},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.58599999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4159999999999999,"5min":1.502,"15min":1.502},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2270000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.383,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.107,"15min":1.115},"min":{"1min":0.68799999999999994,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3280000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0189999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":1.016},"min":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3939999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3},"last":0.51700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91700000000000004,"15min":0.94499999999999995},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.101,"5min":1.605,"15min":1.605},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.62}]},{"osd":2,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.234,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.446,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96599999999999997,"15min":0.97299999999999998},"min":{"1min":0.68100000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.488,"15min":1.488},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.296,"5min":1.996,"15min":1.996},"last":1.119}]},{"osd":5,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.077,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4830000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0649999999999999,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2889999999999999,"5min":1.514,"15min":1.514},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1419999999999999},"min":{"1min":0.70599999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.349,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.161,"15min":1.169},"min":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.4339999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2150000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.147,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65600000000000003,"15min":0.68200000000000005},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.171,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.74199999999999999},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.623,"15min":1.623},"last":1.1419999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.70099999999999996},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0069999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95999999999999996,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.395,"5min":1.806,"15min":1.806},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.67300000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.425,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.196}]},{"osd":6,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.54,"15min":1.54},"last":1.093},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.5720000000000001,"5min":1.73,"15min":1.73},"last":1.407}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.361,"5min":1.407,"15min":1.407},"last":1.25},{"interface":"front","average":{"1min":1.044,"5min":1.0860000000000001,"15min":1.1060000000000001},"min":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.419,"5min":1.732,"15min":1.732},"last":1.224}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.64600000000000002},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1040000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.103,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":1.29,"15min":1.29},"last":1.327}]},{"osd":3,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.77700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.125,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.175},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.98099999999999998},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1399999999999999,"5min":1.534,"15min":1.534},"last":1.5269999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.022,"15min":1.0469999999999999},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.21,"5min":1.877,"15min":1.877},"last":1.4490000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.012,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.25,"5min":1.446,"15min":1.446},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.034,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.143,"15min":1.1870000000000001},"min":{"1min":0.73299999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0379999999999998,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.78}]},{"osd":7,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.583},{"interface":"front","average":{"1min":1.071,"5min":1.1060000000000001,"15min":1.1439999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4630000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.8919999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.67300000000000004,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.05,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.629}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.379,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7929999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.0309999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86099999999999999,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.012,"15min":0.96699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":1.1519999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.077,"15min":1.056},"min":{"1min":0.61099999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.077,"15min":1.083},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5449999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1220000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92500000000000004,"15min":0.90600000000000003},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.099},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1220000000000001,"15min":1.0800000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.9199999999999999,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":1.2609999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1040000000000001,"15min":1.1140000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.226},{"interface":"front","average":{"1min":1.034,"5min":0.998,"15min":0.98699999999999999},"min":{"1min":0.68799999999999994,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9850000000000001,"5min":1.994,"15min":1.994},"last":1.198}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1687552,"data_stored":1101441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75800000000000001,"5min":1.135,"15min":1.135},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.624}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.27,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.026},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2470000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.68999999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1399999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.014},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.71699999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2170000000000001,"5min":1.694,"15min":1.694},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.745,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.298,"5min":1.782,"15min":1.782},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5229999999999999,"5min":1.903,"15min":1.903},"last":0.96399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.0800000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5920000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.653,"15min":1.653},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:20.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:20.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 Processor -- start 2023-11-04T01:43:20.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 -- start start 2023-11-04T01:43:20.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 0x7f85240cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f85240cdea0 0x7f85240b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85240ccee0 con 0x7f85240ca400 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852415a5d0 con 0x7f85240cdea0 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85294a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240ca900 con 0x7f852415a1f0 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85237fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f85240ca400 0x7f85240704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:32770/0 (socket says 172.21.15.40:32770) 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85237fe640 1 -- 172.21.15.40:0/175320977 learned_addr learned my addr 172.21.15.40:0/175320977 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8522ffd640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 0x7f85240cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 --2- 172.21.15.40:0/175320977 >> v2:172.21.15.91:3300/0 conn(0x7f85240cdea0 0x7f85240b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784321512 0 0) 0x7f85240ccee0 con 0x7f85240ca400 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510005740 con 0x7f85240ca400 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190681986 0 0) 0x7f8510005740 con 0x7f85240ca400 2023-11-04T01:43:20.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 msgr2=0x7f85240cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 0x7f85240cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 >> v2:172.21.15.91:3300/0 conn(0x7f85240cdea0 msgr2=0x7f85240b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 --2- 172.21.15.40:0/175320977 >> v2:172.21.15.91:3300/0 conn(0x7f85240cdea0 0x7f85240b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240cabe0 con 0x7f85240ca400 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8514001680 con 0x7f85240ca400 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 >> v1:172.21.15.40:6789/0 conn(0x7f85240ca400 legacy=0x7f85240704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8510005b90 0x7f8510005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85100069e0 0x7f8510006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 0x7f85100073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852415a5d0 con 0x7f85100069e0 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240ca900 con 0x7f8510005b90 2023-11-04T01:43:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851000dba0 con 0x7f852415a1f0 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85100069e0 0x7f8510006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85237fe640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 0x7f85100073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f8522ffd640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8510005b90 0x7f8510005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 -- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 msgr2=0x7f85100073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f852415a1f0 0x7f85100073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 -- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8510005b90 msgr2=0x7f8510005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8510005b90 0x7f8510005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.813+0000 7f85227fc640 1 -- 172.21.15.40:0/175320977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510005740 con 0x7f85100069e0 2023-11-04T01:43:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85227fc640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85100069e0 0x7f8510006e60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f850c009fc0 tx=0x7f850c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf00dbf5470bd08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0a5ac0 con 0x7f85100069e0 2023-11-04T01:43:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00f040 con 0x7f85100069e0 2023-11-04T01:43:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f8521ffb640 1 -- 172.21.15.40:0/175320977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0a5e60 con 0x7f85100069e0 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85294a5640 1 -- 172.21.15.40:0/175320977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85100069e0 msgr2=0x7f8510006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85294a5640 1 --2- 172.21.15.40:0/175320977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85100069e0 0x7f8510006e60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f850c009fc0 tx=0x7f850c01cca0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85237fe640 1 -- 172.21.15.40:0/175320977 reap_dead start 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85294a5640 1 -- 172.21.15.40:0/175320977 shutdown_connections 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85294a5640 1 -- 172.21.15.40:0/175320977 >> 172.21.15.40:0/175320977 conn(0x7f85240cebb0 msgr2=0x7f85240cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85294a5640 1 -- 172.21.15.40:0/175320977 shutdown_connections 2023-11-04T01:43:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.817+0000 7f85294a5640 1 -- 172.21.15.40:0/175320977 wait complete. 2023-11-04T01:43:20.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 Processor -- start 2023-11-04T01:43:20.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- start start 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8524146d90 0x7f8524158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 0x7f85241538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8524155bd0 0x7f8524153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524159850 con 0x7f8524147170 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524158fb0 con 0x7f8524146d90 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8524159290 con 0x7f8524155bd0 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 0x7f85241538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 0x7f85241538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44984/0 (socket says 172.21.15.40:44984) 2023-11-04T01:43:20.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 -- 172.21.15.40:0/1578740860 learned_addr learned my addr 172.21.15.40:0/1578740860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85237fe640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8524155bd0 0x7f8524153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f8522ffd640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8524146d90 0x7f8524158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 -- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8524155bd0 msgr2=0x7f8524153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8524155bd0 0x7f8524153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 -- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8524146d90 msgr2=0x7f8524158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8524146d90 0x7f8524158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 -- 172.21.15.40:0/1578740860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524159570 con 0x7f8524147170 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85227fc640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 0x7f85241538e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b0040 tx=0x7f850c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c003ba0 con 0x7f8524147170 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c003d00 con 0x7f8524147170 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85241533c0 con 0x7f8524147170 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0ad850 con 0x7f8524147170 2023-11-04T01:43:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8524154360 con 0x7f8524147170 2023-11-04T01:43:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.821+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524153550 con 0x7f8524147170 2023-11-04T01:43:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.825+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f850c0b4040 con 0x7f8524147170 2023-11-04T01:43:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.825+0000 7f851b7fe640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85040664d0 0x7f8504068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.825+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f850c11ef20 con 0x7f8524147170 2023-11-04T01:43:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.825+0000 7f8522ffd640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85040664d0 0x7f8504068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.825+0000 7f8522ffd640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85040664d0 0x7f8504068990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f851c009950 tx=0x7f851c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.829+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f850c0ec0a0 con 0x7f8524147170 2023-11-04T01:43:20.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:20.981+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85240ccb70 con 0x7f85040664d0 2023-11-04T01:43:21.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.017+0000 7f851b7fe640 1 -- 172.21.15.40:0/1578740860 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525035 (secure 0 0 0) 0x7f851c0095e0 con 0x7f85040664d0 2023-11-04T01:43:21.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85040664d0 msgr2=0x7f8504068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85040664d0 0x7f8504068990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f851c009950 tx=0x7f851c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 msgr2=0x7f85241538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 0x7f85241538e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f850c0b0040 tx=0x7f850c009750 comp rx=0 tx=0).stop 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 shutdown_connections 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f85040664d0 0x7f8504068990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8524155bd0 0x7f8524153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8524147170 0x7f85241538e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 --2- 172.21.15.40:0/1578740860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8524146d90 0x7f8524158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 >> 172.21.15.40:0/1578740860 conn(0x7f85240cebb0 msgr2=0x7f85240b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 shutdown_connections 2023-11-04T01:43:21.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.025+0000 7f85294a5640 1 -- 172.21.15.40:0/1578740860 wait complete. 2023-11-04T01:43:21.050 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-11-04T01:43:19.825567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259080,"kb_used_data":9632,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715640,"statfs":{"total":773094113280,"available":772828815360,"internally_reserved":0,"allocated":9863168,"data_stored":5225124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726884"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117008+0000","last_change":"2023-11-04T01:43:15.117008+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117008+0000","last_undegraded":"2023-11-04T01:43:15.117008+0000","last_fullsized":"2023-11-04T01:43:15.117008+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131236+0000","last_change":"2023-11-04T01:43:15.131236+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131236+0000","last_undegraded":"2023-11-04T01:43:15.131236+0000","last_fullsized":"2023-11-04T01:43:15.131236+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118764+0000","last_change":"2023-11-04T01:43:15.118764+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118764+0000","last_undegraded":"2023-11-04T01:43:15.118764+0000","last_fullsized":"2023-11-04T01:43:15.118764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.130569+0000","last_change":"2023-11-04T01:43:15.130569+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.130569+0000","last_undegraded":"2023-11-04T01:43:15.130569+0000","last_fullsized":"2023-11-04T01:43:15.130569+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.149804+0000","last_change":"2023-11-04T01:43:15.149804+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.149804+0000","last_undegraded":"2023-11-04T01:43:15.149804+0000","last_fullsized":"2023-11-04T01:43:15.149804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125131+0000","last_change":"2023-11-04T01:43:15.125131+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125131+0000","last_undegraded":"2023-11-04T01:43:15.125131+0000","last_fullsized":"2023-11-04T01:43:15.125131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.124944+0000","last_change":"2023-11-04T01:43:15.124944+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.124944+0000","last_undegraded":"2023-11-04T01:43:15.124944+0000","last_fullsized":"2023-11-04T01:43:15.124944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.127761+0000","last_change":"2023-11-04T01:43:15.127761+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.127761+0000","last_undegraded":"2023-11-04T01:43:15.127761+0000","last_fullsized":"2023-11-04T01:43:15.127761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125044+0000","last_change":"2023-11-04T01:43:15.125044+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125044+0000","last_undegraded":"2023-11-04T01:43:15.125044+0000","last_fullsized":"2023-11-04T01:43:15.125044+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.147747+0000","last_change":"2023-11-04T01:43:15.147747+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.147747+0000","last_undegraded":"2023-11-04T01:43:15.147747+0000","last_fullsized":"2023-11-04T01:43:15.147747+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.111907+0000","last_change":"2023-11-04T01:43:15.111907+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.111907+0000","last_undegraded":"2023-11-04T01:43:15.111907+0000","last_fullsized":"2023-11-04T01:43:15.111907+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110469+0000","last_change":"2023-11-04T01:43:15.110469+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110469+0000","last_undegraded":"2023-11-04T01:43:15.110469+0000","last_fullsized":"2023-11-04T01:43:15.110469+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119196+0000","last_change":"2023-11-04T01:43:15.119196+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119196+0000","last_undegraded":"2023-11-04T01:43:15.119196+0000","last_fullsized":"2023-11-04T01:43:15.119196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119331+0000","last_change":"2023-11-04T01:43:15.119331+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119331+0000","last_undegraded":"2023-11-04T01:43:15.119331+0000","last_fullsized":"2023-11-04T01:43:15.119331+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.129288+0000","last_change":"2023-11-04T01:43:15.129288+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.129288+0000","last_undegraded":"2023-11-04T01:43:15.129288+0000","last_fullsized":"2023-11-04T01:43:15.129288+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.132136+0000","last_change":"2023-11-04T01:43:15.132136+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.132136+0000","last_undegraded":"2023-11-04T01:43:15.132136+0000","last_fullsized":"2023-11-04T01:43:15.132136+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116352+0000","last_change":"2023-11-04T01:43:15.116352+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116352+0000","last_undegraded":"2023-11-04T01:43:15.116352+0000","last_fullsized":"2023-11-04T01:43:15.116352+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125071+0000","last_change":"2023-11-04T01:43:15.125071+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125071+0000","last_undegraded":"2023-11-04T01:43:15.125071+0000","last_fullsized":"2023-11-04T01:43:15.125071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118123+0000","last_change":"2023-11-04T01:43:15.118123+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118123+0000","last_undegraded":"2023-11-04T01:43:15.118123+0000","last_fullsized":"2023-11-04T01:43:15.118123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109148+0000","last_change":"2023-11-04T01:43:15.109148+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109148+0000","last_undegraded":"2023-11-04T01:43:15.109148+0000","last_fullsized":"2023-11-04T01:43:15.109148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122192+0000","last_change":"2023-11-04T01:43:15.122192+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122192+0000","last_undegraded":"2023-11-04T01:43:15.122192+0000","last_fullsized":"2023-11-04T01:43:15.122192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.146557+0000","last_change":"2023-11-04T01:43:15.146557+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.146557+0000","last_undegraded":"2023-11-04T01:43:15.146557+0000","last_fullsized":"2023-11-04T01:43:15.146557+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117462+0000","last_change":"2023-11-04T01:43:15.117462+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117462+0000","last_undegraded":"2023-11-04T01:43:15.117462+0000","last_fullsized":"2023-11-04T01:43:15.117462+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148901+0000","last_change":"2023-11-04T01:43:15.148901+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148901+0000","last_undegraded":"2023-11-04T01:43:15.148901+0000","last_fullsized":"2023-11-04T01:43:15.148901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114154+0000","last_change":"2023-11-04T01:43:15.114154+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114154+0000","last_undegraded":"2023-11-04T01:43:15.114154+0000","last_fullsized":"2023-11-04T01:43:15.114154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114738+0000","last_change":"2023-11-04T01:43:15.114738+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114738+0000","last_undegraded":"2023-11-04T01:43:15.114738+0000","last_fullsized":"2023-11-04T01:43:15.114738+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113282+0000","last_change":"2023-11-04T01:43:15.113282+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113282+0000","last_undegraded":"2023-11-04T01:43:15.113282+0000","last_fullsized":"2023-11-04T01:43:15.113282+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.138778+0000","last_change":"2023-11-04T01:43:15.138778+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.138778+0000","last_undegraded":"2023-11-04T01:43:15.138778+0000","last_fullsized":"2023-11-04T01:43:15.138778+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122902+0000","last_change":"2023-11-04T01:43:15.122902+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122902+0000","last_undegraded":"2023-11-04T01:43:15.122902+0000","last_fullsized":"2023-11-04T01:43:15.122902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110550+0000","last_change":"2023-11-04T01:43:15.110550+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110550+0000","last_undegraded":"2023-11-04T01:43:15.110550+0000","last_fullsized":"2023-11-04T01:43:15.110550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123664+0000","last_change":"2023-11-04T01:43:15.123664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123664+0000","last_undegraded":"2023-11-04T01:43:15.123664+0000","last_fullsized":"2023-11-04T01:43:15.123664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126727+0000","last_change":"2023-11-04T01:43:15.126727+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126727+0000","last_undegraded":"2023-11-04T01:43:15.126727+0000","last_fullsized":"2023-11-04T01:43:15.126727+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113823+0000","last_change":"2023-11-04T01:43:15.113823+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113823+0000","last_undegraded":"2023-11-04T01:43:15.113823+0000","last_fullsized":"2023-11-04T01:43:15.113823+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159528+0000","last_change":"2023-11-04T01:43:15.157943+0000","last_active":"2023-11-04T01:43:15.159528+0000","last_peered":"2023-11-04T01:43:15.159528+0000","last_clean":"2023-11-04T01:43:15.159528+0000","last_became_active":"2023-11-04T01:43:15.157543+0000","last_became_peered":"2023-11-04T01:43:15.157543+0000","last_unstale":"2023-11-04T01:43:15.159528+0000","last_undegraded":"2023-11-04T01:43:15.159528+0000","last_fullsized":"2023-11-04T01:43:15.159528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:54.891988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116221+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:43:14.116221+0000","last_peered":"2023-11-04T01:43:14.116221+0000","last_clean":"2023-11-04T01:43:14.116221+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:43:14.116221+0000","last_undegraded":"2023-11-04T01:43:14.116221+0000","last_fullsized":"2023-11-04T01:43:14.116221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108469+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:43:14.108469+0000","last_peered":"2023-11-04T01:43:14.108469+0000","last_clean":"2023-11-04T01:43:14.108469+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:43:14.108469+0000","last_undegraded":"2023-11-04T01:43:14.108469+0000","last_fullsized":"2023-11-04T01:43:14.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114862+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:43:14.114862+0000","last_peered":"2023-11-04T01:43:14.114862+0000","last_clean":"2023-11-04T01:43:14.114862+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:43:14.114862+0000","last_undegraded":"2023-11-04T01:43:14.114862+0000","last_fullsized":"2023-11-04T01:43:14.114862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111391+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:43:14.111391+0000","last_peered":"2023-11-04T01:43:14.111391+0000","last_clean":"2023-11-04T01:43:14.111391+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:43:14.111391+0000","last_undegraded":"2023-11-04T01:43:14.111391+0000","last_fullsized":"2023-11-04T01:43:14.111391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114458+0000","last_change":"2023-11-04T01:43:15.114458+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114458+0000","last_undegraded":"2023-11-04T01:43:15.114458+0000","last_fullsized":"2023-11-04T01:43:15.114458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137760+0000","last_change":"2023-11-04T01:43:15.134346+0000","last_active":"2023-11-04T01:43:15.137760+0000","last_peered":"2023-11-04T01:43:15.137760+0000","last_clean":"2023-11-04T01:43:15.137760+0000","last_became_active":"2023-11-04T01:43:15.133897+0000","last_became_peered":"2023-11-04T01:43:15.133897+0000","last_unstale":"2023-11-04T01:43:15.137760+0000","last_undegraded":"2023-11-04T01:43:15.137760+0000","last_fullsized":"2023-11-04T01:43:15.137760+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:29.175532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107341+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:43:14.107341+0000","last_peered":"2023-11-04T01:43:14.107341+0000","last_clean":"2023-11-04T01:43:14.107341+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:43:14.107341+0000","last_undegraded":"2023-11-04T01:43:14.107341+0000","last_fullsized":"2023-11-04T01:43:14.107341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117178+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:43:14.117178+0000","last_peered":"2023-11-04T01:43:14.117178+0000","last_clean":"2023-11-04T01:43:14.117178+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:43:14.117178+0000","last_undegraded":"2023-11-04T01:43:14.117178+0000","last_fullsized":"2023-11-04T01:43:14.117178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111700+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:43:14.111700+0000","last_peered":"2023-11-04T01:43:14.111700+0000","last_clean":"2023-11-04T01:43:14.111700+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:43:14.111700+0000","last_undegraded":"2023-11-04T01:43:14.111700+0000","last_fullsized":"2023-11-04T01:43:14.111700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114664+0000","last_change":"2023-11-04T01:43:15.114664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114664+0000","last_undegraded":"2023-11-04T01:43:15.114664+0000","last_fullsized":"2023-11-04T01:43:15.114664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159555+0000","last_change":"2023-11-04T01:43:15.158367+0000","last_active":"2023-11-04T01:43:15.159555+0000","last_peered":"2023-11-04T01:43:15.159555+0000","last_clean":"2023-11-04T01:43:15.159555+0000","last_became_active":"2023-11-04T01:43:15.157718+0000","last_became_peered":"2023-11-04T01:43:15.157718+0000","last_unstale":"2023-11-04T01:43:15.159555+0000","last_undegraded":"2023-11-04T01:43:15.159555+0000","last_fullsized":"2023-11-04T01:43:15.159555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:03.434277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099606+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:43:14.099606+0000","last_peered":"2023-11-04T01:43:14.099606+0000","last_clean":"2023-11-04T01:43:14.099606+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:43:14.099606+0000","last_undegraded":"2023-11-04T01:43:14.099606+0000","last_fullsized":"2023-11-04T01:43:14.099606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109161+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:43:14.109161+0000","last_peered":"2023-11-04T01:43:14.109161+0000","last_clean":"2023-11-04T01:43:14.109161+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:43:14.109161+0000","last_undegraded":"2023-11-04T01:43:14.109161+0000","last_fullsized":"2023-11-04T01:43:14.109161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116648+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:43:14.116648+0000","last_peered":"2023-11-04T01:43:14.116648+0000","last_clean":"2023-11-04T01:43:14.116648+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:43:14.116648+0000","last_undegraded":"2023-11-04T01:43:14.116648+0000","last_fullsized":"2023-11-04T01:43:14.116648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116181+0000","last_change":"2023-11-04T01:43:15.116181+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116181+0000","last_undegraded":"2023-11-04T01:43:15.116181+0000","last_fullsized":"2023-11-04T01:43:15.116181+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168810+0000","last_change":"2023-11-04T01:43:15.162827+0000","last_active":"2023-11-04T01:43:15.168810+0000","last_peered":"2023-11-04T01:43:15.168810+0000","last_clean":"2023-11-04T01:43:15.168810+0000","last_became_active":"2023-11-04T01:43:15.162272+0000","last_became_peered":"2023-11-04T01:43:15.162272+0000","last_unstale":"2023-11-04T01:43:15.168810+0000","last_undegraded":"2023-11-04T01:43:15.168810+0000","last_fullsized":"2023-11-04T01:43:15.168810+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.577222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100017+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:43:14.100017+0000","last_peered":"2023-11-04T01:43:14.100017+0000","last_clean":"2023-11-04T01:43:14.100017+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:43:14.100017+0000","last_undegraded":"2023-11-04T01:43:14.100017+0000","last_fullsized":"2023-11-04T01:43:14.100017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100057+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:43:14.100057+0000","last_peered":"2023-11-04T01:43:14.100057+0000","last_clean":"2023-11-04T01:43:14.100057+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:43:14.100057+0000","last_undegraded":"2023-11-04T01:43:14.100057+0000","last_fullsized":"2023-11-04T01:43:14.100057+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.105693+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:43:15.105693+0000","last_peered":"2023-11-04T01:43:15.105693+0000","last_clean":"2023-11-04T01:43:15.105693+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:43:15.105693+0000","last_undegraded":"2023-11-04T01:43:15.105693+0000","last_fullsized":"2023-11-04T01:43:15.105693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116753+0000","last_change":"2023-11-04T01:43:15.116753+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116753+0000","last_undegraded":"2023-11-04T01:43:15.116753+0000","last_fullsized":"2023-11-04T01:43:15.116753+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.151563+0000","last_change":"2023-11-04T01:43:15.146655+0000","last_active":"2023-11-04T01:43:15.151563+0000","last_peered":"2023-11-04T01:43:15.151563+0000","last_clean":"2023-11-04T01:43:15.151563+0000","last_became_active":"2023-11-04T01:43:15.145780+0000","last_became_peered":"2023-11-04T01:43:15.145780+0000","last_unstale":"2023-11-04T01:43:15.151563+0000","last_undegraded":"2023-11-04T01:43:15.151563+0000","last_fullsized":"2023-11-04T01:43:15.151563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:02.611764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107489+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:43:14.107489+0000","last_peered":"2023-11-04T01:43:14.107489+0000","last_clean":"2023-11-04T01:43:14.107489+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:43:14.107489+0000","last_undegraded":"2023-11-04T01:43:14.107489+0000","last_fullsized":"2023-11-04T01:43:14.107489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113762+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:43:14.113762+0000","last_peered":"2023-11-04T01:43:14.113762+0000","last_clean":"2023-11-04T01:43:14.113762+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:43:14.113762+0000","last_undegraded":"2023-11-04T01:43:14.113762+0000","last_fullsized":"2023-11-04T01:43:14.113762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111706+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:43:14.111706+0000","last_peered":"2023-11-04T01:43:14.111706+0000","last_clean":"2023-11-04T01:43:14.111706+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:43:14.111706+0000","last_undegraded":"2023-11-04T01:43:14.111706+0000","last_fullsized":"2023-11-04T01:43:14.111706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125629+0000","last_change":"2023-11-04T01:43:15.125629+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125629+0000","last_undegraded":"2023-11-04T01:43:15.125629+0000","last_fullsized":"2023-11-04T01:43:15.125629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.165914+0000","last_change":"2023-11-04T01:43:15.148592+0000","last_active":"2023-11-04T01:43:15.165914+0000","last_peered":"2023-11-04T01:43:15.165914+0000","last_clean":"2023-11-04T01:43:15.165914+0000","last_became_active":"2023-11-04T01:43:15.147892+0000","last_became_peered":"2023-11-04T01:43:15.147892+0000","last_unstale":"2023-11-04T01:43:15.165914+0000","last_undegraded":"2023-11-04T01:43:15.165914+0000","last_fullsized":"2023-11-04T01:43:15.165914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:55.779518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112657+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:43:14.112657+0000","last_peered":"2023-11-04T01:43:14.112657+0000","last_clean":"2023-11-04T01:43:14.112657+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:43:14.112657+0000","last_undegraded":"2023-11-04T01:43:14.112657+0000","last_fullsized":"2023-11-04T01:43:14.112657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108116+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:43:14.108116+0000","last_peered":"2023-11-04T01:43:14.108116+0000","last_clean":"2023-11-04T01:43:14.108116+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:43:14.108116+0000","last_undegraded":"2023-11-04T01:43:14.108116+0000","last_fullsized":"2023-11-04T01:43:14.108116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108640+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:43:14.108640+0000","last_peered":"2023-11-04T01:43:14.108640+0000","last_clean":"2023-11-04T01:43:14.108640+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:43:14.108640+0000","last_undegraded":"2023-11-04T01:43:14.108640+0000","last_fullsized":"2023-11-04T01:43:14.108640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123961+0000","last_change":"2023-11-04T01:43:15.123961+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123961+0000","last_undegraded":"2023-11-04T01:43:15.123961+0000","last_fullsized":"2023-11-04T01:43:15.123961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.150022+0000","last_change":"2023-11-04T01:43:15.146312+0000","last_active":"2023-11-04T01:43:15.150022+0000","last_peered":"2023-11-04T01:43:15.150022+0000","last_clean":"2023-11-04T01:43:15.150022+0000","last_became_active":"2023-11-04T01:43:15.145470+0000","last_became_peered":"2023-11-04T01:43:15.145470+0000","last_unstale":"2023-11-04T01:43:15.150022+0000","last_undegraded":"2023-11-04T01:43:15.150022+0000","last_fullsized":"2023-11-04T01:43:15.150022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:06.918241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112960+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:43:14.112960+0000","last_peered":"2023-11-04T01:43:14.112960+0000","last_clean":"2023-11-04T01:43:14.112960+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:43:14.112960+0000","last_undegraded":"2023-11-04T01:43:14.112960+0000","last_fullsized":"2023-11-04T01:43:14.112960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107704+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:43:14.107704+0000","last_peered":"2023-11-04T01:43:14.107704+0000","last_clean":"2023-11-04T01:43:14.107704+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:43:14.107704+0000","last_undegraded":"2023-11-04T01:43:14.107704+0000","last_fullsized":"2023-11-04T01:43:14.107704+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113790+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:43:14.113790+0000","last_peered":"2023-11-04T01:43:14.113790+0000","last_clean":"2023-11-04T01:43:14.113790+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:43:14.113790+0000","last_undegraded":"2023-11-04T01:43:14.113790+0000","last_fullsized":"2023-11-04T01:43:14.113790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148519+0000","last_change":"2023-11-04T01:43:15.148519+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148519+0000","last_undegraded":"2023-11-04T01:43:15.148519+0000","last_fullsized":"2023-11-04T01:43:15.148519+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168590+0000","last_change":"2023-11-04T01:43:15.164771+0000","last_active":"2023-11-04T01:43:15.168590+0000","last_peered":"2023-11-04T01:43:15.168590+0000","last_clean":"2023-11-04T01:43:15.168590+0000","last_became_active":"2023-11-04T01:43:15.164172+0000","last_became_peered":"2023-11-04T01:43:15.164172+0000","last_unstale":"2023-11-04T01:43:15.168590+0000","last_undegraded":"2023-11-04T01:43:15.168590+0000","last_fullsized":"2023-11-04T01:43:15.168590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:50.337311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.120061+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:43:14.120061+0000","last_peered":"2023-11-04T01:43:14.120061+0000","last_clean":"2023-11-04T01:43:14.120061+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:43:14.120061+0000","last_undegraded":"2023-11-04T01:43:14.120061+0000","last_fullsized":"2023-11-04T01:43:14.120061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107402+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:43:14.107402+0000","last_peered":"2023-11-04T01:43:14.107402+0000","last_clean":"2023-11-04T01:43:14.107402+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:43:14.107402+0000","last_undegraded":"2023-11-04T01:43:14.107402+0000","last_fullsized":"2023-11-04T01:43:14.107402+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116779+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:43:14.116779+0000","last_peered":"2023-11-04T01:43:14.116779+0000","last_clean":"2023-11-04T01:43:14.116779+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:43:14.116779+0000","last_undegraded":"2023-11-04T01:43:14.116779+0000","last_fullsized":"2023-11-04T01:43:14.116779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119517+0000","last_change":"2023-11-04T01:43:15.119517+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119517+0000","last_undegraded":"2023-11-04T01:43:15.119517+0000","last_fullsized":"2023-11-04T01:43:15.119517+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166008+0000","last_change":"2023-11-04T01:43:15.162799+0000","last_active":"2023-11-04T01:43:15.166008+0000","last_peered":"2023-11-04T01:43:15.166008+0000","last_clean":"2023-11-04T01:43:15.166008+0000","last_became_active":"2023-11-04T01:43:15.162068+0000","last_became_peered":"2023-11-04T01:43:15.162068+0000","last_unstale":"2023-11-04T01:43:15.166008+0000","last_undegraded":"2023-11-04T01:43:15.166008+0000","last_fullsized":"2023-11-04T01:43:15.166008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108667+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:43:14.108667+0000","last_peered":"2023-11-04T01:43:14.108667+0000","last_clean":"2023-11-04T01:43:14.108667+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:43:14.108667+0000","last_undegraded":"2023-11-04T01:43:14.108667+0000","last_fullsized":"2023-11-04T01:43:14.108667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111179+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:43:14.111179+0000","last_peered":"2023-11-04T01:43:14.111179+0000","last_clean":"2023-11-04T01:43:14.111179+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:43:14.111179+0000","last_undegraded":"2023-11-04T01:43:14.111179+0000","last_fullsized":"2023-11-04T01:43:14.111179+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108691+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:43:14.108691+0000","last_peered":"2023-11-04T01:43:14.108691+0000","last_clean":"2023-11-04T01:43:14.108691+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:43:14.108691+0000","last_undegraded":"2023-11-04T01:43:14.108691+0000","last_fullsized":"2023-11-04T01:43:14.108691+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.121012+0000","last_change":"2023-11-04T01:43:15.121012+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.121012+0000","last_undegraded":"2023-11-04T01:43:15.121012+0000","last_fullsized":"2023-11-04T01:43:15.121012+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137807+0000","last_change":"2023-11-04T01:43:15.132590+0000","last_active":"2023-11-04T01:43:15.137807+0000","last_peered":"2023-11-04T01:43:15.137807+0000","last_clean":"2023-11-04T01:43:15.137807+0000","last_became_active":"2023-11-04T01:43:15.132101+0000","last_became_peered":"2023-11-04T01:43:15.132101+0000","last_unstale":"2023-11-04T01:43:15.137807+0000","last_undegraded":"2023-11-04T01:43:15.137807+0000","last_fullsized":"2023-11-04T01:43:15.137807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:14.252075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117896+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:43:14.117896+0000","last_peered":"2023-11-04T01:43:14.117896+0000","last_clean":"2023-11-04T01:43:14.117896+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:43:14.117896+0000","last_undegraded":"2023-11-04T01:43:14.117896+0000","last_fullsized":"2023-11-04T01:43:14.117896+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113028+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:43:14.113028+0000","last_peered":"2023-11-04T01:43:14.113028+0000","last_clean":"2023-11-04T01:43:14.113028+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:43:14.113028+0000","last_undegraded":"2023-11-04T01:43:14.113028+0000","last_fullsized":"2023-11-04T01:43:14.113028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108235+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:43:14.108235+0000","last_peered":"2023-11-04T01:43:14.108235+0000","last_clean":"2023-11-04T01:43:14.108235+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:43:14.108235+0000","last_undegraded":"2023-11-04T01:43:14.108235+0000","last_fullsized":"2023-11-04T01:43:14.108235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131096+0000","last_change":"2023-11-04T01:43:15.131096+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131096+0000","last_undegraded":"2023-11-04T01:43:15.131096+0000","last_fullsized":"2023-11-04T01:43:15.131096+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168718+0000","last_change":"2023-11-04T01:43:15.161698+0000","last_active":"2023-11-04T01:43:15.168718+0000","last_peered":"2023-11-04T01:43:15.168718+0000","last_clean":"2023-11-04T01:43:15.168718+0000","last_became_active":"2023-11-04T01:43:15.161055+0000","last_became_peered":"2023-11-04T01:43:15.161055+0000","last_unstale":"2023-11-04T01:43:15.168718+0000","last_undegraded":"2023-11-04T01:43:15.168718+0000","last_fullsized":"2023-11-04T01:43:15.168718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:30.109736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109650+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:43:14.109650+0000","last_peered":"2023-11-04T01:43:14.109650+0000","last_clean":"2023-11-04T01:43:14.109650+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:43:14.109650+0000","last_undegraded":"2023-11-04T01:43:14.109650+0000","last_fullsized":"2023-11-04T01:43:14.109650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116385+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:43:14.116385+0000","last_peered":"2023-11-04T01:43:14.116385+0000","last_clean":"2023-11-04T01:43:14.116385+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:43:14.116385+0000","last_undegraded":"2023-11-04T01:43:14.116385+0000","last_fullsized":"2023-11-04T01:43:14.116385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114820+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:43:14.114820+0000","last_peered":"2023-11-04T01:43:14.114820+0000","last_clean":"2023-11-04T01:43:14.114820+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:43:14.114820+0000","last_undegraded":"2023-11-04T01:43:14.114820+0000","last_fullsized":"2023-11-04T01:43:14.114820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.112748+0000","last_change":"2023-11-04T01:43:15.112748+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.112748+0000","last_undegraded":"2023-11-04T01:43:15.112748+0000","last_fullsized":"2023-11-04T01:43:15.112748+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138676+0000","last_change":"2023-11-04T01:43:15.133081+0000","last_active":"2023-11-04T01:43:15.138676+0000","last_peered":"2023-11-04T01:43:15.138676+0000","last_clean":"2023-11-04T01:43:15.138676+0000","last_became_active":"2023-11-04T01:43:15.132291+0000","last_became_peered":"2023-11-04T01:43:15.132291+0000","last_unstale":"2023-11-04T01:43:15.138676+0000","last_undegraded":"2023-11-04T01:43:15.138676+0000","last_fullsized":"2023-11-04T01:43:15.138676+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:49.142953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112522+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:43:14.112522+0000","last_peered":"2023-11-04T01:43:14.112522+0000","last_clean":"2023-11-04T01:43:14.112522+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:43:14.112522+0000","last_undegraded":"2023-11-04T01:43:14.112522+0000","last_fullsized":"2023-11-04T01:43:14.112522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115564+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:43:14.115564+0000","last_peered":"2023-11-04T01:43:14.115564+0000","last_clean":"2023-11-04T01:43:14.115564+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:43:14.115564+0000","last_undegraded":"2023-11-04T01:43:14.115564+0000","last_fullsized":"2023-11-04T01:43:14.115564+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111422+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:43:14.111422+0000","last_peered":"2023-11-04T01:43:14.111422+0000","last_clean":"2023-11-04T01:43:14.111422+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:43:14.111422+0000","last_undegraded":"2023-11-04T01:43:14.111422+0000","last_fullsized":"2023-11-04T01:43:14.111422+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.115396+0000","last_change":"2023-11-04T01:43:15.115396+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.115396+0000","last_undegraded":"2023-11-04T01:43:15.115396+0000","last_fullsized":"2023-11-04T01:43:15.115396+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158653+0000","last_change":"2023-11-04T01:43:15.153802+0000","last_active":"2023-11-04T01:43:15.158653+0000","last_peered":"2023-11-04T01:43:15.158653+0000","last_clean":"2023-11-04T01:43:15.158653+0000","last_became_active":"2023-11-04T01:43:15.153029+0000","last_became_peered":"2023-11-04T01:43:15.153029+0000","last_unstale":"2023-11-04T01:43:15.158653+0000","last_undegraded":"2023-11-04T01:43:15.158653+0000","last_fullsized":"2023-11-04T01:43:15.158653+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118424+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:43:14.118424+0000","last_peered":"2023-11-04T01:43:14.118424+0000","last_clean":"2023-11-04T01:43:14.118424+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:43:14.118424+0000","last_undegraded":"2023-11-04T01:43:14.118424+0000","last_fullsized":"2023-11-04T01:43:14.118424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118204+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:43:14.118204+0000","last_peered":"2023-11-04T01:43:14.118204+0000","last_clean":"2023-11-04T01:43:14.118204+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:43:14.118204+0000","last_undegraded":"2023-11-04T01:43:14.118204+0000","last_fullsized":"2023-11-04T01:43:14.118204+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109890+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:43:14.109890+0000","last_peered":"2023-11-04T01:43:14.109890+0000","last_clean":"2023-11-04T01:43:14.109890+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:43:14.109890+0000","last_undegraded":"2023-11-04T01:43:14.109890+0000","last_fullsized":"2023-11-04T01:43:14.109890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109995+0000","last_change":"2023-11-04T01:43:15.109995+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109995+0000","last_undegraded":"2023-11-04T01:43:15.109995+0000","last_fullsized":"2023-11-04T01:43:15.109995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142716+0000","last_change":"2023-11-04T01:43:15.134863+0000","last_active":"2023-11-04T01:43:15.142716+0000","last_peered":"2023-11-04T01:43:15.142716+0000","last_clean":"2023-11-04T01:43:15.142716+0000","last_became_active":"2023-11-04T01:43:15.134171+0000","last_became_peered":"2023-11-04T01:43:15.134171+0000","last_unstale":"2023-11-04T01:43:15.142716+0000","last_undegraded":"2023-11-04T01:43:15.142716+0000","last_fullsized":"2023-11-04T01:43:15.142716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:18.996637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119278+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:43:14.119278+0000","last_peered":"2023-11-04T01:43:14.119278+0000","last_clean":"2023-11-04T01:43:14.119278+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:43:14.119278+0000","last_undegraded":"2023-11-04T01:43:14.119278+0000","last_fullsized":"2023-11-04T01:43:14.119278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100321+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:43:14.100321+0000","last_peered":"2023-11-04T01:43:14.100321+0000","last_clean":"2023-11-04T01:43:14.100321+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:43:14.100321+0000","last_undegraded":"2023-11-04T01:43:14.100321+0000","last_fullsized":"2023-11-04T01:43:14.100321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126384+0000","last_change":"2023-11-04T01:43:15.126384+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126384+0000","last_undegraded":"2023-11-04T01:43:15.126384+0000","last_fullsized":"2023-11-04T01:43:15.126384+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168735+0000","last_change":"2023-11-04T01:43:15.162032+0000","last_active":"2023-11-04T01:43:15.168735+0000","last_peered":"2023-11-04T01:43:15.168735+0000","last_clean":"2023-11-04T01:43:15.168735+0000","last_became_active":"2023-11-04T01:43:15.161515+0000","last_became_peered":"2023-11-04T01:43:15.161515+0000","last_unstale":"2023-11-04T01:43:15.168735+0000","last_undegraded":"2023-11-04T01:43:15.168735+0000","last_fullsized":"2023-11-04T01:43:15.168735+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:41.610070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114393+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:43:14.114393+0000","last_peered":"2023-11-04T01:43:14.114393+0000","last_clean":"2023-11-04T01:43:14.114393+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:43:14.114393+0000","last_undegraded":"2023-11-04T01:43:14.114393+0000","last_fullsized":"2023-11-04T01:43:14.114393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118113+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:43:14.118113+0000","last_peered":"2023-11-04T01:43:14.118113+0000","last_clean":"2023-11-04T01:43:14.118113+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:43:14.118113+0000","last_undegraded":"2023-11-04T01:43:14.118113+0000","last_fullsized":"2023-11-04T01:43:14.118113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108402+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:43:14.108402+0000","last_peered":"2023-11-04T01:43:14.108402+0000","last_clean":"2023-11-04T01:43:14.108402+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:43:14.108402+0000","last_undegraded":"2023-11-04T01:43:14.108402+0000","last_fullsized":"2023-11-04T01:43:14.108402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109597+0000","last_change":"2023-11-04T01:43:15.109597+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109597+0000","last_undegraded":"2023-11-04T01:43:15.109597+0000","last_fullsized":"2023-11-04T01:43:15.109597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.164067+0000","last_change":"2023-11-04T01:43:15.163139+0000","last_active":"2023-11-04T01:43:15.164067+0000","last_peered":"2023-11-04T01:43:15.164067+0000","last_clean":"2023-11-04T01:43:15.164067+0000","last_became_active":"2023-11-04T01:43:15.162805+0000","last_became_peered":"2023-11-04T01:43:15.162805+0000","last_unstale":"2023-11-04T01:43:15.164067+0000","last_undegraded":"2023-11-04T01:43:15.164067+0000","last_fullsized":"2023-11-04T01:43:15.164067+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114608+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:43:14.114608+0000","last_peered":"2023-11-04T01:43:14.114608+0000","last_clean":"2023-11-04T01:43:14.114608+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:43:14.114608+0000","last_undegraded":"2023-11-04T01:43:14.114608+0000","last_fullsized":"2023-11-04T01:43:14.114608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111316+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:43:14.111316+0000","last_peered":"2023-11-04T01:43:14.111316+0000","last_clean":"2023-11-04T01:43:14.111316+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:43:14.111316+0000","last_undegraded":"2023-11-04T01:43:14.111316+0000","last_fullsized":"2023-11-04T01:43:14.111316+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110722+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:43:14.110722+0000","last_peered":"2023-11-04T01:43:14.110722+0000","last_clean":"2023-11-04T01:43:14.110722+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:43:14.110722+0000","last_undegraded":"2023-11-04T01:43:14.110722+0000","last_fullsized":"2023-11-04T01:43:14.110722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116197+0000","last_change":"2023-11-04T01:43:15.116197+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116197+0000","last_undegraded":"2023-11-04T01:43:15.116197+0000","last_fullsized":"2023-11-04T01:43:15.116197+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166093+0000","last_change":"2023-11-04T01:43:15.162310+0000","last_active":"2023-11-04T01:43:15.166093+0000","last_peered":"2023-11-04T01:43:15.166093+0000","last_clean":"2023-11-04T01:43:15.166093+0000","last_became_active":"2023-11-04T01:43:15.161776+0000","last_became_peered":"2023-11-04T01:43:15.161776+0000","last_unstale":"2023-11-04T01:43:15.166093+0000","last_undegraded":"2023-11-04T01:43:15.166093+0000","last_fullsized":"2023-11-04T01:43:15.166093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:34.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111021+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:43:14.111021+0000","last_peered":"2023-11-04T01:43:14.111021+0000","last_clean":"2023-11-04T01:43:14.111021+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:43:14.111021+0000","last_undegraded":"2023-11-04T01:43:14.111021+0000","last_fullsized":"2023-11-04T01:43:14.111021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100192+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:43:14.100192+0000","last_peered":"2023-11-04T01:43:14.100192+0000","last_clean":"2023-11-04T01:43:14.100192+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:43:14.100192+0000","last_undegraded":"2023-11-04T01:43:14.100192+0000","last_fullsized":"2023-11-04T01:43:14.100192+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115598+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:43:14.115598+0000","last_peered":"2023-11-04T01:43:14.115598+0000","last_clean":"2023-11-04T01:43:14.115598+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:43:14.115598+0000","last_undegraded":"2023-11-04T01:43:14.115598+0000","last_fullsized":"2023-11-04T01:43:14.115598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113922+0000","last_change":"2023-11-04T01:43:15.113922+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113922+0000","last_undegraded":"2023-11-04T01:43:15.113922+0000","last_fullsized":"2023-11-04T01:43:15.113922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142152+0000","last_change":"2023-11-04T01:43:15.128193+0000","last_active":"2023-11-04T01:43:15.142152+0000","last_peered":"2023-11-04T01:43:15.142152+0000","last_clean":"2023-11-04T01:43:15.142152+0000","last_became_active":"2023-11-04T01:43:15.127462+0000","last_became_peered":"2023-11-04T01:43:15.127462+0000","last_unstale":"2023-11-04T01:43:15.142152+0000","last_undegraded":"2023-11-04T01:43:15.142152+0000","last_fullsized":"2023-11-04T01:43:15.142152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111119+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:43:14.111119+0000","last_peered":"2023-11-04T01:43:14.111119+0000","last_clean":"2023-11-04T01:43:14.111119+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:43:14.111119+0000","last_undegraded":"2023-11-04T01:43:14.111119+0000","last_fullsized":"2023-11-04T01:43:14.111119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116285+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:43:14.116285+0000","last_peered":"2023-11-04T01:43:14.116285+0000","last_clean":"2023-11-04T01:43:14.116285+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:43:14.116285+0000","last_undegraded":"2023-11-04T01:43:14.116285+0000","last_fullsized":"2023-11-04T01:43:14.116285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108139+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:43:14.108139+0000","last_peered":"2023-11-04T01:43:14.108139+0000","last_clean":"2023-11-04T01:43:14.108139+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:43:14.108139+0000","last_undegraded":"2023-11-04T01:43:14.108139+0000","last_fullsized":"2023-11-04T01:43:14.108139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123886+0000","last_change":"2023-11-04T01:43:15.123886+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123886+0000","last_undegraded":"2023-11-04T01:43:15.123886+0000","last_fullsized":"2023-11-04T01:43:15.123886+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154872+0000","last_change":"2023-11-04T01:43:15.150032+0000","last_active":"2023-11-04T01:43:15.154872+0000","last_peered":"2023-11-04T01:43:15.154872+0000","last_clean":"2023-11-04T01:43:15.154872+0000","last_became_active":"2023-11-04T01:43:15.149310+0000","last_became_peered":"2023-11-04T01:43:15.149310+0000","last_unstale":"2023-11-04T01:43:15.154872+0000","last_undegraded":"2023-11-04T01:43:15.154872+0000","last_fullsized":"2023-11-04T01:43:15.154872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109441+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:43:14.109441+0000","last_peered":"2023-11-04T01:43:14.109441+0000","last_clean":"2023-11-04T01:43:14.109441+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:43:14.109441+0000","last_undegraded":"2023-11-04T01:43:14.109441+0000","last_fullsized":"2023-11-04T01:43:14.109441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116067+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:43:14.116067+0000","last_peered":"2023-11-04T01:43:14.116067+0000","last_clean":"2023-11-04T01:43:14.116067+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:43:14.116067+0000","last_undegraded":"2023-11-04T01:43:14.116067+0000","last_fullsized":"2023-11-04T01:43:14.116067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111682+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:43:14.111682+0000","last_peered":"2023-11-04T01:43:14.111682+0000","last_clean":"2023-11-04T01:43:14.111682+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:43:14.111682+0000","last_undegraded":"2023-11-04T01:43:14.111682+0000","last_fullsized":"2023-11-04T01:43:14.111682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117930+0000","last_change":"2023-11-04T01:43:15.117930+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117930+0000","last_undegraded":"2023-11-04T01:43:15.117930+0000","last_fullsized":"2023-11-04T01:43:15.117930+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.155517+0000","last_change":"2023-11-04T01:43:15.131252+0000","last_active":"2023-11-04T01:43:15.155517+0000","last_peered":"2023-11-04T01:43:15.155517+0000","last_clean":"2023-11-04T01:43:15.155517+0000","last_became_active":"2023-11-04T01:43:15.130633+0000","last_became_peered":"2023-11-04T01:43:15.130633+0000","last_unstale":"2023-11-04T01:43:15.155517+0000","last_undegraded":"2023-11-04T01:43:15.155517+0000","last_fullsized":"2023-11-04T01:43:15.155517+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:11.208100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109235+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:43:14.109235+0000","last_peered":"2023-11-04T01:43:14.109235+0000","last_clean":"2023-11-04T01:43:14.109235+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:43:14.109235+0000","last_undegraded":"2023-11-04T01:43:14.109235+0000","last_fullsized":"2023-11-04T01:43:14.109235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118717+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:43:14.118717+0000","last_peered":"2023-11-04T01:43:14.118717+0000","last_clean":"2023-11-04T01:43:14.118717+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:43:14.118717+0000","last_undegraded":"2023-11-04T01:43:14.118717+0000","last_fullsized":"2023-11-04T01:43:14.118717+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107822+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:43:14.107822+0000","last_peered":"2023-11-04T01:43:14.107822+0000","last_clean":"2023-11-04T01:43:14.107822+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:43:14.107822+0000","last_undegraded":"2023-11-04T01:43:14.107822+0000","last_fullsized":"2023-11-04T01:43:14.107822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113784+0000","last_change":"2023-11-04T01:43:15.113784+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113784+0000","last_undegraded":"2023-11-04T01:43:15.113784+0000","last_fullsized":"2023-11-04T01:43:15.113784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.163000+0000","last_change":"2023-11-04T01:43:15.161411+0000","last_active":"2023-11-04T01:43:15.163000+0000","last_peered":"2023-11-04T01:43:15.163000+0000","last_clean":"2023-11-04T01:43:15.163000+0000","last_became_active":"2023-11-04T01:43:15.160976+0000","last_became_peered":"2023-11-04T01:43:15.160976+0000","last_unstale":"2023-11-04T01:43:15.163000+0000","last_undegraded":"2023-11-04T01:43:15.163000+0000","last_fullsized":"2023-11-04T01:43:15.163000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:37.815400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112546+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:43:14.112546+0000","last_peered":"2023-11-04T01:43:14.112546+0000","last_clean":"2023-11-04T01:43:14.112546+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:43:14.112546+0000","last_undegraded":"2023-11-04T01:43:14.112546+0000","last_fullsized":"2023-11-04T01:43:14.112546+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109027+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:43:14.109027+0000","last_peered":"2023-11-04T01:43:14.109027+0000","last_clean":"2023-11-04T01:43:14.109027+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:43:14.109027+0000","last_undegraded":"2023-11-04T01:43:14.109027+0000","last_fullsized":"2023-11-04T01:43:14.109027+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113105+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:43:14.113105+0000","last_peered":"2023-11-04T01:43:14.113105+0000","last_clean":"2023-11-04T01:43:14.113105+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:43:14.113105+0000","last_undegraded":"2023-11-04T01:43:14.113105+0000","last_fullsized":"2023-11-04T01:43:14.113105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117691+0000","last_change":"2023-11-04T01:43:15.117691+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117691+0000","last_undegraded":"2023-11-04T01:43:15.117691+0000","last_fullsized":"2023-11-04T01:43:15.117691+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154249+0000","last_change":"2023-11-04T01:43:15.149053+0000","last_active":"2023-11-04T01:43:15.154249+0000","last_peered":"2023-11-04T01:43:15.154249+0000","last_clean":"2023-11-04T01:43:15.154249+0000","last_became_active":"2023-11-04T01:43:15.148336+0000","last_became_peered":"2023-11-04T01:43:15.148336+0000","last_unstale":"2023-11-04T01:43:15.154249+0000","last_undegraded":"2023-11-04T01:43:15.154249+0000","last_fullsized":"2023-11-04T01:43:15.154249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:00.891242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112892+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:43:14.112892+0000","last_peered":"2023-11-04T01:43:14.112892+0000","last_clean":"2023-11-04T01:43:14.112892+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:43:14.112892+0000","last_undegraded":"2023-11-04T01:43:14.112892+0000","last_fullsized":"2023-11-04T01:43:14.112892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108367+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:43:14.108367+0000","last_peered":"2023-11-04T01:43:14.108367+0000","last_clean":"2023-11-04T01:43:14.108367+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:43:14.108367+0000","last_undegraded":"2023-11-04T01:43:14.108367+0000","last_fullsized":"2023-11-04T01:43:14.108367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110382+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:43:14.110382+0000","last_peered":"2023-11-04T01:43:14.110382+0000","last_clean":"2023-11-04T01:43:14.110382+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:43:14.110382+0000","last_undegraded":"2023-11-04T01:43:14.110382+0000","last_fullsized":"2023-11-04T01:43:14.110382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109220+0000","last_change":"2023-11-04T01:43:15.109220+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109220+0000","last_undegraded":"2023-11-04T01:43:15.109220+0000","last_fullsized":"2023-11-04T01:43:15.109220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.152844+0000","last_change":"2023-11-04T01:43:15.143691+0000","last_active":"2023-11-04T01:43:15.152844+0000","last_peered":"2023-11-04T01:43:15.152844+0000","last_clean":"2023-11-04T01:43:15.152844+0000","last_became_active":"2023-11-04T01:43:15.142954+0000","last_became_peered":"2023-11-04T01:43:15.142954+0000","last_unstale":"2023-11-04T01:43:15.152844+0000","last_undegraded":"2023-11-04T01:43:15.152844+0000","last_fullsized":"2023-11-04T01:43:15.152844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108953+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:43:14.108953+0000","last_peered":"2023-11-04T01:43:14.108953+0000","last_clean":"2023-11-04T01:43:14.108953+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:43:14.108953+0000","last_undegraded":"2023-11-04T01:43:14.108953+0000","last_fullsized":"2023-11-04T01:43:14.108953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111231+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:43:14.111231+0000","last_peered":"2023-11-04T01:43:14.111231+0000","last_clean":"2023-11-04T01:43:14.111231+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:43:14.111231+0000","last_undegraded":"2023-11-04T01:43:14.111231+0000","last_fullsized":"2023-11-04T01:43:14.111231+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113065+0000","last_change":"2023-11-04T01:43:15.113065+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113065+0000","last_undegraded":"2023-11-04T01:43:15.113065+0000","last_fullsized":"2023-11-04T01:43:15.113065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.156331+0000","last_change":"2023-11-04T01:43:15.152965+0000","last_active":"2023-11-04T01:43:15.156331+0000","last_peered":"2023-11-04T01:43:15.156331+0000","last_clean":"2023-11-04T01:43:15.156331+0000","last_became_active":"2023-11-04T01:43:15.152534+0000","last_became_peered":"2023-11-04T01:43:15.152534+0000","last_unstale":"2023-11-04T01:43:15.156331+0000","last_undegraded":"2023-11-04T01:43:15.156331+0000","last_fullsized":"2023-11-04T01:43:15.156331+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119750+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:43:14.119750+0000","last_peered":"2023-11-04T01:43:14.119750+0000","last_clean":"2023-11-04T01:43:14.119750+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:43:14.119750+0000","last_undegraded":"2023-11-04T01:43:14.119750+0000","last_fullsized":"2023-11-04T01:43:14.119750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099498+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:43:14.099498+0000","last_peered":"2023-11-04T01:43:14.099498+0000","last_clean":"2023-11-04T01:43:14.099498+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:43:14.099498+0000","last_undegraded":"2023-11-04T01:43:14.099498+0000","last_fullsized":"2023-11-04T01:43:14.099498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116611+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:43:14.116611+0000","last_peered":"2023-11-04T01:43:14.116611+0000","last_clean":"2023-11-04T01:43:14.116611+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:43:14.116611+0000","last_undegraded":"2023-11-04T01:43:14.116611+0000","last_fullsized":"2023-11-04T01:43:14.116611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109576+0000","last_change":"2023-11-04T01:43:15.109576+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109576+0000","last_undegraded":"2023-11-04T01:43:15.109576+0000","last_fullsized":"2023-11-04T01:43:15.109576+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158609+0000","last_change":"2023-11-04T01:43:15.153656+0000","last_active":"2023-11-04T01:43:15.158609+0000","last_peered":"2023-11-04T01:43:15.158609+0000","last_clean":"2023-11-04T01:43:15.158609+0000","last_became_active":"2023-11-04T01:43:15.152300+0000","last_became_peered":"2023-11-04T01:43:15.152300+0000","last_unstale":"2023-11-04T01:43:15.158609+0000","last_undegraded":"2023-11-04T01:43:15.158609+0000","last_fullsized":"2023-11-04T01:43:15.158609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110748+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:43:14.110748+0000","last_peered":"2023-11-04T01:43:14.110748+0000","last_clean":"2023-11-04T01:43:14.110748+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:43:14.110748+0000","last_undegraded":"2023-11-04T01:43:14.110748+0000","last_fullsized":"2023-11-04T01:43:14.110748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116019+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:43:14.116019+0000","last_peered":"2023-11-04T01:43:14.116019+0000","last_clean":"2023-11-04T01:43:14.116019+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:43:14.116019+0000","last_undegraded":"2023-11-04T01:43:14.116019+0000","last_fullsized":"2023-11-04T01:43:14.116019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109874+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:43:14.109874+0000","last_peered":"2023-11-04T01:43:14.109874+0000","last_clean":"2023-11-04T01:43:14.109874+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:43:14.109874+0000","last_undegraded":"2023-11-04T01:43:14.109874+0000","last_fullsized":"2023-11-04T01:43:14.109874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.128023+0000","last_change":"2023-11-04T01:43:15.128023+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.128023+0000","last_undegraded":"2023-11-04T01:43:15.128023+0000","last_fullsized":"2023-11-04T01:43:15.128023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.157296+0000","last_change":"2023-11-04T01:43:15.153690+0000","last_active":"2023-11-04T01:43:15.157296+0000","last_peered":"2023-11-04T01:43:15.157296+0000","last_clean":"2023-11-04T01:43:15.157296+0000","last_became_active":"2023-11-04T01:43:15.153389+0000","last_became_peered":"2023-11-04T01:43:15.153389+0000","last_unstale":"2023-11-04T01:43:15.157296+0000","last_undegraded":"2023-11-04T01:43:15.157296+0000","last_fullsized":"2023-11-04T01:43:15.157296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:22.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107451+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:43:14.107451+0000","last_peered":"2023-11-04T01:43:14.107451+0000","last_clean":"2023-11-04T01:43:14.107451+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:43:14.107451+0000","last_undegraded":"2023-11-04T01:43:14.107451+0000","last_fullsized":"2023-11-04T01:43:14.107451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110287+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:43:14.110287+0000","last_peered":"2023-11-04T01:43:14.110287+0000","last_clean":"2023-11-04T01:43:14.110287+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:43:14.110287+0000","last_undegraded":"2023-11-04T01:43:14.110287+0000","last_fullsized":"2023-11-04T01:43:14.110287+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107987+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:43:14.107987+0000","last_peered":"2023-11-04T01:43:14.107987+0000","last_clean":"2023-11-04T01:43:14.107987+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:43:14.107987+0000","last_undegraded":"2023-11-04T01:43:14.107987+0000","last_fullsized":"2023-11-04T01:43:14.107987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118300+0000","last_change":"2023-11-04T01:43:15.118300+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118300+0000","last_undegraded":"2023-11-04T01:43:15.118300+0000","last_fullsized":"2023-11-04T01:43:15.118300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138678+0000","last_change":"2023-11-04T01:43:15.134623+0000","last_active":"2023-11-04T01:43:15.138678+0000","last_peered":"2023-11-04T01:43:15.138678+0000","last_clean":"2023-11-04T01:43:15.138678+0000","last_became_active":"2023-11-04T01:43:15.133876+0000","last_became_peered":"2023-11-04T01:43:15.133876+0000","last_unstale":"2023-11-04T01:43:15.138678+0000","last_undegraded":"2023-11-04T01:43:15.138678+0000","last_fullsized":"2023-11-04T01:43:15.138678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:27.147417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108626+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:43:14.108626+0000","last_peered":"2023-11-04T01:43:14.108626+0000","last_clean":"2023-11-04T01:43:14.108626+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:43:14.108626+0000","last_undegraded":"2023-11-04T01:43:14.108626+0000","last_fullsized":"2023-11-04T01:43:14.108626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099976+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:43:14.099976+0000","last_peered":"2023-11-04T01:43:14.099976+0000","last_clean":"2023-11-04T01:43:14.099976+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:43:14.099976+0000","last_undegraded":"2023-11-04T01:43:14.099976+0000","last_fullsized":"2023-11-04T01:43:14.099976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110859+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:43:14.110859+0000","last_peered":"2023-11-04T01:43:14.110859+0000","last_clean":"2023-11-04T01:43:14.110859+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:43:14.110859+0000","last_undegraded":"2023-11-04T01:43:14.110859+0000","last_fullsized":"2023-11-04T01:43:14.110859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114081+0000","last_change":"2023-11-04T01:43:15.114081+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114081+0000","last_undegraded":"2023-11-04T01:43:15.114081+0000","last_fullsized":"2023-11-04T01:43:15.114081+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.160210+0000","last_change":"2023-11-04T01:43:15.153163+0000","last_active":"2023-11-04T01:43:15.160210+0000","last_peered":"2023-11-04T01:43:15.160210+0000","last_clean":"2023-11-04T01:43:15.160210+0000","last_became_active":"2023-11-04T01:43:15.152277+0000","last_became_peered":"2023-11-04T01:43:15.152277+0000","last_unstale":"2023-11-04T01:43:15.160210+0000","last_undegraded":"2023-11-04T01:43:15.160210+0000","last_fullsized":"2023-11-04T01:43:15.160210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:44.866182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113707+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:43:14.113707+0000","last_peered":"2023-11-04T01:43:14.113707+0000","last_clean":"2023-11-04T01:43:14.113707+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:43:14.113707+0000","last_undegraded":"2023-11-04T01:43:14.113707+0000","last_fullsized":"2023-11-04T01:43:14.113707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118557+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:43:14.118557+0000","last_peered":"2023-11-04T01:43:14.118557+0000","last_clean":"2023-11-04T01:43:14.118557+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:43:14.118557+0000","last_undegraded":"2023-11-04T01:43:14.118557+0000","last_fullsized":"2023-11-04T01:43:14.118557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107665+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:43:14.107665+0000","last_peered":"2023-11-04T01:43:14.107665+0000","last_clean":"2023-11-04T01:43:14.107665+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:43:14.107665+0000","last_undegraded":"2023-11-04T01:43:14.107665+0000","last_fullsized":"2023-11-04T01:43:14.107665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114506+0000","last_change":"2023-11-04T01:43:15.114506+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114506+0000","last_undegraded":"2023-11-04T01:43:15.114506+0000","last_fullsized":"2023-11-04T01:43:15.114506+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154886+0000","last_change":"2023-11-04T01:43:15.152417+0000","last_active":"2023-11-04T01:43:15.154886+0000","last_peered":"2023-11-04T01:43:15.154886+0000","last_clean":"2023-11-04T01:43:15.154886+0000","last_became_active":"2023-11-04T01:43:15.149079+0000","last_became_peered":"2023-11-04T01:43:15.149079+0000","last_unstale":"2023-11-04T01:43:15.154886+0000","last_undegraded":"2023-11-04T01:43:15.154886+0000","last_fullsized":"2023-11-04T01:43:15.154886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:04.346894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109057+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:43:14.109057+0000","last_peered":"2023-11-04T01:43:14.109057+0000","last_clean":"2023-11-04T01:43:14.109057+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:43:14.109057+0000","last_undegraded":"2023-11-04T01:43:14.109057+0000","last_fullsized":"2023-11-04T01:43:14.109057+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108086+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:43:14.108086+0000","last_peered":"2023-11-04T01:43:14.108086+0000","last_clean":"2023-11-04T01:43:14.108086+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:43:14.108086+0000","last_undegraded":"2023-11-04T01:43:14.108086+0000","last_fullsized":"2023-11-04T01:43:14.108086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.131026+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:43:15.131026+0000","last_peered":"2023-11-04T01:43:15.131026+0000","last_clean":"2023-11-04T01:43:15.131026+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:43:15.131026+0000","last_undegraded":"2023-11-04T01:43:15.131026+0000","last_fullsized":"2023-11-04T01:43:15.131026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.142934+0000","last_change":"2023-11-04T01:43:15.142934+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.142934+0000","last_undegraded":"2023-11-04T01:43:15.142934+0000","last_fullsized":"2023-11-04T01:43:15.142934+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.135294+0000","last_change":"2023-11-04T01:43:15.130147+0000","last_active":"2023-11-04T01:43:15.135294+0000","last_peered":"2023-11-04T01:43:15.135294+0000","last_clean":"2023-11-04T01:43:15.135294+0000","last_became_active":"2023-11-04T01:43:15.129434+0000","last_became_peered":"2023-11-04T01:43:15.129434+0000","last_unstale":"2023-11-04T01:43:15.135294+0000","last_undegraded":"2023-11-04T01:43:15.135294+0000","last_fullsized":"2023-11-04T01:43:15.135294+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:32.080511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117861+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:43:14.117861+0000","last_peered":"2023-11-04T01:43:14.117861+0000","last_clean":"2023-11-04T01:43:14.117861+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:43:14.117861+0000","last_undegraded":"2023-11-04T01:43:14.117861+0000","last_fullsized":"2023-11-04T01:43:14.117861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115367+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:43:14.115367+0000","last_peered":"2023-11-04T01:43:14.115367+0000","last_clean":"2023-11-04T01:43:14.115367+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:43:14.115367+0000","last_undegraded":"2023-11-04T01:43:14.115367+0000","last_fullsized":"2023-11-04T01:43:14.115367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108850+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:43:14.108850+0000","last_peered":"2023-11-04T01:43:14.108850+0000","last_clean":"2023-11-04T01:43:14.108850+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:43:14.108850+0000","last_undegraded":"2023-11-04T01:43:14.108850+0000","last_fullsized":"2023-11-04T01:43:14.108850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114286+0000","last_change":"2023-11-04T01:43:15.114286+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114286+0000","last_undegraded":"2023-11-04T01:43:15.114286+0000","last_fullsized":"2023-11-04T01:43:15.114286+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.149051+0000","last_change":"2023-11-04T01:43:15.144364+0000","last_active":"2023-11-04T01:43:15.149051+0000","last_peered":"2023-11-04T01:43:15.149051+0000","last_clean":"2023-11-04T01:43:15.149051+0000","last_became_active":"2023-11-04T01:43:15.138867+0000","last_became_peered":"2023-11-04T01:43:15.138867+0000","last_unstale":"2023-11-04T01:43:15.149051+0000","last_undegraded":"2023-11-04T01:43:15.149051+0000","last_fullsized":"2023-11-04T01:43:15.149051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:12.573389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119429+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:43:14.119429+0000","last_peered":"2023-11-04T01:43:14.119429+0000","last_clean":"2023-11-04T01:43:14.119429+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:43:14.119429+0000","last_undegraded":"2023-11-04T01:43:14.119429+0000","last_fullsized":"2023-11-04T01:43:14.119429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099681+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:43:14.099681+0000","last_peered":"2023-11-04T01:43:14.099681+0000","last_clean":"2023-11-04T01:43:14.099681+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:43:14.099681+0000","last_undegraded":"2023-11-04T01:43:14.099681+0000","last_fullsized":"2023-11-04T01:43:14.099681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115795+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:43:14.115795+0000","last_peered":"2023-11-04T01:43:14.115795+0000","last_clean":"2023-11-04T01:43:14.115795+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:43:14.115795+0000","last_undegraded":"2023-11-04T01:43:14.115795+0000","last_fullsized":"2023-11-04T01:43:14.115795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.144585+0000","last_change":"2023-11-04T01:43:15.144585+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.144585+0000","last_undegraded":"2023-11-04T01:43:15.144585+0000","last_fullsized":"2023-11-04T01:43:15.144585+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168837+0000","last_change":"2023-11-04T01:43:15.162848+0000","last_active":"2023-11-04T01:43:15.168837+0000","last_peered":"2023-11-04T01:43:15.168837+0000","last_clean":"2023-11-04T01:43:15.168837+0000","last_became_active":"2023-11-04T01:43:15.161007+0000","last_became_peered":"2023-11-04T01:43:15.161007+0000","last_unstale":"2023-11-04T01:43:15.168837+0000","last_undegraded":"2023-11-04T01:43:15.168837+0000","last_fullsized":"2023-11-04T01:43:15.168837+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:44.148187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119952+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:43:14.119952+0000","last_peered":"2023-11-04T01:43:14.119952+0000","last_clean":"2023-11-04T01:43:14.119952+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:43:14.119952+0000","last_undegraded":"2023-11-04T01:43:14.119952+0000","last_fullsized":"2023-11-04T01:43:14.119952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111915+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:43:14.111915+0000","last_peered":"2023-11-04T01:43:14.111915+0000","last_clean":"2023-11-04T01:43:14.111915+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:43:14.111915+0000","last_undegraded":"2023-11-04T01:43:14.111915+0000","last_fullsized":"2023-11-04T01:43:14.111915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114455+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:43:14.114455+0000","last_peered":"2023-11-04T01:43:14.114455+0000","last_clean":"2023-11-04T01:43:14.114455+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:43:14.114455+0000","last_undegraded":"2023-11-04T01:43:14.114455+0000","last_fullsized":"2023-11-04T01:43:14.114455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1675264,"data_stored":1094075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":1.139,"15min":0.95999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":29.603000000000002,"5min":29.603000000000002,"15min":29.603000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.59099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.355,"5min":1.454,"15min":1.454},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96599999999999997,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.129}]},{"osd":2,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.96999999999999997,"15min":0.92700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.008},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.63500000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.2450000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89800000000000002,"15min":0.89700000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":2.0760000000000001,"5min":1.1819999999999999,"15min":1.03},"min":{"1min":0.70999999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":25.791,"5min":25.791,"15min":25.791},"last":1.097}]},{"osd":4,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98599999999999999,"15min":1.0009999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.70099999999999996},{"interface":"front","average":{"1min":2.0910000000000002,"5min":1.27,"15min":1.131},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":25.696999999999999,"5min":25.696999999999999,"15min":25.696999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.129,"15min":1.0589999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":11.064,"5min":11.064,"15min":11.064},"last":1.075},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.1630000000000003,"5min":4.1630000000000003,"15min":4.1630000000000003},"last":1.155}]},{"osd":6,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1200000000000001,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2250000000000001,"15min":1.226},"min":{"1min":0.88500000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":511073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.165,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2210000000000001,"5min":1.347,"15min":1.347},"last":1.1240000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.262,"5min":1.395,"15min":1.395},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2270000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.95399999999999996},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2010000000000001,"5min":1.319,"15min":1.319},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1950000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98199999999999998},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.079,"15min":1.103},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3879999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.03,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.694,"15min":1.694},"last":1.04},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1259999999999999,"15min":1.1359999999999999},"min":{"1min":0.76700000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.083}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.1120000000000001,"15min":1.1160000000000001},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3109999999999999,"5min":1.649,"15min":1.649},"last":1.329},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1499999999999999,"15min":1.175},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.409,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79700000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.23,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.504,"5min":0.5,"15min":0.5},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.262},"last":0.51400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.85599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.419,"15min":1.419},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.76100000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2490000000000001,"5min":1.252,"15min":1.252},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.046},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.58599999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4159999999999999,"5min":1.502,"15min":1.502},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2270000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.383,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.107,"15min":1.115},"min":{"1min":0.68799999999999994,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3280000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0189999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":1.016},"min":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3939999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3},"last":0.51700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91700000000000004,"15min":0.94499999999999995},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.101,"5min":1.605,"15min":1.605},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.62}]},{"osd":2,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.234,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.446,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96599999999999997,"15min":0.97299999999999998},"min":{"1min":0.68100000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.488,"15min":1.488},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.296,"5min":1.996,"15min":1.996},"last":1.119}]},{"osd":5,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.077,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4830000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0649999999999999,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2889999999999999,"5min":1.514,"15min":1.514},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1419999999999999},"min":{"1min":0.70599999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.349,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.161,"15min":1.169},"min":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.4339999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2150000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.147,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65600000000000003,"15min":0.68200000000000005},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.171,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.74199999999999999},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.623,"15min":1.623},"last":1.1419999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.70099999999999996},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0069999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95999999999999996,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.395,"5min":1.806,"15min":1.806},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.67300000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.425,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.196}]},{"osd":6,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.54,"15min":1.54},"last":1.093},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.5720000000000001,"5min":1.73,"15min":1.73},"last":1.407}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.361,"5min":1.407,"15min":1.407},"last":1.25},{"interface":"front","average":{"1min":1.044,"5min":1.0860000000000001,"15min":1.1060000000000001},"min":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.419,"5min":1.732,"15min":1.732},"last":1.224}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.64600000000000002},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1040000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.103,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":1.29,"15min":1.29},"last":1.327}]},{"osd":3,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.77700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.125,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.175},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.98099999999999998},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1399999999999999,"5min":1.534,"15min":1.534},"last":1.5269999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.022,"15min":1.0469999999999999},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.21,"5min":1.877,"15min":1.877},"last":1.4490000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.012,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.25,"5min":1.446,"15min":1.446},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.034,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.143,"15min":1.1870000000000001},"min":{"1min":0.73299999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0379999999999998,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.78}]},{"osd":7,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.583},{"interface":"front","average":{"1min":1.071,"5min":1.1060000000000001,"15min":1.1439999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4630000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.8919999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.67300000000000004,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.05,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.629}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.379,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7929999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.0309999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86099999999999999,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.012,"15min":0.96699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":1.1519999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.077,"15min":1.056},"min":{"1min":0.61099999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.077,"15min":1.083},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5449999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1220000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92500000000000004,"15min":0.90600000000000003},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.099},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1220000000000001,"15min":1.0800000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.9199999999999999,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":1.2609999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1040000000000001,"15min":1.1140000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.226},{"interface":"front","average":{"1min":1.034,"5min":0.998,"15min":0.98699999999999999},"min":{"1min":0.68799999999999994,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9850000000000001,"5min":1.994,"15min":1.994},"last":1.198}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1687552,"data_stored":1101441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75800000000000001,"5min":1.135,"15min":1.135},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.624}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.27,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.026},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2470000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.68999999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1399999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.014},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.71699999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2170000000000001,"5min":1.694,"15min":1.694},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.745,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.298,"5min":1.782,"15min":1.782},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5229999999999999,"5min":1.903,"15min":1.903},"last":0.96399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.0800000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5920000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.653,"15min":1.653},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:21.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-11-04T01:43:21.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.117008+0000', 'last_change': '2023-11-04T01:43:15.117008+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.117008+0000', 'last_undegraded': '2023-11-04T01:43:15.117008+0000', 'last_fullsized': '2023-11-04T01:43:15.117008+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.131236+0000', 'last_change': '2023-11-04T01:43:15.131236+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.131236+0000', 'last_undegraded': '2023-11-04T01:43:15.131236+0000', 'last_fullsized': '2023-11-04T01:43:15.131236+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.118764+0000', 'last_change': '2023-11-04T01:43:15.118764+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.118764+0000', 'last_undegraded': '2023-11-04T01:43:15.118764+0000', 'last_fullsized': '2023-11-04T01:43:15.118764+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.130569+0000', 'last_change': '2023-11-04T01:43:15.130569+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.130569+0000', 'last_undegraded': '2023-11-04T01:43:15.130569+0000', 'last_fullsized': '2023-11-04T01:43:15.130569+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-11-04T01:43:21.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.149804+0000', 'last_change': '2023-11-04T01:43:15.149804+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.149804+0000', 'last_undegraded': '2023-11-04T01:43:15.149804+0000', 'last_fullsized': '2023-11-04T01:43:15.149804+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.125131+0000', 'last_change': '2023-11-04T01:43:15.125131+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.125131+0000', 'last_undegraded': '2023-11-04T01:43:15.125131+0000', 'last_fullsized': '2023-11-04T01:43:15.125131+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.124944+0000', 'last_change': '2023-11-04T01:43:15.124944+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.124944+0000', 'last_undegraded': '2023-11-04T01:43:15.124944+0000', 'last_fullsized': '2023-11-04T01:43:15.124944+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.127761+0000', 'last_change': '2023-11-04T01:43:15.127761+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.127761+0000', 'last_undegraded': '2023-11-04T01:43:15.127761+0000', 'last_fullsized': '2023-11-04T01:43:15.127761+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.125044+0000', 'last_change': '2023-11-04T01:43:15.125044+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.125044+0000', 'last_undegraded': '2023-11-04T01:43:15.125044+0000', 'last_fullsized': '2023-11-04T01:43:15.125044+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.147747+0000', 'last_change': '2023-11-04T01:43:15.147747+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.147747+0000', 'last_undegraded': '2023-11-04T01:43:15.147747+0000', 'last_fullsized': '2023-11-04T01:43:15.147747+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.111907+0000', 'last_change': '2023-11-04T01:43:15.111907+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.111907+0000', 'last_undegraded': '2023-11-04T01:43:15.111907+0000', 'last_fullsized': '2023-11-04T01:43:15.111907+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.110469+0000', 'last_change': '2023-11-04T01:43:15.110469+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.110469+0000', 'last_undegraded': '2023-11-04T01:43:15.110469+0000', 'last_fullsized': '2023-11-04T01:43:15.110469+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.119196+0000', 'last_change': '2023-11-04T01:43:15.119196+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.119196+0000', 'last_undegraded': '2023-11-04T01:43:15.119196+0000', 'last_fullsized': '2023-11-04T01:43:15.119196+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-11-04T01:43:21.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.119331+0000', 'last_change': '2023-11-04T01:43:15.119331+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.119331+0000', 'last_undegraded': '2023-11-04T01:43:15.119331+0000', 'last_fullsized': '2023-11-04T01:43:15.119331+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.129288+0000', 'last_change': '2023-11-04T01:43:15.129288+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.129288+0000', 'last_undegraded': '2023-11-04T01:43:15.129288+0000', 'last_fullsized': '2023-11-04T01:43:15.129288+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.132136+0000', 'last_change': '2023-11-04T01:43:15.132136+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.132136+0000', 'last_undegraded': '2023-11-04T01:43:15.132136+0000', 'last_fullsized': '2023-11-04T01:43:15.132136+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.116352+0000', 'last_change': '2023-11-04T01:43:15.116352+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.116352+0000', 'last_undegraded': '2023-11-04T01:43:15.116352+0000', 'last_fullsized': '2023-11-04T01:43:15.116352+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.125071+0000', 'last_change': '2023-11-04T01:43:15.125071+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.125071+0000', 'last_undegraded': '2023-11-04T01:43:15.125071+0000', 'last_fullsized': '2023-11-04T01:43:15.125071+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.118123+0000', 'last_change': '2023-11-04T01:43:15.118123+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.118123+0000', 'last_undegraded': '2023-11-04T01:43:15.118123+0000', 'last_fullsized': '2023-11-04T01:43:15.118123+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.109148+0000', 'last_change': '2023-11-04T01:43:15.109148+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.109148+0000', 'last_undegraded': '2023-11-04T01:43:15.109148+0000', 'last_fullsized': '2023-11-04T01:43:15.109148+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.122192+0000', 'last_change': '2023-11-04T01:43:15.122192+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.122192+0000', 'last_undegraded': '2023-11-04T01:43:15.122192+0000', 'last_fullsized': '2023-11-04T01:43:15.122192+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.146557+0000', 'last_change': '2023-11-04T01:43:15.146557+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.146557+0000', 'last_undegraded': '2023-11-04T01:43:15.146557+0000', 'last_fullsized': '2023-11-04T01:43:15.146557+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-11-04T01:43:21.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.117462+0000', 'last_change': '2023-11-04T01:43:15.117462+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.117462+0000', 'last_undegraded': '2023-11-04T01:43:15.117462+0000', 'last_fullsized': '2023-11-04T01:43:15.117462+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.148901+0000', 'last_change': '2023-11-04T01:43:15.148901+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.148901+0000', 'last_undegraded': '2023-11-04T01:43:15.148901+0000', 'last_fullsized': '2023-11-04T01:43:15.148901+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114154+0000', 'last_change': '2023-11-04T01:43:15.114154+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114154+0000', 'last_undegraded': '2023-11-04T01:43:15.114154+0000', 'last_fullsized': '2023-11-04T01:43:15.114154+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114738+0000', 'last_change': '2023-11-04T01:43:15.114738+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114738+0000', 'last_undegraded': '2023-11-04T01:43:15.114738+0000', 'last_fullsized': '2023-11-04T01:43:15.114738+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.113282+0000', 'last_change': '2023-11-04T01:43:15.113282+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.113282+0000', 'last_undegraded': '2023-11-04T01:43:15.113282+0000', 'last_fullsized': '2023-11-04T01:43:15.113282+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-11-04T01:43:21.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.138778+0000', 'last_change': '2023-11-04T01:43:15.138778+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.138778+0000', 'last_undegraded': '2023-11-04T01:43:15.138778+0000', 'last_fullsized': '2023-11-04T01:43:15.138778+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.122902+0000', 'last_change': '2023-11-04T01:43:15.122902+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.122902+0000', 'last_undegraded': '2023-11-04T01:43:15.122902+0000', 'last_fullsized': '2023-11-04T01:43:15.122902+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.110550+0000', 'last_change': '2023-11-04T01:43:15.110550+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.110550+0000', 'last_undegraded': '2023-11-04T01:43:15.110550+0000', 'last_fullsized': '2023-11-04T01:43:15.110550+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.123664+0000', 'last_change': '2023-11-04T01:43:15.123664+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.123664+0000', 'last_undegraded': '2023-11-04T01:43:15.123664+0000', 'last_fullsized': '2023-11-04T01:43:15.123664+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.126727+0000', 'last_change': '2023-11-04T01:43:15.126727+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.126727+0000', 'last_undegraded': '2023-11-04T01:43:15.126727+0000', 'last_fullsized': '2023-11-04T01:43:15.126727+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-11-04T01:43:21.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.113823+0000', 'last_change': '2023-11-04T01:43:15.113823+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.113823+0000', 'last_undegraded': '2023-11-04T01:43:15.113823+0000', 'last_fullsized': '2023-11-04T01:43:15.113823+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114458+0000', 'last_change': '2023-11-04T01:43:15.114458+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114458+0000', 'last_undegraded': '2023-11-04T01:43:15.114458+0000', 'last_fullsized': '2023-11-04T01:43:15.114458+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114664+0000', 'last_change': '2023-11-04T01:43:15.114664+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114664+0000', 'last_undegraded': '2023-11-04T01:43:15.114664+0000', 'last_fullsized': '2023-11-04T01:43:15.114664+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.116181+0000', 'last_change': '2023-11-04T01:43:15.116181+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.116181+0000', 'last_undegraded': '2023-11-04T01:43:15.116181+0000', 'last_fullsized': '2023-11-04T01:43:15.116181+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.116753+0000', 'last_change': '2023-11-04T01:43:15.116753+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.116753+0000', 'last_undegraded': '2023-11-04T01:43:15.116753+0000', 'last_fullsized': '2023-11-04T01:43:15.116753+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.125629+0000', 'last_change': '2023-11-04T01:43:15.125629+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.125629+0000', 'last_undegraded': '2023-11-04T01:43:15.125629+0000', 'last_fullsized': '2023-11-04T01:43:15.125629+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.123961+0000', 'last_change': '2023-11-04T01:43:15.123961+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.123961+0000', 'last_undegraded': '2023-11-04T01:43:15.123961+0000', 'last_fullsized': '2023-11-04T01:43:15.123961+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.148519+0000', 'last_change': '2023-11-04T01:43:15.148519+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.148519+0000', 'last_undegraded': '2023-11-04T01:43:15.148519+0000', 'last_fullsized': '2023-11-04T01:43:15.148519+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.119517+0000', 'last_change': '2023-11-04T01:43:15.119517+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.119517+0000', 'last_undegraded': '2023-11-04T01:43:15.119517+0000', 'last_fullsized': '2023-11-04T01:43:15.119517+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.121012+0000', 'last_change': '2023-11-04T01:43:15.121012+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.121012+0000', 'last_undegraded': '2023-11-04T01:43:15.121012+0000', 'last_fullsized': '2023-11-04T01:43:15.121012+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.131096+0000', 'last_change': '2023-11-04T01:43:15.131096+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.131096+0000', 'last_undegraded': '2023-11-04T01:43:15.131096+0000', 'last_fullsized': '2023-11-04T01:43:15.131096+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:43:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.112748+0000', 'last_change': '2023-11-04T01:43:15.112748+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.112748+0000', 'last_undegraded': '2023-11-04T01:43:15.112748+0000', 'last_fullsized': '2023-11-04T01:43:15.112748+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.115396+0000', 'last_change': '2023-11-04T01:43:15.115396+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.115396+0000', 'last_undegraded': '2023-11-04T01:43:15.115396+0000', 'last_fullsized': '2023-11-04T01:43:15.115396+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.109995+0000', 'last_change': '2023-11-04T01:43:15.109995+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.109995+0000', 'last_undegraded': '2023-11-04T01:43:15.109995+0000', 'last_fullsized': '2023-11-04T01:43:15.109995+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.126384+0000', 'last_change': '2023-11-04T01:43:15.126384+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.126384+0000', 'last_undegraded': '2023-11-04T01:43:15.126384+0000', 'last_fullsized': '2023-11-04T01:43:15.126384+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.109597+0000', 'last_change': '2023-11-04T01:43:15.109597+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.109597+0000', 'last_undegraded': '2023-11-04T01:43:15.109597+0000', 'last_fullsized': '2023-11-04T01:43:15.109597+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.116197+0000', 'last_change': '2023-11-04T01:43:15.116197+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.116197+0000', 'last_undegraded': '2023-11-04T01:43:15.116197+0000', 'last_fullsized': '2023-11-04T01:43:15.116197+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.113922+0000', 'last_change': '2023-11-04T01:43:15.113922+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.113922+0000', 'last_undegraded': '2023-11-04T01:43:15.113922+0000', 'last_fullsized': '2023-11-04T01:43:15.113922+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.123886+0000', 'last_change': '2023-11-04T01:43:15.123886+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.123886+0000', 'last_undegraded': '2023-11-04T01:43:15.123886+0000', 'last_fullsized': '2023-11-04T01:43:15.123886+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.117930+0000', 'last_change': '2023-11-04T01:43:15.117930+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.117930+0000', 'last_undegraded': '2023-11-04T01:43:15.117930+0000', 'last_fullsized': '2023-11-04T01:43:15.117930+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.113784+0000', 'last_change': '2023-11-04T01:43:15.113784+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.113784+0000', 'last_undegraded': '2023-11-04T01:43:15.113784+0000', 'last_fullsized': '2023-11-04T01:43:15.113784+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-11-04T01:43:21.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.117691+0000', 'last_change': '2023-11-04T01:43:15.117691+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.117691+0000', 'last_undegraded': '2023-11-04T01:43:15.117691+0000', 'last_fullsized': '2023-11-04T01:43:15.117691+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.109220+0000', 'last_change': '2023-11-04T01:43:15.109220+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.109220+0000', 'last_undegraded': '2023-11-04T01:43:15.109220+0000', 'last_fullsized': '2023-11-04T01:43:15.109220+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.113065+0000', 'last_change': '2023-11-04T01:43:15.113065+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.113065+0000', 'last_undegraded': '2023-11-04T01:43:15.113065+0000', 'last_fullsized': '2023-11-04T01:43:15.113065+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.109576+0000', 'last_change': '2023-11-04T01:43:15.109576+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.109576+0000', 'last_undegraded': '2023-11-04T01:43:15.109576+0000', 'last_fullsized': '2023-11-04T01:43:15.109576+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.128023+0000', 'last_change': '2023-11-04T01:43:15.128023+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.128023+0000', 'last_undegraded': '2023-11-04T01:43:15.128023+0000', 'last_fullsized': '2023-11-04T01:43:15.128023+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-11-04T01:43:21.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.118300+0000', 'last_change': '2023-11-04T01:43:15.118300+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.118300+0000', 'last_undegraded': '2023-11-04T01:43:15.118300+0000', 'last_fullsized': '2023-11-04T01:43:15.118300+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114081+0000', 'last_change': '2023-11-04T01:43:15.114081+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114081+0000', 'last_undegraded': '2023-11-04T01:43:15.114081+0000', 'last_fullsized': '2023-11-04T01:43:15.114081+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114506+0000', 'last_change': '2023-11-04T01:43:15.114506+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114506+0000', 'last_undegraded': '2023-11-04T01:43:15.114506+0000', 'last_fullsized': '2023-11-04T01:43:15.114506+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.142934+0000', 'last_change': '2023-11-04T01:43:15.142934+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.142934+0000', 'last_undegraded': '2023-11-04T01:43:15.142934+0000', 'last_fullsized': '2023-11-04T01:43:15.142934+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.114286+0000', 'last_change': '2023-11-04T01:43:15.114286+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.114286+0000', 'last_undegraded': '2023-11-04T01:43:15.114286+0000', 'last_fullsized': '2023-11-04T01:43:15.114286+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-11-04T01:43:21.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:43:15.144585+0000', 'last_change': '2023-11-04T01:43:15.144585+0000', 'last_active': '2023-11-04T01:43:15.095004+0000', 'last_peered': '2023-11-04T01:43:15.095004+0000', 'last_clean': '2023-11-04T01:43:15.095004+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:43:15.144585+0000', 'last_undegraded': '2023-11-04T01:43:15.144585+0000', 'last_fullsized': '2023-11-04T01:43:15.144585+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'last_clean_scrub_stamp': '2023-11-04T01:43:15.095004+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:43:21.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:43:21.089 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:43:21.081+0000 7f28ac811640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 Processor -- start 2023-11-04T01:43:21.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 -- start start 2023-11-04T01:43:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 0x7fc3880cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc38806fe20 0x7fc3880702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3880cdda0 con 0x7fc388143810 2023-11-04T01:43:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38806f9d0 con 0x7fc38806fe20 2023-11-04T01:43:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38f6dc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38806c950 con 0x7fc3880cd400 2023-11-04T01:43:21.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38d478640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc388143810 0x7fc38806be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:32774/0 (socket says 172.21.15.40:32774) 2023-11-04T01:43:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.209+0000 7fc38d478640 1 -- 172.21.15.40:0/3545148537 learned_addr learned my addr 172.21.15.40:0/3545148537 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38cc77640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 0x7fc3880cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38dc79640 1 --2- 172.21.15.40:0/3545148537 >> v2:172.21.15.91:3300/0 conn(0x7fc38806fe20 0x7fc3880702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132439020 0 0) 0x7fc3880cdda0 con 0x7fc388143810 2023-11-04T01:43:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc374003530 con 0x7fc388143810 2023-11-04T01:43:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 771844049 0 0) 0x7fc374003530 con 0x7fc388143810 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 msgr2=0x7fc3880cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 0x7fc3880cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 >> v2:172.21.15.91:3300/0 conn(0x7fc38806fe20 msgr2=0x7fc3880702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 --2- 172.21.15.40:0/3545148537 >> v2:172.21.15.91:3300/0 conn(0x7fc38806fe20 0x7fc3880702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38806cc30 con 0x7fc388143810 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fc384001680 con 0x7fc388143810 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 >> v1:172.21.15.40:6789/0 conn(0x7fc388143810 legacy=0x7fc38806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc374003980 0x7fc374003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3740047d0 0x7fc374004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 0x7fc374005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38806f9d0 con 0x7fc374003980 2023-11-04T01:43:21.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38806c950 con 0x7fc3740047d0 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37400b990 con 0x7fc3880cd400 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc374003980 0x7fc374003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38dc79640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 0x7fc374005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38cc77640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3740047d0 0x7fc374004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 -- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 msgr2=0x7fc374005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3880cd400 0x7fc374005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 -- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3740047d0 msgr2=0x7fc374004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3740047d0 0x7fc374004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 -- 172.21.15.40:0/3545148537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374003530 con 0x7fc374003980 2023-11-04T01:43:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.213+0000 7fc38d478640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc374003980 0x7fc374003da0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc38400c240 tx=0x7fc38401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af83c9192c1bcf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840058e0 con 0x7fc374003980 2023-11-04T01:43:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc384005a40 con 0x7fc374003980 2023-11-04T01:43:21.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc37bfff640 1 -- 172.21.15.40:0/3545148537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384005e10 con 0x7fc374003980 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38f6dc640 1 -- 172.21.15.40:0/3545148537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc374003980 msgr2=0x7fc374003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/3545148537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc374003980 0x7fc374003da0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc38400c240 tx=0x7fc38401cc30 comp rx=0 tx=0).stop 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38dc79640 1 -- 172.21.15.40:0/3545148537 reap_dead start 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38f6dc640 1 -- 172.21.15.40:0/3545148537 shutdown_connections 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38f6dc640 1 -- 172.21.15.40:0/3545148537 >> 172.21.15.40:0/3545148537 conn(0x7fc3880b07d0 msgr2=0x7fc3880b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38f6dc640 1 -- 172.21.15.40:0/3545148537 shutdown_connections 2023-11-04T01:43:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.217+0000 7fc38f6dc640 1 -- 172.21.15.40:0/3545148537 wait complete. 2023-11-04T01:43:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 Processor -- start 2023-11-04T01:43:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- start start 2023-11-04T01:43:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc374003980 0x7fc388143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc388161500 0x7fc388158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 0x7fc3880b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388162690 con 0x7fc3880b2270 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388158f50 con 0x7fc374003980 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388161a80 con 0x7fc388161500 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 0x7fc3880b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 0x7fc3880b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45002/0 (socket says 172.21.15.40:45002) 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 -- 172.21.15.40:0/418879230 learned_addr learned my addr 172.21.15.40:0/418879230 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38cc77640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc388161500 0x7fc388158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38d478640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc374003980 0x7fc388143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 -- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc388161500 msgr2=0x7fc388158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc388161500 0x7fc388158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 -- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc374003980 msgr2=0x7fc388143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc374003980 0x7fc388143c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 -- 172.21.15.40:0/418879230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388161d60 con 0x7fc3880b2270 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38d478640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc374003980 0x7fc388143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38dc79640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 0x7fc3880b3ce0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc3880b13a0 tx=0x7fc3800115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38000e070 con 0x7fc3880b2270 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3800039a0 con 0x7fc3880b2270 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc388162040 con 0x7fc3880b2270 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380003b50 con 0x7fc3880b2270 2023-11-04T01:43:21.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3880b26f0 con 0x7fc3880b2270 2023-11-04T01:43:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc388162840 con 0x7fc3880b2270 2023-11-04T01:43:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc380003cb0 con 0x7fc3880b2270 2023-11-04T01:43:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc379ffb640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc36c0664d0 0x7fc36c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.221+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fc380084860 con 0x7fc3880b2270 2023-11-04T01:43:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.225+0000 7fc38d478640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc36c0664d0 0x7fc36c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.225+0000 7fc38d478640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc36c0664d0 0x7fc36c068990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc3840aa000 tx=0x7fc384001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.229+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc388162840 con 0x7fc3880b2270 2023-11-04T01:43:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.437+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc388074510 con 0x7fc3880b2270 2023-11-04T01:43:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.437+0000 7fc379ffb640 1 -- 172.21.15.40:0/418879230 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7fc380051930 con 0x7fc3880b2270 2023-11-04T01:43:21.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"3 pool(s) do not have an application enabled","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":228,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061984,"num_in_osds":8,"osd_in_since":1699061975,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":6,"num_objects":2,"data_bytes":590368,"bytes_used":265297920,"bytes_avail":772828815360,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7086}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-04T01:41:47.788736+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc36c0664d0 msgr2=0x7fc36c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc36c0664d0 0x7fc36c068990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc3840aa000 tx=0x7fc384001a80 comp rx=0 tx=0).stop 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 msgr2=0x7fc3880b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 0x7fc3880b3ce0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc3880b13a0 tx=0x7fc3800115a0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 shutdown_connections 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc36c0664d0 0x7fc36c068990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3880b2270 0x7fc3880b3ce0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc388161500 0x7fc388158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 --2- 172.21.15.40:0/418879230 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc374003980 0x7fc388143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 >> 172.21.15.40:0/418879230 conn(0x7fc3880b07d0 msgr2=0x7fc38815dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 shutdown_connections 2023-11-04T01:43:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.441+0000 7fc38f6dc640 1 -- 172.21.15.40:0/418879230 wait complete. 2023-11-04T01:43:21.463 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:43:21.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.577+0000 7f04103c9640 1 Processor -- start 2023-11-04T01:43:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f04103c9640 1 -- start start 2023-11-04T01:43:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f04103c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f040806cc60 0x7f04080d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f04103c9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04080b2ee0 0x7f040815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f04103c9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040806f480 con 0x7f040806d040 2023-11-04T01:43:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f04103c9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080ce7c0 con 0x7f04080b2ee0 2023-11-04T01:43:21.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f04103c9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0408070490 con 0x7f040806cc60 2023-11-04T01:43:21.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040d964640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f040806d040 0x7f04080b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:32780/0 (socket says 172.21.15.40:32780) 2023-11-04T01:43:21.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040e966640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04080b2ee0 0x7f040815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040d964640 1 -- 172.21.15.40:0/2032383083 learned_addr learned my addr 172.21.15.40:0/2032383083 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:21.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040e165640 1 --2- 172.21.15.40:0/2032383083 >> v2:172.21.15.91:3300/0 conn(0x7f040806cc60 0x7f04080d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040e966640 1 -- 172.21.15.40:0/2032383083 >> v2:172.21.15.91:3300/0 conn(0x7f040806cc60 msgr2=0x7f04080d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040e966640 1 --2- 172.21.15.40:0/2032383083 >> v2:172.21.15.91:3300/0 conn(0x7f040806cc60 0x7f04080d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040e966640 1 -- 172.21.15.40:0/2032383083 >> v1:172.21.15.40:6789/0 conn(0x7f040806d040 legacy=0x7f04080b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.581+0000 7f040e966640 1 -- 172.21.15.40:0/2032383083 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040806c280 con 0x7f04080b2ee0 2023-11-04T01:43:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f040e966640 1 --2- 172.21.15.40:0/2032383083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04080b2ee0 0x7f040815c9c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f04080d0cb0 tx=0x7f040001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137142f6140192b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f040d163640 1 -- 172.21.15.40:0/2032383083 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04000a58c0 con 0x7f04080b2ee0 2023-11-04T01:43:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f040d163640 1 -- 172.21.15.40:0/2032383083 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04000a5a20 con 0x7f04080b2ee0 2023-11-04T01:43:21.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f040d163640 1 -- 172.21.15.40:0/2032383083 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04000a5db0 con 0x7f04080b2ee0 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 -- 172.21.15.40:0/2032383083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04080b2ee0 msgr2=0x7f040815c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 --2- 172.21.15.40:0/2032383083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04080b2ee0 0x7f040815c9c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f04080d0cb0 tx=0x7f040001c910 comp rx=0 tx=0).stop 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 -- 172.21.15.40:0/2032383083 shutdown_connections 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 --2- 172.21.15.40:0/2032383083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04080b2ee0 0x7f040815c9c0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 --2- 172.21.15.40:0/2032383083 >> v2:172.21.15.91:3300/0 conn(0x7f040806cc60 0x7f04080d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 -- 172.21.15.40:0/2032383083 >> 172.21.15.40:0/2032383083 conn(0x7f04080cd7d0 msgr2=0x7f04080cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 -- 172.21.15.40:0/2032383083 shutdown_connections 2023-11-04T01:43:21.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 -- 172.21.15.40:0/2032383083 wait complete. 2023-11-04T01:43:21.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 Processor -- start 2023-11-04T01:43:21.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 -- start start 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f040806cc60 0x7f04080b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.585+0000 7f04103c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 0x7f0408158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f04080b2ee0 0x7f04080ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0408159070 con 0x7f040806d040 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04080aee80 con 0x7f040806cc60 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080b3e70 con 0x7f04080b2ee0 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 0x7f0408158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 0x7f0408158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45028/0 (socket says 172.21.15.40:45028) 2023-11-04T01:43:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 -- 172.21.15.40:0/4267337766 learned_addr learned my addr 172.21.15.40:0/4267337766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040e165640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f040806cc60 0x7f04080b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040e966640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f04080b2ee0 0x7f04080ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 -- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f04080b2ee0 msgr2=0x7f04080ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f04080b2ee0 0x7f04080ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 -- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f040806cc60 msgr2=0x7f04080b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f040806cc60 0x7f04080b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 -- 172.21.15.40:0/4267337766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400009a70 con 0x7f040806d040 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040d964640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 0x7f0408158b30 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c500 tx=0x7f03fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc005cf0 con 0x7f040806d040 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc005e50 con 0x7f040806d040 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04080b4150 con 0x7f040806d040 2023-11-04T01:43:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0072f0 con 0x7f040806d040 2023-11-04T01:43:21.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04080b4710 con 0x7f040806d040 2023-11-04T01:43:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04080744a0 con 0x7f040806d040 2023-11-04T01:43:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03fc007450 con 0x7f040806d040 2023-11-04T01:43:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f03faffd640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03ec0664a0 0x7f03ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f03fc083710 con 0x7f040806d040 2023-11-04T01:43:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.589+0000 7f040e165640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03ec0664a0 0x7f03ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.593+0000 7f040e165640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03ec0664a0 0x7f03ec068960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f040815fe80 tx=0x7f0404008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.593+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03fc050890 con 0x7f040806d040 2023-11-04T01:43:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.741+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f040815e570 con 0x7f03ec0664a0 2023-11-04T01:43:21.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.781+0000 7f03faffd640 1 -- 172.21.15.40:0/4267337766 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525035 (secure 0 0 0) 0x7f040815e570 con 0x7f03ec0664a0 2023-11-04T01:43:21.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03ec0664a0 msgr2=0x7f03ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03ec0664a0 0x7f03ec068960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f040815fe80 tx=0x7f0404008040 comp rx=0 tx=0).stop 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 msgr2=0x7f0408158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 0x7f0408158b30 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00c500 tx=0x7f03fc00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 shutdown_connections 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f03ec0664a0 0x7f03ec068960 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f04080b2ee0 0x7f04080ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040806d040 0x7f0408158b30 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 --2- 172.21.15.40:0/4267337766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f040806cc60 0x7f04080b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 >> 172.21.15.40:0/4267337766 conn(0x7f04080cd7d0 msgr2=0x7f040815de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 shutdown_connections 2023-11-04T01:43:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:21.785+0000 7f04103c9640 1 -- 172.21.15.40:0/4267337766 wait complete. 2023-11-04T01:43:21.812 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-11-04T01:43:19.825567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259080,"kb_used_data":9632,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715640,"statfs":{"total":773094113280,"available":772828815360,"internally_reserved":0,"allocated":9863168,"data_stored":5225124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.726884"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117008+0000","last_change":"2023-11-04T01:43:15.117008+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117008+0000","last_undegraded":"2023-11-04T01:43:15.117008+0000","last_fullsized":"2023-11-04T01:43:15.117008+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131236+0000","last_change":"2023-11-04T01:43:15.131236+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131236+0000","last_undegraded":"2023-11-04T01:43:15.131236+0000","last_fullsized":"2023-11-04T01:43:15.131236+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118764+0000","last_change":"2023-11-04T01:43:15.118764+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118764+0000","last_undegraded":"2023-11-04T01:43:15.118764+0000","last_fullsized":"2023-11-04T01:43:15.118764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.130569+0000","last_change":"2023-11-04T01:43:15.130569+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.130569+0000","last_undegraded":"2023-11-04T01:43:15.130569+0000","last_fullsized":"2023-11-04T01:43:15.130569+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.149804+0000","last_change":"2023-11-04T01:43:15.149804+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.149804+0000","last_undegraded":"2023-11-04T01:43:15.149804+0000","last_fullsized":"2023-11-04T01:43:15.149804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125131+0000","last_change":"2023-11-04T01:43:15.125131+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125131+0000","last_undegraded":"2023-11-04T01:43:15.125131+0000","last_fullsized":"2023-11-04T01:43:15.125131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.124944+0000","last_change":"2023-11-04T01:43:15.124944+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.124944+0000","last_undegraded":"2023-11-04T01:43:15.124944+0000","last_fullsized":"2023-11-04T01:43:15.124944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.127761+0000","last_change":"2023-11-04T01:43:15.127761+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.127761+0000","last_undegraded":"2023-11-04T01:43:15.127761+0000","last_fullsized":"2023-11-04T01:43:15.127761+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125044+0000","last_change":"2023-11-04T01:43:15.125044+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125044+0000","last_undegraded":"2023-11-04T01:43:15.125044+0000","last_fullsized":"2023-11-04T01:43:15.125044+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.147747+0000","last_change":"2023-11-04T01:43:15.147747+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.147747+0000","last_undegraded":"2023-11-04T01:43:15.147747+0000","last_fullsized":"2023-11-04T01:43:15.147747+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.111907+0000","last_change":"2023-11-04T01:43:15.111907+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.111907+0000","last_undegraded":"2023-11-04T01:43:15.111907+0000","last_fullsized":"2023-11-04T01:43:15.111907+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110469+0000","last_change":"2023-11-04T01:43:15.110469+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110469+0000","last_undegraded":"2023-11-04T01:43:15.110469+0000","last_fullsized":"2023-11-04T01:43:15.110469+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119196+0000","last_change":"2023-11-04T01:43:15.119196+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119196+0000","last_undegraded":"2023-11-04T01:43:15.119196+0000","last_fullsized":"2023-11-04T01:43:15.119196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119331+0000","last_change":"2023-11-04T01:43:15.119331+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119331+0000","last_undegraded":"2023-11-04T01:43:15.119331+0000","last_fullsized":"2023-11-04T01:43:15.119331+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.129288+0000","last_change":"2023-11-04T01:43:15.129288+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.129288+0000","last_undegraded":"2023-11-04T01:43:15.129288+0000","last_fullsized":"2023-11-04T01:43:15.129288+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.132136+0000","last_change":"2023-11-04T01:43:15.132136+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.132136+0000","last_undegraded":"2023-11-04T01:43:15.132136+0000","last_fullsized":"2023-11-04T01:43:15.132136+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116352+0000","last_change":"2023-11-04T01:43:15.116352+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116352+0000","last_undegraded":"2023-11-04T01:43:15.116352+0000","last_fullsized":"2023-11-04T01:43:15.116352+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125071+0000","last_change":"2023-11-04T01:43:15.125071+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125071+0000","last_undegraded":"2023-11-04T01:43:15.125071+0000","last_fullsized":"2023-11-04T01:43:15.125071+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118123+0000","last_change":"2023-11-04T01:43:15.118123+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118123+0000","last_undegraded":"2023-11-04T01:43:15.118123+0000","last_fullsized":"2023-11-04T01:43:15.118123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109148+0000","last_change":"2023-11-04T01:43:15.109148+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109148+0000","last_undegraded":"2023-11-04T01:43:15.109148+0000","last_fullsized":"2023-11-04T01:43:15.109148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122192+0000","last_change":"2023-11-04T01:43:15.122192+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122192+0000","last_undegraded":"2023-11-04T01:43:15.122192+0000","last_fullsized":"2023-11-04T01:43:15.122192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.146557+0000","last_change":"2023-11-04T01:43:15.146557+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.146557+0000","last_undegraded":"2023-11-04T01:43:15.146557+0000","last_fullsized":"2023-11-04T01:43:15.146557+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117462+0000","last_change":"2023-11-04T01:43:15.117462+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117462+0000","last_undegraded":"2023-11-04T01:43:15.117462+0000","last_fullsized":"2023-11-04T01:43:15.117462+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148901+0000","last_change":"2023-11-04T01:43:15.148901+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148901+0000","last_undegraded":"2023-11-04T01:43:15.148901+0000","last_fullsized":"2023-11-04T01:43:15.148901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114154+0000","last_change":"2023-11-04T01:43:15.114154+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114154+0000","last_undegraded":"2023-11-04T01:43:15.114154+0000","last_fullsized":"2023-11-04T01:43:15.114154+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114738+0000","last_change":"2023-11-04T01:43:15.114738+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114738+0000","last_undegraded":"2023-11-04T01:43:15.114738+0000","last_fullsized":"2023-11-04T01:43:15.114738+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113282+0000","last_change":"2023-11-04T01:43:15.113282+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113282+0000","last_undegraded":"2023-11-04T01:43:15.113282+0000","last_fullsized":"2023-11-04T01:43:15.113282+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.138778+0000","last_change":"2023-11-04T01:43:15.138778+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.138778+0000","last_undegraded":"2023-11-04T01:43:15.138778+0000","last_fullsized":"2023-11-04T01:43:15.138778+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.122902+0000","last_change":"2023-11-04T01:43:15.122902+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.122902+0000","last_undegraded":"2023-11-04T01:43:15.122902+0000","last_fullsized":"2023-11-04T01:43:15.122902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.110550+0000","last_change":"2023-11-04T01:43:15.110550+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.110550+0000","last_undegraded":"2023-11-04T01:43:15.110550+0000","last_fullsized":"2023-11-04T01:43:15.110550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123664+0000","last_change":"2023-11-04T01:43:15.123664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123664+0000","last_undegraded":"2023-11-04T01:43:15.123664+0000","last_fullsized":"2023-11-04T01:43:15.123664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126727+0000","last_change":"2023-11-04T01:43:15.126727+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126727+0000","last_undegraded":"2023-11-04T01:43:15.126727+0000","last_fullsized":"2023-11-04T01:43:15.126727+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113823+0000","last_change":"2023-11-04T01:43:15.113823+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113823+0000","last_undegraded":"2023-11-04T01:43:15.113823+0000","last_fullsized":"2023-11-04T01:43:15.113823+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159528+0000","last_change":"2023-11-04T01:43:15.157943+0000","last_active":"2023-11-04T01:43:15.159528+0000","last_peered":"2023-11-04T01:43:15.159528+0000","last_clean":"2023-11-04T01:43:15.159528+0000","last_became_active":"2023-11-04T01:43:15.157543+0000","last_became_peered":"2023-11-04T01:43:15.157543+0000","last_unstale":"2023-11-04T01:43:15.159528+0000","last_undegraded":"2023-11-04T01:43:15.159528+0000","last_fullsized":"2023-11-04T01:43:15.159528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:54.891988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116221+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:43:14.116221+0000","last_peered":"2023-11-04T01:43:14.116221+0000","last_clean":"2023-11-04T01:43:14.116221+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:43:14.116221+0000","last_undegraded":"2023-11-04T01:43:14.116221+0000","last_fullsized":"2023-11-04T01:43:14.116221+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108469+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:43:14.108469+0000","last_peered":"2023-11-04T01:43:14.108469+0000","last_clean":"2023-11-04T01:43:14.108469+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:43:14.108469+0000","last_undegraded":"2023-11-04T01:43:14.108469+0000","last_fullsized":"2023-11-04T01:43:14.108469+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114862+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:43:14.114862+0000","last_peered":"2023-11-04T01:43:14.114862+0000","last_clean":"2023-11-04T01:43:14.114862+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:43:14.114862+0000","last_undegraded":"2023-11-04T01:43:14.114862+0000","last_fullsized":"2023-11-04T01:43:14.114862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111391+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:43:14.111391+0000","last_peered":"2023-11-04T01:43:14.111391+0000","last_clean":"2023-11-04T01:43:14.111391+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:43:14.111391+0000","last_undegraded":"2023-11-04T01:43:14.111391+0000","last_fullsized":"2023-11-04T01:43:14.111391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114458+0000","last_change":"2023-11-04T01:43:15.114458+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114458+0000","last_undegraded":"2023-11-04T01:43:15.114458+0000","last_fullsized":"2023-11-04T01:43:15.114458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137760+0000","last_change":"2023-11-04T01:43:15.134346+0000","last_active":"2023-11-04T01:43:15.137760+0000","last_peered":"2023-11-04T01:43:15.137760+0000","last_clean":"2023-11-04T01:43:15.137760+0000","last_became_active":"2023-11-04T01:43:15.133897+0000","last_became_peered":"2023-11-04T01:43:15.133897+0000","last_unstale":"2023-11-04T01:43:15.137760+0000","last_undegraded":"2023-11-04T01:43:15.137760+0000","last_fullsized":"2023-11-04T01:43:15.137760+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:29.175532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107341+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:43:14.107341+0000","last_peered":"2023-11-04T01:43:14.107341+0000","last_clean":"2023-11-04T01:43:14.107341+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:43:14.107341+0000","last_undegraded":"2023-11-04T01:43:14.107341+0000","last_fullsized":"2023-11-04T01:43:14.107341+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117178+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:43:14.117178+0000","last_peered":"2023-11-04T01:43:14.117178+0000","last_clean":"2023-11-04T01:43:14.117178+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:43:14.117178+0000","last_undegraded":"2023-11-04T01:43:14.117178+0000","last_fullsized":"2023-11-04T01:43:14.117178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111700+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:43:14.111700+0000","last_peered":"2023-11-04T01:43:14.111700+0000","last_clean":"2023-11-04T01:43:14.111700+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:43:14.111700+0000","last_undegraded":"2023-11-04T01:43:14.111700+0000","last_fullsized":"2023-11-04T01:43:14.111700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114664+0000","last_change":"2023-11-04T01:43:15.114664+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114664+0000","last_undegraded":"2023-11-04T01:43:15.114664+0000","last_fullsized":"2023-11-04T01:43:15.114664+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.159555+0000","last_change":"2023-11-04T01:43:15.158367+0000","last_active":"2023-11-04T01:43:15.159555+0000","last_peered":"2023-11-04T01:43:15.159555+0000","last_clean":"2023-11-04T01:43:15.159555+0000","last_became_active":"2023-11-04T01:43:15.157718+0000","last_became_peered":"2023-11-04T01:43:15.157718+0000","last_unstale":"2023-11-04T01:43:15.159555+0000","last_undegraded":"2023-11-04T01:43:15.159555+0000","last_fullsized":"2023-11-04T01:43:15.159555+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:03.434277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099606+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:43:14.099606+0000","last_peered":"2023-11-04T01:43:14.099606+0000","last_clean":"2023-11-04T01:43:14.099606+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:43:14.099606+0000","last_undegraded":"2023-11-04T01:43:14.099606+0000","last_fullsized":"2023-11-04T01:43:14.099606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109161+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:43:14.109161+0000","last_peered":"2023-11-04T01:43:14.109161+0000","last_clean":"2023-11-04T01:43:14.109161+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:43:14.109161+0000","last_undegraded":"2023-11-04T01:43:14.109161+0000","last_fullsized":"2023-11-04T01:43:14.109161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116648+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:43:14.116648+0000","last_peered":"2023-11-04T01:43:14.116648+0000","last_clean":"2023-11-04T01:43:14.116648+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:43:14.116648+0000","last_undegraded":"2023-11-04T01:43:14.116648+0000","last_fullsized":"2023-11-04T01:43:14.116648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116181+0000","last_change":"2023-11-04T01:43:15.116181+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116181+0000","last_undegraded":"2023-11-04T01:43:15.116181+0000","last_fullsized":"2023-11-04T01:43:15.116181+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168810+0000","last_change":"2023-11-04T01:43:15.162827+0000","last_active":"2023-11-04T01:43:15.168810+0000","last_peered":"2023-11-04T01:43:15.168810+0000","last_clean":"2023-11-04T01:43:15.168810+0000","last_became_active":"2023-11-04T01:43:15.162272+0000","last_became_peered":"2023-11-04T01:43:15.162272+0000","last_unstale":"2023-11-04T01:43:15.168810+0000","last_undegraded":"2023-11-04T01:43:15.168810+0000","last_fullsized":"2023-11-04T01:43:15.168810+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:40:39.577222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100017+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:43:14.100017+0000","last_peered":"2023-11-04T01:43:14.100017+0000","last_clean":"2023-11-04T01:43:14.100017+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:43:14.100017+0000","last_undegraded":"2023-11-04T01:43:14.100017+0000","last_fullsized":"2023-11-04T01:43:14.100017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100057+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:43:14.100057+0000","last_peered":"2023-11-04T01:43:14.100057+0000","last_clean":"2023-11-04T01:43:14.100057+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:43:14.100057+0000","last_undegraded":"2023-11-04T01:43:14.100057+0000","last_fullsized":"2023-11-04T01:43:14.100057+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.105693+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:43:15.105693+0000","last_peered":"2023-11-04T01:43:15.105693+0000","last_clean":"2023-11-04T01:43:15.105693+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:43:15.105693+0000","last_undegraded":"2023-11-04T01:43:15.105693+0000","last_fullsized":"2023-11-04T01:43:15.105693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116753+0000","last_change":"2023-11-04T01:43:15.116753+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116753+0000","last_undegraded":"2023-11-04T01:43:15.116753+0000","last_fullsized":"2023-11-04T01:43:15.116753+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.151563+0000","last_change":"2023-11-04T01:43:15.146655+0000","last_active":"2023-11-04T01:43:15.151563+0000","last_peered":"2023-11-04T01:43:15.151563+0000","last_clean":"2023-11-04T01:43:15.151563+0000","last_became_active":"2023-11-04T01:43:15.145780+0000","last_became_peered":"2023-11-04T01:43:15.145780+0000","last_unstale":"2023-11-04T01:43:15.151563+0000","last_undegraded":"2023-11-04T01:43:15.151563+0000","last_fullsized":"2023-11-04T01:43:15.151563+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:02.611764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107489+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:43:14.107489+0000","last_peered":"2023-11-04T01:43:14.107489+0000","last_clean":"2023-11-04T01:43:14.107489+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:43:14.107489+0000","last_undegraded":"2023-11-04T01:43:14.107489+0000","last_fullsized":"2023-11-04T01:43:14.107489+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113762+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:43:14.113762+0000","last_peered":"2023-11-04T01:43:14.113762+0000","last_clean":"2023-11-04T01:43:14.113762+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:43:14.113762+0000","last_undegraded":"2023-11-04T01:43:14.113762+0000","last_fullsized":"2023-11-04T01:43:14.113762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111706+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:43:14.111706+0000","last_peered":"2023-11-04T01:43:14.111706+0000","last_clean":"2023-11-04T01:43:14.111706+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:43:14.111706+0000","last_undegraded":"2023-11-04T01:43:14.111706+0000","last_fullsized":"2023-11-04T01:43:14.111706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.125629+0000","last_change":"2023-11-04T01:43:15.125629+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.125629+0000","last_undegraded":"2023-11-04T01:43:15.125629+0000","last_fullsized":"2023-11-04T01:43:15.125629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.165914+0000","last_change":"2023-11-04T01:43:15.148592+0000","last_active":"2023-11-04T01:43:15.165914+0000","last_peered":"2023-11-04T01:43:15.165914+0000","last_clean":"2023-11-04T01:43:15.165914+0000","last_became_active":"2023-11-04T01:43:15.147892+0000","last_became_peered":"2023-11-04T01:43:15.147892+0000","last_unstale":"2023-11-04T01:43:15.165914+0000","last_undegraded":"2023-11-04T01:43:15.165914+0000","last_fullsized":"2023-11-04T01:43:15.165914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:55.779518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112657+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:43:14.112657+0000","last_peered":"2023-11-04T01:43:14.112657+0000","last_clean":"2023-11-04T01:43:14.112657+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:43:14.112657+0000","last_undegraded":"2023-11-04T01:43:14.112657+0000","last_fullsized":"2023-11-04T01:43:14.112657+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108116+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:43:14.108116+0000","last_peered":"2023-11-04T01:43:14.108116+0000","last_clean":"2023-11-04T01:43:14.108116+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:43:14.108116+0000","last_undegraded":"2023-11-04T01:43:14.108116+0000","last_fullsized":"2023-11-04T01:43:14.108116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108640+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:43:14.108640+0000","last_peered":"2023-11-04T01:43:14.108640+0000","last_clean":"2023-11-04T01:43:14.108640+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:43:14.108640+0000","last_undegraded":"2023-11-04T01:43:14.108640+0000","last_fullsized":"2023-11-04T01:43:14.108640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123961+0000","last_change":"2023-11-04T01:43:15.123961+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123961+0000","last_undegraded":"2023-11-04T01:43:15.123961+0000","last_fullsized":"2023-11-04T01:43:15.123961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.150022+0000","last_change":"2023-11-04T01:43:15.146312+0000","last_active":"2023-11-04T01:43:15.150022+0000","last_peered":"2023-11-04T01:43:15.150022+0000","last_clean":"2023-11-04T01:43:15.150022+0000","last_became_active":"2023-11-04T01:43:15.145470+0000","last_became_peered":"2023-11-04T01:43:15.145470+0000","last_unstale":"2023-11-04T01:43:15.150022+0000","last_undegraded":"2023-11-04T01:43:15.150022+0000","last_fullsized":"2023-11-04T01:43:15.150022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:06.918241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112960+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:43:14.112960+0000","last_peered":"2023-11-04T01:43:14.112960+0000","last_clean":"2023-11-04T01:43:14.112960+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:43:14.112960+0000","last_undegraded":"2023-11-04T01:43:14.112960+0000","last_fullsized":"2023-11-04T01:43:14.112960+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107704+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:43:14.107704+0000","last_peered":"2023-11-04T01:43:14.107704+0000","last_clean":"2023-11-04T01:43:14.107704+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:43:14.107704+0000","last_undegraded":"2023-11-04T01:43:14.107704+0000","last_fullsized":"2023-11-04T01:43:14.107704+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113790+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:43:14.113790+0000","last_peered":"2023-11-04T01:43:14.113790+0000","last_clean":"2023-11-04T01:43:14.113790+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:43:14.113790+0000","last_undegraded":"2023-11-04T01:43:14.113790+0000","last_fullsized":"2023-11-04T01:43:14.113790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.148519+0000","last_change":"2023-11-04T01:43:15.148519+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.148519+0000","last_undegraded":"2023-11-04T01:43:15.148519+0000","last_fullsized":"2023-11-04T01:43:15.148519+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168590+0000","last_change":"2023-11-04T01:43:15.164771+0000","last_active":"2023-11-04T01:43:15.168590+0000","last_peered":"2023-11-04T01:43:15.168590+0000","last_clean":"2023-11-04T01:43:15.168590+0000","last_became_active":"2023-11-04T01:43:15.164172+0000","last_became_peered":"2023-11-04T01:43:15.164172+0000","last_unstale":"2023-11-04T01:43:15.168590+0000","last_undegraded":"2023-11-04T01:43:15.168590+0000","last_fullsized":"2023-11-04T01:43:15.168590+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:50.337311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.120061+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:43:14.120061+0000","last_peered":"2023-11-04T01:43:14.120061+0000","last_clean":"2023-11-04T01:43:14.120061+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:43:14.120061+0000","last_undegraded":"2023-11-04T01:43:14.120061+0000","last_fullsized":"2023-11-04T01:43:14.120061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107402+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:43:14.107402+0000","last_peered":"2023-11-04T01:43:14.107402+0000","last_clean":"2023-11-04T01:43:14.107402+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:43:14.107402+0000","last_undegraded":"2023-11-04T01:43:14.107402+0000","last_fullsized":"2023-11-04T01:43:14.107402+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116779+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:43:14.116779+0000","last_peered":"2023-11-04T01:43:14.116779+0000","last_clean":"2023-11-04T01:43:14.116779+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:43:14.116779+0000","last_undegraded":"2023-11-04T01:43:14.116779+0000","last_fullsized":"2023-11-04T01:43:14.116779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.119517+0000","last_change":"2023-11-04T01:43:15.119517+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.119517+0000","last_undegraded":"2023-11-04T01:43:15.119517+0000","last_fullsized":"2023-11-04T01:43:15.119517+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166008+0000","last_change":"2023-11-04T01:43:15.162799+0000","last_active":"2023-11-04T01:43:15.166008+0000","last_peered":"2023-11-04T01:43:15.166008+0000","last_clean":"2023-11-04T01:43:15.166008+0000","last_became_active":"2023-11-04T01:43:15.162068+0000","last_became_peered":"2023-11-04T01:43:15.162068+0000","last_unstale":"2023-11-04T01:43:15.166008+0000","last_undegraded":"2023-11-04T01:43:15.166008+0000","last_fullsized":"2023-11-04T01:43:15.166008+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108667+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:43:14.108667+0000","last_peered":"2023-11-04T01:43:14.108667+0000","last_clean":"2023-11-04T01:43:14.108667+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:43:14.108667+0000","last_undegraded":"2023-11-04T01:43:14.108667+0000","last_fullsized":"2023-11-04T01:43:14.108667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111179+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:43:14.111179+0000","last_peered":"2023-11-04T01:43:14.111179+0000","last_clean":"2023-11-04T01:43:14.111179+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:43:14.111179+0000","last_undegraded":"2023-11-04T01:43:14.111179+0000","last_fullsized":"2023-11-04T01:43:14.111179+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108691+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:43:14.108691+0000","last_peered":"2023-11-04T01:43:14.108691+0000","last_clean":"2023-11-04T01:43:14.108691+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:43:14.108691+0000","last_undegraded":"2023-11-04T01:43:14.108691+0000","last_fullsized":"2023-11-04T01:43:14.108691+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.121012+0000","last_change":"2023-11-04T01:43:15.121012+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.121012+0000","last_undegraded":"2023-11-04T01:43:15.121012+0000","last_fullsized":"2023-11-04T01:43:15.121012+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.137807+0000","last_change":"2023-11-04T01:43:15.132590+0000","last_active":"2023-11-04T01:43:15.137807+0000","last_peered":"2023-11-04T01:43:15.137807+0000","last_clean":"2023-11-04T01:43:15.137807+0000","last_became_active":"2023-11-04T01:43:15.132101+0000","last_became_peered":"2023-11-04T01:43:15.132101+0000","last_unstale":"2023-11-04T01:43:15.137807+0000","last_undegraded":"2023-11-04T01:43:15.137807+0000","last_fullsized":"2023-11-04T01:43:15.137807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:14.252075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117896+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:43:14.117896+0000","last_peered":"2023-11-04T01:43:14.117896+0000","last_clean":"2023-11-04T01:43:14.117896+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:43:14.117896+0000","last_undegraded":"2023-11-04T01:43:14.117896+0000","last_fullsized":"2023-11-04T01:43:14.117896+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113028+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:43:14.113028+0000","last_peered":"2023-11-04T01:43:14.113028+0000","last_clean":"2023-11-04T01:43:14.113028+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:43:14.113028+0000","last_undegraded":"2023-11-04T01:43:14.113028+0000","last_fullsized":"2023-11-04T01:43:14.113028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108235+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:43:14.108235+0000","last_peered":"2023-11-04T01:43:14.108235+0000","last_clean":"2023-11-04T01:43:14.108235+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:43:14.108235+0000","last_undegraded":"2023-11-04T01:43:14.108235+0000","last_fullsized":"2023-11-04T01:43:14.108235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.131096+0000","last_change":"2023-11-04T01:43:15.131096+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.131096+0000","last_undegraded":"2023-11-04T01:43:15.131096+0000","last_fullsized":"2023-11-04T01:43:15.131096+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168718+0000","last_change":"2023-11-04T01:43:15.161698+0000","last_active":"2023-11-04T01:43:15.168718+0000","last_peered":"2023-11-04T01:43:15.168718+0000","last_clean":"2023-11-04T01:43:15.168718+0000","last_became_active":"2023-11-04T01:43:15.161055+0000","last_became_peered":"2023-11-04T01:43:15.161055+0000","last_unstale":"2023-11-04T01:43:15.168718+0000","last_undegraded":"2023-11-04T01:43:15.168718+0000","last_fullsized":"2023-11-04T01:43:15.168718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:30.109736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109650+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:43:14.109650+0000","last_peered":"2023-11-04T01:43:14.109650+0000","last_clean":"2023-11-04T01:43:14.109650+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:43:14.109650+0000","last_undegraded":"2023-11-04T01:43:14.109650+0000","last_fullsized":"2023-11-04T01:43:14.109650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116385+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:43:14.116385+0000","last_peered":"2023-11-04T01:43:14.116385+0000","last_clean":"2023-11-04T01:43:14.116385+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:43:14.116385+0000","last_undegraded":"2023-11-04T01:43:14.116385+0000","last_fullsized":"2023-11-04T01:43:14.116385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114820+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:43:14.114820+0000","last_peered":"2023-11-04T01:43:14.114820+0000","last_clean":"2023-11-04T01:43:14.114820+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:43:14.114820+0000","last_undegraded":"2023-11-04T01:43:14.114820+0000","last_fullsized":"2023-11-04T01:43:14.114820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.112748+0000","last_change":"2023-11-04T01:43:15.112748+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.112748+0000","last_undegraded":"2023-11-04T01:43:15.112748+0000","last_fullsized":"2023-11-04T01:43:15.112748+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138676+0000","last_change":"2023-11-04T01:43:15.133081+0000","last_active":"2023-11-04T01:43:15.138676+0000","last_peered":"2023-11-04T01:43:15.138676+0000","last_clean":"2023-11-04T01:43:15.138676+0000","last_became_active":"2023-11-04T01:43:15.132291+0000","last_became_peered":"2023-11-04T01:43:15.132291+0000","last_unstale":"2023-11-04T01:43:15.138676+0000","last_undegraded":"2023-11-04T01:43:15.138676+0000","last_fullsized":"2023-11-04T01:43:15.138676+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:49.142953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112522+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:43:14.112522+0000","last_peered":"2023-11-04T01:43:14.112522+0000","last_clean":"2023-11-04T01:43:14.112522+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:43:14.112522+0000","last_undegraded":"2023-11-04T01:43:14.112522+0000","last_fullsized":"2023-11-04T01:43:14.112522+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115564+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:43:14.115564+0000","last_peered":"2023-11-04T01:43:14.115564+0000","last_clean":"2023-11-04T01:43:14.115564+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:43:14.115564+0000","last_undegraded":"2023-11-04T01:43:14.115564+0000","last_fullsized":"2023-11-04T01:43:14.115564+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111422+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:43:14.111422+0000","last_peered":"2023-11-04T01:43:14.111422+0000","last_clean":"2023-11-04T01:43:14.111422+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:43:14.111422+0000","last_undegraded":"2023-11-04T01:43:14.111422+0000","last_fullsized":"2023-11-04T01:43:14.111422+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.115396+0000","last_change":"2023-11-04T01:43:15.115396+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.115396+0000","last_undegraded":"2023-11-04T01:43:15.115396+0000","last_fullsized":"2023-11-04T01:43:15.115396+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158653+0000","last_change":"2023-11-04T01:43:15.153802+0000","last_active":"2023-11-04T01:43:15.158653+0000","last_peered":"2023-11-04T01:43:15.158653+0000","last_clean":"2023-11-04T01:43:15.158653+0000","last_became_active":"2023-11-04T01:43:15.153029+0000","last_became_peered":"2023-11-04T01:43:15.153029+0000","last_unstale":"2023-11-04T01:43:15.158653+0000","last_undegraded":"2023-11-04T01:43:15.158653+0000","last_fullsized":"2023-11-04T01:43:15.158653+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118424+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:43:14.118424+0000","last_peered":"2023-11-04T01:43:14.118424+0000","last_clean":"2023-11-04T01:43:14.118424+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:43:14.118424+0000","last_undegraded":"2023-11-04T01:43:14.118424+0000","last_fullsized":"2023-11-04T01:43:14.118424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118204+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:43:14.118204+0000","last_peered":"2023-11-04T01:43:14.118204+0000","last_clean":"2023-11-04T01:43:14.118204+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:43:14.118204+0000","last_undegraded":"2023-11-04T01:43:14.118204+0000","last_fullsized":"2023-11-04T01:43:14.118204+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109890+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:43:14.109890+0000","last_peered":"2023-11-04T01:43:14.109890+0000","last_clean":"2023-11-04T01:43:14.109890+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:43:14.109890+0000","last_undegraded":"2023-11-04T01:43:14.109890+0000","last_fullsized":"2023-11-04T01:43:14.109890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109995+0000","last_change":"2023-11-04T01:43:15.109995+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109995+0000","last_undegraded":"2023-11-04T01:43:15.109995+0000","last_fullsized":"2023-11-04T01:43:15.109995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142716+0000","last_change":"2023-11-04T01:43:15.134863+0000","last_active":"2023-11-04T01:43:15.142716+0000","last_peered":"2023-11-04T01:43:15.142716+0000","last_clean":"2023-11-04T01:43:15.142716+0000","last_became_active":"2023-11-04T01:43:15.134171+0000","last_became_peered":"2023-11-04T01:43:15.134171+0000","last_unstale":"2023-11-04T01:43:15.142716+0000","last_undegraded":"2023-11-04T01:43:15.142716+0000","last_fullsized":"2023-11-04T01:43:15.142716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:18.996637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119278+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:43:14.119278+0000","last_peered":"2023-11-04T01:43:14.119278+0000","last_clean":"2023-11-04T01:43:14.119278+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:43:14.119278+0000","last_undegraded":"2023-11-04T01:43:14.119278+0000","last_fullsized":"2023-11-04T01:43:14.119278+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100321+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:43:14.100321+0000","last_peered":"2023-11-04T01:43:14.100321+0000","last_clean":"2023-11-04T01:43:14.100321+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:43:14.100321+0000","last_undegraded":"2023-11-04T01:43:14.100321+0000","last_fullsized":"2023-11-04T01:43:14.100321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.126384+0000","last_change":"2023-11-04T01:43:15.126384+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.126384+0000","last_undegraded":"2023-11-04T01:43:15.126384+0000","last_fullsized":"2023-11-04T01:43:15.126384+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168735+0000","last_change":"2023-11-04T01:43:15.162032+0000","last_active":"2023-11-04T01:43:15.168735+0000","last_peered":"2023-11-04T01:43:15.168735+0000","last_clean":"2023-11-04T01:43:15.168735+0000","last_became_active":"2023-11-04T01:43:15.161515+0000","last_became_peered":"2023-11-04T01:43:15.161515+0000","last_unstale":"2023-11-04T01:43:15.168735+0000","last_undegraded":"2023-11-04T01:43:15.168735+0000","last_fullsized":"2023-11-04T01:43:15.168735+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:41:41.610070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114393+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:43:14.114393+0000","last_peered":"2023-11-04T01:43:14.114393+0000","last_clean":"2023-11-04T01:43:14.114393+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:43:14.114393+0000","last_undegraded":"2023-11-04T01:43:14.114393+0000","last_fullsized":"2023-11-04T01:43:14.114393+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118113+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:43:14.118113+0000","last_peered":"2023-11-04T01:43:14.118113+0000","last_clean":"2023-11-04T01:43:14.118113+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:43:14.118113+0000","last_undegraded":"2023-11-04T01:43:14.118113+0000","last_fullsized":"2023-11-04T01:43:14.118113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108402+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:43:14.108402+0000","last_peered":"2023-11-04T01:43:14.108402+0000","last_clean":"2023-11-04T01:43:14.108402+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:43:14.108402+0000","last_undegraded":"2023-11-04T01:43:14.108402+0000","last_fullsized":"2023-11-04T01:43:14.108402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109597+0000","last_change":"2023-11-04T01:43:15.109597+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109597+0000","last_undegraded":"2023-11-04T01:43:15.109597+0000","last_fullsized":"2023-11-04T01:43:15.109597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.164067+0000","last_change":"2023-11-04T01:43:15.163139+0000","last_active":"2023-11-04T01:43:15.164067+0000","last_peered":"2023-11-04T01:43:15.164067+0000","last_clean":"2023-11-04T01:43:15.164067+0000","last_became_active":"2023-11-04T01:43:15.162805+0000","last_became_peered":"2023-11-04T01:43:15.162805+0000","last_unstale":"2023-11-04T01:43:15.164067+0000","last_undegraded":"2023-11-04T01:43:15.164067+0000","last_fullsized":"2023-11-04T01:43:15.164067+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114608+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:43:14.114608+0000","last_peered":"2023-11-04T01:43:14.114608+0000","last_clean":"2023-11-04T01:43:14.114608+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:43:14.114608+0000","last_undegraded":"2023-11-04T01:43:14.114608+0000","last_fullsized":"2023-11-04T01:43:14.114608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111316+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:43:14.111316+0000","last_peered":"2023-11-04T01:43:14.111316+0000","last_clean":"2023-11-04T01:43:14.111316+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:43:14.111316+0000","last_undegraded":"2023-11-04T01:43:14.111316+0000","last_fullsized":"2023-11-04T01:43:14.111316+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110722+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:43:14.110722+0000","last_peered":"2023-11-04T01:43:14.110722+0000","last_clean":"2023-11-04T01:43:14.110722+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:43:14.110722+0000","last_undegraded":"2023-11-04T01:43:14.110722+0000","last_fullsized":"2023-11-04T01:43:14.110722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.116197+0000","last_change":"2023-11-04T01:43:15.116197+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.116197+0000","last_undegraded":"2023-11-04T01:43:15.116197+0000","last_fullsized":"2023-11-04T01:43:15.116197+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.166093+0000","last_change":"2023-11-04T01:43:15.162310+0000","last_active":"2023-11-04T01:43:15.166093+0000","last_peered":"2023-11-04T01:43:15.166093+0000","last_clean":"2023-11-04T01:43:15.166093+0000","last_became_active":"2023-11-04T01:43:15.161776+0000","last_became_peered":"2023-11-04T01:43:15.161776+0000","last_unstale":"2023-11-04T01:43:15.166093+0000","last_undegraded":"2023-11-04T01:43:15.166093+0000","last_fullsized":"2023-11-04T01:43:15.166093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:38:34.954746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111021+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:43:14.111021+0000","last_peered":"2023-11-04T01:43:14.111021+0000","last_clean":"2023-11-04T01:43:14.111021+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:43:14.111021+0000","last_undegraded":"2023-11-04T01:43:14.111021+0000","last_fullsized":"2023-11-04T01:43:14.111021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.100192+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:43:14.100192+0000","last_peered":"2023-11-04T01:43:14.100192+0000","last_clean":"2023-11-04T01:43:14.100192+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:43:14.100192+0000","last_undegraded":"2023-11-04T01:43:14.100192+0000","last_fullsized":"2023-11-04T01:43:14.100192+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115598+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:43:14.115598+0000","last_peered":"2023-11-04T01:43:14.115598+0000","last_clean":"2023-11-04T01:43:14.115598+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:43:14.115598+0000","last_undegraded":"2023-11-04T01:43:14.115598+0000","last_fullsized":"2023-11-04T01:43:14.115598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113922+0000","last_change":"2023-11-04T01:43:15.113922+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113922+0000","last_undegraded":"2023-11-04T01:43:15.113922+0000","last_fullsized":"2023-11-04T01:43:15.113922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.142152+0000","last_change":"2023-11-04T01:43:15.128193+0000","last_active":"2023-11-04T01:43:15.142152+0000","last_peered":"2023-11-04T01:43:15.142152+0000","last_clean":"2023-11-04T01:43:15.142152+0000","last_became_active":"2023-11-04T01:43:15.127462+0000","last_became_peered":"2023-11-04T01:43:15.127462+0000","last_unstale":"2023-11-04T01:43:15.142152+0000","last_undegraded":"2023-11-04T01:43:15.142152+0000","last_fullsized":"2023-11-04T01:43:15.142152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111119+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:43:14.111119+0000","last_peered":"2023-11-04T01:43:14.111119+0000","last_clean":"2023-11-04T01:43:14.111119+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:43:14.111119+0000","last_undegraded":"2023-11-04T01:43:14.111119+0000","last_fullsized":"2023-11-04T01:43:14.111119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116285+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:43:14.116285+0000","last_peered":"2023-11-04T01:43:14.116285+0000","last_clean":"2023-11-04T01:43:14.116285+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:43:14.116285+0000","last_undegraded":"2023-11-04T01:43:14.116285+0000","last_fullsized":"2023-11-04T01:43:14.116285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108139+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:43:14.108139+0000","last_peered":"2023-11-04T01:43:14.108139+0000","last_clean":"2023-11-04T01:43:14.108139+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:43:14.108139+0000","last_undegraded":"2023-11-04T01:43:14.108139+0000","last_fullsized":"2023-11-04T01:43:14.108139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.123886+0000","last_change":"2023-11-04T01:43:15.123886+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.123886+0000","last_undegraded":"2023-11-04T01:43:15.123886+0000","last_fullsized":"2023-11-04T01:43:15.123886+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154872+0000","last_change":"2023-11-04T01:43:15.150032+0000","last_active":"2023-11-04T01:43:15.154872+0000","last_peered":"2023-11-04T01:43:15.154872+0000","last_clean":"2023-11-04T01:43:15.154872+0000","last_became_active":"2023-11-04T01:43:15.149310+0000","last_became_peered":"2023-11-04T01:43:15.149310+0000","last_unstale":"2023-11-04T01:43:15.154872+0000","last_undegraded":"2023-11-04T01:43:15.154872+0000","last_fullsized":"2023-11-04T01:43:15.154872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109441+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:43:14.109441+0000","last_peered":"2023-11-04T01:43:14.109441+0000","last_clean":"2023-11-04T01:43:14.109441+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:43:14.109441+0000","last_undegraded":"2023-11-04T01:43:14.109441+0000","last_fullsized":"2023-11-04T01:43:14.109441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116067+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:43:14.116067+0000","last_peered":"2023-11-04T01:43:14.116067+0000","last_clean":"2023-11-04T01:43:14.116067+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:43:14.116067+0000","last_undegraded":"2023-11-04T01:43:14.116067+0000","last_fullsized":"2023-11-04T01:43:14.116067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111682+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:43:14.111682+0000","last_peered":"2023-11-04T01:43:14.111682+0000","last_clean":"2023-11-04T01:43:14.111682+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:43:14.111682+0000","last_undegraded":"2023-11-04T01:43:14.111682+0000","last_fullsized":"2023-11-04T01:43:14.111682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117930+0000","last_change":"2023-11-04T01:43:15.117930+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117930+0000","last_undegraded":"2023-11-04T01:43:15.117930+0000","last_fullsized":"2023-11-04T01:43:15.117930+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.155517+0000","last_change":"2023-11-04T01:43:15.131252+0000","last_active":"2023-11-04T01:43:15.155517+0000","last_peered":"2023-11-04T01:43:15.155517+0000","last_clean":"2023-11-04T01:43:15.155517+0000","last_became_active":"2023-11-04T01:43:15.130633+0000","last_became_peered":"2023-11-04T01:43:15.130633+0000","last_unstale":"2023-11-04T01:43:15.155517+0000","last_undegraded":"2023-11-04T01:43:15.155517+0000","last_fullsized":"2023-11-04T01:43:15.155517+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:11.208100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109235+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:43:14.109235+0000","last_peered":"2023-11-04T01:43:14.109235+0000","last_clean":"2023-11-04T01:43:14.109235+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:43:14.109235+0000","last_undegraded":"2023-11-04T01:43:14.109235+0000","last_fullsized":"2023-11-04T01:43:14.109235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118717+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:43:14.118717+0000","last_peered":"2023-11-04T01:43:14.118717+0000","last_clean":"2023-11-04T01:43:14.118717+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:43:14.118717+0000","last_undegraded":"2023-11-04T01:43:14.118717+0000","last_fullsized":"2023-11-04T01:43:14.118717+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107822+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:43:14.107822+0000","last_peered":"2023-11-04T01:43:14.107822+0000","last_clean":"2023-11-04T01:43:14.107822+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:43:14.107822+0000","last_undegraded":"2023-11-04T01:43:14.107822+0000","last_fullsized":"2023-11-04T01:43:14.107822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113784+0000","last_change":"2023-11-04T01:43:15.113784+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113784+0000","last_undegraded":"2023-11-04T01:43:15.113784+0000","last_fullsized":"2023-11-04T01:43:15.113784+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.163000+0000","last_change":"2023-11-04T01:43:15.161411+0000","last_active":"2023-11-04T01:43:15.163000+0000","last_peered":"2023-11-04T01:43:15.163000+0000","last_clean":"2023-11-04T01:43:15.163000+0000","last_became_active":"2023-11-04T01:43:15.160976+0000","last_became_peered":"2023-11-04T01:43:15.160976+0000","last_unstale":"2023-11-04T01:43:15.163000+0000","last_undegraded":"2023-11-04T01:43:15.163000+0000","last_fullsized":"2023-11-04T01:43:15.163000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:37.815400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112546+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:43:14.112546+0000","last_peered":"2023-11-04T01:43:14.112546+0000","last_clean":"2023-11-04T01:43:14.112546+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:43:14.112546+0000","last_undegraded":"2023-11-04T01:43:14.112546+0000","last_fullsized":"2023-11-04T01:43:14.112546+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109027+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:43:14.109027+0000","last_peered":"2023-11-04T01:43:14.109027+0000","last_clean":"2023-11-04T01:43:14.109027+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:43:14.109027+0000","last_undegraded":"2023-11-04T01:43:14.109027+0000","last_fullsized":"2023-11-04T01:43:14.109027+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113105+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:43:14.113105+0000","last_peered":"2023-11-04T01:43:14.113105+0000","last_clean":"2023-11-04T01:43:14.113105+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:43:14.113105+0000","last_undegraded":"2023-11-04T01:43:14.113105+0000","last_fullsized":"2023-11-04T01:43:14.113105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.117691+0000","last_change":"2023-11-04T01:43:15.117691+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.117691+0000","last_undegraded":"2023-11-04T01:43:15.117691+0000","last_fullsized":"2023-11-04T01:43:15.117691+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154249+0000","last_change":"2023-11-04T01:43:15.149053+0000","last_active":"2023-11-04T01:43:15.154249+0000","last_peered":"2023-11-04T01:43:15.154249+0000","last_clean":"2023-11-04T01:43:15.154249+0000","last_became_active":"2023-11-04T01:43:15.148336+0000","last_became_peered":"2023-11-04T01:43:15.148336+0000","last_unstale":"2023-11-04T01:43:15.154249+0000","last_undegraded":"2023-11-04T01:43:15.154249+0000","last_fullsized":"2023-11-04T01:43:15.154249+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:00.891242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.112892+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:43:14.112892+0000","last_peered":"2023-11-04T01:43:14.112892+0000","last_clean":"2023-11-04T01:43:14.112892+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:43:14.112892+0000","last_undegraded":"2023-11-04T01:43:14.112892+0000","last_fullsized":"2023-11-04T01:43:14.112892+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108367+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:43:14.108367+0000","last_peered":"2023-11-04T01:43:14.108367+0000","last_clean":"2023-11-04T01:43:14.108367+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:43:14.108367+0000","last_undegraded":"2023-11-04T01:43:14.108367+0000","last_fullsized":"2023-11-04T01:43:14.108367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110382+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:43:14.110382+0000","last_peered":"2023-11-04T01:43:14.110382+0000","last_clean":"2023-11-04T01:43:14.110382+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:43:14.110382+0000","last_undegraded":"2023-11-04T01:43:14.110382+0000","last_fullsized":"2023-11-04T01:43:14.110382+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109220+0000","last_change":"2023-11-04T01:43:15.109220+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109220+0000","last_undegraded":"2023-11-04T01:43:15.109220+0000","last_fullsized":"2023-11-04T01:43:15.109220+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.152844+0000","last_change":"2023-11-04T01:43:15.143691+0000","last_active":"2023-11-04T01:43:15.152844+0000","last_peered":"2023-11-04T01:43:15.152844+0000","last_clean":"2023-11-04T01:43:15.152844+0000","last_became_active":"2023-11-04T01:43:15.142954+0000","last_became_peered":"2023-11-04T01:43:15.142954+0000","last_unstale":"2023-11-04T01:43:15.152844+0000","last_undegraded":"2023-11-04T01:43:15.152844+0000","last_fullsized":"2023-11-04T01:43:15.152844+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:22.716295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108953+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:43:14.108953+0000","last_peered":"2023-11-04T01:43:14.108953+0000","last_clean":"2023-11-04T01:43:14.108953+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:43:14.108953+0000","last_undegraded":"2023-11-04T01:43:14.108953+0000","last_fullsized":"2023-11-04T01:43:14.108953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111231+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:43:14.111231+0000","last_peered":"2023-11-04T01:43:14.111231+0000","last_clean":"2023-11-04T01:43:14.111231+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:43:14.111231+0000","last_undegraded":"2023-11-04T01:43:14.111231+0000","last_fullsized":"2023-11-04T01:43:14.111231+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099874+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:43:14.099874+0000","last_peered":"2023-11-04T01:43:14.099874+0000","last_clean":"2023-11-04T01:43:14.099874+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:43:14.099874+0000","last_undegraded":"2023-11-04T01:43:14.099874+0000","last_fullsized":"2023-11-04T01:43:14.099874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.113065+0000","last_change":"2023-11-04T01:43:15.113065+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.113065+0000","last_undegraded":"2023-11-04T01:43:15.113065+0000","last_fullsized":"2023-11-04T01:43:15.113065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.156331+0000","last_change":"2023-11-04T01:43:15.152965+0000","last_active":"2023-11-04T01:43:15.156331+0000","last_peered":"2023-11-04T01:43:15.156331+0000","last_clean":"2023-11-04T01:43:15.156331+0000","last_became_active":"2023-11-04T01:43:15.152534+0000","last_became_peered":"2023-11-04T01:43:15.152534+0000","last_unstale":"2023-11-04T01:43:15.156331+0000","last_undegraded":"2023-11-04T01:43:15.156331+0000","last_fullsized":"2023-11-04T01:43:15.156331+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:10:49.130286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119750+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:43:14.119750+0000","last_peered":"2023-11-04T01:43:14.119750+0000","last_clean":"2023-11-04T01:43:14.119750+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:43:14.119750+0000","last_undegraded":"2023-11-04T01:43:14.119750+0000","last_fullsized":"2023-11-04T01:43:14.119750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099498+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:43:14.099498+0000","last_peered":"2023-11-04T01:43:14.099498+0000","last_clean":"2023-11-04T01:43:14.099498+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:43:14.099498+0000","last_undegraded":"2023-11-04T01:43:14.099498+0000","last_fullsized":"2023-11-04T01:43:14.099498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116611+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:43:14.116611+0000","last_peered":"2023-11-04T01:43:14.116611+0000","last_clean":"2023-11-04T01:43:14.116611+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:43:14.116611+0000","last_undegraded":"2023-11-04T01:43:14.116611+0000","last_fullsized":"2023-11-04T01:43:14.116611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.109576+0000","last_change":"2023-11-04T01:43:15.109576+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.109576+0000","last_undegraded":"2023-11-04T01:43:15.109576+0000","last_fullsized":"2023-11-04T01:43:15.109576+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.158609+0000","last_change":"2023-11-04T01:43:15.153656+0000","last_active":"2023-11-04T01:43:15.158609+0000","last_peered":"2023-11-04T01:43:15.158609+0000","last_clean":"2023-11-04T01:43:15.158609+0000","last_became_active":"2023-11-04T01:43:15.152300+0000","last_became_peered":"2023-11-04T01:43:15.152300+0000","last_unstale":"2023-11-04T01:43:15.158609+0000","last_undegraded":"2023-11-04T01:43:15.158609+0000","last_fullsized":"2023-11-04T01:43:15.158609+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110748+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:43:14.110748+0000","last_peered":"2023-11-04T01:43:14.110748+0000","last_clean":"2023-11-04T01:43:14.110748+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:43:14.110748+0000","last_undegraded":"2023-11-04T01:43:14.110748+0000","last_fullsized":"2023-11-04T01:43:14.110748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.116019+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:43:14.116019+0000","last_peered":"2023-11-04T01:43:14.116019+0000","last_clean":"2023-11-04T01:43:14.116019+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:43:14.116019+0000","last_undegraded":"2023-11-04T01:43:14.116019+0000","last_fullsized":"2023-11-04T01:43:14.116019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109874+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:43:14.109874+0000","last_peered":"2023-11-04T01:43:14.109874+0000","last_clean":"2023-11-04T01:43:14.109874+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:43:14.109874+0000","last_undegraded":"2023-11-04T01:43:14.109874+0000","last_fullsized":"2023-11-04T01:43:14.109874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.128023+0000","last_change":"2023-11-04T01:43:15.128023+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.128023+0000","last_undegraded":"2023-11-04T01:43:15.128023+0000","last_fullsized":"2023-11-04T01:43:15.128023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.157296+0000","last_change":"2023-11-04T01:43:15.153690+0000","last_active":"2023-11-04T01:43:15.157296+0000","last_peered":"2023-11-04T01:43:15.157296+0000","last_clean":"2023-11-04T01:43:15.157296+0000","last_became_active":"2023-11-04T01:43:15.153389+0000","last_became_peered":"2023-11-04T01:43:15.153389+0000","last_unstale":"2023-11-04T01:43:15.157296+0000","last_undegraded":"2023-11-04T01:43:15.157296+0000","last_fullsized":"2023-11-04T01:43:15.157296+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:28:22.667516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107451+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:43:14.107451+0000","last_peered":"2023-11-04T01:43:14.107451+0000","last_clean":"2023-11-04T01:43:14.107451+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:43:14.107451+0000","last_undegraded":"2023-11-04T01:43:14.107451+0000","last_fullsized":"2023-11-04T01:43:14.107451+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110287+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:43:14.110287+0000","last_peered":"2023-11-04T01:43:14.110287+0000","last_clean":"2023-11-04T01:43:14.110287+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:43:14.110287+0000","last_undegraded":"2023-11-04T01:43:14.110287+0000","last_fullsized":"2023-11-04T01:43:14.110287+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107987+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:43:14.107987+0000","last_peered":"2023-11-04T01:43:14.107987+0000","last_clean":"2023-11-04T01:43:14.107987+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:43:14.107987+0000","last_undegraded":"2023-11-04T01:43:14.107987+0000","last_fullsized":"2023-11-04T01:43:14.107987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.118300+0000","last_change":"2023-11-04T01:43:15.118300+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.118300+0000","last_undegraded":"2023-11-04T01:43:15.118300+0000","last_fullsized":"2023-11-04T01:43:15.118300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.138678+0000","last_change":"2023-11-04T01:43:15.134623+0000","last_active":"2023-11-04T01:43:15.138678+0000","last_peered":"2023-11-04T01:43:15.138678+0000","last_clean":"2023-11-04T01:43:15.138678+0000","last_became_active":"2023-11-04T01:43:15.133876+0000","last_became_peered":"2023-11-04T01:43:15.133876+0000","last_unstale":"2023-11-04T01:43:15.138678+0000","last_undegraded":"2023-11-04T01:43:15.138678+0000","last_fullsized":"2023-11-04T01:43:15.138678+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:27.147417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108626+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:43:14.108626+0000","last_peered":"2023-11-04T01:43:14.108626+0000","last_clean":"2023-11-04T01:43:14.108626+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:43:14.108626+0000","last_undegraded":"2023-11-04T01:43:14.108626+0000","last_fullsized":"2023-11-04T01:43:14.108626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099976+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:43:14.099976+0000","last_peered":"2023-11-04T01:43:14.099976+0000","last_clean":"2023-11-04T01:43:14.099976+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:43:14.099976+0000","last_undegraded":"2023-11-04T01:43:14.099976+0000","last_fullsized":"2023-11-04T01:43:14.099976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.110859+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:43:14.110859+0000","last_peered":"2023-11-04T01:43:14.110859+0000","last_clean":"2023-11-04T01:43:14.110859+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:43:14.110859+0000","last_undegraded":"2023-11-04T01:43:14.110859+0000","last_fullsized":"2023-11-04T01:43:14.110859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114081+0000","last_change":"2023-11-04T01:43:15.114081+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114081+0000","last_undegraded":"2023-11-04T01:43:15.114081+0000","last_fullsized":"2023-11-04T01:43:15.114081+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.160210+0000","last_change":"2023-11-04T01:43:15.153163+0000","last_active":"2023-11-04T01:43:15.160210+0000","last_peered":"2023-11-04T01:43:15.160210+0000","last_clean":"2023-11-04T01:43:15.160210+0000","last_became_active":"2023-11-04T01:43:15.152277+0000","last_became_peered":"2023-11-04T01:43:15.152277+0000","last_unstale":"2023-11-04T01:43:15.160210+0000","last_undegraded":"2023-11-04T01:43:15.160210+0000","last_fullsized":"2023-11-04T01:43:15.160210+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:44.866182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.113707+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:43:14.113707+0000","last_peered":"2023-11-04T01:43:14.113707+0000","last_clean":"2023-11-04T01:43:14.113707+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:43:14.113707+0000","last_undegraded":"2023-11-04T01:43:14.113707+0000","last_fullsized":"2023-11-04T01:43:14.113707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.118557+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:43:14.118557+0000","last_peered":"2023-11-04T01:43:14.118557+0000","last_clean":"2023-11-04T01:43:14.118557+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:43:14.118557+0000","last_undegraded":"2023-11-04T01:43:14.118557+0000","last_fullsized":"2023-11-04T01:43:14.118557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.107665+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:43:14.107665+0000","last_peered":"2023-11-04T01:43:14.107665+0000","last_clean":"2023-11-04T01:43:14.107665+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:43:14.107665+0000","last_undegraded":"2023-11-04T01:43:14.107665+0000","last_fullsized":"2023-11-04T01:43:14.107665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114506+0000","last_change":"2023-11-04T01:43:15.114506+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114506+0000","last_undegraded":"2023-11-04T01:43:15.114506+0000","last_fullsized":"2023-11-04T01:43:15.114506+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.154886+0000","last_change":"2023-11-04T01:43:15.152417+0000","last_active":"2023-11-04T01:43:15.154886+0000","last_peered":"2023-11-04T01:43:15.154886+0000","last_clean":"2023-11-04T01:43:15.154886+0000","last_became_active":"2023-11-04T01:43:15.149079+0000","last_became_peered":"2023-11-04T01:43:15.149079+0000","last_unstale":"2023-11-04T01:43:15.154886+0000","last_undegraded":"2023-11-04T01:43:15.154886+0000","last_fullsized":"2023-11-04T01:43:15.154886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:04.346894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.109057+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:43:14.109057+0000","last_peered":"2023-11-04T01:43:14.109057+0000","last_clean":"2023-11-04T01:43:14.109057+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:43:14.109057+0000","last_undegraded":"2023-11-04T01:43:14.109057+0000","last_fullsized":"2023-11-04T01:43:14.109057+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108086+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:43:14.108086+0000","last_peered":"2023-11-04T01:43:14.108086+0000","last_clean":"2023-11-04T01:43:14.108086+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:43:14.108086+0000","last_undegraded":"2023-11-04T01:43:14.108086+0000","last_fullsized":"2023-11-04T01:43:14.108086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.131026+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:43:15.131026+0000","last_peered":"2023-11-04T01:43:15.131026+0000","last_clean":"2023-11-04T01:43:15.131026+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:43:15.131026+0000","last_undegraded":"2023-11-04T01:43:15.131026+0000","last_fullsized":"2023-11-04T01:43:15.131026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.142934+0000","last_change":"2023-11-04T01:43:15.142934+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.142934+0000","last_undegraded":"2023-11-04T01:43:15.142934+0000","last_fullsized":"2023-11-04T01:43:15.142934+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.135294+0000","last_change":"2023-11-04T01:43:15.130147+0000","last_active":"2023-11-04T01:43:15.135294+0000","last_peered":"2023-11-04T01:43:15.135294+0000","last_clean":"2023-11-04T01:43:15.135294+0000","last_became_active":"2023-11-04T01:43:15.129434+0000","last_became_peered":"2023-11-04T01:43:15.129434+0000","last_unstale":"2023-11-04T01:43:15.135294+0000","last_undegraded":"2023-11-04T01:43:15.135294+0000","last_fullsized":"2023-11-04T01:43:15.135294+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:32.080511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.117861+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:43:14.117861+0000","last_peered":"2023-11-04T01:43:14.117861+0000","last_clean":"2023-11-04T01:43:14.117861+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:43:14.117861+0000","last_undegraded":"2023-11-04T01:43:14.117861+0000","last_fullsized":"2023-11-04T01:43:14.117861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115367+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:43:14.115367+0000","last_peered":"2023-11-04T01:43:14.115367+0000","last_clean":"2023-11-04T01:43:14.115367+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:43:14.115367+0000","last_undegraded":"2023-11-04T01:43:14.115367+0000","last_fullsized":"2023-11-04T01:43:14.115367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.108850+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:43:14.108850+0000","last_peered":"2023-11-04T01:43:14.108850+0000","last_clean":"2023-11-04T01:43:14.108850+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:43:14.108850+0000","last_undegraded":"2023-11-04T01:43:14.108850+0000","last_fullsized":"2023-11-04T01:43:14.108850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.114286+0000","last_change":"2023-11-04T01:43:15.114286+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.114286+0000","last_undegraded":"2023-11-04T01:43:15.114286+0000","last_fullsized":"2023-11-04T01:43:15.114286+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.149051+0000","last_change":"2023-11-04T01:43:15.144364+0000","last_active":"2023-11-04T01:43:15.149051+0000","last_peered":"2023-11-04T01:43:15.149051+0000","last_clean":"2023-11-04T01:43:15.149051+0000","last_became_active":"2023-11-04T01:43:15.138867+0000","last_became_peered":"2023-11-04T01:43:15.138867+0000","last_unstale":"2023-11-04T01:43:15.149051+0000","last_undegraded":"2023-11-04T01:43:15.149051+0000","last_fullsized":"2023-11-04T01:43:15.149051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:12.573389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119429+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:43:14.119429+0000","last_peered":"2023-11-04T01:43:14.119429+0000","last_clean":"2023-11-04T01:43:14.119429+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:43:14.119429+0000","last_undegraded":"2023-11-04T01:43:14.119429+0000","last_fullsized":"2023-11-04T01:43:14.119429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.099681+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:43:14.099681+0000","last_peered":"2023-11-04T01:43:14.099681+0000","last_clean":"2023-11-04T01:43:14.099681+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:43:14.099681+0000","last_undegraded":"2023-11-04T01:43:14.099681+0000","last_fullsized":"2023-11-04T01:43:14.099681+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.115795+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:43:14.115795+0000","last_peered":"2023-11-04T01:43:14.115795+0000","last_clean":"2023-11-04T01:43:14.115795+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:43:14.115795+0000","last_undegraded":"2023-11-04T01:43:14.115795+0000","last_fullsized":"2023-11-04T01:43:14.115795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2023-11-04T01:43:15.144585+0000","last_change":"2023-11-04T01:43:15.144585+0000","last_active":"2023-11-04T01:43:15.095004+0000","last_peered":"2023-11-04T01:43:15.095004+0000","last_clean":"2023-11-04T01:43:15.095004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:15.144585+0000","last_undegraded":"2023-11-04T01:43:15.144585+0000","last_fullsized":"2023-11-04T01:43:15.144585+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-11-04T01:43:15.168837+0000","last_change":"2023-11-04T01:43:15.162848+0000","last_active":"2023-11-04T01:43:15.168837+0000","last_peered":"2023-11-04T01:43:15.168837+0000","last_clean":"2023-11-04T01:43:15.168837+0000","last_became_active":"2023-11-04T01:43:15.161007+0000","last_became_peered":"2023-11-04T01:43:15.161007+0000","last_unstale":"2023-11-04T01:43:15.168837+0000","last_undegraded":"2023-11-04T01:43:15.168837+0000","last_fullsized":"2023-11-04T01:43:15.168837+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:44.148187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.119952+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:43:14.119952+0000","last_peered":"2023-11-04T01:43:14.119952+0000","last_clean":"2023-11-04T01:43:14.119952+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:43:14.119952+0000","last_undegraded":"2023-11-04T01:43:14.119952+0000","last_fullsized":"2023-11-04T01:43:14.119952+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.111915+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:43:14.111915+0000","last_peered":"2023-11-04T01:43:14.111915+0000","last_clean":"2023-11-04T01:43:14.111915+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:43:14.111915+0000","last_undegraded":"2023-11-04T01:43:14.111915+0000","last_fullsized":"2023-11-04T01:43:14.111915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-11-04T01:43:14.114455+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:43:14.114455+0000","last_peered":"2023-11-04T01:43:14.114455+0000","last_clean":"2023-11-04T01:43:14.114455+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:43:14.114455+0000","last_undegraded":"2023-11-04T01:43:14.114455+0000","last_fullsized":"2023-11-04T01:43:14.114455+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32816,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339024,"statfs":{"total":96636764160,"available":96603160576,"internally_reserved":0,"allocated":1675264,"data_stored":1094075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":1.139,"15min":0.95999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":29.603000000000002,"5min":29.603000000000002,"15min":29.603000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.59099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.355,"5min":1.454,"15min":1.454},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96599999999999997,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.129}]},{"osd":2,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.96999999999999997,"15min":0.92700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.008},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.63500000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.2450000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89800000000000002,"15min":0.89700000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":2.0760000000000001,"5min":1.1819999999999999,"15min":1.03},"min":{"1min":0.70999999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":25.791,"5min":25.791,"15min":25.791},"last":1.097}]},{"osd":4,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98599999999999999,"15min":1.0009999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":0.70099999999999996},{"interface":"front","average":{"1min":2.0910000000000002,"5min":1.27,"15min":1.131},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":25.696999999999999,"5min":25.696999999999999,"15min":25.696999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.129,"15min":1.0589999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":11.064,"5min":11.064,"15min":11.064},"last":1.075},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.1630000000000003,"5min":4.1630000000000003,"15min":4.1630000000000003},"last":1.155}]},{"osd":6,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1200000000000001,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2250000000000001,"15min":1.226},"min":{"1min":0.88500000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":511073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.165,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2210000000000001,"5min":1.347,"15min":1.347},"last":1.1240000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.262,"5min":1.395,"15min":1.395},"last":1.2829999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2270000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.91600000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.95399999999999996},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2010000000000001,"5min":1.319,"15min":1.319},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1950000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98199999999999998},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.079,"15min":1.103},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3879999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.2270000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.03,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.694,"15min":1.694},"last":1.04},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1259999999999999,"15min":1.1359999999999999},"min":{"1min":0.76700000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.083}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.1120000000000001,"15min":1.1160000000000001},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3109999999999999,"5min":1.649,"15min":1.649},"last":1.329},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1499999999999999,"15min":1.175},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.409,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.1599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79700000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.23,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.504,"5min":0.5,"15min":0.5},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.262},"last":0.51400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.85599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.419,"15min":1.419},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.76100000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2490000000000001,"5min":1.252,"15min":1.252},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.046},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.58599999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4159999999999999,"5min":1.502,"15min":1.502},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2270000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.383,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.042},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.107,"15min":1.115},"min":{"1min":0.68799999999999994,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3280000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.0189999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":1.016},"min":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3939999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3},"last":0.51700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91700000000000004,"15min":0.94499999999999995},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.101,"5min":1.605,"15min":1.605},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.62}]},{"osd":2,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.234,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.446,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96599999999999997,"15min":0.97299999999999998},"min":{"1min":0.68100000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.488,"15min":1.488},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.296,"5min":1.996,"15min":1.996},"last":1.119}]},{"osd":5,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.077,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4830000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0649999999999999,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2889999999999999,"5min":1.514,"15min":1.514},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1419999999999999},"min":{"1min":0.70599999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.96599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.349,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.161,"15min":1.169},"min":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.4339999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2150000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.147,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65600000000000003,"15min":0.68200000000000005},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.171,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.74199999999999999},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.623,"15min":1.623},"last":1.1419999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.70099999999999996},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0069999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95999999999999996,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.395,"5min":1.806,"15min":1.806},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.3109999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.67300000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.425,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.196}]},{"osd":6,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.54,"15min":1.54},"last":1.093},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.5720000000000001,"5min":1.73,"15min":1.73},"last":1.407}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.361,"5min":1.407,"15min":1.407},"last":1.25},{"interface":"front","average":{"1min":1.044,"5min":1.0860000000000001,"15min":1.1060000000000001},"min":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.419,"5min":1.732,"15min":1.732},"last":1.224}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.64600000000000002},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1040000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.103,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":1.29,"15min":1.29},"last":1.327}]},{"osd":3,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.77700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.125,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.175},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.98099999999999998},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1399999999999999,"5min":1.534,"15min":1.534},"last":1.5269999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.022,"15min":1.0469999999999999},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.21,"5min":1.877,"15min":1.877},"last":1.4490000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.012,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.25,"5min":1.446,"15min":1.446},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.034,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.7050000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.143,"15min":1.1870000000000001},"min":{"1min":0.73299999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0379999999999998,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.78}]},{"osd":7,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.583},{"interface":"front","average":{"1min":1.071,"5min":1.1060000000000001,"15min":1.1439999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4630000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.8919999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":503707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.67300000000000004,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.05,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.629}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.379,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7929999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.0309999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86099999999999999,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.012,"15min":0.96699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":1.1519999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.077,"15min":1.056},"min":{"1min":0.61099999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.077,"15min":1.083},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5449999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.1220000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92500000000000004,"15min":0.90600000000000003},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.099},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1220000000000001,"15min":1.0800000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.9199999999999999,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":1.2609999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1040000000000001,"15min":1.1140000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.226},{"interface":"front","average":{"1min":1.034,"5min":0.998,"15min":0.98699999999999999},"min":{"1min":0.68799999999999994,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9850000000000001,"5min":1.994,"15min":1.994},"last":1.198}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1687552,"data_stored":1101441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75800000000000001,"5min":1.135,"15min":1.135},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.624}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.27,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.026},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2470000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.68999999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1399999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.81100000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.014},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.71699999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2170000000000001,"5min":1.694,"15min":1.694},"last":1.143}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.745,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.298,"5min":1.782,"15min":1.782},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5229999999999999,"5min":1.903,"15min":1.903},"last":0.96399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.0800000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5920000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.653,"15min":1.653},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:24.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:24.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158bdab640 1 Processor -- start 2023-11-04T01:43:24.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158bdab640 1 -- start start 2023-11-04T01:43:24.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158bdab640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 0x7f15840b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158bdab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840b6070 con 0x7f15840d0690 2023-11-04T01:43:24.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158bdab640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840b8ed0 con 0x7f15840b4990 2023-11-04T01:43:24.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158bdab640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840d1ce0 con 0x7f15840d0ae0 2023-11-04T01:43:24.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1589346640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f15840d0690 0x7f15840b64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:32782/0 (socket says 172.21.15.40:32782) 2023-11-04T01:43:24.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1589346640 1 -- 172.21.15.40:0/1534031906 learned_addr learned my addr 172.21.15.40:0/1534031906 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f158a348640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 0x7f15840b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415820032 0 0) 0x7f15840b6070 con 0x7f15840d0690 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1570003530 con 0x7f15840d0690 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071150649 0 0) 0x7f1570003530 con 0x7f15840d0690 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 msgr2=0x7f15840b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 0x7f15840b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 >> v1:172.21.15.91:6789/0 conn(0x7f15840b4990 legacy=0x7f15840b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840d1fc0 con 0x7f15840d0690 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1574001680 con 0x7f15840d0690 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.949+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 >> v1:172.21.15.40:6789/0 conn(0x7f15840d0690 legacy=0x7f15840b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15700039b0 0x7f1570003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 0x7f15700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1570004d10 0x7f1570005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840d1ce0 con 0x7f1570004d10 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157000bb00 con 0x7f15700039b0 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157000bcc0 con 0x7f15840d0ae0 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1570004d10 0x7f1570005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1589346640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 0x7f15700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1589b47640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15700039b0 0x7f1570003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 -- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 msgr2=0x7f15700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840d0ae0 0x7f15700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 -- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15700039b0 msgr2=0x7f1570003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15700039b0 0x7f1570003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 -- 172.21.15.40:0/1534031906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570003530 con 0x7f1570004d10 2023-11-04T01:43:24.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1570004d10 0x7f1570005190 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f15840d0f90 tx=0x7f157c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e02a32fc6468560 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0a5c10 con 0x7f1570004d10 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00f040 con 0x7f1570004d10 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f1588b45640 1 -- 172.21.15.40:0/1534031906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0ad440 con 0x7f1570004d10 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158bdab640 1 -- 172.21.15.40:0/1534031906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1570004d10 msgr2=0x7f1570005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158bdab640 1 --2- 172.21.15.40:0/1534031906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1570004d10 0x7f1570005190 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f15840d0f90 tx=0x7f157c01cc00 comp rx=0 tx=0).stop 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158a348640 1 -- 172.21.15.40:0/1534031906 reap_dead start 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158bdab640 1 -- 172.21.15.40:0/1534031906 shutdown_connections 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158bdab640 1 -- 172.21.15.40:0/1534031906 >> 172.21.15.40:0/1534031906 conn(0x7f15840cf990 msgr2=0x7f15840cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158bdab640 1 -- 172.21.15.40:0/1534031906 shutdown_connections 2023-11-04T01:43:24.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.953+0000 7f158bdab640 1 -- 172.21.15.40:0/1534031906 wait complete. 2023-11-04T01:43:24.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 Processor -- start 2023-11-04T01:43:24.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- start start 2023-11-04T01:43:24.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 0x7f15840cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840cb7f0 0x7f15840cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f158415f780 0x7f158415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840cc1b0 con 0x7f1584154400 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840c9fe0 con 0x7f158415f780 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15840ca880 con 0x7f15840cb7f0 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 0x7f15840cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 0x7f15840cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45044/0 (socket says 172.21.15.40:45044) 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 -- 172.21.15.40:0/2173503451 learned_addr learned my addr 172.21.15.40:0/2173503451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158a348640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f158415f780 0x7f158415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589346640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840cb7f0 0x7f15840cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 -- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840cb7f0 msgr2=0x7f15840cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840cb7f0 0x7f15840cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 -- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f158415f780 msgr2=0x7f158415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f158415f780 0x7f158415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 -- 172.21.15.40:0/2173503451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840cb250 con 0x7f1584154400 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f1589b47640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 0x7f15840cad10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f158000e550 tx=0x7f158000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800052e0 con 0x7f1584154400 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580005440 con 0x7f1584154400 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584160540 con 0x7f1584154400 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580003820 con 0x7f1584154400 2023-11-04T01:43:24.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15840ca510 con 0x7f1584154400 2023-11-04T01:43:24.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.957+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15840744a0 con 0x7f1584154400 2023-11-04T01:43:24.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.961+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1580003980 con 0x7f1584154400 2023-11-04T01:43:24.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.961+0000 7f157a7fc640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15680664a0 0x7f1568068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.961+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f1580084020 con 0x7f1584154400 2023-11-04T01:43:24.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.961+0000 7f1589346640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15680664a0 0x7f1568068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.961+0000 7f1589346640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15680664a0 0x7f1568068960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f15841f6f10 tx=0x7f1574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:24.965+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15800510f0 con 0x7f1584154400 2023-11-04T01:43:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.113+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 --> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15840d2580 con 0x7f15680664a0 2023-11-04T01:43:25.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.153+0000 7f157a7fc640 1 -- 172.21.15.40:0/2173503451 <== mgr.4100 v2:172.21.15.91:6832/3202656120 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530396 (secure 0 0 0) 0x7f1574010830 con 0x7f15680664a0 2023-11-04T01:43:25.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:25.170 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15680664a0 msgr2=0x7f1568068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15680664a0 0x7f1568068960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f15841f6f10 tx=0x7f1574009040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 msgr2=0x7f15840cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 0x7f15840cad10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f158000e550 tx=0x7f158000ea10 comp rx=0 tx=0).stop 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 shutdown_connections 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15680664a0 0x7f1568068960 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f158415f780 0x7f158415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15840cb7f0 0x7f15840cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 --2- 172.21.15.40:0/2173503451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1584154400 0x7f15840cad10 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 >> 172.21.15.40:0/2173503451 conn(0x7f15840cf990 msgr2=0x7f15840b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 shutdown_connections 2023-11-04T01:43:25.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.161+0000 7f158bdab640 1 -- 172.21.15.40:0/2173503451 wait complete. 2023-11-04T01:43:25.183 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-11-04T01:43:23.827708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259428,"kb_used_data":9960,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715292,"statfs":{"total":773094113280,"available":772828459008,"internally_reserved":0,"allocated":10199040,"data_stored":5396196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":104,"apply_latency_ms":104,"commit_latency_ns":104000000,"apply_latency_ns":104000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004136"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.210909+0000","last_change":"2023-11-04T01:43:16.174729+0000","last_active":"2023-11-04T01:43:17.210909+0000","last_peered":"2023-11-04T01:43:17.210909+0000","last_clean":"2023-11-04T01:43:17.210909+0000","last_became_active":"2023-11-04T01:43:16.174238+0000","last_became_peered":"2023-11-04T01:43:16.174238+0000","last_unstale":"2023-11-04T01:43:17.210909+0000","last_undegraded":"2023-11-04T01:43:17.210909+0000","last_fullsized":"2023-11-04T01:43:17.210909+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:25:26.698309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.146734+0000","last_change":"2023-11-04T01:43:16.180081+0000","last_active":"2023-11-04T01:43:17.146734+0000","last_peered":"2023-11-04T01:43:17.146734+0000","last_clean":"2023-11-04T01:43:17.146734+0000","last_became_active":"2023-11-04T01:43:16.179379+0000","last_became_peered":"2023-11-04T01:43:16.179379+0000","last_unstale":"2023-11-04T01:43:17.146734+0000","last_undegraded":"2023-11-04T01:43:17.146734+0000","last_fullsized":"2023-11-04T01:43:17.146734+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:05.607640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.210616+0000","last_change":"2023-11-04T01:43:16.202732+0000","last_active":"2023-11-04T01:43:17.210616+0000","last_peered":"2023-11-04T01:43:17.210616+0000","last_clean":"2023-11-04T01:43:17.210616+0000","last_became_active":"2023-11-04T01:43:16.202018+0000","last_became_peered":"2023-11-04T01:43:16.202018+0000","last_unstale":"2023-11-04T01:43:17.210616+0000","last_undegraded":"2023-11-04T01:43:17.210616+0000","last_fullsized":"2023-11-04T01:43:17.210616+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:09:33.944174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211878+0000","last_change":"2023-11-04T01:43:16.182931+0000","last_active":"2023-11-04T01:43:17.211878+0000","last_peered":"2023-11-04T01:43:17.211878+0000","last_clean":"2023-11-04T01:43:17.211878+0000","last_became_active":"2023-11-04T01:43:16.182520+0000","last_became_peered":"2023-11-04T01:43:16.182520+0000","last_unstale":"2023-11-04T01:43:17.211878+0000","last_undegraded":"2023-11-04T01:43:17.211878+0000","last_fullsized":"2023-11-04T01:43:17.211878+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:29:00.692042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.213931+0000","last_change":"2023-11-04T01:43:16.197336+0000","last_active":"2023-11-04T01:43:17.213931+0000","last_peered":"2023-11-04T01:43:17.213931+0000","last_clean":"2023-11-04T01:43:17.213931+0000","last_became_active":"2023-11-04T01:43:16.197068+0000","last_became_peered":"2023-11-04T01:43:16.197068+0000","last_unstale":"2023-11-04T01:43:17.213931+0000","last_undegraded":"2023-11-04T01:43:17.213931+0000","last_fullsized":"2023-11-04T01:43:17.213931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:36.454285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.145330+0000","last_change":"2023-11-04T01:43:16.174579+0000","last_active":"2023-11-04T01:43:17.145330+0000","last_peered":"2023-11-04T01:43:17.145330+0000","last_clean":"2023-11-04T01:43:17.145330+0000","last_became_active":"2023-11-04T01:43:16.173811+0000","last_became_peered":"2023-11-04T01:43:16.173811+0000","last_unstale":"2023-11-04T01:43:17.145330+0000","last_undegraded":"2023-11-04T01:43:17.145330+0000","last_fullsized":"2023-11-04T01:43:17.145330+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:45.877229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.144020+0000","last_change":"2023-11-04T01:43:16.172723+0000","last_active":"2023-11-04T01:43:17.144020+0000","last_peered":"2023-11-04T01:43:17.144020+0000","last_clean":"2023-11-04T01:43:17.144020+0000","last_became_active":"2023-11-04T01:43:16.172000+0000","last_became_peered":"2023-11-04T01:43:16.172000+0000","last_unstale":"2023-11-04T01:43:17.144020+0000","last_undegraded":"2023-11-04T01:43:17.144020+0000","last_fullsized":"2023-11-04T01:43:17.144020+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:55:23.727343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.142678+0000","last_change":"2023-11-04T01:43:16.182321+0000","last_active":"2023-11-04T01:43:17.142678+0000","last_peered":"2023-11-04T01:43:17.142678+0000","last_clean":"2023-11-04T01:43:17.142678+0000","last_became_active":"2023-11-04T01:43:16.181784+0000","last_became_peered":"2023-11-04T01:43:16.181784+0000","last_unstale":"2023-11-04T01:43:17.142678+0000","last_undegraded":"2023-11-04T01:43:17.142678+0000","last_fullsized":"2023-11-04T01:43:17.142678+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:15.770900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.146892+0000","last_change":"2023-11-04T01:43:16.173614+0000","last_active":"2023-11-04T01:43:17.146892+0000","last_peered":"2023-11-04T01:43:17.146892+0000","last_clean":"2023-11-04T01:43:17.146892+0000","last_became_active":"2023-11-04T01:43:16.172627+0000","last_became_peered":"2023-11-04T01:43:16.172627+0000","last_unstale":"2023-11-04T01:43:17.146892+0000","last_undegraded":"2023-11-04T01:43:17.146892+0000","last_fullsized":"2023-11-04T01:43:17.146892+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:34.466569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214984+0000","last_change":"2023-11-04T01:43:16.172034+0000","last_active":"2023-11-04T01:43:17.214984+0000","last_peered":"2023-11-04T01:43:17.214984+0000","last_clean":"2023-11-04T01:43:17.214984+0000","last_became_active":"2023-11-04T01:43:16.171664+0000","last_became_peered":"2023-11-04T01:43:16.171664+0000","last_unstale":"2023-11-04T01:43:17.214984+0000","last_undegraded":"2023-11-04T01:43:17.214984+0000","last_fullsized":"2023-11-04T01:43:17.214984+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:24:04.027352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.147122+0000","last_change":"2023-11-04T01:43:16.175528+0000","last_active":"2023-11-04T01:43:17.147122+0000","last_peered":"2023-11-04T01:43:17.147122+0000","last_clean":"2023-11-04T01:43:17.147122+0000","last_became_active":"2023-11-04T01:43:16.173870+0000","last_became_peered":"2023-11-04T01:43:16.173870+0000","last_unstale":"2023-11-04T01:43:17.147122+0000","last_undegraded":"2023-11-04T01:43:17.147122+0000","last_fullsized":"2023-11-04T01:43:17.147122+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:06.776009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214995+0000","last_change":"2023-11-04T01:43:16.183679+0000","last_active":"2023-11-04T01:43:17.214995+0000","last_peered":"2023-11-04T01:43:17.214995+0000","last_clean":"2023-11-04T01:43:17.214995+0000","last_became_active":"2023-11-04T01:43:16.182547+0000","last_became_peered":"2023-11-04T01:43:16.182547+0000","last_unstale":"2023-11-04T01:43:17.214995+0000","last_undegraded":"2023-11-04T01:43:17.214995+0000","last_fullsized":"2023-11-04T01:43:17.214995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:49.658624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212527+0000","last_change":"2023-11-04T01:43:16.188868+0000","last_active":"2023-11-04T01:43:17.212527+0000","last_peered":"2023-11-04T01:43:17.212527+0000","last_clean":"2023-11-04T01:43:17.212527+0000","last_became_active":"2023-11-04T01:43:16.188411+0000","last_became_peered":"2023-11-04T01:43:16.188411+0000","last_unstale":"2023-11-04T01:43:17.212527+0000","last_undegraded":"2023-11-04T01:43:17.212527+0000","last_fullsized":"2023-11-04T01:43:17.212527+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:11:40.429898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.213437+0000","last_change":"2023-11-04T01:43:16.173670+0000","last_active":"2023-11-04T01:43:17.213437+0000","last_peered":"2023-11-04T01:43:17.213437+0000","last_clean":"2023-11-04T01:43:17.213437+0000","last_became_active":"2023-11-04T01:43:16.172682+0000","last_became_peered":"2023-11-04T01:43:16.172682+0000","last_unstale":"2023-11-04T01:43:17.213437+0000","last_undegraded":"2023-11-04T01:43:17.213437+0000","last_fullsized":"2023-11-04T01:43:17.213437+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:33.091558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212737+0000","last_change":"2023-11-04T01:43:16.191518+0000","last_active":"2023-11-04T01:43:17.212737+0000","last_peered":"2023-11-04T01:43:17.212737+0000","last_clean":"2023-11-04T01:43:17.212737+0000","last_became_active":"2023-11-04T01:43:16.190826+0000","last_became_peered":"2023-11-04T01:43:16.190826+0000","last_unstale":"2023-11-04T01:43:17.212737+0000","last_undegraded":"2023-11-04T01:43:17.212737+0000","last_fullsized":"2023-11-04T01:43:17.212737+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:39:28.666164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212596+0000","last_change":"2023-11-04T01:43:16.180053+0000","last_active":"2023-11-04T01:43:17.212596+0000","last_peered":"2023-11-04T01:43:17.212596+0000","last_clean":"2023-11-04T01:43:17.212596+0000","last_became_active":"2023-11-04T01:43:16.178748+0000","last_became_peered":"2023-11-04T01:43:16.178748+0000","last_unstale":"2023-11-04T01:43:17.212596+0000","last_undegraded":"2023-11-04T01:43:17.212596+0000","last_fullsized":"2023-11-04T01:43:17.212596+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:01.501768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211068+0000","last_change":"2023-11-04T01:43:16.202762+0000","last_active":"2023-11-04T01:43:17.211068+0000","last_peered":"2023-11-04T01:43:17.211068+0000","last_clean":"2023-11-04T01:43:17.211068+0000","last_became_active":"2023-11-04T01:43:16.202445+0000","last_became_peered":"2023-11-04T01:43:16.202445+0000","last_unstale":"2023-11-04T01:43:17.211068+0000","last_undegraded":"2023-11-04T01:43:17.211068+0000","last_fullsized":"2023-11-04T01:43:17.211068+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:11:31.068297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.147244+0000","last_change":"2023-11-04T01:43:16.194566+0000","last_active":"2023-11-04T01:43:17.147244+0000","last_peered":"2023-11-04T01:43:17.147244+0000","last_clean":"2023-11-04T01:43:17.147244+0000","last_became_active":"2023-11-04T01:43:16.193130+0000","last_became_peered":"2023-11-04T01:43:16.193130+0000","last_unstale":"2023-11-04T01:43:17.147244+0000","last_undegraded":"2023-11-04T01:43:17.147244+0000","last_fullsized":"2023-11-04T01:43:17.147244+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:33.600920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212601+0000","last_change":"2023-11-04T01:43:16.198768+0000","last_active":"2023-11-04T01:43:17.212601+0000","last_peered":"2023-11-04T01:43:17.212601+0000","last_clean":"2023-11-04T01:43:17.212601+0000","last_became_active":"2023-11-04T01:43:16.198431+0000","last_became_peered":"2023-11-04T01:43:16.198431+0000","last_unstale":"2023-11-04T01:43:17.212601+0000","last_undegraded":"2023-11-04T01:43:17.212601+0000","last_fullsized":"2023-11-04T01:43:17.212601+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:11.327642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214946+0000","last_change":"2023-11-04T01:43:16.183195+0000","last_active":"2023-11-04T01:43:17.214946+0000","last_peered":"2023-11-04T01:43:17.214946+0000","last_clean":"2023-11-04T01:43:17.214946+0000","last_became_active":"2023-11-04T01:43:16.181731+0000","last_became_peered":"2023-11-04T01:43:16.181731+0000","last_unstale":"2023-11-04T01:43:17.214946+0000","last_undegraded":"2023-11-04T01:43:17.214946+0000","last_fullsized":"2023-11-04T01:43:17.214946+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:05.030687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.142537+0000","last_change":"2023-11-04T01:43:16.189291+0000","last_active":"2023-11-04T01:43:17.142537+0000","last_peered":"2023-11-04T01:43:17.142537+0000","last_clean":"2023-11-04T01:43:17.142537+0000","last_became_active":"2023-11-04T01:43:16.188984+0000","last_became_peered":"2023-11-04T01:43:16.188984+0000","last_unstale":"2023-11-04T01:43:17.142537+0000","last_undegraded":"2023-11-04T01:43:17.142537+0000","last_fullsized":"2023-11-04T01:43:17.142537+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:54:35.218412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214282+0000","last_change":"2023-11-04T01:43:16.187487+0000","last_active":"2023-11-04T01:43:17.214282+0000","last_peered":"2023-11-04T01:43:17.214282+0000","last_clean":"2023-11-04T01:43:17.214282+0000","last_became_active":"2023-11-04T01:43:16.187183+0000","last_became_peered":"2023-11-04T01:43:16.187183+0000","last_unstale":"2023-11-04T01:43:17.214282+0000","last_undegraded":"2023-11-04T01:43:17.214282+0000","last_fullsized":"2023-11-04T01:43:17.214282+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:03.980399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.210951+0000","last_change":"2023-11-04T01:43:16.202324+0000","last_active":"2023-11-04T01:43:17.210951+0000","last_peered":"2023-11-04T01:43:17.210951+0000","last_clean":"2023-11-04T01:43:17.210951+0000","last_became_active":"2023-11-04T01:43:16.201985+0000","last_became_peered":"2023-11-04T01:43:16.201985+0000","last_unstale":"2023-11-04T01:43:17.210951+0000","last_undegraded":"2023-11-04T01:43:17.210951+0000","last_fullsized":"2023-11-04T01:43:17.210951+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:03.897565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.213956+0000","last_change":"2023-11-04T01:43:16.175615+0000","last_active":"2023-11-04T01:43:17.213956+0000","last_peered":"2023-11-04T01:43:17.213956+0000","last_clean":"2023-11-04T01:43:17.213956+0000","last_became_active":"2023-11-04T01:43:16.175311+0000","last_became_peered":"2023-11-04T01:43:16.175311+0000","last_unstale":"2023-11-04T01:43:17.213956+0000","last_undegraded":"2023-11-04T01:43:17.213956+0000","last_fullsized":"2023-11-04T01:43:17.213956+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:06.776009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.215204+0000","last_change":"2023-11-04T01:43:16.191258+0000","last_active":"2023-11-04T01:43:17.215204+0000","last_peered":"2023-11-04T01:43:17.215204+0000","last_clean":"2023-11-04T01:43:17.215204+0000","last_became_active":"2023-11-04T01:43:16.190680+0000","last_became_peered":"2023-11-04T01:43:16.190680+0000","last_unstale":"2023-11-04T01:43:17.215204+0000","last_undegraded":"2023-11-04T01:43:17.215204+0000","last_fullsized":"2023-11-04T01:43:17.215204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:13.584437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214449+0000","last_change":"2023-11-04T01:43:16.185918+0000","last_active":"2023-11-04T01:43:17.214449+0000","last_peered":"2023-11-04T01:43:17.214449+0000","last_clean":"2023-11-04T01:43:17.214449+0000","last_became_active":"2023-11-04T01:43:16.185249+0000","last_became_peered":"2023-11-04T01:43:16.185249+0000","last_unstale":"2023-11-04T01:43:17.214449+0000","last_undegraded":"2023-11-04T01:43:17.214449+0000","last_fullsized":"2023-11-04T01:43:17.214449+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:33.525193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.146488+0000","last_change":"2023-11-04T01:43:16.176059+0000","last_active":"2023-11-04T01:43:17.146488+0000","last_peered":"2023-11-04T01:43:17.146488+0000","last_clean":"2023-11-04T01:43:17.146488+0000","last_became_active":"2023-11-04T01:43:16.174699+0000","last_became_peered":"2023-11-04T01:43:16.174699+0000","last_unstale":"2023-11-04T01:43:17.146488+0000","last_undegraded":"2023-11-04T01:43:17.146488+0000","last_fullsized":"2023-11-04T01:43:17.146488+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:47.303180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.145854+0000","last_change":"2023-11-04T01:43:16.191787+0000","last_active":"2023-11-04T01:43:17.145854+0000","last_peered":"2023-11-04T01:43:17.145854+0000","last_clean":"2023-11-04T01:43:17.145854+0000","last_became_active":"2023-11-04T01:43:16.190897+0000","last_became_peered":"2023-11-04T01:43:16.190897+0000","last_unstale":"2023-11-04T01:43:17.145854+0000","last_undegraded":"2023-11-04T01:43:17.145854+0000","last_fullsized":"2023-11-04T01:43:17.145854+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:56.302383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.142239+0000","last_change":"2023-11-04T01:43:16.209247+0000","last_active":"2023-11-04T01:43:17.142239+0000","last_peered":"2023-11-04T01:43:17.142239+0000","last_clean":"2023-11-04T01:43:17.142239+0000","last_became_active":"2023-11-04T01:43:16.208961+0000","last_became_peered":"2023-11-04T01:43:16.208961+0000","last_unstale":"2023-11-04T01:43:17.142239+0000","last_undegraded":"2023-11-04T01:43:17.142239+0000","last_fullsized":"2023-11-04T01:43:17.142239+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:46.487442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214219+0000","last_change":"2023-11-04T01:43:16.193372+0000","last_active":"2023-11-04T01:43:17.214219+0000","last_peered":"2023-11-04T01:43:17.214219+0000","last_clean":"2023-11-04T01:43:17.214219+0000","last_became_active":"2023-11-04T01:43:16.192763+0000","last_became_peered":"2023-11-04T01:43:16.192763+0000","last_unstale":"2023-11-04T01:43:17.214219+0000","last_undegraded":"2023-11-04T01:43:17.214219+0000","last_fullsized":"2023-11-04T01:43:17.214219+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:22.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.144529+0000","last_change":"2023-11-04T01:43:16.184138+0000","last_active":"2023-11-04T01:43:17.144529+0000","last_peered":"2023-11-04T01:43:17.144529+0000","last_clean":"2023-11-04T01:43:17.144529+0000","last_became_active":"2023-11-04T01:43:16.183384+0000","last_became_peered":"2023-11-04T01:43:16.183384+0000","last_unstale":"2023-11-04T01:43:17.144529+0000","last_undegraded":"2023-11-04T01:43:17.144529+0000","last_fullsized":"2023-11-04T01:43:17.144529+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:05.357941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.141357+0000","last_change":"2023-11-04T01:43:16.203305+0000","last_active":"2023-11-04T01:43:17.141357+0000","last_peered":"2023-11-04T01:43:17.141357+0000","last_clean":"2023-11-04T01:43:17.141357+0000","last_became_active":"2023-11-04T01:43:16.202996+0000","last_became_peered":"2023-11-04T01:43:16.202996+0000","last_unstale":"2023-11-04T01:43:17.141357+0000","last_undegraded":"2023-11-04T01:43:17.141357+0000","last_fullsized":"2023-11-04T01:43:17.141357+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:24:12.556887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.143839+0000","last_change":"2023-11-04T01:43:16.182704+0000","last_active":"2023-11-04T01:43:17.143839+0000","last_peered":"2023-11-04T01:43:17.143839+0000","last_clean":"2023-11-04T01:43:17.143839+0000","last_became_active":"2023-11-04T01:43:16.181908+0000","last_became_peered":"2023-11-04T01:43:16.181908+0000","last_unstale":"2023-11-04T01:43:17.143839+0000","last_undegraded":"2023-11-04T01:43:17.143839+0000","last_fullsized":"2023-11-04T01:43:17.143839+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:57.964178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.203582+0000","last_change":"2023-11-04T01:43:15.157943+0000","last_active":"2023-11-04T01:43:16.203582+0000","last_peered":"2023-11-04T01:43:16.203582+0000","last_clean":"2023-11-04T01:43:16.203582+0000","last_became_active":"2023-11-04T01:43:15.157543+0000","last_became_peered":"2023-11-04T01:43:15.157543+0000","last_unstale":"2023-11-04T01:43:16.203582+0000","last_undegraded":"2023-11-04T01:43:16.203582+0000","last_fullsized":"2023-11-04T01:43:16.203582+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:12.224722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.164153+0000","last_change":"2023-11-04T01:42:21.126193+0000","last_active":"2023-11-04T01:43:16.164153+0000","last_peered":"2023-11-04T01:43:16.164153+0000","last_clean":"2023-11-04T01:43:16.164153+0000","last_became_active":"2023-11-04T01:42:21.125436+0000","last_became_peered":"2023-11-04T01:42:21.125436+0000","last_unstale":"2023-11-04T01:43:16.164153+0000","last_undegraded":"2023-11-04T01:43:16.164153+0000","last_fullsized":"2023-11-04T01:43:16.164153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:32.362333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.140348+0000","last_change":"2023-11-04T01:42:22.703294+0000","last_active":"2023-11-04T01:43:16.140348+0000","last_peered":"2023-11-04T01:43:16.140348+0000","last_clean":"2023-11-04T01:43:16.140348+0000","last_became_active":"2023-11-04T01:42:20.144671+0000","last_became_peered":"2023-11-04T01:42:20.144671+0000","last_unstale":"2023-11-04T01:43:16.140348+0000","last_undegraded":"2023-11-04T01:43:16.140348+0000","last_fullsized":"2023-11-04T01:43:16.140348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:44.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019641049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157933+0000","last_change":"2023-11-04T01:39:47.068738+0000","last_active":"2023-11-04T01:43:16.157933+0000","last_peered":"2023-11-04T01:43:16.157933+0000","last_clean":"2023-11-04T01:43:16.157933+0000","last_became_active":"2023-11-04T01:39:47.066269+0000","last_became_peered":"2023-11-04T01:39:47.066269+0000","last_unstale":"2023-11-04T01:43:16.157933+0000","last_undegraded":"2023-11-04T01:43:16.157933+0000","last_fullsized":"2023-11-04T01:43:16.157933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:45.859578+0000","last_clean_scrub_stamp":"2023-11-04T01:39:45.859578+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:16:07.023056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.147775+0000","last_change":"2023-11-04T01:41:13.091584+0000","last_active":"2023-11-04T01:43:16.147775+0000","last_peered":"2023-11-04T01:43:16.147775+0000","last_clean":"2023-11-04T01:43:16.147775+0000","last_became_active":"2023-11-04T01:41:12.097779+0000","last_became_peered":"2023-11-04T01:41:12.097779+0000","last_unstale":"2023-11-04T01:43:16.147775+0000","last_undegraded":"2023-11-04T01:43:16.147775+0000","last_fullsized":"2023-11-04T01:43:16.147775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043836,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211930+0000","last_change":"2023-11-04T01:43:16.175852+0000","last_active":"2023-11-04T01:43:17.211930+0000","last_peered":"2023-11-04T01:43:17.211930+0000","last_clean":"2023-11-04T01:43:17.211930+0000","last_became_active":"2023-11-04T01:43:16.173478+0000","last_became_peered":"2023-11-04T01:43:16.173478+0000","last_unstale":"2023-11-04T01:43:17.211930+0000","last_undegraded":"2023-11-04T01:43:17.211930+0000","last_fullsized":"2023-11-04T01:43:17.211930+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:12.481145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.192765+0000","last_change":"2023-11-04T01:43:15.134346+0000","last_active":"2023-11-04T01:43:16.192765+0000","last_peered":"2023-11-04T01:43:16.192765+0000","last_clean":"2023-11-04T01:43:16.192765+0000","last_became_active":"2023-11-04T01:43:15.133897+0000","last_became_peered":"2023-11-04T01:43:15.133897+0000","last_unstale":"2023-11-04T01:43:16.192765+0000","last_undegraded":"2023-11-04T01:43:16.192765+0000","last_fullsized":"2023-11-04T01:43:16.192765+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:06:49.525817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.138175+0000","last_change":"2023-11-04T01:42:21.120240+0000","last_active":"2023-11-04T01:43:16.138175+0000","last_peered":"2023-11-04T01:43:16.138175+0000","last_clean":"2023-11-04T01:43:16.138175+0000","last_became_active":"2023-11-04T01:42:21.119647+0000","last_became_peered":"2023-11-04T01:42:21.119647+0000","last_unstale":"2023-11-04T01:43:16.138175+0000","last_undegraded":"2023-11-04T01:43:16.138175+0000","last_fullsized":"2023-11-04T01:43:16.138175+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:50.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157633+0000","last_change":"2023-11-04T01:42:22.665191+0000","last_active":"2023-11-04T01:43:16.157633+0000","last_peered":"2023-11-04T01:43:16.157633+0000","last_clean":"2023-11-04T01:43:16.157633+0000","last_became_active":"2023-11-04T01:42:20.134020+0000","last_became_peered":"2023-11-04T01:42:20.134020+0000","last_unstale":"2023-11-04T01:43:16.157633+0000","last_undegraded":"2023-11-04T01:43:16.157633+0000","last_fullsized":"2023-11-04T01:43:16.157633+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:57.232210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001868761,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214854+0000","last_change":"2023-11-04T01:41:13.479624+0000","last_active":"2023-11-04T01:43:17.214854+0000","last_peered":"2023-11-04T01:43:17.214854+0000","last_clean":"2023-11-04T01:43:17.214854+0000","last_became_active":"2023-11-04T01:41:12.109091+0000","last_became_peered":"2023-11-04T01:41:12.109091+0000","last_unstale":"2023-11-04T01:43:17.214854+0000","last_undegraded":"2023-11-04T01:43:17.214854+0000","last_fullsized":"2023-11-04T01:43:17.214854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014099850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212262+0000","last_change":"2023-11-04T01:43:16.177350+0000","last_active":"2023-11-04T01:43:17.212262+0000","last_peered":"2023-11-04T01:43:17.212262+0000","last_clean":"2023-11-04T01:43:17.212262+0000","last_became_active":"2023-11-04T01:43:16.176560+0000","last_became_peered":"2023-11-04T01:43:16.176560+0000","last_unstale":"2023-11-04T01:43:17.212262+0000","last_undegraded":"2023-11-04T01:43:17.212262+0000","last_fullsized":"2023-11-04T01:43:17.212262+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:46.692837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.162969+0000","last_change":"2023-11-04T01:43:15.158367+0000","last_active":"2023-11-04T01:43:16.162969+0000","last_peered":"2023-11-04T01:43:16.162969+0000","last_clean":"2023-11-04T01:43:16.162969+0000","last_became_active":"2023-11-04T01:43:15.157718+0000","last_became_peered":"2023-11-04T01:43:15.157718+0000","last_unstale":"2023-11-04T01:43:16.162969+0000","last_undegraded":"2023-11-04T01:43:16.162969+0000","last_fullsized":"2023-11-04T01:43:16.162969+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:23.772777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157505+0000","last_change":"2023-11-04T01:42:21.137514+0000","last_active":"2023-11-04T01:43:16.157505+0000","last_peered":"2023-11-04T01:43:16.157505+0000","last_clean":"2023-11-04T01:43:16.157505+0000","last_became_active":"2023-11-04T01:42:21.137029+0000","last_became_peered":"2023-11-04T01:42:21.137029+0000","last_unstale":"2023-11-04T01:43:16.157505+0000","last_undegraded":"2023-11-04T01:43:16.157505+0000","last_fullsized":"2023-11-04T01:43:16.157505+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:54.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.161716+0000","last_change":"2023-11-04T01:42:22.123915+0000","last_active":"2023-11-04T01:43:16.161716+0000","last_peered":"2023-11-04T01:43:16.161716+0000","last_clean":"2023-11-04T01:43:16.161716+0000","last_became_active":"2023-11-04T01:42:20.126317+0000","last_became_peered":"2023-11-04T01:42:20.126317+0000","last_unstale":"2023-11-04T01:43:16.161716+0000","last_undegraded":"2023-11-04T01:43:16.161716+0000","last_fullsized":"2023-11-04T01:43:16.161716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010659230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214431+0000","last_change":"2023-11-04T01:41:13.630599+0000","last_active":"2023-11-04T01:43:17.214431+0000","last_peered":"2023-11-04T01:43:17.214431+0000","last_clean":"2023-11-04T01:43:17.214431+0000","last_became_active":"2023-11-04T01:41:12.119123+0000","last_became_peered":"2023-11-04T01:41:12.119123+0000","last_unstale":"2023-11-04T01:43:17.214431+0000","last_undegraded":"2023-11-04T01:43:17.214431+0000","last_fullsized":"2023-11-04T01:43:17.214431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:49.778706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013347210000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211504+0000","last_change":"2023-11-04T01:43:16.170220+0000","last_active":"2023-11-04T01:43:17.211504+0000","last_peered":"2023-11-04T01:43:17.211504+0000","last_clean":"2023-11-04T01:43:17.211504+0000","last_became_active":"2023-11-04T01:43:16.169727+0000","last_became_peered":"2023-11-04T01:43:16.169727+0000","last_unstale":"2023-11-04T01:43:17.211504+0000","last_undegraded":"2023-11-04T01:43:17.211504+0000","last_fullsized":"2023-11-04T01:43:17.211504+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:09:42.728476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.156682+0000","last_change":"2023-11-04T01:43:15.162827+0000","last_active":"2023-11-04T01:43:16.156682+0000","last_peered":"2023-11-04T01:43:16.156682+0000","last_clean":"2023-11-04T01:43:16.156682+0000","last_became_active":"2023-11-04T01:43:15.162272+0000","last_became_peered":"2023-11-04T01:43:15.162272+0000","last_unstale":"2023-11-04T01:43:16.156682+0000","last_undegraded":"2023-11-04T01:43:16.156682+0000","last_fullsized":"2023-11-04T01:43:16.156682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:54.143200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.162491+0000","last_change":"2023-11-04T01:42:21.125224+0000","last_active":"2023-11-04T01:43:16.162491+0000","last_peered":"2023-11-04T01:43:16.162491+0000","last_clean":"2023-11-04T01:43:16.162491+0000","last_became_active":"2023-11-04T01:42:21.124760+0000","last_became_peered":"2023-11-04T01:42:21.124760+0000","last_unstale":"2023-11-04T01:43:16.162491+0000","last_undegraded":"2023-11-04T01:43:16.162491+0000","last_fullsized":"2023-11-04T01:43:16.162491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:47.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157444+0000","last_change":"2023-11-04T01:42:22.709347+0000","last_active":"2023-11-04T01:43:16.157444+0000","last_peered":"2023-11-04T01:43:16.157444+0000","last_clean":"2023-11-04T01:43:16.157444+0000","last_became_active":"2023-11-04T01:42:20.123578+0000","last_became_peered":"2023-11-04T01:42:20.123578+0000","last_unstale":"2023-11-04T01:43:16.157444+0000","last_undegraded":"2023-11-04T01:43:16.157444+0000","last_fullsized":"2023-11-04T01:43:16.157444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:07.432117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041495680000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160324+0000","last_change":"2023-11-04T01:41:13.791091+0000","last_active":"2023-11-04T01:43:16.160324+0000","last_peered":"2023-11-04T01:43:16.160324+0000","last_clean":"2023-11-04T01:43:16.160324+0000","last_became_active":"2023-11-04T01:41:12.097805+0000","last_became_peered":"2023-11-04T01:41:12.097805+0000","last_unstale":"2023-11-04T01:43:16.160324+0000","last_undegraded":"2023-11-04T01:43:16.160324+0000","last_fullsized":"2023-11-04T01:43:16.160324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:28.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001630779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.141986+0000","last_change":"2023-11-04T01:43:16.188055+0000","last_active":"2023-11-04T01:43:17.141986+0000","last_peered":"2023-11-04T01:43:17.141986+0000","last_clean":"2023-11-04T01:43:17.141986+0000","last_became_active":"2023-11-04T01:43:16.187363+0000","last_became_peered":"2023-11-04T01:43:16.187363+0000","last_unstale":"2023-11-04T01:43:17.141986+0000","last_undegraded":"2023-11-04T01:43:17.141986+0000","last_fullsized":"2023-11-04T01:43:17.141986+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:48.411128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.153899+0000","last_change":"2023-11-04T01:43:15.146655+0000","last_active":"2023-11-04T01:43:16.153899+0000","last_peered":"2023-11-04T01:43:16.153899+0000","last_clean":"2023-11-04T01:43:16.153899+0000","last_became_active":"2023-11-04T01:43:15.145780+0000","last_became_peered":"2023-11-04T01:43:15.145780+0000","last_unstale":"2023-11-04T01:43:16.153899+0000","last_undegraded":"2023-11-04T01:43:16.153899+0000","last_fullsized":"2023-11-04T01:43:16.153899+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:07:34.957161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.139744+0000","last_change":"2023-11-04T01:42:21.121823+0000","last_active":"2023-11-04T01:43:16.139744+0000","last_peered":"2023-11-04T01:43:16.139744+0000","last_clean":"2023-11-04T01:43:16.139744+0000","last_became_active":"2023-11-04T01:42:21.121212+0000","last_became_peered":"2023-11-04T01:42:21.121212+0000","last_unstale":"2023-11-04T01:43:16.139744+0000","last_undegraded":"2023-11-04T01:43:16.139744+0000","last_fullsized":"2023-11-04T01:43:16.139744+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:10:01.776084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.169374+0000","last_change":"2023-11-04T01:42:22.389641+0000","last_active":"2023-11-04T01:43:16.169374+0000","last_peered":"2023-11-04T01:43:16.169374+0000","last_clean":"2023-11-04T01:43:16.169374+0000","last_became_active":"2023-11-04T01:42:20.121048+0000","last_became_peered":"2023-11-04T01:42:20.121048+0000","last_unstale":"2023-11-04T01:43:16.169374+0000","last_undegraded":"2023-11-04T01:43:16.169374+0000","last_fullsized":"2023-11-04T01:43:16.169374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:11.368879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012736049999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214311+0000","last_change":"2023-11-04T01:41:13.218082+0000","last_active":"2023-11-04T01:43:17.214311+0000","last_peered":"2023-11-04T01:43:17.214311+0000","last_clean":"2023-11-04T01:43:17.214311+0000","last_became_active":"2023-11-04T01:41:12.095590+0000","last_became_peered":"2023-11-04T01:41:12.095590+0000","last_unstale":"2023-11-04T01:43:17.214311+0000","last_undegraded":"2023-11-04T01:43:17.214311+0000","last_fullsized":"2023-11-04T01:43:17.214311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:15.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011607799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.141350+0000","last_change":"2023-11-04T01:43:16.176549+0000","last_active":"2023-11-04T01:43:17.141350+0000","last_peered":"2023-11-04T01:43:17.141350+0000","last_clean":"2023-11-04T01:43:17.141350+0000","last_became_active":"2023-11-04T01:43:16.176044+0000","last_became_peered":"2023-11-04T01:43:16.176044+0000","last_unstale":"2023-11-04T01:43:17.141350+0000","last_undegraded":"2023-11-04T01:43:17.141350+0000","last_fullsized":"2023-11-04T01:43:17.141350+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:17.151604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.214934+0000","last_change":"2023-11-04T01:43:15.148592+0000","last_active":"2023-11-04T01:43:16.214934+0000","last_peered":"2023-11-04T01:43:16.214934+0000","last_clean":"2023-11-04T01:43:16.214934+0000","last_became_active":"2023-11-04T01:43:15.147892+0000","last_became_peered":"2023-11-04T01:43:15.147892+0000","last_unstale":"2023-11-04T01:43:16.214934+0000","last_undegraded":"2023-11-04T01:43:16.214934+0000","last_fullsized":"2023-11-04T01:43:16.214934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:59:54.786903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177931+0000","last_change":"2023-11-04T01:42:21.118274+0000","last_active":"2023-11-04T01:43:16.177931+0000","last_peered":"2023-11-04T01:43:16.177931+0000","last_clean":"2023-11-04T01:43:16.177931+0000","last_became_active":"2023-11-04T01:42:21.117887+0000","last_became_peered":"2023-11-04T01:42:21.117887+0000","last_unstale":"2023-11-04T01:43:16.177931+0000","last_undegraded":"2023-11-04T01:43:16.177931+0000","last_fullsized":"2023-11-04T01:43:16.177931+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:12:02.327584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.140398+0000","last_change":"2023-11-04T01:42:22.704610+0000","last_active":"2023-11-04T01:43:16.140398+0000","last_peered":"2023-11-04T01:43:16.140398+0000","last_clean":"2023-11-04T01:43:16.140398+0000","last_became_active":"2023-11-04T01:42:20.122300+0000","last_became_peered":"2023-11-04T01:42:20.122300+0000","last_unstale":"2023-11-04T01:43:16.140398+0000","last_undegraded":"2023-11-04T01:43:16.140398+0000","last_fullsized":"2023-11-04T01:43:16.140398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:35.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033105320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.139954+0000","last_change":"2023-11-04T01:41:13.611576+0000","last_active":"2023-11-04T01:43:16.139954+0000","last_peered":"2023-11-04T01:43:16.139954+0000","last_clean":"2023-11-04T01:43:16.139954+0000","last_became_active":"2023-11-04T01:41:12.114467+0000","last_became_peered":"2023-11-04T01:41:12.114467+0000","last_unstale":"2023-11-04T01:43:16.139954+0000","last_undegraded":"2023-11-04T01:43:16.139954+0000","last_fullsized":"2023-11-04T01:43:16.139954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:44.739381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014910819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.145462+0000","last_change":"2023-11-04T01:43:16.184301+0000","last_active":"2023-11-04T01:43:17.145462+0000","last_peered":"2023-11-04T01:43:17.145462+0000","last_clean":"2023-11-04T01:43:17.145462+0000","last_became_active":"2023-11-04T01:43:16.183605+0000","last_became_peered":"2023-11-04T01:43:16.183605+0000","last_unstale":"2023-11-04T01:43:17.145462+0000","last_undegraded":"2023-11-04T01:43:17.145462+0000","last_fullsized":"2023-11-04T01:43:17.145462+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:34.245081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.214487+0000","last_change":"2023-11-04T01:43:15.146312+0000","last_active":"2023-11-04T01:43:16.214487+0000","last_peered":"2023-11-04T01:43:16.214487+0000","last_clean":"2023-11-04T01:43:16.214487+0000","last_became_active":"2023-11-04T01:43:15.145470+0000","last_became_peered":"2023-11-04T01:43:15.145470+0000","last_unstale":"2023-11-04T01:43:16.214487+0000","last_undegraded":"2023-11-04T01:43:16.214487+0000","last_fullsized":"2023-11-04T01:43:16.214487+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:37.815400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.178626+0000","last_change":"2023-11-04T01:42:21.122232+0000","last_active":"2023-11-04T01:43:16.178626+0000","last_peered":"2023-11-04T01:43:16.178626+0000","last_clean":"2023-11-04T01:43:16.178626+0000","last_became_active":"2023-11-04T01:42:21.121817+0000","last_became_peered":"2023-11-04T01:42:21.121817+0000","last_unstale":"2023-11-04T01:43:16.178626+0000","last_undegraded":"2023-11-04T01:43:16.178626+0000","last_fullsized":"2023-11-04T01:43:16.178626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:35.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.138286+0000","last_change":"2023-11-04T01:42:22.706934+0000","last_active":"2023-11-04T01:43:16.138286+0000","last_peered":"2023-11-04T01:43:16.138286+0000","last_clean":"2023-11-04T01:43:16.138286+0000","last_became_active":"2023-11-04T01:42:20.147248+0000","last_became_peered":"2023-11-04T01:42:20.147248+0000","last_unstale":"2023-11-04T01:43:16.138286+0000","last_undegraded":"2023-11-04T01:43:16.138286+0000","last_fullsized":"2023-11-04T01:43:16.138286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:28.527092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00170835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":68,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214954+0000","last_change":"2023-11-04T01:41:13.218599+0000","last_active":"2023-11-04T01:43:17.214954+0000","last_peered":"2023-11-04T01:43:17.214954+0000","last_clean":"2023-11-04T01:43:17.214954+0000","last_became_active":"2023-11-04T01:41:12.090520+0000","last_became_peered":"2023-11-04T01:41:12.090520+0000","last_unstale":"2023-11-04T01:43:17.214954+0000","last_undegraded":"2023-11-04T01:43:17.214954+0000","last_fullsized":"2023-11-04T01:43:17.214954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016365469999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214097+0000","last_change":"2023-11-04T01:43:16.174854+0000","last_active":"2023-11-04T01:43:17.214097+0000","last_peered":"2023-11-04T01:43:17.214097+0000","last_clean":"2023-11-04T01:43:17.214097+0000","last_became_active":"2023-11-04T01:43:16.174120+0000","last_became_peered":"2023-11-04T01:43:16.174120+0000","last_unstale":"2023-11-04T01:43:17.214097+0000","last_undegraded":"2023-11-04T01:43:17.214097+0000","last_fullsized":"2023-11-04T01:43:17.214097+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:45:12.796426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.146303+0000","last_change":"2023-11-04T01:43:15.164771+0000","last_active":"2023-11-04T01:43:16.146303+0000","last_peered":"2023-11-04T01:43:16.146303+0000","last_clean":"2023-11-04T01:43:16.146303+0000","last_became_active":"2023-11-04T01:43:15.164172+0000","last_became_peered":"2023-11-04T01:43:15.164172+0000","last_unstale":"2023-11-04T01:43:16.146303+0000","last_undegraded":"2023-11-04T01:43:16.146303+0000","last_fullsized":"2023-11-04T01:43:16.146303+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:33.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159736+0000","last_change":"2023-11-04T01:42:21.139724+0000","last_active":"2023-11-04T01:43:16.159736+0000","last_peered":"2023-11-04T01:43:16.159736+0000","last_clean":"2023-11-04T01:43:16.159736+0000","last_became_active":"2023-11-04T01:42:21.139276+0000","last_became_peered":"2023-11-04T01:42:21.139276+0000","last_unstale":"2023-11-04T01:43:16.159736+0000","last_undegraded":"2023-11-04T01:43:16.159736+0000","last_fullsized":"2023-11-04T01:43:16.159736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.138439+0000","last_change":"2023-11-04T01:42:22.702684+0000","last_active":"2023-11-04T01:43:16.138439+0000","last_peered":"2023-11-04T01:43:16.138439+0000","last_clean":"2023-11-04T01:43:16.138439+0000","last_became_active":"2023-11-04T01:42:20.138932+0000","last_became_peered":"2023-11-04T01:42:20.138932+0000","last_unstale":"2023-11-04T01:43:16.138439+0000","last_undegraded":"2023-11-04T01:43:16.138439+0000","last_fullsized":"2023-11-04T01:43:16.138439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:46.594137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214648+0000","last_change":"2023-11-04T01:41:13.631339+0000","last_active":"2023-11-04T01:43:17.214648+0000","last_peered":"2023-11-04T01:43:17.214648+0000","last_clean":"2023-11-04T01:43:17.214648+0000","last_became_active":"2023-11-04T01:41:12.118806+0000","last_became_peered":"2023-11-04T01:41:12.118806+0000","last_unstale":"2023-11-04T01:43:17.214648+0000","last_undegraded":"2023-11-04T01:43:17.214648+0000","last_fullsized":"2023-11-04T01:43:17.214648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:28.406509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001778838,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.142004+0000","last_change":"2023-11-04T01:43:16.182011+0000","last_active":"2023-11-04T01:43:17.142004+0000","last_peered":"2023-11-04T01:43:17.142004+0000","last_clean":"2023-11-04T01:43:17.142004+0000","last_became_active":"2023-11-04T01:43:16.181519+0000","last_became_peered":"2023-11-04T01:43:16.181519+0000","last_unstale":"2023-11-04T01:43:17.142004+0000","last_undegraded":"2023-11-04T01:43:17.142004+0000","last_fullsized":"2023-11-04T01:43:17.142004+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:26:00.679324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160354+0000","last_change":"2023-11-04T01:43:15.162799+0000","last_active":"2023-11-04T01:43:16.160354+0000","last_peered":"2023-11-04T01:43:16.160354+0000","last_clean":"2023-11-04T01:43:16.160354+0000","last_became_active":"2023-11-04T01:43:15.162068+0000","last_became_peered":"2023-11-04T01:43:15.162068+0000","last_unstale":"2023-11-04T01:43:16.160354+0000","last_undegraded":"2023-11-04T01:43:16.160354+0000","last_fullsized":"2023-11-04T01:43:16.160354+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:35.443238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.151602+0000","last_change":"2023-11-04T01:42:21.139381+0000","last_active":"2023-11-04T01:43:16.151602+0000","last_peered":"2023-11-04T01:43:16.151602+0000","last_clean":"2023-11-04T01:43:16.151602+0000","last_became_active":"2023-11-04T01:42:21.138541+0000","last_became_peered":"2023-11-04T01:42:21.138541+0000","last_unstale":"2023-11-04T01:43:16.151602+0000","last_undegraded":"2023-11-04T01:43:16.151602+0000","last_fullsized":"2023-11-04T01:43:16.151602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:08.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.147581+0000","last_change":"2023-11-04T01:42:22.122439+0000","last_active":"2023-11-04T01:43:16.147581+0000","last_peered":"2023-11-04T01:43:16.147581+0000","last_clean":"2023-11-04T01:43:16.147581+0000","last_became_active":"2023-11-04T01:42:20.126758+0000","last_became_peered":"2023-11-04T01:42:20.126758+0000","last_unstale":"2023-11-04T01:43:16.147581+0000","last_undegraded":"2023-11-04T01:43:16.147581+0000","last_fullsized":"2023-11-04T01:43:16.147581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:50:17.208788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014998990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.146154+0000","last_change":"2023-11-04T01:41:13.089284+0000","last_active":"2023-11-04T01:43:16.146154+0000","last_peered":"2023-11-04T01:43:16.146154+0000","last_clean":"2023-11-04T01:43:16.146154+0000","last_became_active":"2023-11-04T01:41:12.091437+0000","last_became_peered":"2023-11-04T01:41:12.091437+0000","last_unstale":"2023-11-04T01:43:16.146154+0000","last_undegraded":"2023-11-04T01:43:16.146154+0000","last_fullsized":"2023-11-04T01:43:16.146154+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.180872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014024420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.143185+0000","last_change":"2023-11-04T01:43:16.187956+0000","last_active":"2023-11-04T01:43:17.143185+0000","last_peered":"2023-11-04T01:43:17.143185+0000","last_clean":"2023-11-04T01:43:17.143185+0000","last_became_active":"2023-11-04T01:43:16.187646+0000","last_became_peered":"2023-11-04T01:43:16.187646+0000","last_unstale":"2023-11-04T01:43:17.143185+0000","last_undegraded":"2023-11-04T01:43:17.143185+0000","last_fullsized":"2023-11-04T01:43:17.143185+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:53.264690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.161940+0000","last_change":"2023-11-04T01:43:15.132590+0000","last_active":"2023-11-04T01:43:16.161940+0000","last_peered":"2023-11-04T01:43:16.161940+0000","last_clean":"2023-11-04T01:43:16.161940+0000","last_became_active":"2023-11-04T01:43:15.132101+0000","last_became_peered":"2023-11-04T01:43:15.132101+0000","last_unstale":"2023-11-04T01:43:16.161940+0000","last_undegraded":"2023-11-04T01:43:16.161940+0000","last_fullsized":"2023-11-04T01:43:16.161940+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:58.367027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157038+0000","last_change":"2023-11-04T01:42:21.139094+0000","last_active":"2023-11-04T01:43:16.157038+0000","last_peered":"2023-11-04T01:43:16.157038+0000","last_clean":"2023-11-04T01:43:16.157038+0000","last_became_active":"2023-11-04T01:42:21.138184+0000","last_became_peered":"2023-11-04T01:42:21.138184+0000","last_unstale":"2023-11-04T01:43:16.157038+0000","last_undegraded":"2023-11-04T01:43:16.157038+0000","last_fullsized":"2023-11-04T01:43:16.157038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.178527+0000","last_change":"2023-11-04T01:42:22.118119+0000","last_active":"2023-11-04T01:43:16.178527+0000","last_peered":"2023-11-04T01:43:16.178527+0000","last_clean":"2023-11-04T01:43:16.178527+0000","last_became_active":"2023-11-04T01:42:20.125049+0000","last_became_peered":"2023-11-04T01:42:20.125049+0000","last_unstale":"2023-11-04T01:43:16.178527+0000","last_undegraded":"2023-11-04T01:43:16.178527+0000","last_fullsized":"2023-11-04T01:43:16.178527+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:31.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237964,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.140566+0000","last_change":"2023-11-04T01:41:13.611081+0000","last_active":"2023-11-04T01:43:16.140566+0000","last_peered":"2023-11-04T01:43:16.140566+0000","last_clean":"2023-11-04T01:43:16.140566+0000","last_became_active":"2023-11-04T01:41:12.096433+0000","last_became_peered":"2023-11-04T01:41:12.096433+0000","last_unstale":"2023-11-04T01:43:16.140566+0000","last_undegraded":"2023-11-04T01:43:16.140566+0000","last_fullsized":"2023-11-04T01:43:16.140566+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:35.074038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015575109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.215300+0000","last_change":"2023-11-04T01:43:16.189124+0000","last_active":"2023-11-04T01:43:17.215300+0000","last_peered":"2023-11-04T01:43:17.215300+0000","last_clean":"2023-11-04T01:43:17.215300+0000","last_became_active":"2023-11-04T01:43:16.188462+0000","last_became_peered":"2023-11-04T01:43:16.188462+0000","last_unstale":"2023-11-04T01:43:17.215300+0000","last_undegraded":"2023-11-04T01:43:17.215300+0000","last_fullsized":"2023-11-04T01:43:17.215300+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:20.007684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.156831+0000","last_change":"2023-11-04T01:43:15.161698+0000","last_active":"2023-11-04T01:43:16.156831+0000","last_peered":"2023-11-04T01:43:16.156831+0000","last_clean":"2023-11-04T01:43:16.156831+0000","last_became_active":"2023-11-04T01:43:15.161055+0000","last_became_peered":"2023-11-04T01:43:15.161055+0000","last_unstale":"2023-11-04T01:43:16.156831+0000","last_undegraded":"2023-11-04T01:43:16.156831+0000","last_fullsized":"2023-11-04T01:43:16.156831+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:45:16.982578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.158980+0000","last_change":"2023-11-04T01:42:21.126182+0000","last_active":"2023-11-04T01:43:16.158980+0000","last_peered":"2023-11-04T01:43:16.158980+0000","last_clean":"2023-11-04T01:43:16.158980+0000","last_became_active":"2023-11-04T01:42:21.125340+0000","last_became_peered":"2023-11-04T01:42:21.125340+0000","last_unstale":"2023-11-04T01:43:16.158980+0000","last_undegraded":"2023-11-04T01:43:16.158980+0000","last_fullsized":"2023-11-04T01:43:16.158980+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:52:33.143984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.164337+0000","last_change":"2023-11-04T01:42:22.665805+0000","last_active":"2023-11-04T01:43:16.164337+0000","last_peered":"2023-11-04T01:43:16.164337+0000","last_clean":"2023-11-04T01:43:16.164337+0000","last_became_active":"2023-11-04T01:42:20.134758+0000","last_became_peered":"2023-11-04T01:42:20.134758+0000","last_unstale":"2023-11-04T01:43:16.164337+0000","last_undegraded":"2023-11-04T01:43:16.164337+0000","last_fullsized":"2023-11-04T01:43:16.164337+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:42.787120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002112044,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157689+0000","last_change":"2023-11-04T01:41:13.630986+0000","last_active":"2023-11-04T01:43:16.157689+0000","last_peered":"2023-11-04T01:43:16.157689+0000","last_clean":"2023-11-04T01:43:16.157689+0000","last_became_active":"2023-11-04T01:41:12.118699+0000","last_became_peered":"2023-11-04T01:41:12.118699+0000","last_unstale":"2023-11-04T01:43:16.157689+0000","last_undegraded":"2023-11-04T01:43:16.157689+0000","last_fullsized":"2023-11-04T01:43:16.157689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:31:35.756842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001484965,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.146444+0000","last_change":"2023-11-04T01:43:16.189037+0000","last_active":"2023-11-04T01:43:17.146444+0000","last_peered":"2023-11-04T01:43:17.146444+0000","last_clean":"2023-11-04T01:43:17.146444+0000","last_became_active":"2023-11-04T01:43:16.188184+0000","last_became_peered":"2023-11-04T01:43:16.188184+0000","last_unstale":"2023-11-04T01:43:17.146444+0000","last_undegraded":"2023-11-04T01:43:17.146444+0000","last_fullsized":"2023-11-04T01:43:17.146444+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:50.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.154252+0000","last_change":"2023-11-04T01:43:15.133081+0000","last_active":"2023-11-04T01:43:16.154252+0000","last_peered":"2023-11-04T01:43:16.154252+0000","last_clean":"2023-11-04T01:43:16.154252+0000","last_became_active":"2023-11-04T01:43:15.132291+0000","last_became_peered":"2023-11-04T01:43:15.132291+0000","last_unstale":"2023-11-04T01:43:16.154252+0000","last_undegraded":"2023-11-04T01:43:16.154252+0000","last_fullsized":"2023-11-04T01:43:16.154252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:44.118725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177134+0000","last_change":"2023-11-04T01:42:21.131590+0000","last_active":"2023-11-04T01:43:16.177134+0000","last_peered":"2023-11-04T01:43:16.177134+0000","last_clean":"2023-11-04T01:43:16.177134+0000","last_became_active":"2023-11-04T01:42:21.131263+0000","last_became_peered":"2023-11-04T01:42:21.131263+0000","last_unstale":"2023-11-04T01:43:16.177134+0000","last_undegraded":"2023-11-04T01:43:16.177134+0000","last_fullsized":"2023-11-04T01:43:16.177134+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:14.423906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.164996+0000","last_change":"2023-11-04T01:42:22.662786+0000","last_active":"2023-11-04T01:43:16.164996+0000","last_peered":"2023-11-04T01:43:16.164996+0000","last_clean":"2023-11-04T01:43:16.164996+0000","last_became_active":"2023-11-04T01:42:20.148991+0000","last_became_peered":"2023-11-04T01:42:20.148991+0000","last_unstale":"2023-11-04T01:43:16.164996+0000","last_undegraded":"2023-11-04T01:43:16.164996+0000","last_fullsized":"2023-11-04T01:43:16.164996+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:34.284611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177389+0000","last_change":"2023-11-04T01:41:13.791474+0000","last_active":"2023-11-04T01:43:16.177389+0000","last_peered":"2023-11-04T01:43:16.177389+0000","last_clean":"2023-11-04T01:43:16.177389+0000","last_became_active":"2023-11-04T01:41:12.104656+0000","last_became_peered":"2023-11-04T01:41:12.104656+0000","last_unstale":"2023-11-04T01:43:16.177389+0000","last_undegraded":"2023-11-04T01:43:16.177389+0000","last_fullsized":"2023-11-04T01:43:16.177389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.807412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017345780000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.210285+0000","last_change":"2023-11-04T01:43:16.173695+0000","last_active":"2023-11-04T01:43:17.210285+0000","last_peered":"2023-11-04T01:43:17.210285+0000","last_clean":"2023-11-04T01:43:17.210285+0000","last_became_active":"2023-11-04T01:43:16.172929+0000","last_became_peered":"2023-11-04T01:43:16.172929+0000","last_unstale":"2023-11-04T01:43:17.210285+0000","last_undegraded":"2023-11-04T01:43:17.210285+0000","last_fullsized":"2023-11-04T01:43:17.210285+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:13.073385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.195524+0000","last_change":"2023-11-04T01:43:15.153802+0000","last_active":"2023-11-04T01:43:16.195524+0000","last_peered":"2023-11-04T01:43:16.195524+0000","last_clean":"2023-11-04T01:43:16.195524+0000","last_became_active":"2023-11-04T01:43:15.153029+0000","last_became_peered":"2023-11-04T01:43:15.153029+0000","last_unstale":"2023-11-04T01:43:16.195524+0000","last_undegraded":"2023-11-04T01:43:16.195524+0000","last_fullsized":"2023-11-04T01:43:16.195524+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:46.292133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159462+0000","last_change":"2023-11-04T01:42:21.134597+0000","last_active":"2023-11-04T01:43:16.159462+0000","last_peered":"2023-11-04T01:43:16.159462+0000","last_clean":"2023-11-04T01:43:16.159462+0000","last_became_active":"2023-11-04T01:42:21.133554+0000","last_became_peered":"2023-11-04T01:42:21.133554+0000","last_unstale":"2023-11-04T01:43:16.159462+0000","last_undegraded":"2023-11-04T01:43:16.159462+0000","last_fullsized":"2023-11-04T01:43:16.159462+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.162736+0000","last_change":"2023-11-04T01:42:22.506990+0000","last_active":"2023-11-04T01:43:16.162736+0000","last_peered":"2023-11-04T01:43:16.162736+0000","last_clean":"2023-11-04T01:43:16.162736+0000","last_became_active":"2023-11-04T01:42:20.139596+0000","last_became_peered":"2023-11-04T01:42:20.139596+0000","last_unstale":"2023-11-04T01:43:16.162736+0000","last_undegraded":"2023-11-04T01:43:16.162736+0000","last_fullsized":"2023-11-04T01:43:16.162736+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.875308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013629580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.161931+0000","last_change":"2023-11-04T01:41:13.480904+0000","last_active":"2023-11-04T01:43:16.161931+0000","last_peered":"2023-11-04T01:43:16.161931+0000","last_clean":"2023-11-04T01:43:16.161931+0000","last_became_active":"2023-11-04T01:41:12.114443+0000","last_became_peered":"2023-11-04T01:41:12.114443+0000","last_unstale":"2023-11-04T01:43:16.161931+0000","last_undegraded":"2023-11-04T01:43:16.161931+0000","last_fullsized":"2023-11-04T01:43:16.161931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:07.751618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017595759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212885+0000","last_change":"2023-11-04T01:43:16.181951+0000","last_active":"2023-11-04T01:43:17.212885+0000","last_peered":"2023-11-04T01:43:17.212885+0000","last_clean":"2023-11-04T01:43:17.212885+0000","last_became_active":"2023-11-04T01:43:16.181253+0000","last_became_peered":"2023-11-04T01:43:16.181253+0000","last_unstale":"2023-11-04T01:43:17.212885+0000","last_undegraded":"2023-11-04T01:43:17.212885+0000","last_fullsized":"2023-11-04T01:43:17.212885+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:24.858407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211570+0000","last_change":"2023-11-04T01:43:15.134863+0000","last_active":"2023-11-04T01:43:17.211570+0000","last_peered":"2023-11-04T01:43:17.211570+0000","last_clean":"2023-11-04T01:43:17.211570+0000","last_became_active":"2023-11-04T01:43:15.134171+0000","last_became_peered":"2023-11-04T01:43:15.134171+0000","last_unstale":"2023-11-04T01:43:17.211570+0000","last_undegraded":"2023-11-04T01:43:17.211570+0000","last_fullsized":"2023-11-04T01:43:17.211570+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:10.479487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.163619+0000","last_change":"2023-11-04T01:42:21.133862+0000","last_active":"2023-11-04T01:43:16.163619+0000","last_peered":"2023-11-04T01:43:16.163619+0000","last_clean":"2023-11-04T01:43:16.163619+0000","last_became_active":"2023-11-04T01:42:21.132963+0000","last_became_peered":"2023-11-04T01:42:21.132963+0000","last_unstale":"2023-11-04T01:43:16.163619+0000","last_undegraded":"2023-11-04T01:43:16.163619+0000","last_fullsized":"2023-11-04T01:43:16.163619+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.162296+0000","last_change":"2023-11-04T01:42:22.706009+0000","last_active":"2023-11-04T01:43:16.162296+0000","last_peered":"2023-11-04T01:43:16.162296+0000","last_clean":"2023-11-04T01:43:16.162296+0000","last_became_active":"2023-11-04T01:42:20.132569+0000","last_became_peered":"2023-11-04T01:42:20.132569+0000","last_unstale":"2023-11-04T01:43:16.162296+0000","last_undegraded":"2023-11-04T01:43:16.162296+0000","last_fullsized":"2023-11-04T01:43:16.162296+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:07.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001576214,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160419+0000","last_change":"2023-11-04T01:41:13.087687+0000","last_active":"2023-11-04T01:43:16.160419+0000","last_peered":"2023-11-04T01:43:16.160419+0000","last_clean":"2023-11-04T01:43:16.160419+0000","last_became_active":"2023-11-04T01:41:12.100910+0000","last_became_peered":"2023-11-04T01:41:12.100910+0000","last_unstale":"2023-11-04T01:43:16.160419+0000","last_undegraded":"2023-11-04T01:43:16.160419+0000","last_fullsized":"2023-11-04T01:43:16.160419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:35:53.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012407589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211504+0000","last_change":"2023-11-04T01:43:16.166223+0000","last_active":"2023-11-04T01:43:17.211504+0000","last_peered":"2023-11-04T01:43:17.211504+0000","last_clean":"2023-11-04T01:43:17.211504+0000","last_became_active":"2023-11-04T01:43:16.165428+0000","last_became_peered":"2023-11-04T01:43:16.165428+0000","last_unstale":"2023-11-04T01:43:17.211504+0000","last_undegraded":"2023-11-04T01:43:17.211504+0000","last_fullsized":"2023-11-04T01:43:17.211504+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:49:51.615937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.163235+0000","last_change":"2023-11-04T01:43:15.162032+0000","last_active":"2023-11-04T01:43:16.163235+0000","last_peered":"2023-11-04T01:43:16.163235+0000","last_clean":"2023-11-04T01:43:16.163235+0000","last_became_active":"2023-11-04T01:43:15.161515+0000","last_became_peered":"2023-11-04T01:43:15.161515+0000","last_unstale":"2023-11-04T01:43:16.163235+0000","last_undegraded":"2023-11-04T01:43:16.163235+0000","last_fullsized":"2023-11-04T01:43:16.163235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:19:32.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.172436+0000","last_change":"2023-11-04T01:42:21.129532+0000","last_active":"2023-11-04T01:43:16.172436+0000","last_peered":"2023-11-04T01:43:16.172436+0000","last_clean":"2023-11-04T01:43:16.172436+0000","last_became_active":"2023-11-04T01:42:21.128805+0000","last_became_peered":"2023-11-04T01:42:21.128805+0000","last_unstale":"2023-11-04T01:43:16.172436+0000","last_undegraded":"2023-11-04T01:43:16.172436+0000","last_fullsized":"2023-11-04T01:43:16.172436+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:38:36.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157660+0000","last_change":"2023-11-04T01:42:22.507222+0000","last_active":"2023-11-04T01:43:16.157660+0000","last_peered":"2023-11-04T01:43:16.157660+0000","last_clean":"2023-11-04T01:43:16.157660+0000","last_became_active":"2023-11-04T01:42:20.144303+0000","last_became_peered":"2023-11-04T01:42:20.144303+0000","last_unstale":"2023-11-04T01:43:16.157660+0000","last_undegraded":"2023-11-04T01:43:16.157660+0000","last_fullsized":"2023-11-04T01:43:16.157660+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021127229999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.141718+0000","last_change":"2023-11-04T01:41:13.609964+0000","last_active":"2023-11-04T01:43:16.141718+0000","last_peered":"2023-11-04T01:43:16.141718+0000","last_clean":"2023-11-04T01:43:16.141718+0000","last_became_active":"2023-11-04T01:41:12.103795+0000","last_became_peered":"2023-11-04T01:41:12.103795+0000","last_unstale":"2023-11-04T01:43:16.141718+0000","last_undegraded":"2023-11-04T01:43:16.141718+0000","last_fullsized":"2023-11-04T01:43:16.141718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:53.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093594999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.145662+0000","last_change":"2023-11-04T01:43:16.183812+0000","last_active":"2023-11-04T01:43:17.145662+0000","last_peered":"2023-11-04T01:43:17.145662+0000","last_clean":"2023-11-04T01:43:17.145662+0000","last_became_active":"2023-11-04T01:43:16.182623+0000","last_became_peered":"2023-11-04T01:43:16.182623+0000","last_unstale":"2023-11-04T01:43:17.145662+0000","last_undegraded":"2023-11-04T01:43:17.145662+0000","last_fullsized":"2023-11-04T01:43:17.145662+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:06.390055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.169070+0000","last_change":"2023-11-04T01:43:15.163139+0000","last_active":"2023-11-04T01:43:16.169070+0000","last_peered":"2023-11-04T01:43:16.169070+0000","last_clean":"2023-11-04T01:43:16.169070+0000","last_became_active":"2023-11-04T01:43:15.162805+0000","last_became_peered":"2023-11-04T01:43:15.162805+0000","last_unstale":"2023-11-04T01:43:16.169070+0000","last_undegraded":"2023-11-04T01:43:16.169070+0000","last_fullsized":"2023-11-04T01:43:16.169070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:05.379008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.173183+0000","last_change":"2023-11-04T01:42:21.131993+0000","last_active":"2023-11-04T01:43:16.173183+0000","last_peered":"2023-11-04T01:43:16.173183+0000","last_clean":"2023-11-04T01:43:16.173183+0000","last_became_active":"2023-11-04T01:42:21.131460+0000","last_became_peered":"2023-11-04T01:42:21.131460+0000","last_unstale":"2023-11-04T01:43:16.173183+0000","last_undegraded":"2023-11-04T01:43:16.173183+0000","last_fullsized":"2023-11-04T01:43:16.173183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:40.953727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.166258+0000","last_change":"2023-11-04T01:42:22.388736+0000","last_active":"2023-11-04T01:43:16.166258+0000","last_peered":"2023-11-04T01:43:16.166258+0000","last_clean":"2023-11-04T01:43:16.166258+0000","last_became_active":"2023-11-04T01:42:20.131146+0000","last_became_peered":"2023-11-04T01:42:20.131146+0000","last_unstale":"2023-11-04T01:43:16.166258+0000","last_undegraded":"2023-11-04T01:43:16.166258+0000","last_fullsized":"2023-11-04T01:43:16.166258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015625120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.147335+0000","last_change":"2023-11-04T01:41:13.091746+0000","last_active":"2023-11-04T01:43:16.147335+0000","last_peered":"2023-11-04T01:43:16.147335+0000","last_clean":"2023-11-04T01:43:16.147335+0000","last_became_active":"2023-11-04T01:41:12.111162+0000","last_became_peered":"2023-11-04T01:41:12.111162+0000","last_unstale":"2023-11-04T01:43:16.147335+0000","last_undegraded":"2023-11-04T01:43:16.147335+0000","last_fullsized":"2023-11-04T01:43:16.147335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011025119999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212048+0000","last_change":"2023-11-04T01:43:16.172578+0000","last_active":"2023-11-04T01:43:17.212048+0000","last_peered":"2023-11-04T01:43:17.212048+0000","last_clean":"2023-11-04T01:43:17.212048+0000","last_became_active":"2023-11-04T01:43:16.172213+0000","last_became_peered":"2023-11-04T01:43:16.172213+0000","last_unstale":"2023-11-04T01:43:17.212048+0000","last_undegraded":"2023-11-04T01:43:17.212048+0000","last_fullsized":"2023-11-04T01:43:17.212048+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:43.296942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.210458+0000","last_change":"2023-11-04T01:43:15.162310+0000","last_active":"2023-11-04T01:43:16.210458+0000","last_peered":"2023-11-04T01:43:16.210458+0000","last_clean":"2023-11-04T01:43:16.210458+0000","last_became_active":"2023-11-04T01:43:15.161776+0000","last_became_peered":"2023-11-04T01:43:15.161776+0000","last_unstale":"2023-11-04T01:43:16.210458+0000","last_undegraded":"2023-11-04T01:43:16.210458+0000","last_fullsized":"2023-11-04T01:43:16.210458+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:21:29.708516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.165849+0000","last_change":"2023-11-04T01:42:21.130032+0000","last_active":"2023-11-04T01:43:16.165849+0000","last_peered":"2023-11-04T01:43:16.165849+0000","last_clean":"2023-11-04T01:43:16.165849+0000","last_became_active":"2023-11-04T01:42:21.129618+0000","last_became_peered":"2023-11-04T01:42:21.129618+0000","last_unstale":"2023-11-04T01:43:16.165849+0000","last_undegraded":"2023-11-04T01:43:16.165849+0000","last_fullsized":"2023-11-04T01:43:16.165849+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160016+0000","last_change":"2023-11-04T01:42:22.709245+0000","last_active":"2023-11-04T01:43:16.160016+0000","last_peered":"2023-11-04T01:43:16.160016+0000","last_clean":"2023-11-04T01:43:16.160016+0000","last_became_active":"2023-11-04T01:42:20.131205+0000","last_became_peered":"2023-11-04T01:42:20.131205+0000","last_unstale":"2023-11-04T01:43:16.160016+0000","last_undegraded":"2023-11-04T01:43:16.160016+0000","last_fullsized":"2023-11-04T01:43:16.160016+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:22.502121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001498742,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.163214+0000","last_change":"2023-11-04T01:41:13.629490+0000","last_active":"2023-11-04T01:43:16.163214+0000","last_peered":"2023-11-04T01:43:16.163214+0000","last_clean":"2023-11-04T01:43:16.163214+0000","last_became_active":"2023-11-04T01:41:12.119655+0000","last_became_peered":"2023-11-04T01:41:12.119655+0000","last_unstale":"2023-11-04T01:43:16.163214+0000","last_undegraded":"2023-11-04T01:43:16.163214+0000","last_fullsized":"2023-11-04T01:43:16.163214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:17:13.725054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095245499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212424+0000","last_change":"2023-11-04T01:43:16.194987+0000","last_active":"2023-11-04T01:43:17.212424+0000","last_peered":"2023-11-04T01:43:17.212424+0000","last_clean":"2023-11-04T01:43:17.212424+0000","last_became_active":"2023-11-04T01:43:16.194380+0000","last_became_peered":"2023-11-04T01:43:16.194380+0000","last_unstale":"2023-11-04T01:43:17.212424+0000","last_undegraded":"2023-11-04T01:43:17.212424+0000","last_fullsized":"2023-11-04T01:43:17.212424+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:22.793554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.214930+0000","last_change":"2023-11-04T01:43:15.128193+0000","last_active":"2023-11-04T01:43:16.214930+0000","last_peered":"2023-11-04T01:43:16.214930+0000","last_clean":"2023-11-04T01:43:16.214930+0000","last_became_active":"2023-11-04T01:43:15.127462+0000","last_became_peered":"2023-11-04T01:43:15.127462+0000","last_unstale":"2023-11-04T01:43:16.214930+0000","last_undegraded":"2023-11-04T01:43:16.214930+0000","last_fullsized":"2023-11-04T01:43:16.214930+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:33.234034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177234+0000","last_change":"2023-11-04T01:42:21.118822+0000","last_active":"2023-11-04T01:43:16.177234+0000","last_peered":"2023-11-04T01:43:16.177234+0000","last_clean":"2023-11-04T01:43:16.177234+0000","last_became_active":"2023-11-04T01:42:21.118176+0000","last_became_peered":"2023-11-04T01:42:21.118176+0000","last_unstale":"2023-11-04T01:43:16.177234+0000","last_undegraded":"2023-11-04T01:43:16.177234+0000","last_fullsized":"2023-11-04T01:43:16.177234+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:58.250209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.163223+0000","last_change":"2023-11-04T01:42:22.664280+0000","last_active":"2023-11-04T01:43:16.163223+0000","last_peered":"2023-11-04T01:43:16.163223+0000","last_clean":"2023-11-04T01:43:16.163223+0000","last_became_active":"2023-11-04T01:42:20.148586+0000","last_became_peered":"2023-11-04T01:42:20.148586+0000","last_unstale":"2023-11-04T01:43:16.163223+0000","last_undegraded":"2023-11-04T01:43:16.163223+0000","last_fullsized":"2023-11-04T01:43:16.163223+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:47.955164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018670679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.140184+0000","last_change":"2023-11-04T01:41:13.610703+0000","last_active":"2023-11-04T01:43:16.140184+0000","last_peered":"2023-11-04T01:43:16.140184+0000","last_clean":"2023-11-04T01:43:16.140184+0000","last_became_active":"2023-11-04T01:41:12.099266+0000","last_became_peered":"2023-11-04T01:41:12.099266+0000","last_unstale":"2023-11-04T01:43:16.140184+0000","last_undegraded":"2023-11-04T01:43:16.140184+0000","last_fullsized":"2023-11-04T01:43:16.140184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:19.325190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001449243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.147534+0000","last_change":"2023-11-04T01:43:16.194960+0000","last_active":"2023-11-04T01:43:17.147534+0000","last_peered":"2023-11-04T01:43:17.147534+0000","last_clean":"2023-11-04T01:43:17.147534+0000","last_became_active":"2023-11-04T01:43:16.193909+0000","last_became_peered":"2023-11-04T01:43:16.193909+0000","last_unstale":"2023-11-04T01:43:17.147534+0000","last_undegraded":"2023-11-04T01:43:17.147534+0000","last_fullsized":"2023-11-04T01:43:17.147534+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:57.964178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.152051+0000","last_change":"2023-11-04T01:43:15.150032+0000","last_active":"2023-11-04T01:43:16.152051+0000","last_peered":"2023-11-04T01:43:16.152051+0000","last_clean":"2023-11-04T01:43:16.152051+0000","last_became_active":"2023-11-04T01:43:15.149310+0000","last_became_peered":"2023-11-04T01:43:15.149310+0000","last_unstale":"2023-11-04T01:43:16.152051+0000","last_undegraded":"2023-11-04T01:43:16.152051+0000","last_fullsized":"2023-11-04T01:43:16.152051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:46.292133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.158914+0000","last_change":"2023-11-04T01:42:21.126276+0000","last_active":"2023-11-04T01:43:16.158914+0000","last_peered":"2023-11-04T01:43:16.158914+0000","last_clean":"2023-11-04T01:43:16.158914+0000","last_became_active":"2023-11-04T01:42:21.125432+0000","last_became_peered":"2023-11-04T01:42:21.125432+0000","last_unstale":"2023-11-04T01:43:16.158914+0000","last_undegraded":"2023-11-04T01:43:16.158914+0000","last_fullsized":"2023-11-04T01:43:16.158914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.430844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.164000+0000","last_change":"2023-11-04T01:42:22.664477+0000","last_active":"2023-11-04T01:43:16.164000+0000","last_peered":"2023-11-04T01:43:16.164000+0000","last_clean":"2023-11-04T01:43:16.164000+0000","last_became_active":"2023-11-04T01:42:20.137661+0000","last_became_peered":"2023-11-04T01:42:20.137661+0000","last_unstale":"2023-11-04T01:43:16.164000+0000","last_undegraded":"2023-11-04T01:43:16.164000+0000","last_fullsized":"2023-11-04T01:43:16.164000+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:51.643043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025255519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160124+0000","last_change":"2023-11-04T01:41:13.790451+0000","last_active":"2023-11-04T01:43:16.160124+0000","last_peered":"2023-11-04T01:43:16.160124+0000","last_clean":"2023-11-04T01:43:16.160124+0000","last_became_active":"2023-11-04T01:41:12.098147+0000","last_became_peered":"2023-11-04T01:41:12.098147+0000","last_unstale":"2023-11-04T01:43:16.160124+0000","last_undegraded":"2023-11-04T01:43:16.160124+0000","last_fullsized":"2023-11-04T01:43:16.160124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:58:56.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065435,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212860+0000","last_change":"2023-11-04T01:43:16.183718+0000","last_active":"2023-11-04T01:43:17.212860+0000","last_peered":"2023-11-04T01:43:17.212860+0000","last_clean":"2023-11-04T01:43:17.212860+0000","last_became_active":"2023-11-04T01:43:16.183268+0000","last_became_peered":"2023-11-04T01:43:16.183268+0000","last_unstale":"2023-11-04T01:43:17.212860+0000","last_undegraded":"2023-11-04T01:43:17.212860+0000","last_fullsized":"2023-11-04T01:43:17.212860+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:49.577437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.137978+0000","last_change":"2023-11-04T01:43:15.131252+0000","last_active":"2023-11-04T01:43:16.137978+0000","last_peered":"2023-11-04T01:43:16.137978+0000","last_clean":"2023-11-04T01:43:16.137978+0000","last_became_active":"2023-11-04T01:43:15.130633+0000","last_became_peered":"2023-11-04T01:43:15.130633+0000","last_unstale":"2023-11-04T01:43:16.137978+0000","last_undegraded":"2023-11-04T01:43:16.137978+0000","last_fullsized":"2023-11-04T01:43:16.137978+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:54:46.447738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160711+0000","last_change":"2023-11-04T01:42:21.123611+0000","last_active":"2023-11-04T01:43:16.160711+0000","last_peered":"2023-11-04T01:43:16.160711+0000","last_clean":"2023-11-04T01:43:16.160711+0000","last_became_active":"2023-11-04T01:42:21.122073+0000","last_became_peered":"2023-11-04T01:42:21.122073+0000","last_unstale":"2023-11-04T01:43:16.160711+0000","last_undegraded":"2023-11-04T01:43:16.160711+0000","last_fullsized":"2023-11-04T01:43:16.160711+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:06.887808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159698+0000","last_change":"2023-11-04T01:42:22.507881+0000","last_active":"2023-11-04T01:43:16.159698+0000","last_peered":"2023-11-04T01:43:16.159698+0000","last_clean":"2023-11-04T01:43:16.159698+0000","last_became_active":"2023-11-04T01:42:20.144589+0000","last_became_peered":"2023-11-04T01:42:20.144589+0000","last_unstale":"2023-11-04T01:43:16.159698+0000","last_undegraded":"2023-11-04T01:43:16.159698+0000","last_fullsized":"2023-11-04T01:43:16.159698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:29.682509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001248229,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.138666+0000","last_change":"2023-11-04T01:41:13.609454+0000","last_active":"2023-11-04T01:43:16.138666+0000","last_peered":"2023-11-04T01:43:16.138666+0000","last_clean":"2023-11-04T01:43:16.138666+0000","last_became_active":"2023-11-04T01:41:12.099491+0000","last_became_peered":"2023-11-04T01:41:12.099491+0000","last_unstale":"2023-11-04T01:43:16.138666+0000","last_undegraded":"2023-11-04T01:43:16.138666+0000","last_fullsized":"2023-11-04T01:43:16.138666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:17:34.173356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079903199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.210589+0000","last_change":"2023-11-04T01:43:16.193964+0000","last_active":"2023-11-04T01:43:17.210589+0000","last_peered":"2023-11-04T01:43:17.210589+0000","last_clean":"2023-11-04T01:43:17.210589+0000","last_became_active":"2023-11-04T01:43:16.193644+0000","last_became_peered":"2023-11-04T01:43:16.193644+0000","last_unstale":"2023-11-04T01:43:17.210589+0000","last_undegraded":"2023-11-04T01:43:17.210589+0000","last_fullsized":"2023-11-04T01:43:17.210589+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:30.360335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"90'4","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.211623+0000","last_change":"2023-11-04T01:43:15.161411+0000","last_active":"2023-11-04T01:43:16.211623+0000","last_peered":"2023-11-04T01:43:16.211623+0000","last_clean":"2023-11-04T01:43:16.211623+0000","last_became_active":"2023-11-04T01:43:15.160976+0000","last_became_peered":"2023-11-04T01:43:15.160976+0000","last_unstale":"2023-11-04T01:43:16.211623+0000","last_undegraded":"2023-11-04T01:43:16.211623+0000","last_fullsized":"2023-11-04T01:43:16.211623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177926+0000","last_change":"2023-11-04T01:42:21.123122+0000","last_active":"2023-11-04T01:43:16.177926+0000","last_peered":"2023-11-04T01:43:16.177926+0000","last_clean":"2023-11-04T01:43:16.177926+0000","last_became_active":"2023-11-04T01:42:21.121146+0000","last_became_peered":"2023-11-04T01:42:21.121146+0000","last_unstale":"2023-11-04T01:43:16.177926+0000","last_undegraded":"2023-11-04T01:43:16.177926+0000","last_fullsized":"2023-11-04T01:43:16.177926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.864695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.160663+0000","last_change":"2023-11-04T01:42:22.121963+0000","last_active":"2023-11-04T01:43:16.160663+0000","last_peered":"2023-11-04T01:43:16.160663+0000","last_clean":"2023-11-04T01:43:16.160663+0000","last_became_active":"2023-11-04T01:42:20.135381+0000","last_became_peered":"2023-11-04T01:42:20.135381+0000","last_unstale":"2023-11-04T01:43:16.160663+0000","last_undegraded":"2023-11-04T01:43:16.160663+0000","last_fullsized":"2023-11-04T01:43:16.160663+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:59.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011818449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.179011+0000","last_change":"2023-11-04T01:41:13.791425+0000","last_active":"2023-11-04T01:43:16.179011+0000","last_peered":"2023-11-04T01:43:16.179011+0000","last_clean":"2023-11-04T01:43:16.179011+0000","last_became_active":"2023-11-04T01:41:12.105693+0000","last_became_peered":"2023-11-04T01:41:12.105693+0000","last_unstale":"2023-11-04T01:43:16.179011+0000","last_undegraded":"2023-11-04T01:43:16.179011+0000","last_fullsized":"2023-11-04T01:43:16.179011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:02.170052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011340569999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.141503+0000","last_change":"2023-11-04T01:43:16.188859+0000","last_active":"2023-11-04T01:43:17.141503+0000","last_peered":"2023-11-04T01:43:17.141503+0000","last_clean":"2023-11-04T01:43:17.141503+0000","last_became_active":"2023-11-04T01:43:16.188533+0000","last_became_peered":"2023-11-04T01:43:16.188533+0000","last_unstale":"2023-11-04T01:43:17.141503+0000","last_undegraded":"2023-11-04T01:43:17.141503+0000","last_fullsized":"2023-11-04T01:43:17.141503+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:59.060827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"90'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.209752+0000","last_change":"2023-11-04T01:43:15.149053+0000","last_active":"2023-11-04T01:43:16.209752+0000","last_peered":"2023-11-04T01:43:16.209752+0000","last_clean":"2023-11-04T01:43:16.209752+0000","last_became_active":"2023-11-04T01:43:15.148336+0000","last_became_peered":"2023-11-04T01:43:15.148336+0000","last_unstale":"2023-11-04T01:43:16.209752+0000","last_undegraded":"2023-11-04T01:43:16.209752+0000","last_fullsized":"2023-11-04T01:43:16.209752+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:43.150933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.178145+0000","last_change":"2023-11-04T01:42:21.123301+0000","last_active":"2023-11-04T01:43:16.178145+0000","last_peered":"2023-11-04T01:43:16.178145+0000","last_clean":"2023-11-04T01:43:16.178145+0000","last_became_active":"2023-11-04T01:42:21.122173+0000","last_became_peered":"2023-11-04T01:42:21.122173+0000","last_unstale":"2023-11-04T01:43:16.178145+0000","last_undegraded":"2023-11-04T01:43:16.178145+0000","last_fullsized":"2023-11-04T01:43:16.178145+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:21.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.145750+0000","last_change":"2023-11-04T01:42:22.120147+0000","last_active":"2023-11-04T01:43:16.145750+0000","last_peered":"2023-11-04T01:43:16.145750+0000","last_clean":"2023-11-04T01:43:16.145750+0000","last_became_active":"2023-11-04T01:42:20.122044+0000","last_became_peered":"2023-11-04T01:42:20.122044+0000","last_unstale":"2023-11-04T01:43:16.145750+0000","last_undegraded":"2023-11-04T01:43:16.145750+0000","last_fullsized":"2023-11-04T01:43:16.145750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:52:12.827302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023454019999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.161325+0000","last_change":"2023-11-04T01:41:13.480175+0000","last_active":"2023-11-04T01:43:16.161325+0000","last_peered":"2023-11-04T01:43:16.161325+0000","last_clean":"2023-11-04T01:43:16.161325+0000","last_became_active":"2023-11-04T01:41:12.109288+0000","last_became_peered":"2023-11-04T01:41:12.109288+0000","last_unstale":"2023-11-04T01:43:16.161325+0000","last_undegraded":"2023-11-04T01:43:16.161325+0000","last_fullsized":"2023-11-04T01:43:16.161325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214325+0000","last_change":"2023-11-04T01:43:16.186539+0000","last_active":"2023-11-04T01:43:17.214325+0000","last_peered":"2023-11-04T01:43:17.214325+0000","last_clean":"2023-11-04T01:43:17.214325+0000","last_became_active":"2023-11-04T01:43:16.185883+0000","last_became_peered":"2023-11-04T01:43:16.185883+0000","last_unstale":"2023-11-04T01:43:17.214325+0000","last_undegraded":"2023-11-04T01:43:17.214325+0000","last_fullsized":"2023-11-04T01:43:17.214325+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:24:04.027352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.211218+0000","last_change":"2023-11-04T01:43:15.143691+0000","last_active":"2023-11-04T01:43:16.211218+0000","last_peered":"2023-11-04T01:43:16.211218+0000","last_clean":"2023-11-04T01:43:16.211218+0000","last_became_active":"2023-11-04T01:43:15.142954+0000","last_became_peered":"2023-11-04T01:43:15.142954+0000","last_unstale":"2023-11-04T01:43:16.211218+0000","last_undegraded":"2023-11-04T01:43:16.211218+0000","last_fullsized":"2023-11-04T01:43:16.211218+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:05.764961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.161624+0000","last_change":"2023-11-04T01:42:21.126283+0000","last_active":"2023-11-04T01:43:16.161624+0000","last_peered":"2023-11-04T01:43:16.161624+0000","last_clean":"2023-11-04T01:43:16.161624+0000","last_became_active":"2023-11-04T01:42:21.124846+0000","last_became_peered":"2023-11-04T01:42:21.124846+0000","last_unstale":"2023-11-04T01:43:16.161624+0000","last_undegraded":"2023-11-04T01:43:16.161624+0000","last_fullsized":"2023-11-04T01:43:16.161624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:35.172099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177599+0000","last_change":"2023-11-04T01:42:22.116020+0000","last_active":"2023-11-04T01:43:16.177599+0000","last_peered":"2023-11-04T01:43:16.177599+0000","last_clean":"2023-11-04T01:43:16.177599+0000","last_became_active":"2023-11-04T01:42:20.136568+0000","last_became_peered":"2023-11-04T01:42:20.136568+0000","last_unstale":"2023-11-04T01:43:16.177599+0000","last_undegraded":"2023-11-04T01:43:16.177599+0000","last_fullsized":"2023-11-04T01:43:16.177599+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:56.872369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001508339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.156846+0000","last_change":"2023-11-04T01:41:13.087571+0000","last_active":"2023-11-04T01:43:16.156846+0000","last_peered":"2023-11-04T01:43:16.156846+0000","last_clean":"2023-11-04T01:43:16.156846+0000","last_became_active":"2023-11-04T01:41:12.108080+0000","last_became_peered":"2023-11-04T01:41:12.108080+0000","last_unstale":"2023-11-04T01:43:16.156846+0000","last_undegraded":"2023-11-04T01:43:16.156846+0000","last_fullsized":"2023-11-04T01:43:16.156846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:07.461611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011130230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.145524+0000","last_change":"2023-11-04T01:43:16.194011+0000","last_active":"2023-11-04T01:43:17.145524+0000","last_peered":"2023-11-04T01:43:17.145524+0000","last_clean":"2023-11-04T01:43:17.145524+0000","last_became_active":"2023-11-04T01:43:16.189971+0000","last_became_peered":"2023-11-04T01:43:16.189971+0000","last_unstale":"2023-11-04T01:43:17.145524+0000","last_undegraded":"2023-11-04T01:43:17.145524+0000","last_fullsized":"2023-11-04T01:43:17.145524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:05.607640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.209841+0000","last_change":"2023-11-04T01:43:15.152965+0000","last_active":"2023-11-04T01:43:16.209841+0000","last_peered":"2023-11-04T01:43:16.209841+0000","last_clean":"2023-11-04T01:43:16.209841+0000","last_became_active":"2023-11-04T01:43:15.152534+0000","last_became_peered":"2023-11-04T01:43:15.152534+0000","last_unstale":"2023-11-04T01:43:16.209841+0000","last_undegraded":"2023-11-04T01:43:16.209841+0000","last_fullsized":"2023-11-04T01:43:16.209841+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:04.596592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159152+0000","last_change":"2023-11-04T01:42:21.141147+0000","last_active":"2023-11-04T01:43:16.159152+0000","last_peered":"2023-11-04T01:43:16.159152+0000","last_clean":"2023-11-04T01:43:16.159152+0000","last_became_active":"2023-11-04T01:42:21.140281+0000","last_became_peered":"2023-11-04T01:42:21.140281+0000","last_unstale":"2023-11-04T01:43:16.159152+0000","last_undegraded":"2023-11-04T01:43:16.159152+0000","last_fullsized":"2023-11-04T01:43:16.159152+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:06:12.381378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.154620+0000","last_change":"2023-11-04T01:42:22.704486+0000","last_active":"2023-11-04T01:43:16.154620+0000","last_peered":"2023-11-04T01:43:16.154620+0000","last_clean":"2023-11-04T01:43:16.154620+0000","last_became_active":"2023-11-04T01:42:20.120795+0000","last_became_peered":"2023-11-04T01:42:20.120795+0000","last_unstale":"2023-11-04T01:43:16.154620+0000","last_undegraded":"2023-11-04T01:43:16.154620+0000","last_fullsized":"2023-11-04T01:43:16.154620+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:17:24.544109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024730099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.164532+0000","last_change":"2023-11-04T01:41:13.630602+0000","last_active":"2023-11-04T01:43:16.164532+0000","last_peered":"2023-11-04T01:43:16.164532+0000","last_clean":"2023-11-04T01:43:16.164532+0000","last_became_active":"2023-11-04T01:41:12.118711+0000","last_became_peered":"2023-11-04T01:41:12.118711+0000","last_unstale":"2023-11-04T01:43:16.164532+0000","last_undegraded":"2023-11-04T01:43:16.164532+0000","last_fullsized":"2023-11-04T01:43:16.164532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:03.188939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001442034,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.146802+0000","last_change":"2023-11-04T01:43:16.179791+0000","last_active":"2023-11-04T01:43:17.146802+0000","last_peered":"2023-11-04T01:43:17.146802+0000","last_clean":"2023-11-04T01:43:17.146802+0000","last_became_active":"2023-11-04T01:43:16.178913+0000","last_became_peered":"2023-11-04T01:43:16.178913+0000","last_unstale":"2023-11-04T01:43:17.146802+0000","last_undegraded":"2023-11-04T01:43:17.146802+0000","last_fullsized":"2023-11-04T01:43:17.146802+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:54:36.454285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"90'2","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.198123+0000","last_change":"2023-11-04T01:43:15.153656+0000","last_active":"2023-11-04T01:43:16.198123+0000","last_peered":"2023-11-04T01:43:16.198123+0000","last_clean":"2023-11-04T01:43:16.198123+0000","last_became_active":"2023-11-04T01:43:15.152300+0000","last_became_peered":"2023-11-04T01:43:15.152300+0000","last_unstale":"2023-11-04T01:43:16.198123+0000","last_undegraded":"2023-11-04T01:43:16.198123+0000","last_fullsized":"2023-11-04T01:43:16.198123+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:49.739183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159714+0000","last_change":"2023-11-04T01:42:21.119369+0000","last_active":"2023-11-04T01:43:16.159714+0000","last_peered":"2023-11-04T01:43:16.159714+0000","last_clean":"2023-11-04T01:43:16.159714+0000","last_became_active":"2023-11-04T01:42:21.118932+0000","last_became_peered":"2023-11-04T01:42:21.118932+0000","last_unstale":"2023-11-04T01:43:16.159714+0000","last_undegraded":"2023-11-04T01:43:16.159714+0000","last_fullsized":"2023-11-04T01:43:16.159714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:20.756419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157412+0000","last_change":"2023-11-04T01:42:22.665064+0000","last_active":"2023-11-04T01:43:16.157412+0000","last_peered":"2023-11-04T01:43:16.157412+0000","last_clean":"2023-11-04T01:43:16.157412+0000","last_became_active":"2023-11-04T01:42:20.148763+0000","last_became_peered":"2023-11-04T01:42:20.148763+0000","last_unstale":"2023-11-04T01:43:16.157412+0000","last_undegraded":"2023-11-04T01:43:16.157412+0000","last_fullsized":"2023-11-04T01:43:16.157412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:16:06.791714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024389910000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159122+0000","last_change":"2023-11-04T01:41:13.479117+0000","last_active":"2023-11-04T01:43:16.159122+0000","last_peered":"2023-11-04T01:43:16.159122+0000","last_clean":"2023-11-04T01:43:16.159122+0000","last_became_active":"2023-11-04T01:41:12.112558+0000","last_became_peered":"2023-11-04T01:41:12.112558+0000","last_unstale":"2023-11-04T01:43:16.159122+0000","last_undegraded":"2023-11-04T01:43:16.159122+0000","last_fullsized":"2023-11-04T01:43:16.159122+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:19.177376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014508819999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.147961+0000","last_change":"2023-11-04T01:43:16.171581+0000","last_active":"2023-11-04T01:43:17.147961+0000","last_peered":"2023-11-04T01:43:17.147961+0000","last_clean":"2023-11-04T01:43:17.147961+0000","last_became_active":"2023-11-04T01:43:16.170854+0000","last_became_peered":"2023-11-04T01:43:16.170854+0000","last_unstale":"2023-11-04T01:43:17.147961+0000","last_undegraded":"2023-11-04T01:43:17.147961+0000","last_fullsized":"2023-11-04T01:43:17.147961+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:06.390055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.139628+0000","last_change":"2023-11-04T01:43:15.153690+0000","last_active":"2023-11-04T01:43:16.139628+0000","last_peered":"2023-11-04T01:43:16.139628+0000","last_clean":"2023-11-04T01:43:16.139628+0000","last_became_active":"2023-11-04T01:43:15.153389+0000","last_became_peered":"2023-11-04T01:43:15.153389+0000","last_unstale":"2023-11-04T01:43:16.139628+0000","last_undegraded":"2023-11-04T01:43:16.139628+0000","last_fullsized":"2023-11-04T01:43:16.139628+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:28:18.996637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.145930+0000","last_change":"2023-11-04T01:42:21.123768+0000","last_active":"2023-11-04T01:43:16.145930+0000","last_peered":"2023-11-04T01:43:16.145930+0000","last_clean":"2023-11-04T01:43:16.145930+0000","last_became_active":"2023-11-04T01:42:21.122526+0000","last_became_peered":"2023-11-04T01:42:21.122526+0000","last_unstale":"2023-11-04T01:43:16.145930+0000","last_undegraded":"2023-11-04T01:43:16.145930+0000","last_fullsized":"2023-11-04T01:43:16.145930+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:25:04.363593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.147060+0000","last_change":"2023-11-04T01:42:22.121586+0000","last_active":"2023-11-04T01:43:16.147060+0000","last_peered":"2023-11-04T01:43:16.147060+0000","last_clean":"2023-11-04T01:43:16.147060+0000","last_became_active":"2023-11-04T01:42:20.128359+0000","last_became_peered":"2023-11-04T01:42:20.128359+0000","last_unstale":"2023-11-04T01:43:16.147060+0000","last_undegraded":"2023-11-04T01:43:16.147060+0000","last_fullsized":"2023-11-04T01:43:16.147060+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:28.756844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001290823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.139972+0000","last_change":"2023-11-04T01:41:13.610328+0000","last_active":"2023-11-04T01:43:16.139972+0000","last_peered":"2023-11-04T01:43:16.139972+0000","last_clean":"2023-11-04T01:43:16.139972+0000","last_became_active":"2023-11-04T01:41:12.106007+0000","last_became_peered":"2023-11-04T01:41:12.106007+0000","last_unstale":"2023-11-04T01:43:16.139972+0000","last_undegraded":"2023-11-04T01:43:16.139972+0000","last_fullsized":"2023-11-04T01:43:16.139972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.317033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014149099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.141649+0000","last_change":"2023-11-04T01:43:16.197484+0000","last_active":"2023-11-04T01:43:17.141649+0000","last_peered":"2023-11-04T01:43:17.141649+0000","last_clean":"2023-11-04T01:43:17.141649+0000","last_became_active":"2023-11-04T01:43:16.197139+0000","last_became_peered":"2023-11-04T01:43:16.197139+0000","last_unstale":"2023-11-04T01:43:17.141649+0000","last_undegraded":"2023-11-04T01:43:17.141649+0000","last_fullsized":"2023-11-04T01:43:17.141649+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:15:47.615863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157292+0000","last_change":"2023-11-04T01:43:15.134623+0000","last_active":"2023-11-04T01:43:16.157292+0000","last_peered":"2023-11-04T01:43:16.157292+0000","last_clean":"2023-11-04T01:43:16.157292+0000","last_became_active":"2023-11-04T01:43:15.133876+0000","last_became_peered":"2023-11-04T01:43:15.133876+0000","last_unstale":"2023-11-04T01:43:16.157292+0000","last_undegraded":"2023-11-04T01:43:16.157292+0000","last_fullsized":"2023-11-04T01:43:16.157292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:29:27.754490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.140614+0000","last_change":"2023-11-04T01:42:21.124583+0000","last_active":"2023-11-04T01:43:16.140614+0000","last_peered":"2023-11-04T01:43:16.140614+0000","last_clean":"2023-11-04T01:43:16.140614+0000","last_became_active":"2023-11-04T01:42:21.124246+0000","last_became_peered":"2023-11-04T01:42:21.124246+0000","last_unstale":"2023-11-04T01:43:16.140614+0000","last_undegraded":"2023-11-04T01:43:16.140614+0000","last_fullsized":"2023-11-04T01:43:16.140614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:38.162922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157241+0000","last_change":"2023-11-04T01:42:22.706827+0000","last_active":"2023-11-04T01:43:16.157241+0000","last_peered":"2023-11-04T01:43:16.157241+0000","last_clean":"2023-11-04T01:43:16.157241+0000","last_became_active":"2023-11-04T01:42:20.124653+0000","last_became_peered":"2023-11-04T01:42:20.124653+0000","last_unstale":"2023-11-04T01:43:16.157241+0000","last_undegraded":"2023-11-04T01:43:16.157241+0000","last_fullsized":"2023-11-04T01:43:16.157241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:20:35.580793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017563640000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159923+0000","last_change":"2023-11-04T01:41:13.790089+0000","last_active":"2023-11-04T01:43:16.159923+0000","last_peered":"2023-11-04T01:43:16.159923+0000","last_clean":"2023-11-04T01:43:16.159923+0000","last_became_active":"2023-11-04T01:41:12.102740+0000","last_became_peered":"2023-11-04T01:41:12.102740+0000","last_unstale":"2023-11-04T01:43:16.159923+0000","last_undegraded":"2023-11-04T01:43:16.159923+0000","last_fullsized":"2023-11-04T01:43:16.159923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:32.518827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087240500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.211228+0000","last_change":"2023-11-04T01:43:16.202459+0000","last_active":"2023-11-04T01:43:17.211228+0000","last_peered":"2023-11-04T01:43:17.211228+0000","last_clean":"2023-11-04T01:43:17.211228+0000","last_became_active":"2023-11-04T01:43:16.202109+0000","last_became_peered":"2023-11-04T01:43:16.202109+0000","last_unstale":"2023-11-04T01:43:17.211228+0000","last_undegraded":"2023-11-04T01:43:17.211228+0000","last_fullsized":"2023-11-04T01:43:17.211228+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:50.429752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"90'8","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.215075+0000","last_change":"2023-11-04T01:43:15.153163+0000","last_active":"2023-11-04T01:43:16.215075+0000","last_peered":"2023-11-04T01:43:16.215075+0000","last_clean":"2023-11-04T01:43:16.215075+0000","last_became_active":"2023-11-04T01:43:15.152277+0000","last_became_peered":"2023-11-04T01:43:15.152277+0000","last_unstale":"2023-11-04T01:43:16.215075+0000","last_undegraded":"2023-11-04T01:43:16.215075+0000","last_fullsized":"2023-11-04T01:43:16.215075+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:54:49.739183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.170503+0000","last_change":"2023-11-04T01:42:21.129342+0000","last_active":"2023-11-04T01:43:16.170503+0000","last_peered":"2023-11-04T01:43:16.170503+0000","last_clean":"2023-11-04T01:43:16.170503+0000","last_became_active":"2023-11-04T01:42:21.128628+0000","last_became_peered":"2023-11-04T01:42:21.128628+0000","last_unstale":"2023-11-04T01:43:16.170503+0000","last_undegraded":"2023-11-04T01:43:16.170503+0000","last_fullsized":"2023-11-04T01:43:16.170503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.154570+0000","last_change":"2023-11-04T01:42:22.507852+0000","last_active":"2023-11-04T01:43:16.154570+0000","last_peered":"2023-11-04T01:43:16.154570+0000","last_clean":"2023-11-04T01:43:16.154570+0000","last_became_active":"2023-11-04T01:42:20.144367+0000","last_became_peered":"2023-11-04T01:42:20.144367+0000","last_unstale":"2023-11-04T01:43:16.154570+0000","last_undegraded":"2023-11-04T01:43:16.154570+0000","last_fullsized":"2023-11-04T01:43:16.154570+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:25.845271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017815719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.146134+0000","last_change":"2023-11-04T01:41:13.088948+0000","last_active":"2023-11-04T01:43:16.146134+0000","last_peered":"2023-11-04T01:43:16.146134+0000","last_clean":"2023-11-04T01:43:16.146134+0000","last_became_active":"2023-11-04T01:41:12.109750+0000","last_became_peered":"2023-11-04T01:41:12.109750+0000","last_unstale":"2023-11-04T01:43:16.146134+0000","last_undegraded":"2023-11-04T01:43:16.146134+0000","last_fullsized":"2023-11-04T01:43:16.146134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:55:15.759913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015413,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.210464+0000","last_change":"2023-11-04T01:43:16.194039+0000","last_active":"2023-11-04T01:43:17.210464+0000","last_peered":"2023-11-04T01:43:17.210464+0000","last_clean":"2023-11-04T01:43:17.210464+0000","last_became_active":"2023-11-04T01:43:16.193720+0000","last_became_peered":"2023-11-04T01:43:16.193720+0000","last_unstale":"2023-11-04T01:43:17.210464+0000","last_undegraded":"2023-11-04T01:43:17.210464+0000","last_fullsized":"2023-11-04T01:43:17.210464+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:29:09.979967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.161207+0000","last_change":"2023-11-04T01:43:15.152417+0000","last_active":"2023-11-04T01:43:16.161207+0000","last_peered":"2023-11-04T01:43:16.161207+0000","last_clean":"2023-11-04T01:43:16.161207+0000","last_became_active":"2023-11-04T01:43:15.149079+0000","last_became_peered":"2023-11-04T01:43:15.149079+0000","last_unstale":"2023-11-04T01:43:16.161207+0000","last_undegraded":"2023-11-04T01:43:16.161207+0000","last_fullsized":"2023-11-04T01:43:16.161207+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:45:11.785379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.147523+0000","last_change":"2023-11-04T01:42:21.120249+0000","last_active":"2023-11-04T01:43:16.147523+0000","last_peered":"2023-11-04T01:43:16.147523+0000","last_clean":"2023-11-04T01:43:16.147523+0000","last_became_active":"2023-11-04T01:42:21.119504+0000","last_became_peered":"2023-11-04T01:42:21.119504+0000","last_unstale":"2023-11-04T01:43:16.147523+0000","last_undegraded":"2023-11-04T01:43:16.147523+0000","last_fullsized":"2023-11-04T01:43:16.147523+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:49.147499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.146483+0000","last_change":"2023-11-04T01:42:22.119253+0000","last_active":"2023-11-04T01:43:16.146483+0000","last_peered":"2023-11-04T01:43:16.146483+0000","last_clean":"2023-11-04T01:43:16.146483+0000","last_became_active":"2023-11-04T01:42:20.125984+0000","last_became_peered":"2023-11-04T01:42:20.125984+0000","last_unstale":"2023-11-04T01:43:16.146483+0000","last_undegraded":"2023-11-04T01:43:16.146483+0000","last_fullsized":"2023-11-04T01:43:16.146483+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:39:13.899999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002456438,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.162021+0000","last_change":"2023-11-04T01:41:13.481092+0000","last_active":"2023-11-04T01:43:16.162021+0000","last_peered":"2023-11-04T01:43:16.162021+0000","last_clean":"2023-11-04T01:43:16.162021+0000","last_became_active":"2023-11-04T01:41:12.113460+0000","last_became_peered":"2023-11-04T01:41:12.113460+0000","last_unstale":"2023-11-04T01:43:16.162021+0000","last_undegraded":"2023-11-04T01:43:16.162021+0000","last_fullsized":"2023-11-04T01:43:16.162021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:31.565768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00186075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214324+0000","last_change":"2023-11-04T01:43:16.176736+0000","last_active":"2023-11-04T01:43:17.214324+0000","last_peered":"2023-11-04T01:43:17.214324+0000","last_clean":"2023-11-04T01:43:17.214324+0000","last_became_active":"2023-11-04T01:43:16.176381+0000","last_became_peered":"2023-11-04T01:43:16.176381+0000","last_unstale":"2023-11-04T01:43:17.214324+0000","last_undegraded":"2023-11-04T01:43:17.214324+0000","last_fullsized":"2023-11-04T01:43:17.214324+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:24.858407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.177839+0000","last_change":"2023-11-04T01:43:15.130147+0000","last_active":"2023-11-04T01:43:16.177839+0000","last_peered":"2023-11-04T01:43:16.177839+0000","last_clean":"2023-11-04T01:43:16.177839+0000","last_became_active":"2023-11-04T01:43:15.129434+0000","last_became_peered":"2023-11-04T01:43:15.129434+0000","last_unstale":"2023-11-04T01:43:16.177839+0000","last_undegraded":"2023-11-04T01:43:16.177839+0000","last_fullsized":"2023-11-04T01:43:16.177839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:37.498717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.163424+0000","last_change":"2023-11-04T01:42:21.138885+0000","last_active":"2023-11-04T01:43:16.163424+0000","last_peered":"2023-11-04T01:43:16.163424+0000","last_clean":"2023-11-04T01:43:16.163424+0000","last_became_active":"2023-11-04T01:42:21.137997+0000","last_became_peered":"2023-11-04T01:42:21.137997+0000","last_unstale":"2023-11-04T01:43:16.163424+0000","last_undegraded":"2023-11-04T01:43:16.163424+0000","last_fullsized":"2023-11-04T01:43:16.163424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:09.350833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.158437+0000","last_change":"2023-11-04T01:42:22.662609+0000","last_active":"2023-11-04T01:43:16.158437+0000","last_peered":"2023-11-04T01:43:16.158437+0000","last_clean":"2023-11-04T01:43:16.158437+0000","last_became_active":"2023-11-04T01:42:20.133572+0000","last_became_peered":"2023-11-04T01:42:20.133572+0000","last_unstale":"2023-11-04T01:43:16.158437+0000","last_undegraded":"2023-11-04T01:43:16.158437+0000","last_fullsized":"2023-11-04T01:43:16.158437+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:20.687302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015228679999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.212284+0000","last_change":"2023-11-04T01:41:13.612179+0000","last_active":"2023-11-04T01:43:17.212284+0000","last_peered":"2023-11-04T01:43:17.212284+0000","last_clean":"2023-11-04T01:43:17.212284+0000","last_became_active":"2023-11-04T01:41:12.098815+0000","last_became_peered":"2023-11-04T01:41:12.098815+0000","last_unstale":"2023-11-04T01:43:17.212284+0000","last_undegraded":"2023-11-04T01:43:17.212284+0000","last_fullsized":"2023-11-04T01:43:17.212284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:44.467075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039740499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.141897+0000","last_change":"2023-11-04T01:43:16.182358+0000","last_active":"2023-11-04T01:43:17.141897+0000","last_peered":"2023-11-04T01:43:17.141897+0000","last_clean":"2023-11-04T01:43:17.141897+0000","last_became_active":"2023-11-04T01:43:16.181533+0000","last_became_peered":"2023-11-04T01:43:16.181533+0000","last_unstale":"2023-11-04T01:43:17.141897+0000","last_undegraded":"2023-11-04T01:43:17.141897+0000","last_fullsized":"2023-11-04T01:43:17.141897+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:05.679431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"90'3","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.211162+0000","last_change":"2023-11-04T01:43:15.144364+0000","last_active":"2023-11-04T01:43:16.211162+0000","last_peered":"2023-11-04T01:43:16.211162+0000","last_clean":"2023-11-04T01:43:16.211162+0000","last_became_active":"2023-11-04T01:43:15.138867+0000","last_became_peered":"2023-11-04T01:43:15.138867+0000","last_unstale":"2023-11-04T01:43:16.211162+0000","last_undegraded":"2023-11-04T01:43:16.211162+0000","last_fullsized":"2023-11-04T01:43:16.211162+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:11.208100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.164178+0000","last_change":"2023-11-04T01:42:21.135953+0000","last_active":"2023-11-04T01:43:16.164178+0000","last_peered":"2023-11-04T01:43:16.164178+0000","last_clean":"2023-11-04T01:43:16.164178+0000","last_became_active":"2023-11-04T01:42:21.135234+0000","last_became_peered":"2023-11-04T01:42:21.135234+0000","last_unstale":"2023-11-04T01:43:16.164178+0000","last_undegraded":"2023-11-04T01:43:16.164178+0000","last_fullsized":"2023-11-04T01:43:16.164178+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:37.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.157719+0000","last_change":"2023-11-04T01:42:22.705796+0000","last_active":"2023-11-04T01:43:16.157719+0000","last_peered":"2023-11-04T01:43:16.157719+0000","last_clean":"2023-11-04T01:43:16.157719+0000","last_became_active":"2023-11-04T01:42:20.130979+0000","last_became_peered":"2023-11-04T01:42:20.130979+0000","last_unstale":"2023-11-04T01:43:16.157719+0000","last_undegraded":"2023-11-04T01:43:16.157719+0000","last_fullsized":"2023-11-04T01:43:16.157719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:34.968059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028584560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.165332+0000","last_change":"2023-11-04T01:41:13.629454+0000","last_active":"2023-11-04T01:43:16.165332+0000","last_peered":"2023-11-04T01:43:16.165332+0000","last_clean":"2023-11-04T01:43:16.165332+0000","last_became_active":"2023-11-04T01:41:12.118593+0000","last_became_peered":"2023-11-04T01:41:12.118593+0000","last_unstale":"2023-11-04T01:43:16.165332+0000","last_undegraded":"2023-11-04T01:43:16.165332+0000","last_fullsized":"2023-11-04T01:43:16.165332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:07:37.914518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075410199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:43:17.214362+0000","last_change":"2023-11-04T01:43:16.179192+0000","last_active":"2023-11-04T01:43:17.214362+0000","last_peered":"2023-11-04T01:43:17.214362+0000","last_clean":"2023-11-04T01:43:17.214362+0000","last_became_active":"2023-11-04T01:43:16.177565+0000","last_became_peered":"2023-11-04T01:43:16.177565+0000","last_unstale":"2023-11-04T01:43:17.214362+0000","last_undegraded":"2023-11-04T01:43:17.214362+0000","last_fullsized":"2023-11-04T01:43:17.214362+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:15.095004+0000","last_clean_scrub_stamp":"2023-11-04T01:43:15.095004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:22.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"90'6","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.215355+0000","last_change":"2023-11-04T01:43:15.162848+0000","last_active":"2023-11-04T01:43:16.215355+0000","last_peered":"2023-11-04T01:43:16.215355+0000","last_clean":"2023-11-04T01:43:16.215355+0000","last_became_active":"2023-11-04T01:43:15.161007+0000","last_became_peered":"2023-11-04T01:43:15.161007+0000","last_unstale":"2023-11-04T01:43:16.215355+0000","last_undegraded":"2023-11-04T01:43:16.215355+0000","last_fullsized":"2023-11-04T01:43:16.215355+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:14.083957+0000","last_clean_scrub_stamp":"2023-11-04T01:43:14.083957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:21.097038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.159343+0000","last_change":"2023-11-04T01:42:21.138643+0000","last_active":"2023-11-04T01:43:16.159343+0000","last_peered":"2023-11-04T01:43:16.159343+0000","last_clean":"2023-11-04T01:43:16.159343+0000","last_became_active":"2023-11-04T01:42:21.137915+0000","last_became_peered":"2023-11-04T01:42:21.137915+0000","last_unstale":"2023-11-04T01:43:16.159343+0000","last_undegraded":"2023-11-04T01:43:16.159343+0000","last_fullsized":"2023-11-04T01:43:16.159343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:20.080523+0000","last_clean_scrub_stamp":"2023-11-04T01:42:20.080523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:32.915629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.150536+0000","last_change":"2023-11-04T01:42:22.116657+0000","last_active":"2023-11-04T01:43:16.150536+0000","last_peered":"2023-11-04T01:43:16.150536+0000","last_clean":"2023-11-04T01:43:16.150536+0000","last_became_active":"2023-11-04T01:42:20.145519+0000","last_became_peered":"2023-11-04T01:42:20.145519+0000","last_unstale":"2023-11-04T01:43:16.150536+0000","last_undegraded":"2023-11-04T01:43:16.150536+0000","last_fullsized":"2023-11-04T01:43:16.150536+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:19.068024+0000","last_clean_scrub_stamp":"2023-11-04T01:42:19.068024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:09.014209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001655817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:43:16.170151+0000","last_change":"2023-11-04T01:41:13.219165+0000","last_active":"2023-11-04T01:43:16.170151+0000","last_peered":"2023-11-04T01:43:16.170151+0000","last_clean":"2023-11-04T01:43:16.170151+0000","last_became_active":"2023-11-04T01:41:12.097391+0000","last_became_peered":"2023-11-04T01:41:12.097391+0000","last_unstale":"2023-11-04T01:43:16.170151+0000","last_undegraded":"2023-11-04T01:43:16.170151+0000","last_fullsized":"2023-11-04T01:43:16.170151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:11.050387+0000","last_clean_scrub_stamp":"2023-11-04T01:41:11.050387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:05.618129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011775139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1720320,"data_stored":1116858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":1.139,"15min":0.95999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":29.603000000000002,"5min":29.603000000000002,"15min":29.603000000000002},"last":1.498},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.59099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.355,"5min":1.454,"15min":1.454},"last":0.90000000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88200000000000001,"15min":0.872},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.038},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.96599999999999997,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.96999999999999997,"15min":0.92700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":8.1280000000000001,"5min":8.1280000000000001,"15min":8.1280000000000001},"last":1.6639999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.98099999999999998,"15min":0.96499999999999997},"min":{"1min":0.63500000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.2450000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.89800000000000002,"15min":0.89700000000000002},"min":{"1min":0.65300000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":3.847},{"interface":"front","average":{"1min":2.0760000000000001,"5min":1.1819999999999999,"15min":1.03},"min":{"1min":0.70999999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":25.791,"5min":25.791,"15min":25.791},"last":5.6689999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98599999999999999,"15min":1.0009999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.98,"5min":3.98,"15min":3.98},"last":1.198},{"interface":"front","average":{"1min":2.0910000000000002,"5min":1.27,"15min":1.131},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":25.696999999999999,"5min":25.696999999999999,"15min":25.696999999999999},"last":1.5900000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.129,"15min":1.0589999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":11.064,"5min":11.064,"15min":11.064},"last":5.391},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.139,"15min":1.1459999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":4.1630000000000003,"5min":4.1630000000000003,"15min":4.1630000000000003},"last":1.127}]},{"osd":6,"last update":"Sat Nov 4 01:42:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1200000000000001,"15min":1.1160000000000001},"min":{"1min":0.72699999999999998,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":3.907},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2250000000000001,"15min":1.226},"min":{"1min":0.88500000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":3.9369999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":528546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.51200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.165,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.878,"15min":0.88600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2210000000000001,"5min":1.347,"15min":1.347},"last":0.879}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.99299999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.262,"5min":1.395,"15min":1.395},"last":0.999}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.226,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2270000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.73799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93999999999999995,"15min":0.95399999999999996},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2010000000000001,"5min":1.319,"15min":1.319},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1950000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.95999999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98199999999999998},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.079,"15min":1.103},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3879999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.03,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.694,"15min":1.694},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1259999999999999,"15min":1.1359999999999999},"min":{"1min":0.76700000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0289999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.1120000000000001,"15min":1.1160000000000001},"min":{"1min":0.71799999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3109999999999999,"5min":1.649,"15min":1.649},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1499999999999999,"15min":1.175},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.409,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.0720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1118208,"data_stored":526330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80800000000000005,"15min":0.79700000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.23,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.80100000000000005},"min":{"1min":0.504,"5min":0.5,"15min":0.5},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.262},"last":0.621}]},{"osd":1,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86599999999999999,"15min":0.85599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88100000000000001,"15min":0.876},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.89500000000000002,"15min":0.88500000000000001},"min":{"1min":0.54400000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.419,"15min":1.419},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58699999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1599999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.76100000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2490000000000001,"5min":1.252,"15min":1.252},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.026,"15min":1.046},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.58599999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.01,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.89500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.04,"15min":1.0529999999999999},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4159999999999999,"5min":1.502,"15min":1.502},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.996,"15min":1.0009999999999999},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2270000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0629999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.622,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.383,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.038},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.107,"15min":1.115},"min":{"1min":0.68799999999999994,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3280000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":526422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":1.016},"min":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3939999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.60199999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2869999999999999,"5min":1.3,"15min":1.3},"last":0.98999999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.91700000000000004,"15min":0.94499999999999995},"min":{"1min":0.55500000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.101,"5min":1.605,"15min":1.605},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.92200000000000004},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2130000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.234,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.87},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.446,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.96599999999999997,"15min":0.97299999999999998},"min":{"1min":0.68100000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.488,"15min":1.488},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.296,"5min":1.996,"15min":1.996},"last":1.052}]},{"osd":5,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.077,"15min":1.097},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4830000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0649999999999999,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.087}]},{"osd":6,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2889999999999999,"5min":1.514,"15min":1.514},"last":1.157},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1259999999999999,"15min":1.1419999999999999},"min":{"1min":0.70599999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.129}]},{"osd":7,"last update":"Sat Nov 4 01:42:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.143,"15min":1.1850000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.349,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.161,"15min":1.169},"min":{"1min":0.92000000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.4339999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.2130000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1122304,"data_stored":526912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.65900000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.147,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.629},"min":{"1min":0.33300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65600000000000003,"15min":0.68200000000000005},"min":{"1min":0.309,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.171,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72399999999999998,"15min":0.74199999999999999},"min":{"1min":0.36199999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2829999999999999,"5min":1.623,"15min":1.623},"last":0.434}]},{"osd":2,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.67000000000000004,"15min":0.70099999999999996},"min":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91500000000000004,"5min":1.276,"15min":1.276},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.83899999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0069999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.95999999999999996,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.395,"5min":1.806,"15min":1.806},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97599999999999998,"15min":0.96999999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.67300000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.425,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.228,"5min":1.54,"15min":1.54},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0449999999999999,"15min":1.0649999999999999},"min":{"1min":0.60699999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.5720000000000001,"5min":1.73,"15min":1.73},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.361,"5min":1.407,"15min":1.407},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.0860000000000001,"15min":1.1060000000000001},"min":{"1min":0.65400000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.419,"5min":1.732,"15min":1.732},"last":0.80100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1122304,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.64600000000000002},"min":{"1min":0.35199999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1040000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.103,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":1.29,"15min":1.29},"last":0.84899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.749,"15min":0.77700000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.125,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.76500000000000001},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94099999999999995,"15min":0.98099999999999998},"min":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1399999999999999,"5min":1.534,"15min":1.534},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.022,"15min":1.0469999999999999},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.21,"5min":1.877,"15min":1.877},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.012,"15min":1.046},"min":{"1min":0.65300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.25,"5min":1.446,"15min":1.446},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.034,"15min":1.0589999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.048}]},{"osd":6,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.143,"15min":1.1870000000000001},"min":{"1min":0.73299999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0379999999999998,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.0840000000000001,"15min":1.1140000000000001},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.133}]},{"osd":7,"last update":"Sat Nov 4 01:42:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1830000000000001,"15min":1.2230000000000001},"min":{"1min":0.65000000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.2},{"interface":"front","average":{"1min":1.071,"5min":1.1060000000000001,"15min":1.1439999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4630000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.175}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1122304,"data_stored":526364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.67300000000000004,"15min":0.64200000000000002},"min":{"1min":0.27900000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.65600000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.05,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.66600000000000004},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.625},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2310000000000001,"5min":1.27,"15min":1.27},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.379,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.212},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.7929999999999999,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86099999999999999,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.111},{"interface":"front","average":{"1min":1.216,"5min":1.012,"15min":0.96699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.077,"15min":1.056},"min":{"1min":0.61099999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.077,"15min":1.083},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5449999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.02}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.92500000000000004,"15min":0.90600000000000003},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.1220000000000001,"15min":1.0800000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.9199999999999999,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":1.0660000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1040000000000001,"15min":1.1140000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.794,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.034,"5min":0.998,"15min":0.98699999999999999},"min":{"1min":0.68799999999999994,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9850000000000001,"5min":1.994,"15min":1.994},"last":1.1870000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1728512,"data_stored":1118400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75800000000000001,"5min":1.135,"15min":1.135},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94899999999999995,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.751}]},{"osd":3,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.0840000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.224},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.75600000000000001,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.27,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.004,"15min":1.026},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2470000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.68999999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1399999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.78300000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89400000000000002,"15min":0.87},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.417},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.71699999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.2170000000000001,"5min":1.694,"15min":1.694},"last":0.91900000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.745,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.298,"5min":1.782,"15min":1.782},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.054,"15min":1.0609999999999999},"min":{"1min":0.71699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5229999999999999,"5min":1.903,"15min":1.903},"last":0.89400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:42:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0680000000000001,"15min":1.0800000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5920000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.61299999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5389999999999999,"5min":1.653,"15min":1.653},"last":1.335}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:25.221 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:43:25.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:43:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df878b640 1 Processor -- start 2023-11-04T01:43:25.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df878b640 1 -- start start 2023-11-04T01:43:25.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df878b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6df015af30 0x7f6df00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df878b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df006fc10 con 0x7f6df0071900 2023-11-04T01:43:25.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df878b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df00c8fa0 con 0x7f6df00c9cd0 2023-11-04T01:43:25.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df878b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df00c9840 con 0x7f6df015af30 2023-11-04T01:43:25.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6df0071900 0x7f6df00ad500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:32798/0 (socket says 172.21.15.40:32798) 2023-11-04T01:43:25.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 -- 172.21.15.40:0/2009121634 learned_addr learned my addr 172.21.15.40:0/2009121634 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6527640 1 --2- 172.21.15.40:0/2009121634 >> v2:172.21.15.91:3300/0 conn(0x7f6df015af30 0x7f6df00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704308545 0 0) 0x7f6df006fc10 con 0x7f6df0071900 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd8003530 con 0x7f6df0071900 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294024342 0 0) 0x7f6dd8003530 con 0x7f6df0071900 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 >> v2:172.21.15.91:3300/0 conn(0x7f6df015af30 msgr2=0x7f6df00ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 --2- 172.21.15.40:0/2009121634 >> v2:172.21.15.91:3300/0 conn(0x7f6df015af30 0x7f6df00ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 >> v1:172.21.15.91:6789/0 conn(0x7f6df00c9cd0 legacy=0x7f6df00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df015b310 con 0x7f6df0071900 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f6de8001680 con 0x7f6df0071900 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 >> v1:172.21.15.40:6789/0 conn(0x7f6df0071900 legacy=0x7f6df00ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8003980 0x7f6dd8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd80047d0 0x7f6dd8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd8005190 0x7f6dd800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c9840 con 0x7f6dd8005190 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd800c130 con 0x7f6dd8003980 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd800c2f0 con 0x7f6dd80047d0 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd8005190 0x7f6dd800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6527640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8003980 0x7f6dd8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df5d26640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd80047d0 0x7f6dd8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 -- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd80047d0 msgr2=0x7f6dd8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd80047d0 0x7f6dd8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 -- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8003980 msgr2=0x7f6dd8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8003980 0x7f6dd8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.353+0000 7f6df6d28640 1 -- 172.21.15.40:0/2009121634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8003530 con 0x7f6dd8005190 2023-11-04T01:43:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df5d26640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6dd80047d0 0x7f6dd8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df6d28640 1 -- 172.21.15.40:0/2009121634 reap_dead start 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df6d28640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd8005190 0x7f6dd800b990 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c1c0 tx=0x7f6de801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e374cce0860d0f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8005ae0 con 0x7f6dd8005190 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de80ab070 con 0x7f6dd8005190 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df5525640 1 -- 172.21.15.40:0/2009121634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8007070 con 0x7f6dd8005190 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 -- 172.21.15.40:0/2009121634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd8005190 msgr2=0x7f6dd800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd8005190 0x7f6dd800b990 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c1c0 tx=0x7f6de801f390 comp rx=0 tx=0).stop 2023-11-04T01:43:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 -- 172.21.15.40:0/2009121634 shutdown_connections 2023-11-04T01:43:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 --2- 172.21.15.40:0/2009121634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd8005190 0x7f6dd800b990 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 -- 172.21.15.40:0/2009121634 >> 172.21.15.40:0/2009121634 conn(0x7f6df00ce9e0 msgr2=0x7f6df00cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 -- 172.21.15.40:0/2009121634 shutdown_connections 2023-11-04T01:43:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.357+0000 7f6df878b640 1 -- 172.21.15.40:0/2009121634 wait complete. 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 Processor -- start 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- start start 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8005190 0x7f6df015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 0x7f6df014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6df015d9e0 0x7f6df015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c2ec0 con 0x7f6df015b500 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c2590 con 0x7f6dd8005190 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c2870 con 0x7f6df015d9e0 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 0x7f6df014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 0x7f6df014f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45060/0 (socket says 172.21.15.40:45060) 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 -- 172.21.15.40:0/2990415929 learned_addr learned my addr 172.21.15.40:0/2990415929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df6d28640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6df015d9e0 0x7f6df015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df6527640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8005190 0x7f6df015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 -- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6df015d9e0 msgr2=0x7f6df015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6df015d9e0 0x7f6df015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 -- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8005190 msgr2=0x7f6df015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8005190 0x7f6df015be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 -- 172.21.15.40:0/2990415929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00c2b50 con 0x7f6df015b500 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df5d26640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 0x7f6df014f5a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6de400dae0 tx=0x7f6de4002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4003db0 con 0x7f6df015b500 2023-11-04T01:43:25.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400b710 con 0x7f6df015b500 2023-11-04T01:43:25.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df00c87f0 con 0x7f6df015b500 2023-11-04T01:43:25.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400baa0 con 0x7f6df015b500 2023-11-04T01:43:25.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df015e3a0 con 0x7f6df015b500 2023-11-04T01:43:25.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df00682a0 con 0x7f6df015b500 2023-11-04T01:43:25.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.361+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6de400bc00 con 0x7f6df015b500 2023-11-04T01:43:25.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.365+0000 7f6deeffd640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ddc0664a0 0x7f6ddc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.365+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f6de40844c0 con 0x7f6df015b500 2023-11-04T01:43:25.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.365+0000 7f6df6527640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ddc0664a0 0x7f6ddc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.365+0000 7f6df6527640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ddc0664a0 0x7f6ddc068960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6df01f5940 tx=0x7f6de0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.369+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6de4051590 con 0x7f6df015b500 2023-11-04T01:43:25.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.585+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6df00c2ce0 con 0x7f6df015b500 2023-11-04T01:43:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.589+0000 7f6deeffd640 1 -- 172.21.15.40:0/2990415929 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6de4054bb0 con 0x7f6df015b500 2023-11-04T01:43:25.597 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-11-04T01:43:25.597 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCyoEVlS0vPNhAAjLE7Fq/+qg+9s7hqcwun3Q== 2023-11-04T01:43:25.597 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2023-11-04T01:43:25.597 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2023-11-04T01:43:25.597 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-11-04T01:43:25.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ddc0664a0 msgr2=0x7f6ddc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ddc0664a0 0x7f6ddc068960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6df01f5940 tx=0x7f6de0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 msgr2=0x7f6df014f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 0x7f6df014f5a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6de400dae0 tx=0x7f6de4002090 comp rx=0 tx=0).stop 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 shutdown_connections 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6ddc0664a0 0x7f6ddc068960 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6df015d9e0 0x7f6df015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6df015b500 0x7f6df014f5a0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 --2- 172.21.15.40:0/2990415929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6dd8005190 0x7f6df015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 >> 172.21.15.40:0/2990415929 conn(0x7f6df00ce9e0 msgr2=0x7f6df00cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 shutdown_connections 2023-11-04T01:43:25.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.593+0000 7f6df878b640 1 -- 172.21.15.40:0/2990415929 wait complete. 2023-11-04T01:43:25.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:25.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.733+0000 7f9e3b0af640 1 Processor -- start 2023-11-04T01:43:25.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.733+0000 7f9e3b0af640 1 -- start start 2023-11-04T01:43:25.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3b0af640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9e3415d240 0x7f9e3415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3b0af640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e340d0b10 0x7f9e340d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3b0af640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340b49c0 0x7f9e340b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3b0af640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e340b5330 con 0x7f9e340d0b10 2023-11-04T01:43:25.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3b0af640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e340d2280 con 0x7f9e3415d240 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3b0af640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340d2560 con 0x7f9e340b49c0 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e340d0b10 0x7f9e340d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e340d0b10 0x7f9e340d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45064/0 (socket says 172.21.15.40:45064) 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 -- 172.21.15.40:0/4113677948 learned_addr learned my addr 172.21.15.40:0/4113677948 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e38e4b640 1 --2- 172.21.15.40:0/4113677948 >> v2:172.21.15.91:3300/0 conn(0x7f9e3415d240 0x7f9e3415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3964c640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340b49c0 0x7f9e340b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 -- 172.21.15.40:0/4113677948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340b49c0 msgr2=0x7f9e340b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340b49c0 0x7f9e340b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 -- 172.21.15.40:0/4113677948 >> v2:172.21.15.91:3300/0 conn(0x7f9e3415d240 msgr2=0x7f9e3415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 --2- 172.21.15.40:0/4113677948 >> v2:172.21.15.91:3300/0 conn(0x7f9e3415d240 0x7f9e3415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 -- 172.21.15.40:0/4113677948 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340d2840 con 0x7f9e340d0b10 2023-11-04T01:43:25.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e3964c640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340b49c0 0x7f9e340b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:25.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e33fff640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340d0b10 0x7f9e340d1a00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f9e3408c090 tx=0x7f9e2801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578522396d00b17e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e337fe640 1 -- 172.21.15.40:0/4113677948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280ab620 con 0x7f9e340d0b10 2023-11-04T01:43:25.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e337fe640 1 -- 172.21.15.40:0/4113677948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e280ab780 con 0x7f9e340d0b10 2023-11-04T01:43:25.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.737+0000 7f9e337fe640 1 -- 172.21.15.40:0/4113677948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280abb10 con 0x7f9e340d0b10 2023-11-04T01:43:25.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/4113677948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340d0b10 msgr2=0x7f9e340d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340d0b10 0x7f9e340d1a00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f9e3408c090 tx=0x7f9e2801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/4113677948 shutdown_connections 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340b49c0 0x7f9e340b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/4113677948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340d0b10 0x7f9e340d1a00 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/4113677948 >> v2:172.21.15.91:3300/0 conn(0x7f9e3415d240 0x7f9e3415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/4113677948 >> 172.21.15.40:0/4113677948 conn(0x7f9e340cf9c0 msgr2=0x7f9e340cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/4113677948 shutdown_connections 2023-11-04T01:43:25.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/4113677948 wait complete. 2023-11-04T01:43:25.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 Processor -- start 2023-11-04T01:43:25.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- start start 2023-11-04T01:43:25.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 0x7f9e34148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340d0b10 0x7f9e34154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e3415d240 0x7f9e34155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e341fa360 con 0x7f9e340b49c0 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3414a8e0 con 0x7f9e3415d240 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e341fa080 con 0x7f9e340d0b10 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 0x7f9e34148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 0x7f9e34148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45066/0 (socket says 172.21.15.40:45066) 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 -- 172.21.15.40:0/462692505 learned_addr learned my addr 172.21.15.40:0/462692505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e33fff640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340d0b10 0x7f9e34154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3964c640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e3415d240 0x7f9e34155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 -- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340d0b10 msgr2=0x7f9e34154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340d0b10 0x7f9e34154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 -- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e3415d240 msgr2=0x7f9e34155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e3415d240 0x7f9e34155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 -- 172.21.15.40:0/462692505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280094d0 con 0x7f9e340b49c0 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e38e4b640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 0x7f9e34148870 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400d5f0 tx=0x7f9e2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240125f0 con 0x7f9e340b49c0 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24012750 con 0x7f9e340b49c0 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e34156b80 con 0x7f9e340b49c0 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24012ae0 con 0x7f9e340b49c0 2023-11-04T01:43:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.741+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e34148db0 con 0x7f9e340b49c0 2023-11-04T01:43:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.745+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e340675f0 con 0x7f9e340b49c0 2023-11-04T01:43:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.745+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e24012c40 con 0x7f9e340b49c0 2023-11-04T01:43:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.745+0000 7f9e317fa640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e200664a0 0x7f9e20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.745+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f9e240846a0 con 0x7f9e340b49c0 2023-11-04T01:43:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.745+0000 7f9e33fff640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e200664a0 0x7f9e20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.745+0000 7f9e33fff640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e200664a0 0x7f9e20068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9e280af000 tx=0x7f9e280a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.749+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9e24051770 con 0x7f9e340b49c0 2023-11-04T01:43:25.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.937+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e340c6c80 con 0x7f9e340b49c0 2023-11-04T01:43:25.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.937+0000 7f9e317fa640 1 -- 172.21.15.40:0/462692505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f9e24054d90 con 0x7f9e340b49c0 2023-11-04T01:43:25.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:25.947 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:18.546352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7086},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:25.947 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 47 2023-11-04T01:43:25.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e200664a0 msgr2=0x7f9e20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e200664a0 0x7f9e20068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9e280af000 tx=0x7f9e280a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 msgr2=0x7f9e34148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 0x7f9e34148870 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400d5f0 tx=0x7f9e2400dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 shutdown_connections 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9e200664a0 0x7f9e20068960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9e3415d240 0x7f9e34155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9e340d0b10 0x7f9e34154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 --2- 172.21.15.40:0/462692505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e340b49c0 0x7f9e34148870 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 >> 172.21.15.40:0/462692505 conn(0x7f9e340cf9c0 msgr2=0x7f9e340c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 shutdown_connections 2023-11-04T01:43:25.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:25.941+0000 7f9e3b0af640 1 -- 172.21.15.40:0/462692505 wait complete. 2023-11-04T01:43:26.366 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:43:18.546352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7086}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7086': {'gid': 7086, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/15089123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 15089123}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 15089123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:26.366 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:43:26.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:43:26.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 Processor -- start 2023-11-04T01:43:26.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 -- start start 2023-11-04T01:43:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f28bc06cd30 0x7f28bc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28bc0caf10 0x7f28bc0b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc06dd90 con 0x7f28bc0caf10 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0cefe0 con 0x7f28bc06cd30 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28c10c8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc070d90 con 0x7f28bc159e70 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28bc0caf10 0x7f28bc0b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28bc0caf10 0x7f28bc0b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45068/0 (socket says 172.21.15.40:45068) 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 -- 172.21.15.40:0/806497327 learned_addr learned my addr 172.21.15.40:0/806497327 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bad9d640 1 --2- 172.21.15.40:0/806497327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28ba59c640 1 --2- 172.21.15.40:0/806497327 >> v2:172.21.15.91:3300/0 conn(0x7f28bc06cd30 0x7f28bc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 -- 172.21.15.40:0/806497327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 msgr2=0x7f28bc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 --2- 172.21.15.40:0/806497327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 -- 172.21.15.40:0/806497327 >> v2:172.21.15.91:3300/0 conn(0x7f28bc06cd30 msgr2=0x7f28bc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 --2- 172.21.15.40:0/806497327 >> v2:172.21.15.91:3300/0 conn(0x7f28bc06cd30 0x7f28bc0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.497+0000 7f28bb59e640 1 -- 172.21.15.40:0/806497327 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc06d4f0 con 0x7f28bc0caf10 2023-11-04T01:43:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28bb59e640 1 --2- 172.21.15.40:0/806497327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc0b1700 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0d0c00 tx=0x7f28b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c263df6f4dfc17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28b9d9b640 1 -- 172.21.15.40:0/806497327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ac600 con 0x7f28bc0caf10 2023-11-04T01:43:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28b9d9b640 1 -- 172.21.15.40:0/806497327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b40a8050 con 0x7f28bc0caf10 2023-11-04T01:43:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28b9d9b640 1 -- 172.21.15.40:0/806497327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ac980 con 0x7f28bc0caf10 2023-11-04T01:43:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 -- 172.21.15.40:0/806497327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 msgr2=0x7f28bc0b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 --2- 172.21.15.40:0/806497327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc0b1700 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0d0c00 tx=0x7f28b401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 -- 172.21.15.40:0/806497327 shutdown_connections 2023-11-04T01:43:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 --2- 172.21.15.40:0/806497327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc0b1700 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 --2- 172.21.15.40:0/806497327 >> v2:172.21.15.91:3300/0 conn(0x7f28bc06cd30 0x7f28bc0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 --2- 172.21.15.40:0/806497327 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 -- 172.21.15.40:0/806497327 >> 172.21.15.40:0/806497327 conn(0x7f28bc06e760 msgr2=0x7f28bc06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 -- 172.21.15.40:0/806497327 shutdown_connections 2023-11-04T01:43:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 -- 172.21.15.40:0/806497327 wait complete. 2023-11-04T01:43:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 Processor -- start 2023-11-04T01:43:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.501+0000 7f28c10c8640 1 -- start start 2023-11-04T01:43:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc06cd30 0x7f28bc1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0c6cd0 con 0x7f28bc0caf10 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc154310 con 0x7f28bc06cd30 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc1545b0 con 0x7f28bc159e70 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc1524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45080/0 (socket says 172.21.15.40:45080) 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 -- 172.21.15.40:0/2375240245 learned_addr learned my addr 172.21.15.40:0/2375240245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28bad9d640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc06cd30 0x7f28bc1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28bb59e640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 -- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 msgr2=0x7f28bc1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 -- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc06cd30 msgr2=0x7f28bc1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc06cd30 0x7f28bc1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 -- 172.21.15.40:0/2375240245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b40094d0 con 0x7f28bc0caf10 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28bad9d640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc06cd30 0x7f28bc1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28bb59e640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28ba59c640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc1524a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d800 tx=0x7f28a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28b37fe640 1 -- 172.21.15.40:0/2375240245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400b6c0 con 0x7f28bc0caf10 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28b37fe640 1 -- 172.21.15.40:0/2375240245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400b820 con 0x7f28bc0caf10 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28b37fe640 1 -- 172.21.15.40:0/2375240245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400bb90 con 0x7f28bc0caf10 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc154890 con 0x7f28bc0caf10 2023-11-04T01:43:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc154e50 con 0x7f28bc0caf10 2023-11-04T01:43:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28b37fe640 1 -- 172.21.15.40:0/2375240245 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28a400bcf0 con 0x7f28bc0caf10 2023-11-04T01:43:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28b37fe640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f289c0664a0 0x7f289c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.505+0000 7f28b37fe640 1 -- 172.21.15.40:0/2375240245 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f28a4084840 con 0x7f28bc0caf10 2023-11-04T01:43:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bad9d640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f289c0664a0 0x7f289c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 Processor -- start 2023-11-04T01:43:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- start start 2023-11-04T01:43:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bad9d640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f289c0664a0 0x7f289c068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009ed0 tx=0x7f28ac00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a0be380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69f3c460 con 0x55bc6a071b40 2023-11-04T01:43:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69ecd690 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc69ecabc0 con 0x55bc6a0be8c0 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45094/0 (socket says 172.21.15.40:45094) 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 -- 172.21.15.40:0/3571939685 learned_addr learned my addr 172.21.15.40:0/3571939685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bad9d640 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a0be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28ba59c640 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 -- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 msgr2=0x55bc6a071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 -- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0bdfa0 msgr2=0x55bc6a0be380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a0be380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 -- 172.21.15.40:0/3571939685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc69bbe890 con 0x55bc6a071b40 2023-11-04T01:43:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bad9d640 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a0be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28bb59e640 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a071f20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f28b401c9b0 tx=0x7f28b40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a191355d024ab6cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28b0ff9640 1 -- 172.21.15.40:0/3571939685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ac890 con 0x55bc6a071b40 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28b0ff9640 1 -- 172.21.15.40:0/3571939685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b40ac9f0 con 0x55bc6a071b40 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28b0ff9640 1 -- 172.21.15.40:0/3571939685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40acd60 con 0x55bc6a071b40 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- 172.21.15.40:0/3571939685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 msgr2=0x55bc6a071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a071f20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f28b401c9b0 tx=0x7f28b40a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- 172.21.15.40:0/3571939685 shutdown_connections 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a071f20 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 --2- 172.21.15.40:0/3571939685 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a0be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- 172.21.15.40:0/3571939685 >> 172.21.15.40:0/3571939685 conn(0x55bc6a09ed40 msgr2=0x55bc6a0a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- 172.21.15.40:0/3571939685 shutdown_connections 2023-11-04T01:43:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.509+0000 7f28c41f5000 1 -- 172.21.15.40:0/3571939685 wait complete. 2023-11-04T01:43:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- start start 2023-11-04T01:43:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 Processor -- start 2023-11-04T01:43:26.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a077a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a077f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0784c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69ec64b0 con 0x55bc6a071b40 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69e7eaa0 con 0x55bc6a0be8c0 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc69e84940 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 10 client.0 _ll_register_callbacks cb 0x55bc6a05f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a077a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45102/0 (socket says 172.21.15.40:45102) 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 -- 172.21.15.40:0/1123626171 learned_addr learned my addr 172.21.15.40:0/1123626171 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28ba59c640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a077f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bb59e640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0784c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 -- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 msgr2=0x55bc6a077f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a077f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 -- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 msgr2=0x55bc6a0784c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0784c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 -- 172.21.15.40:0/1123626171 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc06d4f0 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28bad9d640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a077a40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f28ac004030 tx=0x7f28ac004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd26b561fc31c75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 1 -- 172.21.15.40:0/1123626171 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac014960 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 1 -- 172.21.15.40:0/1123626171 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f28ac014ac0 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc69e83e10 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 1 -- 172.21.15.40:0/1123626171 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28ac014c80 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 10 client.7272 fetch_fsmap learned FSMap version 47 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55bc69e871a0 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 1 -- 172.21.15.40:0/1123626171 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc69e83e10 con 0x55bc6a071b40 2023-11-04T01:43:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 1 -- 172.21.15.40:0/1123626171 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f28ac029250 con 0x55bc6a071b40 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 10 client.7272 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 10 client.7272 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 20 client.7272 populate_metadata read hostname 'smithi040' 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a078d60 0x55bc6a0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 4 client.7272 mds_command: new command op to 7086 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 --> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc69ec4e00 con 0x55bc6a078d60 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28ba59c640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a078d60 0x55bc6a0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 10 client.7272 ms_handle_connect on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28ba59c640 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a078d60 0x55bc6a0cf720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2851be817c47cf5 server_cookie=93ac199ec0de27fb in_seq=0 out_seq=0 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 1 -- 172.21.15.40:0/1123626171 <== mds.0 v2:172.21.15.40:6834/15089123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bc69ec4e00 con 0x55bc6a078d60 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 10 client.7272 handle_command_reply: tid=0 2023-11-04T01:43:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 client.7272 shutdown 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 msgr2=0x55bc6a077a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a077a40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f28ac004030 tx=0x7f28ac004a50 comp rx=0 tx=0).stop 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 shutdown_connections 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a078d60 0x55bc6a0cf720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0784c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a077f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f2899ffb640 0 client.7272 ms_handle_reset on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 --2- 172.21.15.40:0/1123626171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a077a40 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 >> 172.21.15.40:0/1123626171 conn(0x55bc6a09ed40 msgr2=0x55bc6a0a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 shutdown_connections 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.513+0000 7f28c41f5000 1 -- 172.21.15.40:0/1123626171 wait complete. 2023-11-04T01:43:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.517+0000 7f28c41f5000 20 client.7272 trim_cache size 0 max 16384 2023-11-04T01:43:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.529+0000 7f28c41f5000 1 Processor -- start 2023-11-04T01:43:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.529+0000 7f28c41f5000 1 -- start start 2023-11-04T01:43:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a071b40 0x55bc6a0798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a079de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a0bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69b7f940 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69ec9010 con 0x55bc6a071b40 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc6a077510 con 0x55bc6a0be8c0 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a079de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a079de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45118/0 (socket says 172.21.15.40:45118) 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 -- 172.21.15.40:0/2604422028 learned_addr learned my addr 172.21.15.40:0/2604422028 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28bad9d640 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a071b40 0x55bc6a0798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 -- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 msgr2=0x55bc6a0bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28bb59e640 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a0bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a0bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 -- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a071b40 msgr2=0x55bc6a0798a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a071b40 0x55bc6a0798a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 -- 172.21.15.40:0/2604422028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc69e6d4a0 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28bad9d640 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a071b40 0x55bc6a0798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a079de0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f28a4055250 tx=0x7f28a4084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce29a7e6e911c00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28b17fa640 1 -- 172.21.15.40:0/2604422028 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a405d850 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28b17fa640 1 -- 172.21.15.40:0/2604422028 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a40829c0 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28b17fa640 1 -- 172.21.15.40:0/2604422028 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4051c60 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- 172.21.15.40:0/2604422028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 msgr2=0x55bc6a079de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a079de0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f28a4055250 tx=0x7f28a4084040 comp rx=0 tx=0).stop 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- 172.21.15.40:0/2604422028 shutdown_connections 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0be8c0 0x55bc6a0bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a0bdfa0 0x55bc6a079de0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- 172.21.15.40:0/2604422028 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a071b40 0x55bc6a0798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- 172.21.15.40:0/2604422028 >> 172.21.15.40:0/2604422028 conn(0x55bc6a09ed40 msgr2=0x55bc6a079190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- 172.21.15.40:0/2604422028 shutdown_connections 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- 172.21.15.40:0/2604422028 wait complete. 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- start start 2023-11-04T01:43:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 Processor -- start 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a0d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a0db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0db6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69e49460 con 0x55bc6a071b40 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc69e99ba0 con 0x55bc6a0be8c0 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc69e84460 con 0x55bc6a0bdfa0 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28c41f5000 10 client.0 _ll_register_callbacks cb 0x7f28b40af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a0d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a0d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45128/0 (socket says 172.21.15.40:45128) 2023-11-04T01:43:26.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28bad9d640 1 -- 172.21.15.40:0/712891314 learned_addr learned my addr 172.21.15.40:0/712891314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.533+0000 7f28ba59c640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a0db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bad9d640 1 -- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 msgr2=0x55bc6a0db1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bad9d640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a0db1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bad9d640 1 -- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 msgr2=0x55bc6a0db6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bb59e640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0db6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bad9d640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0db6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bad9d640 1 -- 172.21.15.40:0/712891314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc154e50 con 0x55bc6a071b40 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28bad9d640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a0d0b60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f28ac026040 tx=0x7f28ac020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fee3ce82409fdb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 1 -- 172.21.15.40:0/712891314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac029250 con 0x55bc6a071b40 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 1 -- 172.21.15.40:0/712891314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f28ac029710 con 0x55bc6a071b40 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc69e90d10 con 0x55bc6a071b40 2023-11-04T01:43:26.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 1 -- 172.21.15.40:0/712891314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28ac0293b0 con 0x55bc6a071b40 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 10 client.7278 fetch_fsmap learned FSMap version 47 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55bc69bbecc0 con 0x55bc6a071b40 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 1 -- 172.21.15.40:0/712891314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc69e90d10 con 0x55bc6a071b40 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 1 -- 172.21.15.40:0/712891314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f28ac005d20 con 0x55bc6a071b40 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 10 client.7278 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 10 client.7278 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 20 client.7278 populate_metadata read hostname 'smithi040' 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a11e7c0 0x55bc6a11eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 4 client.7278 mds_command: new command op to 7086 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 --> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc69ebf490 con 0x55bc6a11e7c0 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28ba59c640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a11e7c0 0x55bc6a11eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28ba59c640 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a11e7c0 0x55bc6a11eba0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b060d637099ed302 server_cookie=c0d96368fcb8cda8 in_seq=0 out_seq=0 2023-11-04T01:43:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 10 client.7278 ms_handle_connect on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 1 -- 172.21.15.40:0/712891314 <== mds.0 v2:172.21.15.40:6834/15089123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55bc69ebf490 con 0x55bc6a11e7c0 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 10 client.7278 handle_command_reply: tid=0 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 client.7278 shutdown 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 msgr2=0x55bc6a0d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a0d0b60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f28ac026040 tx=0x7f28ac020000 comp rx=0 tx=0).stop 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 shutdown_connections 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x55bc6a11e7c0 0x55bc6a11eba0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55bc6a0be8c0 0x55bc6a0db6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55bc6a0bdfa0 0x55bc6a0db1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f2899ffb640 0 client.7278 ms_handle_reset on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 --2- 172.21.15.40:0/712891314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc6a071b40 0x55bc6a0d0b60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 >> 172.21.15.40:0/712891314 conn(0x55bc6a09ed40 msgr2=0x55bc6a079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 shutdown_connections 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 1 -- 172.21.15.40:0/712891314 wait complete. 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c41f5000 20 client.7278 trim_cache size 0 max 16384 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:43:26.551 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7086, 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 10.367263383999999, 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 47, 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 91, 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 91, 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 16.422596840000001 2023-11-04T01:43:26.552 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f289c0664a0 msgr2=0x7f289c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f289c0664a0 0x7f289c068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009ed0 tx=0x7f28ac00b040 comp rx=0 tx=0).stop 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 msgr2=0x7f28bc1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc1524a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d800 tx=0x7f28a400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 shutdown_connections 2023-11-04T01:43:26.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f289c0664a0 0x7f289c068960 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28bc159e70 0x7f28bc1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28bc0caf10 0x7f28bc1524a0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 --2- 172.21.15.40:0/2375240245 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28bc06cd30 0x7f28bc1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 >> 172.21.15.40:0/2375240245 conn(0x7f28bc06e760 msgr2=0x7f28bc0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 shutdown_connections 2023-11-04T01:43:26.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.537+0000 7f28c10c8640 1 -- 172.21.15.40:0/2375240245 wait complete. 2023-11-04T01:43:26.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:26.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa63e6640 1 Processor -- start 2023-11-04T01:43:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa63e6640 1 -- start start 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa63e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa015b320 0x7f2aa006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa63e6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa006bb30 con 0x7f2aa006fe30 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa63e6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa006be10 con 0x7f2aa00b0d40 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa63e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006c7b0 con 0x7f2aa015b320 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2aa006fe30 0x7f2aa00b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:32804/0 (socket says 172.21.15.40:32804) 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 -- 172.21.15.40:0/3373953195 learned_addr learned my addr 172.21.15.40:0/3373953195 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9ffff640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa015b320 0x7f2aa006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533951983 0 0) 0x7f2aa006bb30 con 0x7f2aa006fe30 2023-11-04T01:43:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a88003530 con 0x7f2aa006fe30 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3685305286 0 0) 0x7f2a88003530 con 0x7f2aa006fe30 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa015b320 msgr2=0x7f2aa006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa015b320 0x7f2aa006f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 >> v1:172.21.15.91:6789/0 conn(0x7f2aa00b0d40 legacy=0x7f2aa015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa006c0f0 con 0x7f2aa006fe30 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f2a94001a00 con 0x7f2aa006fe30 2023-11-04T01:43:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 >> v1:172.21.15.40:6789/0 conn(0x7f2aa006fe30 legacy=0x7f2aa00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a880039b0 0x7f2a88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2a880047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a88004ff0 0x7f2a8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006c7b0 con 0x7f2a88004310 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8800bf00 con 0x7f2a88004ff0 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8800c0c0 con 0x7f2a880039b0 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2a880047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9ffff640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a880039b0 0x7f2a88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2aa4983640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a88004ff0 0x7f2a8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 -- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a880039b0 msgr2=0x7f2a88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2a880039b0 0x7f2a88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 -- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a88004ff0 msgr2=0x7f2a8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a88004ff0 0x7f2a8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.669+0000 7f2a9f7fe640 1 -- 172.21.15.40:0/3373953195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88003530 con 0x7f2a88004310 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2a880047f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400a820 tx=0x7f2a9401d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea51b7578cad764 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940072d0 con 0x7f2a88004310 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940a8070 con 0x7f2a88004310 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2a9effd640 1 -- 172.21.15.40:0/3373953195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940076f0 con 0x7f2a88004310 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3373953195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 msgr2=0x7f2a880047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3373953195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2a880047f0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400a820 tx=0x7f2a9401d2f0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa4983640 1 -- 172.21.15.40:0/3373953195 reap_dead start 2023-11-04T01:43:26.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3373953195 shutdown_connections 2023-11-04T01:43:26.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3373953195 >> 172.21.15.40:0/3373953195 conn(0x7f2aa00cebb0 msgr2=0x7f2aa00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3373953195 shutdown_connections 2023-11-04T01:43:26.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3373953195 wait complete. 2023-11-04T01:43:26.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 Processor -- start 2023-11-04T01:43:26.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.673+0000 7f2aa63e6640 1 -- start start 2023-11-04T01:43:26.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2aa01f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c9980 0x7f2aa00c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa0156840 0x7f2aa0156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0157200 con 0x7f2a88004310 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c6ba0 con 0x7f2aa00c9980 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c5f90 con 0x7f2aa0156840 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2aa01f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2aa01f3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45142/0 (socket says 172.21.15.40:45142) 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 -- 172.21.15.40:0/3007469815 learned_addr learned my addr 172.21.15.40:0/3007469815 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c9980 0x7f2aa00c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa4983640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa0156840 0x7f2aa0156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 -- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa0156840 msgr2=0x7f2aa0156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa0156840 0x7f2aa0156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 -- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c9980 msgr2=0x7f2aa00c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c9980 0x7f2aa00c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 -- 172.21.15.40:0/3007469815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00c6270 con 0x7f2a88004310 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa4983640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa0156840 0x7f2aa0156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9ffff640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2aa01f3690 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2a90011610 tx=0x7f2a90011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90015870 con 0x7f2a88004310 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a900159d0 con 0x7f2a88004310 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00c6550 con 0x7f2a88004310 2023-11-04T01:43:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90015d40 con 0x7f2a88004310 2023-11-04T01:43:26.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa01f3bd0 con 0x7f2a88004310 2023-11-04T01:43:26.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa00744a0 con 0x7f2a88004310 2023-11-04T01:43:26.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a9000f480 con 0x7f2a88004310 2023-11-04T01:43:26.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9cff9640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a8c0664a0 0x7f2a8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f2a90084b50 con 0x7f2a88004310 2023-11-04T01:43:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.677+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a8c0664a0 0x7f2a8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.681+0000 7f2a9f7fe640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a8c0664a0 0x7f2a8c068960 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a94009050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.685+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a90051b90 con 0x7f2a88004310 2023-11-04T01:43:26.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.869+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2aa006cbc0 con 0x7f2a88004310 2023-11-04T01:43:26.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.869+0000 7f2a9cff9640 1 -- 172.21.15.40:0/3007469815 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2a900551b0 con 0x7f2a88004310 2023-11-04T01:43:26.877 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a8c0664a0 msgr2=0x7f2a8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a8c0664a0 0x7f2a8c068960 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a94009050 comp rx=0 tx=0).stop 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 msgr2=0x7f2aa01f3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2aa01f3690 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2a90011610 tx=0x7f2a90011ad0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 shutdown_connections 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a8c0664a0 0x7f2a8c068960 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa0156840 0x7f2aa0156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c9980 0x7f2aa00c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 --2- 172.21.15.40:0/3007469815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a88004310 0x7f2aa01f3690 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 >> 172.21.15.40:0/3007469815 conn(0x7f2aa00cebb0 msgr2=0x7f2aa00c3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 shutdown_connections 2023-11-04T01:43:26.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:26.873+0000 7f2aa63e6640 1 -- 172.21.15.40:0/3007469815 wait complete. 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:26.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:26.895 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:26.895 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:26.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:26.895 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:43:26.900 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:43:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42067sec preferred_lft 42067sec 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:26.902 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:26.903 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:26.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:26.904 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:26.950 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:43:26.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:26.952 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:43:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:43:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:43:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:43:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:43:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:27.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.000 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:43:27.000 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:43:27.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:43:27.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:43:27.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:43:27.000 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:43:27.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.074 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:43:27.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:27.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:27.123 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:27.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:43:27.178 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:27.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:27.179 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:27.227 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:27.227 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:27.274 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:27.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:27.319 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:43:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.326 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:43:27.410 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:27.410 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:27.455 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:43:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:43:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:43:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:43:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:27.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:27.465 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:43:27.541 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:43:27.533+0000 7f73a3ad4580 -1 init, newargv = 0x56039ab28a60 newargc=15 2023-11-04T01:43:27.541 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[55853]: starting ceph client 2023-11-04T01:43:27.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[55853]: starting fuse 2023-11-04T01:43:28.611 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:43:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:43:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:43:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:43:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:43:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:28.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:28.623 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:43:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:43:28.671 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:43:28.671 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:28.672 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:28.673 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:43:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.55853.asok 2023-11-04T01:43:28.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:28.814 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55853.asok 2023-11-04T01:43:28.814 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:28.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.55853.asok status 2023-11-04T01:43:28.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:43:29.010 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:43:29.010 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:29.010 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "55853", 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7293, 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:43:29.011 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 7293 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 771372867 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 771372867 2023-11-04T01:43:29.012 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.7293 192.168.0.1:0/771372867", 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/771372867", 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 47, 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 91, 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:43:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:43:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.032 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:29.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:29.032 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:43:29.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.085 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.085 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:29.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:29.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:29.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:43:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:43:29.323 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:43:29.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:43:29.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 Processor -- start 2023-11-04T01:43:29.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 -- start start 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc0015d0b0 0x7fbc0006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0006aaf0 con 0x7fbc0006a6a0 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0015df30 con 0x7fbc0015d0b0 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc08405640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0006d950 con 0x7fbc0006d3b0 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc069a2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc0006a6a0 0x7fbc00070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37986/0 (socket says 172.21.15.40:37986) 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc069a2640 1 -- 172.21.15.40:0/1682050360 learned_addr learned my addr 172.21.15.40:0/1682050360 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc061a1640 1 --2- 172.21.15.40:0/1682050360 >> v2:172.21.15.40:3300/0 conn(0x7fbc0015d0b0 0x7fbc0006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc059a0640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc0519f640 1 -- 172.21.15.40:0/1682050360 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694763016 0 0) 0x7fbbf8001120 con 0x7fbc0006a6a0 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc0519f640 1 -- 172.21.15.40:0/1682050360 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbec003530 con 0x7fbc0006a6a0 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc061a1640 1 -- 172.21.15.40:0/1682050360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 msgr2=0x7fbc0006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc061a1640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0006a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc061a1640 1 -- 172.21.15.40:0/1682050360 >> v1:172.21.15.40:6789/0 conn(0x7fbc0006a6a0 legacy=0x7fbc00070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc061a1640 1 -- 172.21.15.40:0/1682050360 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0015d8e0 con 0x7fbc0015d0b0 2023-11-04T01:43:29.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.449+0000 7fbc059a0640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0006a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc061a1640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc0006ce70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097c0 tx=0x7fbbf401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ad0cc7a9932fbb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc0519f640 1 -- 172.21.15.40:0/1682050360 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab600 con 0x7fbc0015d0b0 2023-11-04T01:43:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc0519f640 1 -- 172.21.15.40:0/1682050360 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40a7050 con 0x7fbc0015d0b0 2023-11-04T01:43:29.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc0519f640 1 -- 172.21.15.40:0/1682050360 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab980 con 0x7fbc0015d0b0 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- 172.21.15.40:0/1682050360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 msgr2=0x7fbc0006ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc0006ce70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097c0 tx=0x7fbbf401c3c0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- 172.21.15.40:0/1682050360 shutdown_connections 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0006a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 --2- 172.21.15.40:0/1682050360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc0006ce70 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- 172.21.15.40:0/1682050360 >> 172.21.15.40:0/1682050360 conn(0x7fbc000b18e0 msgr2=0x7fbc000b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- 172.21.15.40:0/1682050360 shutdown_connections 2023-11-04T01:43:29.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- 172.21.15.40:0/1682050360 wait complete. 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 Processor -- start 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- start start 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc0006a6a0 0x7fbc00151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc000ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00151690 con 0x7fbc0015d0b0 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00155150 con 0x7fbc0006a6a0 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc08405640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001569d0 con 0x7fbc0006d3b0 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc000ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc000ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33642/0 (socket says 172.21.15.40:33642) 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 -- 172.21.15.40:0/1369229389 learned_addr learned my addr 172.21.15.40:0/1369229389 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc061a1640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc0006a6a0 0x7fbc00151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc059a0640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 -- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 msgr2=0x7fbc0015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0015ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 -- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc0006a6a0 msgr2=0x7fbc00151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc0006a6a0 0x7fbc00151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 -- 172.21.15.40:0/1369229389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4009420 con 0x7fbc0015d0b0 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.453+0000 7fbc069a2640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc000ac8b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800c700 tx=0x7fbbf800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8005ac0 con 0x7fbc0015d0b0 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8005c20 con 0x7fbc0015d0b0 2023-11-04T01:43:29.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0015e540 con 0x7fbc0015d0b0 2023-11-04T01:43:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8001d60 con 0x7fbc0015d0b0 2023-11-04T01:43:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc00154e70 con 0x7fbc0015d0b0 2023-11-04T01:43:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0015e3a0 con 0x7fbc0015d0b0 2023-11-04T01:43:29.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbf8007070 con 0x7fbc0015d0b0 2023-11-04T01:43:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbbf2ffd640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe4066490 0x7fbbe4068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fbbf8083520 con 0x7fbc0015d0b0 2023-11-04T01:43:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbc061a1640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe4066490 0x7fbbe4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.457+0000 7fbc061a1640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe4066490 0x7fbbe4068950 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40ad000 tx=0x7fbbf40a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.461+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc0015e3a0 con 0x7fbc0015d0b0 2023-11-04T01:43:29.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:29.653+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbc0015e3a0 con 0x7fbc0015d0b0 2023-11-04T01:43:30.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.257+0000 7fbbf2ffd640 1 -- 172.21.15.40:0/1369229389 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v48) v1 ==== 167+0+0 (secure 0 0 0) 0x7fbc0015e3a0 con 0x7fbc0015d0b0 2023-11-04T01:43:30.264 INFO:teuthology.orchestra.run.smithi040.stderr:enabled new snapshots 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe4066490 msgr2=0x7fbbe4068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe4066490 0x7fbbe4068950 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40ad000 tx=0x7fbbf40a4f90 comp rx=0 tx=0).stop 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 msgr2=0x7fbc000ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc000ac8b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800c700 tx=0x7fbbf800cbc0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 shutdown_connections 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe4066490 0x7fbbe4068950 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0015d0b0 0x7fbc000ac8b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc0006d3b0 0x7fbc0015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 --2- 172.21.15.40:0/1369229389 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc0006a6a0 0x7fbc00151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 >> 172.21.15.40:0/1369229389 conn(0x7fbc000b18e0 msgr2=0x7fbc000b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 shutdown_connections 2023-11-04T01:43:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.261+0000 7fbc08405640 1 -- 172.21.15.40:0/1369229389 wait complete. 2023-11-04T01:43:30.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-04T01:43:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 Processor -- start 2023-11-04T01:43:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 -- start start 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f31a815acb0 0x7f31a815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31a80b0c20 0x7f31a80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a80cb130 con 0x7f31a815c160 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a815bd40 con 0x7f31a80b0c20 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31aca8e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a806fd80 con 0x7f31a815acb0 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a5d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31a815c160 0x7f31a80b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37996/0 (socket says 172.21.15.40:37996) 2023-11-04T01:43:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a5d9b640 1 -- 172.21.15.40:0/1131038044 learned_addr learned my addr 172.21.15.40:0/1131038044 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:30.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a6d9d640 1 --2- 172.21.15.40:0/1131038044 >> v2:172.21.15.40:3300/0 conn(0x7f31a80b0c20 0x7f31a80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a659c640 1 --2- 172.21.15.40:0/1131038044 >> v2:172.21.15.91:3300/0 conn(0x7f31a815acb0 0x7f31a815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a559a640 1 -- 172.21.15.40:0/1131038044 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821655736 0 0) 0x7f31a80cb130 con 0x7f31a815c160 2023-11-04T01:43:30.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a559a640 1 -- 172.21.15.40:0/1131038044 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3194003530 con 0x7f31a815c160 2023-11-04T01:43:30.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a6d9d640 1 -- 172.21.15.40:0/1131038044 >> v2:172.21.15.91:3300/0 conn(0x7f31a815acb0 msgr2=0x7f31a815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a6d9d640 1 --2- 172.21.15.40:0/1131038044 >> v2:172.21.15.91:3300/0 conn(0x7f31a815acb0 0x7f31a815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a6d9d640 1 -- 172.21.15.40:0/1131038044 >> v1:172.21.15.40:6789/0 conn(0x7f31a815c160 legacy=0x7f31a80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.413+0000 7f31a6d9d640 1 -- 172.21.15.40:0/1131038044 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a815b680 con 0x7f31a80b0c20 2023-11-04T01:43:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 --2- 172.21.15.40:0/1131038044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a80b0c20 0x7f31a80ca490 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009d90 tx=0x7f31a001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71638898b5e215c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a559a640 1 -- 172.21.15.40:0/1131038044 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00a59c0 con 0x7f31a80b0c20 2023-11-04T01:43:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a559a640 1 -- 172.21.15.40:0/1131038044 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00a5b20 con 0x7f31a80b0c20 2023-11-04T01:43:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a559a640 1 -- 172.21.15.40:0/1131038044 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00a5e90 con 0x7f31a80b0c20 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- 172.21.15.40:0/1131038044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a80b0c20 msgr2=0x7f31a80ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 --2- 172.21.15.40:0/1131038044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a80b0c20 0x7f31a80ca490 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009d90 tx=0x7f31a001c8e0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- 172.21.15.40:0/1131038044 shutdown_connections 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 --2- 172.21.15.40:0/1131038044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a80b0c20 0x7f31a80ca490 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 --2- 172.21.15.40:0/1131038044 >> v2:172.21.15.91:3300/0 conn(0x7f31a815acb0 0x7f31a815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- 172.21.15.40:0/1131038044 >> 172.21.15.40:0/1131038044 conn(0x7f31a80cb510 msgr2=0x7f31a80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- 172.21.15.40:0/1131038044 shutdown_connections 2023-11-04T01:43:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- 172.21.15.40:0/1131038044 wait complete. 2023-11-04T01:43:30.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 Processor -- start 2023-11-04T01:43:30.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- start start 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31a80b0c20 0x7f31a8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31a815acb0 0x7f31a80ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 0x7f31a80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8152340 con 0x7f31a815c160 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c7420 con 0x7f31a80b0c20 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31aca8e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c7140 con 0x7f31a815acb0 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 0x7f31a80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 0x7f31a80ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33656/0 (socket says 172.21.15.40:33656) 2023-11-04T01:43:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 -- 172.21.15.40:0/2352368513 learned_addr learned my addr 172.21.15.40:0/2352368513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a659c640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31a80b0c20 0x7f31a8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a5d9b640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31a815acb0 0x7f31a80ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 -- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31a815acb0 msgr2=0x7f31a80ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31a815acb0 0x7f31a80ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 -- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31a80b0c20 msgr2=0x7f31a8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31a80b0c20 0x7f31a8151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a6d9d640 1 -- 172.21.15.40:0/2352368513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009a70 con 0x7f31a815c160 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.417+0000 7f31a5d9b640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31a815acb0 0x7f31a80ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f31a6d9d640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 0x7f31a80ace00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f31a00194f0 tx=0x7f31a0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00aed30 con 0x7f31a815c160 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00aee90 con 0x7f31a815c160 2023-11-04T01:43:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a806ba30 con 0x7f31a815c160 2023-11-04T01:43:30.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00b7610 con 0x7f31a815c160 2023-11-04T01:43:30.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a806bff0 con 0x7f31a815c160 2023-11-04T01:43:30.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a806c1e0 con 0x7f31a815c160 2023-11-04T01:43:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31a00b4050 con 0x7f31a815c160 2023-11-04T01:43:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f319effd640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31880664a0 0x7f3188068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f31a011f410 con 0x7f31a815c160 2023-11-04T01:43:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f31a659c640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31880664a0 0x7f3188068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.421+0000 7f31a659c640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31880664a0 0x7f3188068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3198009af0 tx=0x7f3198008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.425+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31a00ec3d0 con 0x7f31a815c160 2023-11-04T01:43:30.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:30.617+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f31a80744a0 con 0x7f31a815c160 2023-11-04T01:43:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.261+0000 7f319effd640 1 -- 172.21.15.40:0/2352368513 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v49) v1 ==== 105+0+0 (secure 0 0 0) 0x7f31a0009450 con 0x7f31a815c160 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31880664a0 msgr2=0x7f3188068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31880664a0 0x7f3188068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3198009af0 tx=0x7f3198008040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 msgr2=0x7f31a80ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 0x7f31a80ace00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f31a00194f0 tx=0x7f31a0019680 comp rx=0 tx=0).stop 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 shutdown_connections 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31880664a0 0x7f3188068960 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31a815c160 0x7f31a80ace00 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f31a815acb0 0x7f31a80ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 --2- 172.21.15.40:0/2352368513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31a80b0c20 0x7f31a8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 >> 172.21.15.40:0/2352368513 conn(0x7f31a80cb510 msgr2=0x7f31a80c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 shutdown_connections 2023-11-04T01:43:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.265+0000 7f31aca8e640 1 -- 172.21.15.40:0/2352368513 wait complete. 2023-11-04T01:43:31.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:31.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.405+0000 7f36224ca640 1 Processor -- start 2023-11-04T01:43:31.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f36224ca640 1 -- start start 2023-11-04T01:43:31.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f36224ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 0x7f361c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f36224ca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f361c06f8f0 0x7f361c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f36224ca640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0c2670 con 0x7f361c0b0b70 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f36224ca640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c070140 con 0x7f361c06f8f0 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f36224ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c15fc90 con 0x7f361c15afd0 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f361c0b0b70 0x7f361c0c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37998/0 (socket says 172.21.15.40:37998) 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 -- 172.21.15.40:0/3680544548 learned_addr learned my addr 172.21.15.40:0/3680544548 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361bfff640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 0x7f361c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361b7fe640 1 --2- 172.21.15.40:0/3680544548 >> v2:172.21.15.91:3300/0 conn(0x7f361c06f8f0 0x7f361c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465148681 0 0) 0x7f361c0c2670 con 0x7f361c0b0b70 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3608003530 con 0x7f361c0b0b70 2023-11-04T01:43:31.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186921368 0 0) 0x7f3608003530 con 0x7f361c0b0b70 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 msgr2=0x7f361c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 0x7f361c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 >> v2:172.21.15.91:3300/0 conn(0x7f361c06f8f0 msgr2=0x7f361c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 --2- 172.21.15.40:0/3680544548 >> v2:172.21.15.91:3300/0 conn(0x7f361c06f8f0 0x7f361c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c06bc30 con 0x7f361c0b0b70 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3614001a00 con 0x7f361c0b0b70 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 >> v1:172.21.15.40:6789/0 conn(0x7f361c0b0b70 legacy=0x7f361c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3608003980 0x7f3608003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 0x7f36080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3608004d10 0x7f3608005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c070140 con 0x7f3608004d10 2023-11-04T01:43:31.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c15fc90 con 0x7f3608003980 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360800b990 con 0x7f361c15afd0 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3608004d10 0x7f3608005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361bfff640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3608003980 0x7f3608003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f361b7fe640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 0x7f36080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 -- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 msgr2=0x7f36080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c15afd0 0x7f36080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 -- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3608003980 msgr2=0x7f3608003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3608003980 0x7f3608003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.409+0000 7f3620a67640 1 -- 172.21.15.40:0/3680544548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3608003530 con 0x7f3608004d10 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f3620a67640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3608004d10 0x7f3608005190 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f361400a830 tx=0x7f361401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2085babf55385cde server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140ad630 con 0x7f3608004d10 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36140a8070 con 0x7f3608004d10 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361affd640 1 -- 172.21.15.40:0/3680544548 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140ada10 con 0x7f3608004d10 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- 172.21.15.40:0/3680544548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3608004d10 msgr2=0x7f3608005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 --2- 172.21.15.40:0/3680544548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3608004d10 0x7f3608005190 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f361400a830 tx=0x7f361401d360 comp rx=0 tx=0).stop 2023-11-04T01:43:31.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f3620a67640 1 -- 172.21.15.40:0/3680544548 reap_dead start 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- 172.21.15.40:0/3680544548 shutdown_connections 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- 172.21.15.40:0/3680544548 >> 172.21.15.40:0/3680544548 conn(0x7f361c0cebb0 msgr2=0x7f361c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- 172.21.15.40:0/3680544548 shutdown_connections 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- 172.21.15.40:0/3680544548 wait complete. 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 Processor -- start 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- start start 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c150050 0x7f361c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 0x7f361c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f361c0cb1b0 0x7f361c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0a84b0 con 0x7f361c0cd740 2023-11-04T01:43:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0ce100 con 0x7f361c0cb1b0 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f36224ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0cbba0 con 0x7f361c150050 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 0x7f361c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 0x7f361c0cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33676/0 (socket says 172.21.15.40:33676) 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 -- 172.21.15.40:0/1097538100 learned_addr learned my addr 172.21.15.40:0/1097538100 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361bfff640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c150050 0x7f361c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f3620a67640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f361c0cb1b0 0x7f361c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 -- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c150050 msgr2=0x7f361c1f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c150050 0x7f361c1f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 -- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f361c0cb1b0 msgr2=0x7f361c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f361c0cb1b0 0x7f361c0cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.413+0000 7f361b7fe640 1 -- 172.21.15.40:0/1097538100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0a8690 con 0x7f361c0cd740 2023-11-04T01:43:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f361b7fe640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 0x7f361c0cdbc0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3604011600 tx=0x7f3604011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604009510 con 0x7f361c0cd740 2023-11-04T01:43:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400f920 con 0x7f361c0cd740 2023-11-04T01:43:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c0a8970 con 0x7f361c0cd740 2023-11-04T01:43:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400fc90 con 0x7f361c0cd740 2023-11-04T01:43:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c0a8f30 con 0x7f361c0cd740 2023-11-04T01:43:31.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c0744a0 con 0x7f361c0cd740 2023-11-04T01:43:31.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3604015460 con 0x7f361c0cd740 2023-11-04T01:43:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f3618ff9640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f35fc0664a0 0x7f35fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f36040847e0 con 0x7f361c0cd740 2023-11-04T01:43:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f361bfff640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f35fc0664a0 0x7f35fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.417+0000 7f361bfff640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f35fc0664a0 0x7f35fc068960 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f360c0098f0 tx=0x7f360c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.421+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3604051820 con 0x7f361c0cd740 2023-11-04T01:43:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.613+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f361c06cba0 con 0x7f361c0cd740 2023-11-04T01:43:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.613+0000 7f3618ff9640 1 -- 172.21.15.40:0/1097538100 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f360400fdf0 con 0x7f361c0cd740 2023-11-04T01:43:31.621 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:31.272336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:creating","state_seq":1,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 50 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f35fc0664a0 msgr2=0x7f35fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f35fc0664a0 0x7f35fc068960 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f360c0098f0 tx=0x7f360c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 msgr2=0x7f361c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 0x7f361c0cdbc0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3604011600 tx=0x7f3604011ac0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 shutdown_connections 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f35fc0664a0 0x7f35fc068960 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f361c0cb1b0 0x7f361c0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361c0cd740 0x7f361c0cdbc0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 --2- 172.21.15.40:0/1097538100 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f361c150050 0x7f361c1f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 >> 172.21.15.40:0/1097538100 conn(0x7f361c0cebb0 msgr2=0x7f361c0c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 shutdown_connections 2023-11-04T01:43:31.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:31.617+0000 7f36224ca640 1 -- 172.21.15.40:0/1097538100 wait complete. 2023-11-04T01:43:32.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:43:31.272336+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7086, 'mds_1': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7068': {'gid': 7068, 'name': 'a', 'rank': 1, 'incarnation': 50, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.40:6833/960586799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 960586799}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 960586799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7086': {'gid': 7086, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/15089123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 15089123}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 15089123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:32.043 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7068:up:creating 2023-11-04T01:43:33.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 Processor -- start 2023-11-04T01:43:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 -- start start 2023-11-04T01:43:33.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f144006dae0 0x7f144013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1440159260 0x7f144015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f144015d4e0 0x7f14400c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144013f240 con 0x7f144015d4e0 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144013ec10 con 0x7f144006dae0 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1448283640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144015da60 con 0x7f1440159260 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1446820640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f144015d4e0 0x7f14400c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1446820640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f144015d4e0 0x7f14400c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33684/0 (socket says 172.21.15.40:33684) 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f1446820640 1 -- 172.21.15.40:0/3225777703 learned_addr learned my addr 172.21.15.40:0/3225777703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f144581e640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1440159260 0x7f144015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.173+0000 7f144601f640 1 --2- 172.21.15.40:0/3225777703 >> v2:172.21.15.91:3300/0 conn(0x7f144006dae0 0x7f144013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1446820640 1 -- 172.21.15.40:0/3225777703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1440159260 msgr2=0x7f144015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1446820640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1440159260 0x7f144015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1446820640 1 -- 172.21.15.40:0/3225777703 >> v2:172.21.15.91:3300/0 conn(0x7f144006dae0 msgr2=0x7f144013f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1446820640 1 --2- 172.21.15.40:0/3225777703 >> v2:172.21.15.91:3300/0 conn(0x7f144006dae0 0x7f144013f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1446820640 1 -- 172.21.15.40:0/3225777703 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144015dd40 con 0x7f144015d4e0 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f144581e640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1440159260 0x7f144015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f144601f640 1 --2- 172.21.15.40:0/3225777703 >> v2:172.21.15.91:3300/0 conn(0x7f144006dae0 0x7f144013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1446820640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f144015d4e0 0x7f14400c9170 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f14400cf6f0 tx=0x7f143801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64014ce892bce388 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f144501d640 1 -- 172.21.15.40:0/3225777703 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380a5730 con 0x7f144015d4e0 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f144501d640 1 -- 172.21.15.40:0/3225777703 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14380a5890 con 0x7f144015d4e0 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f144501d640 1 -- 172.21.15.40:0/3225777703 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380a5c20 con 0x7f144015d4e0 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 -- 172.21.15.40:0/3225777703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f144015d4e0 msgr2=0x7f14400c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f144015d4e0 0x7f14400c9170 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f14400cf6f0 tx=0x7f143801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 -- 172.21.15.40:0/3225777703 shutdown_connections 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f144015d4e0 0x7f14400c9170 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 --2- 172.21.15.40:0/3225777703 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1440159260 0x7f144015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 --2- 172.21.15.40:0/3225777703 >> v2:172.21.15.91:3300/0 conn(0x7f144006dae0 0x7f144013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 -- 172.21.15.40:0/3225777703 >> 172.21.15.40:0/3225777703 conn(0x7f14400cebb0 msgr2=0x7f14400cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 -- 172.21.15.40:0/3225777703 shutdown_connections 2023-11-04T01:43:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.177+0000 7f1448283640 1 -- 172.21.15.40:0/3225777703 wait complete. 2023-11-04T01:43:33.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 Processor -- start 2023-11-04T01:43:33.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- start start 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f144006dae0 0x7f14400c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 0x7f14400c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f144015d4e0 0x7f1440140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c7c00 con 0x7f1440159260 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440150e20 con 0x7f144015d4e0 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1440150b40 con 0x7f144006dae0 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 0x7f14400c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 0x7f14400c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33698/0 (socket says 172.21.15.40:33698) 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 -- 172.21.15.40:0/1154498672 learned_addr learned my addr 172.21.15.40:0/1154498672 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144601f640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f144006dae0 0x7f14400c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1446820640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f144015d4e0 0x7f1440140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 -- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f144006dae0 msgr2=0x7f14400c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f144006dae0 0x7f14400c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 -- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f144015d4e0 msgr2=0x7f1440140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f144015d4e0 0x7f1440140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 -- 172.21.15.40:0/1154498672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009b30 con 0x7f1440159260 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144601f640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f144006dae0 0x7f14400c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1446820640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f144015d4e0 0x7f1440140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f144581e640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 0x7f14400c40b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f143000e840 tx=0x7f143000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000c8d0 con 0x7f1440159260 2023-11-04T01:43:33.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000ca30 con 0x7f1440159260 2023-11-04T01:43:33.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144014c9e0 con 0x7f1440159260 2023-11-04T01:43:33.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000cdc0 con 0x7f1440159260 2023-11-04T01:43:33.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144014cfa0 con 0x7f1440159260 2023-11-04T01:43:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14400744a0 con 0x7f1440159260 2023-11-04T01:43:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.181+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1430013410 con 0x7f1440159260 2023-11-04T01:43:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.185+0000 7f1436ffd640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14240664d0 0x7f1424068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.185+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f1430084090 con 0x7f1440159260 2023-11-04T01:43:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.185+0000 7f144601f640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14240664d0 0x7f1424068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.185+0000 7f144601f640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14240664d0 0x7f1424068990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f14400c4060 tx=0x7f143c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.189+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14300510d0 con 0x7f1440159260 2023-11-04T01:43:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.377+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14400c8c20 con 0x7f1440159260 2023-11-04T01:43:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.377+0000 7f1436ffd640 1 -- 172.21.15.40:0/1154498672 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f14300546f0 con 0x7f1440159260 2023-11-04T01:43:33.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:31.304824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 51 2023-11-04T01:43:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14240664d0 msgr2=0x7f1424068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14240664d0 0x7f1424068990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f14400c4060 tx=0x7f143c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 msgr2=0x7f14400c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 0x7f14400c40b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f143000e840 tx=0x7f143000ed00 comp rx=0 tx=0).stop 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 shutdown_connections 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14240664d0 0x7f1424068990 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f144015d4e0 0x7f1440140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1440159260 0x7f14400c40b0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 --2- 172.21.15.40:0/1154498672 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f144006dae0 0x7f14400c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 >> 172.21.15.40:0/1154498672 conn(0x7f14400cebb0 msgr2=0x7f144013f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 shutdown_connections 2023-11-04T01:43:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.381+0000 7f1448283640 1 -- 172.21.15.40:0/1154498672 wait complete. 2023-11-04T01:43:33.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:43:31.304824+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7086, 'mds_1': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7068': {'gid': 7068, 'name': 'a', 'rank': 1, 'incarnation': 50, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.40:6833/960586799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 960586799}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 960586799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7086': {'gid': 7086, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/15089123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 15089123}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 15089123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:33.807 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:43:33.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:43:33.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 Processor -- start 2023-11-04T01:43:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 -- start start 2023-11-04T01:43:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60940cefa0 0x7f609415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f609413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60940cb390 0x7f60940cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6094140380 con 0x7f60940cb390 2023-11-04T01:43:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609415df00 con 0x7f60940cefa0 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6098fb8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609415e1e0 con 0x7f60940cf380 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60940cb390 0x7f60940cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60940cb390 0x7f60940cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33704/0 (socket says 172.21.15.40:33704) 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 -- 172.21.15.40:0/1018201808 learned_addr learned my addr 172.21.15.40:0/1018201808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f609413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f609259c640 1 --2- 172.21.15.40:0/1018201808 >> v2:172.21.15.91:3300/0 conn(0x7f60940cefa0 0x7f609415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 -- 172.21.15.40:0/1018201808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 msgr2=0x7f609413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f609413fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 -- 172.21.15.40:0/1018201808 >> v2:172.21.15.91:3300/0 conn(0x7f60940cefa0 msgr2=0x7f609415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 --2- 172.21.15.40:0/1018201808 >> v2:172.21.15.91:3300/0 conn(0x7f60940cefa0 0x7f609415d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6092d9d640 1 -- 172.21.15.40:0/1018201808 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609415e4c0 con 0x7f60940cb390 2023-11-04T01:43:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.937+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f609413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6092d9d640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f60940cb800 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6094071b30 tx=0x7f608401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbed4ec14226a55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f609159a640 1 -- 172.21.15.40:0/1018201808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840ad680 con 0x7f60940cb390 2023-11-04T01:43:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f609159a640 1 -- 172.21.15.40:0/1018201808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60840ad7e0 con 0x7f60940cb390 2023-11-04T01:43:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f609159a640 1 -- 172.21.15.40:0/1018201808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840adb70 con 0x7f60940cb390 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 -- 172.21.15.40:0/1018201808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 msgr2=0x7f60940cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f60940cb800 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6094071b30 tx=0x7f608401c3e0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 -- 172.21.15.40:0/1018201808 shutdown_connections 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f60940cb800 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1018201808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f609413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1018201808 >> v2:172.21.15.91:3300/0 conn(0x7f60940cefa0 0x7f609415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 -- 172.21.15.40:0/1018201808 >> 172.21.15.40:0/1018201808 conn(0x7f60940cfc00 msgr2=0x7f60940d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 -- 172.21.15.40:0/1018201808 shutdown_connections 2023-11-04T01:43:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 -- 172.21.15.40:0/1018201808 wait complete. 2023-11-04T01:43:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 Processor -- start 2023-11-04T01:43:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.941+0000 7f6098fb8640 1 -- start start 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f609413bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60940cefa0 0x7f6094159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f60940c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609413c490 con 0x7f60940cb390 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609413b6f0 con 0x7f60940cefa0 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609413b990 con 0x7f60940cf380 2023-11-04T01:43:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f609413bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f609413bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33720/0 (socket says 172.21.15.40:33720) 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 -- 172.21.15.40:0/1941686226 learned_addr learned my addr 172.21.15.40:0/1941686226 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6092d9d640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f60940c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60940cefa0 0x7f6094159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 -- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 msgr2=0x7f60940c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f60940c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 -- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60940cefa0 msgr2=0x7f6094159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60940cefa0 0x7f6094159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 -- 172.21.15.40:0/1941686226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840094d0 con 0x7f60940cb390 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60940cefa0 0x7f6094159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609259c640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f609413bf50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f608c007e60 tx=0x7f608c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f608affd640 1 -- 172.21.15.40:0/1941686226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c014620 con 0x7f60940cb390 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f608affd640 1 -- 172.21.15.40:0/1941686226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00ee90 con 0x7f60940cb390 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609413bc70 con 0x7f60940cb390 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f608affd640 1 -- 172.21.15.40:0/1941686226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0149c0 con 0x7f60940cb390 2023-11-04T01:43:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6094159fe0 con 0x7f60940cb390 2023-11-04T01:43:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f608affd640 1 -- 172.21.15.40:0/1941686226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f608c014b20 con 0x7f60940cb390 2023-11-04T01:43:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f608affd640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f60740664a0 0x7f6074068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f608affd640 1 -- 172.21.15.40:0/1941686226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f608c084bd0 con 0x7f60940cb390 2023-11-04T01:43:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f60740664a0 0x7f6074068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.945+0000 7f609c0e5000 1 Processor -- start 2023-11-04T01:43:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- start start 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f60740664a0 0x7f6074068960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6094157a10 tx=0x7f607c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d6448125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d6447c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64468c460 con 0x55d6447c5f50 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64461d690 con 0x55d6448121f0 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d64461abc0 con 0x55d644812b10 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33728/0 (socket says 172.21.15.40:33728) 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 -- 172.21.15.40:0/2561045576 learned_addr learned my addr 172.21.15.40:0/2561045576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609259c640 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d6448125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6091d9b640 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d6447c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 -- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 msgr2=0x55d6447c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d6447c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 -- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 msgr2=0x55d6448125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d6448125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 -- 172.21.15.40:0/2561045576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64430e890 con 0x55d6447c5f50 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609259c640 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d6448125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6092d9d640 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447c6330 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f608401c210 tx=0x7f60840a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc17e1b21768633a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6073fff640 1 -- 172.21.15.40:0/2561045576 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840adb50 con 0x55d6447c5f50 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6073fff640 1 -- 172.21.15.40:0/2561045576 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60840adcb0 con 0x55d6447c5f50 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f6073fff640 1 -- 172.21.15.40:0/2561045576 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840b6600 con 0x55d6447c5f50 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- 172.21.15.40:0/2561045576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 msgr2=0x55d6447c6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447c6330 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f608401c210 tx=0x7f60840a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- 172.21.15.40:0/2561045576 shutdown_connections 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447c6330 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d6447c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- 172.21.15.40:0/2561045576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d6448125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- 172.21.15.40:0/2561045576 >> 172.21.15.40:0/2561045576 conn(0x55d6447eed40 msgr2=0x55d6447f1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- 172.21.15.40:0/2561045576 shutdown_connections 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- 172.21.15.40:0/2561045576 wait complete. 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 -- start start 2023-11-04T01:43:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 Processor -- start 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.949+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d6447f3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d644812b10 0x55d6447f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6446164b0 con 0x55d6447c5f50 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6445ceaa0 con 0x55d644812b10 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6445d4940 con 0x55d6448121f0 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 10 client.0 _ll_register_callbacks cb 0x55d6447af460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33744/0 (socket says 172.21.15.40:33744) 2023-11-04T01:43:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 -- 172.21.15.40:0/1834746960 learned_addr learned my addr 172.21.15.40:0/1834746960 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d6447f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f6092d9d640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d644812b10 0x55d6447f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 -- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 msgr2=0x55d6447f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d6447f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 -- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d644812b10 msgr2=0x55d6447f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d644812b10 0x55d6447f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 -- 172.21.15.40:0/1834746960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609415e4c0 con 0x55d6447c5f50 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d6447f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f6092d9d640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d644812b10 0x55d6447f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609259c640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447f33c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f608c007e30 tx=0x7f608c0558d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6389f558603af1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 1 -- 172.21.15.40:0/1834746960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c051fe0 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 1 -- 172.21.15.40:0/1834746960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f608c052140 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6445d3e10 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 1 -- 172.21.15.40:0/1834746960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f608c07cbe0 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 10 client.7335 fetch_fsmap learned FSMap version 51 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55d6445d71a0 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 1 -- 172.21.15.40:0/1834746960 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6445d3e10 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 1 -- 172.21.15.40:0/1834746960 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f608c005d20 con 0x55d6447c5f50 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 10 client.7335 fetch_fsmap finished waiting for FSMap version 51 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 10 client.7335 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 20 client.7335 populate_metadata read hostname 'smithi040' 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d6447f46b0 0x55d644823970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 4 client.7335 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d644614e00 con 0x55d6447f46b0 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d6447f46b0 0x55d644823970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 10 client.7335 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f6091d9b640 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d6447f46b0 0x55d644823970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d92d54b5f9770dde server_cookie=a2c77ca62275ae25 in_seq=0 out_seq=0 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 1 -- 172.21.15.40:0/1834746960 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d644614e00 con 0x55d6447f46b0 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 10 client.7335 handle_command_reply: tid=0 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 client.7335 shutdown 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 msgr2=0x55d6447f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447f33c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f608c007e30 tx=0x7f608c0558d0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 shutdown_connections 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d6447f46b0 0x55d644823970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d644812b10 0x55d6447f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d6447f3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f60717fa640 0 client.7335 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 --2- 172.21.15.40:0/1834746960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d6447f33c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 >> 172.21.15.40:0/1834746960 conn(0x55d6447eed40 msgr2=0x55d6447c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 shutdown_connections 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 1 -- 172.21.15.40:0/1834746960 wait complete. 2023-11-04T01:43:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.953+0000 7f609c0e5000 20 client.7335 trim_cache size 0 max 16384 2023-11-04T01:43:33.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 Processor -- start 2023-11-04T01:43:33.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 -- start start 2023-11-04T01:43:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6447c5f50 0x55d6448112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d644811810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 0x55d644823970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6442cf940 con 0x55d644812b10 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644613cc0 con 0x55d6447c5f50 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6445dbd20 con 0x55d6448121f0 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 0x55d644823970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 0x55d644823970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33754/0 (socket says 172.21.15.40:33754) 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 -- 172.21.15.40:0/3415232959 learned_addr learned my addr 172.21.15.40:0/3415232959 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6091d9b640 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d644811810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609259c640 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6447c5f50 0x55d6448112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 -- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 msgr2=0x55d644811810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d644811810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 -- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6447c5f50 msgr2=0x55d6448112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6447c5f50 0x55d6448112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f6092d9d640 1 -- 172.21.15.40:0/3415232959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6445bd4a0 con 0x55d644812b10 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.969+0000 7f609259c640 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6447c5f50 0x55d6448112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6092d9d640 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 0x55d644823970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f608401c8c0 tx=0x7f6084004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2540b8a0e36be98 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6088ff9640 1 -- 172.21.15.40:0/3415232959 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084004230 con 0x55d644812b10 2023-11-04T01:43:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6088ff9640 1 -- 172.21.15.40:0/3415232959 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084004390 con 0x55d644812b10 2023-11-04T01:43:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6088ff9640 1 -- 172.21.15.40:0/3415232959 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60840adb90 con 0x55d644812b10 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3415232959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 msgr2=0x55d644823970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 0x55d644823970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f608401c8c0 tx=0x7f6084004740 comp rx=0 tx=0).stop 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3415232959 shutdown_connections 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d644812b10 0x55d644823970 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d6448121f0 0x55d644811810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3415232959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6447c5f50 0x55d6448112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3415232959 >> 172.21.15.40:0/3415232959 conn(0x55d6447eed40 msgr2=0x55d644810bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3415232959 shutdown_connections 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3415232959 wait complete. 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- start start 2023-11-04T01:43:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 Processor -- start 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d644873790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d644875ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d644878230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644599460 con 0x55d6447c5f50 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64430f1b0 con 0x55d6448121f0 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d644619010 con 0x55d644812b10 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 10 client.0 _ll_register_callbacks cb 0x7f60840b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d644873790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d644873790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33760/0 (socket says 172.21.15.40:33760) 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 -- 172.21.15.40:0/3914132066 learned_addr learned my addr 172.21.15.40:0/3914132066 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6091d9b640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d644875ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6092d9d640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d644878230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 -- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 msgr2=0x55d644878230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d644878230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 -- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 msgr2=0x55d644875ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d644875ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 -- 172.21.15.40:0/3914132066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d64430e890 con 0x55d6447c5f50 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6091d9b640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d644875ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6092d9d640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d644878230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609259c640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d644873790 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f608c055810 tx=0x7f608c082b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c650371c5f86edc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f60717fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f60717fa640 1 -- 172.21.15.40:0/3914132066 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c07cbe0 con 0x55d6447c5f50 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f60717fa640 1 -- 172.21.15.40:0/3914132066 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f608c055020 con 0x55d6447c5f50 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6445e0d10 con 0x55d6447c5f50 2023-11-04T01:43:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f60717fa640 1 -- 172.21.15.40:0/3914132066 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f608c0516c0 con 0x55d6447c5f50 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 10 client.7341 fetch_fsmap learned FSMap version 51 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55d64430ecc0 con 0x55d6447c5f50 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f60717fa640 1 -- 172.21.15.40:0/3914132066 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6445e0d10 con 0x55d6447c5f50 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f60717fa640 1 -- 172.21.15.40:0/3914132066 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f608c005d20 con 0x55d6447c5f50 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 10 client.7341 fetch_fsmap finished waiting for FSMap version 51 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 10 client.7341 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 20 client.7341 populate_metadata read hostname 'smithi040' 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d644878770 0x55d64487ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 4 client.7341 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d64460f490 con 0x55d644878770 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.973+0000 7f6091d9b640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d644878770 0x55d64487ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f60717fa640 10 client.7341 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:43:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6091d9b640 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d644878770 0x55d64487ab60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2211a1fcdf25f19 server_cookie=9b6016999559c170 in_seq=0 out_seq=0 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f60717fa640 1 -- 172.21.15.40:0/3914132066 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d64460f490 con 0x55d644878770 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f60717fa640 10 client.7341 handle_command_reply: tid=0 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 client.7341 shutdown 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 msgr2=0x55d644873790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d644873790 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f608c055810 tx=0x7f608c082b90 comp rx=0 tx=0).stop 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 shutdown_connections 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d644812b10 0x55d644878230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d644878770 0x55d64487ab60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d6448121f0 0x55d644875ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 --2- 172.21.15.40:0/3914132066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6447c5f50 0x55d644873790 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f60717fa640 0 client.7341 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 >> 172.21.15.40:0/3914132066 conn(0x55d6447eed40 msgr2=0x55d6447f3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 shutdown_connections 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 1 -- 172.21.15.40:0/3914132066 wait complete. 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f609c0e5000 20 client.7341 trim_cache size 0 max 16384 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7068, 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:43:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 2.7036076379999998, 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 51, 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 91, 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 91, 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 23.896153373000001 2023-11-04T01:43:33.990 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f60740664a0 msgr2=0x7f6074068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f60740664a0 0x7f6074068960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6094157a10 tx=0x7f607c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 msgr2=0x7f609413bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f609413bf50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f608c007e60 tx=0x7f608c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 shutdown_connections 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f60740664a0 0x7f6074068960 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f60940cf380 0x7f60940c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60940cefa0 0x7f6094159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 --2- 172.21.15.40:0/1941686226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60940cb390 0x7f609413bf50 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 >> 172.21.15.40:0/1941686226 conn(0x7f60940cfc00 msgr2=0x7f60940cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 shutdown_connections 2023-11-04T01:43:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:33.977+0000 7f6098fb8640 1 -- 172.21.15.40:0/1941686226 wait complete. 2023-11-04T01:43:34.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:43:34.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c39ded640 1 Processor -- start 2023-11-04T01:43:34.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c39ded640 1 -- start start 2023-11-04T01:43:34.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c39ded640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c340715d0 0x7f9c340b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c39ded640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c340c2670 con 0x7f9c340b0b70 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c39ded640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3406bc30 con 0x7f9c3415afd0 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c39ded640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c34070140 con 0x7f9c340715d0 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c2affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c340715d0 0x7f9c340b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c33fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c340b0b70 0x7f9c3415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38000/0 (socket says 172.21.15.40:38000) 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c33fff640 1 -- 172.21.15.40:0/4271150912 learned_addr learned my addr 172.21.15.40:0/4271150912 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c32ffd640 1 -- 172.21.15.40:0/4271150912 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278136317 0 0) 0x7f9c340c2670 con 0x7f9c340b0b70 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c32ffd640 1 -- 172.21.15.40:0/4271150912 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c20003530 con 0x7f9c340b0b70 2023-11-04T01:43:34.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c2affd640 1 -- 172.21.15.40:0/4271150912 >> v1:172.21.15.91:6789/0 conn(0x7f9c3415afd0 legacy=0x7f9c3406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c2affd640 1 -- 172.21.15.40:0/4271150912 >> v1:172.21.15.40:6789/0 conn(0x7f9c340b0b70 legacy=0x7f9c3415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.109+0000 7f9c2affd640 1 -- 172.21.15.40:0/4271150912 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3406bf10 con 0x7f9c340715d0 2023-11-04T01:43:34.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c2affd640 1 --2- 172.21.15.40:0/4271150912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c340b0630 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0097c0 tx=0x7f9c1c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2a479310da914d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c32ffd640 1 -- 172.21.15.40:0/4271150912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0ab600 con 0x7f9c340715d0 2023-11-04T01:43:34.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c32ffd640 1 -- 172.21.15.40:0/4271150912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0a7050 con 0x7f9c340715d0 2023-11-04T01:43:34.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c32ffd640 1 -- 172.21.15.40:0/4271150912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0ab980 con 0x7f9c340715d0 2023-11-04T01:43:34.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 -- 172.21.15.40:0/4271150912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 msgr2=0x7f9c340b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4271150912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c340b0630 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0097c0 tx=0x7f9c1c01c440 comp rx=0 tx=0).stop 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 -- 172.21.15.40:0/4271150912 shutdown_connections 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4271150912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c340b0630 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 -- 172.21.15.40:0/4271150912 >> 172.21.15.40:0/4271150912 conn(0x7f9c340cebb0 msgr2=0x7f9c340cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 -- 172.21.15.40:0/4271150912 shutdown_connections 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 -- 172.21.15.40:0/4271150912 wait complete. 2023-11-04T01:43:34.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 Processor -- start 2023-11-04T01:43:34.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.113+0000 7f9c39ded640 1 -- start start 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c3415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c340b0b70 0x7f9c340b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c3415afd0 0x7f9c34152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340b1f20 con 0x7f9c340715d0 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340cc790 con 0x7f9c3415afd0 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340cca70 con 0x7f9c340b0b70 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c3415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c3415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33786/0 (socket says 172.21.15.40:33786) 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 -- 172.21.15.40:0/4210200605 learned_addr learned my addr 172.21.15.40:0/4210200605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c2affd640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c340b0b70 0x7f9c340b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c33fff640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c3415afd0 0x7f9c34152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 -- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c340b0b70 msgr2=0x7f9c340b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c340b0b70 0x7f9c340b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 -- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c3415afd0 msgr2=0x7f9c34152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c3415afd0 0x7f9c34152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 -- 172.21.15.40:0/4210200605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c009420 con 0x7f9c340715d0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c2affd640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c340b0b70 0x7f9c340b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c337fe640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c3415e5b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c450 tx=0x7f9c2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c30ff9640 1 -- 172.21.15.40:0/4210200605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24012830 con 0x7f9c340715d0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c30ff9640 1 -- 172.21.15.40:0/4210200605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c240129b0 con 0x7f9c340715d0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c340ccd50 con 0x7f9c340715d0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c30ff9640 1 -- 172.21.15.40:0/4210200605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24012d60 con 0x7f9c340715d0 2023-11-04T01:43:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34152640 con 0x7f9c340715d0 2023-11-04T01:43:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c30ff9640 1 -- 172.21.15.40:0/4210200605 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c2401c460 con 0x7f9c340715d0 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c30ff9640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c140664a0 0x7f9c14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c30ff9640 1 -- 172.21.15.40:0/4210200605 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f9c24084160 con 0x7f9c340715d0 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.117+0000 7f9c2affd640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c140664a0 0x7f9c14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 Processor -- start 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- start start 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c2affd640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c140664a0 0x7f9c14068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ad000 tx=0x7f9c1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 0x5651a376d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a3720600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a3720b40 0x5651a3720f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a35eb460 con 0x5651a376cfa0 2023-11-04T01:43:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a357c690 con 0x5651a376d8c0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a3579bc0 con 0x5651a3720b40 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 0x5651a376d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 0x5651a376d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33796/0 (socket says 172.21.15.40:33796) 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 -- 172.21.15.40:0/830386212 learned_addr learned my addr 172.21.15.40:0/830386212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c2affd640 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a3720600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c33fff640 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a3720b40 0x5651a3720f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 -- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a3720b40 msgr2=0x5651a3720f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a3720b40 0x5651a3720f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 -- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 msgr2=0x5651a3720600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a3720600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 -- 172.21.15.40:0/830386212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651a326d890 con 0x5651a376cfa0 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c2affd640 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a3720600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c337fe640 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 0x5651a376d380 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f9c24054df0 tx=0x7f9c2405b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe30798cc83a20a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c297fa640 1 -- 172.21.15.40:0/830386212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24058fb0 con 0x5651a376cfa0 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c297fa640 1 -- 172.21.15.40:0/830386212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2405d160 con 0x5651a376cfa0 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c297fa640 1 -- 172.21.15.40:0/830386212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24051570 con 0x5651a376cfa0 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/830386212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 msgr2=0x5651a376d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 0x5651a376d380 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f9c24054df0 tx=0x7f9c2405b1f0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/830386212 shutdown_connections 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a3720b40 0x5651a3720f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a3720600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/830386212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a376cfa0 0x5651a376d380 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/830386212 >> 172.21.15.40:0/830386212 conn(0x5651a374dd40 msgr2=0x5651a3750130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/830386212 shutdown_connections 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/830386212 wait complete. 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 -- start start 2023-11-04T01:43:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.121+0000 7f9c3cf1a000 1 Processor -- start 2023-11-04T01:43:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a37290e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3725b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a37260b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a35754b0 con 0x5651a3720b40 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a352daa0 con 0x5651a376d8c0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a3533940 con 0x5651a376cfa0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 10 client.0 _ll_register_callbacks cb 0x5651a370e460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a37290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a37290e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33810/0 (socket says 172.21.15.40:33810) 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 -- 172.21.15.40:0/1521535004 learned_addr learned my addr 172.21.15.40:0/1521535004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c2affd640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3725b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 -- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 msgr2=0x5651a3725b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c33fff640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a37260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3725b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 -- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 msgr2=0x5651a37260b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a37260b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 -- 172.21.15.40:0/1521535004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34152640 con 0x5651a3720b40 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c337fe640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a37290e0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9c24054df0 tx=0x7f9c24007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47cf2c29c5b80a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 1 -- 172.21.15.40:0/1521535004 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24076060 con 0x5651a3720b40 2023-11-04T01:43:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 1 -- 172.21.15.40:0/1521535004 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f9c24057070 con 0x5651a3720b40 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651a3532e10 con 0x5651a3720b40 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 1 -- 172.21.15.40:0/1521535004 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c2405d160 con 0x5651a3720b40 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 10 client.7356 fetch_fsmap learned FSMap version 51 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5651a35361a0 con 0x5651a3720b40 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 1 -- 172.21.15.40:0/1521535004 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651a3532e10 con 0x5651a3720b40 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 1 -- 172.21.15.40:0/1521535004 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9c24051570 con 0x5651a3720b40 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 10 client.7356 fetch_fsmap finished waiting for FSMap version 51 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 10 client.7356 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 20 client.7356 populate_metadata read hostname 'smithi040' 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a3726df0 0x5651a377e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 4 client.7356 mds_command: new command op to 7086 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 --> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651a3573e00 con 0x5651a3726df0 2023-11-04T01:43:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c2affd640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a3726df0 0x5651a377e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c2affd640 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a3726df0 0x5651a377e250 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233305aa48a6488b server_cookie=f2b843fdf4126c87 in_seq=0 out_seq=0 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 10 client.7356 ms_handle_connect on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 1 -- 172.21.15.40:0/1521535004 <== mds.0 v2:172.21.15.40:6834/15089123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5651a3573e00 con 0x5651a3726df0 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 10 client.7356 handle_command_reply: tid=0 2023-11-04T01:43:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 client.7356 shutdown 2023-11-04T01:43:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 msgr2=0x5651a37290e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a37290e0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9c24054df0 tx=0x7f9c24007f90 comp rx=0 tx=0).stop 2023-11-04T01:43:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 shutdown_connections 2023-11-04T01:43:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a3726df0 0x5651a377e250 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a37260b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3725b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c127fc640 0 client.7356 ms_handle_reset on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/1521535004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a37290e0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 >> 172.21.15.40:0/1521535004 conn(0x5651a374dd40 msgr2=0x5651a3750130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 shutdown_connections 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/1521535004 wait complete. 2023-11-04T01:43:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.125+0000 7f9c3cf1a000 20 client.7356 trim_cache size 0 max 16384 2023-11-04T01:43:34.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 Processor -- start 2023-11-04T01:43:34.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 -- start start 2023-11-04T01:43:34.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a3725ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376cfa0 0x5651a3726000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376d8c0 0x5651a376b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a322e940 con 0x5651a3720b40 2023-11-04T01:43:34.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a326e1b0 con 0x5651a376cfa0 2023-11-04T01:43:34.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a35794b0 con 0x5651a376d8c0 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a3725ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a3725ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33818/0 (socket says 172.21.15.40:33818) 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 -- 172.21.15.40:0/274863457 learned_addr learned my addr 172.21.15.40:0/274863457 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 -- 172.21.15.40:0/274863457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376d8c0 msgr2=0x5651a376b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376d8c0 0x5651a376b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 -- 172.21.15.40:0/274863457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376cfa0 msgr2=0x5651a3726000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376cfa0 0x5651a3726000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.141+0000 7f9c337fe640 1 -- 172.21.15.40:0/274863457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651a37294a0 con 0x5651a3720b40 2023-11-04T01:43:34.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a3725ac0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9c2405cc30 tx=0x7f9c24080000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e946916e8aedf52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c29ffb640 1 -- 172.21.15.40:0/274863457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24076070 con 0x5651a3720b40 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c29ffb640 1 -- 172.21.15.40:0/274863457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2400e040 con 0x5651a3720b40 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c29ffb640 1 -- 172.21.15.40:0/274863457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240511a0 con 0x5651a3720b40 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/274863457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 msgr2=0x5651a3725ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a3725ac0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9c2405cc30 tx=0x7f9c24080000 comp rx=0 tx=0).stop 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/274863457 shutdown_connections 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376d8c0 0x5651a376b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376cfa0 0x5651a3726000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/274863457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a3725ac0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/274863457 >> 172.21.15.40:0/274863457 conn(0x5651a374dd40 msgr2=0x5651a37253b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/274863457 shutdown_connections 2023-11-04T01:43:34.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/274863457 wait complete. 2023-11-04T01:43:34.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- start start 2023-11-04T01:43:34.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 Processor -- start 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a377f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3789ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a378a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a3572cc0 con 0x5651a3720b40 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a3782f40 con 0x5651a376d8c0 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a37207d0 con 0x5651a376cfa0 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 10 client.0 _ll_register_callbacks cb 0x7f9c24054c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a377f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a377f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33824/0 (socket says 172.21.15.40:33824) 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 -- 172.21.15.40:0/3405724588 learned_addr learned my addr 172.21.15.40:0/3405724588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c33fff640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a378a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c2affd640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3789ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 -- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 msgr2=0x5651a3789ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3789ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 -- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 msgr2=0x5651a378a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a378a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 -- 172.21.15.40:0/3405724588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651a35361a0 con 0x5651a3720b40 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c337fe640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a377f690 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9c24051360 tx=0x7f9c2405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3418fe39df47c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c127fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c127fc640 1 -- 172.21.15.40:0/3405724588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400e040 con 0x5651a3720b40 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c127fc640 1 -- 172.21.15.40:0/3405724588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f9c24057040 con 0x5651a3720b40 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651a356e490 con 0x5651a3720b40 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c127fc640 1 -- 172.21.15.40:0/3405724588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c240511a0 con 0x5651a3720b40 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 10 client.7362 fetch_fsmap learned FSMap version 51 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5651a351c4a0 con 0x5651a3720b40 2023-11-04T01:43:34.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c127fc640 1 -- 172.21.15.40:0/3405724588 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651a356e490 con 0x5651a3720b40 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c127fc640 1 -- 172.21.15.40:0/3405724588 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9c24064020 con 0x5651a3720b40 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 10 client.7362 fetch_fsmap finished waiting for FSMap version 51 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 10 client.7362 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 20 client.7362 populate_metadata read hostname 'smithi040' 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a37cd390 0x5651a37cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 4 client.7362 mds_command: new command op to 7086 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 --> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651a356e1b0 con 0x5651a37cd390 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.145+0000 7f9c2affd640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a37cd390 0x5651a37cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c2affd640 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a37cd390 0x5651a37cd770 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e478a8ddcbd18f server_cookie=f1caff284543455d in_seq=0 out_seq=0 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c127fc640 10 client.7362 ms_handle_connect on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c127fc640 1 -- 172.21.15.40:0/3405724588 <== mds.0 v2:172.21.15.40:6834/15089123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5651a356e1b0 con 0x5651a37cd390 2023-11-04T01:43:34.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c127fc640 10 client.7362 handle_command_reply: tid=0 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 client.7362 shutdown 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 msgr2=0x5651a377f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a377f690 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9c24051360 tx=0x7f9c2405b040 comp rx=0 tx=0).stop 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 shutdown_connections 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:6834/15089123,v1:172.21.15.40:6835/15089123] conn(0x5651a37cd390 0x5651a37cd770 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5651a376d8c0 0x5651a378a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5651a376cfa0 0x5651a3789ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 --2- 172.21.15.40:0/3405724588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5651a3720b40 0x5651a377f690 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c127fc640 0 client.7362 ms_handle_reset on v2:172.21.15.40:6834/15089123 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 >> 172.21.15.40:0/3405724588 conn(0x5651a374dd40 msgr2=0x5651a37253b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 shutdown_connections 2023-11-04T01:43:34.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 1 -- 172.21.15.40:0/3405724588 wait complete. 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c3cf1a000 20 client.7362 trim_cache size 0 max 16384 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7086, 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:43:34.162 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 17.977965583, 2023-11-04T01:43:34.163 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 51, 2023-11-04T01:43:34.163 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 91, 2023-11-04T01:43:34.163 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 91, 2023-11-04T01:43:34.163 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 24.033292124999999 2023-11-04T01:43:34.163 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c140664a0 msgr2=0x7f9c14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c140664a0 0x7f9c14068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ad000 tx=0x7f9c1c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 msgr2=0x7f9c3415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c3415e5b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400c450 tx=0x7f9c2400c910 comp rx=0 tx=0).stop 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 shutdown_connections 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c140664a0 0x7f9c14068960 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c3415afd0 0x7f9c34152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c340b0b70 0x7f9c340b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 --2- 172.21.15.40:0/4210200605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c340715d0 0x7f9c3415e5b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 >> 172.21.15.40:0/4210200605 conn(0x7f9c340cebb0 msgr2=0x7f9c340cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 shutdown_connections 2023-11-04T01:43:34.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.149+0000 7f9c39ded640 1 -- 172.21.15.40:0/4210200605 wait complete. 2023-11-04T01:43:34.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.171 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-04T01:43:34.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.183 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-04T01:43:34.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:34.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 Processor -- start 2023-11-04T01:43:34.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 -- start start 2023-11-04T01:43:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13fc0b0d40 0x7f13fc15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13fc06cfd0 con 0x7f13fc0ca990 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc0ca030 con 0x7f13fc0b0d40 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f1401563640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc15e830 con 0x7f13fc159fc0 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13fb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13fc0b0d40 0x7f13fc15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13f3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f13fc0ca990 0x7f13fc0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38004/0 (socket says 172.21.15.40:38004) 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13f3fff640 1 -- 172.21.15.40:0/756548375 learned_addr learned my addr 172.21.15.40:0/756548375 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13faffd640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13fb7fe640 1 -- 172.21.15.40:0/756548375 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 msgr2=0x7f13fc0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13fb7fe640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13fb7fe640 1 -- 172.21.15.40:0/756548375 >> v1:172.21.15.40:6789/0 conn(0x7f13fc0ca990 legacy=0x7f13fc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13fa7fc640 1 -- 172.21.15.40:0/756548375 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423169557 0 0) 0x7f13fc06cfd0 con 0x7f13fc0ca990 2023-11-04T01:43:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13fb7fe640 1 -- 172.21.15.40:0/756548375 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc15eb10 con 0x7f13fc0b0d40 2023-11-04T01:43:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.397+0000 7f13faffd640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13fb7fe640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0b0d40 0x7f13fc15dc50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009d90 tx=0x7f13f401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5960b85fd44fce07 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13fa7fc640 1 -- 172.21.15.40:0/756548375 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f40a58f0 con 0x7f13fc0b0d40 2023-11-04T01:43:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13fa7fc640 1 -- 172.21.15.40:0/756548375 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f40a5a50 con 0x7f13fc0b0d40 2023-11-04T01:43:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13fa7fc640 1 -- 172.21.15.40:0/756548375 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f40a5de0 con 0x7f13fc0b0d40 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/756548375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0b0d40 msgr2=0x7f13fc15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0b0d40 0x7f13fc15dc50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009d90 tx=0x7f13f401c920 comp rx=0 tx=0).stop 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/756548375 shutdown_connections 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0b0d40 0x7f13fc15dc50 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 --2- 172.21.15.40:0/756548375 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/756548375 >> 172.21.15.40:0/756548375 conn(0x7f13fc0cebb0 msgr2=0x7f13fc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/756548375 shutdown_connections 2023-11-04T01:43:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/756548375 wait complete. 2023-11-04T01:43:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 Processor -- start 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- start start 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13fc0b0d40 0x7f13fc15c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 0x7f13fc14f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc06c3a0 con 0x7f13fc0ca990 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc15cc90 con 0x7f13fc0b0d40 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc06bd50 con 0x7f13fc159fc0 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 0x7f13fc14f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 0x7f13fc14f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33842/0 (socket says 172.21.15.40:33842) 2023-11-04T01:43:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 -- 172.21.15.40:0/4063894842 learned_addr learned my addr 172.21.15.40:0/4063894842 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 -- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 msgr2=0x7f13fc0b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 -- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13fc0b0d40 msgr2=0x7f13fc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13fc0b0d40 0x7f13fc15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 -- 172.21.15.40:0/4063894842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4009a70 con 0x7f13fc0ca990 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f3fff640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 0x7f13fc14f040 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f13e400c480 tx=0x7f13e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e40074e0 con 0x7f13fc0ca990 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e4007660 con 0x7f13fc0ca990 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc06c030 con 0x7f13fc0ca990 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4004a30 con 0x7f13fc0ca990 2023-11-04T01:43:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.401+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc06c830 con 0x7f13fc0ca990 2023-11-04T01:43:34.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.405+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc0744a0 con 0x7f13fc0ca990 2023-11-04T01:43:34.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.405+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13e4004b90 con 0x7f13fc0ca990 2023-11-04T01:43:34.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.405+0000 7f13f37fe640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13dc0664d0 0x7f13dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.405+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f13e4083790 con 0x7f13fc0ca990 2023-11-04T01:43:34.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.405+0000 7f13faffd640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13dc0664d0 0x7f13dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.405+0000 7f13faffd640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13dc0664d0 0x7f13dc068990 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00a8d0 tx=0x7f13ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.409+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13e40542f0 con 0x7f13fc0ca990 2023-11-04T01:43:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.589+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13fc06c4e0 con 0x7f13fc0ca990 2023-11-04T01:43:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.589+0000 7f13f37fe640 1 -- 172.21.15.40:0/4063894842 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f13fc06c4e0 con 0x7f13fc0ca990 2023-11-04T01:43:34.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:34.597 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:31.304824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 51 2023-11-04T01:43:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13dc0664d0 msgr2=0x7f13dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13dc0664d0 0x7f13dc068990 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00a8d0 tx=0x7f13ec008040 comp rx=0 tx=0).stop 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 msgr2=0x7f13fc14f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 0x7f13fc14f040 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f13e400c480 tx=0x7f13e400c940 comp rx=0 tx=0).stop 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 shutdown_connections 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13dc0664d0 0x7f13dc068990 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13fc159fc0 0x7f13fc0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13fc0ca990 0x7f13fc14f040 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 --2- 172.21.15.40:0/4063894842 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13fc0b0d40 0x7f13fc15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 >> 172.21.15.40:0/4063894842 conn(0x7f13fc0cebb0 msgr2=0x7f13fc0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 shutdown_connections 2023-11-04T01:43:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:34.593+0000 7f1401563640 1 -- 172.21.15.40:0/4063894842 wait complete. 2023-11-04T01:43:34.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:43:34.741 INFO:teuthology.orchestra.run.smithi040.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:43:34.742 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:34.742 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:43:36.090 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:43:36.085+0000 7f28ac811640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:36.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:36.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 Processor -- start 2023-11-04T01:43:36.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 -- start start 2023-11-04T01:43:36.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7facb40d0b10 0x7facb415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 0x7facb40b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb40b5330 con 0x7facb415d240 2023-11-04T01:43:36.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb40d2280 con 0x7facb40d0b10 2023-11-04T01:43:36.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facbaabf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb40d2560 con 0x7facb40b49c0 2023-11-04T01:43:36.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb905c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 0x7facb40b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7facb40d0b10 0x7facb415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb885b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7facb415d240 0x7facb40d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:41412/0 (socket says 172.21.15.40:41412) 2023-11-04T01:43:36.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb905c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 0x7facb40b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:60428/0 (socket says 172.21.15.40:60428) 2023-11-04T01:43:36.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb885b640 1 -- 172.21.15.40:0/2752245300 learned_addr learned my addr 172.21.15.40:0/2752245300 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:36.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb905c640 1 -- 172.21.15.40:0/2752245300 >> v2:172.21.15.91:3300/0 conn(0x7facb40d0b10 msgr2=0x7facb415d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb905c640 1 --2- 172.21.15.40:0/2752245300 >> v2:172.21.15.91:3300/0 conn(0x7facb40d0b10 0x7facb415d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb905c640 1 -- 172.21.15.40:0/2752245300 >> v1:172.21.15.91:6789/0 conn(0x7facb415d240 legacy=0x7facb40d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.873+0000 7facb905c640 1 -- 172.21.15.40:0/2752245300 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb40d2840 con 0x7facb40b49c0 2023-11-04T01:43:36.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facb905c640 1 --2- 172.21.15.40:0/2752245300 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 0x7facb40b4df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facac009d90 tx=0x7facac01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2035d73cdcb619a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facb37fe640 1 -- 172.21.15.40:0/2752245300 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0a5a00 con 0x7facb40b49c0 2023-11-04T01:43:36.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facb37fe640 1 -- 172.21.15.40:0/2752245300 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac0a5b60 con 0x7facb40b49c0 2023-11-04T01:43:36.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facb37fe640 1 -- 172.21.15.40:0/2752245300 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0ad440 con 0x7facb40b49c0 2023-11-04T01:43:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- 172.21.15.40:0/2752245300 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 msgr2=0x7facb40b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 --2- 172.21.15.40:0/2752245300 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 0x7facb40b4df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facac009d90 tx=0x7facac01c920 comp rx=0 tx=0).stop 2023-11-04T01:43:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- 172.21.15.40:0/2752245300 shutdown_connections 2023-11-04T01:43:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 --2- 172.21.15.40:0/2752245300 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb40b49c0 0x7facb40b4df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 --2- 172.21.15.40:0/2752245300 >> v2:172.21.15.91:3300/0 conn(0x7facb40d0b10 0x7facb415d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- 172.21.15.40:0/2752245300 >> 172.21.15.40:0/2752245300 conn(0x7facb40cf9c0 msgr2=0x7facb40cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- 172.21.15.40:0/2752245300 shutdown_connections 2023-11-04T01:43:36.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- 172.21.15.40:0/2752245300 wait complete. 2023-11-04T01:43:36.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 Processor -- start 2023-11-04T01:43:36.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- start start 2023-11-04T01:43:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 0x7facb414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facb40d0b10 0x7facb415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb415d240 0x7facb41f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40c6700 con 0x7facb40b49c0 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40c5ef0 con 0x7facb40d0b10 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.877+0000 7facbaabf640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb415a410 con 0x7facb415d240 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 0x7facb414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 0x7facb414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33850/0 (socket says 172.21.15.40:33850) 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 -- 172.21.15.40:0/857812176 learned_addr learned my addr 172.21.15.40:0/857812176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb905c640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb415d240 0x7facb41f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb3fff640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facb40d0b10 0x7facb415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 -- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb415d240 msgr2=0x7facb41f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb415d240 0x7facb41f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 -- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facb40d0b10 msgr2=0x7facb415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facb40d0b10 0x7facb415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 -- 172.21.15.40:0/857812176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac009a70 con 0x7facb40b49c0 2023-11-04T01:43:36.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb885b640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 0x7facb414ee50 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7faca400c370 tx=0x7faca400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4005cf0 con 0x7facb40b49c0 2023-11-04T01:43:36.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca4005e50 con 0x7facb40b49c0 2023-11-04T01:43:36.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb40c61a0 con 0x7facb40b49c0 2023-11-04T01:43:36.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40072f0 con 0x7facb40b49c0 2023-11-04T01:43:36.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb40c75f0 con 0x7facb40b49c0 2023-11-04T01:43:36.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb40675f0 con 0x7facb40b49c0 2023-11-04T01:43:36.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faca4007450 con 0x7facb40b49c0 2023-11-04T01:43:36.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb17fa640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faca00664a0 0x7faca0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6800+0+0 (secure 0 0 0) 0x7faca4083770 con 0x7facb40b49c0 2023-11-04T01:43:36.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.881+0000 7facb3fff640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faca00664a0 0x7faca0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.885+0000 7facb3fff640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faca00664a0 0x7faca0068960 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7facb41609c0 tx=0x7faca8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:36.885+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faca4050860 con 0x7facb40b49c0 2023-11-04T01:43:37.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.073+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facb41578e0 con 0x7facb40b49c0 2023-11-04T01:43:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.073+0000 7facb17fa640 1 -- 172.21.15.40:0/857812176 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7faca4053e80 con 0x7facb40b49c0 2023-11-04T01:43:37.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:37.081 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:31.304824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:37.081 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 51 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faca00664a0 msgr2=0x7faca0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faca00664a0 0x7faca0068960 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7facb41609c0 tx=0x7faca8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 msgr2=0x7facb414ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 0x7facb414ee50 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7faca400c370 tx=0x7faca400c830 comp rx=0 tx=0).stop 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 shutdown_connections 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faca00664a0 0x7faca0068960 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7facb415d240 0x7facb41f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7facb40d0b10 0x7facb415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 --2- 172.21.15.40:0/857812176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb40b49c0 0x7facb414ee50 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 >> 172.21.15.40:0/857812176 conn(0x7facb40cf9c0 msgr2=0x7facb41569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 shutdown_connections 2023-11-04T01:43:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:37.077+0000 7facbaabf640 1 -- 172.21.15.40:0/857812176 wait complete. 2023-11-04T01:43:37.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:43:37.236 INFO:teuthology.orchestra.run.smithi040.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:43:37.237 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:37.237 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:43:39.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.365+0000 7fd4c04eb640 1 Processor -- start 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4c04eb640 1 -- start start 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4c04eb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4b80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4c04eb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4b80b0b70 0x7fd4b815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4c04eb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b806c740 con 0x7fd4b815b290 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4c04eb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80b1000 con 0x7fd4b80b0b70 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4c04eb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815b670 con 0x7fd4b80c2670 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4be287640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd4b815b290 0x7fd4b806f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56876/0 (socket says 172.21.15.40:56876) 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4be287640 1 -- 172.21.15.40:0/1647026583 learned_addr learned my addr 172.21.15.40:0/1647026583 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 --2- 172.21.15.40:0/1647026583 >> v2:172.21.15.91:3300/0 conn(0x7fd4b80b0b70 0x7fd4b815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424300810 0 0) 0x7fd4b806c740 con 0x7fd4b815b290 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bda86640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4b80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a4003530 con 0x7fd4b815b290 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984589699 0 0) 0x7fd4a4003530 con 0x7fd4b815b290 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 msgr2=0x7fd4b80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4b80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 >> v2:172.21.15.91:3300/0 conn(0x7fd4b80b0b70 msgr2=0x7fd4b815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 --2- 172.21.15.40:0/1647026583 >> v2:172.21.15.91:3300/0 conn(0x7fd4b80b0b70 0x7fd4b815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b806bb30 con 0x7fd4b815b290 2023-11-04T01:43:39.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd4a8001680 con 0x7fd4b815b290 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 >> v1:172.21.15.40:6789/0 conn(0x7fd4b815b290 legacy=0x7fd4b806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4a4003f00 0x7fd4a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4a4004d10 0x7fd4a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80b1000 con 0x7fd4a4004d10 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815b670 con 0x7fd4a4003f00 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a400b9e0 con 0x7fd4b80c2670 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4a4004d10 0x7fd4a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4be287640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bda86640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4a4003f00 0x7fd4a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 -- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 msgr2=0x7fd4a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 -- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4a4003f00 msgr2=0x7fd4a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4a4003f00 0x7fd4a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4bea88640 1 -- 172.21.15.40:0/1647026583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4003530 con 0x7fd4a4004d10 2023-11-04T01:43:39.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.369+0000 7fd4be287640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b80c2670 0x7fd4a4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4bea88640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4a4004d10 0x7fd4a4005190 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000e170 tx=0x7fd4b001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2902c3aac4ed7c26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00a5c90 con 0x7fd4a4004d10 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b000f040 con 0x7fd4a4004d10 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4bd285640 1 -- 172.21.15.40:0/1647026583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00ad440 con 0x7fd4a4004d10 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 -- 172.21.15.40:0/1647026583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4a4004d10 msgr2=0x7fd4a4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/1647026583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4a4004d10 0x7fd4a4005190 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000e170 tx=0x7fd4b001cc80 comp rx=0 tx=0).stop 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4bea88640 1 -- 172.21.15.40:0/1647026583 reap_dead start 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 -- 172.21.15.40:0/1647026583 shutdown_connections 2023-11-04T01:43:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 -- 172.21.15.40:0/1647026583 >> 172.21.15.40:0/1647026583 conn(0x7fd4b80cebb0 msgr2=0x7fd4b80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 -- 172.21.15.40:0/1647026583 shutdown_connections 2023-11-04T01:43:39.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 -- 172.21.15.40:0/1647026583 wait complete. 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 Processor -- start 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.373+0000 7fd4c04eb640 1 -- start start 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b8159390 0x7fd4b80a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4b8159770 0x7fd4b80a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 0x7fd4b80ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81f4420 con 0x7fd4b80ca510 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81f4700 con 0x7fd4b8159770 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81f49e0 con 0x7fd4b8159390 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 0x7fd4b80ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 0x7fd4b80ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35556/0 (socket says 172.21.15.40:35556) 2023-11-04T01:43:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 -- 172.21.15.40:0/238481789 learned_addr learned my addr 172.21.15.40:0/238481789 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4be287640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b8159390 0x7fd4b80a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bda86640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4b8159770 0x7fd4b80a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 -- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b8159390 msgr2=0x7fd4b80a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b8159390 0x7fd4b80a9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 -- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4b8159770 msgr2=0x7fd4b80a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4b8159770 0x7fd4b80a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 -- 172.21.15.40:0/238481789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b81f4cc0 con 0x7fd4b80ca510 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4bea88640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 0x7fd4b80ca9a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000e170 tx=0x7fd4b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0003ba0 con 0x7fd4b80ca510 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0003d00 con 0x7fd4b80ca510 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b80caee0 con 0x7fd4b80ca510 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00adac0 con 0x7fd4b80ca510 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b80a8680 con 0x7fd4b80ca510 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b81f4e50 con 0x7fd4b80ca510 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4b00b4040 con 0x7fd4b80ca510 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4aeffd640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd49c0664d0 0x7fd49c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6829+0+0 (secure 0 0 0) 0x7fd4b011e160 con 0x7fd4b80ca510 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.377+0000 7fd4be287640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd49c0664d0 0x7fd49c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.381+0000 7fd4be287640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd49c0664d0 0x7fd49c068990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8000c10 tx=0x7fd4a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.381+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4b00eb190 con 0x7fd4b80ca510 2023-11-04T01:43:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4b80744a0 con 0x7fd4b80ca510 2023-11-04T01:43:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4aeffd640 1 -- 172.21.15.40:0/238481789 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fd4b00ee7b0 con 0x7fd4b80ca510 2023-11-04T01:43:39.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:39.579 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:31.304824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 51 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd49c0664d0 msgr2=0x7fd49c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd49c0664d0 0x7fd49c068990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8000c10 tx=0x7fd4a8009040 comp rx=0 tx=0).stop 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 msgr2=0x7fd4b80ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 0x7fd4b80ca9a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000e170 tx=0x7fd4b0009750 comp rx=0 tx=0).stop 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 shutdown_connections 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd49c0664d0 0x7fd49c068990 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b80ca510 0x7fd4b80ca9a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4b8159770 0x7fd4b80a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 --2- 172.21.15.40:0/238481789 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4b8159390 0x7fd4b80a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 >> 172.21.15.40:0/238481789 conn(0x7fd4b80cebb0 msgr2=0x7fd4b815e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 shutdown_connections 2023-11-04T01:43:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:39.573+0000 7fd4c04eb640 1 -- 172.21.15.40:0/238481789 wait complete. 2023-11-04T01:43:39.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:43:39.737 INFO:teuthology.orchestra.run.smithi040.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:43:39.737 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:39.738 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:43:41.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 Processor -- start 2023-11-04T01:43:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 -- start start 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4940715d0 0x7fb4940b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4940b0b70 0x7fb49415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940c2670 con 0x7fb49415afd0 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb494070140 con 0x7fb4940715d0 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb499486640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494071a60 con 0x7fb4940b0b70 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4940715d0 0x7fb4940b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4940715d0 0x7fb4940b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35558/0 (socket says 172.21.15.40:35558) 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 -- 172.21.15.40:0/3894692928 learned_addr learned my addr 172.21.15.40:0/3894692928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb4937fe640 1 --2- 172.21.15.40:0/3894692928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4940b0b70 0x7fb49415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 -- 172.21.15.40:0/3894692928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4940b0b70 msgr2=0x7fb49415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 --2- 172.21.15.40:0/3894692928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4940b0b70 0x7fb49415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 -- 172.21.15.40:0/3894692928 >> v1:172.21.15.91:6789/0 conn(0x7fb49415afd0 legacy=0x7fb49406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.869+0000 7fb48bfff640 1 -- 172.21.15.40:0/3894692928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49406bc30 con 0x7fb4940715d0 2023-11-04T01:43:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb48bfff640 1 --2- 172.21.15.40:0/3894692928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb4940b0630 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009870 tx=0x7fb47c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe1888920113d32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb4927fc640 1 -- 172.21.15.40:0/3894692928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0ab600 con 0x7fb4940715d0 2023-11-04T01:43:41.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb4927fc640 1 -- 172.21.15.40:0/3894692928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c0a7050 con 0x7fb4940715d0 2023-11-04T01:43:41.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb4927fc640 1 -- 172.21.15.40:0/3894692928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0ab980 con 0x7fb4940715d0 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- 172.21.15.40:0/3894692928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 msgr2=0x7fb4940b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 --2- 172.21.15.40:0/3894692928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb4940b0630 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009870 tx=0x7fb47c01c500 comp rx=0 tx=0).stop 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- 172.21.15.40:0/3894692928 shutdown_connections 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 --2- 172.21.15.40:0/3894692928 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb4940b0b70 0x7fb49415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 --2- 172.21.15.40:0/3894692928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb4940b0630 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- 172.21.15.40:0/3894692928 >> 172.21.15.40:0/3894692928 conn(0x7fb4940cebb0 msgr2=0x7fb4940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- 172.21.15.40:0/3894692928 shutdown_connections 2023-11-04T01:43:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- 172.21.15.40:0/3894692928 wait complete. 2023-11-04T01:43:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 Processor -- start 2023-11-04T01:43:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- start start 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb49414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4940b0b70 0x7fb4940b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49415afd0 0x7fb4940ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49414f830 con 0x7fb4940715d0 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49414ff50 con 0x7fb4940b0b70 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb499486640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494150230 con 0x7fb49415afd0 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb49414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb49414f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35566/0 (socket says 172.21.15.40:35566) 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 -- 172.21.15.40:0/3628680556 learned_addr learned my addr 172.21.15.40:0/3628680556 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb4937fe640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49415afd0 0x7fb4940ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb48bfff640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4940b0b70 0x7fb4940b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 -- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49415afd0 msgr2=0x7fb4940ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49415afd0 0x7fb4940ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 -- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4940b0b70 msgr2=0x7fb4940b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4940b0b70 0x7fb4940b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 -- 172.21.15.40:0/3628680556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0094d0 con 0x7fb4940715d0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb48bfff640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4940b0b70 0x7fb4940b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb492ffd640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb49414f2f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb48400b410 tx=0x7fb48400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484004020 con 0x7fb4940715d0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.873+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484004180 con 0x7fb4940715d0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494150510 con 0x7fb4940715d0 2023-11-04T01:43:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484011630 con 0x7fb4940715d0 2023-11-04T01:43:41.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494150ad0 con 0x7fb4940715d0 2023-11-04T01:43:41.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494150cc0 con 0x7fb4940715d0 2023-11-04T01:43:41.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb484011790 con 0x7fb4940715d0 2023-11-04T01:43:41.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb48b7fe640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4740664a0 0x7fb474068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7fb484084040 con 0x7fb4940715d0 2023-11-04T01:43:41.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb48bfff640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4740664a0 0x7fb474068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.877+0000 7fb48bfff640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4740664a0 0x7fb474068960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0ad000 tx=0x7fb47c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:41.881+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb484051060 con 0x7fb4940715d0 2023-11-04T01:43:42.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.069+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4940744a0 con 0x7fb4940715d0 2023-11-04T01:43:42.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.069+0000 7fb48b7fe640 1 -- 172.21.15.40:0/3628680556 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fb484054680 con 0x7fb4940715d0 2023-11-04T01:43:42.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:42.078 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:40.126716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:42.078 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 52 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4740664a0 msgr2=0x7fb474068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4740664a0 0x7fb474068960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0ad000 tx=0x7fb47c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 msgr2=0x7fb49414f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb49414f2f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb48400b410 tx=0x7fb48400b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 shutdown_connections 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4740664a0 0x7fb474068960 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49415afd0 0x7fb4940ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb4940b0b70 0x7fb4940b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 --2- 172.21.15.40:0/3628680556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4940715d0 0x7fb49414f2f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 >> 172.21.15.40:0/3628680556 conn(0x7fb4940cebb0 msgr2=0x7fb49415a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 shutdown_connections 2023-11-04T01:43:42.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.073+0000 7fb499486640 1 -- 172.21.15.40:0/3628680556 wait complete. 2023-11-04T01:43:42.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:43:42.234 INFO:teuthology.orchestra.run.smithi040.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-11-04T01:43:42.235 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:42.235 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-04T01:43:42.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:43:42.375 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:42.375 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:43:42.375 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-04T01:43:42.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f116adc2640 1 Processor -- start 2023-11-04T01:43:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f116adc2640 1 -- start start 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f116adc2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11640b1960 0x7f11640cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f116adc2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11640cdc80 con 0x7f116415cd60 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f116adc2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11640cf5a0 con 0x7f11640b1d40 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f116adc2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1164071e40 con 0x7f11640b1960 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11640b1960 0x7f11640cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11640b1960 0x7f11640cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35572/0 (socket says 172.21.15.40:35572) 2023-11-04T01:43:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 -- 172.21.15.40:0/4040224090 learned_addr learned my addr 172.21.15.40:0/4040224090 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 -- 172.21.15.40:0/4040224090 >> v1:172.21.15.91:6789/0 conn(0x7f11640b1d40 legacy=0x7f11640ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 -- 172.21.15.40:0/4040224090 >> v1:172.21.15.40:6789/0 conn(0x7f116415cd60 legacy=0x7f116415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 -- 172.21.15.40:0/4040224090 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640cf880 con 0x7f11640b1960 2023-11-04T01:43:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.497+0000 7f1168b5e640 1 --2- 172.21.15.40:0/4040224090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640cd740 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f115c009e50 tx=0x7f115c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272cf9ead6e3e8c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f11637fe640 1 -- 172.21.15.40:0/4040224090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0a5860 con 0x7f11640b1960 2023-11-04T01:43:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f11637fe640 1 -- 172.21.15.40:0/4040224090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c0a59c0 con 0x7f11640b1960 2023-11-04T01:43:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f11637fe640 1 -- 172.21.15.40:0/4040224090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0a5d50 con 0x7f11640b1960 2023-11-04T01:43:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/4040224090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 msgr2=0x7f11640cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 --2- 172.21.15.40:0/4040224090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640cd740 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f115c009e50 tx=0x7f115c01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/4040224090 shutdown_connections 2023-11-04T01:43:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 --2- 172.21.15.40:0/4040224090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640cd740 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/4040224090 >> 172.21.15.40:0/4040224090 conn(0x7f116406e760 msgr2=0x7f116406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/4040224090 shutdown_connections 2023-11-04T01:43:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/4040224090 wait complete. 2023-11-04T01:43:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 Processor -- start 2023-11-04T01:43:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- start start 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11640b1d40 0x7f11640c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f116415cd60 0x7f11640c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640c9a30 con 0x7f11640b1960 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640b3440 con 0x7f11640b1d40 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640b4c80 con 0x7f116415cd60 2023-11-04T01:43:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35574/0 (socket says 172.21.15.40:35574) 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 -- 172.21.15.40:0/3669043891 learned_addr learned my addr 172.21.15.40:0/3669043891 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1163fff640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11640b1d40 0x7f11640c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 -- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f116415cd60 msgr2=0x7f11640c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f116415cd60 0x7f11640c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 -- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11640b1d40 msgr2=0x7f11640c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11640b1d40 0x7f11640c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 -- 172.21.15.40:0/3669043891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009b30 con 0x7f11640b1960 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1163fff640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11640b1d40 0x7f11640c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f1168b5e640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640b4740 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f115c0af040 tx=0x7f115c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0b8880 con 0x7f11640b1960 2023-11-04T01:43:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c0b89e0 con 0x7f11640b1960 2023-11-04T01:43:42.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11640b51b0 con 0x7f11640b1960 2023-11-04T01:43:42.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0b8d50 con 0x7f11640b1960 2023-11-04T01:43:42.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.501+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11640b36b0 con 0x7f11640b1960 2023-11-04T01:43:42.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.505+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11640675f0 con 0x7f11640b1960 2023-11-04T01:43:42.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.505+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f115c0ca430 con 0x7f11640b1960 2023-11-04T01:43:42.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.505+0000 7f11617fa640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11500664a0 0x7f1150068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.505+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f115c120040 con 0x7f11640b1960 2023-11-04T01:43:42.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.505+0000 7f1163fff640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11500664a0 0x7f1150068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.505+0000 7f1163fff640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11500664a0 0x7f1150068960 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1164159120 tx=0x7f1158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.509+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f115c0ed2c0 con 0x7f11640b1960 2023-11-04T01:43:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.697+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1164070e10 con 0x7f11640b1960 2023-11-04T01:43:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f11617fa640 1 -- 172.21.15.40:0/3669043891 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f115c0f08e0 con 0x7f11640b1960 2023-11-04T01:43:42.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:42.707 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:40.126716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:42.707 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 52 2023-11-04T01:43:42.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11500664a0 msgr2=0x7f1150068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11500664a0 0x7f1150068960 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1164159120 tx=0x7f1158009040 comp rx=0 tx=0).stop 2023-11-04T01:43:42.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 msgr2=0x7f11640b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640b4740 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f115c0af040 tx=0x7f115c019740 comp rx=0 tx=0).stop 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 shutdown_connections 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f11500664a0 0x7f1150068960 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f116415cd60 0x7f11640c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11640b1d40 0x7f11640c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 --2- 172.21.15.40:0/3669043891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11640b1960 0x7f11640b4740 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 >> 172.21.15.40:0/3669043891 conn(0x7f116406e760 msgr2=0x7f116406b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 shutdown_connections 2023-11-04T01:43:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.701+0000 7f116adc2640 1 -- 172.21.15.40:0/3669043891 wait complete. 2023-11-04T01:43:42.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:43:42.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 Processor -- start 2023-11-04T01:43:42.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 -- start start 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0900ce1b0 0x7ff09015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff09015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09015e800 con 0x7ff09015af70 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff090071200 con 0x7ff0900ce1b0 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09838f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09006c0c0 con 0x7ff09006d160 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0900ce1b0 0x7ff09015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0900ce1b0 0x7ff09015dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35584/0 (socket says 172.21.15.40:35584) 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 -- 172.21.15.40:0/1164873482 learned_addr learned my addr 172.21.15.40:0/1164873482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09692c640 1 --2- 172.21.15.40:0/1164873482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff09015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 -- 172.21.15.40:0/1164873482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 msgr2=0x7ff09015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 --2- 172.21.15.40:0/1164873482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff09015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 -- 172.21.15.40:0/1164873482 >> v1:172.21.15.91:6789/0 conn(0x7ff09015af70 legacy=0x7ff0900cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.849+0000 7ff09592a640 1 -- 172.21.15.40:0/1164873482 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09006c3a0 con 0x7ff0900ce1b0 2023-11-04T01:43:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09592a640 1 --2- 172.21.15.40:0/1164873482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff09015dd80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cfb90 tx=0x7ff08001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928b304695f269bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff095129640 1 -- 172.21.15.40:0/1164873482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800ab600 con 0x7ff0900ce1b0 2023-11-04T01:43:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff095129640 1 -- 172.21.15.40:0/1164873482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0800a7050 con 0x7ff0900ce1b0 2023-11-04T01:43:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff095129640 1 -- 172.21.15.40:0/1164873482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800ab980 con 0x7ff0900ce1b0 2023-11-04T01:43:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- 172.21.15.40:0/1164873482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 msgr2=0x7ff09015dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 --2- 172.21.15.40:0/1164873482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff09015dd80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7ff0900cfb90 tx=0x7ff08001c4c0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- 172.21.15.40:0/1164873482 shutdown_connections 2023-11-04T01:43:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 --2- 172.21.15.40:0/1164873482 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff09015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 --2- 172.21.15.40:0/1164873482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff09015dd80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- 172.21.15.40:0/1164873482 >> 172.21.15.40:0/1164873482 conn(0x7ff0900cb510 msgr2=0x7ff0900cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- 172.21.15.40:0/1164873482 shutdown_connections 2023-11-04T01:43:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- 172.21.15.40:0/1164873482 wait complete. 2023-11-04T01:43:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 Processor -- start 2023-11-04T01:43:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- start start 2023-11-04T01:43:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff090153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff0900c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff09015af70 0x7ff0900b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900b2970 con 0x7ff0900ce1b0 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090153da0 con 0x7ff09015af70 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09838f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090154290 con 0x7ff09006d160 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.853+0000 7ff09592a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff0900c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff0900c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35600/0 (socket says 172.21.15.40:35600) 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 -- 172.21.15.40:0/224596154 learned_addr learned my addr 172.21.15.40:0/224596154 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09612b640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff090153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09692c640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff09015af70 0x7ff0900b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 -- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 msgr2=0x7ff090153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff090153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 -- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff09015af70 msgr2=0x7ff0900b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff09015af70 0x7ff0900b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 -- 172.21.15.40:0/224596154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800094d0 con 0x7ff0900ce1b0 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09612b640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff090153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09592a640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff0900c4dd0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7ff08001cd60 tx=0x7ff080019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800b5640 con 0x7ff0900ce1b0 2023-11-04T01:43:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0800b57a0 con 0x7ff0900ce1b0 2023-11-04T01:43:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800b5b50 con 0x7ff0900ce1b0 2023-11-04T01:43:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0900b1d60 con 0x7ff0900ce1b0 2023-11-04T01:43:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900b2320 con 0x7ff0900ce1b0 2023-11-04T01:43:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0900b2b20 con 0x7ff0900ce1b0 2023-11-04T01:43:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0800b5cb0 con 0x7ff0900ce1b0 2023-11-04T01:43:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff086ffd640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0740664a0 0x7ff074068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7ff08011e7c0 con 0x7ff0900ce1b0 2023-11-04T01:43:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.857+0000 7ff09612b640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0740664a0 0x7ff074068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.861+0000 7ff09612b640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0740664a0 0x7ff074068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0098b0 tx=0x7ff08c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:42.861+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0900b2b20 con 0x7ff0900ce1b0 2023-11-04T01:43:43.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.081+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7ff0900b2b20 con 0x7ff0900ce1b0 2023-11-04T01:43:43.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.941+0000 7ff086ffd640 1 -- 172.21.15.40:0/224596154 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7086 v53) v1 ==== 112+0+0 (secure 0 0 0) 0x7ff0900b2b20 con 0x7ff0900ce1b0 2023-11-04T01:43:43.946 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.7086 2023-11-04T01:43:43.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0740664a0 msgr2=0x7ff074068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0740664a0 0x7ff074068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0098b0 tx=0x7ff08c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 msgr2=0x7ff0900c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff0900c4dd0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7ff08001cd60 tx=0x7ff080019260 comp rx=0 tx=0).stop 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 shutdown_connections 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff0740664a0 0x7ff074068960 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff09015af70 0x7ff0900b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0900ce1b0 0x7ff0900c4dd0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 --2- 172.21.15.40:0/224596154 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff09006d160 0x7ff090153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 >> 172.21.15.40:0/224596154 conn(0x7ff0900cb510 msgr2=0x7ff0900ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 shutdown_connections 2023-11-04T01:43:43.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:43.945+0000 7ff09838f640 1 -- 172.21.15.40:0/224596154 wait complete. 2023-11-04T01:43:43.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 1 2023-11-04T01:43:44.112 INFO:teuthology.orchestra.run.smithi040.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-04T01:43:44.113 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-04T01:43:44.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:44.113 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-04T01:43:44.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:43:44.123 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f28af016640 time 2023-11-04T01:43:44.122753+0000 2023-11-04T01:43:44.123 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f28b5142fae] 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.124 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7f28af016640 thread_name:ms_dispatch 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:43:44.117+0000 7f28af016640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f28af016640 time 2023-11-04T01:43:44.122753+0000 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f28b5142fae] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.125 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f28b4a7d520] 2023-11-04T01:43:44.126 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f28b5143008] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.127 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:43:44.117+0000 7f28af016640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7f28af016640 thread_name:ms_dispatch 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f28b4a7d520] 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f28b5143008] 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.128 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:44.129 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.130 INFO:tasks.ceph.mds.c.smithi040.stderr: -2699> 2023-11-04T01:43:21.081+0000 7f28ac811640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:44.130 INFO:tasks.ceph.mds.c.smithi040.stderr: -956> 2023-11-04T01:43:36.085+0000 7f28ac811640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: -1> 2023-11-04T01:43:44.117+0000 7f28af016640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f28af016640 time 2023-11-04T01:43:44.122753+0000 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f28b5142fae] 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.132 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 0> 2023-11-04T01:43:44.117+0000 7f28af016640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7f28af016640 thread_name:ms_dispatch 2023-11-04T01:43:44.133 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f28b4a7d520] 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f28b5143008] 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.134 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.135 INFO:tasks.ceph.mds.c.smithi040.stderr: -2702> 2023-11-04T01:43:21.081+0000 7f28ac811640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:44.137 INFO:tasks.ceph.mds.c.smithi040.stderr: -959> 2023-11-04T01:43:36.085+0000 7f28ac811640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: -4> 2023-11-04T01:43:44.117+0000 7f28af016640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f28af016640 time 2023-11-04T01:43:44.122753+0000 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f28b5142fae] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.138 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: -3> 2023-11-04T01:43:44.117+0000 7f28af016640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7f28af016640 thread_name:ms_dispatch 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f28b4a7d520] 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:43:44.139 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f28b5143008] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f28b5143162] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x558dd06a2c01] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x558dd043b969] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x558dd043d9eb] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558dd043debc] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x558dd04287f5] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f28b532ef2a] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f28b53c17f1] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f28b4acfb43] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f28b4b61a00] 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:44.140 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:43:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:43:44.244 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:43:44.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.405+0000 7f9f3d235640 1 Processor -- start 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.405+0000 7f9f3d235640 1 -- start start 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3d235640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f3815d5c0 0x7f9f380712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3d235640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f380ad9e0 0x7f9f380c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3d235640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f38070e60 con 0x7f9f3806b7e0 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3d235640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3815d9a0 con 0x7f9f380ad9e0 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3d235640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f38070b30 con 0x7f9f3815d5c0 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f380ad9e0 0x7f9f380c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3759e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f3806b7e0 0x7f9f380cc5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56894/0 (socket says 172.21.15.40:56894) 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3759e640 1 -- 172.21.15.40:0/3551068631 learned_addr learned my addr 172.21.15.40:0/3551068631 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f36d9d640 1 --2- 172.21.15.40:0/3551068631 >> v2:172.21.15.91:3300/0 conn(0x7f9f3815d5c0 0x7f9f380712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3659c640 1 -- 172.21.15.40:0/3551068631 >> v2:172.21.15.91:3300/0 conn(0x7f9f3815d5c0 msgr2=0x7f9f380712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3659c640 1 --2- 172.21.15.40:0/3551068631 >> v2:172.21.15.91:3300/0 conn(0x7f9f3815d5c0 0x7f9f380712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3659c640 1 -- 172.21.15.40:0/3551068631 >> v1:172.21.15.40:6789/0 conn(0x7f9f3806b7e0 legacy=0x7f9f380cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f35d9b640 1 -- 172.21.15.40:0/3551068631 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540877690 0 0) 0x7f9f38070e60 con 0x7f9f3806b7e0 2023-11-04T01:43:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3659c640 1 -- 172.21.15.40:0/3551068631 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380c90f0 con 0x7f9f380ad9e0 2023-11-04T01:43:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f3659c640 1 --2- 172.21.15.40:0/3551068631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f380ad9e0 0x7f9f380c99f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9f3806f570 tx=0x7f9f2001ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67e60c76c10d88d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.409+0000 7f9f35d9b640 1 -- 172.21.15.40:0/3551068631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200a7950 con 0x7f9f380ad9e0 2023-11-04T01:43:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f35d9b640 1 -- 172.21.15.40:0/3551068631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f200a7ab0 con 0x7f9f380ad9e0 2023-11-04T01:43:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f35d9b640 1 -- 172.21.15.40:0/3551068631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200a7e40 con 0x7f9f380ad9e0 2023-11-04T01:43:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/3551068631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f380ad9e0 msgr2=0x7f9f380c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 --2- 172.21.15.40:0/3551068631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f380ad9e0 0x7f9f380c99f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9f3806f570 tx=0x7f9f2001ea70 comp rx=0 tx=0).stop 2023-11-04T01:43:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/3551068631 shutdown_connections 2023-11-04T01:43:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 --2- 172.21.15.40:0/3551068631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f380ad9e0 0x7f9f380c99f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 --2- 172.21.15.40:0/3551068631 >> v2:172.21.15.91:3300/0 conn(0x7f9f3815d5c0 0x7f9f380712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/3551068631 >> 172.21.15.40:0/3551068631 conn(0x7f9f380cea00 msgr2=0x7f9f380cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/3551068631 shutdown_connections 2023-11-04T01:43:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/3551068631 wait complete. 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 Processor -- start 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- start start 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f3806b7e0 0x7f9f38155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f380ad9e0 0x7f9f380b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 0x7f9f3815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380aff20 con 0x7f9f3815d5c0 2023-11-04T01:43:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38155f40 con 0x7f9f380ad9e0 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380af2a0 con 0x7f9f3806b7e0 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 0x7f9f3815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 0x7f9f3815be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35622/0 (socket says 172.21.15.40:35622) 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 -- 172.21.15.40:0/1662567470 learned_addr learned my addr 172.21.15.40:0/1662567470 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3659c640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f380ad9e0 0x7f9f380b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 -- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f3806b7e0 msgr2=0x7f9f38155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f36d9d640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f3806b7e0 0x7f9f38155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f3806b7e0 0x7f9f38155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 -- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f380ad9e0 msgr2=0x7f9f380b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f380ad9e0 0x7f9f380b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 -- 172.21.15.40:0/1662567470 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2000b6c0 con 0x7f9f3815d5c0 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3659c640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f380ad9e0 0x7f9f380b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3759e640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 0x7f9f3815be30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c7b0 tx=0x7f9f3000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000a640 con 0x7f9f3815d5c0 2023-11-04T01:43:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000a7c0 con 0x7f9f3815d5c0 2023-11-04T01:43:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f380af580 con 0x7f9f3815d5c0 2023-11-04T01:43:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000ab70 con 0x7f9f3815d5c0 2023-11-04T01:43:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.413+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f380afb40 con 0x7f9f3815d5c0 2023-11-04T01:43:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.417+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380b0060 con 0x7f9f3815d5c0 2023-11-04T01:43:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.417+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f3000acd0 con 0x7f9f3815d5c0 2023-11-04T01:43:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.417+0000 7f9f2f7fe640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f180664a0 0x7f9f18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.417+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f9f30083a20 con 0x7f9f3815d5c0 2023-11-04T01:43:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.417+0000 7f9f36d9d640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f180664a0 0x7f9f18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.417+0000 7f9f36d9d640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f180664a0 0x7f9f18068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f38159c60 tx=0x7f9f28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.421+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f30050ad0 con 0x7f9f3815d5c0 2023-11-04T01:43:44.547 INFO:tasks.ceph.mds.c.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:43:44.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f380744a0 con 0x7f9f3815d5c0 2023-11-04T01:43:44.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f2f7fe640 1 -- 172.21.15.40:0/1662567470 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f9f30018090 con 0x7f9f3815d5c0 2023-11-04T01:43:44.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:44.619 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:43.085721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:44.619 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 53 2023-11-04T01:43:44.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f180664a0 msgr2=0x7f9f18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f180664a0 0x7f9f18068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f38159c60 tx=0x7f9f28008040 comp rx=0 tx=0).stop 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 msgr2=0x7f9f3815be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 0x7f9f3815be30 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000c7b0 tx=0x7f9f3000cc70 comp rx=0 tx=0).stop 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 shutdown_connections 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f180664a0 0x7f9f18068960 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f3815d5c0 0x7f9f3815be30 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f380ad9e0 0x7f9f380b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 --2- 172.21.15.40:0/1662567470 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f3806b7e0 0x7f9f38155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 >> 172.21.15.40:0/1662567470 conn(0x7f9f380cea00 msgr2=0x7f9f380ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 shutdown_connections 2023-11-04T01:43:44.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:44.613+0000 7f9f3d235640 1 -- 172.21.15.40:0/1662567470 wait complete. 2023-11-04T01:43:44.638 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:49.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:43:49.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:49.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77cb56e640 1 Processor -- start 2023-11-04T01:43:49.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77cb56e640 1 -- start start 2023-11-04T01:43:49.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77cb56e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77c40d0ae0 0x7f77c40b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77cb56e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40b6070 con 0x7f77c40b4990 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77cb56e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40b8ed0 con 0x7f77c40d0690 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77cb56e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40d1ce0 con 0x7f77c40d0ae0 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77c930a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f77c40b4990 0x7f77c40b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41360/0 (socket says 172.21.15.40:41360) 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77c9b0b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77c40d0ae0 0x7f77c40b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77c930a640 1 -- 172.21.15.40:0/1748598836 learned_addr learned my addr 172.21.15.40:0/1748598836 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77c9b0b640 1 -- 172.21.15.40:0/1748598836 >> v1:172.21.15.91:6789/0 conn(0x7f77c40d0690 legacy=0x7f77c40b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77c9b0b640 1 -- 172.21.15.40:0/1748598836 >> v1:172.21.15.40:6789/0 conn(0x7f77c40b4990 legacy=0x7f77c40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.769+0000 7f77c9b0b640 1 -- 172.21.15.40:0/1748598836 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40d1fc0 con 0x7f77c40d0ae0 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 --2- 172.21.15.40:0/1748598836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40b6bf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009d90 tx=0x7f77bc01f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7af985533cc72a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77bbfff640 1 -- 172.21.15.40:0/1748598836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0af600 con 0x7f77c40d0ae0 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77bbfff640 1 -- 172.21.15.40:0/1748598836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc0ab050 con 0x7f77c40d0ae0 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77bbfff640 1 -- 172.21.15.40:0/1748598836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0af980 con 0x7f77c40d0ae0 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- 172.21.15.40:0/1748598836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 msgr2=0x7f77c40b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 --2- 172.21.15.40:0/1748598836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40b6bf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009d90 tx=0x7f77bc01f100 comp rx=0 tx=0).stop 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- 172.21.15.40:0/1748598836 shutdown_connections 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 --2- 172.21.15.40:0/1748598836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40b6bf0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- 172.21.15.40:0/1748598836 >> 172.21.15.40:0/1748598836 conn(0x7f77c40cf990 msgr2=0x7f77c40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- 172.21.15.40:0/1748598836 shutdown_connections 2023-11-04T01:43:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- 172.21.15.40:0/1748598836 wait complete. 2023-11-04T01:43:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 Processor -- start 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- start start 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77c40b4990 0x7f77c41536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77c40d0690 0x7f77c4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40cb850 con 0x7f77c40d0ae0 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4153470 con 0x7f77c40b4990 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77cb56e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40cbaa0 con 0x7f77c40d0690 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40726/0 (socket says 172.21.15.40:40726) 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 -- 172.21.15.40:0/761131401 learned_addr learned my addr 172.21.15.40:0/761131401 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c930a640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77c40b4990 0x7f77c41536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c8b09640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77c40d0690 0x7f77c4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 -- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77c40d0690 msgr2=0x7f77c4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77c40d0690 0x7f77c4159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 -- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77c40b4990 msgr2=0x7f77c41536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77c40b4990 0x7f77c41536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 -- 172.21.15.40:0/761131401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc009a70 con 0x7f77c40d0ae0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.773+0000 7f77c9b0b640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40d2ad0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f77bc01cd30 tx=0x7f77bc01bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0ba680 con 0x7f77c40d0ae0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc0ba7e0 con 0x7f77c40d0ae0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c40cbd80 con 0x7f77c40d0ae0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0bab70 con 0x7f77c40d0ae0 2023-11-04T01:43:49.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40cc340 con 0x7f77c40d0ae0 2023-11-04T01:43:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c40cc530 con 0x7f77c40d0ae0 2023-11-04T01:43:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77bc0b6040 con 0x7f77c40d0ae0 2023-11-04T01:43:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77b9ffb640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77a80664a0 0x7f77a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f77bc122ee0 con 0x7f77c40d0ae0 2023-11-04T01:43:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77c930a640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77a80664a0 0x7f77a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.777+0000 7f77c930a640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77a80664a0 0x7f77a8068960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f77c0005890 tx=0x7f77c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.781+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77bc0eff20 con 0x7f77c40d0ae0 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77c40744a0 con 0x7f77c40d0ae0 2023-11-04T01:43:49.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77b9ffb640 1 -- 172.21.15.40:0/761131401 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f77bc0b4020 con 0x7f77c40d0ae0 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:43.085721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 53 2023-11-04T01:43:49.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77a80664a0 msgr2=0x7f77a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77a80664a0 0x7f77a8068960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f77c0005890 tx=0x7f77c0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 msgr2=0x7f77c40d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40d2ad0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f77bc01cd30 tx=0x7f77bc01bea0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 shutdown_connections 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f77a80664a0 0x7f77a8068960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77c40d0ae0 0x7f77c40d2ad0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f77c40d0690 0x7f77c4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 --2- 172.21.15.40:0/761131401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77c40b4990 0x7f77c41536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 >> 172.21.15.40:0/761131401 conn(0x7f77c40cf990 msgr2=0x7f77c40b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 shutdown_connections 2023-11-04T01:43:49.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:49.973+0000 7f77cb56e640 1 -- 172.21.15.40:0/761131401 wait complete. 2023-11-04T01:43:49.997 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:54.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 Processor -- start 2023-11-04T01:43:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 -- start start 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 0x7f7d4c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0d0b10 0x7f7d4c0d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0d2280 con 0x7f7d4c0b49c0 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d2560 con 0x7f7d4c0d0b10 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d533a4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d2840 con 0x7f7d4c15d240 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d51941640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7d4c0b49c0 0x7f7d4c0cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41362/0 (socket says 172.21.15.40:41362) 2023-11-04T01:43:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d51941640 1 -- 172.21.15.40:0/1900450062 learned_addr learned my addr 172.21.15.40:0/1900450062 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d51140640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 0x7f7d4c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1900450062 >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0d0b10 0x7f7d4c0d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323197904 0 0) 0x7f7d4c0d2280 con 0x7f7d4c0b49c0 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d38003530 con 0x7f7d4c0b49c0 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313089466 0 0) 0x7f7d38003530 con 0x7f7d4c0b49c0 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 msgr2=0x7f7d4c15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 0x7f7d4c15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0d0b10 msgr2=0x7f7d4c0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 --2- 172.21.15.40:0/1900450062 >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0d0b10 0x7f7d4c0d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0b66c0 con 0x7f7d4c0b49c0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f7d48001680 con 0x7f7d4c0b49c0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 >> v1:172.21.15.40:6789/0 conn(0x7f7d4c0b49c0 legacy=0x7f7d4c0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 0x7f7d38005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d2560 con 0x7f7d380047d0 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0d2840 con 0x7f7d38003980 2023-11-04T01:43:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3800b990 con 0x7f7d4c15d240 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1900450062 >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0d0b10 0x7f7d4c0d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d51941640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 0x7f7d38005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d51140640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 -- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 msgr2=0x7f7d38005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d4c15d240 0x7f7d38005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 -- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d38003980 msgr2=0x7f7d38003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.129+0000 7f7d5093f640 1 -- 172.21.15.40:0/1900450062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38003530 con 0x7f7d380047d0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000e350 tx=0x7f7d4001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a4897e07ed9f83 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400a5c60 con 0x7f7d380047d0 2023-11-04T01:43:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000f040 con 0x7f7d380047d0 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d3ffff640 1 -- 172.21.15.40:0/1900450062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400039a0 con 0x7f7d380047d0 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 -- 172.21.15.40:0/1900450062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d380047d0 msgr2=0x7f7d38004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1900450062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000e350 tx=0x7f7d4001ce40 comp rx=0 tx=0).stop 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d51941640 1 -- 172.21.15.40:0/1900450062 reap_dead start 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 -- 172.21.15.40:0/1900450062 shutdown_connections 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 -- 172.21.15.40:0/1900450062 >> 172.21.15.40:0/1900450062 conn(0x7f7d4c0cf9c0 msgr2=0x7f7d4c0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 -- 172.21.15.40:0/1900450062 shutdown_connections 2023-11-04T01:43:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 -- 172.21.15.40:0/1900450062 wait complete. 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 Processor -- start 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.133+0000 7f7d533a4640 1 -- start start 2023-11-04T01:43:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d380047d0 0x7f7d4c15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c1f3090 0x7f7d4c1f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 0x7f7d4c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0ca010 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0ca2b0 con 0x7f7d4c1f3090 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0ca590 con 0x7f7d380047d0 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 0x7f7d4c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 0x7f7d4c0b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40742/0 (socket says 172.21.15.40:40742) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 -- 172.21.15.40:0/1267469951 learned_addr learned my addr 172.21.15.40:0/1267469951 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c1f3090 0x7f7d4c1f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51140640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d380047d0 0x7f7d4c15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 -- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d380047d0 msgr2=0x7f7d4c15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d380047d0 0x7f7d4c15f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 -- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c1f3090 msgr2=0x7f7d4c1f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c1f3090 0x7f7d4c1f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 -- 172.21.15.40:0/1267469951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0ca870 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d5093f640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c1f3090 0x7f7d4c1f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51941640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 0x7f7d4c0b3eb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c10 tx=0x7f7d48011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800f920 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800faa0 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c0cab50 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800fe90 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c1f3a50 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c0675f0 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d4801f460 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d3dffb640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f7d48087390 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.137+0000 7f7d51140640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.141+0000 7f7d51140640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009890 tx=0x7f7d44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.141+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d480543b0 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.337+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4c0d0f70 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.337+0000 7f7d3dffb640 1 -- 172.21.15.40:0/1267469951 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f7d480579d0 con 0x7f7d4c0b3a30 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:43.085721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 53 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 msgr2=0x7f7d30068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009890 tx=0x7f7d44008040 comp rx=0 tx=0).stop 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 msgr2=0x7f7d4c0b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 0x7f7d4c0b3eb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c10 tx=0x7f7d48011c20 comp rx=0 tx=0).stop 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 shutdown_connections 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c0b3a30 0x7f7d4c0b3eb0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c1f3090 0x7f7d4c1f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 --2- 172.21.15.40:0/1267469951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d380047d0 0x7f7d4c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 >> 172.21.15.40:0/1267469951 conn(0x7f7d4c0cf9c0 msgr2=0x7f7d4c0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 shutdown_connections 2023-11-04T01:43:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:43:55.341+0000 7f7d533a4640 1 -- 172.21.15.40:0/1267469951 wait complete. 2023-11-04T01:43:55.364 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:55.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:43:57.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:57.428 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:00.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.489+0000 7f524c365640 1 Processor -- start 2023-11-04T01:44:00.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.489+0000 7f524c365640 1 -- start start 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524c365640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f524415aec0 0x7f524406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524c365640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440ce9b0 con 0x7f52440cdee0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524c365640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440d0940 con 0x7f524415d840 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524c365640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524415e8a0 con 0x7f524415aec0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524a101640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f524415aec0 0x7f524406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524a902640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52440cdee0 0x7f52440cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35688/0 (socket says 172.21.15.40:35688) 2023-11-04T01:44:00.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524a902640 1 -- 172.21.15.40:0/3933496278 learned_addr learned my addr 172.21.15.40:0/3933496278 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524a101640 1 -- 172.21.15.40:0/3933496278 >> v1:172.21.15.91:6789/0 conn(0x7f524415d840 legacy=0x7f52440cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524a101640 1 -- 172.21.15.40:0/3933496278 >> v1:172.21.15.40:6789/0 conn(0x7f52440cdee0 legacy=0x7f52440cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.493+0000 7f524a101640 1 -- 172.21.15.40:0/3933496278 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415b2a0 con 0x7f524415aec0 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524a101640 1 --2- 172.21.15.40:0/3933496278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524406c7b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f523c009d90 tx=0x7f523c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d18d50abe46651 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f52490ff640 1 -- 172.21.15.40:0/3933496278 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0a58c0 con 0x7f524415aec0 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f52490ff640 1 -- 172.21.15.40:0/3933496278 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0a5a20 con 0x7f524415aec0 2023-11-04T01:44:00.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f52490ff640 1 -- 172.21.15.40:0/3933496278 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0a5db0 con 0x7f524415aec0 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- 172.21.15.40:0/3933496278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 msgr2=0x7f524406c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 --2- 172.21.15.40:0/3933496278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524406c7b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f523c009d90 tx=0x7f523c01c800 comp rx=0 tx=0).stop 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- 172.21.15.40:0/3933496278 shutdown_connections 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 --2- 172.21.15.40:0/3933496278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524406c7b0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- 172.21.15.40:0/3933496278 >> 172.21.15.40:0/3933496278 conn(0x7f52440b28f0 msgr2=0x7f52440b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- 172.21.15.40:0/3933496278 shutdown_connections 2023-11-04T01:44:00.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- 172.21.15.40:0/3933496278 wait complete. 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 Processor -- start 2023-11-04T01:44:00.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- start start 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52440cdee0 0x7f5244156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f524415d840 0x7f52440c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440ad840 con 0x7f524415aec0 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244156540 con 0x7f52440cdee0 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524c365640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440acc30 con 0x7f524415d840 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38494/0 (socket says 172.21.15.40:38494) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 -- 172.21.15.40:0/910297112 learned_addr learned my addr 172.21.15.40:0/910297112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524a101640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52440cdee0 0x7f5244156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f524a902640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f524415d840 0x7f52440c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 -- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f524415d840 msgr2=0x7f52440c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f524415d840 0x7f52440c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 -- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52440cdee0 msgr2=0x7f5244156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.497+0000 7f5249900640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52440cdee0 0x7f5244156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5249900640 1 -- 172.21.15.40:0/910297112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009a70 con 0x7f524415aec0 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f524a101640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52440cdee0 0x7f5244156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5249900640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524415a1e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f523800c3c0 tx=0x7f523800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380052d0 con 0x7f524415aec0 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238005430 con 0x7f524415aec0 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440acf10 con 0x7f524415aec0 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238003820 con 0x7f524415aec0 2023-11-04T01:44:00.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440ad4d0 con 0x7f524415aec0 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440ad9f0 con 0x7f524415aec0 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5238003980 con 0x7f524415aec0 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5242ffd640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52300664a0 0x7f5230068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f52380837e0 con 0x7f524415aec0 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f524a101640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52300664a0 0x7f5230068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.501+0000 7f524a101640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52300664a0 0x7f5230068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f523c0af000 tx=0x7f523c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.505+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52440ad9f0 con 0x7f524415aec0 2023-11-04T01:44:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.693+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52440ad9f0 con 0x7f524415aec0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f5242ffd640 1 -- 172.21.15.40:0/910297112 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4969 (secure 0 0 0) 0x7f52440ad9f0 con 0x7f524415aec0 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:00.702 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:43:57.944426+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7086,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7086":{"gid":7086,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/15089123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":15089123},{"type":"v1","addr":"172.21.15.40:6835","nonce":15089123}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:43:57.944426+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:00.703 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 54 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52300664a0 msgr2=0x7f5230068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52300664a0 0x7f5230068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f523c0af000 tx=0x7f523c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 msgr2=0x7f524415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524415a1e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f523800c3c0 tx=0x7f523800c880 comp rx=0 tx=0).stop 2023-11-04T01:44:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 shutdown_connections 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52300664a0 0x7f5230068960 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f524415d840 0x7f52440c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f524415aec0 0x7f524415a1e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 --2- 172.21.15.40:0/910297112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52440cdee0 0x7f5244156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 >> 172.21.15.40:0/910297112 conn(0x7f52440b28f0 msgr2=0x7f52440b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 shutdown_connections 2023-11-04T01:44:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:00.697+0000 7f524c365640 1 -- 172.21.15.40:0/910297112 wait complete. 2023-11-04T01:44:00.720 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:44:00.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:00.734 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:00.734 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:00.734 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:00.796 INFO:teuthology.orchestra.run.smithi040.stdout:1699062224.55062.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:00.798 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062224.55062.core'] 2023-11-04T01:44:00.798 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062224.55062.core, deleting it 2023-11-04T01:44:00.798 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062224.55062.core 2023-11-04T01:44:00.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:44:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 Processor -- start 2023-11-04T01:44:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 -- start start 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806cc60 0x7f1be80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1be806d040 0x7f1be80b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1be80ce920 0x7f1be80b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80ce7c0 con 0x7f1be80ce920 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be8070490 con 0x7f1be806d040 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1befc87640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80cb3a0 con 0x7f1be806cc60 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1be80ce920 0x7f1be80b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1be80ce920 0x7f1be80b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38498/0 (socket says 172.21.15.40:38498) 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 -- 172.21.15.40:0/2466173453 learned_addr learned my addr 172.21.15.40:0/2466173453 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bed222640 1 --2- 172.21.15.40:0/2466173453 >> v2:172.21.15.91:3300/0 conn(0x7f1be806d040 0x7f1be80b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1beda23640 1 --2- 172.21.15.40:0/2466173453 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806cc60 0x7f1be80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 -- 172.21.15.40:0/2466173453 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806cc60 msgr2=0x7f1be80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 --2- 172.21.15.40:0/2466173453 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806cc60 0x7f1be80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 -- 172.21.15.40:0/2466173453 >> v2:172.21.15.91:3300/0 conn(0x7f1be806d040 msgr2=0x7f1be80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 --2- 172.21.15.40:0/2466173453 >> v2:172.21.15.91:3300/0 conn(0x7f1be806d040 0x7f1be80b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.017+0000 7f1bee224640 1 -- 172.21.15.40:0/2466173453 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be806f480 con 0x7f1be80ce920 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1bee224640 1 --2- 172.21.15.40:0/2466173453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80ce920 0x7f1be80b2d10 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1be8067650 tx=0x7f1bd801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae8032980b08a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1beca21640 1 -- 172.21.15.40:0/2466173453 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80a5820 con 0x7f1be80ce920 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1beca21640 1 -- 172.21.15.40:0/2466173453 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd80a5980 con 0x7f1be80ce920 2023-11-04T01:44:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1beca21640 1 -- 172.21.15.40:0/2466173453 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80a5d10 con 0x7f1be80ce920 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 -- 172.21.15.40:0/2466173453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80ce920 msgr2=0x7f1be80b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 --2- 172.21.15.40:0/2466173453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80ce920 0x7f1be80b2d10 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1be8067650 tx=0x7f1bd801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 -- 172.21.15.40:0/2466173453 shutdown_connections 2023-11-04T01:44:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 --2- 172.21.15.40:0/2466173453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80ce920 0x7f1be80b2d10 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 --2- 172.21.15.40:0/2466173453 >> v2:172.21.15.91:3300/0 conn(0x7f1be806d040 0x7f1be80b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 --2- 172.21.15.40:0/2466173453 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806cc60 0x7f1be80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 -- 172.21.15.40:0/2466173453 >> 172.21.15.40:0/2466173453 conn(0x7f1be80cd7d0 msgr2=0x7f1be80cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 -- 172.21.15.40:0/2466173453 shutdown_connections 2023-11-04T01:44:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.021+0000 7f1befc87640 1 -- 172.21.15.40:0/2466173453 wait complete. 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 Processor -- start 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- start start 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 0x7f1be80c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806d040 0x7f1be80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1be80ce920 0x7f1be80ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815d1d0 con 0x7f1be806cc60 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80adb70 con 0x7f1be80ce920 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80ae130 con 0x7f1be806d040 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 0x7f1be80c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 0x7f1be80c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38508/0 (socket says 172.21.15.40:38508) 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 -- 172.21.15.40:0/448443563 learned_addr learned my addr 172.21.15.40:0/448443563 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1bee224640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1be80ce920 0x7f1be80ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1bed222640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806d040 0x7f1be80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 -- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806d040 msgr2=0x7f1be80b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806d040 0x7f1be80b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 -- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1be80ce920 msgr2=0x7f1be80ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1be80ce920 0x7f1be80ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 -- 172.21.15.40:0/448443563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8009b30 con 0x7f1be806cc60 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1bee224640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1be80ce920 0x7f1be80ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1beda23640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 0x7f1be80c54a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1be000d830 tx=0x7f1be000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00096a0 con 0x7f1be806cc60 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0009800 con 0x7f1be806cc60 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be81553f0 con 0x7f1be806cc60 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0009b70 con 0x7f1be806cc60 2023-11-04T01:44:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be80c5e80 con 0x7f1be806cc60 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.025+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be80744a0 con 0x7f1be806cc60 2023-11-04T01:44:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.029+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1be0009cd0 con 0x7f1be806cc60 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.029+0000 7f1be67fc640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1bd40664a0 0x7f1bd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.029+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f1be0084a70 con 0x7f1be806cc60 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.029+0000 7f1bed222640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1bd40664a0 0x7f1bd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.029+0000 7f1bed222640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1bd40664a0 0x7f1bd4068960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1be80b5f80 tx=0x7f1bdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.033+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1be0051a80 con 0x7f1be806cc60 2023-11-04T01:44:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.245+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f1be80b6cd0 con 0x7f1be806cc60 2023-11-04T01:44:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.249+0000 7f1be67fc640 1 -- 172.21.15.40:0/448443563 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7086 v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1be00550a0 con 0x7f1be806cc60 2023-11-04T01:44:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 7086 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1bd40664a0 msgr2=0x7f1bd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1bd40664a0 0x7f1bd4068960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1be80b5f80 tx=0x7f1bdc008040 comp rx=0 tx=0).stop 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 msgr2=0x7f1be80c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 0x7f1be80c54a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1be000d830 tx=0x7f1be000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 shutdown_connections 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1bd40664a0 0x7f1bd4068960 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1be80ce920 0x7f1be80ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1be806d040 0x7f1be80b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 --2- 172.21.15.40:0/448443563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be806cc60 0x7f1be80c54a0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 >> 172.21.15.40:0/448443563 conn(0x7f1be80cd7d0 msgr2=0x7f1be80b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 shutdown_connections 2023-11-04T01:44:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.253+0000 7f1befc87640 1 -- 172.21.15.40:0/448443563 wait complete. 2023-11-04T01:44:01.278 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:44:01.278 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:44:01.278 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:44:01.278 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:01.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:01.278 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:44:01.279 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:44:01.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:44:01.281 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:44:01.281 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:01.340 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:44:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.389+0000 7f5fd979d640 1 Processor -- start 2023-11-04T01:44:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.389+0000 7f5fd979d640 1 -- start start 2023-11-04T01:44:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0690 0x7f5fd40b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5fd40d0ae0 0x7f5fd40b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40b6070 con 0x7f5fd40b4990 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40b8ed0 con 0x7f5fd40d0ae0 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40d1ce0 con 0x7f5fd40d0690 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd2ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5fd40b4990 0x7f5fd40b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35700/0 (socket says 172.21.15.40:35700) 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd2ffd640 1 -- 172.21.15.40:0/1254819941 learned_addr learned my addr 172.21.15.40:0/1254819941 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd37fe640 1 --2- 172.21.15.40:0/1254819941 >> v2:172.21.15.40:3300/0 conn(0x7f5fd40d0ae0 0x7f5fd40b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd27fc640 1 --2- 172.21.15.40:0/1254819941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0690 0x7f5fd40b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd1ffb640 1 -- 172.21.15.40:0/1254819941 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185315780 0 0) 0x7f5fd40b6070 con 0x7f5fd40b4990 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd1ffb640 1 -- 172.21.15.40:0/1254819941 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fbc003530 con 0x7f5fd40b4990 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd37fe640 1 -- 172.21.15.40:0/1254819941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0690 msgr2=0x7f5fd40b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd37fe640 1 --2- 172.21.15.40:0/1254819941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0690 0x7f5fd40b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd37fe640 1 -- 172.21.15.40:0/1254819941 >> v1:172.21.15.40:6789/0 conn(0x7f5fd40b4990 legacy=0x7f5fd40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd37fe640 1 -- 172.21.15.40:0/1254819941 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40d1fc0 con 0x7f5fd40d0ae0 2023-11-04T01:44:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd37fe640 1 --2- 172.21.15.40:0/1254819941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0ae0 0x7f5fd40b6a20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009d90 tx=0x7f5fcc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d87a55b92d450f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd1ffb640 1 -- 172.21.15.40:0/1254819941 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0af600 con 0x7f5fd40d0ae0 2023-11-04T01:44:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd1ffb640 1 -- 172.21.15.40:0/1254819941 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0ab050 con 0x7f5fd40d0ae0 2023-11-04T01:44:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd1ffb640 1 -- 172.21.15.40:0/1254819941 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0af980 con 0x7f5fd40d0ae0 2023-11-04T01:44:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- 172.21.15.40:0/1254819941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0ae0 msgr2=0x7f5fd40b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 --2- 172.21.15.40:0/1254819941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0ae0 0x7f5fd40b6a20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009d90 tx=0x7f5fcc01f130 comp rx=0 tx=0).stop 2023-11-04T01:44:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- 172.21.15.40:0/1254819941 shutdown_connections 2023-11-04T01:44:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 --2- 172.21.15.40:0/1254819941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0ae0 0x7f5fd40b6a20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 --2- 172.21.15.40:0/1254819941 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0690 0x7f5fd40b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- 172.21.15.40:0/1254819941 >> 172.21.15.40:0/1254819941 conn(0x7f5fd40cf990 msgr2=0x7f5fd40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- 172.21.15.40:0/1254819941 shutdown_connections 2023-11-04T01:44:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.393+0000 7f5fd979d640 1 -- 172.21.15.40:0/1254819941 wait complete. 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 Processor -- start 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- start start 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fd40b4990 0x7f5fd415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 0x7f5fd41f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0ae0 0x7f5fd415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40a9900 con 0x7f5fd40d0690 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41f7060 con 0x7f5fd40b4990 2023-11-04T01:44:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4160490 con 0x7f5fd40d0ae0 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 0x7f5fd41f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 0x7f5fd41f6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38526/0 (socket says 172.21.15.40:38526) 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 -- 172.21.15.40:0/81670895 learned_addr learned my addr 172.21.15.40:0/81670895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd37fe640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0ae0 0x7f5fd415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd2ffd640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fd40b4990 0x7f5fd415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 -- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0ae0 msgr2=0x7f5fd415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0ae0 0x7f5fd415ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 -- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fd40b4990 msgr2=0x7f5fd415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fd40b4990 0x7f5fd415fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 -- 172.21.15.40:0/81670895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc009a70 con 0x7f5fd40d0690 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd37fe640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0ae0 0x7f5fd415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd27fc640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 0x7f5fd41f6b20 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800d7d0 tx=0x7f5fc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800b6c0 con 0x7f5fd40d0690 2023-11-04T01:44:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc800b820 con 0x7f5fd40d0690 2023-11-04T01:44:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800bbb0 con 0x7f5fd40d0690 2023-11-04T01:44:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd40a9b50 con 0x7f5fd40d0690 2023-11-04T01:44:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd40aa110 con 0x7f5fd40d0690 2023-11-04T01:44:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.397+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd40744a0 con 0x7f5fd40d0690 2023-11-04T01:44:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.401+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5fc800bd10 con 0x7f5fd40d0690 2023-11-04T01:44:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.401+0000 7f5fbb7fe640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fc00664a0 0x7f5fc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.401+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f5fc80847b0 con 0x7f5fd40d0690 2023-11-04T01:44:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.401+0000 7f5fd2ffd640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fc00664a0 0x7f5fc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.401+0000 7f5fd2ffd640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fc00664a0 0x7f5fc0068960 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40011f0 tx=0x7f5fc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.405+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5fc8051800 con 0x7f5fd40d0690 2023-11-04T01:44:01.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.593+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fd40b85a0 con 0x7f5fd40d0690 2023-11-04T01:44:01.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.593+0000 7f5fbb7fe640 1 -- 172.21.15.40:0/81670895 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4136 (secure 0 0 0) 0x7f5fc8054e20 con 0x7f5fd40d0690 2023-11-04T01:44:01.600 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:01.600 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:01.262934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:replay","state_seq":1,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:01.600 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 56 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fc00664a0 msgr2=0x7f5fc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fc00664a0 0x7f5fc0068960 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40011f0 tx=0x7f5fc4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 msgr2=0x7f5fd41f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 0x7f5fd41f6b20 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800d7d0 tx=0x7f5fc800dc90 comp rx=0 tx=0).stop 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 shutdown_connections 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5fc00664a0 0x7f5fc0068960 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5fd40d0ae0 0x7f5fd415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd40d0690 0x7f5fd41f6b20 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 --2- 172.21.15.40:0/81670895 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5fd40b4990 0x7f5fd415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 >> 172.21.15.40:0/81670895 conn(0x7f5fd40cf990 msgr2=0x7f5fd40b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 shutdown_connections 2023-11-04T01:44:01.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:01.597+0000 7f5fd979d640 1 -- 172.21.15.40:0/81670895 wait complete. 2023-11-04T01:44:01.619 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:44:02.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:44:06.089 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:44:06.084+0000 7efc24dea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:06.089 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:44:06.084+0000 7efc24dea640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:06.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.749+0000 7f16cbb55640 1 Processor -- start 2023-11-04T01:44:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.749+0000 7f16cbb55640 1 -- start start 2023-11-04T01:44:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16cbb55640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c415d690 0x7f16c406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16cbb55640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c40cd400 con 0x7f16c406f8f0 2023-11-04T01:44:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16cbb55640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c40cd6e0 con 0x7f16c415d2b0 2023-11-04T01:44:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16cbb55640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40ad450 con 0x7f16c415d690 2023-11-04T01:44:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16ca0f2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16c406f8f0 0x7f16c40b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35714/0 (socket says 172.21.15.40:35714) 2023-11-04T01:44:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c90f0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c415d690 0x7f16c406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16ca0f2640 1 -- 172.21.15.40:0/4183527003 learned_addr learned my addr 172.21.15.40:0/4183527003 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c90f0640 1 -- 172.21.15.40:0/4183527003 >> v1:172.21.15.91:6789/0 conn(0x7f16c415d2b0 legacy=0x7f16c40ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c90f0640 1 -- 172.21.15.40:0/4183527003 >> v1:172.21.15.40:6789/0 conn(0x7f16c406f8f0 legacy=0x7f16c40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c90f0640 1 -- 172.21.15.40:0/4183527003 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c40ad070 con 0x7f16c415d690 2023-11-04T01:44:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c90f0640 1 --2- 172.21.15.40:0/4183527003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c406c630 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f16b40097c0 tx=0x7f16b401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ab26a42640d338 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c88ef640 1 -- 172.21.15.40:0/4183527003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40ab610 con 0x7f16c415d690 2023-11-04T01:44:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c88ef640 1 -- 172.21.15.40:0/4183527003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b40ab770 con 0x7f16c415d690 2023-11-04T01:44:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.753+0000 7f16c88ef640 1 -- 172.21.15.40:0/4183527003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40abb00 con 0x7f16c415d690 2023-11-04T01:44:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/4183527003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 msgr2=0x7f16c406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 --2- 172.21.15.40:0/4183527003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c406c630 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f16b40097c0 tx=0x7f16b401c3f0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/4183527003 shutdown_connections 2023-11-04T01:44:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 --2- 172.21.15.40:0/4183527003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c406c630 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/4183527003 >> 172.21.15.40:0/4183527003 conn(0x7f16c40cebb0 msgr2=0x7f16c40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/4183527003 shutdown_connections 2023-11-04T01:44:06.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/4183527003 wait complete. 2023-11-04T01:44:06.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 Processor -- start 2023-11-04T01:44:06.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- start start 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c406f8f0 0x7f16c41503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c415d2b0 0x7f16c40b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c40b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c413cb20 con 0x7f16c415d690 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40c8320 con 0x7f16c406f8f0 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40c8600 con 0x7f16c415d2b0 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c40b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c40b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38534/0 (socket says 172.21.15.40:38534) 2023-11-04T01:44:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 -- 172.21.15.40:0/2443708628 learned_addr learned my addr 172.21.15.40:0/2443708628 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16c90f0640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c415d2b0 0x7f16c40b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16c98f1640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c406f8f0 0x7f16c41503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 -- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c415d2b0 msgr2=0x7f16c40b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c415d2b0 0x7f16c40b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 -- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c406f8f0 msgr2=0x7f16c41503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c406f8f0 0x7f16c41503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 -- 172.21.15.40:0/2443708628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009420 con 0x7f16c415d690 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ca0f2640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c40b3eb0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00cbc0 tx=0x7f16bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00ad40 con 0x7f16c415d690 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc012400 con 0x7f16c415d690 2023-11-04T01:44:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00aea0 con 0x7f16c415d690 2023-11-04T01:44:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c40c88e0 con 0x7f16c415d690 2023-11-04T01:44:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.757+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c4150930 con 0x7f16c415d690 2023-11-04T01:44:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.761+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c40744a0 con 0x7f16c415d690 2023-11-04T01:44:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.761+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16bc007070 con 0x7f16c415d690 2023-11-04T01:44:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.761+0000 7f16ba7fc640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.761+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f16bc0842a0 con 0x7f16c415d690 2023-11-04T01:44:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.761+0000 7f16c98f1640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.761+0000 7f16c98f1640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f16c0000f70 tx=0x7f16c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.765+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f16bc051280 con 0x7f16c415d690 2023-11-04T01:44:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.957+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16c413cf40 con 0x7f16c415d690 2023-11-04T01:44:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.957+0000 7f16ba7fc640 1 -- 172.21.15.40:0/2443708628 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f16bc017090 con 0x7f16c415d690 2023-11-04T01:44:06.965 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:06.965 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:04.297759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 60 2023-11-04T01:44:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 msgr2=0x7f16a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f16c0000f70 tx=0x7f16c0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 msgr2=0x7f16c40b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c40b3eb0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00cbc0 tx=0x7f16bc00a430 comp rx=0 tx=0).stop 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 shutdown_connections 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f16a80664a0 0x7f16a8068960 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c415d690 0x7f16c40b3eb0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f16c415d2b0 0x7f16c40b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 --2- 172.21.15.40:0/2443708628 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f16c406f8f0 0x7f16c41503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 >> 172.21.15.40:0/2443708628 conn(0x7f16c40cebb0 msgr2=0x7f16c40cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 shutdown_connections 2023-11-04T01:44:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:06.961+0000 7f16cbb55640 1 -- 172.21.15.40:0/2443708628 wait complete. 2023-11-04T01:44:06.984 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:44:06.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:07.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 Processor -- start 2023-11-04T01:44:07.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 -- start start 2023-11-04T01:44:07.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90f4161510 0x7f90f41618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f90f406ba90 0x7f90f40c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40cc6f0 con 0x7f90f406f8f0 2023-11-04T01:44:07.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40b10d0 con 0x7f90f4161510 2023-11-04T01:44:07.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f9eac640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f406bf90 con 0x7f90f406ba90 2023-11-04T01:44:07.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90f4161510 0x7f90f41618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90f4161510 0x7f90f41618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38536/0 (socket says 172.21.15.40:38536) 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 -- 172.21.15.40:0/687362812 learned_addr learned my addr 172.21.15.40:0/687362812 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f3fff640 1 --2- 172.21.15.40:0/687362812 >> v2:172.21.15.91:3300/0 conn(0x7f90f406ba90 0x7f90f40c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 -- 172.21.15.40:0/687362812 >> v2:172.21.15.91:3300/0 conn(0x7f90f406ba90 msgr2=0x7f90f40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 --2- 172.21.15.40:0/687362812 >> v2:172.21.15.91:3300/0 conn(0x7f90f406ba90 0x7f90f40c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 -- 172.21.15.40:0/687362812 >> v1:172.21.15.91:6789/0 conn(0x7f90f406f8f0 legacy=0x7f90f40b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f37fe640 1 -- 172.21.15.40:0/687362812 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f406c270 con 0x7f90f4161510 2023-11-04T01:44:07.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.101+0000 7f90f3fff640 1 --2- 172.21.15.40:0/687362812 >> v2:172.21.15.91:3300/0 conn(0x7f90f406ba90 0x7f90f40c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:07.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f37fe640 1 --2- 172.21.15.40:0/687362812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f41618f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f90f40b4cf0 tx=0x7f90ec01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442aa8a588a2bcdc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f27fc640 1 -- 172.21.15.40:0/687362812 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0a5730 con 0x7f90f4161510 2023-11-04T01:44:07.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f27fc640 1 -- 172.21.15.40:0/687362812 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec0a5890 con 0x7f90f4161510 2023-11-04T01:44:07.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f27fc640 1 -- 172.21.15.40:0/687362812 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0a5c20 con 0x7f90f4161510 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 -- 172.21.15.40:0/687362812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 msgr2=0x7f90f41618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 --2- 172.21.15.40:0/687362812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f41618f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f90f40b4cf0 tx=0x7f90ec01c960 comp rx=0 tx=0).stop 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 -- 172.21.15.40:0/687362812 shutdown_connections 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 --2- 172.21.15.40:0/687362812 >> v2:172.21.15.91:3300/0 conn(0x7f90f406ba90 0x7f90f40c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 --2- 172.21.15.40:0/687362812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f41618f0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 -- 172.21.15.40:0/687362812 >> 172.21.15.40:0/687362812 conn(0x7f90f40cebb0 msgr2=0x7f90f40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 -- 172.21.15.40:0/687362812 shutdown_connections 2023-11-04T01:44:07.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 -- 172.21.15.40:0/687362812 wait complete. 2023-11-04T01:44:07.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 Processor -- start 2023-11-04T01:44:07.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.105+0000 7f90f9eac640 1 -- start start 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90f406ba90 0x7f90f40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90f406f8f0 0x7f90f4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f4152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4154310 con 0x7f90f4161510 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b17a0 con 0x7f90f406ba90 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b2040 con 0x7f90f406f8f0 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f4152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f4152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38544/0 (socket says 172.21.15.40:38544) 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 -- 172.21.15.40:0/3778128296 learned_addr learned my addr 172.21.15.40:0/3778128296 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 -- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90f406f8f0 msgr2=0x7f90f4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90f406f8f0 0x7f90f4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 -- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90f406ba90 msgr2=0x7f90f40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90f406ba90 0x7f90f40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 -- 172.21.15.40:0/3778128296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009b30 con 0x7f90f4161510 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f3fff640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f4152af0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c7f0 tx=0x7f90e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4007820 con 0x7f90f4161510 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40079c0 con 0x7f90f4161510 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4154540 con 0x7f90f4161510 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4007d70 con 0x7f90f4161510 2023-11-04T01:44:07.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40b1cd0 con 0x7f90f4161510 2023-11-04T01:44:07.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f40744a0 con 0x7f90f4161510 2023-11-04T01:44:07.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90e40113f0 con 0x7f90f4161510 2023-11-04T01:44:07.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90ebfff640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90d40664d0 0x7f90d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f90e40846a0 con 0x7f90f4161510 2023-11-04T01:44:07.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.109+0000 7f90f37fe640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90d40664d0 0x7f90d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.113+0000 7f90f37fe640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90d40664d0 0x7f90d4068990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0ae000 tx=0x7f90ec004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.113+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90e4051650 con 0x7f90f4161510 2023-11-04T01:44:07.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.301+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90f40b21b0 con 0x7f90f4161510 2023-11-04T01:44:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90ebfff640 1 -- 172.21.15.40:0/3778128296 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f90e4054c70 con 0x7f90f4161510 2023-11-04T01:44:07.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:07.310 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:04.297759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 60 2023-11-04T01:44:07.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90d40664d0 msgr2=0x7f90d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90d40664d0 0x7f90d4068990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0ae000 tx=0x7f90ec004ac0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 msgr2=0x7f90f4152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f4152af0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c7f0 tx=0x7f90e400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 shutdown_connections 2023-11-04T01:44:07.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f90d40664d0 0x7f90d4068990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f4161510 0x7f90f4152af0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f90f406f8f0 0x7f90f4153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 --2- 172.21.15.40:0/3778128296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f90f406ba90 0x7f90f40c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 >> 172.21.15.40:0/3778128296 conn(0x7f90f40cebb0 msgr2=0x7f90f40cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 shutdown_connections 2023-11-04T01:44:07.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.305+0000 7f90f9eac640 1 -- 172.21.15.40:0/3778128296 wait complete. 2023-11-04T01:44:07.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:44:04.297759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6316, 'mds_1': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6316': {'gid': 6316, 'name': 'b', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.91:6837/3698962796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6836', 'nonce': 3698962796}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 3698962796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7068': {'gid': 7068, 'name': 'a', 'rank': 1, 'incarnation': 50, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.40:6833/960586799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 960586799}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 960586799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:44:07.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:44:07.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:44:07.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 Processor -- start 2023-11-04T01:44:07.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 -- start start 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6e40d0690 0x7fd6e40b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd6e40d0ae0 0x7fd6e40b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40b6070 con 0x7fd6e40b4990 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e40b8ed0 con 0x7fd6e40d0690 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6eb2a2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e40d1ce0 con 0x7fd6e40d0ae0 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6e903e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6e40b4990 0x7fd6e40b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39226/0 (socket says 172.21.15.40:39226) 2023-11-04T01:44:07.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6e903e640 1 -- 172.21.15.40:0/417666917 learned_addr learned my addr 172.21.15.40:0/417666917 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6e883d640 1 --2- 172.21.15.40:0/417666917 >> v2:172.21.15.40:3300/0 conn(0x7fd6e40d0690 0x7fd6e40b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.857+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545198605 0 0) 0x7fd6e40b6070 con 0x7fd6e40b4990 2023-11-04T01:44:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d0003530 con 0x7fd6e40b4990 2023-11-04T01:44:07.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 --2- 172.21.15.40:0/417666917 >> v2:172.21.15.91:3300/0 conn(0x7fd6e40d0ae0 0x7fd6e40b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3845765301 0 0) 0x7fd6d0003530 con 0x7fd6e40b4990 2023-11-04T01:44:07.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 >> v2:172.21.15.91:3300/0 conn(0x7fd6e40d0ae0 msgr2=0x7fd6e40b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 --2- 172.21.15.40:0/417666917 >> v2:172.21.15.91:3300/0 conn(0x7fd6e40d0ae0 0x7fd6e40b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 >> v2:172.21.15.40:3300/0 conn(0x7fd6e40d0690 msgr2=0x7fd6e40b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 --2- 172.21.15.40:0/417666917 >> v2:172.21.15.40:3300/0 conn(0x7fd6e40d0690 0x7fd6e40b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40d1fc0 con 0x7fd6e40b4990 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd6e0001a00 con 0x7fd6e40b4990 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 >> v1:172.21.15.40:6789/0 conn(0x7fd6e40b4990 legacy=0x7fd6e40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0003980 0x7fd6d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d00047d0 0x7fd6d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d0005190 0x7fd6d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40b8ed0 con 0x7fd6d0005190 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40d1ce0 con 0x7fd6d00047d0 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d000bf00 con 0x7fd6d0003980 2023-11-04T01:44:07.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d0005190 0x7fd6d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e903e640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0003980 0x7fd6d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 -- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0003980 msgr2=0x7fd6d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e883d640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d00047d0 0x7fd6d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0003980 0x7fd6d0003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 -- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d00047d0 msgr2=0x7fd6d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d00047d0 0x7fd6d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 -- 172.21.15.40:0/417666917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0003530 con 0x7fd6d0005190 2023-11-04T01:44:07.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e883d640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6d00047d0 0x7fd6d0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:07.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 -- 172.21.15.40:0/417666917 reap_dead start 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6e983f640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d0005190 0x7fd6d000b990 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009ab0 tx=0x7fd6dc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f272350886cc8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0a5660 con 0x7fd6d0005190 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0a57c0 con 0x7fd6d0005190 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6dbfff640 1 -- 172.21.15.40:0/417666917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0a5b30 con 0x7fd6d0005190 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/417666917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d0005190 msgr2=0x7fd6d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d0005190 0x7fd6d000b990 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009ab0 tx=0x7fd6dc01ca70 comp rx=0 tx=0).stop 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/417666917 shutdown_connections 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/417666917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d0005190 0x7fd6d000b990 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/417666917 >> 172.21.15.40:0/417666917 conn(0x7fd6e40cf990 msgr2=0x7fd6e40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/417666917 shutdown_connections 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.861+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/417666917 wait complete. 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 Processor -- start 2023-11-04T01:44:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 -- start start 2023-11-04T01:44:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0005190 0x7fd6e41f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 0x7fd6e4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e4157560 0x7fd6e41579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41f4140 con 0x7fd6e40b70d0 2023-11-04T01:44:07.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41f4420 con 0x7fd6e4157560 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41f4700 con 0x7fd6d0005190 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 0x7fd6e4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 0x7fd6e4156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58754/0 (socket says 172.21.15.40:58754) 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 -- 172.21.15.40:0/1887166884 learned_addr learned my addr 172.21.15.40:0/1887166884 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0005190 0x7fd6e41f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e983f640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e4157560 0x7fd6e41579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 -- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0005190 msgr2=0x7fd6e41f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0005190 0x7fd6e41f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 -- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e4157560 msgr2=0x7fd6e41579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e4157560 0x7fd6e41579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 -- 172.21.15.40:0/1887166884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e41f49e0 con 0x7fd6e40b70d0 2023-11-04T01:44:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6e883d640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 0x7fd6e4156d60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009fd0 tx=0x7fd6d4010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6d9ffb640 1 -- 172.21.15.40:0/1887166884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4004220 con 0x7fd6e40b70d0 2023-11-04T01:44:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6d9ffb640 1 -- 172.21.15.40:0/1887166884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d4004380 con 0x7fd6e40b70d0 2023-11-04T01:44:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6d9ffb640 1 -- 172.21.15.40:0/1887166884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400eb60 con 0x7fd6e40b70d0 2023-11-04T01:44:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e41f4cc0 con 0x7fd6e40b70d0 2023-11-04T01:44:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.865+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e41572a0 con 0x7fd6e40b70d0 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6d9ffb640 1 -- 172.21.15.40:0/1887166884 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6d400ecc0 con 0x7fd6e40b70d0 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6d9ffb640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6c80664d0 0x7fd6c8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6d9ffb640 1 -- 172.21.15.40:0/1887166884 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fd6d4084310 con 0x7fd6e40b70d0 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6c80664d0 0x7fd6c8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 Processor -- start 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 -- start start 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6c80664d0 0x7fd6c8068990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40a9bc0 tx=0x7fd6e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a7a9fa0 0x55854a7aa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a75d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 0x55854a75df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a628460 con 0x55854a75db40 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a5b9690 con 0x55854a7a9fa0 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55854a5b6bc0 con 0x55854a7aa8c0 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 0x55854a75df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 0x55854a75df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58766/0 (socket says 172.21.15.40:58766) 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 -- 172.21.15.40:0/3239636239 learned_addr learned my addr 172.21.15.40:0/3239636239 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e883d640 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a75d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e903e640 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a7a9fa0 0x55854a7aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 -- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 msgr2=0x55854a75d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a75d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 -- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a7a9fa0 msgr2=0x55854a7aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a7a9fa0 0x55854a7aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 -- 172.21.15.40:0/3239636239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55854a2aa890 con 0x55854a75db40 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e883d640 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a75d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6e983f640 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 0x55854a75df20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc01d310 tx=0x7fd6dc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83e475fa0898bee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6c6ffd640 1 -- 172.21.15.40:0/3239636239 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0b2070 con 0x55854a75db40 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6c6ffd640 1 -- 172.21.15.40:0/3239636239 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00f000 con 0x55854a75db40 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.869+0000 7fd6c6ffd640 1 -- 172.21.15.40:0/3239636239 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0a5b50 con 0x55854a75db40 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/3239636239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 msgr2=0x55854a75df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 0x55854a75df20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc01d310 tx=0x7fd6dc0046d0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/3239636239 shutdown_connections 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a75db40 0x55854a75df20 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a75d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/3239636239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a7a9fa0 0x55854a7aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/3239636239 >> 172.21.15.40:0/3239636239 conn(0x55854a78ad40 msgr2=0x55854a78d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/3239636239 shutdown_connections 2023-11-04T01:44:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/3239636239 wait complete. 2023-11-04T01:44:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- start start 2023-11-04T01:44:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 Processor -- start 2023-11-04T01:44:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a763a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 0x55854a763f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a7644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a5b24b0 con 0x55854a7a9fa0 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a56aaa0 con 0x55854a75db40 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55854a570940 con 0x55854a7aa8c0 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 10 client.0 _ll_register_callbacks cb 0x55854a74b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 0x55854a763f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 0x55854a763f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58776/0 (socket says 172.21.15.40:58776) 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 -- 172.21.15.40:0/21994720 learned_addr learned my addr 172.21.15.40:0/21994720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e903e640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a763a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e983f640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a7644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 -- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 msgr2=0x55854a7644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a7644c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 -- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 msgr2=0x55854a763a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a763a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 -- 172.21.15.40:0/21994720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d0003530 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e883d640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 0x55854a763f80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400e540 tx=0x7fd6d40555f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6bdf0c9653e694 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6bffff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6bffff640 1 -- 172.21.15.40:0/21994720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4059040 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6bffff640 1 -- 172.21.15.40:0/21994720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fd6d405d1f0 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55854a56fe10 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6bffff640 1 -- 172.21.15.40:0/21994720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d405b070 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 10 client.7479 fetch_fsmap learned FSMap version 60 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55854a5731a0 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6bffff640 1 -- 172.21.15.40:0/21994720 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55854a56fe10 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6bffff640 1 -- 172.21.15.40:0/21994720 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 60) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fd6d401a030 con 0x55854a7a9fa0 2023-11-04T01:44:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 10 client.7479 fetch_fsmap finished waiting for FSMap version 60 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 10 client.7479 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 20 client.7479 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a764d60 0x55854a7bb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 4 client.7479 mds_command: new command op to 6316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 --> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55854a5b0e00 con 0x55854a764d60 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.873+0000 7fd6e903e640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a764d60 0x55854a7bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6bffff640 10 client.7479 ms_handle_connect on v2:172.21.15.91:6836/3698962796 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6e903e640 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a764d60 0x55854a7bb720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efa97ce101e90402 server_cookie=4c3f10e24fe01dc8 in_seq=0 out_seq=0 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6bffff640 1 -- 172.21.15.40:0/21994720 <== mds.0 v2:172.21.15.91:6836/3698962796 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55854a5b0e00 con 0x55854a764d60 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6bffff640 10 client.7479 handle_command_reply: tid=0 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 client.7479 shutdown 2023-11-04T01:44:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 msgr2=0x55854a763f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 0x55854a763f80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400e540 tx=0x7fd6d40555f0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 shutdown_connections 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a764d60 0x55854a7bb720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a7aa8c0 0x55854a7644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7a9fa0 0x55854a763f80 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6bffff640 0 client.7479 ms_handle_reset on v2:172.21.15.91:6836/3698962796 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/21994720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a763a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 >> 172.21.15.40:0/21994720 conn(0x55854a78ad40 msgr2=0x55854a78d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 shutdown_connections 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/21994720 wait complete. 2023-11-04T01:44:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.877+0000 7fd6ee3cf000 20 client.7479 trim_cache size 0 max 16384 2023-11-04T01:44:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 Processor -- start 2023-11-04T01:44:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 -- start start 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a7658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a765de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a26b940 con 0x55854a7602a0 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a577d20 con 0x55854a75db40 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55854a570460 con 0x55854a78ad40 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a7658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a7658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58784/0 (socket says 172.21.15.40:58784) 2023-11-04T01:44:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 -- 172.21.15.40:0/1533653221 learned_addr learned my addr 172.21.15.40:0/1533653221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 -- 172.21.15.40:0/1533653221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 msgr2=0x55854a765de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a765de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 -- 172.21.15.40:0/1533653221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 msgr2=0x55854a7a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 -- 172.21.15.40:0/1533653221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55854a5594a0 con 0x55854a7602a0 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a7658a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x55854a58bc10 tx=0x7fd6e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ae80124ffd4466 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6c77fe640 1 -- 172.21.15.40:0/1533653221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0014a80 con 0x55854a7602a0 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6c77fe640 1 -- 172.21.15.40:0/1533653221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000d070 con 0x55854a7602a0 2023-11-04T01:44:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.893+0000 7fd6c77fe640 1 -- 172.21.15.40:0/1533653221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0014be0 con 0x55854a7602a0 2023-11-04T01:44:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1533653221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 msgr2=0x55854a7658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a7658a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x55854a58bc10 tx=0x7fd6e0012000 comp rx=0 tx=0).stop 2023-11-04T01:44:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1533653221 shutdown_connections 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a765de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1533653221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a7658a0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1533653221 >> 172.21.15.40:0/1533653221 conn(0x55854a763bd0 msgr2=0x55854a765190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1533653221 shutdown_connections 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1533653221 wait complete. 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- start start 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 Processor -- start 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a809cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a80a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a760ce0 con 0x55854a7602a0 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854a5afcc0 con 0x55854a75db40 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55854a5f2830 con 0x55854a78ad40 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 10 client.0 _ll_register_callbacks cb 0x7fd6d00036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a809cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a809cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58786/0 (socket says 172.21.15.40:58786) 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 -- 172.21.15.40:0/1932559719 learned_addr learned my addr 172.21.15.40:0/1932559719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 -- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 msgr2=0x55854a80a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e983f640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a80a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a80a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 -- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 msgr2=0x55854a7bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7bcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 -- 172.21.15.40:0/1932559719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e40d1fc0 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e883d640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a809cb0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4053e70 tx=0x7fd6d4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47649e32a00ae1ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6bffff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6bffff640 1 -- 172.21.15.40:0/1932559719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4059040 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6bffff640 1 -- 172.21.15.40:0/1932559719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fd6d405d1f0 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55854a7618a0 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6bffff640 1 -- 172.21.15.40:0/1932559719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d4004630 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 10 client.7485 fetch_fsmap learned FSMap version 60 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55854a2aacc0 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6bffff640 1 -- 172.21.15.40:0/1932559719 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55854a7618a0 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6bffff640 1 -- 172.21.15.40:0/1932559719 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 60) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fd6d401a070 con 0x55854a7602a0 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 10 client.7485 fetch_fsmap finished waiting for FSMap version 60 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 10 client.7485 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:44:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 20 client.7485 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a7a9fa0 0x55854a7c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 4 client.7485 mds_command: new command op to 6316 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 --> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55854a57cd10 con 0x55854a7a9fa0 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.897+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a7a9fa0 0x55854a7c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6bffff640 10 client.7485 ms_handle_connect on v2:172.21.15.91:6836/3698962796 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6e903e640 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a7a9fa0 0x55854a7c7630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8856c5f1d06223b3 server_cookie=3dc30d7aaa489935 in_seq=0 out_seq=0 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6bffff640 1 -- 172.21.15.40:0/1932559719 <== mds.0 v2:172.21.15.91:6836/3698962796 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55854a57cd10 con 0x55854a7a9fa0 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6bffff640 10 client.7485 handle_command_reply: tid=0 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 client.7485 shutdown 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 msgr2=0x55854a809cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a809cb0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4053e70 tx=0x7fd6d4000bd0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 shutdown_connections 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:6836/3698962796,v1:172.21.15.91:6837/3698962796] conn(0x55854a7a9fa0 0x55854a7c7630 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55854a78ad40 0x55854a80a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55854a7602a0 0x55854a809cb0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6bffff640 0 client.7485 ms_handle_reset on v2:172.21.15.91:6836/3698962796 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 --2- 172.21.15.40:0/1932559719 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55854a75db40 0x55854a7bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 >> 172.21.15.40:0/1932559719 conn(0x55854a763bd0 msgr2=0x55854a765ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 shutdown_connections 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 1 -- 172.21.15.40:0/1932559719 wait complete. 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6ee3cf000 20 client.7485 trim_cache size 0 max 16384 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:44:07.911 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 6316, 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 6.632751259, 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 60, 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 94, 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 94, 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 57.800154262 2023-11-04T01:44:07.912 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:44:07.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6c80664d0 msgr2=0x7fd6c8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6c80664d0 0x7fd6c8068990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40a9bc0 tx=0x7fd6e0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:07.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 msgr2=0x7fd6e4156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 0x7fd6e4156d60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009fd0 tx=0x7fd6d4010d60 comp rx=0 tx=0).stop 2023-11-04T01:44:07.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 shutdown_connections 2023-11-04T01:44:07.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd6c80664d0 0x7fd6c8068990 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd6e4157560 0x7fd6e41579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6e40b70d0 0x7fd6e4156d60 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 --2- 172.21.15.40:0/1887166884 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd6d0005190 0x7fd6e41f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 >> 172.21.15.40:0/1887166884 conn(0x7fd6e40cf990 msgr2=0x7fd6e40b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 shutdown_connections 2023-11-04T01:44:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:07.901+0000 7fd6eb2a2640 1 -- 172.21.15.40:0/1887166884 wait complete. 2023-11-04T01:44:07.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:44:08.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 Processor -- start 2023-11-04T01:44:08.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 -- start start 2023-11-04T01:44:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce8815a1f0 0x7fce880cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce880cdea0 0x7fce880b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce880ccee0 con 0x7fce880ca400 2023-11-04T01:44:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8815a5d0 con 0x7fce8815a1f0 2023-11-04T01:44:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce8e1f1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880ca900 con 0x7fce880cdea0 2023-11-04T01:44:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce8815a1f0 0x7fce880cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce8815a1f0 0x7fce880cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58796/0 (socket says 172.21.15.40:58796) 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 -- 172.21.15.40:0/773083315 learned_addr learned my addr 172.21.15.40:0/773083315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce86ffd640 1 --2- 172.21.15.40:0/773083315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce880cdea0 0x7fce880b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 -- 172.21.15.40:0/773083315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce880cdea0 msgr2=0x7fce880b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 --2- 172.21.15.40:0/773083315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce880cdea0 0x7fce880b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 -- 172.21.15.40:0/773083315 >> v1:172.21.15.91:6789/0 conn(0x7fce880ca400 legacy=0x7fce880704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.033+0000 7fce877fe640 1 -- 172.21.15.40:0/773083315 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880cabe0 con 0x7fce8815a1f0 2023-11-04T01:44:08.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce877fe640 1 --2- 172.21.15.40:0/773083315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce8815a1f0 0x7fce880cd370 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156637a8fe07e974 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce867fc640 1 -- 172.21.15.40:0/773083315 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700aa5f0 con 0x7fce8815a1f0 2023-11-04T01:44:08.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce867fc640 1 -- 172.21.15.40:0/773083315 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700aa750 con 0x7fce8815a1f0 2023-11-04T01:44:08.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce867fc640 1 -- 172.21.15.40:0/773083315 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700aaae0 con 0x7fce8815a1f0 2023-11-04T01:44:08.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 -- 172.21.15.40:0/773083315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce8815a1f0 msgr2=0x7fce880cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/773083315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce8815a1f0 0x7fce880cd370 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce7001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 -- 172.21.15.40:0/773083315 shutdown_connections 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/773083315 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce880cdea0 0x7fce880b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/773083315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce8815a1f0 0x7fce880cd370 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 -- 172.21.15.40:0/773083315 >> 172.21.15.40:0/773083315 conn(0x7fce880cebb0 msgr2=0x7fce880cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 -- 172.21.15.40:0/773083315 shutdown_connections 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 -- 172.21.15.40:0/773083315 wait complete. 2023-11-04T01:44:08.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 Processor -- start 2023-11-04T01:44:08.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.037+0000 7fce8e1f1640 1 -- start start 2023-11-04T01:44:08.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce880ca400 0x7fce881592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 0x7fce88155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce8815a1f0 0x7fce880b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce88156840 con 0x7fce880cdea0 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce88158e60 con 0x7fce880ca400 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce88158250 con 0x7fce8815a1f0 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 0x7fce88155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 0x7fce88155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58798/0 (socket says 172.21.15.40:58798) 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 -- 172.21.15.40:0/2053976476 learned_addr learned my addr 172.21.15.40:0/2053976476 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce87fff640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce8815a1f0 0x7fce880b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce877fe640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce880ca400 0x7fce881592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 -- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce8815a1f0 msgr2=0x7fce880b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce8815a1f0 0x7fce880b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 -- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce880ca400 msgr2=0x7fce881592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce880ca400 0x7fce881592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 -- 172.21.15.40:0/2053976476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700094d0 con 0x7fce880cdea0 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce877fe640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce880ca400 0x7fce881592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 0x7fce88155a40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fce7800c7f0 tx=0x7fce7800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce7ffff640 1 -- 172.21.15.40:0/2053976476 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78004220 con 0x7fce880cdea0 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce7ffff640 1 -- 172.21.15.40:0/2053976476 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce780043a0 con 0x7fce880cdea0 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce88158530 con 0x7fce880cdea0 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce7ffff640 1 -- 172.21.15.40:0/2053976476 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78004510 con 0x7fce880cdea0 2023-11-04T01:44:08.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce88158af0 con 0x7fce880cdea0 2023-11-04T01:44:08.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce7ffff640 1 -- 172.21.15.40:0/2053976476 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce78003a70 con 0x7fce880cdea0 2023-11-04T01:44:08.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce7ffff640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce680664a0 0x7fce68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce7ffff640 1 -- 172.21.15.40:0/2053976476 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fce780842a0 con 0x7fce880cdea0 2023-11-04T01:44:08.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce877fe640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce680664a0 0x7fce68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce9131e000 1 Processor -- start 2023-11-04T01:44:08.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.041+0000 7fce9131e000 1 -- start start 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce680664a0 0x7fce68068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fce700ae000 tx=0x7fce70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b20dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b2090600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b2090f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b1f5b460 con 0x5652b20dcfa0 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b1eec690 con 0x5652b2090b40 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652b1ee9bc0 con 0x5652b20dd8c0 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b20dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b20dd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58800/0 (socket says 172.21.15.40:58800) 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/4093233420 learned_addr learned my addr 172.21.15.40:0/4093233420 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce86ffd640 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b2090600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce87fff640 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b2090f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 msgr2=0x5652b2090600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b2090600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 msgr2=0x5652b2090f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b2090f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/4093233420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652b1bdd890 con 0x5652b20dcfa0 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b20dd380 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fce70000c10 tx=0x7fce700a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfea54f023371531 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce7d7fa640 1 -- 172.21.15.40:0/4093233420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700b3ac0 con 0x5652b20dcfa0 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce7d7fa640 1 -- 172.21.15.40:0/4093233420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700bb040 con 0x5652b20dcfa0 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce7d7fa640 1 -- 172.21.15.40:0/4093233420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700b3e40 con 0x5652b20dcfa0 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- 172.21.15.40:0/4093233420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 msgr2=0x5652b20dd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b20dd380 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fce70000c10 tx=0x7fce700a7000 comp rx=0 tx=0).stop 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- 172.21.15.40:0/4093233420 shutdown_connections 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b2090f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b2090600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- 172.21.15.40:0/4093233420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b20dd380 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- 172.21.15.40:0/4093233420 >> 172.21.15.40:0/4093233420 conn(0x5652b20bdd40 msgr2=0x5652b20c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- 172.21.15.40:0/4093233420 shutdown_connections 2023-11-04T01:44:08.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- 172.21.15.40:0/4093233420 wait complete. 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- start start 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 Processor -- start 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b2096a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dcfa0 0x5652b2096f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b1ee54b0 con 0x5652b2090b40 2023-11-04T01:44:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b1e9daa0 con 0x5652b20dcfa0 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652b1ea3940 con 0x5652b20dd8c0 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce9131e000 10 client.0 _ll_register_callbacks cb 0x5652b207e460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b2096a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b2096a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58808/0 (socket says 172.21.15.40:58808) 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/2348778432 learned_addr learned my addr 172.21.15.40:0/2348778432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dcfa0 0x5652b2096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce87fff640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 msgr2=0x5652b20974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dcfa0 msgr2=0x5652b2096f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dcfa0 0x5652b2096f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce877fe640 1 -- 172.21.15.40:0/2348778432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce880cabe0 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.045+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dcfa0 0x5652b2096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce877fe640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b2096a40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fce70000c10 tx=0x7fce7001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c433af10a9896603 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 1 -- 172.21.15.40:0/2348778432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700b3ac0 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 1 -- 172.21.15.40:0/2348778432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fce700a7070 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652b1ea2e10 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 1 -- 172.21.15.40:0/2348778432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce700b3c20 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 10 client.7497 fetch_fsmap learned FSMap version 60 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5652b1ea61a0 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 1 -- 172.21.15.40:0/2348778432 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652b1ea2e10 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 1 -- 172.21.15.40:0/2348778432 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 60) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fce700be070 con 0x5652b2090b40 2023-11-04T01:44:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 10 client.7497 fetch_fsmap finished waiting for FSMap version 60 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 10 client.7497 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 20 client.7497 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b2097d90 0x5652b20ee720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 4 client.7497 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652b1ee3e00 con 0x5652b2097d90 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b2097d90 0x5652b20ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b2097d90 0x5652b20ee720 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac0f6c2f20d41044 server_cookie=3ebda98e3097b259 in_seq=0 out_seq=0 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 10 client.7497 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 1 -- 172.21.15.40:0/2348778432 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5652b1ee3e00 con 0x5652b2097d90 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 10 client.7497 handle_command_reply: tid=0 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 client.7497 shutdown 2023-11-04T01:44:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 msgr2=0x5652b2096a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b2096a40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fce70000c10 tx=0x7fce7001ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 shutdown_connections 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b2097d90 0x5652b20ee720 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dcfa0 0x5652b2096f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 --2- 172.21.15.40:0/2348778432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b2096a40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce667fc640 0 client.7497 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 >> 172.21.15.40:0/2348778432 conn(0x5652b20bdd40 msgr2=0x5652b20c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 shutdown_connections 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 1 -- 172.21.15.40:0/2348778432 wait complete. 2023-11-04T01:44:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.049+0000 7fce9131e000 20 client.7497 trim_cache size 0 max 16384 2023-11-04T01:44:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 Processor -- start 2023-11-04T01:44:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- start start 2023-11-04T01:44:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b208ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b208f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20db050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b1b9e940 con 0x5652b20dcfa0 2023-11-04T01:44:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b2093ce0 con 0x5652b2090b40 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652b1f25830 con 0x5652b20dd8c0 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b208f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b208f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58818/0 (socket says 172.21.15.40:58818) 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 -- 172.21.15.40:0/2882938839 learned_addr learned my addr 172.21.15.40:0/2882938839 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce877fe640 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b208ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce87fff640 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 -- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 msgr2=0x5652b20db050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20db050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 -- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 msgr2=0x5652b208ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b208ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 -- 172.21.15.40:0/2882938839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652b1e8c4a0 con 0x5652b20dcfa0 2023-11-04T01:44:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce877fe640 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b208ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce86ffd640 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b208f2a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fce78051420 tx=0x7fce7805b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110e8c52e0035c24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce7dffb640 1 -- 172.21.15.40:0/2882938839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78053060 con 0x5652b20dcfa0 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce7dffb640 1 -- 172.21.15.40:0/2882938839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7805b0b0 con 0x5652b20dcfa0 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce7dffb640 1 -- 172.21.15.40:0/2882938839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78003d20 con 0x5652b20dcfa0 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- 172.21.15.40:0/2882938839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 msgr2=0x5652b208f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b208f2a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fce78051420 tx=0x7fce7805b040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- 172.21.15.40:0/2882938839 shutdown_connections 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dd8c0 0x5652b20db050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b20dcfa0 0x5652b208f2a0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 --2- 172.21.15.40:0/2882938839 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b2090b40 0x5652b208ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- 172.21.15.40:0/2882938839 >> 172.21.15.40:0/2882938839 conn(0x5652b20bdd40 msgr2=0x5652b2095e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- 172.21.15.40:0/2882938839 shutdown_connections 2023-11-04T01:44:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.065+0000 7fce9131e000 1 -- 172.21.15.40:0/2882938839 wait complete. 2023-11-04T01:44:08.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- start start 2023-11-04T01:44:08.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 Processor -- start 2023-11-04T01:44:08.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b20efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dcfa0 0x5652b20fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dd8c0 0x5652b20fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b20f3410 con 0x5652b2090b40 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652b2090a00 con 0x5652b20dd8c0 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652b1e68460 con 0x5652b20dcfa0 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 10 client.0 _ll_register_callbacks cb 0x7fce700096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b20efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b20efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58828/0 (socket says 172.21.15.40:58828) 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 -- 172.21.15.40:0/47100275 learned_addr learned my addr 172.21.15.40:0/47100275 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce86ffd640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dcfa0 0x5652b20fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce87fff640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dd8c0 0x5652b20fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 -- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dcfa0 msgr2=0x5652b20fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dcfa0 0x5652b20fa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 -- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dd8c0 msgr2=0x5652b20fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dd8c0 0x5652b20fa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 -- 172.21.15.40:0/47100275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce88158af0 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce877fe640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b20efb60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fce70008010 tx=0x7fce700b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dcc639a94469b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 1 -- 172.21.15.40:0/47100275 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70003ab0 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 1 -- 172.21.15.40:0/47100275 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fce70003c10 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652b1eafd10 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 1 -- 172.21.15.40:0/47100275 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce70003dd0 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 10 client.7503 fetch_fsmap learned FSMap version 60 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5652b1bddcc0 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 1 -- 172.21.15.40:0/47100275 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652b1eafd10 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 1 -- 172.21.15.40:0/47100275 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 60) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fce700be040 con 0x5652b2090b40 2023-11-04T01:44:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 10 client.7503 fetch_fsmap finished waiting for FSMap version 60 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 10 client.7503 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 20 client.7503 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b213d6c0 0x5652b213daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 4 client.7503 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5652b1ede490 con 0x5652b213d6c0 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce86ffd640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b213d6c0 0x5652b213daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 10 client.7503 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce86ffd640 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b213d6c0 0x5652b213daa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a830efd628e28f92 server_cookie=11adebb09be1c64e in_seq=0 out_seq=0 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 1 -- 172.21.15.40:0/47100275 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5652b1ede490 con 0x5652b213d6c0 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 10 client.7503 handle_command_reply: tid=0 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 client.7503 shutdown 2023-11-04T01:44:08.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 msgr2=0x5652b20efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b20efb60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fce70008010 tx=0x7fce700b5040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 shutdown_connections 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5652b213d6c0 0x5652b213daa0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5652b20dd8c0 0x5652b20fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5652b20dcfa0 0x5652b20fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 --2- 172.21.15.40:0/47100275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652b2090b40 0x5652b20efb60 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce667fc640 0 client.7503 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 >> 172.21.15.40:0/47100275 conn(0x5652b20bdd40 msgr2=0x5652b2098170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 shutdown_connections 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 1 -- 172.21.15.40:0/47100275 wait complete. 2023-11-04T01:44:08.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.069+0000 7fce9131e000 20 client.7503 trim_cache size 0 max 16384 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7068, 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 36.798500124999997, 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 60, 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 94, 2023-11-04T01:44:08.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 94, 2023-11-04T01:44:08.085 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 57.991046556999997 2023-11-04T01:44:08.085 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:44:08.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce680664a0 msgr2=0x7fce68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce680664a0 0x7fce68068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fce700ae000 tx=0x7fce70008040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 msgr2=0x7fce88155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 0x7fce88155a40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fce7800c7f0 tx=0x7fce7800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 shutdown_connections 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fce680664a0 0x7fce68068960 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fce8815a1f0 0x7fce880b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce880cdea0 0x7fce88155a40 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 --2- 172.21.15.40:0/2053976476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fce880ca400 0x7fce881592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 >> 172.21.15.40:0/2053976476 conn(0x7fce880cebb0 msgr2=0x7fce8815b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 shutdown_connections 2023-11-04T01:44:08.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.073+0000 7fce8e1f1640 1 -- 172.21.15.40:0/2053976476 wait complete. 2023-11-04T01:44:08.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 Processor -- start 2023-11-04T01:44:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 -- start start 2023-11-04T01:44:08.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240b4990 0x7f4e240b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4e240d0690 0x7f4e240cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e240d0ae0 0x7f4e240cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240b6070 con 0x7f4e240d0ae0 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240b8ed0 con 0x7f4e240d0690 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e28e17640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240b52b0 con 0x7f4e240b4990 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e240d0ae0 0x7f4e240cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e240d0ae0 0x7f4e240cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58834/0 (socket says 172.21.15.40:58834) 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 -- 172.21.15.40:0/3641346706 learned_addr learned my addr 172.21.15.40:0/3641346706 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e21d9b640 1 --2- 172.21.15.40:0/3641346706 >> v2:172.21.15.91:3300/0 conn(0x7f4e240d0690 0x7f4e240cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e2259c640 1 --2- 172.21.15.40:0/3641346706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240b4990 0x7f4e240b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 -- 172.21.15.40:0/3641346706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240b4990 msgr2=0x7f4e240b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 --2- 172.21.15.40:0/3641346706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240b4990 0x7f4e240b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 -- 172.21.15.40:0/3641346706 >> v2:172.21.15.91:3300/0 conn(0x7f4e240d0690 msgr2=0x7f4e240cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 --2- 172.21.15.40:0/3641346706 >> v2:172.21.15.91:3300/0 conn(0x7f4e240d0690 0x7f4e240cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.201+0000 7f4e22d9d640 1 -- 172.21.15.40:0/3641346706 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240d1ce0 con 0x7f4e240d0ae0 2023-11-04T01:44:08.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e22d9d640 1 --2- 172.21.15.40:0/3641346706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0ae0 0x7f4e240cdcb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4e24066d30 tx=0x7f4e1c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6800a86268c7d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e2159a640 1 -- 172.21.15.40:0/3641346706 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0af400 con 0x7f4e240d0ae0 2023-11-04T01:44:08.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e2159a640 1 -- 172.21.15.40:0/3641346706 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c0ab050 con 0x7f4e240d0ae0 2023-11-04T01:44:08.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e2159a640 1 -- 172.21.15.40:0/3641346706 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0af780 con 0x7f4e240d0ae0 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- 172.21.15.40:0/3641346706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0ae0 msgr2=0x7f4e240cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3641346706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0ae0 0x7f4e240cdcb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4e24066d30 tx=0x7f4e1c01f1c0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- 172.21.15.40:0/3641346706 shutdown_connections 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3641346706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0ae0 0x7f4e240cdcb0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3641346706 >> v2:172.21.15.91:3300/0 conn(0x7f4e240d0690 0x7f4e240cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3641346706 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240b4990 0x7f4e240b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- 172.21.15.40:0/3641346706 >> 172.21.15.40:0/3641346706 conn(0x7f4e240cf990 msgr2=0x7f4e240cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- 172.21.15.40:0/3641346706 shutdown_connections 2023-11-04T01:44:08.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- 172.21.15.40:0/3641346706 wait complete. 2023-11-04T01:44:08.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 Processor -- start 2023-11-04T01:44:08.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- start start 2023-11-04T01:44:08.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e240b4990 0x7f4e2415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 0x7f4e240a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240d0ae0 0x7f4e241f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240aa150 con 0x7f4e240d0690 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2415fe60 con 0x7f4e240b4990 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e28e17640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2415f5c0 con 0x7f4e240d0ae0 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 0x7f4e240a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 0x7f4e240a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58842/0 (socket says 172.21.15.40:58842) 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 -- 172.21.15.40:0/3220672046 learned_addr learned my addr 172.21.15.40:0/3220672046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e22d9d640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240d0ae0 0x7f4e241f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e2259c640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e240b4990 0x7f4e2415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 -- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240d0ae0 msgr2=0x7f4e241f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240d0ae0 0x7f4e241f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 -- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e240b4990 msgr2=0x7f4e2415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e240b4990 0x7f4e2415ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 -- 172.21.15.40:0/3220672046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c009b30 con 0x7f4e240d0690 2023-11-04T01:44:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.205+0000 7f4e21d9b640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 0x7f4e240a9c10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800d7d0 tx=0x7f4e1800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800b6c0 con 0x7f4e240d0690 2023-11-04T01:44:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800b820 con 0x7f4e240d0690 2023-11-04T01:44:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2415f8a0 con 0x7f4e240d0690 2023-11-04T01:44:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800bbb0 con 0x7f4e240d0690 2023-11-04T01:44:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e241f3900 con 0x7f4e240d0690 2023-11-04T01:44:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e241f3a90 con 0x7f4e240d0690 2023-11-04T01:44:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e1800bd10 con 0x7f4e240d0690 2023-11-04T01:44:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e12ffd640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4e040664a0 0x7f4e04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f4e18084790 con 0x7f4e240d0690 2023-11-04T01:44:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e2259c640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4e040664a0 0x7f4e04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.209+0000 7f4e2259c640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4e040664a0 0x7f4e04068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ca740 tx=0x7f4e14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.213+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e180517e0 con 0x7f4e240d0690 2023-11-04T01:44:08.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.405+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e240744a0 con 0x7f4e240d0690 2023-11-04T01:44:08.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.405+0000 7f4e12ffd640 1 -- 172.21.15.40:0/3220672046 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f4e18054e00 con 0x7f4e240d0690 2023-11-04T01:44:08.413 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:08.413 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:04.297759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:08.413 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 60 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4e040664a0 msgr2=0x7f4e04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4e040664a0 0x7f4e04068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ca740 tx=0x7f4e14008040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 msgr2=0x7f4e240a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 0x7f4e240a9c10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800d7d0 tx=0x7f4e1800dc90 comp rx=0 tx=0).stop 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 shutdown_connections 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4e040664a0 0x7f4e04068960 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4e240d0ae0 0x7f4e241f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e240d0690 0x7f4e240a9c10 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 --2- 172.21.15.40:0/3220672046 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e240b4990 0x7f4e2415ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 >> 172.21.15.40:0/3220672046 conn(0x7f4e240cf990 msgr2=0x7f4e240b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 shutdown_connections 2023-11-04T01:44:08.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.409+0000 7f4e28e17640 1 -- 172.21.15.40:0/3220672046 wait complete. 2023-11-04T01:44:08.432 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:44:08.574 INFO:teuthology.orchestra.run.smithi091.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:44.122618+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:44:08.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:44.122618+0000" } ] } 2023-11-04T01:44:08.575 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:44:08.575 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-04T01:44:08.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:08.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e09e54640 1 Processor -- start 2023-11-04T01:44:08.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e09e54640 1 -- start start 2023-11-04T01:44:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e09e54640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e040d0ae0 0x7f0e040b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e09e54640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e040b6070 con 0x7f0e040d0690 2023-11-04T01:44:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e09e54640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e040b8ed0 con 0x7f0e040b4990 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e09e54640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e040d1ce0 con 0x7f0e040d0ae0 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0dfbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0e040d0690 0x7f0e040b64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39228/0 (socket says 172.21.15.40:39228) 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0dfbfff640 1 -- 172.21.15.40:0/210299927 learned_addr learned my addr 172.21.15.40:0/210299927 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e03fff640 1 --2- 172.21.15.40:0/210299927 >> v2:172.21.15.40:3300/0 conn(0x7f0e040d0ae0 0x7f0e040b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e02ffd640 1 -- 172.21.15.40:0/210299927 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333777523 0 0) 0x7f0e040b6070 con 0x7f0e040d0690 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e02ffd640 1 -- 172.21.15.40:0/210299927 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0df0003530 con 0x7f0e040d0690 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e03fff640 1 -- 172.21.15.40:0/210299927 >> v1:172.21.15.91:6789/0 conn(0x7f0e040b4990 legacy=0x7f0e040b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e03fff640 1 -- 172.21.15.40:0/210299927 >> v1:172.21.15.40:6789/0 conn(0x7f0e040d0690 legacy=0x7f0e040b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.701+0000 7f0e03fff640 1 -- 172.21.15.40:0/210299927 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e040d1fc0 con 0x7f0e040d0ae0 2023-11-04T01:44:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e03fff640 1 --2- 172.21.15.40:0/210299927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040d0ae0 0x7f0e040b6bf0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba3f053c15f86d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e02ffd640 1 -- 172.21.15.40:0/210299927 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0af600 con 0x7f0e040d0ae0 2023-11-04T01:44:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e02ffd640 1 -- 172.21.15.40:0/210299927 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0ab050 con 0x7f0e040d0ae0 2023-11-04T01:44:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e02ffd640 1 -- 172.21.15.40:0/210299927 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0af980 con 0x7f0e040d0ae0 2023-11-04T01:44:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- 172.21.15.40:0/210299927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040d0ae0 msgr2=0x7f0e040b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 --2- 172.21.15.40:0/210299927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040d0ae0 0x7f0e040b6bf0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009d90 tx=0x7f0dfc01f130 comp rx=0 tx=0).stop 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- 172.21.15.40:0/210299927 shutdown_connections 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 --2- 172.21.15.40:0/210299927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040d0ae0 0x7f0e040b6bf0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- 172.21.15.40:0/210299927 >> 172.21.15.40:0/210299927 conn(0x7f0e040cf990 msgr2=0x7f0e040cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- 172.21.15.40:0/210299927 shutdown_connections 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- 172.21.15.40:0/210299927 wait complete. 2023-11-04T01:44:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 Processor -- start 2023-11-04T01:44:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- start start 2023-11-04T01:44:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 0x7f0e0414e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e040d0690 0x7f0e041f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e040d0ae0 0x7f0e040cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0415d4d0 con 0x7f0e040b4990 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e041f3090 con 0x7f0e040d0690 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0415d720 con 0x7f0e040d0ae0 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 0x7f0e0414e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 0x7f0e0414e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58850/0 (socket says 172.21.15.40:58850) 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 -- 172.21.15.40:0/1261037460 learned_addr learned my addr 172.21.15.40:0/1261037460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e040d0690 0x7f0e041f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e03fff640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e040d0ae0 0x7f0e040cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 -- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e040d0ae0 msgr2=0x7f0e040cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e040d0ae0 0x7f0e040cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 -- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e040d0690 msgr2=0x7f0e041f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e040d0690 0x7f0e041f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 -- 172.21.15.40:0/1261037460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009a70 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e037fe640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 0x7f0e0414e450 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0df400c3c0 tx=0x7f0df400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40052d0 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4005430 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0415da00 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.705+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4003840 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0415dfc0 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e040cd380 con 0x7f0e040b4990 2023-11-04T01:44:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0df40039a0 con 0x7f0e040b4990 2023-11-04T01:44:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0e00ff9640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0de40664a0 0x7f0de4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f0df4083c90 con 0x7f0e040b4990 2023-11-04T01:44:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0de40664a0 0x7f0de4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.709+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0de40664a0 0x7f0de4068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0e040b6f20 tx=0x7f0dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.713+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0df4050cc0 con 0x7f0e040b4990 2023-11-04T01:44:08.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.893+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e040744a0 con 0x7f0e040b4990 2023-11-04T01:44:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e00ff9640 1 -- 172.21.15.40:0/1261037460 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f0df40542e0 con 0x7f0e040b4990 2023-11-04T01:44:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:08.902 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:04.297759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 60 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0de40664a0 msgr2=0x7f0de4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0de40664a0 0x7f0de4068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0e040b6f20 tx=0x7f0dec009040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 msgr2=0x7f0e0414e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 0x7f0e0414e450 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0df400c3c0 tx=0x7f0df400c880 comp rx=0 tx=0).stop 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 shutdown_connections 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0de40664a0 0x7f0de4068960 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0e040d0ae0 0x7f0e040cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0e040d0690 0x7f0e041f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 --2- 172.21.15.40:0/1261037460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e040b4990 0x7f0e0414e450 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 >> 172.21.15.40:0/1261037460 conn(0x7f0e040cf990 msgr2=0x7f0e040b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 shutdown_connections 2023-11-04T01:44:08.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:08.897+0000 7f0e09e54640 1 -- 172.21.15.40:0/1261037460 wait complete. 2023-11-04T01:44:08.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:44:09.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.037+0000 7f97fe883640 1 Processor -- start 2023-11-04T01:44:09.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.037+0000 7f97fe883640 1 -- start start 2023-11-04T01:44:09.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fe883640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fe883640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f97f80b0510 0x7f97f80b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fe883640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80cae10 con 0x7f97f80b3d90 2023-11-04T01:44:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fe883640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80cb3d0 con 0x7f97f80b0510 2023-11-04T01:44:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fe883640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80b0ee0 con 0x7f97f80b4170 2023-11-04T01:44:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f97f80b0510 0x7f97f80b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97f77fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f97f80b0510 0x7f97f80b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:55596/0 (socket says 172.21.15.40:55596) 2023-11-04T01:44:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97f7fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f97f80b3d90 0x7f97f80ca500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:53126/0 (socket says 172.21.15.40:53126) 2023-11-04T01:44:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 -- 172.21.15.40:0/493541059 learned_addr learned my addr 172.21.15.40:0/493541059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 -- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 msgr2=0x7f97f80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 --2- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f80cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 -- 172.21.15.40:0/493541059 >> v1:172.21.15.91:6789/0 conn(0x7f97f80b3d90 legacy=0x7f97f80ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 -- 172.21.15.40:0/493541059 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80cb0f0 con 0x7f97f80b0510 2023-11-04T01:44:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97fce20640 1 --2- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f80b09a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009e50 tx=0x7f97f001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8820c2fe1d6e053 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97f6ffd640 1 -- 172.21.15.40:0/493541059 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a58a0 con 0x7f97f80b0510 2023-11-04T01:44:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97f6ffd640 1 -- 172.21.15.40:0/493541059 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f00a5a00 con 0x7f97f80b0510 2023-11-04T01:44:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.041+0000 7f97f6ffd640 1 -- 172.21.15.40:0/493541059 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a5d90 con 0x7f97f80b0510 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 msgr2=0x7f97f80b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 --2- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f80b09a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009e50 tx=0x7f97f001c9e0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- 172.21.15.40:0/493541059 shutdown_connections 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 --2- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f80b09a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 --2- 172.21.15.40:0/493541059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- 172.21.15.40:0/493541059 >> 172.21.15.40:0/493541059 conn(0x7f97f80cb510 msgr2=0x7f97f80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- 172.21.15.40:0/493541059 shutdown_connections 2023-11-04T01:44:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- 172.21.15.40:0/493541059 wait complete. 2023-11-04T01:44:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 Processor -- start 2023-11-04T01:44:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- start start 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f8156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 0x7f97f80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c4a50 con 0x7f97f80b3d90 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8156f10 con 0x7f97f80b0510 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fe883640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c40b0 con 0x7f97f80b4170 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 0x7f97f80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 0x7f97f80c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58856/0 (socket says 172.21.15.40:58856) 2023-11-04T01:44:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 -- 172.21.15.40:0/743286370 learned_addr learned my addr 172.21.15.40:0/743286370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f7fff640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f8156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97fce20640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 -- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 msgr2=0x7f97f81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 -- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 msgr2=0x7f97f8156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f8156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 -- 172.21.15.40:0/743286370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0009b30 con 0x7f97f80b3d90 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.045+0000 7f97f77fe640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 0x7f97f80c77c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e870 tx=0x7f97ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec009510 con 0x7f97f80b3d90 2023-11-04T01:44:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00eec0 con 0x7f97f80b3d90 2023-11-04T01:44:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f80c4390 con 0x7f97f80b3d90 2023-11-04T01:44:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00cb40 con 0x7f97f80b3d90 2023-11-04T01:44:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f80c7d00 con 0x7f97f80b3d90 2023-11-04T01:44:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f80ad730 con 0x7f97f80b3d90 2023-11-04T01:44:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97ec00cca0 con 0x7f97f80b3d90 2023-11-04T01:44:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f4ff9640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97e40664d0 0x7f97e4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f97ec0844b0 con 0x7f97f80b3d90 2023-11-04T01:44:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f7fff640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97e40664d0 0x7f97e4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.049+0000 7f97f7fff640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97e40664d0 0x7f97e4068990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000f70 tx=0x7f97e8007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.053+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97ec0513d0 con 0x7f97f80b3d90 2023-11-04T01:44:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.257+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f97f80744a0 con 0x7f97f80b3d90 2023-11-04T01:44:09.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.957+0000 7f97f4ff9640 1 -- 172.21.15.40:0/743286370 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6316 v61) v1 ==== 112+0+0 (secure 0 0 0) 0x7f97ec0549f0 con 0x7f97f80b3d90 2023-11-04T01:44:09.966 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.6316 2023-11-04T01:44:09.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97e40664d0 msgr2=0x7f97e4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97e40664d0 0x7f97e4068990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000f70 tx=0x7f97e8007cd0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 msgr2=0x7f97f80c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 0x7f97f80c77c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e870 tx=0x7f97ec00ec70 comp rx=0 tx=0).stop 2023-11-04T01:44:09.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 shutdown_connections 2023-11-04T01:44:09.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97e40664d0 0x7f97e4068990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f80b4170 0x7f97f81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f80b3d90 0x7f97f80c77c0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 --2- 172.21.15.40:0/743286370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f80b0510 0x7f97f8156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 >> 172.21.15.40:0/743286370 conn(0x7f97f80cb510 msgr2=0x7f97f80b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 shutdown_connections 2023-11-04T01:44:09.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:09.961+0000 7f97fe883640 1 -- 172.21.15.40:0/743286370 wait complete. 2023-11-04T01:44:09.989 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:44:10.129 INFO:teuthology.orchestra.run.smithi091.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:44:10.130 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:44:10.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:10.130 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-04T01:44:10.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:44:10.146 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7efc215e3640 time 2023-11-04T01:44:10.146706+0000 2023-11-04T01:44:10.146 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc2d71bfae] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.147 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:44:10.144+0000 7efc215e3640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7efc215e3640 time 2023-11-04T01:44:10.146706+0000 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc2d71bfae] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.148 INFO:tasks.ceph.mds.b.smithi091.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7efc215e3640 thread_name:MR_Finisher 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc2d056520] 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:44:10.149 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc2d71c008] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:44:10.144+0000 7efc215e3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:10.150 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7efc215e3640 thread_name:MR_Finisher 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc2d056520] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc2d71c008] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.151 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.152 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.152 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.152 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:10.152 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.153 INFO:tasks.ceph.mds.b.smithi091.stderr: -507> 2023-11-04T01:44:06.084+0000 7efc24dea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:10.153 INFO:tasks.ceph.mds.b.smithi091.stderr: -505> 2023-11-04T01:44:06.084+0000 7efc24dea640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: -1> 2023-11-04T01:44:10.144+0000 7efc215e3640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7efc215e3640 time 2023-11-04T01:44:10.146706+0000 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc2d71bfae] 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.154 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 0> 2023-11-04T01:44:10.144+0000 7efc215e3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7efc215e3640 thread_name:MR_Finisher 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc2d056520] 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:44:10.155 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc2d71c008] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:10.156 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.158 INFO:tasks.ceph.mds.b.smithi091.stderr: -507> 2023-11-04T01:44:06.084+0000 7efc24dea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:10.158 INFO:tasks.ceph.mds.b.smithi091.stderr: -505> 2023-11-04T01:44:06.084+0000 7efc24dea640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:10.159 INFO:tasks.ceph.mds.b.smithi091.stderr: -1> 2023-11-04T01:44:10.144+0000 7efc215e3640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7efc215e3640 time 2023-11-04T01:44:10.146706+0000 2023-11-04T01:44:10.159 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:10.159 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.159 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.159 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc2d71bfae] 2023-11-04T01:44:10.159 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 0> 2023-11-04T01:44:10.144+0000 7efc215e3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7efc215e3640 thread_name:MR_Finisher 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc2d056520] 2023-11-04T01:44:10.160 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc2d71c008] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7efc2d71c162] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55dc769304c5] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55dc7696508c] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55dc769654bc] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55dc769655f3] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7efc2d7c2305] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7efc2d0a8b43] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7efc2d13aa00] 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:10.161 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:44:10.314 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:44:10.314 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:44:10.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec52715640 1 Processor -- start 2023-11-04T01:44:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec52715640 1 -- start start 2023-11-04T01:44:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec52715640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fec4c0d0ae0 0x7fec4c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec52715640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c0b6070 con 0x7fec4c0d0690 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec52715640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c0b8ed0 con 0x7fec4c0b4990 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec52715640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c0d1ce0 con 0x7fec4c0d0ae0 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec437fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fec4c0d0690 0x7fec4c0b64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39238/0 (socket says 172.21.15.40:39238) 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec437fe640 1 -- 172.21.15.40:0/3985468864 learned_addr learned my addr 172.21.15.40:0/3985468864 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec50cb2640 1 --2- 172.21.15.40:0/3985468864 >> v2:172.21.15.91:3300/0 conn(0x7fec4c0d0ae0 0x7fec4c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76984513 0 0) 0x7fec4c0b6070 con 0x7fec4c0d0690 2023-11-04T01:44:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec38003530 con 0x7fec4c0d0690 2023-11-04T01:44:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735463775 0 0) 0x7fec38003530 con 0x7fec4c0d0690 2023-11-04T01:44:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 >> v2:172.21.15.91:3300/0 conn(0x7fec4c0d0ae0 msgr2=0x7fec4c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 --2- 172.21.15.40:0/3985468864 >> v2:172.21.15.91:3300/0 conn(0x7fec4c0d0ae0 0x7fec4c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 >> v1:172.21.15.91:6789/0 conn(0x7fec4c0b4990 legacy=0x7fec4c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0d1fc0 con 0x7fec4c0d0690 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fec34001680 con 0x7fec4c0d0690 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 >> v1:172.21.15.40:6789/0 conn(0x7fec4c0d0690 legacy=0x7fec4c0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec380047d0 0x7fec38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec38005190 0x7fec3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0d1ce0 con 0x7fec38003980 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3800c040 con 0x7fec38005190 2023-11-04T01:44:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3800c200 con 0x7fec380047d0 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4bfff640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4bfff640 1 -- 172.21.15.40:0/3985468864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec380047d0 msgr2=0x7fec38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4bfff640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec380047d0 0x7fec38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4bfff640 1 -- 172.21.15.40:0/3985468864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec38005190 msgr2=0x7fec3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4bfff640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec38005190 0x7fec3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec4bfff640 1 -- 172.21.15.40:0/3985468864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38003530 con 0x7fec38003980 2023-11-04T01:44:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.429+0000 7fec50cb2640 1 -- 172.21.15.40:0/3985468864 reap_dead start 2023-11-04T01:44:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec4bfff640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec38003da0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fec3c001780 tx=0x7fec3c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f63b9dc7b22a72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0052d0 con 0x7fec38003980 2023-11-04T01:44:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c0a7050 con 0x7fec38003980 2023-11-04T01:44:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec4b7fe640 1 -- 172.21.15.40:0/3985468864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c003600 con 0x7fec38003980 2023-11-04T01:44:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 -- 172.21.15.40:0/3985468864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 msgr2=0x7fec38003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec38003da0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fec3c001780 tx=0x7fec3c01c3e0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 -- 172.21.15.40:0/3985468864 shutdown_connections 2023-11-04T01:44:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 --2- 172.21.15.40:0/3985468864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec38003da0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 -- 172.21.15.40:0/3985468864 >> 172.21.15.40:0/3985468864 conn(0x7fec4c0cf990 msgr2=0x7fec4c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 -- 172.21.15.40:0/3985468864 shutdown_connections 2023-11-04T01:44:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 -- 172.21.15.40:0/3985468864 wait complete. 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 Processor -- start 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.433+0000 7fec52715640 1 -- start start 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec4c1f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec4c0b1760 0x7fec4c15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec4c0d3100 0x7fec4c0d3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0d3ac0 con 0x7fec38003980 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c160480 con 0x7fec4c0b1760 2023-11-04T01:44:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1f6790 con 0x7fec4c0d3100 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec4c1f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec4c1f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58880/0 (socket says 172.21.15.40:58880) 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 -- 172.21.15.40:0/718177411 learned_addr learned my addr 172.21.15.40:0/718177411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec50cb2640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec4c0d3100 0x7fec4c0d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec437fe640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec4c0b1760 0x7fec4c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 -- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec4c0d3100 msgr2=0x7fec4c0d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec4c0d3100 0x7fec4c0d3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 -- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec4c0b1760 msgr2=0x7fec4c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec4c0b1760 0x7fec4c15f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 -- 172.21.15.40:0/718177411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c15fec0 con 0x7fec38003980 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec4bfff640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec4c1f6f50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fec3c01c210 tx=0x7fec38005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c007500 con 0x7fec38003980 2023-11-04T01:44:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c007680 con 0x7fec38003980 2023-11-04T01:44:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c1601a0 con 0x7fec38003980 2023-11-04T01:44:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c006a20 con 0x7fec38003980 2023-11-04T01:44:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c1f7490 con 0x7fec38003980 2023-11-04T01:44:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c0744a0 con 0x7fec38003980 2023-11-04T01:44:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec3c006b80 con 0x7fec38003980 2023-11-04T01:44:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec497fa640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec2c0664d0 0x7fec2c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fec3c11e5b0 con 0x7fec38003980 2023-11-04T01:44:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.437+0000 7fec437fe640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec2c0664d0 0x7fec2c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.441+0000 7fec437fe640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec2c0664d0 0x7fec2c068990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fec34001830 tx=0x7fec340015a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.441+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec3c0eb600 con 0x7fec38003980 2023-11-04T01:44:10.570 INFO:tasks.ceph.mds.b.smithi091.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:44:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.633+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec4c160690 con 0x7fec38003980 2023-11-04T01:44:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.633+0000 7fec497fa640 1 -- 172.21.15.40:0/718177411 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fec3c0eec20 con 0x7fec38003980 2023-11-04T01:44:10.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:10.641 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:09.265090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:10.642 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 61 2023-11-04T01:44:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec2c0664d0 msgr2=0x7fec2c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec2c0664d0 0x7fec2c068990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fec34001830 tx=0x7fec340015a0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 msgr2=0x7fec4c1f6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec4c1f6f50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fec3c01c210 tx=0x7fec38005800 comp rx=0 tx=0).stop 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 shutdown_connections 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec2c0664d0 0x7fec2c068990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec4c0d3100 0x7fec4c0d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec4c0b1760 0x7fec4c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 --2- 172.21.15.40:0/718177411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec38003980 0x7fec4c1f6f50 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 >> 172.21.15.40:0/718177411 conn(0x7fec4c0cf990 msgr2=0x7fec4c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 shutdown_connections 2023-11-04T01:44:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:10.637+0000 7fec52715640 1 -- 172.21.15.40:0/718177411 wait complete. 2023-11-04T01:44:10.661 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:15.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:15.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:44:15.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed0daf6640 1 Processor -- start 2023-11-04T01:44:15.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed0daf6640 1 -- start start 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed0daf6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fed080d0b10 0x7fed0815d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed0daf6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed080d2280 con 0x7fed080b49c0 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed0daf6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed080d2560 con 0x7fed0815d240 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed0daf6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed080d2840 con 0x7fed080d0b10 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fed080b49c0 0x7fed080b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39240/0 (socket says 172.21.15.40:39240) 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 -- 172.21.15.40:0/2717280776 learned_addr learned my addr 172.21.15.40:0/2717280776 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed06ffd640 1 --2- 172.21.15.40:0/2717280776 >> v2:172.21.15.91:3300/0 conn(0x7fed080d0b10 0x7fed0815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705534323 0 0) 0x7fed080d2280 con 0x7fed080b49c0 2023-11-04T01:44:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece8003530 con 0x7fed080b49c0 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 365359623 0 0) 0x7fece8003530 con 0x7fed080b49c0 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 >> v2:172.21.15.91:3300/0 conn(0x7fed080d0b10 msgr2=0x7fed0815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 --2- 172.21.15.40:0/2717280776 >> v2:172.21.15.91:3300/0 conn(0x7fed080d0b10 0x7fed0815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 >> v1:172.21.15.91:6789/0 conn(0x7fed0815d240 legacy=0x7fed080d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080b66c0 con 0x7fed080b49c0 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fecf8001680 con 0x7fed080b49c0 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 >> v1:172.21.15.40:6789/0 conn(0x7fed080b49c0 legacy=0x7fed080b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece8003980 0x7fece8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fece80047d0 0x7fece8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fece800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080d2840 con 0x7fece8005190 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece800c030 con 0x7fece8003980 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece800c1f0 con 0x7fece80047d0 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fece800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed06ffd640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fece80047d0 0x7fece8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed077fe640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece8003980 0x7fece8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 -- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fece80047d0 msgr2=0x7fece8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fece80047d0 0x7fece8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 -- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece8003980 msgr2=0x7fece8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece8003980 0x7fece8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed07fff640 1 -- 172.21.15.40:0/2717280776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8003530 con 0x7fece8005190 2023-11-04T01:44:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.789+0000 7fed077fe640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fece8003980 0x7fece8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed07fff640 1 -- 172.21.15.40:0/2717280776 reap_dead start 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed07fff640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fece800b990 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c240 tx=0x7fecf801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bf7df2fad07a80 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80a5b40 con 0x7fece8005190 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80a5ce0 con 0x7fece8005190 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed067fc640 1 -- 172.21.15.40:0/2717280776 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8005b20 con 0x7fece8005190 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 -- 172.21.15.40:0/2717280776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 msgr2=0x7fece800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fece800b990 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c240 tx=0x7fecf801cc40 comp rx=0 tx=0).stop 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 -- 172.21.15.40:0/2717280776 shutdown_connections 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 --2- 172.21.15.40:0/2717280776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fece800b990 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 -- 172.21.15.40:0/2717280776 >> 172.21.15.40:0/2717280776 conn(0x7fed080cf9c0 msgr2=0x7fed080cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 -- 172.21.15.40:0/2717280776 shutdown_connections 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 -- 172.21.15.40:0/2717280776 wait complete. 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 Processor -- start 2023-11-04T01:44:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.793+0000 7fed0daf6640 1 -- start start 2023-11-04T01:44:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fed0815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed080cafc0 0x7fed080cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed080cbe90 0x7fed081f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080cc2f0 con 0x7fece8005190 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080ce240 con 0x7fed080cafc0 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed080cd390 con 0x7fed080cbe90 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fed0815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fed0815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58892/0 (socket says 172.21.15.40:58892) 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 -- 172.21.15.40:0/4149349370 learned_addr learned my addr 172.21.15.40:0/4149349370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed06ffd640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed080cafc0 0x7fed080cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed07fff640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed080cbe90 0x7fed081f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 -- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed080cbe90 msgr2=0x7fed081f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed080cbe90 0x7fed081f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 -- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed080cafc0 msgr2=0x7fed080cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed080cafc0 0x7fed080cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 -- 172.21.15.40:0/4149349370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080cd630 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed07fff640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed080cbe90 0x7fed081f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed077fe640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fed0815a5d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fecf000e480 tx=0x7fecf000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00052e0 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0005440 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0003820 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed080cd910 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed080cded0 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed080675f0 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecf0003980 con 0x7fece8005190 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fecfffff640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fecec0664a0 0x7fecec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fecf00840b0 con 0x7fece8005190 2023-11-04T01:44:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.797+0000 7fed06ffd640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fecec0664a0 0x7fecec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.801+0000 7fed06ffd640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fecec0664a0 0x7fecec068960 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fed0815f880 tx=0x7fed0000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.801+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fecf0051060 con 0x7fece8005190 2023-11-04T01:44:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed080b5ec0 con 0x7fece8005190 2023-11-04T01:44:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fecfffff640 1 -- 172.21.15.40:0/4149349370 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fecf0054680 con 0x7fece8005190 2023-11-04T01:44:15.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:15.999 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:09.265090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 61 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fecec0664a0 msgr2=0x7fecec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fecec0664a0 0x7fecec068960 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fed0815f880 tx=0x7fed0000b040 comp rx=0 tx=0).stop 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 msgr2=0x7fed0815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fed0815a5d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fecf000e480 tx=0x7fecf000e940 comp rx=0 tx=0).stop 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 shutdown_connections 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fecec0664a0 0x7fecec068960 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fed080cbe90 0x7fed081f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fed080cafc0 0x7fed080cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 --2- 172.21.15.40:0/4149349370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece8005190 0x7fed0815a5d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 >> 172.21.15.40:0/4149349370 conn(0x7fed080cf9c0 msgr2=0x7fed0815c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 shutdown_connections 2023-11-04T01:44:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:15.993+0000 7fed0daf6640 1 -- 172.21.15.40:0/4149349370 wait complete. 2023-11-04T01:44:16.018 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:21.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.145+0000 7f696a9d4640 1 Processor -- start 2023-11-04T01:44:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.145+0000 7f696a9d4640 1 -- start start 2023-11-04T01:44:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f696a9d4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69640c9960 0x7f69640cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f696a9d4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69640b0c70 0x7f69640ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f696a9d4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640ce320 con 0x7f69640b0890 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f696a9d4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696406d2f0 con 0x7f69640b0c70 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f696a9d4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640ce110 con 0x7f69640c9960 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69640b0c70 0x7f69640ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69640b0c70 0x7f69640ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35330/0 (socket says 172.21.15.40:35330) 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 -- 172.21.15.40:0/3638664232 learned_addr learned my addr 172.21.15.40:0/3638664232 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f69637fe640 1 --2- 172.21.15.40:0/3638664232 >> v2:172.21.15.91:3300/0 conn(0x7f69640c9960 0x7f69640cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 -- 172.21.15.40:0/3638664232 >> v2:172.21.15.91:3300/0 conn(0x7f69640c9960 msgr2=0x7f69640cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 --2- 172.21.15.40:0/3638664232 >> v2:172.21.15.91:3300/0 conn(0x7f69640c9960 0x7f69640cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 -- 172.21.15.40:0/3638664232 >> v1:172.21.15.91:6789/0 conn(0x7f69640b0890 legacy=0x7f69640704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:21.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 -- 172.21.15.40:0/3638664232 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640ce600 con 0x7f69640b0c70 2023-11-04T01:44:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6968f71640 1 --2- 172.21.15.40:0/3638664232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f69640ccf90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6964070050 tx=0x7f695c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff2f14a4db3a3ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6962ffd640 1 -- 172.21.15.40:0/3638664232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0a5820 con 0x7f69640b0c70 2023-11-04T01:44:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6962ffd640 1 -- 172.21.15.40:0/3638664232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0a5980 con 0x7f69640b0c70 2023-11-04T01:44:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.149+0000 7f6962ffd640 1 -- 172.21.15.40:0/3638664232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0a5d10 con 0x7f69640b0c70 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3638664232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 msgr2=0x7f69640ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3638664232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f69640ccf90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6964070050 tx=0x7f695c01c960 comp rx=0 tx=0).stop 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3638664232 shutdown_connections 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3638664232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f69640ccf90 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3638664232 >> v2:172.21.15.91:3300/0 conn(0x7f69640c9960 0x7f69640cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3638664232 >> 172.21.15.40:0/3638664232 conn(0x7f69640cebb0 msgr2=0x7f69640cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3638664232 shutdown_connections 2023-11-04T01:44:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3638664232 wait complete. 2023-11-04T01:44:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 Processor -- start 2023-11-04T01:44:21.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- start start 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69640b0890 0x7f6964157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f6964164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640c9960 0x7f69641570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696415f9e0 con 0x7f69640b0c70 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696415fca0 con 0x7f69640c9960 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696415ff80 con 0x7f69640b0890 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f6964164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f6964164960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35332/0 (socket says 172.21.15.40:35332) 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 -- 172.21.15.40:0/3868538508 learned_addr learned my addr 172.21.15.40:0/3868538508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f6968f71640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640c9960 0x7f69641570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f6963fff640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69640b0890 0x7f6964157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 -- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69640b0890 msgr2=0x7f6964157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69640b0890 0x7f6964157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 -- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640c9960 msgr2=0x7f69641570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640c9960 0x7f69641570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 -- 172.21.15.40:0/3868538508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c009b30 con 0x7f69640b0c70 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f69637fe640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f6964164960 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f695800d800 tx=0x7f695800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800b6c0 con 0x7f69640b0c70 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695800b860 con 0x7f69640b0c70 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6964160260 con 0x7f69640b0c70 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800bc10 con 0x7f69640b0c70 2023-11-04T01:44:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.153+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69641575e0 con 0x7f69640b0c70 2023-11-04T01:44:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.157+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69640c40d0 con 0x7f69640b0c70 2023-11-04T01:44:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.157+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f695801e460 con 0x7f69640b0c70 2023-11-04T01:44:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.157+0000 7f6960ff9640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69500664a0 0x7f6950068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.157+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f69580849f0 con 0x7f69640b0c70 2023-11-04T01:44:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.157+0000 7f6963fff640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69500664a0 0x7f6950068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.157+0000 7f6963fff640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69500664a0 0x7f6950068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f695400b810 tx=0x7f6954008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.161+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69640c40d0 con 0x7f69640b0c70 2023-11-04T01:44:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.349+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69640c40d0 con 0x7f69640b0c70 2023-11-04T01:44:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.349+0000 7f6960ff9640 1 -- 172.21.15.40:0/3868538508 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f69640c40d0 con 0x7f69640b0c70 2023-11-04T01:44:21.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:09.265090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 61 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69500664a0 msgr2=0x7f6950068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69500664a0 0x7f6950068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f695400b810 tx=0x7f6954008040 comp rx=0 tx=0).stop 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 msgr2=0x7f6964164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f6964164960 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f695800d800 tx=0x7f695800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 shutdown_connections 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69500664a0 0x7f6950068960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640c9960 0x7f69641570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69640b0c70 0x7f6964164960 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 --2- 172.21.15.40:0/3868538508 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69640b0890 0x7f6964157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 >> 172.21.15.40:0/3868538508 conn(0x7f69640cebb0 msgr2=0x7f696415dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 shutdown_connections 2023-11-04T01:44:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:21.353+0000 7f696a9d4640 1 -- 172.21.15.40:0/3868538508 wait complete. 2023-11-04T01:44:21.374 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:22.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:44:26.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 Processor -- start 2023-11-04T01:44:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 -- start start 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8e015afd0 0x7fa8e00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e00b0d40 0x7fa8e015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00c2670 con 0x7fa8e006f8f0 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e0070140 con 0x7fa8e015afd0 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e6b1b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e006c9f0 con 0x7fa8e00b0d40 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e48b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8e015afd0 0x7fa8e00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e48b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8e015afd0 0x7fa8e00715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35334/0 (socket says 172.21.15.40:35334) 2023-11-04T01:44:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e48b7640 1 -- 172.21.15.40:0/3091166509 learned_addr learned my addr 172.21.15.40:0/3091166509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e50b8640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e00b0d40 0x7fa8e015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.505+0000 7fa8e48b7640 1 -- 172.21.15.40:0/3091166509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e00b0d40 msgr2=0x7fa8e015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e48b7640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e00b0d40 0x7fa8e015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e48b7640 1 -- 172.21.15.40:0/3091166509 >> v1:172.21.15.40:6789/0 conn(0x7fa8e006f8f0 legacy=0x7fa8e00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e48b7640 1 -- 172.21.15.40:0/3091166509 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e006bc30 con 0x7fa8e015afd0 2023-11-04T01:44:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e50b8640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e00b0d40 0x7fa8e015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e48b7640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e00715d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009e50 tx=0x7fa8d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db926f6d67815ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8df7fe640 1 -- 172.21.15.40:0/3091166509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80a58a0 con 0x7fa8e015afd0 2023-11-04T01:44:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8df7fe640 1 -- 172.21.15.40:0/3091166509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d80a5a00 con 0x7fa8e015afd0 2023-11-04T01:44:26.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8df7fe640 1 -- 172.21.15.40:0/3091166509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80a5d90 con 0x7fa8e015afd0 2023-11-04T01:44:26.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/3091166509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 msgr2=0x7fa8e00715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e00715d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009e50 tx=0x7fa8d801c9e0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/3091166509 shutdown_connections 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e00b0d40 0x7fa8e015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/3091166509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e00715d0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/3091166509 >> 172.21.15.40:0/3091166509 conn(0x7fa8e00cebb0 msgr2=0x7fa8e00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/3091166509 shutdown_connections 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.509+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/3091166509 wait complete. 2023-11-04T01:44:26.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 Processor -- start 2023-11-04T01:44:26.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- start start 2023-11-04T01:44:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e006f8f0 0x7fa8e00c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8e00b0d40 0x7fa8e00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e0140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00c7860 con 0x7fa8e015afd0 2023-11-04T01:44:26.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00ad860 con 0x7fa8e00b0d40 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00c7e00 con 0x7fa8e006f8f0 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e0140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e0140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35346/0 (socket says 172.21.15.40:35346) 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 -- 172.21.15.40:0/1459821881 learned_addr learned my addr 172.21.15.40:0/1459821881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e48b7640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e006f8f0 0x7fa8e00c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8dffff640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8e00b0d40 0x7fa8e00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 -- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e006f8f0 msgr2=0x7fa8e00c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e006f8f0 0x7fa8e00c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 -- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8e00b0d40 msgr2=0x7fa8e00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8e00b0d40 0x7fa8e00ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 -- 172.21.15.40:0/1459821881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8009b30 con 0x7fa8e015afd0 2023-11-04T01:44:26.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e50b8640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e0140c40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c7f0 tx=0x7fa8d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0007820 con 0x7fa8e015afd0 2023-11-04T01:44:26.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d0007980 con 0x7fa8e015afd0 2023-11-04T01:44:26.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e00ad2a0 con 0x7fa8e015afd0 2023-11-04T01:44:26.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0007d70 con 0x7fa8e015afd0 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e00c7a90 con 0x7fa8e015afd0 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e00c7fb0 con 0x7fa8e015afd0 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8d00113f0 con 0x7fa8e015afd0 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.513+0000 7fa8dd7fa640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8cc0664a0 0x7fa8cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.517+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7fa8d0084610 con 0x7fa8e015afd0 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.517+0000 7fa8e48b7640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8cc0664a0 0x7fa8cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.517+0000 7fa8e48b7640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8cc0664a0 0x7fa8cc068960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80ae000 tx=0x7fa8d80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.521+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8e00c7fb0 con 0x7fa8e015afd0 2023-11-04T01:44:26.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.713+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8e00c7f70 con 0x7fa8e015afd0 2023-11-04T01:44:26.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.713+0000 7fa8dd7fa640 1 -- 172.21.15.40:0/1459821881 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fa8d0051660 con 0x7fa8e015afd0 2023-11-04T01:44:26.719 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:26.719 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:09.265090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:26.720 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 61 2023-11-04T01:44:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.713+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8cc0664a0 msgr2=0x7fa8cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.713+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8cc0664a0 0x7fa8cc068960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80ae000 tx=0x7fa8d80a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:26.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 msgr2=0x7fa8e0140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e0140c40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000c7f0 tx=0x7fa8d000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 shutdown_connections 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8cc0664a0 0x7fa8cc068960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8e015afd0 0x7fa8e0140c40 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8e00b0d40 0x7fa8e00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 --2- 172.21.15.40:0/1459821881 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8e006f8f0 0x7fa8e00c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 >> 172.21.15.40:0/1459821881 conn(0x7fa8e00cebb0 msgr2=0x7fa8e00c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 shutdown_connections 2023-11-04T01:44:26.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:26.717+0000 7fa8e6b1b640 1 -- 172.21.15.40:0/1459821881 wait complete. 2023-11-04T01:44:26.739 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:27.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:27.542 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:28.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:44:31.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e03b43640 1 Processor -- start 2023-11-04T01:44:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e03b43640 1 -- start start 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e03b43640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8dfc0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e03b43640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc15b360 con 0x7f8dfc15af80 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e03b43640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc071880 con 0x7f8dfc06ace0 2023-11-04T01:44:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e03b43640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc071b60 con 0x7f8dfc0b1e10 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8dfc15af80 0x7f8dfc0b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50968/0 (socket says 172.21.15.40:50968) 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 -- 172.21.15.40:0/2304376752 learned_addr learned my addr 172.21.15.40:0/2304376752 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e010de640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8dfc0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507674562 0 0) 0x7f8dfc15b360 con 0x7f8dfc15af80 2023-11-04T01:44:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de8003530 con 0x7f8dfc15af80 2023-11-04T01:44:31.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064171884 0 0) 0x7f8de8003530 con 0x7f8dfc15af80 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 msgr2=0x7f8dfc0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8dfc0ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 >> v1:172.21.15.91:6789/0 conn(0x7f8dfc06ace0 legacy=0x7f8dfc15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc06a200 con 0x7f8dfc15af80 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8df8001680 con 0x7f8dfc15af80 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 >> v1:172.21.15.40:6789/0 conn(0x7f8dfc15af80 legacy=0x7f8dfc0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80039b0 0x7f8de8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80047d0 0x7f8de8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8de80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc071b60 con 0x7f8de80039b0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de800bb20 con 0x7f8de80047d0 2023-11-04T01:44:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de800bcb0 con 0x7f8dfc0b1e10 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80039b0 0x7f8de8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e010de640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80047d0 0x7f8de8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e020e0640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8de80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 -- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 msgr2=0x7f8de80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8de80051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 -- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80047d0 msgr2=0x7f8de8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80047d0 0x7f8de8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e018df640 1 -- 172.21.15.40:0/2304376752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8003530 con 0x7f8de80039b0 2023-11-04T01:44:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.873+0000 7f8e020e0640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc0b1e10 0x7f8de80051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e018df640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80039b0 0x7f8de8003dd0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8df800c270 tx=0x7f8df801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f79d65a11e9be9b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80a5af0 con 0x7f8de80039b0 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df80a5c50 con 0x7f8de80039b0 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e008dd640 1 -- 172.21.15.40:0/2304376752 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80058e0 con 0x7f8de80039b0 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 -- 172.21.15.40:0/2304376752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80039b0 msgr2=0x7f8de8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 --2- 172.21.15.40:0/2304376752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80039b0 0x7f8de8003dd0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8df800c270 tx=0x7f8df801cc10 comp rx=0 tx=0).stop 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e020e0640 1 -- 172.21.15.40:0/2304376752 reap_dead start 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 -- 172.21.15.40:0/2304376752 shutdown_connections 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 -- 172.21.15.40:0/2304376752 >> 172.21.15.40:0/2304376752 conn(0x7f8dfc06e760 msgr2=0x7f8dfc06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 -- 172.21.15.40:0/2304376752 shutdown_connections 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 -- 172.21.15.40:0/2304376752 wait complete. 2023-11-04T01:44:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 Processor -- start 2023-11-04T01:44:31.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.877+0000 7f8e03b43640 1 -- start start 2023-11-04T01:44:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80039b0 0x7f8dfc0b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 0x7f8dfc0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc159f40 0x7f8dfc0c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc154220 con 0x7f8dfc159ac0 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1647a0 con 0x7f8de80039b0 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc164a80 con 0x7f8dfc159f40 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 0x7f8dfc0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 0x7f8dfc0c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50976/0 (socket says 172.21.15.40:50976) 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 -- 172.21.15.40:0/4130177934 learned_addr learned my addr 172.21.15.40:0/4130177934 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e020e0640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc159f40 0x7f8dfc0c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e018df640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80039b0 0x7f8dfc0b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 -- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc159f40 msgr2=0x7f8dfc0c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc159f40 0x7f8dfc0c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 -- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80039b0 msgr2=0x7f8dfc0b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80039b0 0x7f8dfc0b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 -- 172.21.15.40:0/4130177934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc164d60 con 0x7f8dfc159ac0 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e020e0640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc159f40 0x7f8dfc0c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e018df640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80039b0 0x7f8dfc0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e010de640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 0x7f8dfc0c6c40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0115e0 tx=0x7f8dec011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00f8f0 con 0x7f8dfc159ac0 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec00fa50 con 0x7f8dfc159ac0 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc165040 con 0x7f8dfc159ac0 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00fdc0 con 0x7f8dfc159ac0 2023-11-04T01:44:31.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc165600 con 0x7f8dfc159ac0 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc0675f0 con 0x7f8dfc159ac0 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8dec015460 con 0x7f8dfc159ac0 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8df27fc640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de00664d0 0x7f8de0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f8dec084b80 con 0x7f8dfc159ac0 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.881+0000 7f8e018df640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de00664d0 0x7f8de0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.885+0000 7f8e018df640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de00664d0 0x7f8de0068990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ab000 tx=0x7f8df80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:31.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:31.885+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8dec051aa0 con 0x7f8dfc159ac0 2023-11-04T01:44:32.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dfc0c65f0 con 0x7f8dfc159ac0 2023-11-04T01:44:32.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8df27fc640 1 -- 172.21.15.40:0/4130177934 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4976 (secure 0 0 0) 0x7f8dec0550c0 con 0x7f8dfc159ac0 2023-11-04T01:44:32.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7440,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:27.955965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6316,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6316":{"gid":6316,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":17,"addr":"172.21.15.91:6837/3698962796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":3698962796},{"type":"v1","addr":"172.21.15.91:6837","nonce":3698962796}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:27.955965+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:32.087 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 62 2023-11-04T01:44:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de00664d0 msgr2=0x7f8de0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de00664d0 0x7f8de0068990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8df80ab000 tx=0x7f8df80a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 msgr2=0x7f8dfc0c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 0x7f8dfc0c6c40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0115e0 tx=0x7f8dec011aa0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 shutdown_connections 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8de00664d0 0x7f8de0068990 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8dfc159f40 0x7f8dfc0c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dfc159ac0 0x7f8dfc0c6c40 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 --2- 172.21.15.40:0/4130177934 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8de80039b0 0x7f8dfc0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.081+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 >> 172.21.15.40:0/4130177934 conn(0x7f8dfc06e760 msgr2=0x7f8dfc158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.085+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 shutdown_connections 2023-11-04T01:44:32.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.085+0000 7f8e03b43640 1 -- 172.21.15.40:0/4130177934 wait complete. 2023-11-04T01:44:32.107 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:44:32.107 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:32.121 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:32.122 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:32.122 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:32.212 INFO:teuthology.orchestra.run.smithi091.stdout:1699062250.44387.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:32.214 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062250.44387.core'] 2023-11-04T01:44:32.214 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062250.44387.core, deleting it 2023-11-04T01:44:32.214 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062250.44387.core 2023-11-04T01:44:32.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320884d640 1 Processor -- start 2023-11-04T01:44:32.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320884d640 1 -- start start 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320884d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32040b0d40 0x7f3204166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320884d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040c2670 con 0x7f320415afd0 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320884d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320406bc30 con 0x7f32040715d0 2023-11-04T01:44:32.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320884d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3204070140 con 0x7f32040b0d40 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f320415afd0 0x7f320406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50982/0 (socket says 172.21.15.40:50982) 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320259c640 1 -- 172.21.15.40:0/488767505 learned_addr learned my addr 172.21.15.40:0/488767505 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f3202d9d640 1 --2- 172.21.15.40:0/488767505 >> v2:172.21.15.40:3300/0 conn(0x7f32040b0d40 0x7f3204166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320159a640 1 -- 172.21.15.40:0/488767505 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947000663 0 0) 0x7f32040c2670 con 0x7f320415afd0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f320159a640 1 -- 172.21.15.40:0/488767505 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ec003530 con 0x7f320415afd0 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f3202d9d640 1 -- 172.21.15.40:0/488767505 >> v1:172.21.15.91:6789/0 conn(0x7f32040715d0 legacy=0x7f32040b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f3202d9d640 1 -- 172.21.15.40:0/488767505 >> v1:172.21.15.40:6789/0 conn(0x7f320415afd0 legacy=0x7f320406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.401+0000 7f3202d9d640 1 -- 172.21.15.40:0/488767505 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320406bf10 con 0x7f32040b0d40 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f3202d9d640 1 --2- 172.21.15.40:0/488767505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f3204166010 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009d90 tx=0x7f31fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ca203338e814e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320159a640 1 -- 172.21.15.40:0/488767505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0a5810 con 0x7f32040b0d40 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320159a640 1 -- 172.21.15.40:0/488767505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc0a5970 con 0x7f32040b0d40 2023-11-04T01:44:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320159a640 1 -- 172.21.15.40:0/488767505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0a5ce0 con 0x7f32040b0d40 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 -- 172.21.15.40:0/488767505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 msgr2=0x7f3204166010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 --2- 172.21.15.40:0/488767505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f3204166010 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009d90 tx=0x7f31fc01c950 comp rx=0 tx=0).stop 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 -- 172.21.15.40:0/488767505 shutdown_connections 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 --2- 172.21.15.40:0/488767505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f3204166010 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 -- 172.21.15.40:0/488767505 >> 172.21.15.40:0/488767505 conn(0x7f32040cebb0 msgr2=0x7f32040cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 -- 172.21.15.40:0/488767505 shutdown_connections 2023-11-04T01:44:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 -- 172.21.15.40:0/488767505 wait complete. 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 Processor -- start 2023-11-04T01:44:32.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.405+0000 7f320884d640 1 -- start start 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32040715d0 0x7f320415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f320414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f320415afd0 0x7f32040ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320415fc90 con 0x7f32040b0d40 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32041571e0 con 0x7f32040715d0 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c7e80 con 0x7f320415afd0 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f320414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f320414e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50994/0 (socket says 172.21.15.40:50994) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 -- 172.21.15.40:0/1247223019 learned_addr learned my addr 172.21.15.40:0/1247223019 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320259c640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32040715d0 0x7f320415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3202d9d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f320415afd0 0x7f32040ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 -- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f320415afd0 msgr2=0x7f32040ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f320415afd0 0x7f32040ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 -- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32040715d0 msgr2=0x7f320415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32040715d0 0x7f320415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 -- 172.21.15.40:0/1247223019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc009a70 con 0x7f32040b0d40 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320259c640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32040715d0 0x7f320415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f3201d9b640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f320414e1c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c370 tx=0x7f31f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40052d0 con 0x7f32040b0d40 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4005430 con 0x7f32040b0d40 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040c8160 con 0x7f32040b0d40 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4007260 con 0x7f32040b0d40 2023-11-04T01:44:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320414e700 con 0x7f32040b0d40 2023-11-04T01:44:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32040744a0 con 0x7f32040b0d40 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31f40073c0 con 0x7f32040b0d40 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f31f2ffd640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664d0 0x7f31e4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6915+0+0 (secure 0 0 0) 0x7f31f4083680 con 0x7f32040b0d40 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.409+0000 7f320259c640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664d0 0x7f31e4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.413+0000 7f320259c640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664d0 0x7f31e4068990 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f31f80011f0 tx=0x7f31f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.413+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31f4050640 con 0x7f32040b0d40 2023-11-04T01:44:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.625+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f32040c8610 con 0x7f32040b0d40 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.629+0000 7f31f2ffd640 1 -- 172.21.15.40:0/1247223019 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6316 v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f31f4053c60 con 0x7f32040b0d40 2023-11-04T01:44:32.636 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 6316 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664d0 msgr2=0x7f31e4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664d0 0x7f31e4068990 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f31f80011f0 tx=0x7f31f8009040 comp rx=0 tx=0).stop 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 msgr2=0x7f320414e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f320414e1c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c370 tx=0x7f31f400c830 comp rx=0 tx=0).stop 2023-11-04T01:44:32.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 shutdown_connections 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31e40664d0 0x7f31e4068990 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f320415afd0 0x7f32040ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32040b0d40 0x7f320414e1c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 --2- 172.21.15.40:0/1247223019 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32040715d0 0x7f320415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 >> 172.21.15.40:0/1247223019 conn(0x7f32040cebb0 msgr2=0x7f32040c30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 shutdown_connections 2023-11-04T01:44:32.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.633+0000 7f320884d640 1 -- 172.21.15.40:0/1247223019 wait complete. 2023-11-04T01:44:32.659 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:44:32.659 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:44:32.659 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:44:32.659 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:32.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:32.660 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:44:32.660 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:44:32.660 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:44:32.663 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:44:32.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:32.736 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 Processor -- start 2023-11-04T01:44:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 -- start start 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2b000ae650 0x7f2b000ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b000aea30 0x7f2b000cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b000cc6b0 con 0x7f2b00072350 2023-11-04T01:44:32.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000cf4c0 con 0x7f2b000aea30 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b07187640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000cd700 con 0x7f2b000ae650 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b000aea30 0x7f2b000cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b000aea30 0x7f2b000cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51004/0 (socket says 172.21.15.40:51004) 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 -- 172.21.15.40:0/3661483293 learned_addr learned my addr 172.21.15.40:0/3661483293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b04f23640 1 --2- 172.21.15.40:0/3661483293 >> v2:172.21.15.91:3300/0 conn(0x7f2b000ae650 0x7f2b000ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 -- 172.21.15.40:0/3661483293 >> v2:172.21.15.91:3300/0 conn(0x7f2b000ae650 msgr2=0x7f2b000ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 --2- 172.21.15.40:0/3661483293 >> v2:172.21.15.91:3300/0 conn(0x7f2b000ae650 0x7f2b000ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 -- 172.21.15.40:0/3661483293 >> v1:172.21.15.91:6789/0 conn(0x7f2b00072350 legacy=0x7f2b000ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.765+0000 7f2b05724640 1 -- 172.21.15.40:0/3661483293 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000cc900 con 0x7f2b000aea30 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b05724640 1 --2- 172.21.15.40:0/3661483293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b000aea30 0x7f2b000cf950 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2b0006fe50 tx=0x7f2af801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8dc4d560b48735 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2aff7fe640 1 -- 172.21.15.40:0/3661483293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a5740 con 0x7f2b000aea30 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2aff7fe640 1 -- 172.21.15.40:0/3661483293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af80a58a0 con 0x7f2b000aea30 2023-11-04T01:44:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2aff7fe640 1 -- 172.21.15.40:0/3661483293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a5c30 con 0x7f2b000aea30 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- 172.21.15.40:0/3661483293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b000aea30 msgr2=0x7f2b000cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 --2- 172.21.15.40:0/3661483293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b000aea30 0x7f2b000cf950 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2b0006fe50 tx=0x7f2af801c880 comp rx=0 tx=0).stop 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- 172.21.15.40:0/3661483293 shutdown_connections 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 --2- 172.21.15.40:0/3661483293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b000aea30 0x7f2b000cf950 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 --2- 172.21.15.40:0/3661483293 >> v2:172.21.15.91:3300/0 conn(0x7f2b000ae650 0x7f2b000ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- 172.21.15.40:0/3661483293 >> 172.21.15.40:0/3661483293 conn(0x7f2b000716a0 msgr2=0x7f2b00071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- 172.21.15.40:0/3661483293 shutdown_connections 2023-11-04T01:44:32.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- 172.21.15.40:0/3661483293 wait complete. 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 Processor -- start 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- start start 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 0x7f2b00156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b000ae650 0x7f2b001555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b000aea30 0x7f2b00153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00155b00 con 0x7f2b00072350 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0015b540 con 0x7f2b000ae650 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b07187640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0015b820 con 0x7f2b000aea30 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 0x7f2b00156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 0x7f2b00156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51008/0 (socket says 172.21.15.40:51008) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 -- 172.21.15.40:0/540591176 learned_addr learned my addr 172.21.15.40:0/540591176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2afffff640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b000ae650 0x7f2b001555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b05724640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b000aea30 0x7f2b00153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 -- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b000aea30 msgr2=0x7f2b00153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b000aea30 0x7f2b00153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 -- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b000ae650 msgr2=0x7f2b001555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b000ae650 0x7f2b001555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 -- 172.21.15.40:0/540591176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009b30 con 0x7f2b00072350 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2afffff640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b000ae650 0x7f2b001555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2b04f23640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 0x7f2b00156350 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2af000d5f0 tx=0x7f2af000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.769+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00125f0 con 0x7f2b00072350 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0012750 con 0x7f2b00072350 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0015bb00 con 0x7f2b00072350 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0012b00 con 0x7f2b00072350 2023-11-04T01:44:32.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0015c0c0 con 0x7f2b00072350 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b000675f0 con 0x7f2b00072350 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2af0012c60 con 0x7f2b00072350 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afd7fa640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2aec0664a0 0x7f2aec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:32.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f2af00848e0 con 0x7f2b00072350 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afffff640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2aec0664a0 0x7f2aec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:32.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.773+0000 7f2afffff640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2aec0664a0 0x7f2aec068960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2b00156890 tx=0x7f2af4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:32.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.777+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2af0051860 con 0x7f2b00072350 2023-11-04T01:44:32.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.965+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b00070540 con 0x7f2b00072350 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.965+0000 7f2afd7fa640 1 -- 172.21.15.40:0/540591176 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4136 (secure 0 0 0) 0x7f2af0054e80 con 0x7f2b00072350 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:32.640993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:replay","state_seq":1,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:32.972 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 64 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2aec0664a0 msgr2=0x7f2aec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2aec0664a0 0x7f2aec068960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2b00156890 tx=0x7f2af4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 msgr2=0x7f2b00156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 0x7f2b00156350 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2af000d5f0 tx=0x7f2af000dab0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 shutdown_connections 2023-11-04T01:44:32.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2aec0664a0 0x7f2aec068960 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b000aea30 0x7f2b00153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b000ae650 0x7f2b001555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 --2- 172.21.15.40:0/540591176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b00072350 0x7f2b00156350 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 >> 172.21.15.40:0/540591176 conn(0x7f2b000716a0 msgr2=0x7f2b000b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 shutdown_connections 2023-11-04T01:44:32.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:32.969+0000 7f2b07187640 1 -- 172.21.15.40:0/540591176 wait complete. 2023-11-04T01:44:32.992 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:44:35.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:44:37.299 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:44:37.297+0000 7fdfd3ec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:37.299 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:44:37.297+0000 7fdfd3ec6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:37.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 Processor -- start 2023-11-04T01:44:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 -- start start 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb3680715d0 0x7fb3680b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3680b0b70 0x7fb36815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680c2670 con 0x7fb36815afd0 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb368070140 con 0x7fb3680b0b70 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb37070d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb368071a60 con 0x7fb3680715d0 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3680b0b70 0x7fb36815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3680b0b70 0x7fb36815ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35076/0 (socket says 172.21.15.40:35076) 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 -- 172.21.15.40:0/2682726786 learned_addr learned my addr 172.21.15.40:0/2682726786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36dca8640 1 --2- 172.21.15.40:0/2682726786 >> v2:172.21.15.91:3300/0 conn(0x7fb3680715d0 0x7fb3680b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 -- 172.21.15.40:0/2682726786 >> v2:172.21.15.91:3300/0 conn(0x7fb3680715d0 msgr2=0x7fb3680b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 --2- 172.21.15.40:0/2682726786 >> v2:172.21.15.91:3300/0 conn(0x7fb3680715d0 0x7fb3680b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 -- 172.21.15.40:0/2682726786 >> v1:172.21.15.91:6789/0 conn(0x7fb36815afd0 legacy=0x7fb36806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 -- 172.21.15.40:0/2682726786 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36806bc30 con 0x7fb3680b0b70 2023-11-04T01:44:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.125+0000 7fb36ecaa640 1 --2- 172.21.15.40:0/2682726786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36815ec80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ce900 tx=0x7fb36001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e00918996b8630 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36d4a7640 1 -- 172.21.15.40:0/2682726786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600a5690 con 0x7fb3680b0b70 2023-11-04T01:44:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36d4a7640 1 -- 172.21.15.40:0/2682726786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3600a57f0 con 0x7fb3680b0b70 2023-11-04T01:44:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36d4a7640 1 -- 172.21.15.40:0/2682726786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600a5b80 con 0x7fb3680b0b70 2023-11-04T01:44:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2682726786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 msgr2=0x7fb36815ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 --2- 172.21.15.40:0/2682726786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36815ec80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ce900 tx=0x7fb36001c9d0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2682726786 shutdown_connections 2023-11-04T01:44:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 --2- 172.21.15.40:0/2682726786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36815ec80 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 --2- 172.21.15.40:0/2682726786 >> v2:172.21.15.91:3300/0 conn(0x7fb3680715d0 0x7fb3680b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2682726786 >> 172.21.15.40:0/2682726786 conn(0x7fb3680cebb0 msgr2=0x7fb3680cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2682726786 shutdown_connections 2023-11-04T01:44:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2682726786 wait complete. 2023-11-04T01:44:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 Processor -- start 2023-11-04T01:44:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- start start 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3680715d0 0x7fb3680c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36814f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb36815afd0 0x7fb36815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3681512a0 con 0x7fb3680b0b70 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3681584c0 con 0x7fb3680715d0 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368150a00 con 0x7fb36815afd0 2023-11-04T01:44:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36814f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36814f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35090/0 (socket says 172.21.15.40:35090) 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 -- 172.21.15.40:0/2593169612 learned_addr learned my addr 172.21.15.40:0/2593169612 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36ecaa640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb36815afd0 0x7fb36815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36e4a9640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3680715d0 0x7fb3680c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 -- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb36815afd0 msgr2=0x7fb36815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb36815afd0 0x7fb36815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 -- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3680715d0 msgr2=0x7fb3680c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3680715d0 0x7fb3680c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 -- 172.21.15.40:0/2593169612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360009b30 con 0x7fb3680b0b70 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb36dca8640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36814f620 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00d5f0 tx=0x7fb35c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0125f0 con 0x7fb3680b0b70 2023-11-04T01:44:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c012750 con 0x7fb3680b0b70 2023-11-04T01:44:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368150ce0 con 0x7fb3680b0b70 2023-11-04T01:44:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c012b00 con 0x7fb3680b0b70 2023-11-04T01:44:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.129+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680c4120 con 0x7fb3680b0b70 2023-11-04T01:44:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.133+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb368158320 con 0x7fb3680b0b70 2023-11-04T01:44:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.133+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb35c012c60 con 0x7fb3680b0b70 2023-11-04T01:44:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.133+0000 7fb35affd640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb34c0664a0 0x7fb34c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.133+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb35c0848b0 con 0x7fb3680b0b70 2023-11-04T01:44:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.133+0000 7fb36e4a9640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb34c0664a0 0x7fb34c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.133+0000 7fb36e4a9640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb34c0664a0 0x7fb34c068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb364000f70 tx=0x7fb364009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.137+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb368158320 con 0x7fb3680b0b70 2023-11-04T01:44:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.325+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb368158320 con 0x7fb3680b0b70 2023-11-04T01:44:38.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.325+0000 7fb35affd640 1 -- 172.21.15.40:0/2593169612 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fb368158320 con 0x7fb3680b0b70 2023-11-04T01:44:38.332 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:38.332 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:35.672881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:38.332 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 68 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb34c0664a0 msgr2=0x7fb34c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb34c0664a0 0x7fb34c068960 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb364000f70 tx=0x7fb364009040 comp rx=0 tx=0).stop 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 msgr2=0x7fb36814f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36814f620 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00d5f0 tx=0x7fb35c00dab0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 shutdown_connections 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb34c0664a0 0x7fb34c068960 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb36815afd0 0x7fb36815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3680b0b70 0x7fb36814f620 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 --2- 172.21.15.40:0/2593169612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3680715d0 0x7fb3680c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 >> 172.21.15.40:0/2593169612 conn(0x7fb3680cebb0 msgr2=0x7fb3680af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 shutdown_connections 2023-11-04T01:44:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.329+0000 7fb37070d640 1 -- 172.21.15.40:0/2593169612 wait complete. 2023-11-04T01:44:38.349 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:44:38.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 Processor -- start 2023-11-04T01:44:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 -- start start 2023-11-04T01:44:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8e00d0690 0x7ff8e00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00d0ae0 0x7ff8e00b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e00b6070 con 0x7ff8e00b4990 2023-11-04T01:44:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00b8ed0 con 0x7ff8e00d0690 2023-11-04T01:44:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8e4a04640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00d1ce0 con 0x7ff8e00d0ae0 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8ded9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00d0ae0 0x7ff8e00b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8d7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8e00d0690 0x7ff8e00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8ded9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00d0ae0 0x7ff8e00b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8de59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7ff8e00b4990 0x7ff8e00b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:39660/0 (socket says 172.21.15.40:39660) 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8d7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff8e00d0690 0x7ff8e00b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:50774/0 (socket says 172.21.15.40:50774) 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8ded9d640 1 -- 172.21.15.40:0/1228254635 learned_addr learned my addr 172.21.15.40:0/1228254635 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8d7fff640 1 -- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00d0ae0 msgr2=0x7ff8e00b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8d7fff640 1 --2- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00d0ae0 0x7ff8e00b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8d7fff640 1 -- 172.21.15.40:0/1228254635 >> v1:172.21.15.91:6789/0 conn(0x7ff8e00b4990 legacy=0x7ff8e00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.453+0000 7ff8d7fff640 1 -- 172.21.15.40:0/1228254635 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00d1fc0 con 0x7ff8e00d0690 2023-11-04T01:44:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 --2- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0690 0x7ff8e00b64e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80097c0 tx=0x7ff8c801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f484eb58b2e445a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8ddd9b640 1 -- 172.21.15.40:0/1228254635 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80a8970 con 0x7ff8e00d0690 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8ddd9b640 1 -- 172.21.15.40:0/1228254635 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80a8ad0 con 0x7ff8e00d0690 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8ddd9b640 1 -- 172.21.15.40:0/1228254635 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80a8e60 con 0x7ff8e00d0690 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0690 msgr2=0x7ff8e00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0690 0x7ff8e00b64e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80097c0 tx=0x7ff8c801ec70 comp rx=0 tx=0).stop 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- 172.21.15.40:0/1228254635 shutdown_connections 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00d0ae0 0x7ff8e00b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/1228254635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0690 0x7ff8e00b64e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- 172.21.15.40:0/1228254635 >> 172.21.15.40:0/1228254635 conn(0x7ff8e00cf990 msgr2=0x7ff8e00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- 172.21.15.40:0/1228254635 shutdown_connections 2023-11-04T01:44:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- 172.21.15.40:0/1228254635 wait complete. 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 Processor -- start 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- start start 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00b4990 0x7ff8e01f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 0x7ff8e015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0ae0 0x7ff8e00aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e00aa9d0 con 0x7ff8e00d0690 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0160240 con 0x7ff8e00d0ae0 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8e4a04640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e01f3b20 con 0x7ff8e00b4990 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 0x7ff8e015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 0x7ff8e015b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35104/0 (socket says 172.21.15.40:35104) 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 -- 172.21.15.40:0/3287880854 learned_addr learned my addr 172.21.15.40:0/3287880854 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8ded9d640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0ae0 0x7ff8e00aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8de59c640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00b4990 0x7ff8e01f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 -- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00b4990 msgr2=0x7ff8e01f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00b4990 0x7ff8e01f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 -- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0ae0 msgr2=0x7ff8e00aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0ae0 0x7ff8e00aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8d7fff640 1 -- 172.21.15.40:0/3287880854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009420 con 0x7ff8e00d0690 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.457+0000 7ff8ded9d640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0ae0 0x7ff8e00aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d7fff640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 0x7ff8e015b5b0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff8c801c8a0 tx=0x7ff8c801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80b1e00 con 0x7ff8e00d0690 2023-11-04T01:44:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e00aae60 con 0x7ff8e00d0690 2023-11-04T01:44:38.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8006e20 con 0x7ff8e00d0690 2023-11-04T01:44:38.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80b9630 con 0x7ff8e00d0690 2023-11-04T01:44:38.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e00aa0a0 con 0x7ff8e00d0690 2023-11-04T01:44:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e00aab80 con 0x7ff8e00d0690 2023-11-04T01:44:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8c80b7040 con 0x7ff8e00d0690 2023-11-04T01:44:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d6ffd640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c00664a0 0x7ff8c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7ff8c81223f0 con 0x7ff8e00d0690 2023-11-04T01:44:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8de59c640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c00664a0 0x7ff8c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.461+0000 7ff8de59c640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c00664a0 0x7ff8c0068960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0000f70 tx=0x7ff8d0007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.465+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8e00aab80 con 0x7ff8e00d0690 2023-11-04T01:44:38.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.653+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8e00aab80 con 0x7ff8e00d0690 2023-11-04T01:44:38.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.653+0000 7ff8d6ffd640 1 -- 172.21.15.40:0/3287880854 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4928 (secure 0 0 0) 0x7ff8e00aab80 con 0x7ff8e00d0690 2023-11-04T01:44:38.660 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:38.660 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:35.672881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 68 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c00664a0 msgr2=0x7ff8c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c00664a0 0x7ff8c0068960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0000f70 tx=0x7ff8d0007cf0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 msgr2=0x7ff8e015b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 0x7ff8e015b5b0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff8c801c8a0 tx=0x7ff8c801ba10 comp rx=0 tx=0).stop 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 shutdown_connections 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff8c00664a0 0x7ff8c0068960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff8e00d0ae0 0x7ff8e00aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e00d0690 0x7ff8e015b5b0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 --2- 172.21.15.40:0/3287880854 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff8e00b4990 0x7ff8e01f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 >> 172.21.15.40:0/3287880854 conn(0x7ff8e00cf990 msgr2=0x7ff8e00b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 shutdown_connections 2023-11-04T01:44:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:38.657+0000 7ff8e4a04640 1 -- 172.21.15.40:0/3287880854 wait complete. 2023-11-04T01:44:39.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:44:35.672881+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 95, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7440, 'mds_1': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7068': {'gid': 7068, 'name': 'a', 'rank': 1, 'incarnation': 50, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.40:6833/960586799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 960586799}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 960586799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7440': {'gid': 7440, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.40:6835/1813470604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 1813470604}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 1813470604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:44:39.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:44:39.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:44:39.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa759d56640 1 Processor -- start 2023-11-04T01:44:39.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa759d56640 1 -- start start 2023-11-04T01:44:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa759d56640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa75415a1f0 0x7fa7540cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa759d56640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540ccee0 con 0x7fa7540b0d40 2023-11-04T01:44:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa759d56640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75415a5d0 con 0x7fa7540cdea0 2023-11-04T01:44:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa759d56640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540ca900 con 0x7fa75415a1f0 2023-11-04T01:44:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa753fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa7540b0d40 0x7fa7540704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47258/0 (socket says 172.21.15.40:47258) 2023-11-04T01:44:39.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa753fff640 1 -- 172.21.15.40:0/3737030960 learned_addr learned my addr 172.21.15.40:0/3737030960 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7537fe640 1 --2- 172.21.15.40:0/3737030960 >> v2:172.21.15.91:3300/0 conn(0x7fa75415a1f0 0x7fa7540cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616269432 0 0) 0x7fa7540ccee0 con 0x7fa7540b0d40 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c003530 con 0x7fa7540b0d40 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836785622 0 0) 0x7fa73c003530 con 0x7fa7540b0d40 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 >> v2:172.21.15.91:3300/0 conn(0x7fa75415a1f0 msgr2=0x7fa7540cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 --2- 172.21.15.40:0/3737030960 >> v2:172.21.15.91:3300/0 conn(0x7fa75415a1f0 0x7fa7540cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 >> v1:172.21.15.91:6789/0 conn(0x7fa7540cdea0 legacy=0x7fa7540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540cabe0 con 0x7fa7540b0d40 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fa744001680 con 0x7fa7540b0d40 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 >> v1:172.21.15.40:6789/0 conn(0x7fa7540b0d40 legacy=0x7fa7540704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa73c003980 0x7fa73c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa73c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa73c005190 0x7fa73c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540ca900 con 0x7fa73c0047d0 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c00c030 con 0x7fa73c003980 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c00c1f0 con 0x7fa73c005190 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa752ffd640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa73c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.209+0000 7fa7537fe640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa73c003980 0x7fa73c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa753fff640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa73c005190 0x7fa73c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa752ffd640 1 -- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa73c005190 msgr2=0x7fa73c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa752ffd640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa73c005190 0x7fa73c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa752ffd640 1 -- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa73c003980 msgr2=0x7fa73c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa752ffd640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa73c003980 0x7fa73c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa752ffd640 1 -- 172.21.15.40:0/3737030960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c003530 con 0x7fa73c0047d0 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa753fff640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa73c005190 0x7fa73c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:39.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa753fff640 1 -- 172.21.15.40:0/3737030960 reap_dead start 2023-11-04T01:44:39.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa752ffd640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa73c004c50 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa748001750 tx=0x7fa74801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11d9c6e399f3ad8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480052d0 con 0x7fa73c0047d0 2023-11-04T01:44:39.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7480a7050 con 0x7fa73c0047d0 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa7527fc640 1 -- 172.21.15.40:0/3737030960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748003600 con 0x7fa73c0047d0 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 -- 172.21.15.40:0/3737030960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 msgr2=0x7fa73c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa73c004c50 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa748001750 tx=0x7fa74801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 -- 172.21.15.40:0/3737030960 shutdown_connections 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 --2- 172.21.15.40:0/3737030960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa73c004c50 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 -- 172.21.15.40:0/3737030960 >> 172.21.15.40:0/3737030960 conn(0x7fa7540cebb0 msgr2=0x7fa7540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 -- 172.21.15.40:0/3737030960 shutdown_connections 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.213+0000 7fa759d56640 1 -- 172.21.15.40:0/3737030960 wait complete. 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 Processor -- start 2023-11-04T01:44:39.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 -- start start 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa7540c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7540c6ee0 0x7fa75406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7540b3210 0x7fa75415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c5bf0 con 0x7fa73c0047d0 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c8720 con 0x7fa7540c6ee0 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540c5e40 con 0x7fa7540b3210 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa7540c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa7540c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35122/0 (socket says 172.21.15.40:35122) 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 -- 172.21.15.40:0/1185148365 learned_addr learned my addr 172.21.15.40:0/1185148365 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 -- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7540b3210 msgr2=0x7fa75415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7540b3210 0x7fa75415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 -- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7540c6ee0 msgr2=0x7fa75406bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7540c6ee0 0x7fa75406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 -- 172.21.15.40:0/1185148365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540c6120 con 0x7fa73c0047d0 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa7537fe640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa7540c81e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007f30 tx=0x7fa74c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa73bfff640 1 -- 172.21.15.40:0/1185148365 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00e030 con 0x7fa73c0047d0 2023-11-04T01:44:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa73bfff640 1 -- 172.21.15.40:0/1185148365 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c016470 con 0x7fa73c0047d0 2023-11-04T01:44:39.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7540c6400 con 0x7fa73c0047d0 2023-11-04T01:44:39.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa73bfff640 1 -- 172.21.15.40:0/1185148365 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c016820 con 0x7fa73c0047d0 2023-11-04T01:44:39.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7540c69c0 con 0x7fa73c0047d0 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.217+0000 7fa73bfff640 1 -- 172.21.15.40:0/1185148365 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa74c016980 con 0x7fa73c0047d0 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa73bfff640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7400664a0 0x7fa740068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa73bfff640 1 -- 172.21.15.40:0/1185148365 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa74c00f070 con 0x7fa73c0047d0 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa752ffd640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7400664a0 0x7fa740068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 Processor -- start 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- start start 2023-11-04T01:44:39.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa752ffd640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7400664a0 0x7fa740068960 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa75406df00 tx=0x7fa748001130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d9371bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371bf8c0 0x55d937172600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d937172f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93703d460 con 0x55d9371befa0 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d936fce690 con 0x55d937172b40 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d936fcbbc0 con 0x55d9371bf8c0 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d9371bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d9371bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35126/0 (socket says 172.21.15.40:35126) 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 -- 172.21.15.40:0/1359160427 learned_addr learned my addr 172.21.15.40:0/1359160427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa752ffd640 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371bf8c0 0x55d937172600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa753fff640 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d937172f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 -- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371bf8c0 msgr2=0x55d937172600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371bf8c0 0x55d937172600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 -- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 msgr2=0x55d937172f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d937172f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 -- 172.21.15.40:0/1359160427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d936cbf890 con 0x55d9371befa0 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7537fe640 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d9371bf380 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0833a0 tx=0x7fa74c0560d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d028e6d919f8326 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7397fa640 1 -- 172.21.15.40:0/1359160427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c05aea0 con 0x55d9371befa0 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7397fa640 1 -- 172.21.15.40:0/1359160427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c0543b0 con 0x55d9371befa0 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa7397fa640 1 -- 172.21.15.40:0/1359160427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c052720 con 0x55d9371befa0 2023-11-04T01:44:39.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- 172.21.15.40:0/1359160427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 msgr2=0x55d9371bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d9371bf380 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0833a0 tx=0x7fa74c0560d0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- 172.21.15.40:0/1359160427 shutdown_connections 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d937172f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371bf8c0 0x55d937172600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 --2- 172.21.15.40:0/1359160427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d9371bf380 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- 172.21.15.40:0/1359160427 >> 172.21.15.40:0/1359160427 conn(0x55d93719fd40 msgr2=0x55d9371a2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- 172.21.15.40:0/1359160427 shutdown_connections 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- 172.21.15.40:0/1359160427 wait complete. 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.221+0000 7fa75ce83000 1 -- start start 2023-11-04T01:44:39.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 Processor -- start 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d937172b40 0x55d937178a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d937178f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d9371bf8c0 0x55d937179490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d936fc74b0 con 0x55d9371befa0 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d936f7faa0 con 0x55d9371bf8c0 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d936f85940 con 0x55d937172b40 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 10 client.0 _ll_register_callbacks cb 0x55d937160460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d937178f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d937178f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35134/0 (socket says 172.21.15.40:35134) 2023-11-04T01:44:39.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 -- 172.21.15.40:0/2357570174 learned_addr learned my addr 172.21.15.40:0/2357570174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d937172b40 0x55d937178a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa753fff640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d9371bf8c0 0x55d937179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 -- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d937172b40 msgr2=0x55d937178a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d937172b40 0x55d937178a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 -- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d9371bf8c0 msgr2=0x55d937179490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d9371bf8c0 0x55d937179490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 -- 172.21.15.40:0/2357570174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7540c69c0 con 0x55d9371befa0 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa752ffd640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d937178f50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa748001750 tx=0x7fa748019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545c1d9c85c901de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 1 -- 172.21.15.40:0/2357570174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748007020 con 0x55d9371befa0 2023-11-04T01:44:39.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 1 -- 172.21.15.40:0/2357570174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa7480bb040 con 0x55d9371befa0 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d936f84e10 con 0x55d9371befa0 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 1 -- 172.21.15.40:0/2357570174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa748007180 con 0x55d9371befa0 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 10 client.7599 fetch_fsmap learned FSMap version 68 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55d936f881a0 con 0x55d9371befa0 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 1 -- 172.21.15.40:0/2357570174 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d936f84e10 con 0x55d9371befa0 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 1 -- 172.21.15.40:0/2357570174 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 68) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa7480072e0 con 0x55d9371befa0 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 10 client.7599 fetch_fsmap finished waiting for FSMap version 68 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 10 client.7599 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 20 client.7599 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:39.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d937179d00 0x55d9371d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 4 client.7599 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d936fc5e00 con 0x55d937179d00 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d937179d00 0x55d9371d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d937179d00 0x55d9371d0720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19533948e85f45bb server_cookie=bfaa844ea9017da1 in_seq=0 out_seq=0 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 10 client.7599 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 1 -- 172.21.15.40:0/2357570174 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d936fc5e00 con 0x55d937179d00 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 10 client.7599 handle_command_reply: tid=0 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 client.7599 shutdown 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 msgr2=0x55d937178f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d937178f50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa748001750 tx=0x7fa748019140 comp rx=0 tx=0).stop 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 shutdown_connections 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d937179d00 0x55d9371d0720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d9371bf8c0 0x55d937179490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d9371befa0 0x55d937178f50 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa7327fc640 0 client.7599 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2357570174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d937172b40 0x55d937178a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 >> 172.21.15.40:0/2357570174 conn(0x55d93719fd40 msgr2=0x55d9371a2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 shutdown_connections 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 1 -- 172.21.15.40:0/2357570174 wait complete. 2023-11-04T01:44:39.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.225+0000 7fa75ce83000 20 client.7599 trim_cache size 0 max 16384 2023-11-04T01:44:39.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 Processor -- start 2023-11-04T01:44:39.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 -- start start 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d93719fd40 0x55d937171470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 0x55d9371719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371be270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d936c80940 con 0x55d937172b40 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d936fc4cc0 con 0x55d93719fd40 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d936fc74b0 con 0x55d9371befa0 2023-11-04T01:44:39.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.241+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 0x55d9371719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 0x55d9371719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35136/0 (socket says 172.21.15.40:35136) 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/739155362 learned_addr learned my addr 172.21.15.40:0/739155362 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 msgr2=0x55d9371be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa753fff640 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7537fe640 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d93719fd40 0x55d937171470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371be270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d93719fd40 msgr2=0x55d937171470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d93719fd40 0x55d937171470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/739155362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d936f6e4a0 con 0x55d937172b40 2023-11-04T01:44:39.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 0x55d9371719b0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa748019180 tx=0x7fa7480bf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677d4d0988a5d3a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa739ffb640 1 -- 172.21.15.40:0/739155362 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b6440 con 0x55d937172b40 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa739ffb640 1 -- 172.21.15.40:0/739155362 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744001d80 con 0x55d937172b40 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa739ffb640 1 -- 172.21.15.40:0/739155362 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b67c0 con 0x55d937172b40 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/739155362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 msgr2=0x55d9371719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 0x55d9371719b0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa748019180 tx=0x7fa7480bf000 comp rx=0 tx=0).stop 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/739155362 shutdown_connections 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d937172b40 0x55d9371719b0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- 172.21.15.40:0/739155362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d93719fd40 0x55d937171470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/739155362 >> 172.21.15.40:0/739155362 conn(0x55d937178ba0 msgr2=0x55d937170d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/739155362 shutdown_connections 2023-11-04T01:44:39.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/739155362 wait complete. 2023-11-04T01:44:39.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- start start 2023-11-04T01:44:39.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 Processor -- start 2023-11-04T01:44:39.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d9371d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 0x55d9371e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9371d5410 con 0x55d93719fd40 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d936fc48b0 con 0x55d937172b40 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d936f7e100 con 0x55d9371befa0 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 10 client.0 _ll_register_callbacks cb 0x7fa74c055de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 0x55d9371e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 0x55d9371e05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35152/0 (socket says 172.21.15.40:35152) 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/2029341509 learned_addr learned my addr 172.21.15.40:0/2029341509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d9371d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa753fff640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 msgr2=0x55d9371e0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371e0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 msgr2=0x55d9371d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d9371d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 -- 172.21.15.40:0/2029341509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d936f881a0 con 0x55d93719fd40 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d9371d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa752ffd640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 0x55d9371e05c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fa74801cc40 tx=0x7fa7480b3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2715cfd375a9c4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7327fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7327fc640 1 -- 172.21.15.40:0/2029341509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b6da0 con 0x55d93719fd40 2023-11-04T01:44:39.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7327fc640 1 -- 172.21.15.40:0/2029341509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa7480bb070 con 0x55d93719fd40 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d936f91d10 con 0x55d93719fd40 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7327fc640 1 -- 172.21.15.40:0/2029341509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7480db470 con 0x55d93719fd40 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 10 client.7605 fetch_fsmap learned FSMap version 68 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55d936cbfcc0 con 0x55d93719fd40 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.245+0000 7fa7327fc640 1 -- 172.21.15.40:0/2029341509 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d936f91d10 con 0x55d93719fd40 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7327fc640 1 -- 172.21.15.40:0/2029341509 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 68) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa7480db5d0 con 0x55d93719fd40 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 10 client.7605 fetch_fsmap finished waiting for FSMap version 68 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 10 client.7605 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 20 client.7605 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:39.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d9371bf8c0 0x55d937223ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 4 client.7605 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d936fc0490 con 0x55d9371bf8c0 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d9371bf8c0 0x55d937223ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7327fc640 10 client.7605 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7537fe640 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d9371bf8c0 0x55d937223ad0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8b6336ba0fef279 server_cookie=bf2e8f7c16e500c9 in_seq=0 out_seq=0 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7327fc640 1 -- 172.21.15.40:0/2029341509 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d936fc0490 con 0x55d9371bf8c0 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7327fc640 10 client.7605 handle_command_reply: tid=0 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 client.7605 shutdown 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 msgr2=0x55d9371e05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 0x55d9371e05c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fa74801cc40 tx=0x7fa7480b3000 comp rx=0 tx=0).stop 2023-11-04T01:44:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 shutdown_connections 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x55d9371befa0 0x55d9371e0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d93719fd40 0x55d9371e05c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x55d9371bf8c0 0x55d937223ad0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 --2- 172.21.15.40:0/2029341509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55d937172b40 0x55d9371d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa7327fc640 0 client.7605 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 >> 172.21.15.40:0/2029341509 conn(0x55d937178ba0 msgr2=0x55d937171680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 shutdown_connections 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 1 -- 172.21.15.40:0/2029341509 wait complete. 2023-11-04T01:44:39.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa75ce83000 20 client.7605 trim_cache size 0 max 16384 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7068, 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 67.975929296999993, 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 68, 2023-11-04T01:44:39.263 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2023-11-04T01:44:39.264 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:44:39.264 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 89.168475627000007 2023-11-04T01:44:39.264 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:44:39.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7400664a0 msgr2=0x7fa740068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7400664a0 0x7fa740068960 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa75406df00 tx=0x7fa748001130 comp rx=0 tx=0).stop 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 msgr2=0x7fa7540c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa7540c81e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007f30 tx=0x7fa74c011660 comp rx=0 tx=0).stop 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 shutdown_connections 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7400664a0 0x7fa740068960 secure :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa75406df00 tx=0x7fa748001130 comp rx=0 tx=0).stop 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa7540b3210 0x7fa75415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa7540c6ee0 0x7fa75406bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 --2- 172.21.15.40:0/1185148365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c0047d0 0x7fa7540c81e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 >> 172.21.15.40:0/1185148365 conn(0x7fa7540cebb0 msgr2=0x7fa754151090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 shutdown_connections 2023-11-04T01:44:39.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.249+0000 7fa759d56640 1 -- 172.21.15.40:0/1185148365 wait complete. 2023-11-04T01:44:39.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:44:39.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 Processor -- start 2023-11-04T01:44:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 -- start start 2023-11-04T01:44:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1300715d0 0x7fa1300b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa13015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300c2670 con 0x7fa13015afd0 2023-11-04T01:44:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa130070140 con 0x7fa1300715d0 2023-11-04T01:44:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa135b70640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa130071a60 con 0x7fa1300b0b70 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1300715d0 0x7fa1300b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa13015afd0 0x7fa13006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47266/0 (socket says 172.21.15.40:47266) 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12f7fe640 1 -- 172.21.15.40:0/1442244136 learned_addr learned my addr 172.21.15.40:0/1442244136 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12ffff640 1 --2- 172.21.15.40:0/1442244136 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa13015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12effd640 1 -- 172.21.15.40:0/1442244136 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 msgr2=0x7fa13015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12effd640 1 --2- 172.21.15.40:0/1442244136 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa13015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12effd640 1 -- 172.21.15.40:0/1442244136 >> v1:172.21.15.40:6789/0 conn(0x7fa13015afd0 legacy=0x7fa13006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12effd640 1 -- 172.21.15.40:0/1442244136 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13006bc30 con 0x7fa1300715d0 2023-11-04T01:44:39.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.377+0000 7fa12e7fc640 1 -- 172.21.15.40:0/1442244136 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018184668 0 0) 0x7fa1300c2670 con 0x7fa13015afd0 2023-11-04T01:44:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa12effd640 1 --2- 172.21.15.40:0/1442244136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1300715d0 0x7fa1300b0630 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa1240097c0 tx=0x7fa12401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64119119ea88f68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa12e7fc640 1 -- 172.21.15.40:0/1442244136 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240ab600 con 0x7fa1300715d0 2023-11-04T01:44:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa12e7fc640 1 -- 172.21.15.40:0/1442244136 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1240a7050 con 0x7fa1300715d0 2023-11-04T01:44:39.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa12e7fc640 1 -- 172.21.15.40:0/1442244136 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240ab980 con 0x7fa1300715d0 2023-11-04T01:44:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 -- 172.21.15.40:0/1442244136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1300715d0 msgr2=0x7fa1300b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 --2- 172.21.15.40:0/1442244136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1300715d0 0x7fa1300b0630 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa1240097c0 tx=0x7fa12401c480 comp rx=0 tx=0).stop 2023-11-04T01:44:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 -- 172.21.15.40:0/1442244136 shutdown_connections 2023-11-04T01:44:39.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 --2- 172.21.15.40:0/1442244136 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa13015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 --2- 172.21.15.40:0/1442244136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1300715d0 0x7fa1300b0630 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 -- 172.21.15.40:0/1442244136 >> 172.21.15.40:0/1442244136 conn(0x7fa1300cebb0 msgr2=0x7fa1300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 -- 172.21.15.40:0/1442244136 shutdown_connections 2023-11-04T01:44:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 -- 172.21.15.40:0/1442244136 wait complete. 2023-11-04T01:44:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.381+0000 7fa135b70640 1 Processor -- start 2023-11-04T01:44:39.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 -- start start 2023-11-04T01:44:39.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1300715d0 0x7fa1300c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa1300b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 0x7fa1300b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b3910 con 0x7fa13015afd0 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b46e0 con 0x7fa1300715d0 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b3b60 con 0x7fa1300b0b70 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 0x7fa1300b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 0x7fa1300b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35174/0 (socket says 172.21.15.40:35174) 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 -- 172.21.15.40:0/1668466090 learned_addr learned my addr 172.21.15.40:0/1668466090 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 -- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 msgr2=0x7fa1300b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa1300b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 -- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1300715d0 msgr2=0x7fa1300c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1300715d0 0x7fa1300c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1300715d0 0x7fa1300c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 -- 172.21.15.40:0/1668466090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124009420 con 0x7fa13015afd0 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1300715d0 0x7fa1300c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa12ffff640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 0x7fa1300b19a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa128007e60 tx=0x7fa12800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa117fff640 1 -- 172.21.15.40:0/1668466090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128014420 con 0x7fa13015afd0 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa117fff640 1 -- 172.21.15.40:0/1668466090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280145a0 con 0x7fa13015afd0 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300b3e40 con 0x7fa13015afd0 2023-11-04T01:44:39.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa117fff640 1 -- 172.21.15.40:0/1668466090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128014950 con 0x7fa13015afd0 2023-11-04T01:44:39.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300b4400 con 0x7fa13015afd0 2023-11-04T01:44:39.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa117fff640 1 -- 172.21.15.40:0/1668466090 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa128014ab0 con 0x7fa13015afd0 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.385+0000 7fa117fff640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa11c0664a0 0x7fa11c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa117fff640 1 -- 172.21.15.40:0/1668466090 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa128084c20 con 0x7fa13015afd0 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa11c0664a0 0x7fa11c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 Processor -- start 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- start start 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa11c0664a0 0x7fa11c068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa120000f70 tx=0x7fa120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d029e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d0251600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d0251f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d011c460 con 0x5606d0251b40 2023-11-04T01:44:39.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d00ad690 con 0x5606d029dfa0 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d00aabc0 con 0x5606d029e8c0 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d0251f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d0251f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35186/0 (socket says 172.21.15.40:35186) 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 -- 172.21.15.40:0/2221783841 learned_addr learned my addr 172.21.15.40:0/2221783841 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d029e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12effd640 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d0251600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 -- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 msgr2=0x5606d0251600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d0251600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 -- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 msgr2=0x5606d029e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d029e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 -- 172.21.15.40:0/2221783841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606cfd9e890 con 0x5606d0251b40 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa12ffff640 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d0251f20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fa12805d6b0 tx=0x7fa128055fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644b66fb93802652 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa1157fa640 1 -- 172.21.15.40:0/2221783841 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12806d1c0 con 0x5606d0251b40 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa1157fa640 1 -- 172.21.15.40:0/2221783841 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128059a30 con 0x5606d0251b40 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa1157fa640 1 -- 172.21.15.40:0/2221783841 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12805dbe0 con 0x5606d0251b40 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- 172.21.15.40:0/2221783841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 msgr2=0x5606d0251f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d0251f20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fa12805d6b0 tx=0x7fa128055fe0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- 172.21.15.40:0/2221783841 shutdown_connections 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d0251f20 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d0251600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2221783841 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d029e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- 172.21.15.40:0/2221783841 >> 172.21.15.40:0/2221783841 conn(0x5606d027ed40 msgr2=0x5606d0281130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- 172.21.15.40:0/2221783841 shutdown_connections 2023-11-04T01:44:39.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- 172.21.15.40:0/2221783841 wait complete. 2023-11-04T01:44:39.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 -- start start 2023-11-04T01:44:39.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.389+0000 7fa138c9d000 1 Processor -- start 2023-11-04T01:44:39.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d02a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d00a64b0 con 0x5606d0251b40 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d005eaa0 con 0x5606d029dfa0 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d0064940 con 0x5606d029e8c0 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 10 client.0 _ll_register_callbacks cb 0x5606d023f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02a5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35196/0 (socket says 172.21.15.40:35196) 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 -- 172.21.15.40:0/3682644409 learned_addr learned my addr 172.21.15.40:0/3682644409 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12ffff640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12effd640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d02a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 -- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 msgr2=0x5606d02576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 -- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 msgr2=0x5606d02a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d02a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 -- 172.21.15.40:0/3682644409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300b4400 con 0x5606d0251b40 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12effd640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d02a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02a5300 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fa120005bb0 tx=0x7fa120000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785c3aacfcb140b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 1 -- 172.21.15.40:0/3682644409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120012410 con 0x5606d0251b40 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 1 -- 172.21.15.40:0/3682644409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa120012570 con 0x5606d0251b40 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606d0063e10 con 0x5606d0251b40 2023-11-04T01:44:39.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 1 -- 172.21.15.40:0/3682644409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa120012730 con 0x5606d0251b40 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 10 client.7620 fetch_fsmap learned FSMap version 68 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x5606d00671a0 con 0x5606d0251b40 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 1 -- 172.21.15.40:0/3682644409 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606d0063e10 con 0x5606d0251b40 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 1 -- 172.21.15.40:0/3682644409 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 68) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa120012890 con 0x5606d0251b40 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 10 client.7620 fetch_fsmap finished waiting for FSMap version 68 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 10 client.7620 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 20 client.7620 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0258450 0x5606d0258830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 4 client.7620 mds_command: new command op to 7440 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 --> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606d00a4e00 con 0x5606d0258450 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12effd640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0258450 0x5606d0258830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 10 client.7620 ms_handle_connect on v2:172.21.15.40:6834/1813470604 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa12effd640 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0258450 0x5606d0258830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beec31a80db2653d server_cookie=d53c8b839ee7c82 in_seq=0 out_seq=0 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 1 -- 172.21.15.40:0/3682644409 <== mds.0 v2:172.21.15.40:6834/1813470604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606d00a4e00 con 0x5606d0258450 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 10 client.7620 handle_command_reply: tid=0 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 client.7620 shutdown 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 msgr2=0x5606d02a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02a5300 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fa120005bb0 tx=0x7fa120000ee0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 shutdown_connections 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0258450 0x5606d0258830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029dfa0 0x5606d02a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa10e7fc640 0 client.7620 ms_handle_reset on v2:172.21.15.40:6834/1813470604 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3682644409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02a5300 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 >> 172.21.15.40:0/3682644409 conn(0x5606d027ed40 msgr2=0x5606d0281130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 shutdown_connections 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 1 -- 172.21.15.40:0/3682644409 wait complete. 2023-11-04T01:44:39.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.393+0000 7fa138c9d000 20 client.7620 trim_cache size 0 max 16384 2023-11-04T01:44:39.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 Processor -- start 2023-11-04T01:44:39.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 -- start start 2023-11-04T01:44:39.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d0251b40 0x5606d0258830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 0x5606d0258d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606cfd5f940 con 0x5606d029dfa0 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606cfd9f1b0 con 0x5606d0251b40 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d00a38b0 con 0x5606d029e8c0 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 0x5606d0258d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 0x5606d0258d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35212/0 (socket says 172.21.15.40:35212) 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 -- 172.21.15.40:0/3465412001 learned_addr learned my addr 172.21.15.40:0/3465412001 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 -- 172.21.15.40:0/3465412001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 msgr2=0x5606d02592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 -- 172.21.15.40:0/3465412001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d0251b40 msgr2=0x5606d0258830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d0251b40 0x5606d0258830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 -- 172.21.15.40:0/3465412001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606d004d4a0 con 0x5606d029dfa0 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa12effd640 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 0x5606d0258d70 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa12401c4c0 tx=0x7fa124004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cac98075bb08a34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa115ffb640 1 -- 172.21.15.40:0/3465412001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240ab7a0 con 0x5606d029dfa0 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa115ffb640 1 -- 172.21.15.40:0/3465412001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1240ab900 con 0x5606d029dfa0 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.409+0000 7fa115ffb640 1 -- 172.21.15.40:0/3465412001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240abc70 con 0x5606d029dfa0 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/3465412001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 msgr2=0x5606d0258d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 0x5606d0258d70 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa12401c4c0 tx=0x7fa124004740 comp rx=0 tx=0).stop 2023-11-04T01:44:39.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/3465412001 shutdown_connections 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029e8c0 0x5606d02592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d029dfa0 0x5606d0258d70 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- 172.21.15.40:0/3465412001 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d0251b40 0x5606d0258830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/3465412001 >> 172.21.15.40:0/3465412001 conn(0x5606d027ed40 msgr2=0x5606d02ab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/3465412001 shutdown_connections 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/3465412001 wait complete. 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- start start 2023-11-04T01:44:39.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 Processor -- start 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02ff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029dfa0 0x5606d02ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029e8c0 0x5606d02a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d00aa4b0 con 0x5606d0251b40 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d00a5340 con 0x5606d029e8c0 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d0079ba0 con 0x5606d029dfa0 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 10 client.0 _ll_register_callbacks cb 0x7fa1280556b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02ff630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35228/0 (socket says 172.21.15.40:35228) 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 -- 172.21.15.40:0/2716357558 learned_addr learned my addr 172.21.15.40:0/2716357558 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12ffff640 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029e8c0 0x5606d02a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 -- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029dfa0 msgr2=0x5606d02ffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029dfa0 0x5606d02ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 -- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029e8c0 msgr2=0x5606d02a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029e8c0 0x5606d02a1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 -- 172.21.15.40:0/2716357558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13006bc30 con 0x5606d0251b40 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12f7fe640 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02ff630 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa120000f20 tx=0x7fa120001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7eeaf702f02795 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:44:39.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 1 -- 172.21.15.40:0/2716357558 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120012dc0 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 1 -- 172.21.15.40:0/2716357558 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa120012620 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606d02558a0 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 1 -- 172.21.15.40:0/2716357558 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1200127e0 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 10 client.7626 fetch_fsmap learned FSMap version 68 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x5606cfd9ecc0 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 1 -- 172.21.15.40:0/2716357558 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606d02558a0 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 1 -- 172.21.15.40:0/2716357558 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 68) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa120021460 con 0x5606d0251b40 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 10 client.7626 fetch_fsmap finished waiting for FSMap version 68 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 10 client.7626 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:44:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 20 client.7626 populate_metadata read hostname 'smithi040' 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0306500 0x5606d03088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 4 client.7626 mds_command: new command op to 7440 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 --> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606d0070d10 con 0x5606d0306500 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12effd640 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0306500 0x5606d03088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 10 client.7626 ms_handle_connect on v2:172.21.15.40:6834/1813470604 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa12effd640 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0306500 0x5606d03088f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b05e97e5e3155c96 server_cookie=8cd690b28213871b in_seq=0 out_seq=0 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 1 -- 172.21.15.40:0/2716357558 <== mds.0 v2:172.21.15.40:6834/1813470604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5606d0070d10 con 0x5606d0306500 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa10e7fc640 10 client.7626 handle_command_reply: tid=0 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 client.7626 shutdown 2023-11-04T01:44:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 msgr2=0x5606d02ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02ff630 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa120000f20 tx=0x7fa120001090 comp rx=0 tx=0).stop 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.413+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 shutdown_connections 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:6834/1813470604,v1:172.21.15.40:6835/1813470604] conn(0x5606d0306500 0x5606d03088f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5606d029e8c0 0x5606d02a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5606d029dfa0 0x5606d02ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 --2- 172.21.15.40:0/2716357558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5606d0251b40 0x5606d02ff630 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa10e7fc640 0 client.7626 ms_handle_reset on v2:172.21.15.40:6834/1813470604 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 >> 172.21.15.40:0/2716357558 conn(0x5606d027ed40 msgr2=0x5606d0256660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 shutdown_connections 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 1 -- 172.21.15.40:0/2716357558 wait complete. 2023-11-04T01:44:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa138c9d000 20 client.7626 trim_cache size 0 max 16384 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7440, 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 6.7731037120000002, 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 68, 2023-11-04T01:44:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2023-11-04T01:44:39.431 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:44:39.431 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 38.079406431999999 2023-11-04T01:44:39.431 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:44:39.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa11c0664a0 msgr2=0x7fa11c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa11c0664a0 0x7fa11c068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa120000f70 tx=0x7fa120009040 comp rx=0 tx=0).stop 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 msgr2=0x7fa1300b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 0x7fa1300b19a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa128007e60 tx=0x7fa12800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 shutdown_connections 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa11c0664a0 0x7fa11c068960 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa13015afd0 0x7fa1300b19a0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1300b0b70 0x7fa1300b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 --2- 172.21.15.40:0/1668466090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1300715d0 0x7fa1300c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 >> 172.21.15.40:0/1668466090 conn(0x7fa1300cebb0 msgr2=0x7fa13015a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 shutdown_connections 2023-11-04T01:44:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.417+0000 7fa135b70640 1 -- 172.21.15.40:0/1668466090 wait complete. 2023-11-04T01:44:39.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:39.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7aafe640 1 Processor -- start 2023-11-04T01:44:39.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7aafe640 1 -- start start 2023-11-04T01:44:39.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7aafe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe740d0ae0 0x7fbe740b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7aafe640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740b6070 con 0x7fbe740b4990 2023-11-04T01:44:39.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7aafe640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740b8ed0 con 0x7fbe740d0690 2023-11-04T01:44:39.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7aafe640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe740d1ce0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7889a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbe740b4990 0x7fbe740b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47270/0 (socket says 172.21.15.40:47270) 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7889a640 1 -- 172.21.15.40:0/1676465206 learned_addr learned my addr 172.21.15.40:0/1676465206 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7909b640 1 --2- 172.21.15.40:0/1676465206 >> v2:172.21.15.40:3300/0 conn(0x7fbe740d0ae0 0x7fbe740b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7909b640 1 -- 172.21.15.40:0/1676465206 >> v1:172.21.15.91:6789/0 conn(0x7fbe740d0690 legacy=0x7fbe740b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7909b640 1 -- 172.21.15.40:0/1676465206 >> v1:172.21.15.40:6789/0 conn(0x7fbe740b4990 legacy=0x7fbe740b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe7909b640 1 -- 172.21.15.40:0/1676465206 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740d1fc0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.553+0000 7fbe737fe640 1 -- 172.21.15.40:0/1676465206 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490264059 0 0) 0x7fbe740b6070 con 0x7fbe740b4990 2023-11-04T01:44:39.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7909b640 1 --2- 172.21.15.40:0/1676465206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740b6bf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fbe640097c0 tx=0x7fbe6401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d03345b66b94a8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe737fe640 1 -- 172.21.15.40:0/1676465206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640a8930 con 0x7fbe740d0ae0 2023-11-04T01:44:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe737fe640 1 -- 172.21.15.40:0/1676465206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640a8a90 con 0x7fbe740d0ae0 2023-11-04T01:44:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe737fe640 1 -- 172.21.15.40:0/1676465206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640a8e20 con 0x7fbe740d0ae0 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 -- 172.21.15.40:0/1676465206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 msgr2=0x7fbe740b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/1676465206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740b6bf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fbe640097c0 tx=0x7fbe6401ec30 comp rx=0 tx=0).stop 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 -- 172.21.15.40:0/1676465206 shutdown_connections 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/1676465206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740b6bf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 -- 172.21.15.40:0/1676465206 >> 172.21.15.40:0/1676465206 conn(0x7fbe740cf990 msgr2=0x7fbe740cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 -- 172.21.15.40:0/1676465206 shutdown_connections 2023-11-04T01:44:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 -- 172.21.15.40:0/1676465206 wait complete. 2023-11-04T01:44:39.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 Processor -- start 2023-11-04T01:44:39.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.557+0000 7fbe7aafe640 1 -- start start 2023-11-04T01:44:39.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe740b4990 0x7fbe741f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe740d0690 0x7fbe740d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741f6560 con 0x7fbe740d0ae0 2023-11-04T01:44:39.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74149950 con 0x7fbe740b4990 2023-11-04T01:44:39.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741f5f10 con 0x7fbe740d0690 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740d2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35246/0 (socket says 172.21.15.40:35246) 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 -- 172.21.15.40:0/752405564 learned_addr learned my addr 172.21.15.40:0/752405564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7889a640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe740b4990 0x7fbe741f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe73fff640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe740d0690 0x7fbe740d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 -- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe740d0690 msgr2=0x7fbe740d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe740d0690 0x7fbe740d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 -- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe740b4990 msgr2=0x7fbe741f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe740b4990 0x7fbe741f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 -- 172.21.15.40:0/752405564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009420 con 0x7fbe740d0ae0 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7909b640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740d2d00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b3040 tx=0x7fbe6401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640b0e20 con 0x7fbe740d0ae0 2023-11-04T01:44:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640b9410 con 0x7fbe740d0ae0 2023-11-04T01:44:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640b97c0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe741f61f0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe741f69f0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe741f66d0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe640b7040 con 0x7fbe740d0ae0 2023-11-04T01:44:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe717fa640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe540664a0 0x7fbe54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fbe64122060 con 0x7fbe740d0ae0 2023-11-04T01:44:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7889a640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe540664a0 0x7fbe54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:39.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.561+0000 7fbe7889a640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe540664a0 0x7fbe54068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0012f0 tx=0x7fbe6c005ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:39.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.565+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe640ef060 con 0x7fbe740d0ae0 2023-11-04T01:44:39.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.757+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe741f66a0 con 0x7fbe740d0ae0 2023-11-04T01:44:39.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.757+0000 7fbe717fa640 1 -- 172.21.15.40:0/752405564 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fbe640b5090 con 0x7fbe740d0ae0 2023-11-04T01:44:39.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:39.764 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:35.672881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 68 2023-11-04T01:44:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.757+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe540664a0 msgr2=0x7fbe54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.757+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe540664a0 0x7fbe54068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0012f0 tx=0x7fbe6c005ec0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.757+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 msgr2=0x7fbe740d2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.757+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740d2d00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbe640b3040 tx=0x7fbe6401b9d0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 shutdown_connections 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbe540664a0 0x7fbe54068960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe740d0ae0 0x7fbe740d2d00 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbe740d0690 0x7fbe740d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 --2- 172.21.15.40:0/752405564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe740b4990 0x7fbe741f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 >> 172.21.15.40:0/752405564 conn(0x7fbe740cf990 msgr2=0x7fbe740d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 shutdown_connections 2023-11-04T01:44:39.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:39.761+0000 7fbe7aafe640 1 -- 172.21.15.40:0/752405564 wait complete. 2023-11-04T01:44:39.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:44:39.913 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:44.122618+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:44:10.143073+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:44:39.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:44.122618+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:44:10.143073+0000" } ] } 2023-11-04T01:44:39.914 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:44:39.914 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-04T01:44:39.914 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.033+0000 7f55e0f49640 1 Processor -- start 2023-11-04T01:44:40.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.033+0000 7f55e0f49640 1 -- start start 2023-11-04T01:44:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55e0f49640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 0x7f55dc0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55e0f49640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f55dc0cd6d0 0x7f55dc0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55e0f49640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0d0a60 con 0x7f55dc0cb400 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55e0f49640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc15b390 con 0x7f55dc0cd6d0 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55e0f49640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0cf8a0 con 0x7f55dc15afb0 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55da59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 0x7f55dc0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55dad9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f55dc0cd6d0 0x7f55dc0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55d9d9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f55dc0cb400 0x7f55dc0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:39678/0 (socket says 172.21.15.40:39678) 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55da59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 0x7f55dc0b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:40732/0 (socket says 172.21.15.40:40732) 2023-11-04T01:44:40.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55d9d9b640 1 -- 172.21.15.40:0/3501510111 learned_addr learned my addr 172.21.15.40:0/3501510111 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55da59c640 1 -- 172.21.15.40:0/3501510111 >> v2:172.21.15.91:3300/0 conn(0x7f55dc0cd6d0 msgr2=0x7f55dc0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55da59c640 1 --2- 172.21.15.40:0/3501510111 >> v2:172.21.15.91:3300/0 conn(0x7f55dc0cd6d0 0x7f55dc0cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55da59c640 1 -- 172.21.15.40:0/3501510111 >> v1:172.21.15.91:6789/0 conn(0x7f55dc0cb400 legacy=0x7f55dc0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.037+0000 7f55da59c640 1 -- 172.21.15.40:0/3501510111 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0d04a0 con 0x7f55dc15afb0 2023-11-04T01:44:40.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55da59c640 1 --2- 172.21.15.40:0/3501510111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 0x7f55dc0b3050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0097c0 tx=0x7f55cc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e21f7d5bfa440aad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55d959a640 1 -- 172.21.15.40:0/3501510111 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0ac620 con 0x7f55dc15afb0 2023-11-04T01:44:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55d959a640 1 -- 172.21.15.40:0/3501510111 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc0ac780 con 0x7f55dc15afb0 2023-11-04T01:44:40.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55d959a640 1 -- 172.21.15.40:0/3501510111 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0acb10 con 0x7f55dc15afb0 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- 172.21.15.40:0/3501510111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 msgr2=0x7f55dc0b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 --2- 172.21.15.40:0/3501510111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 0x7f55dc0b3050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0097c0 tx=0x7f55cc01c3c0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- 172.21.15.40:0/3501510111 shutdown_connections 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 --2- 172.21.15.40:0/3501510111 >> v2:172.21.15.91:3300/0 conn(0x7f55dc0cd6d0 0x7f55dc0cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 --2- 172.21.15.40:0/3501510111 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc15afb0 0x7f55dc0b3050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- 172.21.15.40:0/3501510111 >> 172.21.15.40:0/3501510111 conn(0x7f55dc065dc0 msgr2=0x7f55dc0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- 172.21.15.40:0/3501510111 shutdown_connections 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- 172.21.15.40:0/3501510111 wait complete. 2023-11-04T01:44:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 Processor -- start 2023-11-04T01:44:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- start start 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55dc0cb400 0x7f55dc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc0cd6d0 0x7f55dc15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 0x7f55dc06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc155cd0 con 0x7f55dc15afb0 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15cab0 con 0x7f55dc0cb400 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55e0f49640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15cd90 con 0x7f55dc0cd6d0 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55dad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 0x7f55dc06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55dad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 0x7f55dc06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35248/0 (socket says 172.21.15.40:35248) 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55dad9d640 1 -- 172.21.15.40:0/552422414 learned_addr learned my addr 172.21.15.40:0/552422414 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55d9d9b640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc0cd6d0 0x7f55dc15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.041+0000 7f55da59c640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55dc0cb400 0x7f55dc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55dad9d640 1 -- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc0cd6d0 msgr2=0x7f55dc15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55dad9d640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc0cd6d0 0x7f55dc15db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55dad9d640 1 -- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55dc0cb400 msgr2=0x7f55dc155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55dad9d640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55dc0cb400 0x7f55dc155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55dad9d640 1 -- 172.21.15.40:0/552422414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009420 con 0x7f55dc15afb0 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d9d9b640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc0cd6d0 0x7f55dc15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55dad9d640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 0x7f55dc06dd20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f55d400efc0 tx=0x7f55d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4014480 con 0x7f55dc15afb0 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d400f040 con 0x7f55dc15afb0 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc15d070 con 0x7f55dc15afb0 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4014820 con 0x7f55dc15afb0 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc15d630 con 0x7f55dc15afb0 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc15d850 con 0x7f55dc15afb0 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55d4014980 con 0x7f55dc15afb0 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d2ffd640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55bc0664d0 0x7f55bc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f55d4085220 con 0x7f55dc15afb0 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.045+0000 7f55da59c640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55bc0664d0 0x7f55bc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.049+0000 7f55da59c640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55bc0664d0 0x7f55bc068990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0ae000 tx=0x7f55cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.049+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55d4052190 con 0x7f55dc15afb0 2023-11-04T01:44:40.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55dc0675f0 con 0x7f55dc15afb0 2023-11-04T01:44:40.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55d2ffd640 1 -- 172.21.15.40:0/552422414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f55d40557b0 con 0x7f55dc15afb0 2023-11-04T01:44:40.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:40.251 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:35.672881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:40.251 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 68 2023-11-04T01:44:40.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55bc0664d0 msgr2=0x7f55bc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55bc0664d0 0x7f55bc068990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0ae000 tx=0x7f55cc008040 comp rx=0 tx=0).stop 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 msgr2=0x7f55dc06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 0x7f55dc06dd20 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f55d400efc0 tx=0x7f55d400c490 comp rx=0 tx=0).stop 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 shutdown_connections 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.245+0000 7f55e0f49640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55bc0664d0 0x7f55bc068990 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.249+0000 7f55e0f49640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55dc15afb0 0x7f55dc06dd20 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.249+0000 7f55e0f49640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55dc0cd6d0 0x7f55dc15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.249+0000 7f55e0f49640 1 --2- 172.21.15.40:0/552422414 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55dc0cb400 0x7f55dc155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.249+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 >> 172.21.15.40:0/552422414 conn(0x7f55dc065dc0 msgr2=0x7f55dc0b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:40.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.249+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 shutdown_connections 2023-11-04T01:44:40.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.249+0000 7f55e0f49640 1 -- 172.21.15.40:0/552422414 wait complete. 2023-11-04T01:44:40.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:44:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.385+0000 7f0837bd4640 1 Processor -- start 2023-11-04T01:44:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.385+0000 7f0837bd4640 1 -- start start 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0837bd4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f083015acb0 0x7f083015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0837bd4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f083015c160 0x7f08300b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0837bd4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08300b0a50 0x7f08300ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0837bd4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083015bd40 con 0x7f083015c160 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0837bd4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083006fd80 con 0x7f083015acb0 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0837bd4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08300b0ee0 con 0x7f08300b0a50 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f083015c160 0x7f08300b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f083015c160 0x7f08300b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35258/0 (socket says 172.21.15.40:35258) 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0836171640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08300b0a50 0x7f08300ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 -- 172.21.15.40:0/2309128494 learned_addr learned my addr 172.21.15.40:0/2309128494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:40.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f0835970640 1 --2- 172.21.15.40:0/2309128494 >> v2:172.21.15.91:3300/0 conn(0x7f083015acb0 0x7f083015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 -- 172.21.15.40:0/2309128494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08300b0a50 msgr2=0x7f08300ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:40.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 --2- 172.21.15.40:0/2309128494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08300b0a50 0x7f08300ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 -- 172.21.15.40:0/2309128494 >> v2:172.21.15.91:3300/0 conn(0x7f083015acb0 msgr2=0x7f083015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:40.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 --2- 172.21.15.40:0/2309128494 >> v2:172.21.15.91:3300/0 conn(0x7f083015acb0 0x7f083015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 -- 172.21.15.40:0/2309128494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08300cb130 con 0x7f083015c160 2023-11-04T01:44:40.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083516f640 1 --2- 172.21.15.40:0/2309128494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015c160 0x7f08300b0510 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f083006d550 tx=0x7f082001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0fb68092efe59f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.389+0000 7f083496e640 1 -- 172.21.15.40:0/2309128494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200aa5f0 con 0x7f083015c160 2023-11-04T01:44:40.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083496e640 1 -- 172.21.15.40:0/2309128494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08200aa750 con 0x7f083015c160 2023-11-04T01:44:40.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083496e640 1 -- 172.21.15.40:0/2309128494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200aaae0 con 0x7f083015c160 2023-11-04T01:44:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- 172.21.15.40:0/2309128494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015c160 msgr2=0x7f08300b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2309128494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015c160 0x7f08300b0510 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f083006d550 tx=0x7f082001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- 172.21.15.40:0/2309128494 shutdown_connections 2023-11-04T01:44:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2309128494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08300b0a50 0x7f08300ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2309128494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015c160 0x7f08300b0510 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2309128494 >> v2:172.21.15.91:3300/0 conn(0x7f083015acb0 0x7f083015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- 172.21.15.40:0/2309128494 >> 172.21.15.40:0/2309128494 conn(0x7f08300cb510 msgr2=0x7f08300cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- 172.21.15.40:0/2309128494 shutdown_connections 2023-11-04T01:44:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- 172.21.15.40:0/2309128494 wait complete. 2023-11-04T01:44:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 Processor -- start 2023-11-04T01:44:40.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- start start 2023-11-04T01:44:40.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08300b0a50 0x7f083014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 0x7f08300c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f083015c160 0x7f08300c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c7da0 con 0x7f083015acb0 2023-11-04T01:44:40.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300b3320 con 0x7f08300b0a50 2023-11-04T01:44:40.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08300c7ff0 con 0x7f083015c160 2023-11-04T01:44:40.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 0x7f08300c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 0x7f08300c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35260/0 (socket says 172.21.15.40:35260) 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 -- 172.21.15.40:0/2685278828 learned_addr learned my addr 172.21.15.40:0/2685278828 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0835970640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08300b0a50 0x7f083014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0836171640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f083015c160 0x7f08300c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 -- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f083015c160 msgr2=0x7f08300c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f083015c160 0x7f08300c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 -- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08300b0a50 msgr2=0x7f083014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08300b0a50 0x7f083014bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 -- 172.21.15.40:0/2685278828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200094d0 con 0x7f083015acb0 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f083516f640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 0x7f08300c7320 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f08200ac040 tx=0x7f082001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200bd5f0 con 0x7f083015acb0 2023-11-04T01:44:40.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08200bd770 con 0x7f083015acb0 2023-11-04T01:44:40.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08300c82d0 con 0x7f083015acb0 2023-11-04T01:44:40.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.393+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08200bdb20 con 0x7f083015acb0 2023-11-04T01:44:40.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08300c8890 con 0x7f083015acb0 2023-11-04T01:44:40.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08300744a0 con 0x7f083015acb0 2023-11-04T01:44:40.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08200b33f0 con 0x7f083015acb0 2023-11-04T01:44:40.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f08267fc640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08140664a0 0x7f0814068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f08200a7070 con 0x7f083015acb0 2023-11-04T01:44:40.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f0835970640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08140664a0 0x7f0814068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.397+0000 7f0835970640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08140664a0 0x7f0814068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f082c009a70 tx=0x7f082c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.401+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08200ebfe0 con 0x7f083015acb0 2023-11-04T01:44:40.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:40.613+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f08300c8130 con 0x7f083015acb0 2023-11-04T01:44:41.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.001+0000 7f08267fc640 1 -- 172.21.15.40:0/2685278828 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7440 v69) v1 ==== 112+0+0 (secure 0 0 0) 0x7f08300c8130 con 0x7f083015acb0 2023-11-04T01:44:41.009 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.7440 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08140664a0 msgr2=0x7f0814068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08140664a0 0x7f0814068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f082c009a70 tx=0x7f082c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 msgr2=0x7f08300c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 0x7f08300c7320 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f08200ac040 tx=0x7f082001ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 shutdown_connections 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08140664a0 0x7f0814068960 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f083015c160 0x7f08300c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f083015acb0 0x7f08300c7320 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 --2- 172.21.15.40:0/2685278828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08300b0a50 0x7f083014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 >> 172.21.15.40:0/2685278828 conn(0x7f08300cb510 msgr2=0x7f083015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:41.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 shutdown_connections 2023-11-04T01:44:41.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.005+0000 7f0837bd4640 1 -- 172.21.15.40:0/2685278828 wait complete. 2023-11-04T01:44:41.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:44:41.176 INFO:teuthology.orchestra.run.smithi040.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:44:41.176 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:44:41.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:41.177 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-04T01:44:41.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:44:41.196 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7fdfd66cb640 time 2023-11-04T01:44:41.196571+0000 2023-11-04T01:44:41.197 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:41.198 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdfdc7f7fae] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.199 INFO:tasks.ceph.mds.c.smithi040.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdfd66cb640 thread_name:ms_dispatch 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:44:41.193+0000 7fdfd66cb640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7fdfd66cb640 time 2023-11-04T01:44:41.196571+0000 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdfdc7f7fae] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.200 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdfdc132520] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdfdc7f8008] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.201 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.202 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.203 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:44:41.193+0000 7fdfd66cb640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:41.203 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdfd66cb640 thread_name:ms_dispatch 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdfdc132520] 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:44:41.205 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdfdc7f8008] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.206 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: -357> 2023-11-04T01:44:37.297+0000 7fdfd3ec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: -355> 2023-11-04T01:44:37.297+0000 7fdfd3ec6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: -1> 2023-11-04T01:44:41.193+0000 7fdfd66cb640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7fdfd66cb640 time 2023-11-04T01:44:41.196571+0000 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdfdc7f7fae] 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.207 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 0> 2023-11-04T01:44:41.193+0000 7fdfd66cb640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdfd66cb640 thread_name:ms_dispatch 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdfdc132520] 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:44:41.208 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdfdc7f8008] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.209 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:41.210 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.210 INFO:tasks.ceph.mds.c.smithi040.stderr: -357> 2023-11-04T01:44:37.297+0000 7fdfd3ec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:41.210 INFO:tasks.ceph.mds.c.smithi040.stderr: -355> 2023-11-04T01:44:37.297+0000 7fdfd3ec6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:41.210 INFO:tasks.ceph.mds.c.smithi040.stderr: -1> 2023-11-04T01:44:41.193+0000 7fdfd66cb640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7fdfd66cb640 time 2023-11-04T01:44:41.196571+0000 2023-11-04T01:44:41.210 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:41.210 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdfdc7f7fae] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.211 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 0> 2023-11-04T01:44:41.193+0000 7fdfd66cb640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdfd66cb640 thread_name:ms_dispatch 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdfdc132520] 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdfdc7f8008] 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdfdc7f8162] 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55568308516d] 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x555682e17969] 2023-11-04T01:44:41.212 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x555682e199eb] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555682e19ebc] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x555682e047f5] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fdfdc9e3f2a] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fdfdca767f1] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdfdc184b43] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdfdc216a00] 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:41.213 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:44:41.328 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:44:41.328 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:44:41.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:41.376 INFO:tasks.ceph.mds.c.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:44:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 Processor -- start 2023-11-04T01:44:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 -- start start 2023-11-04T01:44:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f140b4990 0x7f9f140b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f140cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f140b6070 con 0x7f9f140d0690 2023-11-04T01:44:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f140b8ed0 con 0x7f9f140b4990 2023-11-04T01:44:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f1b2db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140b52b0 con 0x7f9f140b74f0 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f18876640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f140d0690 0x7f9f140cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47274/0 (socket says 172.21.15.40:47274) 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f18876640 1 -- 172.21.15.40:0/207369380 learned_addr learned my addr 172.21.15.40:0/207369380 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f19878640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f140cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f19077640 1 --2- 172.21.15.40:0/207369380 >> v2:172.21.15.91:3300/0 conn(0x7f9f140b4990 0x7f9f140b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308443025 0 0) 0x7f9f140b6070 con 0x7f9f140d0690 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f00003530 con 0x7f9f140d0690 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3479071756 0 0) 0x7f9f00003530 con 0x7f9f140d0690 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 msgr2=0x7f9f140cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f140cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 >> v2:172.21.15.91:3300/0 conn(0x7f9f140b4990 msgr2=0x7f9f140b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 --2- 172.21.15.40:0/207369380 >> v2:172.21.15.91:3300/0 conn(0x7f9f140b4990 0x7f9f140b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.489+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140d1ce0 con 0x7f9f140d0690 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9f04001680 con 0x7f9f140d0690 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 >> v1:172.21.15.40:6789/0 conn(0x7f9f140d0690 legacy=0x7f9f140cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f00003980 0x7f9f00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f00004d10 0x7f9f00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140b8ed0 con 0x7f9f00003980 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140b52b0 con 0x7f9f00004d10 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0000b990 con 0x7f9f140b74f0 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f00003980 0x7f9f00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f18876640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19878640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f00004d10 0x7f9f00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 -- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 msgr2=0x7f9f000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 -- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f00004d10 msgr2=0x7f9f00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f00004d10 0x7f9f00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 -- 172.21.15.40:0/207369380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f00003530 con 0x7f9f00003980 2023-11-04T01:44:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f18876640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f140b74f0 0x7f9f000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19077640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f00003980 0x7f9f00003da0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009ae0 tx=0x7f9f1001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0ad76d1d621b34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100a5680 con 0x7f9f00003980 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f100a57e0 con 0x7f9f00003980 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f0bfff640 1 -- 172.21.15.40:0/207369380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100a5b90 con 0x7f9f00003980 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f1b2db640 1 -- 172.21.15.40:0/207369380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f00003980 msgr2=0x7f9f00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/207369380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f00003980 0x7f9f00003da0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009ae0 tx=0x7f9f1001ca90 comp rx=0 tx=0).stop 2023-11-04T01:44:41.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f19878640 1 -- 172.21.15.40:0/207369380 reap_dead start 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f1b2db640 1 -- 172.21.15.40:0/207369380 shutdown_connections 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f1b2db640 1 -- 172.21.15.40:0/207369380 >> 172.21.15.40:0/207369380 conn(0x7f9f140cf990 msgr2=0x7f9f140cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f1b2db640 1 -- 172.21.15.40:0/207369380 shutdown_connections 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.493+0000 7f9f1b2db640 1 -- 172.21.15.40:0/207369380 wait complete. 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 Processor -- start 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- start start 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f00003980 0x7f9f141f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f140cca80 0x7f9f140a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 0x7f9f140b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f140cb200 con 0x7f9f140abd40 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f141f2b10 con 0x7f9f140cca80 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f141f2df0 con 0x7f9f00003980 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 0x7f9f140b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 0x7f9f140b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35282/0 (socket says 172.21.15.40:35282) 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 -- 172.21.15.40:0/1309556512 learned_addr learned my addr 172.21.15.40:0/1309556512 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19077640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f00003980 0x7f9f141f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f18876640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f140cca80 0x7f9f140a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 -- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f00003980 msgr2=0x7f9f141f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f00003980 0x7f9f141f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 -- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f140cca80 msgr2=0x7f9f140a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f140cca80 0x7f9f140a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 -- 172.21.15.40:0/1309556512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f141f30d0 con 0x7f9f140abd40 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f19878640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 0x7f9f140b3a20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9f140cf090 tx=0x7f9f0c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c00e070 con 0x7f9f140abd40 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c011e10 con 0x7f9f140abd40 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0039a0 con 0x7f9f140abd40 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f141f33b0 con 0x7f9f140abd40 2023-11-04T01:44:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f140ccf00 con 0x7f9f140abd40 2023-11-04T01:44:41.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.497+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f140744a0 con 0x7f9f140abd40 2023-11-04T01:44:41.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.501+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f0c003b00 con 0x7f9f140abd40 2023-11-04T01:44:41.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.501+0000 7f9f09ffb640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ef80664a0 0x7f9ef8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:41.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.501+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f9f0c084ae0 con 0x7f9f140abd40 2023-11-04T01:44:41.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.501+0000 7f9f19077640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ef80664a0 0x7f9ef8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:41.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.501+0000 7f9f19077640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ef80664a0 0x7f9ef8068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f100af000 tx=0x7f9f100046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:41.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.505+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f0c0519b0 con 0x7f9f140abd40 2023-11-04T01:44:41.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.693+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f140cb340 con 0x7f9f140abd40 2023-11-04T01:44:41.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.693+0000 7f9f09ffb640 1 -- 172.21.15.40:0/1309556512 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f9f0c054fd0 con 0x7f9f140abd40 2023-11-04T01:44:41.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:41.700 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:40.621390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:41.700 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 69 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ef80664a0 msgr2=0x7f9ef8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ef80664a0 0x7f9ef8068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f100af000 tx=0x7f9f100046d0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 msgr2=0x7f9f140b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 0x7f9f140b3a20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9f140cf090 tx=0x7f9f0c0115a0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 shutdown_connections 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9ef80664a0 0x7f9ef8068960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f140abd40 0x7f9f140b3a20 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f140cca80 0x7f9f140a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 --2- 172.21.15.40:0/1309556512 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f00003980 0x7f9f141f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 >> 172.21.15.40:0/1309556512 conn(0x7f9f140cf990 msgr2=0x7f9f140d2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:41.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 shutdown_connections 2023-11-04T01:44:41.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:41.697+0000 7f9f1b2db640 1 -- 172.21.15.40:0/1309556512 wait complete. 2023-11-04T01:44:41.719 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:42.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:44:46.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674e67a640 1 Processor -- start 2023-11-04T01:44:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674e67a640 1 -- start start 2023-11-04T01:44:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674e67a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f674806c630 0x7f67480b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674e67a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480cd400 con 0x7f674815d2b0 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674e67a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480cd6e0 con 0x7f674815d690 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674e67a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67480ad450 con 0x7f674806c630 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6747fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f674815d2b0 0x7f67480ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47280/0 (socket says 172.21.15.40:47280) 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6747fff640 1 -- 172.21.15.40:0/2699417932 learned_addr learned my addr 172.21.15.40:0/2699417932 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 --2- 172.21.15.40:0/2699417932 >> v2:172.21.15.91:3300/0 conn(0x7f674806c630 0x7f67480b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066195483 0 0) 0x7f67480cd400 con 0x7f674815d2b0 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6734003530 con 0x7f674815d2b0 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 980792084 0 0) 0x7f6734003530 con 0x7f674815d2b0 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 >> v2:172.21.15.91:3300/0 conn(0x7f674806c630 msgr2=0x7f67480b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 --2- 172.21.15.40:0/2699417932 >> v2:172.21.15.91:3300/0 conn(0x7f674806c630 0x7f67480b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 >> v1:172.21.15.91:6789/0 conn(0x7f674815d690 legacy=0x7f674806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67480ad070 con 0x7f674815d2b0 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f6730001680 con 0x7f674815d2b0 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 >> v1:172.21.15.40:6789/0 conn(0x7f674815d2b0 legacy=0x7f67480ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734003980 0x7f6734003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67340047d0 0x7f6734004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734005190 0x7f673400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480ad450 con 0x7f6734005190 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673400c130 con 0x7f67340047d0 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673400c2f0 con 0x7f6734003980 2023-11-04T01:44:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734005190 0x7f673400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f67477fe640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67340047d0 0x7f6734004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f6747fff640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734003980 0x7f6734003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 -- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734003980 msgr2=0x7f6734003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734003980 0x7f6734003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 -- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67340047d0 msgr2=0x7f6734004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67340047d0 0x7f6734004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.853+0000 7f674cc17640 1 -- 172.21.15.40:0/2699417932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734003530 con 0x7f6734005190 2023-11-04T01:44:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674cc17640 1 -- 172.21.15.40:0/2699417932 reap_dead start 2023-11-04T01:44:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674cc17640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734005190 0x7f673400b990 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6740009ae0 tx=0x7f674001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31400288fdcd8c6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740004020 con 0x7f6734005190 2023-11-04T01:44:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67400041c0 con 0x7f6734005190 2023-11-04T01:44:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f6746ffd640 1 -- 172.21.15.40:0/2699417932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740003620 con 0x7f6734005190 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- 172.21.15.40:0/2699417932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734005190 msgr2=0x7f673400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734005190 0x7f673400b990 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6740009ae0 tx=0x7f674001ca90 comp rx=0 tx=0).stop 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- 172.21.15.40:0/2699417932 shutdown_connections 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 --2- 172.21.15.40:0/2699417932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734005190 0x7f673400b990 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- 172.21.15.40:0/2699417932 >> 172.21.15.40:0/2699417932 conn(0x7f67480cebb0 msgr2=0x7f67480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- 172.21.15.40:0/2699417932 shutdown_connections 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- 172.21.15.40:0/2699417932 wait complete. 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 Processor -- start 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- start start 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734005190 0x7f6748158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 0x7f67480ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67480ca8f0 0x7f67480c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480cb9c0 con 0x7f6748160490 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480cbe50 con 0x7f67480ca8f0 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.857+0000 7f674e67a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480cadb0 con 0x7f6734005190 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 0x7f67480ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 0x7f67480ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35306/0 (socket says 172.21.15.40:35306) 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 -- 172.21.15.40:0/1123435050 learned_addr learned my addr 172.21.15.40:0/1123435050 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f674cc17640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67480ca8f0 0x7f67480c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6747fff640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734005190 0x7f6748158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 -- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734005190 msgr2=0x7f6748158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734005190 0x7f6748158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 -- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67480ca8f0 msgr2=0x7f67480c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67480ca8f0 0x7f67480c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 -- 172.21.15.40:0/1123435050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67480cb090 con 0x7f6748160490 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f674cc17640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67480ca8f0 0x7f67480c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f67477fe640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 0x7f67480ca3b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f673800e820 tx=0x7f673800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738003b90 con 0x7f6748160490 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6738003cf0 con 0x7f6748160490 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67480cb370 con 0x7f6748160490 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380052f0 con 0x7f6748160490 2023-11-04T01:44:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67480c7420 con 0x7f6748160490 2023-11-04T01:44:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67480accf0 con 0x7f6748160490 2023-11-04T01:44:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6738005450 con 0x7f6748160490 2023-11-04T01:44:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6744ff9640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f6738084f80 con 0x7f6748160490 2023-11-04T01:44:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6747fff640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.861+0000 7f6747fff640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67280664a0 0x7f6728068960 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6730005360 tx=0x7f6730009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:46.865+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6738051ed0 con 0x7f6748160490 2023-11-04T01:44:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.053+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67480744a0 con 0x7f6748160490 2023-11-04T01:44:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.053+0000 7f6744ff9640 1 -- 172.21.15.40:0/1123435050 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f6738003e60 con 0x7f6748160490 2023-11-04T01:44:47.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:47.056 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:40.621390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 69 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67280664a0 msgr2=0x7f6728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67280664a0 0x7f6728068960 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6730005360 tx=0x7f6730009040 comp rx=0 tx=0).stop 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 msgr2=0x7f67480ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 0x7f67480ca3b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f673800e820 tx=0x7f673800ece0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 shutdown_connections 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f67480ca8f0 0x7f67480c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6748160490 0x7f67480ca3b0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 --2- 172.21.15.40:0/1123435050 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6734005190 0x7f6748158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 >> 172.21.15.40:0/1123435050 conn(0x7f67480cebb0 msgr2=0x7f674806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 shutdown_connections 2023-11-04T01:44:47.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:47.057+0000 7f674e67a640 1 -- 172.21.15.40:0/1123435050 wait complete. 2023-11-04T01:44:47.075 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:48.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:44:52.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:52.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd436e6e640 1 Processor -- start 2023-11-04T01:44:52.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd436e6e640 1 -- start start 2023-11-04T01:44:52.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd436e6e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4300b0890 0x7fd4300cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd436e6e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4300ce320 con 0x7fd4300b0c70 2023-11-04T01:44:52.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd436e6e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4300ce600 con 0x7fd4300c9960 2023-11-04T01:44:52.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd436e6e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43006d2f0 con 0x7fd4300b0890 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd434c0a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4300b0890 0x7fd4300cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd43540b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd4300b0c70 0x7fd4300ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60822/0 (socket says 172.21.15.40:60822) 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd43540b640 1 -- 172.21.15.40:0/542468879 learned_addr learned my addr 172.21.15.40:0/542468879 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd434c0a640 1 -- 172.21.15.40:0/542468879 >> v1:172.21.15.91:6789/0 conn(0x7fd4300c9960 legacy=0x7fd4300704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd434c0a640 1 -- 172.21.15.40:0/542468879 >> v1:172.21.15.40:6789/0 conn(0x7fd4300b0c70 legacy=0x7fd4300ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd42f7fe640 1 -- 172.21.15.40:0/542468879 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029752730 0 0) 0x7fd4300ce320 con 0x7fd4300b0c70 2023-11-04T01:44:52.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.213+0000 7fd434c0a640 1 -- 172.21.15.40:0/542468879 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300ce8e0 con 0x7fd4300b0890 2023-11-04T01:44:52.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd434c0a640 1 --2- 172.21.15.40:0/542468879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300b0890 0x7fd4300cdbd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd4240097c0 tx=0x7fd42401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e174ad6e607d2531 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd42f7fe640 1 -- 172.21.15.40:0/542468879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240ab600 con 0x7fd4300b0890 2023-11-04T01:44:52.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd42f7fe640 1 -- 172.21.15.40:0/542468879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4240a7050 con 0x7fd4300b0890 2023-11-04T01:44:52.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd42f7fe640 1 -- 172.21.15.40:0/542468879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240ab980 con 0x7fd4300b0890 2023-11-04T01:44:52.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- 172.21.15.40:0/542468879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300b0890 msgr2=0x7fd4300cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 --2- 172.21.15.40:0/542468879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300b0890 0x7fd4300cdbd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd4240097c0 tx=0x7fd42401c480 comp rx=0 tx=0).stop 2023-11-04T01:44:52.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- 172.21.15.40:0/542468879 shutdown_connections 2023-11-04T01:44:52.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 --2- 172.21.15.40:0/542468879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300b0890 0x7fd4300cdbd0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- 172.21.15.40:0/542468879 >> 172.21.15.40:0/542468879 conn(0x7fd4300cebb0 msgr2=0x7fd4300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- 172.21.15.40:0/542468879 shutdown_connections 2023-11-04T01:44:52.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- 172.21.15.40:0/542468879 wait complete. 2023-11-04T01:44:52.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 Processor -- start 2023-11-04T01:44:52.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- start start 2023-11-04T01:44:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4300b0890 0x7fd4300c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4300b0c70 0x7fd430153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 0x7fd43014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300c8840 con 0x7fd4300c9960 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300c7f10 con 0x7fd4300b0890 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd436e6e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300c81f0 con 0x7fd4300b0c70 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd43540b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 0x7fd43014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd43540b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 0x7fd43014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46082/0 (socket says 172.21.15.40:46082) 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.217+0000 7fd43540b640 1 -- 172.21.15.40:0/734371059 learned_addr learned my addr 172.21.15.40:0/734371059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd434c0a640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4300b0890 0x7fd4300c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42ffff640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4300b0c70 0x7fd430153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd43540b640 1 -- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4300b0c70 msgr2=0x7fd430153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd43540b640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4300b0c70 0x7fd430153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd43540b640 1 -- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4300b0890 msgr2=0x7fd4300c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd43540b640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4300b0890 0x7fd4300c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd43540b640 1 -- 172.21.15.40:0/734371059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd424009420 con 0x7fd4300c9960 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42ffff640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4300b0c70 0x7fd430153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd43540b640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 0x7fd43014e090 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd428001570 tx=0x7fd42800ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428004d80 con 0x7fd4300c9960 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42800ca30 con 0x7fd4300c9960 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800cde0 con 0x7fd4300c9960 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300c84d0 con 0x7fd4300c9960 2023-11-04T01:44:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300c63e0 con 0x7fd4300c9960 2023-11-04T01:44:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4300744a0 con 0x7fd4300c9960 2023-11-04T01:44:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4280070d0 con 0x7fd4300c9960 2023-11-04T01:44:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42d7fa640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4140664a0 0x7fd414068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fd428086c30 con 0x7fd4300c9960 2023-11-04T01:44:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.221+0000 7fd434c0a640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4140664a0 0x7fd414068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.225+0000 7fd434c0a640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4140664a0 0x7fd414068960 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd4240ad000 tx=0x7fd424008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.225+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd428053b20 con 0x7fd4300c9960 2023-11-04T01:44:52.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4300c8980 con 0x7fd4300c9960 2023-11-04T01:44:52.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd42d7fa640 1 -- 172.21.15.40:0/734371059 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fd428015020 con 0x7fd4300c9960 2023-11-04T01:44:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:52.419 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:40.621390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:52.419 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 69 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4140664a0 msgr2=0x7fd414068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4140664a0 0x7fd414068960 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd4240ad000 tx=0x7fd424008040 comp rx=0 tx=0).stop 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 msgr2=0x7fd43014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 0x7fd43014e090 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd428001570 tx=0x7fd42800ef50 comp rx=0 tx=0).stop 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 shutdown_connections 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4140664a0 0x7fd414068960 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4300c9960 0x7fd43014e090 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4300b0c70 0x7fd430153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 --2- 172.21.15.40:0/734371059 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4300b0890 0x7fd4300c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 >> 172.21.15.40:0/734371059 conn(0x7fd4300cebb0 msgr2=0x7fd4300cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 shutdown_connections 2023-11-04T01:44:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:52.417+0000 7fd436e6e640 1 -- 172.21.15.40:0/734371059 wait complete. 2023-11-04T01:44:52.438 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:55.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:44:57.438 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:57.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 Processor -- start 2023-11-04T01:44:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 -- start start 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1000b4990 0x7fe1000b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000d0690 0x7fe1000cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe1000d0ae0 0x7fe1000cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000b6070 con 0x7fe1000b4990 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000b8ed0 con 0x7fe1000d0ae0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe107a37640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000b52b0 con 0x7fe1000d0690 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1000b4990 0x7fe1000b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1000b4990 0x7fe1000b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44954/0 (socket says 172.21.15.40:44954) 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 -- 172.21.15.40:0/2887538132 learned_addr learned my addr 172.21.15.40:0/2887538132 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe104fd2640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000d0690 0x7fe1000cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe105fd4640 1 --2- 172.21.15.40:0/2887538132 >> v2:172.21.15.91:3300/0 conn(0x7fe1000d0ae0 0x7fe1000cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 -- 172.21.15.40:0/2887538132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000d0690 msgr2=0x7fe1000cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000d0690 0x7fe1000cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 -- 172.21.15.40:0/2887538132 >> v2:172.21.15.91:3300/0 conn(0x7fe1000d0ae0 msgr2=0x7fe1000cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 --2- 172.21.15.40:0/2887538132 >> v2:172.21.15.91:3300/0 conn(0x7fe1000d0ae0 0x7fe1000cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe1057d3640 1 -- 172.21.15.40:0/2887538132 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1000d1ce0 con 0x7fe1000b4990 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe104fd2640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000d0690 0x7fe1000cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.572+0000 7fe105fd4640 1 --2- 172.21.15.40:0/2887538132 >> v2:172.21.15.91:3300/0 conn(0x7fe1000d0ae0 0x7fe1000cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe1057d3640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000b4990 0x7fe1000b4d70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fe100079850 tx=0x7fe0fc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff0e4e6e0c5b85f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe0f7fff640 1 -- 172.21.15.40:0/2887538132 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0a89b0 con 0x7fe1000b4990 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe0f7fff640 1 -- 172.21.15.40:0/2887538132 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc0a8b10 con 0x7fe1000b4990 2023-11-04T01:44:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe0f7fff640 1 -- 172.21.15.40:0/2887538132 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0a8ea0 con 0x7fe1000b4990 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- 172.21.15.40:0/2887538132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000b4990 msgr2=0x7fe1000b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000b4990 0x7fe1000b4d70 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fe100079850 tx=0x7fe0fc01ecf0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- 172.21.15.40:0/2887538132 shutdown_connections 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- 172.21.15.40:0/2887538132 >> v2:172.21.15.91:3300/0 conn(0x7fe1000d0ae0 0x7fe1000cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000d0690 0x7fe1000cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- 172.21.15.40:0/2887538132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000b4990 0x7fe1000b4d70 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- 172.21.15.40:0/2887538132 >> 172.21.15.40:0/2887538132 conn(0x7fe1000cf990 msgr2=0x7fe1000cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- 172.21.15.40:0/2887538132 shutdown_connections 2023-11-04T01:44:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- 172.21.15.40:0/2887538132 wait complete. 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 Processor -- start 2023-11-04T01:44:57.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- start start 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000b4990 0x7fe100156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000d0690 0x7fe1000cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 0x7fe1000b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000cb080 con 0x7fe1000d0ae0 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000c9fe0 con 0x7fe1000d0690 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe107a37640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000ca2c0 con 0x7fe1000b4990 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 0x7fe1000b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 0x7fe1000b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44964/0 (socket says 172.21.15.40:44964) 2023-11-04T01:44:57.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 -- 172.21.15.40:0/1953423955 learned_addr learned my addr 172.21.15.40:0/1953423955 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe1057d3640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000b4990 0x7fe100156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe104fd2640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000d0690 0x7fe1000cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 -- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000b4990 msgr2=0x7fe100156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000b4990 0x7fe100156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 -- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000d0690 msgr2=0x7fe1000cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.576+0000 7fe105fd4640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000d0690 0x7fe1000cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe105fd4640 1 -- 172.21.15.40:0/1953423955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0094d0 con 0x7fe1000d0ae0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe1057d3640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000b4990 0x7fe100156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe105fd4640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 0x7fe1000b2fc0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8007ef0 tx=0x7fe0f800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8003ba0 con 0x7fe1000d0ae0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f800f040 con 0x7fe1000d0ae0 2023-11-04T01:44:57.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800de80 con 0x7fe1000d0ae0 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1000ca5a0 con 0x7fe1000d0ae0 2023-11-04T01:44:57.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1000cab60 con 0x7fe1000d0ae0 2023-11-04T01:44:57.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1000cad80 con 0x7fe1000d0ae0 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0f8004030 con 0x7fe1000d0ae0 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe0f5ffb640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0e40664a0 0x7fe0e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fe0f8084520 con 0x7fe1000d0ae0 2023-11-04T01:44:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe1057d3640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0e40664a0 0x7fe0e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.580+0000 7fe1057d3640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0e40664a0 0x7fe0e4068960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0b2000 tx=0x7fe0fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.587 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:57.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.584+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe0f80515d0 con 0x7fe1000d0ae0 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.772+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1000cbf40 con 0x7fe1000d0ae0 2023-11-04T01:44:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe0f5ffb640 1 -- 172.21.15.40:0/1953423955 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fe0f8054bf0 con 0x7fe1000d0ae0 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:40.621390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 69 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0e40664a0 msgr2=0x7fe0e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0e40664a0 0x7fe0e4068960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0b2000 tx=0x7fe0fc008040 comp rx=0 tx=0).stop 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 msgr2=0x7fe1000b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 0x7fe1000b2fc0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8007ef0 tx=0x7fe0f800d4a0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 shutdown_connections 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0e40664a0 0x7fe0e4068960 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1000d0ae0 0x7fe1000b2fc0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1000d0690 0x7fe1000cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 --2- 172.21.15.40:0/1953423955 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1000b4990 0x7fe100156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 >> 172.21.15.40:0/1953423955 conn(0x7fe1000cf990 msgr2=0x7fe1000d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 shutdown_connections 2023-11-04T01:44:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:44:57.776+0000 7fe107a37640 1 -- 172.21.15.40:0/1953423955 wait complete. 2023-11-04T01:44:57.796 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:02.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-11-04T01:45:02.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:02.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 Processor -- start 2023-11-04T01:45:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 -- start start 2023-11-04T01:45:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0b4990 0x7f749c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f749c0d0690 0x7f749c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f749c0d0ae0 0x7f749c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c0b6070 con 0x7f749c0d0690 2023-11-04T01:45:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c0b8ed0 con 0x7f749c0d0ae0 2023-11-04T01:45:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f74a1918640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c0b52b0 con 0x7f749c0b4990 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f749c0d0690 0x7f749c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f749c0d0690 0x7f749c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44972/0 (socket says 172.21.15.40:44972) 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 -- 172.21.15.40:0/1842229405 learned_addr learned my addr 172.21.15.40:0/1842229405 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f749b7fe640 1 --2- 172.21.15.40:0/1842229405 >> v2:172.21.15.91:3300/0 conn(0x7f749c0d0ae0 0x7f749c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f749affd640 1 --2- 172.21.15.40:0/1842229405 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0b4990 0x7f749c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 -- 172.21.15.40:0/1842229405 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0b4990 msgr2=0x7f749c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 --2- 172.21.15.40:0/1842229405 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0b4990 0x7f749c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 -- 172.21.15.40:0/1842229405 >> v2:172.21.15.91:3300/0 conn(0x7f749c0d0ae0 msgr2=0x7f749c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 --2- 172.21.15.40:0/1842229405 >> v2:172.21.15.91:3300/0 conn(0x7f749c0d0ae0 0x7f749c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.928+0000 7f7493fff640 1 -- 172.21.15.40:0/1842229405 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c0d1ce0 con 0x7f749c0d0690 2023-11-04T01:45:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f7493fff640 1 --2- 172.21.15.40:0/1842229405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0d0690 0x7f749c0cd770 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f749c0b5f30 tx=0x7f748401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80228236329d9496 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f749a7fc640 1 -- 172.21.15.40:0/1842229405 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840a89b0 con 0x7f749c0d0690 2023-11-04T01:45:02.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f749a7fc640 1 -- 172.21.15.40:0/1842229405 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840a8b10 con 0x7f749c0d0690 2023-11-04T01:45:02.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f749a7fc640 1 -- 172.21.15.40:0/1842229405 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840a8ea0 con 0x7f749c0d0690 2023-11-04T01:45:02.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 -- 172.21.15.40:0/1842229405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0d0690 msgr2=0x7f749c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 --2- 172.21.15.40:0/1842229405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0d0690 0x7f749c0cd770 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f749c0b5f30 tx=0x7f748401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 -- 172.21.15.40:0/1842229405 shutdown_connections 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 --2- 172.21.15.40:0/1842229405 >> v2:172.21.15.91:3300/0 conn(0x7f749c0d0ae0 0x7f749c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 --2- 172.21.15.40:0/1842229405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0d0690 0x7f749c0cd770 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 --2- 172.21.15.40:0/1842229405 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0b4990 0x7f749c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 -- 172.21.15.40:0/1842229405 >> 172.21.15.40:0/1842229405 conn(0x7f749c0cf990 msgr2=0x7f749c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 -- 172.21.15.40:0/1842229405 shutdown_connections 2023-11-04T01:45:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 -- 172.21.15.40:0/1842229405 wait complete. 2023-11-04T01:45:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 Processor -- start 2023-11-04T01:45:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.932+0000 7f74a1918640 1 -- start start 2023-11-04T01:45:02.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 0x7f749c1e9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f749c0d0690 0x7f749c14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0d0ae0 0x7f749c1e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c1e9650 con 0x7f749c0b4990 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15d700 con 0x7f749c0d0690 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c1e66e0 con 0x7f749c0d0ae0 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 0x7f749c1e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 0x7f749c1e9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44978/0 (socket says 172.21.15.40:44978) 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 -- 172.21.15.40:0/3363251744 learned_addr learned my addr 172.21.15.40:0/3363251744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7493fff640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f749c0d0690 0x7f749c14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749b7fe640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0d0ae0 0x7f749c1e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 -- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0d0ae0 msgr2=0x7f749c1e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0d0ae0 0x7f749c1e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 -- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f749c0d0690 msgr2=0x7f749c14d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f749c0d0690 0x7f749c14d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 -- 172.21.15.40:0/3363251744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840094d0 con 0x7f749c0b4990 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7493fff640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f749c0d0690 0x7f749c14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f749affd640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 0x7f749c1e9110 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f748c00d800 tx=0x7f748c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0096a0 con 0x7f749c0b4990 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c009800 con 0x7f749c0b4990 2023-11-04T01:45:02.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c009990 con 0x7f749c0b4990 2023-11-04T01:45:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c1e69c0 con 0x7f749c0b4990 2023-11-04T01:45:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c14d7f0 con 0x7f749c0b4990 2023-11-04T01:45:02.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c1e6ee0 con 0x7f749c0b4990 2023-11-04T01:45:02.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f748c009af0 con 0x7f749c0b4990 2023-11-04T01:45:02.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7498ff9640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f747c0664d0 0x7f747c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.936+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f748c0847f0 con 0x7f749c0b4990 2023-11-04T01:45:02.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.940+0000 7f7493fff640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f747c0664d0 0x7f747c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.940+0000 7f7493fff640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f747c0664d0 0x7f747c068990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f74840b2000 tx=0x7f7484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:02.944+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f749c1e6ee0 con 0x7f749c0b4990 2023-11-04T01:45:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.132+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f749c1e6ee0 con 0x7f749c0b4990 2023-11-04T01:45:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.132+0000 7f7498ff9640 1 -- 172.21.15.40:0/3363251744 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4976 (secure 0 0 0) 0x7f749c1e6ee0 con 0x7f749c0b4990 2023-11-04T01:45:03.136 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:03.137 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:44:57.967721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7440,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7440":{"gid":7440,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":12,"addr":"172.21.15.40:6835/1813470604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1813470604},{"type":"v1","addr":"172.21.15.40:6835","nonce":1813470604}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:57.967721+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 70 2023-11-04T01:45:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f747c0664d0 msgr2=0x7f747c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f747c0664d0 0x7f747c068990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f74840b2000 tx=0x7f7484008040 comp rx=0 tx=0).stop 2023-11-04T01:45:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 msgr2=0x7f749c1e9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 0x7f749c1e9110 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f748c00d800 tx=0x7f748c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 shutdown_connections 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f747c0664d0 0x7f747c068990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f749c0d0ae0 0x7f749c1e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f749c0d0690 0x7f749c14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 --2- 172.21.15.40:0/3363251744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f749c0b4990 0x7f749c1e9110 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 >> 172.21.15.40:0/3363251744 conn(0x7f749c0cf990 msgr2=0x7f749c0b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 shutdown_connections 2023-11-04T01:45:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.136+0000 7f74a1918640 1 -- 172.21.15.40:0/3363251744 wait complete. 2023-11-04T01:45:03.156 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:45:03.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:45:03.167 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:45:03.168 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:45:03.168 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:45:03.223 INFO:teuthology.orchestra.run.smithi040.stdout:1699062281.56462.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:45:03.225 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062281.56462.core'] 2023-11-04T01:45:03.225 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062281.56462.core, deleting it 2023-11-04T01:45:03.225 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062281.56462.core 2023-11-04T01:45:03.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:45:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a71e4a640 1 Processor -- start 2023-11-04T01:45:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a71e4a640 1 -- start start 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a71e4a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a6c15afd0 0x7f3a6c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a71e4a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0c2670 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a71e4a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c06bc30 con 0x7f3a6c06f8f0 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a71e4a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c070140 con 0x7f3a6c15afd0 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a6b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a6c15afd0 0x7f3a6c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a6bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3a6c0b0d40 0x7f3a6c15ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52304/0 (socket says 172.21.15.40:52304) 2023-11-04T01:45:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.456+0000 7f3a6bfff640 1 -- 172.21.15.40:0/1993513241 learned_addr learned my addr 172.21.15.40:0/1993513241 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6b7fe640 1 -- 172.21.15.40:0/1993513241 >> v1:172.21.15.91:6789/0 conn(0x7f3a6c06f8f0 legacy=0x7f3a6c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6b7fe640 1 -- 172.21.15.40:0/1993513241 >> v1:172.21.15.40:6789/0 conn(0x7f3a6c0b0d40 legacy=0x7f3a6c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6b7fe640 1 -- 172.21.15.40:0/1993513241 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c06bf10 con 0x7f3a6c15afd0 2023-11-04T01:45:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6b7fe640 1 --2- 172.21.15.40:0/1993513241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c15afd0 0x7f3a6c0715d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097c0 tx=0x7f3a5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09040721ab05d60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6a7fc640 1 -- 172.21.15.40:0/1993513241 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0ab600 con 0x7f3a6c15afd0 2023-11-04T01:45:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6a7fc640 1 -- 172.21.15.40:0/1993513241 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0a7050 con 0x7f3a6c15afd0 2023-11-04T01:45:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a6a7fc640 1 -- 172.21.15.40:0/1993513241 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0ab980 con 0x7f3a6c15afd0 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 -- 172.21.15.40:0/1993513241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c15afd0 msgr2=0x7f3a6c0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/1993513241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c15afd0 0x7f3a6c0715d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097c0 tx=0x7f3a5c01c480 comp rx=0 tx=0).stop 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 -- 172.21.15.40:0/1993513241 shutdown_connections 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/1993513241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c15afd0 0x7f3a6c0715d0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 -- 172.21.15.40:0/1993513241 >> 172.21.15.40:0/1993513241 conn(0x7f3a6c0cebb0 msgr2=0x7f3a6c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 -- 172.21.15.40:0/1993513241 shutdown_connections 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.460+0000 7f3a71e4a640 1 -- 172.21.15.40:0/1993513241 wait complete. 2023-11-04T01:45:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 Processor -- start 2023-11-04T01:45:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- start start 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3a6c06f8f0 0x7f3a6c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 0x7f3a6c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3a6c15afd0 0x7f3a6c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c150590 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0c6ea0 con 0x7f3a6c06f8f0 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b4610 con 0x7f3a6c15afd0 2023-11-04T01:45:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 0x7f3a6c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 0x7f3a6c0b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44988/0 (socket says 172.21.15.40:44988) 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 -- 172.21.15.40:0/3219193869 learned_addr learned my addr 172.21.15.40:0/3219193869 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6b7fe640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3a6c06f8f0 0x7f3a6c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6bfff640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3a6c15afd0 0x7f3a6c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 -- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3a6c15afd0 msgr2=0x7f3a6c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3a6c15afd0 0x7f3a6c0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 -- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3a6c06f8f0 msgr2=0x7f3a6c14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3a6c06f8f0 0x7f3a6c14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 -- 172.21.15.40:0/3219193869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c009420 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6bfff640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3a6c15afd0 0x7f3a6c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a6affd640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 0x7f3a6c0b17d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c3c0 tx=0x7f3a6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600052d0 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60005430 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c0c6850 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60003840 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c0b38e0 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c0744a0 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.464+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a600039a0 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.468+0000 7f3a53fff640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3a580664a0 0x7f3a58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.468+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f3a600838b0 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.468+0000 7f3a6b7fe640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3a580664a0 0x7f3a58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.468+0000 7f3a6b7fe640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3a580664a0 0x7f3a58068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0ad000 tx=0x7f3a5c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.472+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a60050820 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.684+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f3a6c06cba0 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.688+0000 7f3a53fff640 1 -- 172.21.15.40:0/3219193869 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7440 v71) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3a60053e40 con 0x7f3a6c0b0d40 2023-11-04T01:45:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 7440 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3a580664a0 msgr2=0x7f3a58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3a580664a0 0x7f3a58068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0ad000 tx=0x7f3a5c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 msgr2=0x7f3a6c0b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 0x7f3a6c0b17d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000c3c0 tx=0x7f3a6000c880 comp rx=0 tx=0).stop 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 shutdown_connections 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f3a580664a0 0x7f3a58068960 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3a6c15afd0 0x7f3a6c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a6c0b0d40 0x7f3a6c0b17d0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 --2- 172.21.15.40:0/3219193869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3a6c06f8f0 0x7f3a6c14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 >> 172.21.15.40:0/3219193869 conn(0x7f3a6c0cebb0 msgr2=0x7f3a6c0ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 shutdown_connections 2023-11-04T01:45:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.692+0000 7f3a71e4a640 1 -- 172.21.15.40:0/3219193869 wait complete. 2023-11-04T01:45:03.714 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:45:03.714 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:45:03.714 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:45:03.714 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:03.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:03.714 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:45:03.715 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:45:03.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:45:03.717 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:45:03.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:03.787 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:45:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 Processor -- start 2023-11-04T01:45:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 -- start start 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b4990 0x7f99900b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99900b74f0 0x7f99900cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99900b6070 con 0x7f99900d0690 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99900b8ed0 con 0x7f99900b74f0 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f99970df640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99900b52b0 con 0x7f99900b4990 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f99900d0690 0x7f99900cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52310/0 (socket says 172.21.15.40:52310) 2023-11-04T01:45:03.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998ffff640 1 -- 172.21.15.40:0/594938418 learned_addr learned my addr 172.21.15.40:0/594938418 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f999567c640 1 --2- 172.21.15.40:0/594938418 >> v2:172.21.15.40:3300/0 conn(0x7f99900b74f0 0x7f99900cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f9994e7b640 1 --2- 172.21.15.40:0/594938418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b4990 0x7f99900b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998f7fe640 1 -- 172.21.15.40:0/594938418 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107307857 0 0) 0x7f99900b6070 con 0x7f99900d0690 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998f7fe640 1 -- 172.21.15.40:0/594938418 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f997c003530 con 0x7f99900d0690 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f999567c640 1 -- 172.21.15.40:0/594938418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b4990 msgr2=0x7f99900b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f999567c640 1 --2- 172.21.15.40:0/594938418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b4990 0x7f99900b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f999567c640 1 -- 172.21.15.40:0/594938418 >> v1:172.21.15.40:6789/0 conn(0x7f99900d0690 legacy=0x7f99900cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f999567c640 1 -- 172.21.15.40:0/594938418 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99900d1ce0 con 0x7f99900b74f0 2023-11-04T01:45:03.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f999567c640 1 --2- 172.21.15.40:0/594938418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900b74f0 0x7f99900cde80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f99800097c0 tx=0x7f998001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20899d05d36f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998f7fe640 1 -- 172.21.15.40:0/594938418 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800a8970 con 0x7f99900b74f0 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998f7fe640 1 -- 172.21.15.40:0/594938418 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99800a8ad0 con 0x7f99900b74f0 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.836+0000 7f998f7fe640 1 -- 172.21.15.40:0/594938418 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800a8e40 con 0x7f99900b74f0 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/594938418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900b74f0 msgr2=0x7f99900cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 --2- 172.21.15.40:0/594938418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900b74f0 0x7f99900cde80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f99800097c0 tx=0x7f998001ec70 comp rx=0 tx=0).stop 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/594938418 shutdown_connections 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 --2- 172.21.15.40:0/594938418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900b74f0 0x7f99900cde80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 --2- 172.21.15.40:0/594938418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b4990 0x7f99900b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/594938418 >> 172.21.15.40:0/594938418 conn(0x7f99900cf990 msgr2=0x7f99900cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:03.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/594938418 shutdown_connections 2023-11-04T01:45:03.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/594938418 wait complete. 2023-11-04T01:45:03.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 Processor -- start 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- start start 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99900b4990 0x7f999015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b74f0 0x7f99900b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 0x7f99900b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99901601f0 con 0x7f99900d0690 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99900cca50 con 0x7f99900b4990 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999015d650 con 0x7f99900b74f0 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 0x7f99900b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 0x7f99900b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45024/0 (socket says 172.21.15.40:45024) 2023-11-04T01:45:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 -- 172.21.15.40:0/3190004120 learned_addr learned my addr 172.21.15.40:0/3190004120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f998ffff640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b74f0 0x7f99900b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f9994e7b640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99900b4990 0x7f999015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 -- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b74f0 msgr2=0x7f99900b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b74f0 0x7f99900b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 -- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99900b4990 msgr2=0x7f999015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99900b4990 0x7f999015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 -- 172.21.15.40:0/3190004120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980009420 con 0x7f99900d0690 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f999567c640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 0x7f99900b3b50 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f998001c8a0 tx=0x7f998001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800b1de0 con 0x7f99900d0690 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9980006e20 con 0x7f99900d0690 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800b9610 con 0x7f99900d0690 2023-11-04T01:45:03.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999015d930 con 0x7f99900d0690 2023-11-04T01:45:03.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.840+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99900cbd20 con 0x7f99900d0690 2023-11-04T01:45:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.844+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99900744a0 con 0x7f99900d0690 2023-11-04T01:45:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.844+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99800b7040 con 0x7f99900d0690 2023-11-04T01:45:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.844+0000 7f998d7fa640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99700664a0 0x7f9970068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.844+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f9980121f30 con 0x7f99900d0690 2023-11-04T01:45:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.844+0000 7f9994e7b640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99700664a0 0x7f9970068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.844+0000 7f9994e7b640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99700664a0 0x7f9970068960 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9988003fd0 tx=0x7f99880039c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:03.848+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99800eee50 con 0x7f99900d0690 2023-11-04T01:45:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.036+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f999015dde0 con 0x7f99900d0690 2023-11-04T01:45:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.036+0000 7f998d7fa640 1 -- 172.21.15.40:0/3190004120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4136 (secure 0 0 0) 0x7f99800b5020 con 0x7f99900d0690 2023-11-04T01:45:04.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:04.041 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:03.696401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:replay","state_seq":1,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 72 2023-11-04T01:45:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99700664a0 msgr2=0x7f9970068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99700664a0 0x7f9970068960 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9988003fd0 tx=0x7f99880039c0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 msgr2=0x7f99900b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 0x7f99900b3b50 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f998001c8a0 tx=0x7f998001ba10 comp rx=0 tx=0).stop 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 shutdown_connections 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99700664a0 0x7f9970068960 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99900d0690 0x7f99900b3b50 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99900b74f0 0x7f99900b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 --2- 172.21.15.40:0/3190004120 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99900b4990 0x7f999015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 >> 172.21.15.40:0/3190004120 conn(0x7f99900cf990 msgr2=0x7f99900b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 shutdown_connections 2023-11-04T01:45:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:04.040+0000 7f99970df640 1 -- 172.21.15.40:0/3190004120 wait complete. 2023-11-04T01:45:04.060 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:45:08.666 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:45:08.663+0000 7ff6fdc99640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:08.666 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:45:08.663+0000 7ff6fdc99640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:08.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:45:09.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:09.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f980ddea640 1 Processor -- start 2023-11-04T01:45:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f980ddea640 1 -- start start 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f980ddea640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f98080b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f980ddea640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080b6070 con 0x7f98080b74f0 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f980ddea640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080b8ed0 con 0x7f98080d0690 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f980ddea640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98080ce590 con 0x7f98080b4990 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f9807fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f98080b74f0 0x7f98080cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60476/0 (socket says 172.21.15.40:60476) 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f9807fff640 1 -- 172.21.15.40:0/783639872 learned_addr learned my addr 172.21.15.40:0/783639872 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f98080b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189846638 0 0) 0x7f98080b6070 con 0x7f98080b74f0 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f0003530 con 0x7f98080b74f0 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715873147 0 0) 0x7f97f0003530 con 0x7f98080b74f0 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 msgr2=0x7f98080b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f98080b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 >> v1:172.21.15.91:6789/0 conn(0x7f98080d0690 legacy=0x7f98080cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080b52b0 con 0x7f98080b74f0 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9800001a00 con 0x7f98080b74f0 2023-11-04T01:45:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 >> v1:172.21.15.40:6789/0 conn(0x7f98080b74f0 legacy=0x7f98080cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f00039b0 0x7f97f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f0004360 0x7f97f0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f97f0005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080ce590 con 0x7f97f00039b0 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f000b990 con 0x7f97f0004360 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f000bb50 con 0x7f98080b4990 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f00039b0 0x7f97f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f9807fff640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f97f0005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f9806ffd640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f0004360 0x7f97f0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 -- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 msgr2=0x7f97f0005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f97f0005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 -- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f0004360 msgr2=0x7f97f0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f0004360 0x7f97f0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f98077fe640 1 -- 172.21.15.40:0/783639872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0003530 con 0x7f97f00039b0 2023-11-04T01:45:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f9807fff640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f98080b4990 0x7f97f0005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.196+0000 7f9806ffd640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97f0004360 0x7f97f0004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f98077fe640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f00039b0 0x7f97f0003d90 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009ac0 tx=0x7f97f801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa00a426f83223d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80a5620 con 0x7f97f00039b0 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80a5780 con 0x7f97f00039b0 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f98067fc640 1 -- 172.21.15.40:0/783639872 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80a5b10 con 0x7f97f00039b0 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 -- 172.21.15.40:0/783639872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f00039b0 msgr2=0x7f97f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 --2- 172.21.15.40:0/783639872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97f00039b0 0x7f97f0003d90 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009ac0 tx=0x7f97f801ca30 comp rx=0 tx=0).stop 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f9807fff640 1 -- 172.21.15.40:0/783639872 reap_dead start 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 -- 172.21.15.40:0/783639872 shutdown_connections 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 -- 172.21.15.40:0/783639872 >> 172.21.15.40:0/783639872 conn(0x7f98080cf990 msgr2=0x7f98080cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 -- 172.21.15.40:0/783639872 shutdown_connections 2023-11-04T01:45:09.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 -- 172.21.15.40:0/783639872 wait complete. 2023-11-04T01:45:09.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 Processor -- start 2023-11-04T01:45:09.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.200+0000 7f980ddea640 1 -- start start 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f00039b0 0x7f9808151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 0x7f980815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f980815a910 0x7f980815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9808152250 con 0x7f9808156d10 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980815b2d0 con 0x7f980815a910 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9808158340 con 0x7f97f00039b0 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 0x7f980815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 0x7f980815f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51178/0 (socket says 172.21.15.40:51178) 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 -- 172.21.15.40:0/883434782 learned_addr learned my addr 172.21.15.40:0/883434782 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9807fff640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f980815a910 0x7f980815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f98077fe640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f00039b0 0x7f9808151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 -- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f00039b0 msgr2=0x7f9808151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f00039b0 0x7f9808151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 -- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f980815a910 msgr2=0x7f980815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f980815a910 0x7f980815ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 -- 172.21.15.40:0/883434782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98081572a0 con 0x7f9808156d10 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9807fff640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f980815a910 0x7f980815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f9806ffd640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 0x7f980815f090 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00fb70 tx=0x7f97fc00d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc019070 con 0x7f9808156d10 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00fe70 con 0x7f9808156d10 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00dbc0 con 0x7f9808156d10 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808157580 con 0x7f9808156d10 2023-11-04T01:45:09.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808157b40 con 0x7f9808156d10 2023-11-04T01:45:09.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98080744a0 con 0x7f9808156d10 2023-11-04T01:45:09.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97fc00dd20 con 0x7f9808156d10 2023-11-04T01:45:09.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f97effff640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97f40664d0 0x7f97f4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f97fc086e30 con 0x7f9808156d10 2023-11-04T01:45:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f98077fe640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97f40664d0 0x7f97f4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.204+0000 7f98077fe640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97f40664d0 0x7f97f4068990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009ac0 tx=0x7f97f80046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.208+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97fc053d50 con 0x7f9808156d10 2023-11-04T01:45:09.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.400+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98080cd320 con 0x7f9808156d10 2023-11-04T01:45:09.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.400+0000 7f97effff640 1 -- 172.21.15.40:0/883434782 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f97fc057370 con 0x7f9808156d10 2023-11-04T01:45:09.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:09.404 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:06.727436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:09.404 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 76 2023-11-04T01:45:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97f40664d0 msgr2=0x7f97f4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97f40664d0 0x7f97f4068990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009ac0 tx=0x7f97f80046d0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 msgr2=0x7f980815f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 0x7f980815f090 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00fb70 tx=0x7f97fc00d4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 shutdown_connections 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97f40664d0 0x7f97f4068990 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f980815a910 0x7f980815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9808156d10 0x7f980815f090 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 --2- 172.21.15.40:0/883434782 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f97f00039b0 0x7f9808151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 >> 172.21.15.40:0/883434782 conn(0x7f98080cf990 msgr2=0x7f98080b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 shutdown_connections 2023-11-04T01:45:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.404+0000 7f980ddea640 1 -- 172.21.15.40:0/883434782 wait complete. 2023-11-04T01:45:09.423 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:45:09.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 Processor -- start 2023-11-04T01:45:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 -- start start 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c0b4990 0x7fa30c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b74f0 0x7fa30c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0b6070 con 0x7fa30c0d0690 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0b8ed0 con 0x7fa30c0b4990 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa313ef1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0b52b0 con 0x7fa30c0b74f0 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa311c8d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c0b4990 0x7fa30c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa31148c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa30c0d0690 0x7fa30c0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60488/0 (socket says 172.21.15.40:60488) 2023-11-04T01:45:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa31148c640 1 -- 172.21.15.40:0/2549537833 learned_addr learned my addr 172.21.15.40:0/2549537833 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa31248e640 1 --2- 172.21.15.40:0/2549537833 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b74f0 0x7fa30c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa311c8d640 1 -- 172.21.15.40:0/2549537833 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b74f0 msgr2=0x7fa30c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa311c8d640 1 --2- 172.21.15.40:0/2549537833 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b74f0 0x7fa30c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa311c8d640 1 -- 172.21.15.40:0/2549537833 >> v1:172.21.15.40:6789/0 conn(0x7fa30c0d0690 legacy=0x7fa30c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa311c8d640 1 -- 172.21.15.40:0/2549537833 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0d1ce0 con 0x7fa30c0b4990 2023-11-04T01:45:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.548+0000 7fa310c8b640 1 -- 172.21.15.40:0/2549537833 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053785832 0 0) 0x7fa30c0b6070 con 0x7fa30c0d0690 2023-11-04T01:45:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa311c8d640 1 --2- 172.21.15.40:0/2549537833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b4990 0x7fa30c0b4d70 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fa3040097c0 tx=0x7fa30401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf91d970a270d16c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa310c8b640 1 -- 172.21.15.40:0/2549537833 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a8970 con 0x7fa30c0b4990 2023-11-04T01:45:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa310c8b640 1 -- 172.21.15.40:0/2549537833 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3040a8ad0 con 0x7fa30c0b4990 2023-11-04T01:45:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa310c8b640 1 -- 172.21.15.40:0/2549537833 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a8e60 con 0x7fa30c0b4990 2023-11-04T01:45:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- 172.21.15.40:0/2549537833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b4990 msgr2=0x7fa30c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 --2- 172.21.15.40:0/2549537833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b4990 0x7fa30c0b4d70 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fa3040097c0 tx=0x7fa30401ec70 comp rx=0 tx=0).stop 2023-11-04T01:45:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- 172.21.15.40:0/2549537833 shutdown_connections 2023-11-04T01:45:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 --2- 172.21.15.40:0/2549537833 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b74f0 0x7fa30c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 --2- 172.21.15.40:0/2549537833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b4990 0x7fa30c0b4d70 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- 172.21.15.40:0/2549537833 >> 172.21.15.40:0/2549537833 conn(0x7fa30c0cf990 msgr2=0x7fa30c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- 172.21.15.40:0/2549537833 shutdown_connections 2023-11-04T01:45:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- 172.21.15.40:0/2549537833 wait complete. 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 Processor -- start 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- start start 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b4990 0x7fa30c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 0x7fa30c0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa30c0d0690 0x7fa30c1f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c154b40 con 0x7fa30c0b74f0 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0cb4f0 con 0x7fa30c0d0690 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa313ef1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0cb7d0 con 0x7fa30c0b4990 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa31148c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 0x7fa30c0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa31148c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 0x7fa30c0cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51200/0 (socket says 172.21.15.40:51200) 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.552+0000 7fa31148c640 1 -- 172.21.15.40:0/225010828 learned_addr learned my addr 172.21.15.40:0/225010828 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa311c8d640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b4990 0x7fa30c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31248e640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa30c0d0690 0x7fa30c1f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31148c640 1 -- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b4990 msgr2=0x7fa30c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31148c640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b4990 0x7fa30c0cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31148c640 1 -- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa30c0d0690 msgr2=0x7fa30c1f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31148c640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa30c0d0690 0x7fa30c1f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31148c640 1 -- 172.21.15.40:0/225010828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009420 con 0x7fa30c0b74f0 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa311c8d640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b4990 0x7fa30c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa31148c640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 0x7fa30c0cccb0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c840 tx=0x7fa30000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000a640 con 0x7fa30c0b74f0 2023-11-04T01:45:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000a7c0 con 0x7fa30c0b74f0 2023-11-04T01:45:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c0cbab0 con 0x7fa30c0b74f0 2023-11-04T01:45:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000ab70 con 0x7fa30c0b74f0 2023-11-04T01:45:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c152c00 con 0x7fa30c0b74f0 2023-11-04T01:45:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c154910 con 0x7fa30c0b74f0 2023-11-04T01:45:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa30000acd0 con 0x7fa30c0b74f0 2023-11-04T01:45:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa30a7fc640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa2f80664a0 0x7fa2f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7fa300083c00 con 0x7fa30c0b74f0 2023-11-04T01:45:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa311c8d640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa2f80664a0 0x7fa2f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.556+0000 7fa311c8d640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa2f80664a0 0x7fa2f8068960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3040b2000 tx=0x7fa3040aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.560+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa30008a080 con 0x7fa30c0b74f0 2023-11-04T01:45:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.748+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa30c0744a0 con 0x7fa30c0b74f0 2023-11-04T01:45:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa30a7fc640 1 -- 172.21.15.40:0/225010828 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fa300018020 con 0x7fa30c0b74f0 2023-11-04T01:45:09.754 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:09.754 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:06.727436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:09.755 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 76 2023-11-04T01:45:09.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa2f80664a0 msgr2=0x7fa2f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa2f80664a0 0x7fa2f8068960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3040b2000 tx=0x7fa3040aa070 comp rx=0 tx=0).stop 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 msgr2=0x7fa30c0cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 0x7fa30c0cccb0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c840 tx=0x7fa30000cd00 comp rx=0 tx=0).stop 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 shutdown_connections 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa2f80664a0 0x7fa2f8068960 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa30c0d0690 0x7fa30c1f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b74f0 0x7fa30c0cccb0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 --2- 172.21.15.40:0/225010828 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa30c0b4990 0x7fa30c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 >> 172.21.15.40:0/225010828 conn(0x7fa30c0cf990 msgr2=0x7fa30c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 shutdown_connections 2023-11-04T01:45:09.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:09.752+0000 7fa313ef1640 1 -- 172.21.15.40:0/225010828 wait complete. 2023-11-04T01:45:10.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:45:06.727436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6601, 'mds_1': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6601': {'gid': 6601, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.91:6837/2523798790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6836', 'nonce': 2523798790}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 2523798790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7068': {'gid': 7068, 'name': 'a', 'rank': 1, 'incarnation': 50, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.40:6833/960586799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 960586799}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 960586799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:10.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:45:10.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:45:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.304+0000 7f2b4a91f640 1 Processor -- start 2023-11-04T01:45:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.304+0000 7f2b4a91f640 1 -- start start 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b44144180 0x7f2b4415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b441447f0 0x7f2b4406cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b44144560 con 0x7f2b4406a160 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4415f920 con 0x7f2b44144180 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4415f360 con 0x7f2b441447f0 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b44144180 0x7f2b4415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b44144180 0x7f2b4415ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51212/0 (socket says 172.21.15.40:51212) 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 -- 172.21.15.40:0/3061905719 learned_addr learned my addr 172.21.15.40:0/3061905719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/3061905719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b441447f0 0x7f2b4406cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 -- 172.21.15.40:0/3061905719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b441447f0 msgr2=0x7f2b4406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 --2- 172.21.15.40:0/3061905719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b441447f0 0x7f2b4406cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 -- 172.21.15.40:0/3061905719 >> v1:172.21.15.91:6789/0 conn(0x7f2b4406a160 legacy=0x7f2b440c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 -- 172.21.15.40:0/3061905719 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4415f640 con 0x7f2b44144180 2023-11-04T01:45:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b43fff640 1 --2- 172.21.15.40:0/3061905719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44144180 0x7f2b4415ea60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009870 tx=0x7f2b2c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc64350c5c201d42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b437fe640 1 -- 172.21.15.40:0/3061905719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0ac600 con 0x7f2b44144180 2023-11-04T01:45:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b437fe640 1 -- 172.21.15.40:0/3061905719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0a8050 con 0x7f2b44144180 2023-11-04T01:45:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b437fe640 1 -- 172.21.15.40:0/3061905719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0ac980 con 0x7f2b44144180 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- 172.21.15.40:0/3061905719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44144180 msgr2=0x7f2b4415ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/3061905719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44144180 0x7f2b4415ea60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009870 tx=0x7f2b2c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- 172.21.15.40:0/3061905719 shutdown_connections 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/3061905719 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b441447f0 0x7f2b4406cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/3061905719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44144180 0x7f2b4415ea60 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- 172.21.15.40:0/3061905719 >> 172.21.15.40:0/3061905719 conn(0x7f2b440cfc00 msgr2=0x7f2b440d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- 172.21.15.40:0/3061905719 shutdown_connections 2023-11-04T01:45:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.308+0000 7f2b4a91f640 1 -- 172.21.15.40:0/3061905719 wait complete. 2023-11-04T01:45:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 Processor -- start 2023-11-04T01:45:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 -- start start 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b4406a160 0x7f2b440b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b44144180 0x7f2b440b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 0x7f2b44158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4415a370 con 0x7f2b441447f0 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440c9cf0 con 0x7f2b4406a160 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440c9f90 con 0x7f2b44144180 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 0x7f2b44158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 0x7f2b44158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51220/0 (socket says 172.21.15.40:51220) 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 -- 172.21.15.40:0/1626365314 learned_addr learned my addr 172.21.15.40:0/1626365314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b43fff640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b4406a160 0x7f2b440b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b44144180 0x7f2b440b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 -- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b44144180 msgr2=0x7f2b440b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b44144180 0x7f2b440b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 -- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b4406a160 msgr2=0x7f2b440b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b4406a160 0x7f2b440b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 -- 172.21.15.40:0/1626365314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0094d0 con 0x7f2b441447f0 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b43fff640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b4406a160 0x7f2b440b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b44144180 0x7f2b440b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 0x7f2b44158fb0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c780 tx=0x7f2b3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b417fa640 1 -- 172.21.15.40:0/1626365314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c004b70 con 0x7f2b441447f0 2023-11-04T01:45:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b417fa640 1 -- 172.21.15.40:0/1626365314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00ce90 con 0x7f2b441447f0 2023-11-04T01:45:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440b3310 con 0x7f2b441447f0 2023-11-04T01:45:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b417fa640 1 -- 172.21.15.40:0/1626365314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00a850 con 0x7f2b441447f0 2023-11-04T01:45:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.312+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b440b56a0 con 0x7f2b441447f0 2023-11-04T01:45:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 Processor -- start 2023-11-04T01:45:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b417fa640 1 -- 172.21.15.40:0/1626365314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b3c00a9b0 con 0x7f2b441447f0 2023-11-04T01:45:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- start start 2023-11-04T01:45:10.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b417fa640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b240664a0 0x7f2b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b417fa640 1 -- 172.21.15.40:0/1626365314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f2b3c084590 con 0x7f2b441447f0 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b240664a0 0x7f2b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b915191f0 0x561b915195d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b914cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b914ccf50 0x561b914cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b91393460 con 0x561b91519b10 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b91324690 con 0x561b914ccf50 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b91321bc0 con 0x561b915191f0 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b914cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b914cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51222/0 (socket says 172.21.15.40:51222) 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 -- 172.21.15.40:0/1222041171 learned_addr learned my addr 172.21.15.40:0/1222041171 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b43fff640 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b915191f0 0x561b915195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b914ccf50 0x561b914cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 -- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b915191f0 msgr2=0x561b915195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b915191f0 0x561b915195d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 -- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b914ccf50 msgr2=0x561b914cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b914ccf50 0x561b914cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 -- 172.21.15.40:0/1222041171 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b91015890 con 0x561b91519b10 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b914cca10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2b340157c0 tx=0x7f2b3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca87ca7a0807d36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b240664a0 0x7f2b24068960 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400afd0 tx=0x7f2b3400ae30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b39ffb640 1 -- 172.21.15.40:0/1222041171 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340189f0 con 0x561b91519b10 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b39ffb640 1 -- 172.21.15.40:0/1222041171 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3400c050 con 0x561b91519b10 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b39ffb640 1 -- 172.21.15.40:0/1222041171 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34018d70 con 0x561b91519b10 2023-11-04T01:45:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- 172.21.15.40:0/1222041171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 msgr2=0x561b914cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b914cca10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f2b340157c0 tx=0x7f2b3401a000 comp rx=0 tx=0).stop 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- 172.21.15.40:0/1222041171 shutdown_connections 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b914ccf50 0x561b914cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b914cca10 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/1222041171 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b915191f0 0x561b915195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- 172.21.15.40:0/1222041171 >> 172.21.15.40:0/1222041171 conn(0x561b914f5d40 msgr2=0x561b914f8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- 172.21.15.40:0/1222041171 shutdown_connections 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.316+0000 7f2b4da4c000 1 -- 172.21.15.40:0/1222041171 wait complete. 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- start start 2023-11-04T01:45:10.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 Processor -- start 2023-11-04T01:45:10.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 0x561b914fa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b914fa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b914fae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9131d4b0 con 0x561b914ccf50 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b912d5aa0 con 0x561b915191f0 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b912db940 con 0x561b91519b10 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 10 client.0 _ll_register_callbacks cb 0x561b914b6460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 0x561b914fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 0x561b914fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51228/0 (socket says 172.21.15.40:51228) 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 -- 172.21.15.40:0/2898952408 learned_addr learned my addr 172.21.15.40:0/2898952408 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b914fa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b914fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 -- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 msgr2=0x561b914fae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b914fae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 -- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 msgr2=0x561b914fa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b914fa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 -- 172.21.15.40:0/2898952408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b34015580 con 0x561b914ccf50 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b43fff640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 0x561b914fa3c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c01ab80 tx=0x7f2b2c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a43a4da9523342 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 1 -- 172.21.15.40:0/2898952408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0ace50 con 0x561b914ccf50 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 1 -- 172.21.15.40:0/2898952408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f2b2c0b6440 con 0x561b914ccf50 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b912dae10 con 0x561b914ccf50 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 1 -- 172.21.15.40:0/2898952408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b2c0b6600 con 0x561b914ccf50 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 10 client.7725 fetch_fsmap learned FSMap version 76 2023-11-04T01:45:10.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x561b912de1a0 con 0x561b914ccf50 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 1 -- 172.21.15.40:0/2898952408 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b912dae10 con 0x561b914ccf50 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 1 -- 172.21.15.40:0/2898952408 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 76) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2b2c0b6760 con 0x561b914ccf50 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 10 client.7725 fetch_fsmap finished waiting for FSMap version 76 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 10 client.7725 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 20 client.7725 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b914fb6b0 0x561b9152a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 4 client.7725 mds_command: new command op to 6601 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 --> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b9131be00 con 0x561b914fb6b0 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b914fb6b0 0x561b9152a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b914fb6b0 0x561b9152a970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=257df9d9cd452f20 server_cookie=70b732ce53f9ae3 in_seq=0 out_seq=0 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.320+0000 7f2b22ffd640 10 client.7725 ms_handle_connect on v2:172.21.15.91:6836/2523798790 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b22ffd640 1 -- 172.21.15.40:0/2898952408 <== mds.0 v2:172.21.15.91:6836/2523798790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561b9131be00 con 0x561b914fb6b0 2023-11-04T01:45:10.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b22ffd640 10 client.7725 handle_command_reply: tid=0 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 client.7725 shutdown 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 msgr2=0x561b914fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 0x561b914fa3c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c01ab80 tx=0x7f2b2c01ad10 comp rx=0 tx=0).stop 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 shutdown_connections 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b914fb6b0 0x561b9152a970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b914fae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b914fa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/2898952408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b914ccf50 0x561b914fa3c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b22ffd640 0 client.7725 ms_handle_reset on v2:172.21.15.91:6836/2523798790 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 >> 172.21.15.40:0/2898952408 conn(0x561b914f5d40 msgr2=0x561b914c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 shutdown_connections 2023-11-04T01:45:10.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 1 -- 172.21.15.40:0/2898952408 wait complete. 2023-11-04T01:45:10.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.324+0000 7f2b4da4c000 20 client.7725 trim_cache size 0 max 16384 2023-11-04T01:45:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 Processor -- start 2023-11-04T01:45:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- start start 2023-11-04T01:45:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 0x561b91518280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b915187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b9152a970 0x561b9152ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b90fd6940 con 0x561b915191f0 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9131c340 con 0x561b9152a970 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b91320010 con 0x561b91519b10 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 0x561b91518280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 0x561b91518280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51234/0 (socket says 172.21.15.40:51234) 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 -- 172.21.15.40:0/3787509986 learned_addr learned my addr 172.21.15.40:0/3787509986 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 -- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 msgr2=0x561b915187c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b915187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b9152a970 0x561b9152ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 -- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b9152a970 msgr2=0x561b9152ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b9152a970 0x561b9152ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 -- 172.21.15.40:0/3787509986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b912c44a0 con 0x561b915191f0 2023-11-04T01:45:10.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b43fff640 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 0x561b91518280 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c008010 tx=0x7f2b2c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4fc743ee07c24c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/3787509986 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0b6640 con 0x561b915191f0 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/3787509986 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0b67a0 con 0x561b915191f0 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/3787509986 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c004260 con 0x561b915191f0 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- 172.21.15.40:0/3787509986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 msgr2=0x561b91518280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 0x561b91518280 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c008010 tx=0x7f2b2c0b7000 comp rx=0 tx=0).stop 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- 172.21.15.40:0/3787509986 shutdown_connections 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b9152a970 0x561b9152ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b91519b10 0x561b915187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/3787509986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b915191f0 0x561b91518280 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- 172.21.15.40:0/3787509986 >> 172.21.15.40:0/3787509986 conn(0x561b914f5d40 msgr2=0x561b91517b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- 172.21.15.40:0/3787509986 shutdown_connections 2023-11-04T01:45:10.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- 172.21.15.40:0/3787509986 wait complete. 2023-11-04T01:45:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.340+0000 7f2b4da4c000 1 -- start start 2023-11-04T01:45:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 Processor -- start 2023-11-04T01:45:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b9157b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b9157dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b9152a970 0x561b91580160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9152f660 con 0x561b91519b10 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b912db460 con 0x561b915191f0 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b91318e20 con 0x561b9152a970 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 10 client.0 _ll_register_callbacks cb 0x7f2b3400acd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b9157dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b9157dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51246/0 (socket says 172.21.15.40:51246) 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 -- 172.21.15.40:0/46428217 learned_addr learned my addr 172.21.15.40:0/46428217 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b48ebc640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b9152a970 0x561b91580160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b43fff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b9157b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 -- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b9152a970 msgr2=0x561b91580160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b9152a970 0x561b91580160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 -- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 msgr2=0x561b9157b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b9157b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 -- 172.21.15.40:0/46428217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b912de1a0 con 0x561b91519b10 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b43fff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b9157b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b3bfff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b9157dc10 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400e000 tx=0x7f2b340046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a83d4579fc4c64a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 1 -- 172.21.15.40:0/46428217 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34018d00 con 0x561b91519b10 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 1 -- 172.21.15.40:0/46428217 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f2b3401e070 con 0x561b91519b10 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b912e7d10 con 0x561b91519b10 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 1 -- 172.21.15.40:0/46428217 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b34018e60 con 0x561b91519b10 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 10 client.7731 fetch_fsmap learned FSMap version 76 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x561b91015cc0 con 0x561b91519b10 2023-11-04T01:45:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 1 -- 172.21.15.40:0/46428217 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561b912e7d10 con 0x561b91519b10 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 1 -- 172.21.15.40:0/46428217 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 76) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2b34022430 con 0x561b91519b10 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 10 client.7731 fetch_fsmap finished waiting for FSMap version 76 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 10 client.7731 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 20 client.7731 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b915806a0 0x561b91582a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 4 client.7731 mds_command: new command op to 6601 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 --> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561b91316490 con 0x561b915806a0 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b43fff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b915806a0 0x561b91582a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b43fff640 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b915806a0 0x561b91582a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81642683a6ab402 server_cookie=94f065d11199c5bb in_seq=0 out_seq=0 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 10 client.7731 ms_handle_connect on v2:172.21.15.91:6836/2523798790 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 1 -- 172.21.15.40:0/46428217 <== mds.0 v2:172.21.15.91:6836/2523798790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561b91316490 con 0x561b915806a0 2023-11-04T01:45:10.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 10 client.7731 handle_command_reply: tid=0 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 client.7731 shutdown 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 msgr2=0x561b9157dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b9157dc10 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400e000 tx=0x7f2b340046d0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 shutdown_connections 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:6836/2523798790,v1:172.21.15.91:6837/2523798790] conn(0x561b915806a0 0x561b91582a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561b9152a970 0x561b91580160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561b91519b10 0x561b9157dc10 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 --2- 172.21.15.40:0/46428217 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561b915191f0 0x561b9157b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b22ffd640 0 client.7731 ms_handle_reset on v2:172.21.15.91:6836/2523798790 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 >> 172.21.15.40:0/46428217 conn(0x561b914f5d40 msgr2=0x561b91518490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 shutdown_connections 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 1 -- 172.21.15.40:0/46428217 wait complete. 2023-11-04T01:45:10.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.344+0000 7f2b4da4c000 20 client.7731 trim_cache size 0 max 16384 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 6601, 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 6.6422831139999996, 2023-11-04T01:45:10.355 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 76, 2023-11-04T01:45:10.356 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 96, 2023-11-04T01:45:10.356 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:45:10.356 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 37.611693414000001 2023-11-04T01:45:10.356 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b240664a0 msgr2=0x7f2b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b240664a0 0x7f2b24068960 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400afd0 tx=0x7f2b3400ae30 comp rx=0 tx=0).stop 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 msgr2=0x7f2b44158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 0x7f2b44158fb0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c780 tx=0x7f2b3c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 shutdown_connections 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2b240664a0 0x7f2b24068960 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441447f0 0x7f2b44158fb0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2b44144180 0x7f2b440b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 --2- 172.21.15.40:0/1626365314 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2b4406a160 0x7f2b440b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 >> 172.21.15.40:0/1626365314 conn(0x7f2b440cfc00 msgr2=0x7f2b44070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 shutdown_connections 2023-11-04T01:45:10.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.348+0000 7f2b4a91f640 1 -- 172.21.15.40:0/1626365314 wait complete. 2023-11-04T01:45:10.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:45:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 Processor -- start 2023-11-04T01:45:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 -- start start 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50700cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50700cdea0 0x7f50700b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700ccee0 con 0x7f50700ca400 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507015a5d0 con 0x7f50700cdea0 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f5077290640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ca900 con 0x7f507015a1f0 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507482b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50700cdea0 0x7f50700b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507582d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f50700ca400 0x7f50700704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60496/0 (socket says 172.21.15.40:60496) 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507482b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50700cdea0 0x7f50700b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51254/0 (socket says 172.21.15.40:51254) 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507582d640 1 -- 172.21.15.40:0/1074807747 learned_addr learned my addr 172.21.15.40:0/1074807747 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507502c640 1 --2- 172.21.15.40:0/1074807747 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50700cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507482b640 1 -- 172.21.15.40:0/1074807747 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 msgr2=0x7f50700cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507482b640 1 --2- 172.21.15.40:0/1074807747 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50700cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507482b640 1 -- 172.21.15.40:0/1074807747 >> v1:172.21.15.40:6789/0 conn(0x7f50700ca400 legacy=0x7f50700704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.476+0000 7f507482b640 1 -- 172.21.15.40:0/1074807747 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700cabe0 con 0x7f50700cdea0 2023-11-04T01:45:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f507482b640 1 --2- 172.21.15.40:0/1074807747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f50700b0630 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f50600097c0 tx=0x7f506001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba48a4f4856b9872 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5067fff640 1 -- 172.21.15.40:0/1074807747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600ab650 con 0x7f50700cdea0 2023-11-04T01:45:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5067fff640 1 -- 172.21.15.40:0/1074807747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600ab7b0 con 0x7f50700cdea0 2023-11-04T01:45:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5067fff640 1 -- 172.21.15.40:0/1074807747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600abb40 con 0x7f50700cdea0 2023-11-04T01:45:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 -- 172.21.15.40:0/1074807747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 msgr2=0x7f50700b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 --2- 172.21.15.40:0/1074807747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f50700b0630 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f50600097c0 tx=0x7f506001c450 comp rx=0 tx=0).stop 2023-11-04T01:45:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 -- 172.21.15.40:0/1074807747 shutdown_connections 2023-11-04T01:45:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 --2- 172.21.15.40:0/1074807747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f50700b0630 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 --2- 172.21.15.40:0/1074807747 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50700cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 -- 172.21.15.40:0/1074807747 >> 172.21.15.40:0/1074807747 conn(0x7f50700cebb0 msgr2=0x7f50700cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 -- 172.21.15.40:0/1074807747 shutdown_connections 2023-11-04T01:45:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.480+0000 7f5077290640 1 -- 172.21.15.40:0/1074807747 wait complete. 2023-11-04T01:45:10.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 Processor -- start 2023-11-04T01:45:10.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 -- start start 2023-11-04T01:45:10.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50700ca400 0x7f507014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f5070157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50701590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507014ffe0 con 0x7f50700cdea0 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701502c0 con 0x7f50700ca400 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50701505a0 con 0x7f507015a1f0 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f5070157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f5070157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51264/0 (socket says 172.21.15.40:51264) 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 -- 172.21.15.40:0/936347596 learned_addr learned my addr 172.21.15.40:0/936347596 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507582d640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50701590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507502c640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50700ca400 0x7f507014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 -- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 msgr2=0x7f50701590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50701590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 -- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50700ca400 msgr2=0x7f507014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50700ca400 0x7f507014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 -- 172.21.15.40:0/936347596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060009420 con 0x7f50700cdea0 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507502c640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50700ca400 0x7f507014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507582d640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50701590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f507482b640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f5070157190 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f50600ad040 tx=0x7f506001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5065ffb640 1 -- 172.21.15.40:0/936347596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600b5810 con 0x7f50700cdea0 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5065ffb640 1 -- 172.21.15.40:0/936347596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600b5990 con 0x7f50700cdea0 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5070150880 con 0x7f50700cdea0 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5065ffb640 1 -- 172.21.15.40:0/936347596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600b5d40 con 0x7f50700cdea0 2023-11-04T01:45:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507014cfa0 con 0x7f50700cdea0 2023-11-04T01:45:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5065ffb640 1 -- 172.21.15.40:0/936347596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50600bf410 con 0x7f50700cdea0 2023-11-04T01:45:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5065ffb640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50540664a0 0x7f5054068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.484+0000 7f5065ffb640 1 -- 172.21.15.40:0/936347596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f506011f170 con 0x7f50700cdea0 2023-11-04T01:45:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507502c640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50540664a0 0x7f5054068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 Processor -- start 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- start start 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507502c640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50540664a0 0x7f5054068960 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5070159c10 tx=0x7f506c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7edfa0 0x557ebb7ee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb66c460 con 0x557ebb7ee8c0 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5fd690 con 0x557ebb7a1b40 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5fabc0 con 0x557ebb7edfa0 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51274/0 (socket says 172.21.15.40:51274) 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 -- 172.21.15.40:0/2798690845 learned_addr learned my addr 172.21.15.40:0/2798690845 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507502c640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7edfa0 0x557ebb7ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507582d640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 -- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7edfa0 msgr2=0x557ebb7ee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7edfa0 0x557ebb7ee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 -- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 msgr2=0x557ebb7a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 -- 172.21.15.40:0/2798690845 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ebb2ee890 con 0x557ebb7ee8c0 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507502c640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7edfa0 0x557ebb7ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507582d640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507482b640 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a1600 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f50600efe90 tx=0x7f50600ec370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26131436c4dca75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f505affd640 1 -- 172.21.15.40:0/2798690845 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600f8200 con 0x557ebb7ee8c0 2023-11-04T01:45:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f505affd640 1 -- 172.21.15.40:0/2798690845 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600f60b0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f505affd640 1 -- 172.21.15.40:0/2798690845 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600ec610 con 0x557ebb7ee8c0 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- 172.21.15.40:0/2798690845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 msgr2=0x557ebb7a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a1600 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f50600efe90 tx=0x7f50600ec370 comp rx=0 tx=0).stop 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- 172.21.15.40:0/2798690845 shutdown_connections 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a1600 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2798690845 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7edfa0 0x557ebb7ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- 172.21.15.40:0/2798690845 >> 172.21.15.40:0/2798690845 conn(0x557ebb7ced40 msgr2=0x557ebb7d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- 172.21.15.40:0/2798690845 shutdown_connections 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- 172.21.15.40:0/2798690845 wait complete. 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 -- start start 2023-11-04T01:45:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.488+0000 7f507a3bd000 1 Processor -- start 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7a1b40 0x557ebb7a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb7a7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5f64b0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5aeaa0 con 0x557ebb7edfa0 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5b4940 con 0x557ebb7a1b40 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 10 client.0 _ll_register_callbacks cb 0x557ebb78f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51288/0 (socket says 172.21.15.40:51288) 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 -- 172.21.15.40:0/224329526 learned_addr learned my addr 172.21.15.40:0/224329526 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507482b640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb7a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507502c640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7a1b40 0x557ebb7a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 -- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7a1b40 msgr2=0x557ebb7a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7a1b40 0x557ebb7a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 -- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 msgr2=0x557ebb7a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb7a7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 -- 172.21.15.40:0/224329526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507014cfa0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507582d640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a7d70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f5068001e50 tx=0x7f5068001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb3ef7ffd93863c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 1 -- 172.21.15.40:0/224329526 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005cd0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ebb5b3e10 con 0x557ebb7ee8c0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 1 -- 172.21.15.40:0/224329526 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f5068005e30 con 0x557ebb7ee8c0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 1 -- 172.21.15.40:0/224329526 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50680011c0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 10 client.7746 fetch_fsmap learned FSMap version 76 2023-11-04T01:45:10.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x557ebb5b71a0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 1 -- 172.21.15.40:0/224329526 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ebb5b3e10 con 0x557ebb7ee8c0 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 1 -- 172.21.15.40:0/224329526 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 76) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f50680070d0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 10 client.7746 fetch_fsmap finished waiting for FSMap version 76 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 10 client.7746 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 20 client.7746 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb7fd030 0x557ebb7ff420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 4 client.7746 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ebb5f4e00 con 0x557ebb7fd030 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507502c640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb7fd030 0x557ebb7ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 10 client.7746 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507502c640 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb7fd030 0x557ebb7ff420 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe9e7951b1e7df04 server_cookie=ac32bc44bd04371f in_seq=0 out_seq=0 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 1 -- 172.21.15.40:0/224329526 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ebb5f4e00 con 0x557ebb7fd030 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 10 client.7746 handle_command_reply: tid=0 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 client.7746 shutdown 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 msgr2=0x557ebb7a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a7d70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f5068001e50 tx=0x7f5068001e80 comp rx=0 tx=0).stop 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 shutdown_connections 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7ee8c0 0x557ebb7a7d70 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb7fd030 0x557ebb7ff420 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb7a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 --2- 172.21.15.40:0/224329526 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7a1b40 0x557ebb7a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f504ffff640 0 client.7746 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 >> 172.21.15.40:0/224329526 conn(0x557ebb7ced40 msgr2=0x557ebb7d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 shutdown_connections 2023-11-04T01:45:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 1 -- 172.21.15.40:0/224329526 wait complete. 2023-11-04T01:45:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.492+0000 7f507a3bd000 20 client.7746 trim_cache size 0 max 16384 2023-11-04T01:45:10.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 Processor -- start 2023-11-04T01:45:10.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 -- start start 2023-11-04T01:45:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 0x557ebb7a1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb7ff420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb2af940 con 0x557ebb7edfa0 2023-11-04T01:45:10.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb79d080 con 0x557ebb7a1b40 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5f9010 con 0x557ebb7ee8c0 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507482b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 0x557ebb7a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507482b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 0x557ebb7a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51300/0 (socket says 172.21.15.40:51300) 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.508+0000 7f507482b640 1 -- 172.21.15.40:0/33251133 learned_addr learned my addr 172.21.15.40:0/33251133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 -- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 msgr2=0x557ebb7ff420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507582d640 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb7ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb7ff420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 -- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 msgr2=0x557ebb7a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 -- 172.21.15.40:0/33251133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ebb59d4a0 con 0x557ebb7edfa0 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 0x557ebb7a1240 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f50600ec400 tx=0x7f50600f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fc5b214594e8e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f505b7fe640 1 -- 172.21.15.40:0/33251133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600fc070 con 0x557ebb7edfa0 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f505b7fe640 1 -- 172.21.15.40:0/33251133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600f8200 con 0x557ebb7edfa0 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f505b7fe640 1 -- 172.21.15.40:0/33251133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600f60b0 con 0x557ebb7edfa0 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/33251133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 msgr2=0x557ebb7a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 0x557ebb7a1240 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f50600ec400 tx=0x7f50600f3000 comp rx=0 tx=0).stop 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/33251133 shutdown_connections 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb7ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7edfa0 0x557ebb7a1240 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- 172.21.15.40:0/33251133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7a1b40 0x557ebb7a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/33251133 >> 172.21.15.40:0/33251133 conn(0x557ebb7ced40 msgr2=0x557ebb7a05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/33251133 shutdown_connections 2023-11-04T01:45:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/33251133 wait complete. 2023-11-04T01:45:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- start start 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 Processor -- start 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 0x557ebb801450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb84e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb84ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb2ef1b0 con 0x557ebb7a1b40 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5f07b0 con 0x557ebb7edfa0 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ebb5fa4b0 con 0x557ebb7ee8c0 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 10 client.0 _ll_register_callbacks cb 0x7f50600ec2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 0x557ebb801450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 0x557ebb801450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51310/0 (socket says 172.21.15.40:51310) 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 -- 172.21.15.40:0/2713059984 learned_addr learned my addr 172.21.15.40:0/2713059984 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507582d640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb84ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb84e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 -- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 msgr2=0x557ebb84ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb84ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 -- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 msgr2=0x557ebb84e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb84e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 -- 172.21.15.40:0/2713059984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ebb2ee890 con 0x557ebb7a1b40 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb84e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507502c640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 0x557ebb801450 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x557ebb5a06c0 tx=0x7f506c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f09c86e5a75b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f504ffff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f504ffff640 1 -- 172.21.15.40:0/2713059984 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c027720 con 0x557ebb7a1b40 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f504ffff640 1 -- 172.21.15.40:0/2713059984 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f506c027880 con 0x557ebb7a1b40 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ebb7a42a0 con 0x557ebb7a1b40 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f504ffff640 1 -- 172.21.15.40:0/2713059984 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f506c030480 con 0x557ebb7a1b40 2023-11-04T01:45:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 10 client.7752 fetch_fsmap learned FSMap version 76 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x557ebb2eecc0 con 0x557ebb7a1b40 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f504ffff640 1 -- 172.21.15.40:0/2713059984 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ebb7a42a0 con 0x557ebb7a1b40 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f504ffff640 1 -- 172.21.15.40:0/2713059984 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 76) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f506c005d20 con 0x557ebb7a1b40 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 10 client.7752 fetch_fsmap finished waiting for FSMap version 76 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 10 client.7752 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 20 client.7752 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb859a10 0x557ebb85be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 4 client.7752 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557ebb5c0d10 con 0x557ebb859a10 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.512+0000 7f507482b640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb859a10 0x557ebb85be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f504ffff640 10 client.7752 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507482b640 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb859a10 0x557ebb85be00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=292b9ba7374220cd server_cookie=9772f5b89afad7b9 in_seq=0 out_seq=0 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f504ffff640 1 -- 172.21.15.40:0/2713059984 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x557ebb5c0d10 con 0x557ebb859a10 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f504ffff640 10 client.7752 handle_command_reply: tid=0 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 client.7752 shutdown 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 msgr2=0x557ebb801450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 0x557ebb801450 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x557ebb5a06c0 tx=0x7f506c004ac0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 shutdown_connections 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557ebb7ee8c0 0x557ebb84ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x557ebb859a10 0x557ebb85be00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557ebb7edfa0 0x557ebb84e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 --2- 172.21.15.40:0/2713059984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557ebb7a1b40 0x557ebb801450 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f504ffff640 0 client.7752 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 >> 172.21.15.40:0/2713059984 conn(0x557ebb7ced40 msgr2=0x557ebb7a05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 shutdown_connections 2023-11-04T01:45:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 1 -- 172.21.15.40:0/2713059984 wait complete. 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f507a3bd000 20 client.7752 trim_cache size 0 max 16384 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7068, 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 99.239597509999996, 2023-11-04T01:45:10.524 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 76, 2023-11-04T01:45:10.525 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 96, 2023-11-04T01:45:10.525 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:45:10.525 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 120.432146596 2023-11-04T01:45:10.525 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:45:10.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50540664a0 msgr2=0x7f5054068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50540664a0 0x7f5054068960 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5070159c10 tx=0x7f506c00b040 comp rx=0 tx=0).stop 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 msgr2=0x7f5070157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f5070157190 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f50600ad040 tx=0x7f506001ac90 comp rx=0 tx=0).stop 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 shutdown_connections 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50540664a0 0x7f5054068960 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f507015a1f0 0x7f50701590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50700cdea0 0x7f5070157190 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 --2- 172.21.15.40:0/936347596 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50700ca400 0x7f507014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 >> 172.21.15.40:0/936347596 conn(0x7f50700cebb0 msgr2=0x7f50700b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 shutdown_connections 2023-11-04T01:45:10.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.516+0000 7f5077290640 1 -- 172.21.15.40:0/936347596 wait complete. 2023-11-04T01:45:10.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f1771b9e640 1 Processor -- start 2023-11-04T01:45:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f1771b9e640 1 -- start start 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f1771b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f176c0cdf00 0x7f176c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f1771b9e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c15fa20 con 0x7f176c15b050 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f1771b9e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c06daf0 con 0x7f176c0cfe80 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f1771b9e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0d0ca0 con 0x7f176c0cdf00 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f176b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f176c15b050 0x7f176c0cd7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60512/0 (socket says 172.21.15.40:60512) 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f176b7fe640 1 -- 172.21.15.40:0/1248978675 learned_addr learned my addr 172.21.15.40:0/1248978675 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f176affd640 1 --2- 172.21.15.40:0/1248978675 >> v2:172.21.15.91:3300/0 conn(0x7f176c0cdf00 0x7f176c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745307865 0 0) 0x7f176c15fa20 con 0x7f176c15b050 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.644+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1754003530 con 0x7f176c15b050 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4270425653 0 0) 0x7f1754003530 con 0x7f176c15b050 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 >> v2:172.21.15.91:3300/0 conn(0x7f176c0cdf00 msgr2=0x7f176c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 --2- 172.21.15.40:0/1248978675 >> v2:172.21.15.91:3300/0 conn(0x7f176c0cdf00 0x7f176c0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 >> v1:172.21.15.91:6789/0 conn(0x7f176c0cfe80 legacy=0x7f176c15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c15ec60 con 0x7f176c15b050 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f175c001680 con 0x7f176c15b050 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 >> v1:172.21.15.40:6789/0 conn(0x7f176c15b050 legacy=0x7f176c0cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1754003980 0x7f1754003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17540047d0 0x7f1754004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1754005190 0x7f175400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0d0ca0 con 0x7f17540047d0 2023-11-04T01:45:10.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175400c130 con 0x7f1754005190 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175400c2f0 con 0x7f1754003980 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17540047d0 0x7f1754004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176b7fe640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1754003980 0x7f1754003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176bfff640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1754005190 0x7f175400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 -- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1754003980 msgr2=0x7f1754003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1754003980 0x7f1754003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 -- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1754005190 msgr2=0x7f175400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1754005190 0x7f175400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 -- 172.21.15.40:0/1248978675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754003530 con 0x7f17540047d0 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176b7fe640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1754003980 0x7f1754003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176bfff640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1754005190 0x7f175400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:10.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176bfff640 1 -- 172.21.15.40:0/1248978675 reap_dead start 2023-11-04T01:45:10.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176affd640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17540047d0 0x7f1754004c50 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f1760009ae0 tx=0x7f176001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b5feed54119c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a6510 con 0x7f17540047d0 2023-11-04T01:45:10.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600a6670 con 0x7f17540047d0 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f176a7fc640 1 -- 172.21.15.40:0/1248978675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a6a20 con 0x7f17540047d0 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 -- 172.21.15.40:0/1248978675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17540047d0 msgr2=0x7f1754004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17540047d0 0x7f1754004c50 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f1760009ae0 tx=0x7f176001ca20 comp rx=0 tx=0).stop 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 -- 172.21.15.40:0/1248978675 shutdown_connections 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1248978675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17540047d0 0x7f1754004c50 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 -- 172.21.15.40:0/1248978675 >> 172.21.15.40:0/1248978675 conn(0x7f176c0b28f0 msgr2=0x7f176c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 -- 172.21.15.40:0/1248978675 shutdown_connections 2023-11-04T01:45:10.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.648+0000 7f1771b9e640 1 -- 172.21.15.40:0/1248978675 wait complete. 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 Processor -- start 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- start start 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17540047d0 0x7f176c1e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f176c1520e0 0x7f176c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 0x7f176c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c7d50 con 0x7f176c152630 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1e9b50 con 0x7f17540047d0 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c158b20 con 0x7f176c1520e0 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 0x7f176c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 0x7f176c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51336/0 (socket says 172.21.15.40:51336) 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 -- 172.21.15.40:0/1249937432 learned_addr learned my addr 172.21.15.40:0/1249937432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176affd640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f176c1520e0 0x7f176c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176b7fe640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17540047d0 0x7f176c1e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 -- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f176c1520e0 msgr2=0x7f176c0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f176c1520e0 0x7f176c0c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 -- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17540047d0 msgr2=0x7f176c1e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17540047d0 0x7f176c1e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 -- 172.21.15.40:0/1249937432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c158840 con 0x7f176c152630 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f176bfff640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 0x7f176c0c8d40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f176c06edd0 tx=0x7f176400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764003b80 con 0x7f176c152630 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764003d00 con 0x7f176c152630 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640052b0 con 0x7f176c152630 2023-11-04T01:45:10.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c1e9500 con 0x7f176c152630 2023-11-04T01:45:10.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c1584d0 con 0x7f176c152630 2023-11-04T01:45:10.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.652+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c1e9c90 con 0x7f176c152630 2023-11-04T01:45:10.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.656+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1764005410 con 0x7f176c152630 2023-11-04T01:45:10.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.656+0000 7f1753fff640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17580664a0 0x7f1758068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.656+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f1764084350 con 0x7f176c152630 2023-11-04T01:45:10.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.656+0000 7f176b7fe640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17580664a0 0x7f1758068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.656+0000 7f176b7fe640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17580664a0 0x7f1758068960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f176c063da0 tx=0x7f175c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.660+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1764051270 con 0x7f176c152630 2023-11-04T01:45:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f176c0cc1d0 con 0x7f176c152630 2023-11-04T01:45:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1753fff640 1 -- 172.21.15.40:0/1249937432 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f1764019310 con 0x7f176c152630 2023-11-04T01:45:10.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:10.851 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:06.727436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 76 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17580664a0 msgr2=0x7f1758068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17580664a0 0x7f1758068960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f176c063da0 tx=0x7f175c009040 comp rx=0 tx=0).stop 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 msgr2=0x7f176c0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 0x7f176c0c8d40 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f176c06edd0 tx=0x7f176400dc00 comp rx=0 tx=0).stop 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 shutdown_connections 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f17580664a0 0x7f1758068960 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f176c152630 0x7f176c0c8d40 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f176c1520e0 0x7f176c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 --2- 172.21.15.40:0/1249937432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f17540047d0 0x7f176c1e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 >> 172.21.15.40:0/1249937432 conn(0x7f176c0b28f0 msgr2=0x7f176c0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.848+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 shutdown_connections 2023-11-04T01:45:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:10.852+0000 7f1771b9e640 1 -- 172.21.15.40:0/1249937432 wait complete. 2023-11-04T01:45:10.870 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:45:11.010 INFO:teuthology.orchestra.run.smithi091.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:44.122618+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:44:10.143073+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:44:41.187610+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:45:11.011 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:44.122618+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:44:10.143073+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:44:41.187610+0000" } ] } 2023-11-04T01:45:11.011 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:45:11.011 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-04T01:45:11.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 Processor -- start 2023-11-04T01:45:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 -- start start 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f708015d2b0 0x7f708006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f708015d690 0x7f70800ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70800cd160 con 0x7f708006f8f0 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800ad450 con 0x7f708015d2b0 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f7084b7d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800cd400 con 0x7f708015d690 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f708015d2b0 0x7f708006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f708015d2b0 0x7f708006c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51338/0 (socket says 172.21.15.40:51338) 2023-11-04T01:45:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 -- 172.21.15.40:0/1647674247 learned_addr learned my addr 172.21.15.40:0/1647674247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707dd9b640 1 --2- 172.21.15.40:0/1647674247 >> v2:172.21.15.91:3300/0 conn(0x7f708015d690 0x7f70800ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 -- 172.21.15.40:0/1647674247 >> v2:172.21.15.91:3300/0 conn(0x7f708015d690 msgr2=0x7f70800ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 --2- 172.21.15.40:0/1647674247 >> v2:172.21.15.91:3300/0 conn(0x7f708015d690 0x7f70800ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 -- 172.21.15.40:0/1647674247 >> v1:172.21.15.91:6789/0 conn(0x7f708006f8f0 legacy=0x7f70800b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 -- 172.21.15.40:0/1647674247 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800cd6e0 con 0x7f708015d2b0 2023-11-04T01:45:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.140+0000 7f707e59c640 1 --2- 172.21.15.40:0/1647674247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f708006c630 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f70800cfbf0 tx=0x7f707801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3e1ae31db6ef4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707d59a640 1 -- 172.21.15.40:0/1647674247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780a57b0 con 0x7f708015d2b0 2023-11-04T01:45:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707d59a640 1 -- 172.21.15.40:0/1647674247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780a5910 con 0x7f708015d2b0 2023-11-04T01:45:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707d59a640 1 -- 172.21.15.40:0/1647674247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780a5ca0 con 0x7f708015d2b0 2023-11-04T01:45:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/1647674247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 msgr2=0x7f708006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 --2- 172.21.15.40:0/1647674247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f708006c630 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f70800cfbf0 tx=0x7f707801c8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/1647674247 shutdown_connections 2023-11-04T01:45:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 --2- 172.21.15.40:0/1647674247 >> v2:172.21.15.91:3300/0 conn(0x7f708015d690 0x7f70800ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 --2- 172.21.15.40:0/1647674247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f708006c630 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/1647674247 >> 172.21.15.40:0/1647674247 conn(0x7f70800cebb0 msgr2=0x7f70800cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:11.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/1647674247 shutdown_connections 2023-11-04T01:45:11.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/1647674247 wait complete. 2023-11-04T01:45:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 Processor -- start 2023-11-04T01:45:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- start start 2023-11-04T01:45:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f708006f8f0 0x7f70801f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f70801548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f708015d690 0x7f70800c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080155e40 con 0x7f708015d2b0 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080155230 con 0x7f708015d690 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7080155510 con 0x7f708006f8f0 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f70801548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f70801548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51352/0 (socket says 172.21.15.40:51352) 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 -- 172.21.15.40:0/4172161148 learned_addr learned my addr 172.21.15.40:0/4172161148 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707ed9d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f708015d690 0x7f70800c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707e59c640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f708006f8f0 0x7f70801f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 -- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f708006f8f0 msgr2=0x7f70801f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f708006f8f0 0x7f70801f8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 -- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f708015d690 msgr2=0x7f70800c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f708015d690 0x7f70800c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 -- 172.21.15.40:0/4172161148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009b30 con 0x7f708015d2b0 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707ed9d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f708015d690 0x7f70800c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f707dd9b640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f70801548c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f706800d5d0 tx=0x7f706800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068004240 con 0x7f708015d2b0 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70680043a0 con 0x7f708015d2b0 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70801557f0 con 0x7f708015d2b0 2023-11-04T01:45:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068003840 con 0x7f708015d2b0 2023-11-04T01:45:11.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.144+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70801f8cb0 con 0x7f708015d2b0 2023-11-04T01:45:11.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.148+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080155fb0 con 0x7f708015d2b0 2023-11-04T01:45:11.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.148+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70680039a0 con 0x7f708015d2b0 2023-11-04T01:45:11.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.148+0000 7f7076ffd640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70600664a0 0x7f7060068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.148+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f70680845d0 con 0x7f708015d2b0 2023-11-04T01:45:11.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.148+0000 7f707e59c640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70600664a0 0x7f7060068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.148+0000 7f707e59c640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70600664a0 0x7f7060068960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f70780ae000 tx=0x7f70780a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:11.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.152+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f70680514e0 con 0x7f708015d2b0 2023-11-04T01:45:11.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.340+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70800744a0 con 0x7f708015d2b0 2023-11-04T01:45:11.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.340+0000 7f7076ffd640 1 -- 172.21.15.40:0/4172161148 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f7068054b00 con 0x7f708015d2b0 2023-11-04T01:45:11.345 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:11.345 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:06.727436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:11.345 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 76 2023-11-04T01:45:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70600664a0 msgr2=0x7f7060068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70600664a0 0x7f7060068960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f70780ae000 tx=0x7f70780a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 msgr2=0x7f70801548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f70801548c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f706800d5d0 tx=0x7f706800da90 comp rx=0 tx=0).stop 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 shutdown_connections 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70600664a0 0x7f7060068960 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f708015d690 0x7f70800c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708015d2b0 0x7f70801548c0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 --2- 172.21.15.40:0/4172161148 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f708006f8f0 0x7f70801f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 >> 172.21.15.40:0/4172161148 conn(0x7f70800cebb0 msgr2=0x7f7080153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 shutdown_connections 2023-11-04T01:45:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.344+0000 7f7084b7d640 1 -- 172.21.15.40:0/4172161148 wait complete. 2023-11-04T01:45:11.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:45:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.480+0000 7f92c1a26640 1 Processor -- start 2023-11-04T01:45:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.480+0000 7f92c1a26640 1 -- start start 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92c1a26640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f92bc15d0b0 0x7f92bc160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92c1a26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92bc1610f0 0x7f92bc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92c1a26640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0b5e00 con 0x7f92bc0cfd50 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92c1a26640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0d1520 con 0x7f92bc1610f0 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92c1a26640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0d01e0 con 0x7f92bc15d0b0 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92bc1610f0 0x7f92bc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92bc1610f0 0x7f92bc0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51364/0 (socket says 172.21.15.40:51364) 2023-11-04T01:45:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 -- 172.21.15.40:0/1975892545 learned_addr learned my addr 172.21.15.40:0/1975892545 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92baffd640 1 --2- 172.21.15.40:0/1975892545 >> v2:172.21.15.91:3300/0 conn(0x7f92bc15d0b0 0x7f92bc160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 -- 172.21.15.40:0/1975892545 >> v2:172.21.15.91:3300/0 conn(0x7f92bc15d0b0 msgr2=0x7f92bc160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 --2- 172.21.15.40:0/1975892545 >> v2:172.21.15.91:3300/0 conn(0x7f92bc15d0b0 0x7f92bc160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 -- 172.21.15.40:0/1975892545 >> v1:172.21.15.91:6789/0 conn(0x7f92bc0cfd50 legacy=0x7f92bc0b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 -- 172.21.15.40:0/1975892545 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc15d490 con 0x7f92bc1610f0 2023-11-04T01:45:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92ba7fc640 1 --2- 172.21.15.40:0/1975892545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc0cf810 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f92bc06b900 tx=0x7f92b001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0083c5759459dac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92b9ffb640 1 -- 172.21.15.40:0/1975892545 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00aa660 con 0x7f92bc1610f0 2023-11-04T01:45:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92b9ffb640 1 -- 172.21.15.40:0/1975892545 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b00aa7c0 con 0x7f92bc1610f0 2023-11-04T01:45:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.484+0000 7f92b9ffb640 1 -- 172.21.15.40:0/1975892545 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00aab50 con 0x7f92bc1610f0 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1975892545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 msgr2=0x7f92bc0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1975892545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc0cf810 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f92bc06b900 tx=0x7f92b001c500 comp rx=0 tx=0).stop 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1975892545 shutdown_connections 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1975892545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc0cf810 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1975892545 >> v2:172.21.15.91:3300/0 conn(0x7f92bc15d0b0 0x7f92bc160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1975892545 >> 172.21.15.40:0/1975892545 conn(0x7f92bc06a890 msgr2=0x7f92bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1975892545 shutdown_connections 2023-11-04T01:45:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1975892545 wait complete. 2023-11-04T01:45:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 Processor -- start 2023-11-04T01:45:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- start start 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92bc0cfd50 0x7f92bc152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92bc15d0b0 0x7f92bc14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1534c0 con 0x7f92bc1610f0 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1521c0 con 0x7f92bc0cfd50 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc1524a0 con 0x7f92bc15d0b0 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51374/0 (socket says 172.21.15.40:51374) 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 -- 172.21.15.40:0/1237548762 learned_addr learned my addr 172.21.15.40:0/1237548762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92baffd640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92bc0cfd50 0x7f92bc152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92ba7fc640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92bc15d0b0 0x7f92bc14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 -- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92bc15d0b0 msgr2=0x7f92bc14e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92bc15d0b0 0x7f92bc14e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 -- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92bc0cfd50 msgr2=0x7f92bc152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92bc0cfd50 0x7f92bc152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 -- 172.21.15.40:0/1237548762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00094d0 con 0x7f92bc1610f0 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92ba7fc640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92bc15d0b0 0x7f92bc14e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92baffd640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92bc0cfd50 0x7f92bc152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92bb7fe640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc154d10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c430 tx=0x7f92b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4005220 con 0x7f92bc1610f0 2023-11-04T01:45:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4005380 con 0x7f92bc1610f0 2023-11-04T01:45:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc152780 con 0x7f92bc1610f0 2023-11-04T01:45:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4007270 con 0x7f92bc1610f0 2023-11-04T01:45:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.488+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc15e3a0 con 0x7f92bc1610f0 2023-11-04T01:45:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.492+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc152300 con 0x7f92bc1610f0 2023-11-04T01:45:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.492+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92b40073d0 con 0x7f92bc1610f0 2023-11-04T01:45:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.492+0000 7f92a3fff640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92a80664a0 0x7f92a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.492+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f92b4083a20 con 0x7f92bc1610f0 2023-11-04T01:45:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.492+0000 7f92baffd640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92a80664a0 0x7f92a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.492+0000 7f92baffd640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92a80664a0 0x7f92a8068960 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0074c0 tx=0x7f92ac00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:11.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.496+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92bc152300 con 0x7f92bc1610f0 2023-11-04T01:45:11.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.708+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f92bc152300 con 0x7f92bc1610f0 2023-11-04T01:45:11.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.992+0000 7f92a3fff640 1 -- 172.21.15.40:0/1237548762 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6601 v77) v1 ==== 112+0+0 (secure 0 0 0) 0x7f92bc152300 con 0x7f92bc1610f0 2023-11-04T01:45:11.995 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.6601 2023-11-04T01:45:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92a80664a0 msgr2=0x7f92a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92a80664a0 0x7f92a8068960 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0074c0 tx=0x7f92ac00b040 comp rx=0 tx=0).stop 2023-11-04T01:45:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 msgr2=0x7f92bc154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc154d10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c430 tx=0x7f92b400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 shutdown_connections 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92a80664a0 0x7f92a8068960 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc1610f0 0x7f92bc154d10 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92bc15d0b0 0x7f92bc14e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 --2- 172.21.15.40:0/1237548762 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92bc0cfd50 0x7f92bc152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 >> 172.21.15.40:0/1237548762 conn(0x7f92bc06a890 msgr2=0x7f92bc0b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 shutdown_connections 2023-11-04T01:45:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:11.996+0000 7f92c1a26640 1 -- 172.21.15.40:0/1237548762 wait complete. 2023-11-04T01:45:12.019 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:45:12.161 INFO:teuthology.orchestra.run.smithi091.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:45:12.161 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:45:12.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:12.161 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-04T01:45:12.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:45:12.324 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:45:12.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:12.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 Processor -- start 2023-11-04T01:45:12.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 -- start start 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44e4159a50 0x7f44e40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f44e40ce720 0x7f44e406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e4159e30 con 0x7f44e40ce070 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e4070b80 con 0x7f44e4159a50 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ec597640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40ccfd0 con 0x7f44e40ce720 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44eab34640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f44e40ce070 0x7f44e415d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60526/0 (socket says 172.21.15.40:60526) 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44eab34640 1 -- 172.21.15.40:0/346412588 learned_addr learned my addr 172.21.15.40:0/346412588 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ea333640 1 --2- 172.21.15.40:0/346412588 >> v2:172.21.15.40:3300/0 conn(0x7f44e4159a50 0x7f44e40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44e9b32640 1 --2- 172.21.15.40:0/346412588 >> v2:172.21.15.91:3300/0 conn(0x7f44e40ce720 0x7f44e406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44e9331640 1 -- 172.21.15.40:0/346412588 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530405680 0 0) 0x7f44dc0014a0 con 0x7f44e40ce070 2023-11-04T01:45:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44e9331640 1 -- 172.21.15.40:0/346412588 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d0003530 con 0x7f44e40ce070 2023-11-04T01:45:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ea333640 1 -- 172.21.15.40:0/346412588 >> v2:172.21.15.91:3300/0 conn(0x7f44e40ce720 msgr2=0x7f44e406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ea333640 1 --2- 172.21.15.40:0/346412588 >> v2:172.21.15.91:3300/0 conn(0x7f44e40ce720 0x7f44e406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ea333640 1 -- 172.21.15.40:0/346412588 >> v1:172.21.15.40:6789/0 conn(0x7f44e40ce070 legacy=0x7f44e415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ea333640 1 -- 172.21.15.40:0/346412588 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40cd2b0 con 0x7f44e4159a50 2023-11-04T01:45:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.440+0000 7f44ea333640 1 --2- 172.21.15.40:0/346412588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e4159a50 0x7f44e40cc6f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f44e406db30 tx=0x7f44e0020020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf03d9d76ff9df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9331640 1 -- 172.21.15.40:0/346412588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00a9e30 con 0x7f44e4159a50 2023-11-04T01:45:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9331640 1 -- 172.21.15.40:0/346412588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e00b1440 con 0x7f44e4159a50 2023-11-04T01:45:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9331640 1 -- 172.21.15.40:0/346412588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00b17d0 con 0x7f44e4159a50 2023-11-04T01:45:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/346412588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e4159a50 msgr2=0x7f44e40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 --2- 172.21.15.40:0/346412588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e4159a50 0x7f44e40cc6f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f44e406db30 tx=0x7f44e0020020 comp rx=0 tx=0).stop 2023-11-04T01:45:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/346412588 shutdown_connections 2023-11-04T01:45:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 --2- 172.21.15.40:0/346412588 >> v2:172.21.15.91:3300/0 conn(0x7f44e40ce720 0x7f44e406ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 --2- 172.21.15.40:0/346412588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e4159a50 0x7f44e40cc6f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/346412588 >> 172.21.15.40:0/346412588 conn(0x7f44e40cebb0 msgr2=0x7f44e40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/346412588 shutdown_connections 2023-11-04T01:45:12.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/346412588 wait complete. 2023-11-04T01:45:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 Processor -- start 2023-11-04T01:45:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- start start 2023-11-04T01:45:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44e40ce070 0x7f44e41537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 0x7f44e41e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f44e41e5930 0x7f44e40b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b22b0 con 0x7f44e40ce720 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e41e5db0 con 0x7f44e40ce070 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b26d0 con 0x7f44e41e5930 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 0x7f44e41e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 0x7f44e41e53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51394/0 (socket says 172.21.15.40:51394) 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 -- 172.21.15.40:0/741496294 learned_addr learned my addr 172.21.15.40:0/741496294 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ea333640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44e40ce070 0x7f44e41537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44eab34640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f44e41e5930 0x7f44e40b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 -- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f44e41e5930 msgr2=0x7f44e40b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f44e41e5930 0x7f44e40b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 -- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44e40ce070 msgr2=0x7f44e41537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44e40ce070 0x7f44e41537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 -- 172.21.15.40:0/741496294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e000a5c0 con 0x7f44e40ce720 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ea333640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44e40ce070 0x7f44e41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44e9b32640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 0x7f44e41e53f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f44d400d5d0 tx=0x7f44d400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4004240 con 0x7f44e40ce720 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d40043a0 con 0x7f44e40ce720 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4003840 con 0x7f44e40ce720 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e40b1910 con 0x7f44e40ce720 2023-11-04T01:45:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.444+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e40b1ed0 con 0x7f44e40ce720 2023-11-04T01:45:12.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.448+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e40744a0 con 0x7f44e40ce720 2023-11-04T01:45:12.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.448+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44d40039a0 con 0x7f44e40ce720 2023-11-04T01:45:12.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.448+0000 7f44daffd640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f44c80664a0 0x7f44c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.448+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f44d4084500 con 0x7f44e40ce720 2023-11-04T01:45:12.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.448+0000 7f44ea333640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f44c80664a0 0x7f44c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.448+0000 7f44ea333640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f44c80664a0 0x7f44c8068960 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f44e00b3000 tx=0x7f44e00ab070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:12.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.452+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44d40514b0 con 0x7f44e40ce720 2023-11-04T01:45:12.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44e40c9070 con 0x7f44e40ce720 2023-11-04T01:45:12.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44daffd640 1 -- 172.21.15.40:0/741496294 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f44d4054ad0 con 0x7f44e40ce720 2023-11-04T01:45:12.642 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:12.642 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":77,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:11.711886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:12.643 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 77 2023-11-04T01:45:12.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f44c80664a0 msgr2=0x7f44c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f44c80664a0 0x7f44c8068960 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f44e00b3000 tx=0x7f44e00ab070 comp rx=0 tx=0).stop 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 msgr2=0x7f44e41e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 0x7f44e41e53f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f44d400d5d0 tx=0x7f44d400da90 comp rx=0 tx=0).stop 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 shutdown_connections 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f44c80664a0 0x7f44c8068960 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f44e41e5930 0x7f44e40b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44e40ce720 0x7f44e41e53f0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 --2- 172.21.15.40:0/741496294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44e40ce070 0x7f44e41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 >> 172.21.15.40:0/741496294 conn(0x7f44e40cebb0 msgr2=0x7f44e4071710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 shutdown_connections 2023-11-04T01:45:12.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:12.640+0000 7f44ec597640 1 -- 172.21.15.40:0/741496294 wait complete. 2023-11-04T01:45:12.661 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:12.744 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7ff6fa492640 time 2023-11-04T01:45:12.745717+0000 2023-11-04T01:45:12.744 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7065cafae] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.746 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7ff6fa492640 thread_name:MR_Finisher 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:45:12.743+0000 7ff6fa492640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7ff6fa492640 time 2023-11-04T01:45:12.745717+0000 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7065cafae] 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.747 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.748 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.748 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.748 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.748 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.748 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff705f05520] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7065cb008] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.749 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:45:12.743+0000 7ff6fa492640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7ff6fa492640 thread_name:MR_Finisher 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff705f05520] 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:45:12.750 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7065cb008] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:12.751 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.759 INFO:tasks.ceph.mds.b.smithi091.stderr: -486> 2023-11-04T01:45:08.663+0000 7ff6fdc99640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:12.759 INFO:tasks.ceph.mds.b.smithi091.stderr: -484> 2023-11-04T01:45:08.663+0000 7ff6fdc99640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: -1> 2023-11-04T01:45:12.743+0000 7ff6fa492640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7ff6fa492640 time 2023-11-04T01:45:12.745717+0000 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7065cafae] 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.761 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 0> 2023-11-04T01:45:12.743+0000 7ff6fa492640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7ff6fa492640 thread_name:MR_Finisher 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff705f05520] 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:45:12.762 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7065cb008] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:12.763 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.770 INFO:tasks.ceph.mds.b.smithi091.stderr: -486> 2023-11-04T01:45:08.663+0000 7ff6fdc99640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:12.770 INFO:tasks.ceph.mds.b.smithi091.stderr: -484> 2023-11-04T01:45:08.663+0000 7ff6fdc99640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:12.771 INFO:tasks.ceph.mds.b.smithi091.stderr: -1> 2023-11-04T01:45:12.743+0000 7ff6fa492640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7ff6fa492640 time 2023-11-04T01:45:12.745717+0000 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7065cafae] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.772 INFO:tasks.ceph.mds.b.smithi091.stderr: 0> 2023-11-04T01:45:12.743+0000 7ff6fa492640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7ff6fa492640 thread_name:MR_Finisher 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff705f05520] 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7065cb008] 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff7065cb162] 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x55ec75c85da5] 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ec75cb608c] 2023-11-04T01:45:12.773 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ec75cb64bc] 2023-11-04T01:45:12.774 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ec75cb65f3] 2023-11-04T01:45:12.774 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7ff706671305] 2023-11-04T01:45:12.774 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff705f57b43] 2023-11-04T01:45:12.774 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff705fe9a00] 2023-11-04T01:45:12.774 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:12.774 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:45:13.170 INFO:tasks.ceph.mds.b.smithi091.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:45:15.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:45:17.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:17.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.792+0000 7f4f351ba640 1 Processor -- start 2023-11-04T01:45:17.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.792+0000 7f4f351ba640 1 -- start start 2023-11-04T01:45:17.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f351ba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f30159260 0x7f4f3013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f351ba640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3013f240 con 0x7f4f300c9170 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f351ba640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3013ec10 con 0x7f4f30159640 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f351ba640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3015da60 con 0x7f4f30159260 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2f59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4f300c9170 0x7f4f3013cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57772/0 (socket says 172.21.15.40:57772) 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2f59e640 1 -- 172.21.15.40:0/1855826478 learned_addr learned my addr 172.21.15.40:0/1855826478 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2ed9d640 1 --2- 172.21.15.40:0/1855826478 >> v2:172.21.15.40:3300/0 conn(0x7f4f30159260 0x7f4f3013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2dd9b640 1 -- 172.21.15.40:0/1855826478 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807442529 0 0) 0x7f4f3013f240 con 0x7f4f300c9170 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2dd9b640 1 -- 172.21.15.40:0/1855826478 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1c003530 con 0x7f4f300c9170 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2ed9d640 1 -- 172.21.15.40:0/1855826478 >> v1:172.21.15.91:6789/0 conn(0x7f4f30159640 legacy=0x7f4f3015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2ed9d640 1 -- 172.21.15.40:0/1855826478 >> v1:172.21.15.40:6789/0 conn(0x7f4f300c9170 legacy=0x7f4f3013cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2ed9d640 1 -- 172.21.15.40:0/1855826478 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3015dd40 con 0x7f4f30159260 2023-11-04T01:45:17.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2ed9d640 1 --2- 172.21.15.40:0/1855826478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f3013f6d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009d90 tx=0x7f4f2001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7681ca0aaeaed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2dd9b640 1 -- 172.21.15.40:0/1855826478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200a5a00 con 0x7f4f30159260 2023-11-04T01:45:17.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2dd9b640 1 -- 172.21.15.40:0/1855826478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f200a5b60 con 0x7f4f30159260 2023-11-04T01:45:17.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.796+0000 7f4f2dd9b640 1 -- 172.21.15.40:0/1855826478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200ad440 con 0x7f4f30159260 2023-11-04T01:45:17.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/1855826478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 msgr2=0x7f4f3013f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 --2- 172.21.15.40:0/1855826478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f3013f6d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009d90 tx=0x7f4f2001c920 comp rx=0 tx=0).stop 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/1855826478 shutdown_connections 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 --2- 172.21.15.40:0/1855826478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f3013f6d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/1855826478 >> 172.21.15.40:0/1855826478 conn(0x7f4f300cebb0 msgr2=0x7f4f300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/1855826478 shutdown_connections 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/1855826478 wait complete. 2023-11-04T01:45:17.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 Processor -- start 2023-11-04T01:45:17.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- start start 2023-11-04T01:45:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f300c9170 0x7f4f3015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f300c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4f30159640 0x7f4f3015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3015c910 con 0x7f4f30159260 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c7670 con 0x7f4f300c9170 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3015b950 con 0x7f4f30159640 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f300c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f300c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44464/0 (socket says 172.21.15.40:44464) 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 -- 172.21.15.40:0/577220490 learned_addr learned my addr 172.21.15.40:0/577220490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2f59e640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4f30159640 0x7f4f3015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2ed9d640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f300c9170 0x7f4f3015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 -- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4f30159640 msgr2=0x7f4f3015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4f30159640 0x7f4f3015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 -- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f300c9170 msgr2=0x7f4f3015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f300c9170 0x7f4f3015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 -- 172.21.15.40:0/577220490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009a70 con 0x7f4f30159260 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f2e59c640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f300c7130 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c3f0 tx=0x7f4f1800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f180052d0 con 0x7f4f30159260 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18005430 con 0x7f4f30159260 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3015d830 con 0x7f4f30159260 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18003840 con 0x7f4f30159260 2023-11-04T01:45:17.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.800+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3015c630 con 0x7f4f30159260 2023-11-04T01:45:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.804+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f300744a0 con 0x7f4f30159260 2023-11-04T01:45:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.804+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f180039a0 con 0x7f4f30159260 2023-11-04T01:45:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.804+0000 7f4f277fe640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4f100664a0 0x7f4f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.804+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f4f18083950 con 0x7f4f30159260 2023-11-04T01:45:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.804+0000 7f4f2ed9d640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4f100664a0 0x7f4f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.804+0000 7f4f2ed9d640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4f100664a0 0x7f4f10068960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4f200af000 tx=0x7f4f200a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:17.808+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f180508a0 con 0x7f4f30159260 2023-11-04T01:45:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.000+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f300c2250 con 0x7f4f30159260 2023-11-04T01:45:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.000+0000 7f4f277fe640 1 -- 172.21.15.40:0/577220490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f4f18053ec0 con 0x7f4f30159260 2023-11-04T01:45:18.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:18.004 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":77,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:11.711886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:18.004 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 77 2023-11-04T01:45:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4f100664a0 msgr2=0x7f4f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4f100664a0 0x7f4f10068960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4f200af000 tx=0x7f4f200a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 msgr2=0x7f4f300c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f300c7130 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c3f0 tx=0x7f4f1800c8b0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 shutdown_connections 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4f100664a0 0x7f4f10068960 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4f30159640 0x7f4f3015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f30159260 0x7f4f300c7130 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 --2- 172.21.15.40:0/577220490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4f300c9170 0x7f4f3015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 >> 172.21.15.40:0/577220490 conn(0x7f4f300cebb0 msgr2=0x7f4f300cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 shutdown_connections 2023-11-04T01:45:18.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:18.004+0000 7f4f351ba640 1 -- 172.21.15.40:0/577220490 wait complete. 2023-11-04T01:45:18.023 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:21.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:45:23.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.156+0000 7fe3338ac640 1 Processor -- start 2023-11-04T01:45:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.156+0000 7fe3338ac640 1 -- start start 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe3338ac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe3338ac640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe32c0b0c70 0x7fe32c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe3338ac640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0ce320 con 0x7fe32c0c9960 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe3338ac640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c06d2f0 con 0x7fe32c0b0c70 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe3338ac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0ce110 con 0x7fe32c0b0890 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe330e47640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe32c0c9960 0x7fe32c0704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57776/0 (socket says 172.21.15.40:57776) 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331e49640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe32c0b0c70 0x7fe32c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe330e47640 1 -- 172.21.15.40:0/4061068358 learned_addr learned my addr 172.21.15.40:0/4061068358 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331648640 1 --2- 172.21.15.40:0/4061068358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331e49640 1 -- 172.21.15.40:0/4061068358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 msgr2=0x7fe32c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331e49640 1 --2- 172.21.15.40:0/4061068358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331e49640 1 -- 172.21.15.40:0/4061068358 >> v1:172.21.15.40:6789/0 conn(0x7fe32c0c9960 legacy=0x7fe32c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331e49640 1 -- 172.21.15.40:0/4061068358 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0ce600 con 0x7fe32c0b0c70 2023-11-04T01:45:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe31ffff640 1 -- 172.21.15.40:0/4061068358 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101747800 0 0) 0x7fe32c0ce320 con 0x7fe32c0c9960 2023-11-04T01:45:23.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe331e49640 1 --2- 172.21.15.40:0/4061068358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0ccf90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fe324009d90 tx=0x7fe32401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dec63d6fd6d37ad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe31ffff640 1 -- 172.21.15.40:0/4061068358 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240a59e0 con 0x7fe32c0b0c70 2023-11-04T01:45:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe31ffff640 1 -- 172.21.15.40:0/4061068358 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240a5b40 con 0x7fe32c0b0c70 2023-11-04T01:45:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.160+0000 7fe31ffff640 1 -- 172.21.15.40:0/4061068358 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240ad440 con 0x7fe32c0b0c70 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/4061068358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0b0c70 msgr2=0x7fe32c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 --2- 172.21.15.40:0/4061068358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0ccf90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fe324009d90 tx=0x7fe32401c920 comp rx=0 tx=0).stop 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/4061068358 shutdown_connections 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 --2- 172.21.15.40:0/4061068358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0ccf90 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 --2- 172.21.15.40:0/4061068358 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/4061068358 >> 172.21.15.40:0/4061068358 conn(0x7fe32c0cebb0 msgr2=0x7fe32c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/4061068358 shutdown_connections 2023-11-04T01:45:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/4061068358 wait complete. 2023-11-04T01:45:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 Processor -- start 2023-11-04T01:45:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- start start 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c1437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 0x7fe32c153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c154260 con 0x7fe32c0c9960 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c157140 con 0x7fe32c0b0c70 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c157420 con 0x7fe32c0b0890 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 0x7fe32c153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 0x7fe32c153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44482/0 (socket says 172.21.15.40:44482) 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 -- 172.21.15.40:0/1698629513 learned_addr learned my addr 172.21.15.40:0/1698629513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe330e47640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331648640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c1437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 -- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 msgr2=0x7fe32c1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c1437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 -- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe32c0b0c70 msgr2=0x7fe32c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 -- 172.21.15.40:0/1698629513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009a70 con 0x7fe32c0c9960 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe331e49640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 0x7fe32c153d20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe32401afd0 tx=0x7fe3240196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240ade40 con 0x7fe32c0c9960 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324009450 con 0x7fe32c0c9960 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240b9670 con 0x7fe32c0c9960 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c157700 con 0x7fe32c0c9960 2023-11-04T01:45:23.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.164+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c155b60 con 0x7fe32c0c9960 2023-11-04T01:45:23.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.168+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c0c5580 con 0x7fe32c0c9960 2023-11-04T01:45:23.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.168+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3240039a0 con 0x7fe32c0c9960 2023-11-04T01:45:23.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.168+0000 7fe31dffb640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3100664d0 0x7fe310068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.168+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7fe32411f8b0 con 0x7fe32c0c9960 2023-11-04T01:45:23.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.168+0000 7fe331648640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3100664d0 0x7fe310068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.168+0000 7fe331648640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3100664d0 0x7fe310068990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe32000b9d0 tx=0x7fe320008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.172+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3240ec7d0 con 0x7fe32c0c9960 2023-11-04T01:45:23.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.360+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe32c0744a0 con 0x7fe32c0c9960 2023-11-04T01:45:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe31dffb640 1 -- 172.21.15.40:0/1698629513 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fe3240efdf0 con 0x7fe32c0c9960 2023-11-04T01:45:23.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:23.366 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":77,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:11.711886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:23.366 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 77 2023-11-04T01:45:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3100664d0 msgr2=0x7fe310068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3100664d0 0x7fe310068990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe32000b9d0 tx=0x7fe320008040 comp rx=0 tx=0).stop 2023-11-04T01:45:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 msgr2=0x7fe32c153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 0x7fe32c153d20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fe32401afd0 tx=0x7fe3240196c0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 shutdown_connections 2023-11-04T01:45:23.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe3100664d0 0x7fe310068990 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0c9960 0x7fe32c153d20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe32c0b0c70 0x7fe32c0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 --2- 172.21.15.40:0/1698629513 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe32c0b0890 0x7fe32c1437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 >> 172.21.15.40:0/1698629513 conn(0x7fe32c0cebb0 msgr2=0x7fe32c0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 shutdown_connections 2023-11-04T01:45:23.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:23.364+0000 7fe3338ac640 1 -- 172.21.15.40:0/1698629513 wait complete. 2023-11-04T01:45:23.385 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:27.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:27.640 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:28.386 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:28.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.516+0000 7fc48961f640 1 Processor -- start 2023-11-04T01:45:28.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.516+0000 7fc48961f640 1 -- start start 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc48415afd0 0x7fc4840715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc4840b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840c2670 con 0x7fc4840b0b70 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc484070140 con 0x7fc48415afd0 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48415fc90 con 0x7fc48406f8f0 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc4837fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc4840b0b70 0x7fc4840c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60442/0 (socket says 172.21.15.40:60442) 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc4837fe640 1 -- 172.21.15.40:0/1955810245 learned_addr learned my addr 172.21.15.40:0/1955810245 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc482ffd640 1 --2- 172.21.15.40:0/1955810245 >> v2:172.21.15.40:3300/0 conn(0x7fc48415afd0 0x7fc4840715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc481ffb640 1 -- 172.21.15.40:0/1955810245 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105035924 0 0) 0x7fc4840c2670 con 0x7fc4840b0b70 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc481ffb640 1 -- 172.21.15.40:0/1955810245 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc470003530 con 0x7fc4840b0b70 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc4827fc640 1 --2- 172.21.15.40:0/1955810245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc4840b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc482ffd640 1 -- 172.21.15.40:0/1955810245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 msgr2=0x7fc4840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc482ffd640 1 --2- 172.21.15.40:0/1955810245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc4840b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc482ffd640 1 -- 172.21.15.40:0/1955810245 >> v1:172.21.15.40:6789/0 conn(0x7fc4840b0b70 legacy=0x7fc4840c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc482ffd640 1 -- 172.21.15.40:0/1955810245 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48406bc30 con 0x7fc48415afd0 2023-11-04T01:45:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc482ffd640 1 --2- 172.21.15.40:0/1955810245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4840715d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0097c0 tx=0x7fc47c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ea63b3c6c8535a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc481ffb640 1 -- 172.21.15.40:0/1955810245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0ab600 con 0x7fc48415afd0 2023-11-04T01:45:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc481ffb640 1 -- 172.21.15.40:0/1955810245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c0a7050 con 0x7fc48415afd0 2023-11-04T01:45:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc481ffb640 1 -- 172.21.15.40:0/1955810245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0ab980 con 0x7fc48415afd0 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- 172.21.15.40:0/1955810245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 msgr2=0x7fc4840715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 --2- 172.21.15.40:0/1955810245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4840715d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0097c0 tx=0x7fc47c01c480 comp rx=0 tx=0).stop 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- 172.21.15.40:0/1955810245 shutdown_connections 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 --2- 172.21.15.40:0/1955810245 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc4840b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 --2- 172.21.15.40:0/1955810245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4840715d0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- 172.21.15.40:0/1955810245 >> 172.21.15.40:0/1955810245 conn(0x7fc4840cebb0 msgr2=0x7fc4840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- 172.21.15.40:0/1955810245 shutdown_connections 2023-11-04T01:45:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.520+0000 7fc48961f640 1 -- 172.21.15.40:0/1955810245 wait complete. 2023-11-04T01:45:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 Processor -- start 2023-11-04T01:45:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- start start 2023-11-04T01:45:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc484158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4840b0b70 0x7fc4841f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4841f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484150b60 con 0x7fc48415afd0 2023-11-04T01:45:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840cb9c0 con 0x7fc4840b0b70 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840cbca0 con 0x7fc48406f8f0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4841f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4841f71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37934/0 (socket says 172.21.15.40:37934) 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 -- 172.21.15.40:0/1604379371 learned_addr learned my addr 172.21.15.40:0/1604379371 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc482ffd640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc484158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4827fc640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4840b0b70 0x7fc4841f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 -- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 msgr2=0x7fc484158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc484158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 -- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4840b0b70 msgr2=0x7fc4841f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4840b0b70 0x7fc4841f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 -- 172.21.15.40:0/1604379371 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009420 con 0x7fc48415afd0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc4837fe640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4841f71d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c3c0 tx=0x7fc47400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474005cf0 con 0x7fc48415afd0 2023-11-04T01:45:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474005e50 con 0x7fc48415afd0 2023-11-04T01:45:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4841504a0 con 0x7fc48415afd0 2023-11-04T01:45:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474007310 con 0x7fc48415afd0 2023-11-04T01:45:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4840c7a00 con 0x7fc48415afd0 2023-11-04T01:45:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.524+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc484150ca0 con 0x7fc48415afd0 2023-11-04T01:45:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.528+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc474007470 con 0x7fc48415afd0 2023-11-04T01:45:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.528+0000 7fc47b7fe640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc4640664a0 0x7fc464068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.528+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7fc474083880 con 0x7fc48415afd0 2023-11-04T01:45:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.528+0000 7fc482ffd640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc4640664a0 0x7fc464068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.528+0000 7fc482ffd640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc4640664a0 0x7fc464068960 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0ad000 tx=0x7fc47c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.532+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc484150ca0 con 0x7fc48415afd0 2023-11-04T01:45:28.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:45:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.720+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc484150ca0 con 0x7fc48415afd0 2023-11-04T01:45:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc47b7fe640 1 -- 172.21.15.40:0/1604379371 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4976 (secure 0 0 0) 0x7fc484150ca0 con 0x7fc48415afd0 2023-11-04T01:45:28.726 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7689,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:27.978704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6601,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6601":{"gid":6601,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":12,"addr":"172.21.15.91:6837/2523798790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2523798790},{"type":"v1","addr":"172.21.15.91:6837","nonce":2523798790}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:27.978703+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:28.726 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 78 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc4640664a0 msgr2=0x7fc464068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc4640664a0 0x7fc464068960 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0ad000 tx=0x7fc47c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 msgr2=0x7fc4841f71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4841f71d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c3c0 tx=0x7fc47400c880 comp rx=0 tx=0).stop 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 shutdown_connections 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc4640664a0 0x7fc464068960 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc48415afd0 0x7fc4841f71d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4840b0b70 0x7fc4841f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 --2- 172.21.15.40:0/1604379371 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc48406f8f0 0x7fc484158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 >> 172.21.15.40:0/1604379371 conn(0x7fc4840cebb0 msgr2=0x7fc484156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 shutdown_connections 2023-11-04T01:45:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:28.724+0000 7fc48961f640 1 -- 172.21.15.40:0/1604379371 wait complete. 2023-11-04T01:45:28.745 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:45:28.745 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:45:28.758 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:45:28.760 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:45:28.760 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:45:28.816 INFO:teuthology.orchestra.run.smithi091.stdout:1699062312.44467.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:45:28.818 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062312.44467.core'] 2023-11-04T01:45:28.818 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062312.44467.core, deleting it 2023-11-04T01:45:28.818 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062312.44467.core 2023-11-04T01:45:28.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:45:29.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.008+0000 7f9bd35ca640 1 Processor -- start 2023-11-04T01:45:29.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.008+0000 7f9bd35ca640 1 -- start start 2023-11-04T01:45:29.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd35ca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9bcc15b290 0x7f9bcc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd35ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bcc0c2670 0x7f9bcc0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd35ca640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc06c740 con 0x7f9bcc06fe30 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd35ca640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc15b670 con 0x7f9bcc0c2670 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd35ca640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc06bb30 con 0x7f9bcc15b290 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bcc0c2670 0x7f9bcc0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bcc0c2670 0x7f9bcc0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37938/0 (socket says 172.21.15.40:37938) 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 -- 172.21.15.40:0/2229090441 learned_addr learned my addr 172.21.15.40:0/2229090441 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd1366640 1 --2- 172.21.15.40:0/2229090441 >> v2:172.21.15.91:3300/0 conn(0x7f9bcc15b290 0x7f9bcc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 -- 172.21.15.40:0/2229090441 >> v2:172.21.15.91:3300/0 conn(0x7f9bcc15b290 msgr2=0x7f9bcc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 --2- 172.21.15.40:0/2229090441 >> v2:172.21.15.91:3300/0 conn(0x7f9bcc15b290 0x7f9bcc06f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 -- 172.21.15.40:0/2229090441 >> v1:172.21.15.91:6789/0 conn(0x7f9bcc06fe30 legacy=0x7f9bcc0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 -- 172.21.15.40:0/2229090441 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc06be10 con 0x7f9bcc0c2670 2023-11-04T01:45:29.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd1366640 1 --2- 172.21.15.40:0/2229090441 >> v2:172.21.15.91:3300/0 conn(0x7f9bcc15b290 0x7f9bcc06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bd0b65640 1 --2- 172.21.15.40:0/2229090441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc0c2670 0x7f9bcc0b0630 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0ce930 tx=0x7f9bbc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1dd828643eef6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bc3fff640 1 -- 172.21.15.40:0/2229090441 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0ab600 con 0x7f9bcc0c2670 2023-11-04T01:45:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bc3fff640 1 -- 172.21.15.40:0/2229090441 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc0a7050 con 0x7f9bcc0c2670 2023-11-04T01:45:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.012+0000 7f9bc3fff640 1 -- 172.21.15.40:0/2229090441 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0ab980 con 0x7f9bcc0c2670 2023-11-04T01:45:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2229090441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc0c2670 msgr2=0x7f9bcc0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2229090441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc0c2670 0x7f9bcc0b0630 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0ce930 tx=0x7f9bbc01c430 comp rx=0 tx=0).stop 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2229090441 shutdown_connections 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2229090441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc0c2670 0x7f9bcc0b0630 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2229090441 >> v2:172.21.15.91:3300/0 conn(0x7f9bcc15b290 0x7f9bcc06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2229090441 >> 172.21.15.40:0/2229090441 conn(0x7f9bcc0cebb0 msgr2=0x7f9bcc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2229090441 shutdown_connections 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2229090441 wait complete. 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 Processor -- start 2023-11-04T01:45:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- start start 2023-11-04T01:45:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bcc06fe30 0x7f9bcc0b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bcc0c2670 0x7f9bcc14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 0x7f9bcc0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0b2750 con 0x7f9bcc15b290 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0b4500 con 0x7f9bcc06fe30 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0b1b40 con 0x7f9bcc0c2670 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 0x7f9bcc0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 0x7f9bcc0b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37954/0 (socket says 172.21.15.40:37954) 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 -- 172.21.15.40:0/2877717798 learned_addr learned my addr 172.21.15.40:0/2877717798 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1366640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bcc06fe30 0x7f9bcc0b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd0b65640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bcc0c2670 0x7f9bcc14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 -- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bcc0c2670 msgr2=0x7f9bcc14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bcc0c2670 0x7f9bcc14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 -- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bcc06fe30 msgr2=0x7f9bcc0b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bcc06fe30 0x7f9bcc0b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 -- 172.21.15.40:0/2877717798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0094d0 con 0x7f9bcc15b290 2023-11-04T01:45:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd0b65640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bcc0c2670 0x7f9bcc14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd1b67640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 0x7f9bcc0b2be0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400c780 tx=0x7f9bc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4004b70 con 0x7f9bcc15b290 2023-11-04T01:45:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc400ce90 con 0x7f9bcc15b290 2023-11-04T01:45:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc0b1e20 con 0x7f9bcc15b290 2023-11-04T01:45:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400a850 con 0x7f9bcc15b290 2023-11-04T01:45:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.016+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc0b23e0 con 0x7f9bcc15b290 2023-11-04T01:45:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.020+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc0b28c0 con 0x7f9bcc15b290 2023-11-04T01:45:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.020+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bc400a9b0 con 0x7f9bcc15b290 2023-11-04T01:45:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.020+0000 7f9bc1ffb640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bb00664a0 0x7f9bb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.020+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f9bc4084680 con 0x7f9bcc15b290 2023-11-04T01:45:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.020+0000 7f9bd1366640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bb00664a0 0x7f9bb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.020+0000 7f9bd1366640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bb00664a0 0x7f9bb0068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.024+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9bc4051470 con 0x7f9bcc15b290 2023-11-04T01:45:29.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.240+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f9bcc0744a0 con 0x7f9bcc15b290 2023-11-04T01:45:29.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bc1ffb640 1 -- 172.21.15.40:0/2877717798 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6601 v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9bc4054a90 con 0x7f9bcc15b290 2023-11-04T01:45:29.246 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 6601 2023-11-04T01:45:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bb00664a0 msgr2=0x7f9bb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bb00664a0 0x7f9bb0068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8008040 comp rx=0 tx=0).stop 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 msgr2=0x7f9bcc0b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 0x7f9bcc0b2be0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400c780 tx=0x7f9bc400cc40 comp rx=0 tx=0).stop 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 shutdown_connections 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9bb00664a0 0x7f9bb0068960 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bcc15b290 0x7f9bcc0b2be0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9bcc0c2670 0x7f9bcc14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 --2- 172.21.15.40:0/2877717798 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9bcc06fe30 0x7f9bcc0b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 >> 172.21.15.40:0/2877717798 conn(0x7f9bcc0cebb0 msgr2=0x7f9bcc0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 shutdown_connections 2023-11-04T01:45:29.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.244+0000 7f9bd35ca640 1 -- 172.21.15.40:0/2877717798 wait complete. 2023-11-04T01:45:29.270 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:45:29.270 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:45:29.270 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:45:29.270 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:29.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:29.270 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:45:29.271 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:45:29.271 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:45:29.274 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:45:29.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:29.348 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:45:29.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.388+0000 7fd8afc8e640 1 Processor -- start 2023-11-04T01:45:29.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.388+0000 7fd8afc8e640 1 -- start start 2023-11-04T01:45:29.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8afc8e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd8a815afd0 0x7fd8a80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8afc8e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80c2670 con 0x7fd8a806f8f0 2023-11-04T01:45:29.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8afc8e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a806bc30 con 0x7fd8a80b0d40 2023-11-04T01:45:29.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8afc8e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a8070140 con 0x7fd8a815afd0 2023-11-04T01:45:29.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd8a806f8f0 0x7fd8a80b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60446/0 (socket says 172.21.15.40:60446) 2023-11-04T01:45:29.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 -- 172.21.15.40:0/1792064734 learned_addr learned my addr 172.21.15.40:0/1792064734 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:29.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ada2a640 1 --2- 172.21.15.40:0/1792064734 >> v2:172.21.15.91:3300/0 conn(0x7fd8a815afd0 0x7fd8a80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859326597 0 0) 0x7fd8a80c2670 con 0x7fd8a806f8f0 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd894003530 con 0x7fd8a806f8f0 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426453755 0 0) 0x7fd894003530 con 0x7fd8a806f8f0 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 >> v2:172.21.15.91:3300/0 conn(0x7fd8a815afd0 msgr2=0x7fd8a80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 --2- 172.21.15.40:0/1792064734 >> v2:172.21.15.91:3300/0 conn(0x7fd8a815afd0 0x7fd8a80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 >> v1:172.21.15.91:6789/0 conn(0x7fd8a80b0d40 legacy=0x7fd8a815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a806bf10 con 0x7fd8a806f8f0 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd898001680 con 0x7fd8a806f8f0 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 >> v1:172.21.15.40:6789/0 conn(0x7fd8a806f8f0 legacy=0x7fd8a80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd894003980 0x7fd894003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd894004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd894005190 0x7fd89400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8070140 con 0x7fd8940047d0 2023-11-04T01:45:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89400c030 con 0x7fd894003980 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89400c1f0 con 0x7fd894005190 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd894004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ada2a640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd894003980 0x7fd894003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ae22b640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd894005190 0x7fd89400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 -- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd894005190 msgr2=0x7fd89400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd894005190 0x7fd89400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 -- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd894003980 msgr2=0x7fd894003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd894003980 0x7fd894003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ad229640 1 -- 172.21.15.40:0/1792064734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894003530 con 0x7fd8940047d0 2023-11-04T01:45:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.392+0000 7fd8ae22b640 1 -- 172.21.15.40:0/1792064734 reap_dead start 2023-11-04T01:45:29.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ad229640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd894004c50 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c240 tx=0x7fd89801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dd4aa6e72b5d40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898005ae0 con 0x7fd8940047d0 2023-11-04T01:45:29.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8980ab070 con 0x7fd8940047d0 2023-11-04T01:45:29.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8aca28640 1 -- 172.21.15.40:0/1792064734 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898007070 con 0x7fd8940047d0 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- 172.21.15.40:0/1792064734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 msgr2=0x7fd894004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd894004c50 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c240 tx=0x7fd89801f3b0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- 172.21.15.40:0/1792064734 shutdown_connections 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/1792064734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd894004c50 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- 172.21.15.40:0/1792064734 >> 172.21.15.40:0/1792064734 conn(0x7fd8a80cebb0 msgr2=0x7fd8a80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- 172.21.15.40:0/1792064734 shutdown_connections 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- 172.21.15.40:0/1792064734 wait complete. 2023-11-04T01:45:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 Processor -- start 2023-11-04T01:45:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- start start 2023-11-04T01:45:29.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd8a8156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8a80c8350 0x7fd8a80c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a814e2c0 0x7fd8a80c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80c68c0 con 0x7fd8940047d0 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8155520 con 0x7fd8a814e2c0 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8afc8e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a81557c0 con 0x7fd8a80c8350 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd8a8156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd8a8156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37968/0 (socket says 172.21.15.40:37968) 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 -- 172.21.15.40:0/466467547 learned_addr learned my addr 172.21.15.40:0/466467547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ad229640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8a80c8350 0x7fd8a80c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ae22b640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a814e2c0 0x7fd8a80c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 -- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8a80c8350 msgr2=0x7fd8a80c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8a80c8350 0x7fd8a80c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 -- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a814e2c0 msgr2=0x7fd8a80c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a814e2c0 0x7fd8a80c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.396+0000 7fd8ada2a640 1 -- 172.21.15.40:0/466467547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8155aa0 con 0x7fd8940047d0 2023-11-04T01:45:29.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd8ada2a640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd8a8156a60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4011aa0 tx=0x7fd8a4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400fb80 con 0x7fd8940047d0 2023-11-04T01:45:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a400fce0 con 0x7fd8940047d0 2023-11-04T01:45:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4014680 con 0x7fd8940047d0 2023-11-04T01:45:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a8155d80 con 0x7fd8940047d0 2023-11-04T01:45:29.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a8156fa0 con 0x7fd8940047d0 2023-11-04T01:45:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a81571f0 con 0x7fd8940047d0 2023-11-04T01:45:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8a40147e0 con 0x7fd8940047d0 2023-11-04T01:45:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd89e7fc640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd88c0664d0 0x7fd88c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7fd8a4084ce0 con 0x7fd8940047d0 2023-11-04T01:45:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd8ad229640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd88c0664d0 0x7fd88c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.400+0000 7fd8ad229640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd88c0664d0 0x7fd88c068990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd8980af000 tx=0x7fd8980aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.404+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8a4051c30 con 0x7fd8940047d0 2023-11-04T01:45:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.592+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8a80744a0 con 0x7fd8940047d0 2023-11-04T01:45:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd89e7fc640 1 -- 172.21.15.40:0/466467547 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4136 (secure 0 0 0) 0x7fd8a4022020 con 0x7fd8940047d0 2023-11-04T01:45:29.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:29.252525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:replay","state_seq":1,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:29.598 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 80 2023-11-04T01:45:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd88c0664d0 msgr2=0x7fd88c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd88c0664d0 0x7fd88c068990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd8980af000 tx=0x7fd8980aa000 comp rx=0 tx=0).stop 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 msgr2=0x7fd8a8156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd8a8156a60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4011aa0 tx=0x7fd8a4011f60 comp rx=0 tx=0).stop 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 shutdown_connections 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd88c0664d0 0x7fd88c068990 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd8a814e2c0 0x7fd8a80c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8a80c8350 0x7fd8a80c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 --2- 172.21.15.40:0/466467547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8940047d0 0x7fd8a8156a60 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 >> 172.21.15.40:0/466467547 conn(0x7fd8a80cebb0 msgr2=0x7fd8a8158200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 shutdown_connections 2023-11-04T01:45:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:29.596+0000 7fd8afc8e640 1 -- 172.21.15.40:0/466467547 wait complete. 2023-11-04T01:45:29.615 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:45:34.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:34.728 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:45:34.724+0000 7fdb5d655640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:34.729 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:45:34.724+0000 7fdb5d655640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe189a30640 1 Processor -- start 2023-11-04T01:45:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe189a30640 1 -- start start 2023-11-04T01:45:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe189a30640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fe1840ce070 0x7fe184159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe189a30640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1840ccfd0 con 0x7fe1840ce720 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe189a30640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1840cd2b0 con 0x7fe1840b06a0 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe189a30640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840cd590 con 0x7fe1840ce070 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe182ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1840ce720 0x7fe1840cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60448/0 (socket says 172.21.15.40:60448) 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe182ffd640 1 -- 172.21.15.40:0/3929465673 learned_addr learned my addr 172.21.15.40:0/3929465673 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464487658 0 0) 0x7fe1840ccfd0 con 0x7fe1840ce720 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c003530 con 0x7fe1840ce720 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 --2- 172.21.15.40:0/3929465673 >> v2:172.21.15.91:3300/0 conn(0x7fe1840ce070 0x7fe184159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3218283427 0 0) 0x7fe16c003530 con 0x7fe1840ce720 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 >> v2:172.21.15.91:3300/0 conn(0x7fe1840ce070 msgr2=0x7fe184159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 --2- 172.21.15.40:0/3929465673 >> v2:172.21.15.91:3300/0 conn(0x7fe1840ce070 0x7fe184159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 >> v1:172.21.15.91:6789/0 conn(0x7fe1840b06a0 legacy=0x7fe18406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840cd870 con 0x7fe1840ce720 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fe174001680 con 0x7fe1840ce720 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 >> v1:172.21.15.40:6789/0 conn(0x7fe1840ce720 legacy=0x7fe1840cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c003980 0x7fe16c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16c0047d0 0x7fe16c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe16c005190 0x7fe16c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840cd590 con 0x7fe16c0047d0 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c00c0c0 con 0x7fe16c003980 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c00c280 con 0x7fe16c005190 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16c0047d0 0x7fe16c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe182ffd640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c003980 0x7fe16c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1837fe640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe16c005190 0x7fe16c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 -- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe16c005190 msgr2=0x7fe16c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe16c005190 0x7fe16c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 -- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c003980 msgr2=0x7fe16c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c003980 0x7fe16c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1827fc640 1 -- 172.21.15.40:0/3929465673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c003530 con 0x7fe16c0047d0 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1837fe640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe16c005190 0x7fe16c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe182ffd640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c003980 0x7fe16c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.748+0000 7fe1837fe640 1 -- 172.21.15.40:0/3929465673 reap_dead start 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe1827fc640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16c0047d0 0x7fe16c004c50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe178007360 tx=0x7fe17801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8496c0817bdaea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780a5db0 con 0x7fe16c0047d0 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780ad440 con 0x7fe16c0047d0 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe181ffb640 1 -- 172.21.15.40:0/3929465673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780ad7d0 con 0x7fe16c0047d0 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 -- 172.21.15.40:0/3929465673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16c0047d0 msgr2=0x7fe16c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16c0047d0 0x7fe16c004c50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe178007360 tx=0x7fe17801ce20 comp rx=0 tx=0).stop 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 -- 172.21.15.40:0/3929465673 shutdown_connections 2023-11-04T01:45:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 --2- 172.21.15.40:0/3929465673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16c0047d0 0x7fe16c004c50 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 -- 172.21.15.40:0/3929465673 >> 172.21.15.40:0/3929465673 conn(0x7fe1840cebb0 msgr2=0x7fe1840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 -- 172.21.15.40:0/3929465673 shutdown_connections 2023-11-04T01:45:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 -- 172.21.15.40:0/3929465673 wait complete. 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 Processor -- start 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.752+0000 7fe189a30640 1 -- start start 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0047d0 0x7fe184154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1840c5d10 0x7fe1841e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 0x7fe1841e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840b3920 con 0x7fe1840c6190 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840b32f0 con 0x7fe16c0047d0 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841555a0 con 0x7fe1840c5d10 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 0x7fe1841e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 0x7fe1841e59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37994/0 (socket says 172.21.15.40:37994) 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 -- 172.21.15.40:0/817739540 learned_addr learned my addr 172.21.15.40:0/817739540 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1827fc640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1840c5d10 0x7fe1841e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe182ffd640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0047d0 0x7fe184154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 -- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1840c5d10 msgr2=0x7fe1841e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1840c5d10 0x7fe1841e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 -- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0047d0 msgr2=0x7fe184154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0047d0 0x7fe184154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 -- 172.21.15.40:0/817739540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840b2370 con 0x7fe1840c6190 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe182ffd640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0047d0 0x7fe184154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe1837fe640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 0x7fe1841e59c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe1840c9290 tx=0x7fe17c00d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00b070 con 0x7fe1840c6190 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c003600 con 0x7fe1840c6190 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c005500 con 0x7fe1840c6190 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1840b2650 con 0x7fe1840c6190 2023-11-04T01:45:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1840b1790 con 0x7fe1840c6190 2023-11-04T01:45:34.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1840b3a60 con 0x7fe1840c6190 2023-11-04T01:45:34.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe17c0039b0 con 0x7fe1840c6190 2023-11-04T01:45:34.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe16bfff640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1700664d0 0x7fe170068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.756+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7fe17c083cf0 con 0x7fe1840c6190 2023-11-04T01:45:34.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.760+0000 7fe182ffd640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1700664d0 0x7fe170068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.760+0000 7fe182ffd640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1700664d0 0x7fe170068990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe184073900 tx=0x7fe174001530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.760+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe17c050b90 con 0x7fe1840c6190 2023-11-04T01:45:34.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.952+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1840b3a60 con 0x7fe1840c6190 2023-11-04T01:45:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.952+0000 7fe16bfff640 1 -- 172.21.15.40:0/817739540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fe1840b3a60 con 0x7fe1840c6190 2023-11-04T01:45:34.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:34.957 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:32.295098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 84 2023-11-04T01:45:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1700664d0 msgr2=0x7fe170068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1700664d0 0x7fe170068990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe184073900 tx=0x7fe174001530 comp rx=0 tx=0).stop 2023-11-04T01:45:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 msgr2=0x7fe1841e59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 0x7fe1841e59c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe1840c9290 tx=0x7fe17c00d810 comp rx=0 tx=0).stop 2023-11-04T01:45:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 shutdown_connections 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe1700664d0 0x7fe170068990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1840c6190 0x7fe1841e59c0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe1840c5d10 0x7fe1841e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 --2- 172.21.15.40:0/817739540 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe16c0047d0 0x7fe184154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 >> 172.21.15.40:0/817739540 conn(0x7fe1840cebb0 msgr2=0x7fe18415c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 shutdown_connections 2023-11-04T01:45:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:34.956+0000 7fe189a30640 1 -- 172.21.15.40:0/817739540 wait complete. 2023-11-04T01:45:34.976 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:45:34.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:35.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 Processor -- start 2023-11-04T01:45:35.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 -- start start 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9488161770 0x7f948806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 0x7f94880cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948806d320 con 0x7f94880d08c0 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9488161b50 con 0x7f9488161770 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f948d536640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948806e9d0 con 0x7f94880d0430 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94877fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f94880d08c0 0x7f9488165220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60452/0 (socket says 172.21.15.40:60452) 2023-11-04T01:45:35.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94877fe640 1 -- 172.21.15.40:0/3332979093 learned_addr learned my addr 172.21.15.40:0/3332979093 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9486ffd640 1 --2- 172.21.15.40:0/3332979093 >> v2:172.21.15.91:3300/0 conn(0x7f9488161770 0x7f948806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 0x7f94880cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044359651 0 0) 0x7f9478001120 con 0x7f94880d08c0 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9468003530 con 0x7f94880d08c0 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189651797 0 0) 0x7f9468003530 con 0x7f94880d08c0 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 msgr2=0x7f94880cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 0x7f94880cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 >> v2:172.21.15.91:3300/0 conn(0x7f9488161770 msgr2=0x7f948806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 --2- 172.21.15.40:0/3332979093 >> v2:172.21.15.91:3300/0 conn(0x7f9488161770 0x7f948806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948806cd60 con 0x7f94880d08c0 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9478001810 con 0x7f94880d08c0 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 >> v1:172.21.15.40:6789/0 conn(0x7f94880d08c0 legacy=0x7f9488165220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9468003980 0x7f9468003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f9468004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 0x7f9468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948806e9d0 con 0x7f94680047d0 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946800b990 con 0x7f9468003980 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946800bad0 con 0x7f94880d0430 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f9468004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f9486ffd640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9468003980 0x7f9468003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94877fe640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 0x7f9468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 -- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 msgr2=0x7f9468005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94880d0430 0x7f9468005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 -- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9468003980 msgr2=0x7f9468003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9468003980 0x7f9468003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.100+0000 7f94867fc640 1 -- 172.21.15.40:0/3332979093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468003530 con 0x7f94680047d0 2023-11-04T01:45:35.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f94867fc640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f9468004c50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f9480009fc0 tx=0x7f948001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c3c55e1896d135 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800a5b90 con 0x7f94680047d0 2023-11-04T01:45:35.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000f040 con 0x7f94680047d0 2023-11-04T01:45:35.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f9485ffb640 1 -- 172.21.15.40:0/3332979093 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800ad440 con 0x7f94680047d0 2023-11-04T01:45:35.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 -- 172.21.15.40:0/3332979093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 msgr2=0x7f9468004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 --2- 172.21.15.40:0/3332979093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f9468004c50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f9480009fc0 tx=0x7f948001cc60 comp rx=0 tx=0).stop 2023-11-04T01:45:35.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f94877fe640 1 -- 172.21.15.40:0/3332979093 reap_dead start 2023-11-04T01:45:35.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 -- 172.21.15.40:0/3332979093 shutdown_connections 2023-11-04T01:45:35.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 -- 172.21.15.40:0/3332979093 >> 172.21.15.40:0/3332979093 conn(0x7f94880b28f0 msgr2=0x7f94880b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 -- 172.21.15.40:0/3332979093 shutdown_connections 2023-11-04T01:45:35.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 -- 172.21.15.40:0/3332979093 wait complete. 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 Processor -- start 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.104+0000 7f948d536640 1 -- start start 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f94881f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9488149310 0x7f948815f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9488149790 0x7f948815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9488157610 con 0x7f94680047d0 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c7270 con 0x7f9488149790 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c7550 con 0x7f9488149310 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f94881f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f94881f6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38012/0 (socket says 172.21.15.40:38012) 2023-11-04T01:45:35.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 -- 172.21.15.40:0/1840608471 learned_addr learned my addr 172.21.15.40:0/1840608471 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f94867fc640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9488149310 0x7f948815f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f94877fe640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9488149790 0x7f948815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 -- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9488149310 msgr2=0x7f948815f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9488149310 0x7f948815f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 -- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9488149790 msgr2=0x7f948815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9488149790 0x7f948815ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 -- 172.21.15.40:0/1840608471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880c7830 con 0x7f94680047d0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f94877fe640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9488149790 0x7f948815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f9486ffd640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f94881f6f80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f9470011660 tx=0x7f9470011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000f9c0 con 0x7f94680047d0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947000fb20 con 0x7f94680047d0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880c7b10 con 0x7f94680047d0 2023-11-04T01:45:35.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000fe90 con 0x7f94680047d0 2023-11-04T01:45:35.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94881f74c0 con 0x7f94680047d0 2023-11-04T01:45:35.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94880b6d60 con 0x7f94680047d0 2023-11-04T01:45:35.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9470015460 con 0x7f94680047d0 2023-11-04T01:45:35.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f947f7fe640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f946c0664d0 0x7f946c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f9470084990 con 0x7f94680047d0 2023-11-04T01:45:35.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.108+0000 7f94867fc640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f946c0664d0 0x7f946c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.112+0000 7f94867fc640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f946c0664d0 0x7f946c068990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f94800af000 tx=0x7f94800a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.112+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9470051850 con 0x7f94680047d0 2023-11-04T01:45:35.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:45:35.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9488148260 con 0x7f94680047d0 2023-11-04T01:45:35.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f947f7fe640 1 -- 172.21.15.40:0/1840608471 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f9470054e70 con 0x7f94680047d0 2023-11-04T01:45:35.306 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:35.306 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:32.295098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 84 2023-11-04T01:45:35.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f946c0664d0 msgr2=0x7f946c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f946c0664d0 0x7f946c068990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f94800af000 tx=0x7f94800a7040 comp rx=0 tx=0).stop 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 msgr2=0x7f94881f6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f94881f6f80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f9470011660 tx=0x7f9470011b20 comp rx=0 tx=0).stop 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 shutdown_connections 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f946c0664d0 0x7f946c068990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9488149790 0x7f948815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9488149310 0x7f948815f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 --2- 172.21.15.40:0/1840608471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94680047d0 0x7f94881f6f80 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 >> 172.21.15.40:0/1840608471 conn(0x7f94880b28f0 msgr2=0x7f9488146c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 shutdown_connections 2023-11-04T01:45:35.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.304+0000 7f948d536640 1 -- 172.21.15.40:0/1840608471 wait complete. 2023-11-04T01:45:35.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:15.493516+0000', 'modified': '2023-11-04T01:45:32.295098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7689, 'mds_1': 7068}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7068': {'gid': 7068, 'name': 'a', 'rank': 1, 'incarnation': 50, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.40:6833/960586799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 960586799}, {'type': 'v1', 'addr': '172.21.15.40:6833', 'nonce': 960586799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7689': {'gid': 7689, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.40:6835/2918977483', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 2918977483}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 2918977483}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:35.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:45:35.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:45:35.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f7730920640 1 Processor -- start 2023-11-04T01:45:35.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f7730920640 1 -- start start 2023-11-04T01:45:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f7730920640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f772c159e70 0x7f772c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f7730920640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c070d90 con 0x7f772c0b1700 2023-11-04T01:45:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f7730920640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c06d4f0 con 0x7f772c06cd30 2023-11-04T01:45:35.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f7730920640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c06dd90 con 0x7f772c159e70 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f772c159e70 0x7f772c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772ad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f772c0b1700 0x7f772c071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60458/0 (socket says 172.21.15.40:60458) 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772ad9d640 1 -- 172.21.15.40:0/894382507 learned_addr learned my addr 172.21.15.40:0/894382507 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772a59c640 1 -- 172.21.15.40:0/894382507 >> v1:172.21.15.91:6789/0 conn(0x7f772c06cd30 legacy=0x7f772c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772a59c640 1 -- 172.21.15.40:0/894382507 >> v1:172.21.15.40:6789/0 conn(0x7f772c0b1700 legacy=0x7f772c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772a59c640 1 -- 172.21.15.40:0/894382507 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c06d7d0 con 0x7f772c159e70 2023-11-04T01:45:35.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.864+0000 7f772959a640 1 -- 172.21.15.40:0/894382507 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181996245 0 0) 0x7f772c070d90 con 0x7f772c0b1700 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f772a59c640 1 --2- 172.21.15.40:0/894382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c0ceaa0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f77200097c0 tx=0x7f772001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4c3b42705df077 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f772959a640 1 -- 172.21.15.40:0/894382507 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200ab670 con 0x7f772c159e70 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f772959a640 1 -- 172.21.15.40:0/894382507 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77200ab7d0 con 0x7f772c159e70 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f772959a640 1 -- 172.21.15.40:0/894382507 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200abb60 con 0x7f772c159e70 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 -- 172.21.15.40:0/894382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 msgr2=0x7f772c0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 --2- 172.21.15.40:0/894382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c0ceaa0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f77200097c0 tx=0x7f772001c450 comp rx=0 tx=0).stop 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 -- 172.21.15.40:0/894382507 shutdown_connections 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 --2- 172.21.15.40:0/894382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c0ceaa0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 -- 172.21.15.40:0/894382507 >> 172.21.15.40:0/894382507 conn(0x7f772c06e760 msgr2=0x7f772c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 -- 172.21.15.40:0/894382507 shutdown_connections 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 -- 172.21.15.40:0/894382507 wait complete. 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 Processor -- start 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.868+0000 7f7730920640 1 -- start start 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f772c06cd30 0x7f772c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f772c0b1700 0x7f772c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0cefe0 con 0x7f772c159e70 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c14eed0 con 0x7f772c0b1700 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0c6550 con 0x7f772c06cd30 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38040/0 (socket says 172.21.15.40:38040) 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 -- 172.21.15.40:0/3461166492 learned_addr learned my addr 172.21.15.40:0/3461166492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7729d9b640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f772c0b1700 0x7f772c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772a59c640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f772c06cd30 0x7f772c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 -- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f772c06cd30 msgr2=0x7f772c0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f772c06cd30 0x7f772c0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 -- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f772c0b1700 msgr2=0x7f772c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f772c0b1700 0x7f772c1576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 -- 172.21.15.40:0/3461166492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720009420 con 0x7f772c159e70 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7729d9b640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f772c0b1700 0x7f772c1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:35.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772ad9d640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c153470 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f772400c7d0 tx=0x7f772400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f771affd640 1 -- 172.21.15.40:0/3461166492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400a5e0 con 0x7f772c159e70 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f771affd640 1 -- 172.21.15.40:0/3461166492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400a740 con 0x7f772c159e70 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f771affd640 1 -- 172.21.15.40:0/3461166492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400ab30 con 0x7f772c159e70 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c14e2c0 con 0x7f772c159e70 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c14e880 con 0x7f772c159e70 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f771affd640 1 -- 172.21.15.40:0/3461166492 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f772400ac90 con 0x7f772c159e70 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f771affd640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f770c0664a0 0x7f770c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f771affd640 1 -- 172.21.15.40:0/3461166492 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f7724083a60 con 0x7f772c159e70 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.872+0000 7f772a59c640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f770c0664a0 0x7f770c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 Processor -- start 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- start start 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f770c0664a0 0x7f770c068960 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f77200af000 tx=0x7f77200a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 0x5607296f6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f68c0 0x5607296a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x560729574460 con 0x5607296f5fa0 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x560729505690 con 0x5607296f68c0 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x560729502bc0 con 0x5607296a9b40 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 0x5607296f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 0x5607296f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38044/0 (socket says 172.21.15.40:38044) 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 -- 172.21.15.40:0/280362210 learned_addr learned my addr 172.21.15.40:0/280362210 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7729d9b640 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f68c0 0x5607296a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772ad9d640 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 -- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 msgr2=0x5607296a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296a9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 -- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f68c0 msgr2=0x5607296a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f68c0 0x5607296a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 -- 172.21.15.40:0/280362210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607291f6890 con 0x5607296f5fa0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772ad9d640 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f772a59c640 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 0x5607296f6380 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f772001a080 tx=0x7f7720004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133d0cb44d265f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f770bfff640 1 -- 172.21.15.40:0/280362210 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200c5070 con 0x5607296f5fa0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f770bfff640 1 -- 172.21.15.40:0/280362210 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77200c05a0 con 0x5607296f5fa0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f770bfff640 1 -- 172.21.15.40:0/280362210 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200b9070 con 0x5607296f5fa0 2023-11-04T01:45:35.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- 172.21.15.40:0/280362210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 msgr2=0x5607296f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 0x5607296f6380 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f772001a080 tx=0x7f7720004740 comp rx=0 tx=0).stop 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- 172.21.15.40:0/280362210 shutdown_connections 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f68c0 0x5607296a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 --2- 172.21.15.40:0/280362210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296f5fa0 0x5607296f6380 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- 172.21.15.40:0/280362210 >> 172.21.15.40:0/280362210 conn(0x5607296d6d40 msgr2=0x5607296d9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- 172.21.15.40:0/280362210 shutdown_connections 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- 172.21.15.40:0/280362210 wait complete. 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 -- start start 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.876+0000 7f7733a4d000 1 Processor -- start 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x5607296aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607296af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296f68c0 0x5607296af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607294fe4b0 con 0x5607296a9b40 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607294b6aa0 con 0x5607296f5fa0 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607294bc940 con 0x5607296f68c0 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 10 client.0 _ll_register_callbacks cb 0x560729697460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x5607296aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x5607296aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38048/0 (socket says 172.21.15.40:38048) 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 -- 172.21.15.40:0/161619206 learned_addr learned my addr 172.21.15.40:0/161619206 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7729d9b640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607296af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772ad9d640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296f68c0 0x5607296af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 -- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296f68c0 msgr2=0x5607296af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296f68c0 0x5607296af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 -- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 msgr2=0x5607296af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607296af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 -- 172.21.15.40:0/161619206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c06d7d0 con 0x5607296a9b40 2023-11-04T01:45:35.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7729d9b640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607296af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772ad9d640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296f68c0 0x5607296af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f772a59c640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x5607296aeb70 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f7720004780 tx=0x7f772001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fd69d57e6a9876 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 1 -- 172.21.15.40:0/161619206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200c5070 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 1 -- 172.21.15.40:0/161619206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f77200c0a90 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607294bbe10 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 1 -- 172.21.15.40:0/161619206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77200c0c50 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 10 client.7854 fetch_fsmap learned FSMap version 84 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5607294bf1a0 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 1 -- 172.21.15.40:0/161619206 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607294bbe10 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 1 -- 172.21.15.40:0/161619206 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 84) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f77200cb420 con 0x5607296a9b40 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 10 client.7854 fetch_fsmap finished waiting for FSMap version 84 2023-11-04T01:45:35.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 10 client.7854 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 20 client.7854 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296b0000 0x560729707250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 4 client.7854 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607294fce00 con 0x5607296b0000 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7729d9b640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296b0000 0x560729707250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7729d9b640 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296b0000 0x560729707250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd35cbf738f071e9 server_cookie=b9602782ca064035 in_seq=0 out_seq=0 2023-11-04T01:45:35.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 10 client.7854 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 1 -- 172.21.15.40:0/161619206 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5607294fce00 con 0x5607296b0000 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 10 client.7854 handle_command_reply: tid=0 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 client.7854 shutdown 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 msgr2=0x5607296aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x5607296aeb70 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f7720004780 tx=0x7f772001ac90 comp rx=0 tx=0).stop 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 shutdown_connections 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296f68c0 0x5607296af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296b0000 0x560729707250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607296af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 --2- 172.21.15.40:0/161619206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x5607296aeb70 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 >> 172.21.15.40:0/161619206 conn(0x5607296d6d40 msgr2=0x5607296d9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f77097fa640 0 client.7854 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 shutdown_connections 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 1 -- 172.21.15.40:0/161619206 wait complete. 2023-11-04T01:45:35.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.880+0000 7f7733a4d000 20 client.7854 trim_cache size 0 max 16384 2023-11-04T01:45:35.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.896+0000 7f7733a4d000 1 Processor -- start 2023-11-04T01:45:35.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.896+0000 7f7733a4d000 1 -- start start 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.896+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 0x5607296f5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.896+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.896+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x560729707250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607291b7940 con 0x5607296d6d40 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607294b9db0 con 0x5607296f5fa0 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x560729481460 con 0x5607296a9b40 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 0x5607296f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 0x5607296f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38056/0 (socket says 172.21.15.40:38056) 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/1777759578 learned_addr learned my addr 172.21.15.40:0/1777759578 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:35.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 msgr2=0x5607296f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 msgr2=0x560729707250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772ad9d640 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x560729707250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x560729707250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/1777759578 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607294a54a0 con 0x5607296d6d40 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 0x5607296f5060 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f77200bb040 tx=0x7f772000b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ca53b7bf56d869 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7718ff9640 1 -- 172.21.15.40:0/1777759578 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200cbbe0 con 0x5607296d6d40 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7718ff9640 1 -- 172.21.15.40:0/1777759578 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77200cbd40 con 0x5607296d6d40 2023-11-04T01:45:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7718ff9640 1 -- 172.21.15.40:0/1777759578 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720005ba0 con 0x5607296d6d40 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- 172.21.15.40:0/1777759578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 msgr2=0x5607296f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 0x5607296f5060 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f77200bb040 tx=0x7f772000b050 comp rx=0 tx=0).stop 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- 172.21.15.40:0/1777759578 shutdown_connections 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x560729707250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296a9b40 0x5607296f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- 172.21.15.40:0/1777759578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296d6d40 0x5607296f5060 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- 172.21.15.40:0/1777759578 >> 172.21.15.40:0/1777759578 conn(0x5607296a8980 msgr2=0x5607296b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- 172.21.15.40:0/1777759578 shutdown_connections 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- 172.21.15.40:0/1777759578 wait complete. 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- start start 2023-11-04T01:45:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 Processor -- start 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x560729709280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296d6d40 0x560729755e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607297563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607294f87b0 con 0x5607296a9b40 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607295087d0 con 0x5607296f5fa0 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x560729501010 con 0x5607296d6d40 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 10 client.0 _ll_register_callbacks cb 0x7f7720009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x560729709280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x560729709280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38066/0 (socket says 172.21.15.40:38066) 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/3922188604 learned_addr learned my addr 172.21.15.40:0/3922188604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7729d9b640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296d6d40 0x560729755e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772ad9d640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607297563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296d6d40 msgr2=0x560729755e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296d6d40 0x560729755e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 msgr2=0x5607297563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607297563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 -- 172.21.15.40:0/3922188604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607294bf1a0 con 0x5607296a9b40 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f772a59c640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x560729709280 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f772001c9c0 tx=0x7f77200c2050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e56fbed68100dfc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f77097fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f77097fa640 1 -- 172.21.15.40:0/3922188604 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200b9070 con 0x5607296a9b40 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607294c8d10 con 0x5607296a9b40 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.900+0000 7f77097fa640 1 -- 172.21.15.40:0/3922188604 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f77200c08b0 con 0x5607296a9b40 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 1 -- 172.21.15.40:0/3922188604 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77200cbbe0 con 0x5607296a9b40 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 10 client.7860 fetch_fsmap learned FSMap version 84 2023-11-04T01:45:35.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5607291f6cc0 con 0x5607296a9b40 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 1 -- 172.21.15.40:0/3922188604 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607294c8d10 con 0x5607296a9b40 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 1 -- 172.21.15.40:0/3922188604 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 84) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f77200c0a70 con 0x5607296a9b40 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 10 client.7860 fetch_fsmap finished waiting for FSMap version 84 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 10 client.7860 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 20 client.7860 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296f68c0 0x560729752bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 4 client.7860 mds_command: new command op to 7068 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 --> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5607294f7490 con 0x5607296f68c0 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7729d9b640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296f68c0 0x560729752bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7729d9b640 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296f68c0 0x560729752bf0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38d69749bd7356fe server_cookie=aaa354dbe7a5d7d1 in_seq=0 out_seq=0 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 10 client.7860 ms_handle_connect on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:35.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 1 -- 172.21.15.40:0/3922188604 <== mds.1 v2:172.21.15.40:6832/960586799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x5607294f7490 con 0x5607296f68c0 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 10 client.7860 handle_command_reply: tid=0 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 client.7860 shutdown 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 msgr2=0x560729709280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x560729709280 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f772001c9c0 tx=0x7f77200c2050 comp rx=0 tx=0).stop 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 shutdown_connections 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:6832/960586799,v1:172.21.15.40:6833/960586799] conn(0x5607296f68c0 0x560729752bf0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5607296f5fa0 0x5607297563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5607296d6d40 0x560729755e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f77097fa640 0 client.7860 ms_handle_reset on v2:172.21.15.40:6832/960586799 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 --2- 172.21.15.40:0/3922188604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5607296a9b40 0x560729709280 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 >> 172.21.15.40:0/3922188604 conn(0x5607296a8980 msgr2=0x5607296f48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 shutdown_connections 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 1 -- 172.21.15.40:0/3922188604 wait complete. 2023-11-04T01:45:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7733a4d000 20 client.7860 trim_cache size 0 max 16384 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7068, 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 124.628464373, 2023-11-04T01:45:35.912 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 84, 2023-11-04T01:45:35.913 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 97, 2023-11-04T01:45:35.913 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 97, 2023-11-04T01:45:35.913 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 145.82101107 2023-11-04T01:45:35.913 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:45:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f770c0664a0 msgr2=0x7f770c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f770c0664a0 0x7f770c068960 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f77200af000 tx=0x7f77200a7000 comp rx=0 tx=0).stop 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 msgr2=0x7f772c153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c153470 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f772400c7d0 tx=0x7f772400cc90 comp rx=0 tx=0).stop 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 shutdown_connections 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f770c0664a0 0x7f770c068960 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f772c159e70 0x7f772c153470 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f772c0b1700 0x7f772c1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 --2- 172.21.15.40:0/3461166492 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f772c06cd30 0x7f772c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 >> 172.21.15.40:0/3461166492 conn(0x7f772c06e760 msgr2=0x7f772c15c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 shutdown_connections 2023-11-04T01:45:35.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:35.904+0000 7f7730920640 1 -- 172.21.15.40:0/3461166492 wait complete. 2023-11-04T01:45:35.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:45:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 Processor -- start 2023-11-04T01:45:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 -- start start 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f61ac15d240 0x7f61ac15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f61ac0b49c0 0x7f61ac0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0b52e0 con 0x7f61ac0d0b10 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0d2280 con 0x7f61ac15d240 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61b11f3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0d2560 con 0x7f61ac0b49c0 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61aad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f61ac15d240 0x7f61ac15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61aa59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f61ac0d0b10 0x7f61ac0d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60462/0 (socket says 172.21.15.40:60462) 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.036+0000 7f61aa59c640 1 -- 172.21.15.40:0/218855503 learned_addr learned my addr 172.21.15.40:0/218855503 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61ab59e640 1 --2- 172.21.15.40:0/218855503 >> v2:172.21.15.91:3300/0 conn(0x7f61ac0b49c0 0x7f61ac0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61a9d9b640 1 -- 172.21.15.40:0/218855503 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229329914 0 0) 0x7f61ac0b52e0 con 0x7f61ac0d0b10 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61a9d9b640 1 -- 172.21.15.40:0/218855503 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6194003530 con 0x7f61ac0d0b10 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61aad9d640 1 -- 172.21.15.40:0/218855503 >> v2:172.21.15.91:3300/0 conn(0x7f61ac0b49c0 msgr2=0x7f61ac0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61aad9d640 1 --2- 172.21.15.40:0/218855503 >> v2:172.21.15.91:3300/0 conn(0x7f61ac0b49c0 0x7f61ac0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61aad9d640 1 -- 172.21.15.40:0/218855503 >> v1:172.21.15.40:6789/0 conn(0x7f61ac0d0b10 legacy=0x7f61ac0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61aad9d640 1 -- 172.21.15.40:0/218855503 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0d2840 con 0x7f61ac15d240 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61aad9d640 1 --2- 172.21.15.40:0/218855503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac15d240 0x7f61ac15d620 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b5720 tx=0x7f619c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d787a75537da8cc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61a9d9b640 1 -- 172.21.15.40:0/218855503 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0ab650 con 0x7f61ac15d240 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61a9d9b640 1 -- 172.21.15.40:0/218855503 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c0ab7b0 con 0x7f61ac15d240 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61a9d9b640 1 -- 172.21.15.40:0/218855503 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0abb40 con 0x7f61ac15d240 2023-11-04T01:45:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 -- 172.21.15.40:0/218855503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac15d240 msgr2=0x7f61ac15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 --2- 172.21.15.40:0/218855503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac15d240 0x7f61ac15d620 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b5720 tx=0x7f619c01c430 comp rx=0 tx=0).stop 2023-11-04T01:45:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 -- 172.21.15.40:0/218855503 shutdown_connections 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 --2- 172.21.15.40:0/218855503 >> v2:172.21.15.91:3300/0 conn(0x7f61ac0b49c0 0x7f61ac0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 --2- 172.21.15.40:0/218855503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac15d240 0x7f61ac15d620 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 -- 172.21.15.40:0/218855503 >> 172.21.15.40:0/218855503 conn(0x7f61ac0cf9c0 msgr2=0x7f61ac0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 -- 172.21.15.40:0/218855503 shutdown_connections 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.040+0000 7f61b11f3640 1 -- 172.21.15.40:0/218855503 wait complete. 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 Processor -- start 2023-11-04T01:45:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 -- start start 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f61ac0b49c0 0x7f61ac0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 0x7f61ac0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61ac15d240 0x7f61ac159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac151e30 con 0x7f61ac0d0b10 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac156270 con 0x7f61ac15d240 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0c88e0 con 0x7f61ac0b49c0 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 0x7f61ac0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 0x7f61ac0c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38090/0 (socket says 172.21.15.40:38090) 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 -- 172.21.15.40:0/2272087443 learned_addr learned my addr 172.21.15.40:0/2272087443 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61ab59e640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61ac15d240 0x7f61ac159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aad9d640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f61ac0b49c0 0x7f61ac0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 -- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f61ac0b49c0 msgr2=0x7f61ac0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f61ac0b49c0 0x7f61ac0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 -- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61ac15d240 msgr2=0x7f61ac159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61ac15d240 0x7f61ac159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 -- 172.21.15.40:0/2272087443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c009420 con 0x7f61ac0d0b10 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aad9d640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f61ac0b49c0 0x7f61ac0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61ab59e640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61ac15d240 0x7f61ac159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61aa59c640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 0x7f61ac0c7e50 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c4d0 tx=0x7f61a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61937fe640 1 -- 172.21.15.40:0/2272087443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0005cf0 con 0x7f61ac0d0b10 2023-11-04T01:45:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61937fe640 1 -- 172.21.15.40:0/2272087443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0005e50 con 0x7f61ac0d0b10 2023-11-04T01:45:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac1554b0 con 0x7f61ac0d0b10 2023-11-04T01:45:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61937fe640 1 -- 172.21.15.40:0/2272087443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0007270 con 0x7f61ac0d0b10 2023-11-04T01:45:36.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac155a70 con 0x7f61ac0d0b10 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61937fe640 1 -- 172.21.15.40:0/2272087443 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61a00073d0 con 0x7f61ac0d0b10 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.044+0000 7f61937fe640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f61980664a0 0x7f6198068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61937fe640 1 -- 172.21.15.40:0/2272087443 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f61a00838f0 con 0x7f61ac0d0b10 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aad9d640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f61980664a0 0x7f6198068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 Processor -- start 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- start start 2023-11-04T01:45:36.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aad9d640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f61980664a0 0x7f6198068960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f619c0af000 tx=0x7f619c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d589e4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d58997600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d58997f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d58862460 con 0x561d589e48c0 2023-11-04T01:45:36.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d587f3690 con 0x561d589e3fa0 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d587f0bc0 con 0x561d58997b40 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d58997600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d58997600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38098/0 (socket says 172.21.15.40:38098) 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 -- 172.21.15.40:0/128596808 learned_addr learned my addr 172.21.15.40:0/128596808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aad9d640 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d589e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61ab59e640 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d58997f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 -- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 msgr2=0x561d58997f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d58997f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 -- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 msgr2=0x561d589e4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d589e4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 -- 172.21.15.40:0/128596808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d584e4890 con 0x561d589e48c0 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61aa59c640 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d58997600 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f61a005c240 tx=0x7f61a0058740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447ec96dadba8f02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f6190ff9640 1 -- 172.21.15.40:0/128596808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0007680 con 0x561d589e48c0 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f6190ff9640 1 -- 172.21.15.40:0/128596808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0050c30 con 0x561d589e48c0 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f6190ff9640 1 -- 172.21.15.40:0/128596808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0053c30 con 0x561d589e48c0 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- 172.21.15.40:0/128596808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 msgr2=0x561d58997600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d58997600 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f61a005c240 tx=0x7f61a0058740 comp rx=0 tx=0).stop 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- 172.21.15.40:0/128596808 shutdown_connections 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d58997f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d58997600 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 --2- 172.21.15.40:0/128596808 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d589e4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- 172.21.15.40:0/128596808 >> 172.21.15.40:0/128596808 conn(0x561d589c4d40 msgr2=0x561d589c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- 172.21.15.40:0/128596808 shutdown_connections 2023-11-04T01:45:36.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- 172.21.15.40:0/128596808 wait complete. 2023-11-04T01:45:36.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 -- start start 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.048+0000 7f61b4320000 1 Processor -- start 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d589a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d5899cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d5899d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d587ec4b0 con 0x561d589e48c0 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d587a4aa0 con 0x561d589e3fa0 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d587aa940 con 0x561d58997b40 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 10 client.0 _ll_register_callbacks cb 0x561d58985460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d5899d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d5899d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38112/0 (socket says 172.21.15.40:38112) 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 -- 172.21.15.40:0/3447604413 learned_addr learned my addr 172.21.15.40:0/3447604413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61aad9d640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d589a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61aa59c640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d5899cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 -- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 msgr2=0x561d589a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d589a00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 -- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 msgr2=0x561d5899cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d5899cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 -- 172.21.15.40:0/3447604413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac155a70 con 0x561d589e48c0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61ab59e640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d5899d0b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007a00 tx=0x7f61a4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71733b69c2b82742 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 1 -- 172.21.15.40:0/3447604413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4010ad0 con 0x561d589e48c0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 1 -- 172.21.15.40:0/3447604413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f61a4010c30 con 0x561d589e48c0 2023-11-04T01:45:36.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d587a9e10 con 0x561d589e48c0 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 1 -- 172.21.15.40:0/3447604413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61a4010df0 con 0x561d589e48c0 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 10 client.7875 fetch_fsmap learned FSMap version 84 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561d587ad1a0 con 0x561d589e48c0 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 1 -- 172.21.15.40:0/3447604413 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d587a9e10 con 0x561d589e48c0 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 1 -- 172.21.15.40:0/3447604413 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 84) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f61a40039a0 con 0x561d589e48c0 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 10 client.7875 fetch_fsmap finished waiting for FSMap version 84 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 10 client.7875 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 20 client.7875 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d5899de20 0x561d589f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 4 client.7875 mds_command: new command op to 7689 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 --> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d587eae00 con 0x561d5899de20 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61aad9d640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d5899de20 0x561d589f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61aad9d640 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d5899de20 0x561d589f5250 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa2e3831f85119 server_cookie=6ea77b65b0905596 in_seq=0 out_seq=0 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 10 client.7875 ms_handle_connect on v2:172.21.15.40:6834/2918977483 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 1 -- 172.21.15.40:0/3447604413 <== mds.0 v2:172.21.15.40:6834/2918977483 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d587eae00 con 0x561d5899de20 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 10 client.7875 handle_command_reply: tid=0 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 client.7875 shutdown 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 msgr2=0x561d5899d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d5899d0b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007a00 tx=0x7f61a4007ec0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 shutdown_connections 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d5899de20 0x561d589f5250 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e48c0 0x561d5899d0b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e3fa0 0x561d5899cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 --2- 172.21.15.40:0/3447604413 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d58997b40 0x561d589a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f6189ffb640 0 client.7875 ms_handle_reset on v2:172.21.15.40:6834/2918977483 2023-11-04T01:45:36.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 >> 172.21.15.40:0/3447604413 conn(0x561d589c4d40 msgr2=0x561d589c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 shutdown_connections 2023-11-04T01:45:36.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.052+0000 7f61b4320000 1 -- 172.21.15.40:0/3447604413 wait complete. 2023-11-04T01:45:36.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.056+0000 7f61b4320000 20 client.7875 trim_cache size 0 max 16384 2023-11-04T01:45:36.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.068+0000 7f61b4320000 1 Processor -- start 2023-11-04T01:45:36.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.068+0000 7f61b4320000 1 -- start start 2023-11-04T01:45:36.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d58997b40 0x561d5899f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 0x561d5899f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e48c0 0x561d589e2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d584a5940 con 0x561d589e3fa0 2023-11-04T01:45:36.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d587e98b0 con 0x561d58997b40 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d58997a00 con 0x561d589e48c0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 0x561d5899f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 0x561d5899f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38126/0 (socket says 172.21.15.40:38126) 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 -- 172.21.15.40:0/2092131951 learned_addr learned my addr 172.21.15.40:0/2092131951 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d58997b40 0x561d5899f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 -- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e48c0 msgr2=0x561d589e2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61ab59e640 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e48c0 0x561d589e2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e48c0 0x561d589e2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 -- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d58997b40 msgr2=0x561d5899f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d58997b40 0x561d5899f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 -- 172.21.15.40:0/2092131951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d587934a0 con 0x561d589e3fa0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 0x561d5899f750 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f61a00818b0 tx=0x7f61a0083070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1e079d9c97e57f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61917fa640 1 -- 172.21.15.40:0/2092131951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a006f070 con 0x561d589e3fa0 2023-11-04T01:45:36.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61917fa640 1 -- 172.21.15.40:0/2092131951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00528c0 con 0x561d589e3fa0 2023-11-04T01:45:36.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61917fa640 1 -- 172.21.15.40:0/2092131951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0050c30 con 0x561d589e3fa0 2023-11-04T01:45:36.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- 172.21.15.40:0/2092131951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 msgr2=0x561d5899f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 0x561d5899f750 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f61a00818b0 tx=0x7f61a0083070 comp rx=0 tx=0).stop 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- 172.21.15.40:0/2092131951 shutdown_connections 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e48c0 0x561d589e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d589e3fa0 0x561d5899f750 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- 172.21.15.40:0/2092131951 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d58997b40 0x561d5899f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- 172.21.15.40:0/2092131951 >> 172.21.15.40:0/2092131951 conn(0x561d589c4d40 msgr2=0x561d5899ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- 172.21.15.40:0/2092131951 shutdown_connections 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- 172.21.15.40:0/2092131951 wait complete. 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- start start 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 Processor -- start 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 0x561d589f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e3fa0 0x561d589f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e48c0 0x561d58a41250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5899a390 con 0x561d58997b40 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d589c7360 con 0x561d589e48c0 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d587e7e20 con 0x561d589e3fa0 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61b4320000 10 client.0 _ll_register_callbacks cb 0x7f61a0054060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 0x561d589f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 0x561d589f62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38130/0 (socket says 172.21.15.40:38130) 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 -- 172.21.15.40:0/1380966207 learned_addr learned my addr 172.21.15.40:0/1380966207 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e3fa0 0x561d589f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61ab59e640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e48c0 0x561d58a41250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 -- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e3fa0 msgr2=0x561d589f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e3fa0 0x561d589f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 -- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e48c0 msgr2=0x561d58a41250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e48c0 0x561d58a41250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 -- 172.21.15.40:0/1380966207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d584e4890 con 0x561d58997b40 2023-11-04T01:45:36.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aa59c640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e3fa0 0x561d589f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61ab59e640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e48c0 0x561d58a41250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f61aad9d640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 0x561d589f62a0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ad040 tx=0x7f619c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248a89bc7487eec5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.072+0000 7f6189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 1 -- 172.21.15.40:0/1380966207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0bc040 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 1 -- 172.21.15.40:0/1380966207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f619c0ba050 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d587b6d10 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 1 -- 172.21.15.40:0/1380966207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f619c0b5ad0 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 10 client.7881 fetch_fsmap learned FSMap version 84 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561d584e4cc0 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 1 -- 172.21.15.40:0/1380966207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d587b6d10 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 1 -- 172.21.15.40:0/1380966207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 84) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f619c0b5c30 con 0x561d58997b40 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 10 client.7881 fetch_fsmap finished waiting for FSMap version 84 2023-11-04T01:45:36.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 10 client.7881 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 20 client.7881 populate_metadata read hostname 'smithi040' 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d58a4b6e0 0x561d58a4dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 4 client.7881 mds_command: new command op to 7689 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 --> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d587e5490 con 0x561d58a4b6e0 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61aa59c640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d58a4b6e0 0x561d58a4dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61aa59c640 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d58a4b6e0 0x561d58a4dad0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ec4cce8f9fa874 server_cookie=5dd5e09291bf8a58 in_seq=0 out_seq=0 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 10 client.7881 ms_handle_connect on v2:172.21.15.40:6834/2918977483 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 1 -- 172.21.15.40:0/1380966207 <== mds.0 v2:172.21.15.40:6834/2918977483 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x561d587e5490 con 0x561d58a4b6e0 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 10 client.7881 handle_command_reply: tid=0 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 client.7881 shutdown 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 msgr2=0x561d589f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 0x561d589f62a0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f619c0ad040 tx=0x7f619c0046d0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 shutdown_connections 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:6834/2918977483,v1:172.21.15.40:6835/2918977483] conn(0x561d58a4b6e0 0x561d58a4dad0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x561d589e48c0 0x561d58a41250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x561d589e3fa0 0x561d589f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 --2- 172.21.15.40:0/1380966207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x561d58997b40 0x561d589f62a0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f6189ffb640 0 client.7881 ms_handle_reset on v2:172.21.15.40:6834/2918977483 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 >> 172.21.15.40:0/1380966207 conn(0x561d589c4d40 msgr2=0x561d5899ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 shutdown_connections 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 1 -- 172.21.15.40:0/1380966207 wait complete. 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b4320000 20 client.7881 trim_cache size 0 max 16384 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:45:36.084 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d", 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 7689, 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 6.8198228150000002, 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 84, 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 97, 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 97, 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 32.290336468 2023-11-04T01:45:36.085 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:45:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f61980664a0 msgr2=0x7f6198068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f61980664a0 0x7f6198068960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f619c0af000 tx=0x7f619c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 msgr2=0x7f61ac0c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 0x7f61ac0c7e50 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c4d0 tx=0x7f61a000c990 comp rx=0 tx=0).stop 2023-11-04T01:45:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 shutdown_connections 2023-11-04T01:45:36.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f61980664a0 0x7f6198068960 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61ac15d240 0x7f61ac159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac0d0b10 0x7f61ac0c7e50 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 --2- 172.21.15.40:0/2272087443 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f61ac0b49c0 0x7f61ac0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 >> 172.21.15.40:0/2272087443 conn(0x7f61ac0cf9c0 msgr2=0x7f61ac158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 shutdown_connections 2023-11-04T01:45:36.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.076+0000 7f61b11f3640 1 -- 172.21.15.40:0/2272087443 wait complete. 2023-11-04T01:45:36.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:36.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.204+0000 7f2d47b06640 1 Processor -- start 2023-11-04T01:45:36.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.204+0000 7f2d47b06640 1 -- start start 2023-11-04T01:45:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d47b06640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d400b0890 0x7f2d400cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d47b06640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400c9960 0x7f2d400704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d47b06640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2d400b0c70 0x7f2d400ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d47b06640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4006d2f0 con 0x7f2d400b0890 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d47b06640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400ce110 con 0x7f2d400b0c70 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d47b06640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400ce320 con 0x7f2d400c9960 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d400b0890 0x7f2d400cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d400b0890 0x7f2d400cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38138/0 (socket says 172.21.15.40:38138) 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 -- 172.21.15.40:0/298950293 learned_addr learned my addr 172.21.15.40:0/298950293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d460a3640 1 --2- 172.21.15.40:0/298950293 >> v2:172.21.15.91:3300/0 conn(0x7f2d400b0c70 0x7f2d400ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d450a1640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400c9960 0x7f2d400704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 -- 172.21.15.40:0/298950293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400c9960 msgr2=0x7f2d400704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400c9960 0x7f2d400704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 -- 172.21.15.40:0/298950293 >> v2:172.21.15.91:3300/0 conn(0x7f2d400b0c70 msgr2=0x7f2d400ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 --2- 172.21.15.40:0/298950293 >> v2:172.21.15.91:3300/0 conn(0x7f2d400b0c70 0x7f2d400ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 -- 172.21.15.40:0/298950293 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400ce600 con 0x7f2d400b0890 2023-11-04T01:45:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d450a1640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400c9960 0x7f2d400704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d460a3640 1 --2- 172.21.15.40:0/298950293 >> v2:172.21.15.91:3300/0 conn(0x7f2d400b0c70 0x7f2d400ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d458a2640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d400cdbd0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f2d400c9df0 tx=0x7f2d3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2038d654689c2b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d448a0640 1 -- 172.21.15.40:0/298950293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0aa610 con 0x7f2d400b0890 2023-11-04T01:45:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d448a0640 1 -- 172.21.15.40:0/298950293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0a6040 con 0x7f2d400b0890 2023-11-04T01:45:36.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.208+0000 7f2d448a0640 1 -- 172.21.15.40:0/298950293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0aa990 con 0x7f2d400b0890 2023-11-04T01:45:36.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/298950293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 msgr2=0x7f2d400cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d400cdbd0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f2d400c9df0 tx=0x7f2d3c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/298950293 shutdown_connections 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- 172.21.15.40:0/298950293 >> v2:172.21.15.91:3300/0 conn(0x7f2d400b0c70 0x7f2d400ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400c9960 0x7f2d400704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- 172.21.15.40:0/298950293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d400cdbd0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/298950293 >> 172.21.15.40:0/298950293 conn(0x7f2d400cebb0 msgr2=0x7f2d400cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/298950293 shutdown_connections 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/298950293 wait complete. 2023-11-04T01:45:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 Processor -- start 2023-11-04T01:45:36.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- start start 2023-11-04T01:45:36.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d4014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400b0c70 0x7f2d40158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d400c9960 0x7f2d401590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401f79c0 con 0x7f2d400b0890 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401f8500 con 0x7f2d400c9960 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401f7bd0 con 0x7f2d400b0c70 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d4014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d4014b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38150/0 (socket says 172.21.15.40:38150) 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 -- 172.21.15.40:0/3363324687 learned_addr learned my addr 172.21.15.40:0/3363324687 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d450a1640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400b0c70 0x7f2d40158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d460a3640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d400c9960 0x7f2d401590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 -- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400b0c70 msgr2=0x7f2d40158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400b0c70 0x7f2d40158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 -- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d400c9960 msgr2=0x7f2d401590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d400c9960 0x7f2d401590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 -- 172.21.15.40:0/3363324687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0094d0 con 0x7f2d400b0890 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d458a2640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d4014b220 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0ac040 tx=0x7f2d3c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0b3600 con 0x7f2d400b0890 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0b3780 con 0x7f2d400b0890 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d401f7eb0 con 0x7f2d400b0890 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0b3b30 con 0x7f2d400b0890 2023-11-04T01:45:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.212+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4014b760 con 0x7f2d400b0890 2023-11-04T01:45:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.216+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d400cc500 con 0x7f2d400b0890 2023-11-04T01:45:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.216+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d3c0b3c90 con 0x7f2d400b0890 2023-11-04T01:45:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.216+0000 7f2d367fc640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d240664a0 0x7f2d24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.216+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f2d3c11ed30 con 0x7f2d400b0890 2023-11-04T01:45:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.216+0000 7f2d450a1640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d240664a0 0x7f2d24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.216+0000 7f2d450a1640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d240664a0 0x7f2d24068960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006fd0 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.220+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d3c0ebd10 con 0x7f2d400b0890 2023-11-04T01:45:36.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.404+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d400744a0 con 0x7f2d400b0890 2023-11-04T01:45:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.404+0000 7f2d367fc640 1 -- 172.21.15.40:0/3363324687 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f2d3c0ef330 con 0x7f2d400b0890 2023-11-04T01:45:36.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.408 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:32.295098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:36.408 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 84 2023-11-04T01:45:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d240664a0 msgr2=0x7f2d24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d240664a0 0x7f2d24068960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006fd0 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 msgr2=0x7f2d4014b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d4014b220 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0ac040 tx=0x7f2d3c01ad10 comp rx=0 tx=0).stop 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 shutdown_connections 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2d240664a0 0x7f2d24068960 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2d400c9960 0x7f2d401590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2d400b0c70 0x7f2d40158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 --2- 172.21.15.40:0/3363324687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d400b0890 0x7f2d4014b220 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 >> 172.21.15.40:0/3363324687 conn(0x7f2d400cebb0 msgr2=0x7f2d400b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 shutdown_connections 2023-11-04T01:45:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.408+0000 7f2d47b06640 1 -- 172.21.15.40:0/3363324687 wait complete. 2023-11-04T01:45:36.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:45:36.560 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:44.122618+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:44:10.143073+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:44:41.187610+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:45:12.175587+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:45:36.561 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:44.122618+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:44:10.143073+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:44:41.187610+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:45:12.175587+0000" } ] } 2023-11-04T01:45:36.561 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:45:36.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:45:36.564 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-11-04T01:45:36.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:45:36.591 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-11-04T01:45:36.592 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.91,[v2:172.21.15.91:3301,v1:172.21.15.91:6790]" 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.593 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-11-04T01:45:36.594 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-11-04T01:45:36.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:45:36.596 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:36.597 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-11-04T01:45:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:45:36.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-11-04T01:45:36.600 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-11-04T01:45:36.601 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi040.stdout: mds_reconnect_timeout = 5 2023-11-04T01:45:36.602 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2023-11-04T01:45:36.603 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2023-11-04T01:45:36.604 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.605 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "172.21.15.40,172.21.15.91,[v2:172.21.15.91:3301,v1:172.21.15.91:6790]" 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.606 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug trim objects = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2023-11-04T01:45:36.607 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2023-11-04T01:45:36.608 INFO:teuthology.orchestra.run.smithi091.stdout: bdev async discard = True 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: bdev enable discard = True 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore allocator = bitmap 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 1/20 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 1/20 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 20 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 4/10 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:45:36.609 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2023-11-04T01:45:36.610 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:45:36.611 INFO:teuthology.orchestra.run.smithi091.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: # 1m isn't quite enough 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: mon op complaint time = 120 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2023-11-04T01:45:36.612 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: client mount timeout = 600 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: debug client = 20 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = "" 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2023-11-04T01:45:36.613 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout:[mds] 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds = 20 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds balancer = 20 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug frag = True 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug scatterstat = True 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: mds op complaint time = 180 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: mds verify scatter = True 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-11-04T01:45:36.614 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-11-04T01:45:36.615 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-11-04T01:45:36.615 INFO:teuthology.orchestra.run.smithi091.stdout: mds_reconnect_timeout = 5 2023-11-04T01:45:36.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:36.616 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:45:36.714 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-04T01:45:36.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:36.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.828+0000 7f2f408c9640 1 Processor -- start 2023-11-04T01:45:36.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f408c9640 1 -- start start 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f408c9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2f3c0c92b0 0x7f2f3c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f408c9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f3c06c1c0 0x7f2f3c1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f408c9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3c0c9ac0 con 0x7f2f3c06bde0 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f408c9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3c0caf20 con 0x7f2f3c06c1c0 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f408c9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3c0c97e0 con 0x7f2f3c0c92b0 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f3c06c1c0 0x7f2f3c1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f3c06c1c0 0x7f2f3c1442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38154/0 (socket says 172.21.15.40:38154) 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 -- 172.21.15.40:0/4051503270 learned_addr learned my addr 172.21.15.40:0/4051503270 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f39d9b640 1 --2- 172.21.15.40:0/4051503270 >> v2:172.21.15.91:3300/0 conn(0x7f2f3c0c92b0 0x7f2f3c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 -- 172.21.15.40:0/4051503270 >> v2:172.21.15.91:3300/0 conn(0x7f2f3c0c92b0 msgr2=0x7f2f3c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 --2- 172.21.15.40:0/4051503270 >> v2:172.21.15.91:3300/0 conn(0x7f2f3c0c92b0 0x7f2f3c0cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 -- 172.21.15.40:0/4051503270 >> v1:172.21.15.91:6789/0 conn(0x7f2f3c06bde0 legacy=0x7f2f3c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 -- 172.21.15.40:0/4051503270 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0cb1c0 con 0x7f2f3c06c1c0 2023-11-04T01:45:36.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3ad9d640 1 --2- 172.21.15.40:0/4051503270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c1442b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c06dfc0 tx=0x7f2f3401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646a92128f8f6018 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3959a640 1 -- 172.21.15.40:0/4051503270 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340a5740 con 0x7f2f3c06c1c0 2023-11-04T01:45:36.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.832+0000 7f2f3959a640 1 -- 172.21.15.40:0/4051503270 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340a58a0 con 0x7f2f3c06c1c0 2023-11-04T01:45:36.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3959a640 1 -- 172.21.15.40:0/4051503270 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340a5c30 con 0x7f2f3c06c1c0 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/4051503270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06c1c0 msgr2=0x7f2f3c1442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 --2- 172.21.15.40:0/4051503270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c1442b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c06dfc0 tx=0x7f2f3401c990 comp rx=0 tx=0).stop 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/4051503270 shutdown_connections 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 --2- 172.21.15.40:0/4051503270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c1442b0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 --2- 172.21.15.40:0/4051503270 >> v2:172.21.15.91:3300/0 conn(0x7f2f3c0c92b0 0x7f2f3c0cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/4051503270 >> 172.21.15.40:0/4051503270 conn(0x7f2f3c0b0890 msgr2=0x7f2f3c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/4051503270 shutdown_connections 2023-11-04T01:45:36.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/4051503270 wait complete. 2023-11-04T01:45:36.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 Processor -- start 2023-11-04T01:45:36.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- start start 2023-11-04T01:45:36.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 0x7f2f3c0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2f3c0c92b0 0x7f2f3c13f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c140370 con 0x7f2f3c06bde0 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0c8690 con 0x7f2f3c06c1c0 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c13fe20 con 0x7f2f3c0c92b0 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 0x7f2f3c0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 0x7f2f3c0c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38168/0 (socket says 172.21.15.40:38168) 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 -- 172.21.15.40:0/839498947 learned_addr learned my addr 172.21.15.40:0/839498947 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f39d9b640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3ad9d640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2f3c0c92b0 0x7f2f3c13f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 -- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2f3c0c92b0 msgr2=0x7f2f3c13f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2f3c0c92b0 0x7f2f3c13f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 -- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f3c06c1c0 msgr2=0x7f2f3c0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c0c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 -- 172.21.15.40:0/839498947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34009b30 con 0x7f2f3c06bde0 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f3a59c640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 0x7f2f3c0c8b20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c480 tx=0x7f2f2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c012830 con 0x7f2f3c06bde0 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0129b0 con 0x7f2f3c06bde0 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c140090 con 0x7f2f3c06bde0 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c012d60 con 0x7f2f3c06bde0 2023-11-04T01:45:36.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.836+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c142da0 con 0x7f2f3c06bde0 2023-11-04T01:45:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.840+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c0c8150 con 0x7f2f3c06bde0 2023-11-04T01:45:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.840+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f2c01c460 con 0x7f2f3c06bde0 2023-11-04T01:45:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.840+0000 7f2f2affd640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f1c0664a0 0x7f2f1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.840+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f2f2c084350 con 0x7f2f3c06bde0 2023-11-04T01:45:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.840+0000 7f2f39d9b640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f1c0664a0 0x7f2f1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.840+0000 7f2f39d9b640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f1c0664a0 0x7f2f1c068960 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c071ad0 tx=0x7f2f30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:36.844+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f2c0512a0 con 0x7f2f3c06bde0 2023-11-04T01:45:37.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.024+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f3c04e4a0 con 0x7f2f3c06bde0 2023-11-04T01:45:37.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.024+0000 7f2f2affd640 1 -- 172.21.15.40:0/839498947 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f2f2c0548c0 con 0x7f2f3c06bde0 2023-11-04T01:45:37.029 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:37.029 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:32.295098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:37.029 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 84 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f1c0664a0 msgr2=0x7f2f1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f1c0664a0 0x7f2f1c068960 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c071ad0 tx=0x7f2f30008040 comp rx=0 tx=0).stop 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 msgr2=0x7f2f3c0c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 0x7f2f3c0c8b20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c480 tx=0x7f2f2c00c940 comp rx=0 tx=0).stop 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 shutdown_connections 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2f1c0664a0 0x7f2f1c068960 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2f3c0c92b0 0x7f2f3c13f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f3c06c1c0 0x7f2f3c0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 --2- 172.21.15.40:0/839498947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f3c06bde0 0x7f2f3c0c8b20 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 >> 172.21.15.40:0/839498947 conn(0x7f2f3c0b0890 msgr2=0x7f2f3c0c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 shutdown_connections 2023-11-04T01:45:37.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.028+0000 7f2f408c9640 1 -- 172.21.15.40:0/839498947 wait complete. 2023-11-04T01:45:37.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:45:37.169 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":9,"last_created":5,"last_destroyed":8,"pending_noop":[],"snaps":[{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:45:12.175587+0000","name":"s16","metadata":{}}],"need_to_purge":{"16":[2,3,4,6,7,8]},"pending_update":[],"pending_destroy":[{"version":16,"removed_snap":5,"seq":9}]} 2023-11-04T01:45:37.170 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 8, "last_snap": 9, "need_to_purge": { "16": [ 2, 3, 4, 6, 7, 8 ] }, "pending_destroy": [ { "removed_snap": 5, "seq": 9, "version": 16 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:45:12.175587+0000" } ] } 2023-11-04T01:45:37.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:45:37.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 Processor -- start 2023-11-04T01:45:37.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 -- start start 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f99f00cd2d0 0x7f99f00ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99f0070ef0 0x7f99f00ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00ad8e0 con 0x7f99f015d2f0 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00adbc0 con 0x7f99f0070ef0 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f6c9c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00adea0 con 0x7f99f00cd2d0 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f5239640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99f0070ef0 0x7f99f00ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f4a38640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f99f015d2f0 0x7f99f00ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52902/0 (socket says 172.21.15.40:52902) 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f4a38640 1 -- 172.21.15.40:0/2444832425 learned_addr learned my addr 172.21.15.40:0/2444832425 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99effff640 1 --2- 172.21.15.40:0/2444832425 >> v2:172.21.15.91:3300/0 conn(0x7f99f00cd2d0 0x7f99f00ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f5239640 1 -- 172.21.15.40:0/2444832425 >> v2:172.21.15.91:3300/0 conn(0x7f99f00cd2d0 msgr2=0x7f99f00ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f5239640 1 --2- 172.21.15.40:0/2444832425 >> v2:172.21.15.91:3300/0 conn(0x7f99f00cd2d0 0x7f99f00ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f5239640 1 -- 172.21.15.40:0/2444832425 >> v1:172.21.15.40:6789/0 conn(0x7f99f015d2f0 legacy=0x7f99f00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f5239640 1 -- 172.21.15.40:0/2444832425 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00ae180 con 0x7f99f0070ef0 2023-11-04T01:45:37.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99f5239640 1 --2- 172.21.15.40:0/2444832425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00ae5c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009d90 tx=0x7f99e801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be9e8222367d44b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99ef7fe640 1 -- 172.21.15.40:0/2444832425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e80a59f0 con 0x7f99f0070ef0 2023-11-04T01:45:37.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99ef7fe640 1 -- 172.21.15.40:0/2444832425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e80a5b50 con 0x7f99f0070ef0 2023-11-04T01:45:37.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.292+0000 7f99ef7fe640 1 -- 172.21.15.40:0/2444832425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e80ad440 con 0x7f99f0070ef0 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/2444832425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 msgr2=0x7f99f00ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/2444832425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00ae5c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009d90 tx=0x7f99e801c910 comp rx=0 tx=0).stop 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/2444832425 shutdown_connections 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/2444832425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00ae5c0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/2444832425 >> v2:172.21.15.91:3300/0 conn(0x7f99f00cd2d0 0x7f99f00ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/2444832425 >> 172.21.15.40:0/2444832425 conn(0x7f99f00ced10 msgr2=0x7f99f00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/2444832425 shutdown_connections 2023-11-04T01:45:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/2444832425 wait complete. 2023-11-04T01:45:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 Processor -- start 2023-11-04T01:45:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- start start 2023-11-04T01:45:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f00cd2d0 0x7f99f00c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99f015d2f0 0x7f99f00c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00c9200 con 0x7f99f0070ef0 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00c7470 con 0x7f99f00cd2d0 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0158380 con 0x7f99f015d2f0 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33278/0 (socket says 172.21.15.40:33278) 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 -- 172.21.15.40:0/902445346 learned_addr learned my addr 172.21.15.40:0/902445346 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99effff640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f00cd2d0 0x7f99f00c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 -- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99f015d2f0 msgr2=0x7f99f00c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99f015d2f0 0x7f99f00c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 -- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f00cd2d0 msgr2=0x7f99f00c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f00cd2d0 0x7f99f00c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 -- 172.21.15.40:0/902445346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8009a70 con 0x7f99f0070ef0 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f4a38640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00c8240 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c400 tx=0x7f99d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8005cf0 con 0x7f99f0070ef0 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f00c6990 con 0x7f99f0070ef0 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8005e50 con 0x7f99f0070ef0 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80072d0 con 0x7f99f0070ef0 2023-11-04T01:45:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.296+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f00c6f50 con 0x7f99f0070ef0 2023-11-04T01:45:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.300+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f00c67f0 con 0x7f99f0070ef0 2023-11-04T01:45:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.300+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99d8007430 con 0x7f99f0070ef0 2023-11-04T01:45:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.300+0000 7f99ed7fa640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99d00664a0 0x7f99d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.300+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f99d80838f0 con 0x7f99f0070ef0 2023-11-04T01:45:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.300+0000 7f99effff640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99d00664a0 0x7f99d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.300+0000 7f99effff640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99d00664a0 0x7f99d0068960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f99f006d460 tx=0x7f99e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.304+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99f00c67f0 con 0x7f99f0070ef0 2023-11-04T01:45:37.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:37.524+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f99f00c67f0 con 0x7f99f0070ef0 2023-11-04T01:45:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.320+0000 7f99ed7fa640 1 -- 172.21.15.40:0/902445346 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7689 v85) v1 ==== 112+0+0 (secure 0 0 0) 0x7f99f00c67f0 con 0x7f99f0070ef0 2023-11-04T01:45:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.7689 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99d00664a0 msgr2=0x7f99d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99d00664a0 0x7f99d0068960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f99f006d460 tx=0x7f99e0008040 comp rx=0 tx=0).stop 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 msgr2=0x7f99f00c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00c8240 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c400 tx=0x7f99d800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 shutdown_connections 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f99d00664a0 0x7f99d0068960 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99f015d2f0 0x7f99f00c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f99f00cd2d0 0x7f99f00c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.324+0000 7f99f6c9c640 1 --2- 172.21.15.40:0/902445346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99f0070ef0 0x7f99f00c8240 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.328+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 >> 172.21.15.40:0/902445346 conn(0x7f99f00ced10 msgr2=0x7f99f00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.328+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 shutdown_connections 2023-11-04T01:45:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.328+0000 7f99f6c9c640 1 -- 172.21.15.40:0/902445346 wait complete. 2023-11-04T01:45:38.348 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:45:38.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.472+0000 7f5588916640 1 Processor -- start 2023-11-04T01:45:38.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.472+0000 7f5588916640 1 -- start start 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5588916640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f55840cabd0 0x7f55840cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5588916640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55840af2d0 0x7f55840af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5588916640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558406fe50 con 0x7f55841556c0 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5588916640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840cb5c0 con 0x7f55840af2d0 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5588916640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840ae7f0 con 0x7f55840cabd0 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5582d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55840af2d0 0x7f55840af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f558259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f55841556c0 0x7f558415c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52916/0 (socket says 172.21.15.40:52916) 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f558259c640 1 -- 172.21.15.40:0/4241868118 learned_addr learned my addr 172.21.15.40:0/4241868118 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f557bfff640 1 --2- 172.21.15.40:0/4241868118 >> v2:172.21.15.91:3300/0 conn(0x7f55840cabd0 0x7f55840cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5582d9d640 1 -- 172.21.15.40:0/4241868118 >> v2:172.21.15.91:3300/0 conn(0x7f55840cabd0 msgr2=0x7f55840cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5582d9d640 1 --2- 172.21.15.40:0/4241868118 >> v2:172.21.15.91:3300/0 conn(0x7f55840cabd0 0x7f55840cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5582d9d640 1 -- 172.21.15.40:0/4241868118 >> v1:172.21.15.40:6789/0 conn(0x7f55841556c0 legacy=0x7f558415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5581d9b640 1 -- 172.21.15.40:0/4241868118 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668877350 0 0) 0x7f558406fe50 con 0x7f55841556c0 2023-11-04T01:45:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5582d9d640 1 -- 172.21.15.40:0/4241868118 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840aead0 con 0x7f55840af2d0 2023-11-04T01:45:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f557bfff640 1 --2- 172.21.15.40:0/4241868118 >> v2:172.21.15.91:3300/0 conn(0x7f55840cabd0 0x7f55840cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:38.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5582d9d640 1 --2- 172.21.15.40:0/4241868118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f55840af740 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f557c009d90 tx=0x7f557c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8095eb6ae2cfdbb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:38.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5581d9b640 1 -- 172.21.15.40:0/4241868118 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0a5940 con 0x7f55840af2d0 2023-11-04T01:45:38.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5581d9b640 1 -- 172.21.15.40:0/4241868118 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c0a5aa0 con 0x7f55840af2d0 2023-11-04T01:45:38.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.476+0000 7f5581d9b640 1 -- 172.21.15.40:0/4241868118 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0a5e30 con 0x7f55840af2d0 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/4241868118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 msgr2=0x7f55840af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 --2- 172.21.15.40:0/4241868118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f55840af740 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f557c009d90 tx=0x7f557c01c8e0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/4241868118 shutdown_connections 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 --2- 172.21.15.40:0/4241868118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f55840af740 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 --2- 172.21.15.40:0/4241868118 >> v2:172.21.15.91:3300/0 conn(0x7f55840cabd0 0x7f55840cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/4241868118 >> 172.21.15.40:0/4241868118 conn(0x7f55840ced10 msgr2=0x7f55840cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/4241868118 shutdown_connections 2023-11-04T01:45:38.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/4241868118 wait complete. 2023-11-04T01:45:38.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 Processor -- start 2023-11-04T01:45:38.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- start start 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f5584150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55840cabd0 0x7f558414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55841556c0 0x7f55841f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5584150330 con 0x7f55840af2d0 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841f5c70 con 0x7f55840cabd0 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840c8200 con 0x7f55841556c0 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f5584150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f5584150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33288/0 (socket says 172.21.15.40:33288) 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 -- 172.21.15.40:0/3599503415 learned_addr learned my addr 172.21.15.40:0/3599503415 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5582d9d640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55841556c0 0x7f55841f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f557bfff640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55840cabd0 0x7f558414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 -- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55841556c0 msgr2=0x7f55841f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55841556c0 0x7f55841f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 -- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55840cabd0 msgr2=0x7f558414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55840cabd0 0x7f558414fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 -- 172.21.15.40:0/3599503415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009a70 con 0x7f55840af2d0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f558259c640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f5584150490 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f557400c4e0 tx=0x7f557400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740074e0 con 0x7f55840af2d0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5574007660 con 0x7f55840af2d0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840cd060 con 0x7f55840af2d0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574004a30 con 0x7f55840af2d0 2023-11-04T01:45:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.480+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55840c7e90 con 0x7f55840af2d0 2023-11-04T01:45:38.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.484+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558404e4a0 con 0x7f55840af2d0 2023-11-04T01:45:38.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.484+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5574004b90 con 0x7f55840af2d0 2023-11-04T01:45:38.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.484+0000 7f557affd640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55640664a0 0x7f5564068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.484+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7173+0+0 (secure 0 0 0) 0x7f55740838b0 con 0x7f55840af2d0 2023-11-04T01:45:38.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.484+0000 7f557bfff640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55640664a0 0x7f5564068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.484+0000 7f557bfff640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55640664a0 0x7f5564068960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f556c006fd0 tx=0x7f556c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.488+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5574054200 con 0x7f55840af2d0 2023-11-04T01:45:38.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:38.704+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f55840ca050 con 0x7f55840af2d0 2023-11-04T01:45:39.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.340+0000 7f557affd640 1 -- 172.21.15.40:0/3599503415 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7068 v86) v1 ==== 112+0+0 (secure 0 0 0) 0x7f55740180a0 con 0x7f55840af2d0 2023-11-04T01:45:39.345 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.7068 2023-11-04T01:45:39.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.344+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55640664a0 msgr2=0x7f5564068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.344+0000 7f5588916640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55640664a0 0x7f5564068960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f556c006fd0 tx=0x7f556c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:39.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.344+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 msgr2=0x7f5584150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.344+0000 7f5588916640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f5584150490 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f557400c4e0 tx=0x7f557400c9a0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 shutdown_connections 2023-11-04T01:45:39.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f55640664a0 0x7f5564068960 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f55841556c0 0x7f55841f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f55840cabd0 0x7f558414fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 --2- 172.21.15.40:0/3599503415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55840af2d0 0x7f5584150490 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 >> 172.21.15.40:0/3599503415 conn(0x7f55840ced10 msgr2=0x7f5584154560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 shutdown_connections 2023-11-04T01:45:39.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.348+0000 7f5588916640 1 -- 172.21.15.40:0/3599503415 wait complete. 2023-11-04T01:45:39.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:45:39.509 INFO:teuthology.orchestra.run.smithi040.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:45:39.509 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:45:39.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:39.510 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-04T01:45:39.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:45:39.535 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fdb59e4e640 time 2023-11-04T01:45:39.535459+0000 2023-11-04T01:45:39.535 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdb65f86fae] 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.537 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:45:39.532+0000 7fdb59e4e640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fdb59e4e640 time 2023-11-04T01:45:39.535459+0000 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdb65f86fae] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.538 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdb59e4e640 thread_name:MR_Finisher 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb658c1520] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdb65f87008] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.539 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:45:39.532+0000 7fdb59e4e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdb59e4e640 thread_name:MR_Finisher 2023-11-04T01:45:39.540 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb658c1520] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdb65f87008] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.541 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.542 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.542 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:39.542 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.542 INFO:tasks.ceph.mds.c.smithi040.stderr: -709> 2023-11-04T01:45:34.724+0000 7fdb5d655640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:39.542 INFO:tasks.ceph.mds.c.smithi040.stderr: -707> 2023-11-04T01:45:34.724+0000 7fdb5d655640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: -1> 2023-11-04T01:45:39.532+0000 7fdb59e4e640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fdb59e4e640 time 2023-11-04T01:45:39.535459+0000 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdb65f86fae] 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.544 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 0> 2023-11-04T01:45:39.532+0000 7fdb59e4e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdb59e4e640 thread_name:MR_Finisher 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb658c1520] 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:45:39.545 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdb65f87008] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:39.546 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.550 INFO:tasks.ceph.mds.c.smithi040.stderr: -709> 2023-11-04T01:45:34.724+0000 7fdb5d655640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:39.550 INFO:tasks.ceph.mds.c.smithi040.stderr: -707> 2023-11-04T01:45:34.724+0000 7fdb5d655640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:39.551 INFO:tasks.ceph.mds.c.smithi040.stderr: -1> 2023-11-04T01:45:39.532+0000 7fdb59e4e640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fdb59e4e640 time 2023-11-04T01:45:39.535459+0000 2023-11-04T01:45:39.551 INFO:tasks.ceph.mds.c.smithi040.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:39.551 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.551 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.551 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdb65f86fae] 2023-11-04T01:45:39.551 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 0> 2023-11-04T01:45:39.532+0000 7fdb59e4e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: in thread 7fdb59e4e640 thread_name:MR_Finisher 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:39.552 INFO:tasks.ceph.mds.c.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdb658c1520] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 3: raise() 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 4: abort() 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdb65f87008] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fdb65f87162] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x5632135b64c5] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5632135eb08c] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x5632135eb4bc] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5632135eb5f3] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fdb6602d305] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fdb65913b43] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fdb659a5a00] 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:39.553 INFO:tasks.ceph.mds.c.smithi040.stderr: 2023-11-04T01:45:39.664 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:45:39.665 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:45:39.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:39.817 INFO:tasks.ceph.mds.c.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:45:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.836+0000 7f69e2b98640 1 Processor -- start 2023-11-04T01:45:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e2b98640 1 -- start start 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e2b98640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69dc15d840 0x7f69dc1644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e2b98640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc0ca010 con 0x7f69dc153ae0 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e2b98640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc0cd7b0 con 0x7f69dc0cd1d0 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e2b98640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc0ca260 con 0x7f69dc15d840 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e0934640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f69dc153ae0 0x7f69dc0caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52932/0 (socket says 172.21.15.40:52932) 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e0934640 1 -- 172.21.15.40:0/1766513466 learned_addr learned my addr 172.21.15.40:0/1766513466 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 --2- 172.21.15.40:0/1766513466 >> v2:172.21.15.91:3300/0 conn(0x7f69dc15d840 0x7f69dc1644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265263265 0 0) 0x7f69dc0ca010 con 0x7f69dc153ae0 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c4003530 con 0x7f69dc153ae0 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845017139 0 0) 0x7f69c4003530 con 0x7f69dc153ae0 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 >> v2:172.21.15.91:3300/0 conn(0x7f69dc15d840 msgr2=0x7f69dc1644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 --2- 172.21.15.40:0/1766513466 >> v2:172.21.15.91:3300/0 conn(0x7f69dc15d840 0x7f69dc1644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 >> v1:172.21.15.91:6789/0 conn(0x7f69dc0cd1d0 legacy=0x7f69dc15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0ca540 con 0x7f69dc153ae0 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f69cc001680 con 0x7f69dc153ae0 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 >> v1:172.21.15.40:6789/0 conn(0x7f69dc153ae0 legacy=0x7f69dc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c4003980 0x7f69c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c40047d0 0x7f69c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0ca260 con 0x7f69c4005190 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c400c030 con 0x7f69c40047d0 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c400c1f0 con 0x7f69c4003980 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69dbfff640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c40047d0 0x7f69c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e0934640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c4003980 0x7f69c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 -- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c4003980 msgr2=0x7f69c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c4003980 0x7f69c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 -- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c40047d0 msgr2=0x7f69c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69c40047d0 0x7f69c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e1135640 1 -- 172.21.15.40:0/1766513466 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4003530 con 0x7f69c4005190 2023-11-04T01:45:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.840+0000 7f69e0934640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69c4003980 0x7f69c4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e1135640 1 -- 172.21.15.40:0/1766513466 reap_dead start 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e1135640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69c400b990 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009fc0 tx=0x7f69d401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215fa30d961674f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40a5cb0 con 0x7f69c4005190 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400f040 con 0x7f69c4005190 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69db7fe640 1 -- 172.21.15.40:0/1766513466 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4003be0 con 0x7f69c4005190 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- 172.21.15.40:0/1766513466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 msgr2=0x7f69c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69c400b990 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009fc0 tx=0x7f69d401cca0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- 172.21.15.40:0/1766513466 shutdown_connections 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 --2- 172.21.15.40:0/1766513466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69c400b990 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- 172.21.15.40:0/1766513466 >> 172.21.15.40:0/1766513466 conn(0x7f69dc0b0890 msgr2=0x7f69dc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- 172.21.15.40:0/1766513466 shutdown_connections 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- 172.21.15.40:0/1766513466 wait complete. 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 Processor -- start 2023-11-04T01:45:39.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- start start 2023-11-04T01:45:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69dc14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69dc167620 0x7f69dc1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69dc151e00 0x7f69dc152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc14ae10 con 0x7f69c4005190 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc1530d0 con 0x7f69dc151e00 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e2b98640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc152b10 con 0x7f69dc167620 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e0934640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69dc14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e0934640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69dc14a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33300/0 (socket says 172.21.15.40:33300) 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e0934640 1 -- 172.21.15.40:0/2009212541 learned_addr learned my addr 172.21.15.40:0/2009212541 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.844+0000 7f69e1135640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69dc151e00 0x7f69dc152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e0934640 1 -- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69dc167620 msgr2=0x7f69dc1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69dbfff640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69dc167620 0x7f69dc1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e0934640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69dc167620 0x7f69dc1514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e0934640 1 -- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69dc151e00 msgr2=0x7f69dc152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e0934640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69dc151e00 0x7f69dc152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e0934640 1 -- 172.21.15.40:0/2009212541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc152df0 con 0x7f69c4005190 2023-11-04T01:45:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e1135640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69dc151e00 0x7f69dc152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e0934640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69dc14a8d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f69cc007fd0 tx=0x7f69cc00dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0074e0 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc007640 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc14a3b0 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc004a10 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc1527c0 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc04e4a0 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69cc004b70 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69d97fa640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69c8066470 0x7f69c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7261+0+0 (secure 0 0 0) 0x7f69cc0841d0 con 0x7f69c4005190 2023-11-04T01:45:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69dbfff640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69c8066470 0x7f69c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.848+0000 7f69dbfff640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69c8066470 0x7f69c8068930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f69dc1466c0 tx=0x7f69d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:39.852+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69cc051030 con 0x7f69c4005190 2023-11-04T01:45:40.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.044+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69dc0cc5f0 con 0x7f69c4005190 2023-11-04T01:45:40.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69d97fa640 1 -- 172.21.15.40:0/2009212541 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f69cc054650 con 0x7f69c4005190 2023-11-04T01:45:40.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:40.050 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:38.706741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:40.050 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 86 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69c8066470 msgr2=0x7f69c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69c8066470 0x7f69c8068930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f69dc1466c0 tx=0x7f69d0009040 comp rx=0 tx=0).stop 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 msgr2=0x7f69dc14a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69dc14a8d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f69cc007fd0 tx=0x7f69cc00dc70 comp rx=0 tx=0).stop 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 shutdown_connections 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69c8066470 0x7f69c8068930 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69dc151e00 0x7f69dc152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f69dc167620 0x7f69dc1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 --2- 172.21.15.40:0/2009212541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69c4005190 0x7f69dc14a8d0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 >> 172.21.15.40:0/2009212541 conn(0x7f69dc0b0890 msgr2=0x7f69dc0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 shutdown_connections 2023-11-04T01:45:40.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:40.048+0000 7f69e2b98640 1 -- 172.21.15.40:0/2009212541 wait complete. 2023-11-04T01:45:40.069 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:41.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:45:45.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:45.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.200+0000 7f963e817640 1 Processor -- start 2023-11-04T01:45:45.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.200+0000 7f963e817640 1 -- start start 2023-11-04T01:45:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963e817640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f96380cd1d0 0x7f963815d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963e817640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f963815d670 0x7f963806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963e817640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963815dac0 con 0x7f9638153ae0 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963e817640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380ca010 con 0x7f963815d670 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963e817640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380cd7b0 con 0x7f96380cd1d0 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963cdb4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f963815d670 0x7f963806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f9637fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9638153ae0 0x7f96380caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52940/0 (socket says 172.21.15.40:52940) 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f9637fff640 1 -- 172.21.15.40:0/2475381474 learned_addr learned my addr 172.21.15.40:0/2475381474 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f962f7fe640 1 --2- 172.21.15.40:0/2475381474 >> v2:172.21.15.91:3300/0 conn(0x7f96380cd1d0 0x7f963815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963cdb4640 1 -- 172.21.15.40:0/2475381474 >> v2:172.21.15.91:3300/0 conn(0x7f96380cd1d0 msgr2=0x7f963815d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963cdb4640 1 --2- 172.21.15.40:0/2475381474 >> v2:172.21.15.91:3300/0 conn(0x7f96380cd1d0 0x7f963815d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963cdb4640 1 -- 172.21.15.40:0/2475381474 >> v1:172.21.15.40:6789/0 conn(0x7f9638153ae0 legacy=0x7f96380caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f96377fe640 1 -- 172.21.15.40:0/2475381474 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435332582 0 0) 0x7f9628001120 con 0x7f9638153ae0 2023-11-04T01:45:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963cdb4640 1 -- 172.21.15.40:0/2475381474 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380ca260 con 0x7f963815d670 2023-11-04T01:45:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f963cdb4640 1 --2- 172.21.15.40:0/2475381474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f963806bc80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f963806b180 tx=0x7f963001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d29ac1e011fdcb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f96377fe640 1 -- 172.21.15.40:0/2475381474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96300a5750 con 0x7f963815d670 2023-11-04T01:45:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f96377fe640 1 -- 172.21.15.40:0/2475381474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96300a58b0 con 0x7f963815d670 2023-11-04T01:45:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.204+0000 7f96377fe640 1 -- 172.21.15.40:0/2475381474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96300a5c40 con 0x7f963815d670 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/2475381474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 msgr2=0x7f963806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 --2- 172.21.15.40:0/2475381474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f963806bc80 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f963806b180 tx=0x7f963001c910 comp rx=0 tx=0).stop 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/2475381474 shutdown_connections 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 --2- 172.21.15.40:0/2475381474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f963806bc80 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 --2- 172.21.15.40:0/2475381474 >> v2:172.21.15.91:3300/0 conn(0x7f96380cd1d0 0x7f963815d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/2475381474 >> 172.21.15.40:0/2475381474 conn(0x7f96380b0890 msgr2=0x7f96380b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/2475381474 shutdown_connections 2023-11-04T01:45:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/2475381474 wait complete. 2023-11-04T01:45:45.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 Processor -- start 2023-11-04T01:45:45.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- start start 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96380cd1d0 0x7f9638071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9638153ae0 0x7f96380b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f96380c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638070ff0 con 0x7f963815d670 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96380b2000 con 0x7f9638153ae0 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96380b46f0 con 0x7f96380cd1d0 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f96380c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f96380c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33318/0 (socket says 172.21.15.40:33318) 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 -- 172.21.15.40:0/1372052547 learned_addr learned my addr 172.21.15.40:0/1372052547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f962f7fe640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9638153ae0 0x7f96380b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f9637fff640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96380cd1d0 0x7f9638071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 -- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96380cd1d0 msgr2=0x7f9638071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96380cd1d0 0x7f9638071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 -- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9638153ae0 msgr2=0x7f96380b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9638153ae0 0x7f96380b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 -- 172.21.15.40:0/1372052547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009a70 con 0x7f963815d670 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f962f7fe640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9638153ae0 0x7f96380b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963cdb4640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f96380c4c00 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f96300b0040 tx=0x7f96300196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96300b9650 con 0x7f963815d670 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96300b97b0 con 0x7f963815d670 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96300b9b60 con 0x7f963815d670 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96380b1cd0 con 0x7f963815d670 2023-11-04T01:45:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.208+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9638151f50 con 0x7f963815d670 2023-11-04T01:45:45.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.212+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96380b2170 con 0x7f963815d670 2023-11-04T01:45:45.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.212+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96300b9cc0 con 0x7f963815d670 2023-11-04T01:45:45.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.212+0000 7f96357fa640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f961c0664a0 0x7f961c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.212+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7261+0+0 (secure 0 0 0) 0x7f963011f6f0 con 0x7f963815d670 2023-11-04T01:45:45.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.212+0000 7f9637fff640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f961c0664a0 0x7f961c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.212+0000 7f9637fff640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f961c0664a0 0x7f961c068960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f96280079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:45.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.216+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96300ec540 con 0x7f963815d670 2023-11-04T01:45:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f963804e4a0 con 0x7f963815d670 2023-11-04T01:45:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f96357fa640 1 -- 172.21.15.40:0/1372052547 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f96300efb60 con 0x7f963815d670 2023-11-04T01:45:45.411 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:45.411 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:38.706741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 86 2023-11-04T01:45:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f961c0664a0 msgr2=0x7f961c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f961c0664a0 0x7f961c068960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f96280079c0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 msgr2=0x7f96380c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f96380c4c00 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f96300b0040 tx=0x7f96300196b0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 shutdown_connections 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f961c0664a0 0x7f961c068960 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f963815d670 0x7f96380c4c00 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9638153ae0 0x7f96380b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 --2- 172.21.15.40:0/1372052547 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96380cd1d0 0x7f9638071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 >> 172.21.15.40:0/1372052547 conn(0x7f96380b0890 msgr2=0x7f963806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 shutdown_connections 2023-11-04T01:45:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:45.408+0000 7f963e817640 1 -- 172.21.15.40:0/1372052547 wait complete. 2023-11-04T01:45:45.430 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:48.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:45:50.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:50.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 Processor -- start 2023-11-04T01:45:50.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 -- start start 2023-11-04T01:45:50.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d3006c1c0 0x7f9d301442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300c9ac0 con 0x7f9d3006bde0 2023-11-04T01:45:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d300caf20 con 0x7f9d3006c1c0 2023-11-04T01:45:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d34d14640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300c97e0 con 0x7f9d300c92b0 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2ed9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9d3006c1c0 0x7f9d301442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2dd9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2e59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f9d3006bde0 0x7f9d3015c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:52404/0 (socket says 172.21.15.40:52404) 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2e59c640 1 -- 172.21.15.40:0/1365503194 learned_addr learned my addr 172.21.15.40:0/1365503194 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2d59a640 1 -- 172.21.15.40:0/1365503194 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925548786 0 0) 0x7f9d300c9ac0 con 0x7f9d3006bde0 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2d59a640 1 -- 172.21.15.40:0/1365503194 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d18003530 con 0x7f9d3006bde0 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2dd9b640 1 -- 172.21.15.40:0/1365503194 >> v2:172.21.15.91:3300/0 conn(0x7f9d3006c1c0 msgr2=0x7f9d301442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2dd9b640 1 --2- 172.21.15.40:0/1365503194 >> v2:172.21.15.91:3300/0 conn(0x7f9d3006c1c0 0x7f9d301442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2dd9b640 1 -- 172.21.15.40:0/1365503194 >> v1:172.21.15.91:6789/0 conn(0x7f9d3006bde0 legacy=0x7f9d3015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.564+0000 7f9d2dd9b640 1 -- 172.21.15.40:0/1365503194 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300cb1c0 con 0x7f9d300c92b0 2023-11-04T01:45:50.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d2dd9b640 1 --2- 172.21.15.40:0/1365503194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300cbca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097f0 tx=0x7f9d2401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edc3f39d8051ca0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:50.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d2d59a640 1 -- 172.21.15.40:0/1365503194 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d240ab600 con 0x7f9d300c92b0 2023-11-04T01:45:50.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d2d59a640 1 -- 172.21.15.40:0/1365503194 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d240a7050 con 0x7f9d300c92b0 2023-11-04T01:45:50.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d2d59a640 1 -- 172.21.15.40:0/1365503194 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d240ab960 con 0x7f9d300c92b0 2023-11-04T01:45:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 -- 172.21.15.40:0/1365503194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 msgr2=0x7f9d300cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 --2- 172.21.15.40:0/1365503194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300cbca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097f0 tx=0x7f9d2401c480 comp rx=0 tx=0).stop 2023-11-04T01:45:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 -- 172.21.15.40:0/1365503194 shutdown_connections 2023-11-04T01:45:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 --2- 172.21.15.40:0/1365503194 >> v2:172.21.15.91:3300/0 conn(0x7f9d3006c1c0 0x7f9d301442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 --2- 172.21.15.40:0/1365503194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300cbca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 -- 172.21.15.40:0/1365503194 >> 172.21.15.40:0/1365503194 conn(0x7f9d300b0890 msgr2=0x7f9d300b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 -- 172.21.15.40:0/1365503194 shutdown_connections 2023-11-04T01:45:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 -- 172.21.15.40:0/1365503194 wait complete. 2023-11-04T01:45:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 Processor -- start 2023-11-04T01:45:50.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.568+0000 7f9d34d14640 1 -- start start 2023-11-04T01:45:50.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 0x7f9d3013e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:50.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3006c1c0 0x7f9d300c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:50.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:50.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3015c3a0 con 0x7f9d3006bde0 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3015cc40 con 0x7f9d3006c1c0 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3013e590 con 0x7f9d300c92b0 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 0x7f9d3013e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 0x7f9d3013e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43684/0 (socket says 172.21.15.40:43684) 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 -- 172.21.15.40:0/2542393474 learned_addr learned my addr 172.21.15.40:0/2542393474 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2dd9b640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3006c1c0 0x7f9d300c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2ed9d640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 -- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 msgr2=0x7f9d300c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 -- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3006c1c0 msgr2=0x7f9d300c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3006c1c0 0x7f9d300c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 -- 172.21.15.40:0/2542393474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24009420 con 0x7f9d3006bde0 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2e59c640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 0x7f9d3013e050 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c480 tx=0x7f9d2000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20005cf0 con 0x7f9d3006bde0 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20005e50 con 0x7f9d3006bde0 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d300c6280 con 0x7f9d3006bde0 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20007290 con 0x7f9d3006bde0 2023-11-04T01:45:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3015c8d0 con 0x7f9d3006bde0 2023-11-04T01:45:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3004e4a0 con 0x7f9d3006bde0 2023-11-04T01:45:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d200073f0 con 0x7f9d3006bde0 2023-11-04T01:45:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d1effd640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d100664d0 0x7f9d10068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7217+0+0 (secure 0 0 0) 0x7f9d200838c0 con 0x7f9d3006bde0 2023-11-04T01:45:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.572+0000 7f9d2dd9b640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d100664d0 0x7f9d10068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:50.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.576+0000 7f9d2dd9b640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d100664d0 0x7f9d10068990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9d240ad000 tx=0x7f9d240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:50.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.576+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d20050890 con 0x7f9d3006bde0 2023-11-04T01:45:50.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.764+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d3006cf10 con 0x7f9d3006bde0 2023-11-04T01:45:50.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d1effd640 1 -- 172.21.15.40:0/2542393474 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f9d20017020 con 0x7f9d3006bde0 2023-11-04T01:45:50.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:50.770 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:38.706741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:50.771 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 86 2023-11-04T01:45:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d100664d0 msgr2=0x7f9d10068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d100664d0 0x7f9d10068990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9d240ad000 tx=0x7f9d240a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 msgr2=0x7f9d3013e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 0x7f9d3013e050 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c480 tx=0x7f9d2000c940 comp rx=0 tx=0).stop 2023-11-04T01:45:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 shutdown_connections 2023-11-04T01:45:50.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d100664d0 0x7f9d10068990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d300c92b0 0x7f9d300c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d3006c1c0 0x7f9d300c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 --2- 172.21.15.40:0/2542393474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d3006bde0 0x7f9d3013e050 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 >> 172.21.15.40:0/2542393474 conn(0x7f9d300b0890 msgr2=0x7f9d300cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 shutdown_connections 2023-11-04T01:45:50.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:50.768+0000 7f9d34d14640 1 -- 172.21.15.40:0/2542393474 wait complete. 2023-11-04T01:45:50.787 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:55.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:45:55.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 Processor -- start 2023-11-04T01:45:55.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 -- start start 2023-11-04T01:45:55.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8eb015cf80 0x7f8eb00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8eb00add70 0x7f8eb015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb00c4910 con 0x7f8eb00ae200 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006bbf0 con 0x7f8eb00add70 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb84b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb015dcf0 con 0x7f8eb015cf80 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8eb00add70 0x7f8eb015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8eb00add70 0x7f8eb015d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43700/0 (socket says 172.21.15.40:43700) 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 -- 172.21.15.40:0/3646941104 learned_addr learned my addr 172.21.15.40:0/3646941104 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb624c640 1 --2- 172.21.15.40:0/3646941104 >> v2:172.21.15.91:3300/0 conn(0x7f8eb015cf80 0x7f8eb00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 -- 172.21.15.40:0/3646941104 >> v2:172.21.15.91:3300/0 conn(0x7f8eb015cf80 msgr2=0x7f8eb00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 --2- 172.21.15.40:0/3646941104 >> v2:172.21.15.91:3300/0 conn(0x7f8eb015cf80 0x7f8eb00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 -- 172.21.15.40:0/3646941104 >> v1:172.21.15.40:6789/0 conn(0x7f8eb00ae200 legacy=0x7f8eb00cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 -- 172.21.15.40:0/3646941104 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb015dfd0 con 0x7f8eb00add70 2023-11-04T01:45:55.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb624c640 1 --2- 172.21.15.40:0/3646941104 >> v2:172.21.15.91:3300/0 conn(0x7f8eb015cf80 0x7f8eb00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:55.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb5a4b640 1 --2- 172.21.15.40:0/3646941104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb00add70 0x7f8eb015d360 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006dcf0 tx=0x7f8ea401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2aca6abff3a173 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:55.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb524a640 1 -- 172.21.15.40:0/3646941104 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40ab640 con 0x7f8eb00add70 2023-11-04T01:45:55.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb524a640 1 -- 172.21.15.40:0/3646941104 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40a7070 con 0x7f8eb00add70 2023-11-04T01:45:55.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.920+0000 7f8eb524a640 1 -- 172.21.15.40:0/3646941104 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40ab9c0 con 0x7f8eb00add70 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3646941104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb00add70 msgr2=0x7f8eb015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3646941104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb00add70 0x7f8eb015d360 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006dcf0 tx=0x7f8ea401c440 comp rx=0 tx=0).stop 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3646941104 shutdown_connections 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3646941104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb00add70 0x7f8eb015d360 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3646941104 >> v2:172.21.15.91:3300/0 conn(0x7f8eb015cf80 0x7f8eb00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3646941104 >> 172.21.15.40:0/3646941104 conn(0x7f8eb00b0890 msgr2=0x7f8eb00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3646941104 shutdown_connections 2023-11-04T01:45:55.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3646941104 wait complete. 2023-11-04T01:45:55.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 Processor -- start 2023-11-04T01:45:55.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- start start 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8eb00add70 0x7f8eb015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb00ae200 0x7f8eb00cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 0x7f8eb0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00cef60 con 0x7f8eb015cf80 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0152290 con 0x7f8eb00ae200 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0152570 con 0x7f8eb00add70 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 0x7f8eb0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 0x7f8eb0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43702/0 (socket says 172.21.15.40:43702) 2023-11-04T01:45:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 -- 172.21.15.40:0/3489645745 learned_addr learned my addr 172.21.15.40:0/3489645745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb624c640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8eb00add70 0x7f8eb015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 -- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8eb00add70 msgr2=0x7f8eb015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8eb00add70 0x7f8eb015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 -- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb00ae200 msgr2=0x7f8eb00cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb5a4b640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb00ae200 0x7f8eb00cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb00ae200 0x7f8eb00cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 -- 172.21.15.40:0/3489645745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40094d0 con 0x7f8eb015cf80 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb5a4b640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb00ae200 0x7f8eb00cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb6a4d640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 0x7f8eb0155de0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c3c0 tx=0x7f8ea000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00052d0 con 0x7f8eb015cf80 2023-11-04T01:45:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea0005430 con 0x7f8eb015cf80 2023-11-04T01:45:55.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0156320 con 0x7f8eb015cf80 2023-11-04T01:45:55.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0003860 con 0x7f8eb015cf80 2023-11-04T01:45:55.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.924+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb0152850 con 0x7f8eb015cf80 2023-11-04T01:45:55.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.928+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb00cf130 con 0x7f8eb015cf80 2023-11-04T01:45:55.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.928+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ea00039c0 con 0x7f8eb015cf80 2023-11-04T01:45:55.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.928+0000 7f8eaeffd640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8e9c0664a0 0x7f8e9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:55.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.928+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7217+0+0 (secure 0 0 0) 0x7f8ea0083990 con 0x7f8eb015cf80 2023-11-04T01:45:55.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.928+0000 7f8eb624c640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8e9c0664a0 0x7f8e9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:55.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.928+0000 7f8eb624c640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8e9c0664a0 0x7f8e9c068960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8007510 tx=0x7f8ea80074a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:55.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:55.932+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ea0050820 con 0x7f8eb015cf80 2023-11-04T01:45:56.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.124+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8eb0160090 con 0x7f8eb015cf80 2023-11-04T01:45:56.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eaeffd640 1 -- 172.21.15.40:0/3489645745 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4976 (secure 0 0 0) 0x7f8ea0053e40 con 0x7f8eb015cf80 2023-11-04T01:45:56.130 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:56.130 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":87,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:52.991829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:52.991828+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:56.130 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 87 2023-11-04T01:45:56.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8e9c0664a0 msgr2=0x7f8e9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8e9c0664a0 0x7f8e9c068960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8007510 tx=0x7f8ea80074a0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 msgr2=0x7f8eb0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 0x7f8eb0155de0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c3c0 tx=0x7f8ea000c880 comp rx=0 tx=0).stop 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 shutdown_connections 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8e9c0664a0 0x7f8e9c068960 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8eb015cf80 0x7f8eb0155de0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8eb00ae200 0x7f8eb00cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 --2- 172.21.15.40:0/3489645745 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8eb00add70 0x7f8eb015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 >> 172.21.15.40:0/3489645745 conn(0x7f8eb00b0890 msgr2=0x7f8eb00ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 shutdown_connections 2023-11-04T01:45:56.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.128+0000 7f8eb84b0640 1 -- 172.21.15.40:0/3489645745 wait complete. 2023-11-04T01:45:56.150 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:45:56.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:45:56.164 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:45:56.165 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:45:56.165 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:45:56.223 INFO:teuthology.orchestra.run.smithi040.stdout:1699062339.57369.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:45:56.225 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062339.57369.core'] 2023-11-04T01:45:56.226 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062339.57369.core, deleting it 2023-11-04T01:45:56.226 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062339.57369.core 2023-11-04T01:45:56.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 Processor -- start 2023-11-04T01:45:56.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 -- start start 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6620160680 0x7f66200cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66200ce7f0 0x7f66200b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66200cf000 con 0x7f6620160a60 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66200d09b0 con 0x7f6620160680 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f66251d7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66200b5de0 con 0x7f66200ce7f0 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6620160a60 0x7f66200ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54156/0 (socket says 172.21.15.40:54156) 2023-11-04T01:45:56.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661659c640 1 -- 172.21.15.40:0/1721813803 learned_addr learned my addr 172.21.15.40:0/1721813803 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661ed9d640 1 --2- 172.21.15.40:0/1721813803 >> v2:172.21.15.91:3300/0 conn(0x7f6620160680 0x7f66200cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661f59e640 1 --2- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66200ce7f0 0x7f66200b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661e59c640 1 -- 172.21.15.40:0/1721813803 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228582115 0 0) 0x7f66200cf000 con 0x7f6620160a60 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661e59c640 1 -- 172.21.15.40:0/1721813803 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f660c003530 con 0x7f6620160a60 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661ed9d640 1 -- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66200ce7f0 msgr2=0x7f66200b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661ed9d640 1 --2- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66200ce7f0 0x7f66200b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661ed9d640 1 -- 172.21.15.40:0/1721813803 >> v1:172.21.15.40:6789/0 conn(0x7f6620160a60 legacy=0x7f66200ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661e59c640 1 -- 172.21.15.40:0/1721813803 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3179768739 0 0) 0x7f660c003530 con 0x7f6620160a60 2023-11-04T01:45:56.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.460+0000 7f661ed9d640 1 -- 172.21.15.40:0/1721813803 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200d1610 con 0x7f6620160680 2023-11-04T01:45:56.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f661ed9d640 1 --2- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6620160680 0x7f66200cdba0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66100097c0 tx=0x7f661001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b21efc7c582b7563 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f661e59c640 1 -- 172.21.15.40:0/1721813803 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608001680 con 0x7f6620160680 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f661e59c640 1 -- 172.21.15.40:0/1721813803 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100a7050 con 0x7f6620160680 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f661e59c640 1 -- 172.21.15.40:0/1721813803 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ab620 con 0x7f6620160680 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 -- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6620160680 msgr2=0x7f66200cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 --2- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6620160680 0x7f66200cdba0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66100097c0 tx=0x7f661001c370 comp rx=0 tx=0).stop 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 -- 172.21.15.40:0/1721813803 shutdown_connections 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 --2- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f66200ce7f0 0x7f66200b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 --2- 172.21.15.40:0/1721813803 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6620160680 0x7f66200cdba0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 -- 172.21.15.40:0/1721813803 >> 172.21.15.40:0/1721813803 conn(0x7f66200d2f90 msgr2=0x7f66200d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 -- 172.21.15.40:0/1721813803 shutdown_connections 2023-11-04T01:45:56.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 -- 172.21.15.40:0/1721813803 wait complete. 2023-11-04T01:45:56.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 Processor -- start 2023-11-04T01:45:56.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.464+0000 7f66251d7640 1 -- start start 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66200ce7f0 0x7f66200b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 0x7f66200b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6620160a60 0x7f662015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620159d30 con 0x7f6620160680 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662015a010 con 0x7f66200ce7f0 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662015a2f0 con 0x7f6620160a60 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 0x7f66200b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 0x7f66200b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43716/0 (socket says 172.21.15.40:43716) 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 -- 172.21.15.40:0/3907598288 learned_addr learned my addr 172.21.15.40:0/3907598288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661ed9d640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66200ce7f0 0x7f66200b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661f59e640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6620160a60 0x7f662015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 -- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6620160a60 msgr2=0x7f662015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6620160a60 0x7f662015e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 -- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66200ce7f0 msgr2=0x7f66200b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66200ce7f0 0x7f66200b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 -- 172.21.15.40:0/3907598288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610009420 con 0x7f6620160680 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661ed9d640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66200ce7f0 0x7f66200b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661659c640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 0x7f66200b7b80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f660800c750 tx=0x7f660800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608005ae0 con 0x7f6620160680 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608005c40 con 0x7f6620160680 2023-11-04T01:45:56.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662015a5d0 con 0x7f6620160680 2023-11-04T01:45:56.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608007070 con 0x7f6620160680 2023-11-04T01:45:56.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6620151a00 con 0x7f6620160680 2023-11-04T01:45:56.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662004e4a0 con 0x7f6620160680 2023-11-04T01:45:56.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66080071f0 con 0x7f6620160680 2023-11-04T01:45:56.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f6617fff640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66000664d0 0x7f6600068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7217+0+0 (secure 0 0 0) 0x7f6608084350 con 0x7f6620160680 2023-11-04T01:45:56.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.468+0000 7f661ed9d640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66000664d0 0x7f6600068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.472+0000 7f661ed9d640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66000664d0 0x7f6600068990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f66100ad000 tx=0x7f6610008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:56.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.472+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6608051140 con 0x7f6620160680 2023-11-04T01:45:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f662006c440 con 0x7f6620160680 2023-11-04T01:45:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f6617fff640 1 -- 172.21.15.40:0/3907598288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4976 (secure 0 0 0) 0x7f6608054760 con 0x7f6620160680 2023-11-04T01:45:56.663 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:56.663 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":87,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:52.991829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7689,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7689":{"gid":7689,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.40:6835/2918977483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2918977483},{"type":"v1","addr":"172.21.15.40:6835","nonce":2918977483}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:52.991828+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 87 2023-11-04T01:45:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66000664d0 msgr2=0x7f6600068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66000664d0 0x7f6600068990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f66100ad000 tx=0x7f6610008040 comp rx=0 tx=0).stop 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 msgr2=0x7f66200b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 0x7f66200b7b80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f660800c750 tx=0x7f660800cc10 comp rx=0 tx=0).stop 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 shutdown_connections 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f66000664d0 0x7f6600068990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6620160a60 0x7f662015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6620160680 0x7f66200b7b80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 --2- 172.21.15.40:0/3907598288 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f66200ce7f0 0x7f66200b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 >> 172.21.15.40:0/3907598288 conn(0x7f66200d2f90 msgr2=0x7f662006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 shutdown_connections 2023-11-04T01:45:56.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.660+0000 7f66251d7640 1 -- 172.21.15.40:0/3907598288 wait complete. 2023-11-04T01:45:56.681 INFO:tasks.ceph.mds.a:Sent signal 9 2023-11-04T01:45:56.681 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:56.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:56.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 down 2023-11-04T01:45:56.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:45:56.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 Processor -- start 2023-11-04T01:45:56.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 -- start start 2023-11-04T01:45:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f92ec160680 0x7f92ec0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec160a60 0x7f92ec0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec0cf000 con 0x7f92ec0b3e30 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec0b5de0 con 0x7f92ec160680 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92f1d61640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0d1610 con 0x7f92ec160a60 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ebfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92ec0b3e30 0x7f92ec0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54168/0 (socket says 172.21.15.40:54168) 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ebfff640 1 -- 172.21.15.40:0/2842175022 learned_addr learned my addr 172.21.15.40:0/2842175022 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/2842175022 >> v2:172.21.15.91:3300/0 conn(0x7f92ec160680 0x7f92ec0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973009520 0 0) 0x7f92ec0cf000 con 0x7f92ec0b3e30 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92eaffd640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec160a60 0x7f92ec0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d8003530 con 0x7f92ec0b3e30 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2091732377 0 0) 0x7f92d8003530 con 0x7f92ec0b3e30 2023-11-04T01:45:56.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec160a60 msgr2=0x7f92ec0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec160a60 0x7f92ec0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 >> v2:172.21.15.91:3300/0 conn(0x7f92ec160680 msgr2=0x7f92ec0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 --2- 172.21.15.40:0/2842175022 >> v2:172.21.15.91:3300/0 conn(0x7f92ec160680 0x7f92ec0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.856+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0d18f0 con 0x7f92ec0b3e30 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f92e4001680 con 0x7f92ec0b3e30 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 >> v1:172.21.15.40:6789/0 conn(0x7f92ec0b3e30 legacy=0x7f92ec0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92d80047d0 0x7f92d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92d8005190 0x7f92d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0b5de0 con 0x7f92d8003980 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0d1610 con 0x7f92d80047d0 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d800bfb0 con 0x7f92d8005190 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eaffd640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec160a60 0x7f92ec0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:56.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 -- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92d8005190 msgr2=0x7f92d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92d8005190 0x7f92d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 -- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92d80047d0 msgr2=0x7f92d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92d80047d0 0x7f92d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 -- 172.21.15.40:0/2842175022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d8003530 con 0x7f92d8003980 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92d8003da0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009fc0 tx=0x7f92dc01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca5bedff89721f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0a5c60 con 0x7f92d8003980 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00f040 con 0x7f92d8003980 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ea7fc640 1 -- 172.21.15.40:0/2842175022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc0ad440 con 0x7f92d8003980 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92f1d61640 1 -- 172.21.15.40:0/2842175022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 msgr2=0x7f92d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92f1d61640 1 --2- 172.21.15.40:0/2842175022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92d8003da0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009fc0 tx=0x7f92dc01cc70 comp rx=0 tx=0).stop 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92ebfff640 1 -- 172.21.15.40:0/2842175022 reap_dead start 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92f1d61640 1 -- 172.21.15.40:0/2842175022 shutdown_connections 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92f1d61640 1 -- 172.21.15.40:0/2842175022 >> 172.21.15.40:0/2842175022 conn(0x7f92ec0d2f90 msgr2=0x7f92ec0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92f1d61640 1 -- 172.21.15.40:0/2842175022 shutdown_connections 2023-11-04T01:45:56.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.860+0000 7f92f1d61640 1 -- 172.21.15.40:0/2842175022 wait complete. 2023-11-04T01:45:56.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 Processor -- start 2023-11-04T01:45:56.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- start start 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92ec153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec0b4a10 0x7f92ec0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92ec0c9140 0x7f92ec0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec154ac0 con 0x7f92d8003980 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec154040 con 0x7f92ec0c9140 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec161bc0 con 0x7f92ec0b4a10 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92ec153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92ec153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43738/0 (socket says 172.21.15.40:43738) 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 -- 172.21.15.40:0/1501850686 learned_addr learned my addr 172.21.15.40:0/1501850686 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eaffd640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec0b4a10 0x7f92ec0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92ebfff640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92ec0c9140 0x7f92ec0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 -- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec0b4a10 msgr2=0x7f92ec0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec0b4a10 0x7f92ec0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 -- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92ec0c9140 msgr2=0x7f92ec0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92ec0c9140 0x7f92ec0c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 -- 172.21.15.40:0/1501850686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0c9b00 con 0x7f92d8003980 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92eb7fe640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92ec153b00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f92dc098780 tx=0x7f92dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc003ba0 con 0x7f92d8003980 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc003d00 con 0x7f92d8003980 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec161dd0 con 0x7f92d8003980 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc004260 con 0x7f92d8003980 2023-11-04T01:45:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec162390 con 0x7f92d8003980 2023-11-04T01:45:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.864+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec04e4a0 con 0x7f92d8003980 2023-11-04T01:45:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.868+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92dc0b4040 con 0x7f92d8003980 2023-11-04T01:45:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.868+0000 7f92e3fff640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92cc0664d0 0x7f92cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.868+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7217+0+0 (secure 0 0 0) 0x7f92dc11e660 con 0x7f92d8003980 2023-11-04T01:45:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.868+0000 7f92eaffd640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92cc0664d0 0x7f92cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:56.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.868+0000 7f92eaffd640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92cc0664d0 0x7f92cc068990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92d4006aa0 tx=0x7f92d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:56.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:56.872+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92dc0eb580 con 0x7f92d8003980 2023-11-04T01:45:56.882 INFO:tasks.ceph.mds.a.smithi040.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:45:57.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.088+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f92ec0b8ac0 con 0x7f92d8003980 2023-11-04T01:45:57.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92e3fff640 1 -- 172.21.15.40:0/1501850686 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7689 v88) v1 ==== 97+0+0 (secure 0 0 0) 0x7f92dc0eeba0 con 0x7f92d8003980 2023-11-04T01:45:57.094 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 7689 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92cc0664d0 msgr2=0x7f92cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92cc0664d0 0x7f92cc068990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92d4006aa0 tx=0x7f92d4008040 comp rx=0 tx=0).stop 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 msgr2=0x7f92ec153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92ec153b00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f92dc098780 tx=0x7f92dc009750 comp rx=0 tx=0).stop 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 shutdown_connections 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92cc0664d0 0x7f92cc068990 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f92ec0c9140 0x7f92ec0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f92ec0b4a10 0x7f92ec0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 --2- 172.21.15.40:0/1501850686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d8003980 0x7f92ec153b00 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 >> 172.21.15.40:0/1501850686 conn(0x7f92ec0d2f90 msgr2=0x7f92ec0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:57.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 shutdown_connections 2023-11-04T01:45:57.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.092+0000 7f92f1d61640 1 -- 172.21.15.40:0/1501850686 wait complete. 2023-11-04T01:45:57.115 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:45:57.115 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:45:57.116 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:45:57.116 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:57.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:57.116 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:45:57.116 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:45:57.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:45:57.118 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:45:57.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:57.180 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:45:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57808e640 1 Processor -- start 2023-11-04T01:45:57.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57808e640 1 -- start start 2023-11-04T01:45:57.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57808e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb5700701f0 0x7fb5700c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57808e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57015b9e0 con 0x7fb57006fd90 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57808e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57015bcc0 con 0x7fb57015ac00 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57808e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57015c560 con 0x7fb5700701f0 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb575629640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb57006fd90 0x7fb57015afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58992/0 (socket says 172.21.15.40:58992) 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb575629640 1 -- 172.21.15.40:0/1162523137 learned_addr learned my addr 172.21.15.40:0/1162523137 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb57662b640 1 --2- 172.21.15.40:0/1162523137 >> v2:172.21.15.91:3300/0 conn(0x7fb5700701f0 0x7fb5700c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721204045 0 0) 0x7fb57015b9e0 con 0x7fb57006fd90 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb558003530 con 0x7fb57006fd90 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 883006672 0 0) 0x7fb558003530 con 0x7fb57006fd90 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 >> v2:172.21.15.91:3300/0 conn(0x7fb5700701f0 msgr2=0x7fb5700c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 --2- 172.21.15.40:0/1162523137 >> v2:172.21.15.91:3300/0 conn(0x7fb5700701f0 0x7fb5700c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 >> v1:172.21.15.91:6789/0 conn(0x7fb57015ac00 legacy=0x7fb5700cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57015bfa0 con 0x7fb57006fd90 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fb56c001a00 con 0x7fb57006fd90 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 >> v1:172.21.15.40:6789/0 conn(0x7fb57006fd90 legacy=0x7fb57015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb558003980 0x7fb558003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5580047d0 0x7fb558004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb55800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57015c560 con 0x7fb558005190 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55800c130 con 0x7fb5580047d0 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.236+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55800c2f0 con 0x7fb558003980 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb55800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb575629640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5580047d0 0x7fb558004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb575e2a640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb558003980 0x7fb558003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 -- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb558003980 msgr2=0x7fb558003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb558003980 0x7fb558003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 -- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5580047d0 msgr2=0x7fb558004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb5580047d0 0x7fb558004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 -- 172.21.15.40:0/1162523137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558003530 con 0x7fb558005190 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 -- 172.21.15.40:0/1162523137 reap_dead start 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57662b640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb55800b990 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fb568009ae0 tx=0x7fb56801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8c213c15860d86 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568004020 con 0x7fb558005190 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5680041c0 con 0x7fb558005190 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb574e28640 1 -- 172.21.15.40:0/1162523137 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568003620 con 0x7fb558005190 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 -- 172.21.15.40:0/1162523137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 msgr2=0x7fb55800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb55800b990 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fb568009ae0 tx=0x7fb56801ca90 comp rx=0 tx=0).stop 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 -- 172.21.15.40:0/1162523137 shutdown_connections 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 --2- 172.21.15.40:0/1162523137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb55800b990 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 -- 172.21.15.40:0/1162523137 >> 172.21.15.40:0/1162523137 conn(0x7fb5700cef90 msgr2=0x7fb5700cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 -- 172.21.15.40:0/1162523137 shutdown_connections 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.240+0000 7fb57808e640 1 -- 172.21.15.40:0/1162523137 wait complete. 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 Processor -- start 2023-11-04T01:45:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- start start 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb5700b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb57006c600 0x7fb5700c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb57006ca40 0x7fb5700c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700c9c60 con 0x7fb558005190 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700c9ea0 con 0x7fb57006ca40 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b2720 con 0x7fb57006c600 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb5700b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb5700b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44318/0 (socket says 172.21.15.40:44318) 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 -- 172.21.15.40:0/4205704613 learned_addr learned my addr 172.21.15.40:0/4205704613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57662b640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb57006ca40 0x7fb5700c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575629640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb57006c600 0x7fb5700c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 -- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb57006c600 msgr2=0x7fb5700c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb57006c600 0x7fb5700c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 -- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb57006ca40 msgr2=0x7fb5700c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb57006ca40 0x7fb5700c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 -- 172.21.15.40:0/4205704613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700b2a00 con 0x7fb558005190 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb575e2a640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb5700b3200 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fb56000e4b0 tx=0x7fb56000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600052e0 con 0x7fb558005190 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560005440 con 0x7fb558005190 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700b2ce0 con 0x7fb558005190 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560003840 con 0x7fb558005190 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700b2360 con 0x7fb558005190 2023-11-04T01:45:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57004e4a0 con 0x7fb558005190 2023-11-04T01:45:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5600039a0 con 0x7fb558005190 2023-11-04T01:45:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.244+0000 7fb5667fc640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb55c0664a0 0x7fb55c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.248+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7259+0+0 (secure 0 0 0) 0x7fb560084300 con 0x7fb558005190 2023-11-04T01:45:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.248+0000 7fb575629640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb55c0664a0 0x7fb55c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.248+0000 7fb575629640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb55c0664a0 0x7fb55c068960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb56c004c00 tx=0x7fb56c004b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:57.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.252+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb560051060 con 0x7fb558005190 2023-11-04T01:45:57.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb57015e8f0 con 0x7fb558005190 2023-11-04T01:45:57.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb5667fc640 1 -- 172.21.15.40:0/4205704613 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4137 (secure 0 0 0) 0x7fb560054680 con 0x7fb558005190 2023-11-04T01:45:57.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:45:57.443 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:57.099243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:replay","state_seq":1,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:57.443 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 89 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb55c0664a0 msgr2=0x7fb55c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb55c0664a0 0x7fb55c068960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb56c004c00 tx=0x7fb56c004b70 comp rx=0 tx=0).stop 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 msgr2=0x7fb5700b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb5700b3200 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fb56000e4b0 tx=0x7fb56000e970 comp rx=0 tx=0).stop 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 shutdown_connections 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb55c0664a0 0x7fb55c068960 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb57006ca40 0x7fb5700c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb57006c600 0x7fb5700c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 --2- 172.21.15.40:0/4205704613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb558005190 0x7fb5700b3200 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 >> 172.21.15.40:0/4205704613 conn(0x7fb5700cef90 msgr2=0x7fb57015de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:57.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 shutdown_connections 2023-11-04T01:45:57.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:45:57.440+0000 7fb57808e640 1 -- 172.21.15.40:0/4205704613 wait complete. 2023-11-04T01:45:57.462 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:45:57.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:57.720 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:01.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:46:01.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:46:02.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:02.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.592+0000 7f01752e4640 1 Processor -- start 2023-11-04T01:46:02.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.592+0000 7f01752e4640 1 -- start start 2023-11-04T01:46:02.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f01752e4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0170142eb0 0x7f017015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f01752e4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01700cbd80 0x7f01700cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f01752e4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01700ca100 con 0x7f0170142ad0 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f01752e4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01700ca3e0 con 0x7f01700cbd80 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f01752e4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01700ca6c0 con 0x7f0170142eb0 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01700cbd80 0x7f01700cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01700cbd80 0x7f01700cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44324/0 (socket says 172.21.15.40:44324) 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 -- 172.21.15.40:0/3599929664 learned_addr learned my addr 172.21.15.40:0/3599929664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016e7fc640 1 --2- 172.21.15.40:0/3599929664 >> v2:172.21.15.91:3300/0 conn(0x7f0170142eb0 0x7f017015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 -- 172.21.15.40:0/3599929664 >> v2:172.21.15.91:3300/0 conn(0x7f0170142eb0 msgr2=0x7f017015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 --2- 172.21.15.40:0/3599929664 >> v2:172.21.15.91:3300/0 conn(0x7f0170142eb0 0x7f017015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 -- 172.21.15.40:0/3599929664 >> v1:172.21.15.91:6789/0 conn(0x7f0170142ad0 legacy=0x7f01700cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 -- 172.21.15.40:0/3599929664 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700ca9a0 con 0x7f01700cbd80 2023-11-04T01:46:02.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.596+0000 7f016f7fe640 1 --2- 172.21.15.40:0/3599929664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01700cbd80 0x7f01700cc830 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f01700c5ce0 tx=0x7f016801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f335033a6e0e139 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016dffb640 1 -- 172.21.15.40:0/3599929664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680a5820 con 0x7f01700cbd80 2023-11-04T01:46:02.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016dffb640 1 -- 172.21.15.40:0/3599929664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01680a5980 con 0x7f01700cbd80 2023-11-04T01:46:02.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016dffb640 1 -- 172.21.15.40:0/3599929664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680a5d10 con 0x7f01700cbd80 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- 172.21.15.40:0/3599929664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01700cbd80 msgr2=0x7f01700cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 --2- 172.21.15.40:0/3599929664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01700cbd80 0x7f01700cc830 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f01700c5ce0 tx=0x7f016801c940 comp rx=0 tx=0).stop 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- 172.21.15.40:0/3599929664 shutdown_connections 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 --2- 172.21.15.40:0/3599929664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01700cbd80 0x7f01700cc830 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 --2- 172.21.15.40:0/3599929664 >> v2:172.21.15.91:3300/0 conn(0x7f0170142eb0 0x7f017015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- 172.21.15.40:0/3599929664 >> 172.21.15.40:0/3599929664 conn(0x7f01700b0890 msgr2=0x7f01700b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- 172.21.15.40:0/3599929664 shutdown_connections 2023-11-04T01:46:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- 172.21.15.40:0/3599929664 wait complete. 2023-11-04T01:46:02.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 Processor -- start 2023-11-04T01:46:02.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- start start 2023-11-04T01:46:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01700cbd80 0x7f017013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0170142ad0 0x7f01700cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 0x7f0170158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017013b2c0 con 0x7f0170142eb0 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017013b5a0 con 0x7f0170142ad0 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017013b880 con 0x7f01700cbd80 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 0x7f0170158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 0x7f0170158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44334/0 (socket says 172.21.15.40:44334) 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 -- 172.21.15.40:0/670225085 learned_addr learned my addr 172.21.15.40:0/670225085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016effd640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01700cbd80 0x7f017013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016e7fc640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0170142ad0 0x7f01700cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 -- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01700cbd80 msgr2=0x7f017013c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01700cbd80 0x7f017013c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 -- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0170142ad0 msgr2=0x7f01700cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0170142ad0 0x7f01700cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 -- 172.21.15.40:0/670225085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168009b30 con 0x7f0170142eb0 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f016f7fe640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 0x7f0170158810 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f01680af040 tx=0x7f01680196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680b8880 con 0x7f0170142eb0 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01680b89e0 con 0x7f0170142eb0 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017013bb60 con 0x7f0170142eb0 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.600+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680b8d90 con 0x7f0170142eb0 2023-11-04T01:46:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017013c8a0 con 0x7f0170142eb0 2023-11-04T01:46:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017004e4a0 con 0x7f0170142eb0 2023-11-04T01:46:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01680b6440 con 0x7f0170142eb0 2023-11-04T01:46:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f01577fe640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f015c0664a0 0x7f015c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7259+0+0 (secure 0 0 0) 0x7f016811fc80 con 0x7f0170142eb0 2023-11-04T01:46:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f016effd640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f015c0664a0 0x7f015c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.604+0000 7f016effd640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f015c0664a0 0x7f015c068960 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0160001650 tx=0x7f0160009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.608+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f01680ecb00 con 0x7f0170142eb0 2023-11-04T01:46:02.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.800+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f017013c010 con 0x7f0170142eb0 2023-11-04T01:46:02.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.804+0000 7f01577fe640 1 -- 172.21.15.40:0/670225085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f01680f0120 con 0x7f0170142eb0 2023-11-04T01:46:02.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:02.806 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:57.133224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:resolve","state_seq":8,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:02.806 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 90 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f015c0664a0 msgr2=0x7f015c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f015c0664a0 0x7f015c068960 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0160001650 tx=0x7f0160009040 comp rx=0 tx=0).stop 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 msgr2=0x7f0170158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 0x7f0170158810 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f01680af040 tx=0x7f01680196e0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 shutdown_connections 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f015c0664a0 0x7f015c068960 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0170142eb0 0x7f0170158810 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0170142ad0 0x7f01700cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 --2- 172.21.15.40:0/670225085 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f01700cbd80 0x7f017013c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 >> 172.21.15.40:0/670225085 conn(0x7f01700b0890 msgr2=0x7f017013e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 shutdown_connections 2023-11-04T01:46:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.808+0000 7f01752e4640 1 -- 172.21.15.40:0/670225085 wait complete. 2023-11-04T01:46:02.827 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:02.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:02.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5dfe108640 1 Processor -- start 2023-11-04T01:46:02.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5dfe108640 1 -- start start 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5dfe108640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5df815cf80 0x7f5df80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5dfe108640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80c4910 con 0x7f5df80ae200 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5dfe108640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df815da70 con 0x7f5df80add70 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5dfe108640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df806bbf0 con 0x7f5df815cf80 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5df80ae200 0x7f5df80cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59008/0 (socket says 172.21.15.40:59008) 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df7fff640 1 -- 172.21.15.40:0/91975236 learned_addr learned my addr 172.21.15.40:0/91975236 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:02.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df77fe640 1 --2- 172.21.15.40:0/91975236 >> v2:172.21.15.40:3300/0 conn(0x7f5df815cf80 0x7f5df80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df67fc640 1 -- 172.21.15.40:0/91975236 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039570219 0 0) 0x7f5df80c4910 con 0x7f5df80ae200 2023-11-04T01:46:02.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df67fc640 1 -- 172.21.15.40:0/91975236 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de0003530 con 0x7f5df80ae200 2023-11-04T01:46:02.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df77fe640 1 -- 172.21.15.40:0/91975236 >> v1:172.21.15.91:6789/0 conn(0x7f5df80add70 legacy=0x7f5df815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df77fe640 1 -- 172.21.15.40:0/91975236 >> v1:172.21.15.40:6789/0 conn(0x7f5df80ae200 legacy=0x7f5df80cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.952+0000 7f5df77fe640 1 -- 172.21.15.40:0/91975236 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df815dcf0 con 0x7f5df815cf80 2023-11-04T01:46:02.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5df77fe640 1 --2- 172.21.15.40:0/91975236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df815cf80 0x7f5df80ac8e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5de80097c0 tx=0x7f5de801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4078c0ef6da35ad0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5df67fc640 1 -- 172.21.15.40:0/91975236 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80ac620 con 0x7f5df815cf80 2023-11-04T01:46:02.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5df67fc640 1 -- 172.21.15.40:0/91975236 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de80ac780 con 0x7f5df815cf80 2023-11-04T01:46:02.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5df67fc640 1 -- 172.21.15.40:0/91975236 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80acb10 con 0x7f5df815cf80 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 -- 172.21.15.40:0/91975236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df815cf80 msgr2=0x7f5df80ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 --2- 172.21.15.40:0/91975236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df815cf80 0x7f5df80ac8e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5de80097c0 tx=0x7f5de801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 -- 172.21.15.40:0/91975236 shutdown_connections 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 --2- 172.21.15.40:0/91975236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df815cf80 0x7f5df80ac8e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 -- 172.21.15.40:0/91975236 >> 172.21.15.40:0/91975236 conn(0x7f5df80b0890 msgr2=0x7f5df80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 -- 172.21.15.40:0/91975236 shutdown_connections 2023-11-04T01:46:02.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.956+0000 7f5dfe108640 1 -- 172.21.15.40:0/91975236 wait complete. 2023-11-04T01:46:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 Processor -- start 2023-11-04T01:46:02.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- start start 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5df80add70 0x7f5df8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 0x7f5df814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df8151560 0x7f5df81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81532a0 con 0x7f5df80ae200 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8154230 con 0x7f5df8151560 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81589e0 con 0x7f5df80add70 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 0x7f5df814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 0x7f5df814e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44346/0 (socket says 172.21.15.40:44346) 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 -- 172.21.15.40:0/640191261 learned_addr learned my addr 172.21.15.40:0/640191261 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df77fe640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5df80add70 0x7f5df8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df7fff640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df8151560 0x7f5df81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 -- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5df80add70 msgr2=0x7f5df8153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5df80add70 0x7f5df8153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 -- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df8151560 msgr2=0x7f5df81580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df8151560 0x7f5df81580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 -- 172.21.15.40:0/640191261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009420 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df7fff640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df8151560 0x7f5df81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5df6ffd640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 0x7f5df814e770 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c500 tx=0x7f5dec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec005220 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec005380 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec007270 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df8158cc0 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df81537d0 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df804e4a0 con 0x7f5df80ae200 2023-11-04T01:46:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5dec0073d0 con 0x7f5df80ae200 2023-11-04T01:46:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.960+0000 7f5ddffff640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5de40664a0 0x7f5de4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.964+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7259+0+0 (secure 0 0 0) 0x7f5dec083d60 con 0x7f5df80ae200 2023-11-04T01:46:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.964+0000 7f5df77fe640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5de40664a0 0x7f5de4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.964+0000 7f5df77fe640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5de40664a0 0x7f5de4068960 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ae000 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:02.968+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5dec050be0 con 0x7f5df80ae200 2023-11-04T01:46:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.160+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df806cf10 con 0x7f5df80ae200 2023-11-04T01:46:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.160+0000 7f5ddffff640 1 -- 172.21.15.40:0/640191261 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f5dec054200 con 0x7f5df80ae200 2023-11-04T01:46:03.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:03.164 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:57.133224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:resolve","state_seq":8,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 90 2023-11-04T01:46:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5de40664a0 msgr2=0x7f5de4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5de40664a0 0x7f5de4068960 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ae000 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2023-11-04T01:46:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 msgr2=0x7f5df814e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 0x7f5df814e770 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c500 tx=0x7f5dec00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 shutdown_connections 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5de40664a0 0x7f5de4068960 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df8151560 0x7f5df81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5df80ae200 0x7f5df814e770 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 --2- 172.21.15.40:0/640191261 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5df80add70 0x7f5df8153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 >> 172.21.15.40:0/640191261 conn(0x7f5df80b0890 msgr2=0x7f5df80ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 shutdown_connections 2023-11-04T01:46:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.164+0000 7f5dfe108640 1 -- 172.21.15.40:0/640191261 wait complete. 2023-11-04T01:46:03.184 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:46:03.184 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3563699722290039s 2023-11-04T01:46:03.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:03.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 Processor -- start 2023-11-04T01:46:03.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 -- start start 2023-11-04T01:46:03.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006bde0 0x7f2aa00cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa006c1c0 0x7f2aa01442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00c9ac0 con 0x7f2aa00c92b0 2023-11-04T01:46:03.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00caf20 con 0x7f2aa006c1c0 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa862d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c97e0 con 0x7f2aa006bde0 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa6bca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa006c1c0 0x7f2aa01442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa5bc8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2aa00c92b0 0x7f2aa015c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59024/0 (socket says 172.21.15.40:59024) 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa5bc8640 1 -- 172.21.15.40:0/3477581791 learned_addr learned my addr 172.21.15.40:0/3477581791 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa63c9640 1 --2- 172.21.15.40:0/3477581791 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006bde0 0x7f2aa00cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa6bca640 1 -- 172.21.15.40:0/3477581791 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006bde0 msgr2=0x7f2aa00cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa6bca640 1 --2- 172.21.15.40:0/3477581791 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006bde0 0x7f2aa00cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa6bca640 1 -- 172.21.15.40:0/3477581791 >> v1:172.21.15.40:6789/0 conn(0x7f2aa00c92b0 legacy=0x7f2aa015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa53c7640 1 -- 172.21.15.40:0/3477581791 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369259420 0 0) 0x7f2aa00c9ac0 con 0x7f2aa00c92b0 2023-11-04T01:46:03.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.300+0000 7f2aa6bca640 1 -- 172.21.15.40:0/3477581791 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00cb1c0 con 0x7f2aa006c1c0 2023-11-04T01:46:03.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa6bca640 1 --2- 172.21.15.40:0/3477581791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006c1c0 0x7f2aa01442b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009dc0 tx=0x7f2a9801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568d494f515c3edc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa53c7640 1 -- 172.21.15.40:0/3477581791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a980a58e0 con 0x7f2aa006c1c0 2023-11-04T01:46:03.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa53c7640 1 -- 172.21.15.40:0/3477581791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a980a5a40 con 0x7f2aa006c1c0 2023-11-04T01:46:03.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa53c7640 1 -- 172.21.15.40:0/3477581791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a980a5dd0 con 0x7f2aa006c1c0 2023-11-04T01:46:03.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- 172.21.15.40:0/3477581791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006c1c0 msgr2=0x7f2aa01442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 --2- 172.21.15.40:0/3477581791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006c1c0 0x7f2aa01442b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009dc0 tx=0x7f2a9801c930 comp rx=0 tx=0).stop 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- 172.21.15.40:0/3477581791 shutdown_connections 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 --2- 172.21.15.40:0/3477581791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006c1c0 0x7f2aa01442b0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 --2- 172.21.15.40:0/3477581791 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006bde0 0x7f2aa00cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- 172.21.15.40:0/3477581791 >> 172.21.15.40:0/3477581791 conn(0x7f2aa00b0890 msgr2=0x7f2aa00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- 172.21.15.40:0/3477581791 shutdown_connections 2023-11-04T01:46:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- 172.21.15.40:0/3477581791 wait complete. 2023-11-04T01:46:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 Processor -- start 2023-11-04T01:46:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- start start 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 0x7f2aa014b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006c1c0 0x7f2aa015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c92b0 0x7f2aa015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0136f40 con 0x7f2aa006bde0 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa013ae50 con 0x7f2aa00c92b0 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa862d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00c6c80 con 0x7f2aa006c1c0 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 0x7f2aa014b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 0x7f2aa014b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44366/0 (socket says 172.21.15.40:44366) 2023-11-04T01:46:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 -- 172.21.15.40:0/197745624 learned_addr learned my addr 172.21.15.40:0/197745624 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 -- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006c1c0 msgr2=0x7f2aa015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa5bc8640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006c1c0 0x7f2aa015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa6bca640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c92b0 0x7f2aa015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006c1c0 0x7f2aa015a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 -- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c92b0 msgr2=0x7f2aa015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c92b0 0x7f2aa015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.304+0000 7f2aa63c9640 1 -- 172.21.15.40:0/197745624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009a70 con 0x7f2aa006bde0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2aa63c9640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 0x7f2aa014b890 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00d800 tx=0x7f2a9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00b6c0 con 0x7f2aa006bde0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00b820 con 0x7f2aa006bde0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00c6f60 con 0x7f2aa006bde0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00bb90 con 0x7f2aa006bde0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00c7520 con 0x7f2aa006bde0 2023-11-04T01:46:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa004e4a0 con 0x7f2aa006bde0 2023-11-04T01:46:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a9c00bcf0 con 0x7f2aa006bde0 2023-11-04T01:46:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2a96ffd640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a840664a0 0x7f2a84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7259+0+0 (secure 0 0 0) 0x7f2a9c0849b0 con 0x7f2aa006bde0 2023-11-04T01:46:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2aa5bc8640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a840664a0 0x7f2a84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.308+0000 7f2aa5bc8640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a840664a0 0x7f2a84068960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2a90007fd0 tx=0x7f2a90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.312+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a9c051820 con 0x7f2aa006bde0 2023-11-04T01:46:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.500+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa006cf10 con 0x7f2aa006bde0 2023-11-04T01:46:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.500+0000 7f2a96ffd640 1 -- 172.21.15.40:0/197745624 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f2a9c054e40 con 0x7f2aa006bde0 2023-11-04T01:46:03.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:03.504 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":90}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:45:57.133224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7068},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:resolve","state_seq":8,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7068":{"gid":7068,"name":"a","rank":1,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6833/960586799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":960586799},{"type":"v1","addr":"172.21.15.40:6833","nonce":960586799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 90 2023-11-04T01:46:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a840664a0 msgr2=0x7f2a84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a840664a0 0x7f2a84068960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2a90007fd0 tx=0x7f2a90009040 comp rx=0 tx=0).stop 2023-11-04T01:46:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 msgr2=0x7f2aa014b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 0x7f2aa014b890 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00d800 tx=0x7f2a9c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 shutdown_connections 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2a840664a0 0x7f2a84068960 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2aa00c92b0 0x7f2aa015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2aa006c1c0 0x7f2aa015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 --2- 172.21.15.40:0/197745624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa006bde0 0x7f2aa014b890 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 >> 172.21.15.40:0/197745624 conn(0x7f2aa00b0890 msgr2=0x7f2aa015cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 shutdown_connections 2023-11-04T01:46:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.504+0000 7f2aa862d640 1 -- 172.21.15.40:0/197745624 wait complete. 2023-11-04T01:46:03.522 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:46:03.669 INFO:teuthology.orchestra.run.smithi091.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"16":[5,9]},"pending_update":[{"version":19,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-04T01:45:39.519076+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:46:03.669 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "16": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-04T01:45:39.519076+0000" }, "version": 19 } ], "snaps": [] } 2023-11-04T01:46:03.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:46:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 Processor -- start 2023-11-04T01:46:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 -- start start 2023-11-04T01:46:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f52d40b4be0 0x7f52d4160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d406a130 0x7f52d406a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d41614b0 con 0x7f52d415d2a0 2023-11-04T01:46:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d406ab20 con 0x7f52d40b4be0 2023-11-04T01:46:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d9f58640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40b38d0 con 0x7f52d406a130 2023-11-04T01:46:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d2ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f52d40b4be0 0x7f52d4160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d37fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f52d415d2a0 0x7f52d406cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:56476/0 (socket says 172.21.15.40:56476) 2023-11-04T01:46:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d37fe640 1 -- 172.21.15.40:0/4287759194 learned_addr learned my addr 172.21.15.40:0/4287759194 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d3fff640 1 --2- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d406a130 0x7f52d406a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d2ffd640 1 -- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d406a130 msgr2=0x7f52d406a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d2ffd640 1 --2- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d406a130 0x7f52d406a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d2ffd640 1 -- 172.21.15.40:0/4287759194 >> v1:172.21.15.91:6789/0 conn(0x7f52d415d2a0 legacy=0x7f52d406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.800+0000 7f52d2ffd640 1 -- 172.21.15.40:0/4287759194 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40b3bb0 con 0x7f52d40b4be0 2023-11-04T01:46:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d2ffd640 1 --2- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b4be0 0x7f52d4160f70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097c0 tx=0x7f52c401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1345833d24407c0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d27fc640 1 -- 172.21.15.40:0/4287759194 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40ab600 con 0x7f52d40b4be0 2023-11-04T01:46:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d27fc640 1 -- 172.21.15.40:0/4287759194 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c40a7050 con 0x7f52d40b4be0 2023-11-04T01:46:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d27fc640 1 -- 172.21.15.40:0/4287759194 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40ab980 con 0x7f52d40b4be0 2023-11-04T01:46:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 -- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b4be0 msgr2=0x7f52d4160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 --2- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b4be0 0x7f52d4160f70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097c0 tx=0x7f52c401c480 comp rx=0 tx=0).stop 2023-11-04T01:46:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 -- 172.21.15.40:0/4287759194 shutdown_connections 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 --2- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d406a130 0x7f52d406a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 --2- 172.21.15.40:0/4287759194 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b4be0 0x7f52d4160f70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 -- 172.21.15.40:0/4287759194 >> 172.21.15.40:0/4287759194 conn(0x7f52d40b18a0 msgr2=0x7f52d40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 -- 172.21.15.40:0/4287759194 shutdown_connections 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.804+0000 7f52d9f58640 1 -- 172.21.15.40:0/4287759194 wait complete. 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 Processor -- start 2023-11-04T01:46:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- start start 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 0x7f52d4151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d40b4be0 0x7f52d40acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d415d2a0 0x7f52d40ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40ae7a0 con 0x7f52d406a130 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40adf00 con 0x7f52d415d2a0 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40ae1e0 con 0x7f52d40b4be0 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 0x7f52d4151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 0x7f52d4151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44368/0 (socket says 172.21.15.40:44368) 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 -- 172.21.15.40:0/2598073214 learned_addr learned my addr 172.21.15.40:0/2598073214 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d2ffd640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d40b4be0 0x7f52d40acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d3fff640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d415d2a0 0x7f52d40ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 -- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d40b4be0 msgr2=0x7f52d40acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d40b4be0 0x7f52d40acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 -- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d415d2a0 msgr2=0x7f52d40ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d415d2a0 0x7f52d40ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 -- 172.21.15.40:0/2598073214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009420 con 0x7f52d406a130 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d2ffd640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d40b4be0 0x7f52d40acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d37fe640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 0x7f52d4151020 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c420 tx=0x7f52c800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8005cf0 con 0x7f52d406a130 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8005e50 con 0x7f52d406a130 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d40ae4c0 con 0x7f52d406a130 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80072f0 con 0x7f52d406a130 2023-11-04T01:46:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d4152230 con 0x7f52d406a130 2023-11-04T01:46:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.808+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d40b31a0 con 0x7f52d406a130 2023-11-04T01:46:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.812+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52c8007450 con 0x7f52d406a130 2023-11-04T01:46:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.812+0000 7f52bbfff640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52c00664d0 0x7f52c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.812+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7259+0+0 (secure 0 0 0) 0x7f52c8083880 con 0x7f52d406a130 2023-11-04T01:46:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.812+0000 7f52d2ffd640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52c00664d0 0x7f52c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.812+0000 7f52d2ffd640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52c00664d0 0x7f52c0068990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f52c40ad000 tx=0x7f52c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:03.816+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52c80506f0 con 0x7f52d406a130 2023-11-04T01:46:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.032+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f52d41614b0 con 0x7f52d406a130 2023-11-04T01:46:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.036+0000 7f52bbfff640 1 -- 172.21.15.40:0/2598073214 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7068 v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7f52d41614b0 con 0x7f52d406a130 2023-11-04T01:46:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 7068 2023-11-04T01:46:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52c00664d0 msgr2=0x7f52c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52c00664d0 0x7f52c0068990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f52c40ad000 tx=0x7f52c4008040 comp rx=0 tx=0).stop 2023-11-04T01:46:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 msgr2=0x7f52d4151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 0x7f52d4151020 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c420 tx=0x7f52c800c8e0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 shutdown_connections 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52c00664d0 0x7f52c0068990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d415d2a0 0x7f52d40ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d40b4be0 0x7f52d40acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 --2- 172.21.15.40:0/2598073214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52d406a130 0x7f52d4151020 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 >> 172.21.15.40:0/2598073214 conn(0x7f52d40b18a0 msgr2=0x7f52d40aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 shutdown_connections 2023-11-04T01:46:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.040+0000 7f52d9f58640 1 -- 172.21.15.40:0/2598073214 wait complete. 2023-11-04T01:46:04.062 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:46:04.062 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:46:04.062 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:46:04.062 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:04.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:04.062 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:46:04.063 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:46:04.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:46:04.064 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:46:04.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:04.124 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:46:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 Processor -- start 2023-11-04T01:46:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 -- start start 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f502406cc50 0x7f50240b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5024070bc0 0x7f5024071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5024071550 con 0x7f5024143ae0 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502406d250 con 0x7f5024070bc0 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f502942e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502406d530 con 0x7f502406cc50 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f50237fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5024070bc0 0x7f5024071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f50237fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5024070bc0 0x7f5024071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44404/0 (socket says 172.21.15.40:44404) 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.176+0000 7f50237fe640 1 -- 172.21.15.40:0/564793229 learned_addr learned my addr 172.21.15.40:0/564793229 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f501bfff640 1 --2- 172.21.15.40:0/564793229 >> v2:172.21.15.91:3300/0 conn(0x7f502406cc50 0x7f50240b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50237fe640 1 -- 172.21.15.40:0/564793229 >> v2:172.21.15.91:3300/0 conn(0x7f502406cc50 msgr2=0x7f50240b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50237fe640 1 --2- 172.21.15.40:0/564793229 >> v2:172.21.15.91:3300/0 conn(0x7f502406cc50 0x7f50240b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50237fe640 1 -- 172.21.15.40:0/564793229 >> v1:172.21.15.91:6789/0 conn(0x7f5024143ae0 legacy=0x7f50240cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50237fe640 1 -- 172.21.15.40:0/564793229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502406d810 con 0x7f5024070bc0 2023-11-04T01:46:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50237fe640 1 --2- 172.21.15.40:0/564793229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024070bc0 0x7f5024071010 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5024070b70 tx=0x7f501c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c506670b3ad137 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50227fc640 1 -- 172.21.15.40:0/564793229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0a5730 con 0x7f5024070bc0 2023-11-04T01:46:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50227fc640 1 -- 172.21.15.40:0/564793229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c0a5890 con 0x7f5024070bc0 2023-11-04T01:46:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f50227fc640 1 -- 172.21.15.40:0/564793229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0a5c20 con 0x7f5024070bc0 2023-11-04T01:46:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 -- 172.21.15.40:0/564793229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024070bc0 msgr2=0x7f5024071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 --2- 172.21.15.40:0/564793229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024070bc0 0x7f5024071010 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5024070b70 tx=0x7f501c01c960 comp rx=0 tx=0).stop 2023-11-04T01:46:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 -- 172.21.15.40:0/564793229 shutdown_connections 2023-11-04T01:46:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 --2- 172.21.15.40:0/564793229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024070bc0 0x7f5024071010 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 --2- 172.21.15.40:0/564793229 >> v2:172.21.15.91:3300/0 conn(0x7f502406cc50 0x7f50240b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 -- 172.21.15.40:0/564793229 >> 172.21.15.40:0/564793229 conn(0x7f50240b18a0 msgr2=0x7f50240b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:04.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 -- 172.21.15.40:0/564793229 shutdown_connections 2023-11-04T01:46:04.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.180+0000 7f502942e640 1 -- 172.21.15.40:0/564793229 wait complete. 2023-11-04T01:46:04.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 Processor -- start 2023-11-04T01:46:04.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- start start 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f502406cc50 0x7f50241f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5024070bc0 0x7f5024156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 0x7f502413aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024159cc0 con 0x7f5024143ae0 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50241f5010 con 0x7f502406cc50 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502413a9c0 con 0x7f5024070bc0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 0x7f502413aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 0x7f502413aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44416/0 (socket says 172.21.15.40:44416) 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 -- 172.21.15.40:0/463995979 learned_addr learned my addr 172.21.15.40:0/463995979 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f5022ffd640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f502406cc50 0x7f50241f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 -- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5024070bc0 msgr2=0x7f5024156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5024070bc0 0x7f5024156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 -- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f502406cc50 msgr2=0x7f50241f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f502406cc50 0x7f50241f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 -- 172.21.15.40:0/463995979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009b30 con 0x7f5024143ae0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f5022ffd640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f502406cc50 0x7f50241f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f50237fe640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 0x7f502413aff0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f501c01a590 tx=0x7f501c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0b8670 con 0x7f5024143ae0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c0b87d0 con 0x7f5024143ae0 2023-11-04T01:46:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502413aca0 con 0x7f5024143ae0 2023-11-04T01:46:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0b8b80 con 0x7f5024143ae0 2023-11-04T01:46:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50241f42d0 con 0x7f5024143ae0 2023-11-04T01:46:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5024164d30 con 0x7f5024143ae0 2023-11-04T01:46:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.184+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f501c0b8ce0 con 0x7f5024143ae0 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.188+0000 7f501b7fe640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50040664a0 0x7f5004068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.188+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7345+0+0 (secure 0 0 0) 0x7f501c11faf0 con 0x7f5024143ae0 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.188+0000 7f5022ffd640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50040664a0 0x7f5004068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.188+0000 7f5022ffd640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50040664a0 0x7f5004068960 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f501400a850 tx=0x7f5014008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.192+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f501c0eca20 con 0x7f5024143ae0 2023-11-04T01:46:04.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.380+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5024071550 con 0x7f5024143ae0 2023-11-04T01:46:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f501b7fe640 1 -- 172.21.15.40:0/463995979 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4141 (secure 0 0 0) 0x7f5024071550 con 0x7f5024143ae0 2023-11-04T01:46:04.386 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:04.386 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:04.043721+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:resolve","state_seq":8,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:replay","state_seq":1,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 92 2023-11-04T01:46:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50040664a0 msgr2=0x7f5004068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50040664a0 0x7f5004068960 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f501400a850 tx=0x7f5014008040 comp rx=0 tx=0).stop 2023-11-04T01:46:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 msgr2=0x7f502413aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 0x7f502413aff0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f501c01a590 tx=0x7f501c019700 comp rx=0 tx=0).stop 2023-11-04T01:46:04.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 shutdown_connections 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f50040664a0 0x7f5004068960 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5024143ae0 0x7f502413aff0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5024070bc0 0x7f5024156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 --2- 172.21.15.40:0/463995979 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f502406cc50 0x7f50241f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 >> 172.21.15.40:0/463995979 conn(0x7f50240b18a0 msgr2=0x7f50240b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 shutdown_connections 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:04.384+0000 7f502942e640 1 -- 172.21.15.40:0/463995979 wait complete. 2023-11-04T01:46:04.405 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:08.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:46:09.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 Processor -- start 2023-11-04T01:46:09.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 -- start start 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f233c0b27d0 0x7f233c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c15ef50 0x7f233c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c15f8e0 con 0x7f233c0b5ef0 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c15ea70 con 0x7f233c0b27d0 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2340e00640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0b2c90 con 0x7f233c15ef50 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f233c0b27d0 0x7f233c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f233c0b27d0 0x7f233c0ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56902/0 (socket says 172.21.15.40:56902) 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 -- 172.21.15.40:0/3983228864 learned_addr learned my addr 172.21.15.40:0/3983228864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:09.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f233ad9d640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c15ef50 0x7f233c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 -- 172.21.15.40:0/3983228864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c15ef50 msgr2=0x7f233c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:09.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c15ef50 0x7f233c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 -- 172.21.15.40:0/3983228864 >> v1:172.21.15.91:6789/0 conn(0x7f233c0b5ef0 legacy=0x7f233c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:09.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f2339d9b640 1 -- 172.21.15.40:0/3983228864 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0b2f70 con 0x7f233c0b27d0 2023-11-04T01:46:09.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.540+0000 7f233ad9d640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c15ef50 0x7f233c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2339d9b640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c0b27d0 0x7f233c0ce130 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2324009870 tx=0x7f232401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e58f3184a51030 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233959a640 1 -- 172.21.15.40:0/3983228864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240aa5f0 con 0x7f233c0b27d0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233959a640 1 -- 172.21.15.40:0/3983228864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23240aa750 con 0x7f233c0b27d0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233959a640 1 -- 172.21.15.40:0/3983228864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240aaae0 con 0x7f233c0b27d0 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- 172.21.15.40:0/3983228864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c0b27d0 msgr2=0x7f233c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c0b27d0 0x7f233c0ce130 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2324009870 tx=0x7f232401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- 172.21.15.40:0/3983228864 shutdown_connections 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c15ef50 0x7f233c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 --2- 172.21.15.40:0/3983228864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c0b27d0 0x7f233c0ce130 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- 172.21.15.40:0/3983228864 >> 172.21.15.40:0/3983228864 conn(0x7f233c06a130 msgr2=0x7f233c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- 172.21.15.40:0/3983228864 shutdown_connections 2023-11-04T01:46:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- 172.21.15.40:0/3983228864 wait complete. 2023-11-04T01:46:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 Processor -- start 2023-11-04T01:46:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- start start 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c0b27d0 0x7f233c0ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0b5ef0 0x7f233c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 0x7f233c0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0cee40 con 0x7f233c15ef50 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c158530 con 0x7f233c0b5ef0 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2340e00640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0cfc60 con 0x7f233c0b27d0 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 0x7f233c0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 0x7f233c0c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56908/0 (socket says 172.21.15.40:56908) 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 -- 172.21.15.40:0/1772095681 learned_addr learned my addr 172.21.15.40:0/1772095681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233a59c640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c0b27d0 0x7f233c0ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f2339d9b640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0b5ef0 0x7f233c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 -- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c0b27d0 msgr2=0x7f233c0ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c0b27d0 0x7f233c0ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 -- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0b5ef0 msgr2=0x7f233c151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0b5ef0 0x7f233c151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 -- 172.21.15.40:0/1772095681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240094d0 con 0x7f233c15ef50 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.544+0000 7f233ad9d640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 0x7f233c0c85c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f232c00c820 tx=0x7f232c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c004240 con 0x7f233c15ef50 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0cf050 con 0x7f233c15ef50 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c0043c0 con 0x7f233c15ef50 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c004530 con 0x7f233c15ef50 2023-11-04T01:46:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0cf8f0 con 0x7f233c15ef50 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c0cfdf0 con 0x7f233c15ef50 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f232c003860 con 0x7f233c15ef50 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2332ffd640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f231c0664a0 0x7f231c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7345+0+0 (secure 0 0 0) 0x7f232c084690 con 0x7f233c15ef50 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f233a59c640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f231c0664a0 0x7f231c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.548+0000 7f233a59c640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f231c0664a0 0x7f231c068960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2334005680 tx=0x7f2334003dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.552+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f232c0514d0 con 0x7f233c15ef50 2023-11-04T01:46:09.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.740+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f233c067610 con 0x7f233c15ef50 2023-11-04T01:46:09.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2332ffd640 1 -- 172.21.15.40:0/1772095681 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f232c054af0 con 0x7f233c15ef50 2023-11-04T01:46:09.746 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:09.746 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:05.061812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:09.746 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 94 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f231c0664a0 msgr2=0x7f231c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f231c0664a0 0x7f231c068960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2334005680 tx=0x7f2334003dd0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 msgr2=0x7f233c0c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 0x7f233c0c85c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f232c00c820 tx=0x7f232c00cce0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 shutdown_connections 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f231c0664a0 0x7f231c068960 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f233c15ef50 0x7f233c0c85c0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f233c0b5ef0 0x7f233c151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 --2- 172.21.15.40:0/1772095681 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f233c0b27d0 0x7f233c0ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 >> 172.21.15.40:0/1772095681 conn(0x7f233c06a130 msgr2=0x7f233c06a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 shutdown_connections 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.744+0000 7f2340e00640 1 -- 172.21.15.40:0/1772095681 wait complete. 2023-11-04T01:46:09.764 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:09.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36c426640 1 Processor -- start 2023-11-04T01:46:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36c426640 1 -- start start 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36c426640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd364142ad0 0x7fd36415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36c426640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640ca100 con 0x7fd364142eb0 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36c426640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640ca3e0 con 0x7fd3640cbd80 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36c426640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3640ca6c0 con 0x7fd364142ad0 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36a1c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd364142ad0 0x7fd36415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd3699c1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd364142eb0 0x7fd3640cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41216/0 (socket says 172.21.15.40:41216) 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd3699c1640 1 -- 172.21.15.40:0/3396392042 learned_addr learned my addr 172.21.15.40:0/3396392042 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36a1c2640 1 -- 172.21.15.40:0/3396392042 >> v1:172.21.15.91:6789/0 conn(0x7fd3640cbd80 legacy=0x7fd3640c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36a1c2640 1 -- 172.21.15.40:0/3396392042 >> v1:172.21.15.40:6789/0 conn(0x7fd364142eb0 legacy=0x7fd3640cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd3691c0640 1 -- 172.21.15.40:0/3396392042 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612273482 0 0) 0x7fd3640ca100 con 0x7fd364142eb0 2023-11-04T01:46:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.872+0000 7fd36a1c2640 1 -- 172.21.15.40:0/3396392042 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3640ca9a0 con 0x7fd364142ad0 2023-11-04T01:46:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a1c2640 1 --2- 172.21.15.40:0/3396392042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142ad0 0x7fd36415e4e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd3600097c0 tx=0x7fd36001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b910ea5926e4073 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd3691c0640 1 -- 172.21.15.40:0/3396392042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600ab600 con 0x7fd364142ad0 2023-11-04T01:46:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd3691c0640 1 -- 172.21.15.40:0/3396392042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3600a7050 con 0x7fd364142ad0 2023-11-04T01:46:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd3691c0640 1 -- 172.21.15.40:0/3396392042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600ab980 con 0x7fd364142ad0 2023-11-04T01:46:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3396392042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142ad0 msgr2=0x7fd36415e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 --2- 172.21.15.40:0/3396392042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142ad0 0x7fd36415e4e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd3600097c0 tx=0x7fd36001c3b0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3396392042 shutdown_connections 2023-11-04T01:46:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 --2- 172.21.15.40:0/3396392042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142ad0 0x7fd36415e4e0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3396392042 >> 172.21.15.40:0/3396392042 conn(0x7fd3640b0890 msgr2=0x7fd3640b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3396392042 shutdown_connections 2023-11-04T01:46:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3396392042 wait complete. 2023-11-04T01:46:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 Processor -- start 2023-11-04T01:46:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- start start 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3640cbd80 0x7fd36415d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd364142ad0 0x7fd364136660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 0x7fd3641591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36415d7e0 con 0x7fd364142eb0 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640c86f0 con 0x7fd364142ad0 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640c8410 con 0x7fd3640cbd80 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 0x7fd3641591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 0x7fd3641591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56936/0 (socket says 172.21.15.40:56936) 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 -- 172.21.15.40:0/3570030284 learned_addr learned my addr 172.21.15.40:0/3570030284 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd3699c1640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd364142ad0 0x7fd364136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 -- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3640cbd80 msgr2=0x7fd36415d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3640cbd80 0x7fd36415d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 -- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd364142ad0 msgr2=0x7fd364136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd364142ad0 0x7fd364136660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 -- 172.21.15.40:0/3570030284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009420 con 0x7fd364142eb0 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36a9c3640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 0x7fd3641591a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c780 tx=0x7fd35c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00a9f0 con 0x7fd364142eb0 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c00ce90 con 0x7fd364142eb0 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00add0 con 0x7fd364142eb0 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3641586c0 con 0x7fd364142eb0 2023-11-04T01:46:09.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.876+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd364158c80 con 0x7fd364142eb0 2023-11-04T01:46:09.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.880+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36404e4a0 con 0x7fd364142eb0 2023-11-04T01:46:09.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.880+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd35c012420 con 0x7fd364142eb0 2023-11-04T01:46:09.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.880+0000 7fd35affd640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd3480664a0 0x7fd348068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.880+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7345+0+0 (secure 0 0 0) 0x7fd35c0845e0 con 0x7fd364142eb0 2023-11-04T01:46:09.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.880+0000 7fd36a1c2640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd3480664a0 0x7fd348068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.880+0000 7fd36a1c2640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd3480664a0 0x7fd348068960 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd3600ad000 tx=0x7fd360008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:09.884+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd35c051480 con 0x7fd364142eb0 2023-11-04T01:46:10.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.072+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd36406d010 con 0x7fd364142eb0 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.072+0000 7fd35affd640 1 -- 172.21.15.40:0/3570030284 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fd35c054aa0 con 0x7fd364142eb0 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:05.061812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 94 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd3480664a0 msgr2=0x7fd348068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd3480664a0 0x7fd348068960 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd3600ad000 tx=0x7fd360008040 comp rx=0 tx=0).stop 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 msgr2=0x7fd3641591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 0x7fd3641591a0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c780 tx=0x7fd35c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 shutdown_connections 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd3480664a0 0x7fd348068960 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd364142eb0 0x7fd3641591a0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd364142ad0 0x7fd364136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 --2- 172.21.15.40:0/3570030284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3640cbd80 0x7fd36415d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 >> 172.21.15.40:0/3570030284 conn(0x7fd3640b0890 msgr2=0x7fd3640c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 shutdown_connections 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:10.076+0000 7fd36c426640 1 -- 172.21.15.40:0/3570030284 wait complete. 2023-11-04T01:46:10.094 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:11.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feffed40640 1 Processor -- start 2023-11-04T01:46:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feffed40640 1 -- start start 2023-11-04T01:46:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feffed40640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 0x7feff80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feffed40640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80c9ac0 con 0x7feff80c92b0 2023-11-04T01:46:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feffed40640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80caf20 con 0x7feff806bde0 2023-11-04T01:46:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feffed40640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff80c97e0 con 0x7feff806c1c0 2023-11-04T01:46:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feff7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feff80c92b0 0x7feff81442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41220/0 (socket says 172.21.15.40:41220) 2023-11-04T01:46:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.228+0000 7feff7fff640 1 -- 172.21.15.40:0/3000617072 learned_addr learned my addr 172.21.15.40:0/3000617072 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:11.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 0x7feff80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979153714 0 0) 0x7feff80c9ac0 con 0x7feff80c92b0 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe8003530 con 0x7feff80c92b0 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235079919 0 0) 0x7fefe8003530 con 0x7feff80c92b0 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 msgr2=0x7feff80cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 0x7feff80cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 >> v1:172.21.15.91:6789/0 conn(0x7feff806bde0 legacy=0x7feff815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80cb1c0 con 0x7feff80c92b0 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fefe4001680 con 0x7feff80c92b0 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 >> v1:172.21.15.40:6789/0 conn(0x7feff80c92b0 legacy=0x7feff81442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe80039b0 0x7fefe8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 0x7fefe80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe8004d10 0x7fefe8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff80c97e0 con 0x7fefe8004d10 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe800bac0 con 0x7fefe80039b0 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe800bc80 con 0x7feff806c1c0 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe8004d10 0x7fefe8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff7fff640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 0x7fefe80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffcadc640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe80039b0 0x7fefe8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 -- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 msgr2=0x7fefe80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff806c1c0 0x7fefe80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 -- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe80039b0 msgr2=0x7fefe8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe80039b0 0x7fefe8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 -- 172.21.15.40:0/3000617072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8003530 con 0x7fefe8004d10 2023-11-04T01:46:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe8004d10 0x7fefe8005190 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feff0009fc0 tx=0x7feff001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb215e582b22645 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00a5b60 con 0x7fefe8004d10 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff000f040 con 0x7fefe8004d10 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feff77fe640 1 -- 172.21.15.40:0/3000617072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00ad440 con 0x7fefe8004d10 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffed40640 1 -- 172.21.15.40:0/3000617072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe8004d10 msgr2=0x7fefe8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffed40640 1 --2- 172.21.15.40:0/3000617072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe8004d10 0x7fefe8005190 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feff0009fc0 tx=0x7feff001cc60 comp rx=0 tx=0).stop 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffd2dd640 1 -- 172.21.15.40:0/3000617072 reap_dead start 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffed40640 1 -- 172.21.15.40:0/3000617072 shutdown_connections 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffed40640 1 -- 172.21.15.40:0/3000617072 >> 172.21.15.40:0/3000617072 conn(0x7feff80b0890 msgr2=0x7feff80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffed40640 1 -- 172.21.15.40:0/3000617072 shutdown_connections 2023-11-04T01:46:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.232+0000 7feffed40640 1 -- 172.21.15.40:0/3000617072 wait complete. 2023-11-04T01:46:11.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 Processor -- start 2023-11-04T01:46:11.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- start start 2023-11-04T01:46:11.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feff81f00f0 0x7feff81f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff80cf420 0x7feff80c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 0x7feff81f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff81f3b50 con 0x7feff80c5180 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff80c3ba0 con 0x7feff81f00f0 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff80c3e80 con 0x7feff80cf420 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 0x7feff81f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 0x7feff81f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56954/0 (socket says 172.21.15.40:56954) 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 -- 172.21.15.40:0/345355475 learned_addr learned my addr 172.21.15.40:0/345355475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feff7fff640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff80cf420 0x7feff80c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffcadc640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feff81f00f0 0x7feff81f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 -- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff80cf420 msgr2=0x7feff80c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff80cf420 0x7feff80c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 -- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feff81f00f0 msgr2=0x7feff81f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feff81f00f0 0x7feff81f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 -- 172.21.15.40:0/345355475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80c4160 con 0x7feff80c5180 2023-11-04T01:46:11.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffd2dd640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 0x7feff81f3d50 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7feff0002240 tx=0x7feff0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:11.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00039a0 con 0x7feff80c5180 2023-11-04T01:46:11.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff0003b00 con 0x7feff80c5180 2023-11-04T01:46:11.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff80c4440 con 0x7feff80c5180 2023-11-04T01:46:11.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff0003e70 con 0x7feff80c5180 2023-11-04T01:46:11.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff81f04d0 con 0x7feff80c5180 2023-11-04T01:46:11.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.236+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff804e4a0 con 0x7feff80c5180 2023-11-04T01:46:11.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.240+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feff00b4040 con 0x7feff80c5180 2023-11-04T01:46:11.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.240+0000 7feff57fa640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefdc0664d0 0x7fefdc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.240+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7345+0+0 (secure 0 0 0) 0x7feff00a5e40 con 0x7feff80c5180 2023-11-04T01:46:11.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.240+0000 7feffcadc640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefdc0664d0 0x7fefdc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.240+0000 7feffcadc640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefdc0664d0 0x7fefdc068990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fefec005510 tx=0x7fefec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:11.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.244+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feff00eb240 con 0x7feff80c5180 2023-11-04T01:46:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.432+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feff806cf10 con 0x7feff80c5180 2023-11-04T01:46:11.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feff57fa640 1 -- 172.21.15.40:0/345355475 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7feff00ee860 con 0x7feff80c5180 2023-11-04T01:46:11.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:11.437 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:05.061812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:11.437 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 94 2023-11-04T01:46:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefdc0664d0 msgr2=0x7fefdc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefdc0664d0 0x7fefdc068990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fefec005510 tx=0x7fefec009040 comp rx=0 tx=0).stop 2023-11-04T01:46:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 msgr2=0x7feff81f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 0x7feff81f3d50 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7feff0002240 tx=0x7feff0009750 comp rx=0 tx=0).stop 2023-11-04T01:46:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 shutdown_connections 2023-11-04T01:46:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefdc0664d0 0x7fefdc068990 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff80c5180 0x7feff81f3d50 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7feff80cf420 0x7feff80c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 --2- 172.21.15.40:0/345355475 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feff81f00f0 0x7feff81f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 >> 172.21.15.40:0/345355475 conn(0x7feff80b0890 msgr2=0x7feff815da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 shutdown_connections 2023-11-04T01:46:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:11.436+0000 7feffed40640 1 -- 172.21.15.40:0/345355475 wait complete. 2023-11-04T01:46:11.456 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:12.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.592+0000 7fa895792640 1 Processor -- start 2023-11-04T01:46:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.592+0000 7fa895792640 1 -- start start 2023-11-04T01:46:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.592+0000 7fa895792640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa890160a60 0x7fa8900ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8900cf000 con 0x7fa8900b3e30 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900b5de0 con 0x7fa890160a60 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900d1610 con 0x7fa890160680 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa8867fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa890160a60 0x7fa8900ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8900b3e30 0x7fa8900cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41228/0 (socket says 172.21.15.40:41228) 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88f7fe640 1 -- 172.21.15.40:0/4199597587 learned_addr learned my addr 172.21.15.40:0/4199597587 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88effd640 1 --2- 172.21.15.40:0/4199597587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa8867fc640 1 -- 172.21.15.40:0/4199597587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 msgr2=0x7fa8900cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa8867fc640 1 --2- 172.21.15.40:0/4199597587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa8867fc640 1 -- 172.21.15.40:0/4199597587 >> v1:172.21.15.40:6789/0 conn(0x7fa8900b3e30 legacy=0x7fa8900cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88e7fc640 1 -- 172.21.15.40:0/4199597587 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924612386 0 0) 0x7fa8900cf000 con 0x7fa8900b3e30 2023-11-04T01:46:12.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa8867fc640 1 -- 172.21.15.40:0/4199597587 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900d18f0 con 0x7fa890160a60 2023-11-04T01:46:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa8867fc640 1 --2- 172.21.15.40:0/4199597587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa890160a60 0x7fa8900ce0e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa8780097c0 tx=0x7fa87801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6653515436ec51f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88e7fc640 1 -- 172.21.15.40:0/4199597587 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780ac620 con 0x7fa890160a60 2023-11-04T01:46:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88e7fc640 1 -- 172.21.15.40:0/4199597587 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780ac780 con 0x7fa890160a60 2023-11-04T01:46:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa88e7fc640 1 -- 172.21.15.40:0/4199597587 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780acb10 con 0x7fa890160a60 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- 172.21.15.40:0/4199597587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa890160a60 msgr2=0x7fa8900ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 --2- 172.21.15.40:0/4199597587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa890160a60 0x7fa8900ce0e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa8780097c0 tx=0x7fa87801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- 172.21.15.40:0/4199597587 shutdown_connections 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 --2- 172.21.15.40:0/4199597587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa890160a60 0x7fa8900ce0e0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 --2- 172.21.15.40:0/4199597587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- 172.21.15.40:0/4199597587 >> 172.21.15.40:0/4199597587 conn(0x7fa8900d2f90 msgr2=0x7fa8900d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- 172.21.15.40:0/4199597587 shutdown_connections 2023-11-04T01:46:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.596+0000 7fa895792640 1 -- 172.21.15.40:0/4199597587 wait complete. 2023-11-04T01:46:12.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 Processor -- start 2023-11-04T01:46:12.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- start start 2023-11-04T01:46:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 0x7fa8900c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa890160a60 0x7fa8900c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c9000 con 0x7fa8900b3e30 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901576b0 con 0x7fa890160a60 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa890157990 con 0x7fa890160680 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 0x7fa8900c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 0x7fa8900c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56984/0 (socket says 172.21.15.40:56984) 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 -- 172.21.15.40:0/1556783772 learned_addr learned my addr 172.21.15.40:0/1556783772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa8867fc640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 -- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 msgr2=0x7fa8900cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 -- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa890160a60 msgr2=0x7fa8900c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88f7fe640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa890160a60 0x7fa8900c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa890160a60 0x7fa8900c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 -- 172.21.15.40:0/1556783772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009420 con 0x7fa8900b3e30 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa88effd640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 0x7fa8900c9a60 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fa88000d800 tx=0x7fa88000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000b6c0 con 0x7fa8900b3e30 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000b820 con 0x7fa8900b3e30 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900c9260 con 0x7fa8900b3e30 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bb90 con 0x7fa8900b3e30 2023-11-04T01:46:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900ccfd0 con 0x7fa8900b3e30 2023-11-04T01:46:12.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.600+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89004e4a0 con 0x7fa8900b3e30 2023-11-04T01:46:12.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.604+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa88000bcf0 con 0x7fa8900b3e30 2023-11-04T01:46:12.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.604+0000 7fa887fff640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8700664a0 0x7fa870068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.604+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7345+0+0 (secure 0 0 0) 0x7fa880084a90 con 0x7fa8900b3e30 2023-11-04T01:46:12.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.604+0000 7fa8867fc640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8700664a0 0x7fa870068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.604+0000 7fa8867fc640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8700664a0 0x7fa870068960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa8780ae000 tx=0x7fa8780a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.608+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa880051890 con 0x7fa8900b3e30 2023-11-04T01:46:12.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa890158580 con 0x7fa8900b3e30 2023-11-04T01:46:12.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa887fff640 1 -- 172.21.15.40:0/1556783772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fa880011340 con 0x7fa8900b3e30 2023-11-04T01:46:12.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:12.803 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:05.061812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:12.803 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 94 2023-11-04T01:46:12.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8700664a0 msgr2=0x7fa870068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8700664a0 0x7fa870068960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa8780ae000 tx=0x7fa8780a7000 comp rx=0 tx=0).stop 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 msgr2=0x7fa8900c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 0x7fa8900c9a60 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fa88000d800 tx=0x7fa88000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 shutdown_connections 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa8700664a0 0x7fa870068960 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa890160a60 0x7fa8900c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa890160680 0x7fa8900cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 --2- 172.21.15.40:0/1556783772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8900b3e30 0x7fa8900c9a60 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 >> 172.21.15.40:0/1556783772 conn(0x7fa8900d2f90 msgr2=0x7fa8900b8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 shutdown_connections 2023-11-04T01:46:12.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:12.800+0000 7fa895792640 1 -- 172.21.15.40:0/1556783772 wait complete. 2023-11-04T01:46:12.821 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:13.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:13.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 Processor -- start 2023-11-04T01:46:13.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 -- start start 2023-11-04T01:46:13.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3b806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff3b80cd470 0x7ff3b80b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b806d250 con 0x7ff3b8070bc0 2023-11-04T01:46:13.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b806d530 con 0x7ff3b80cd470 2023-11-04T01:46:13.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3bd8a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b806d810 con 0x7ff3b8143ae0 2023-11-04T01:46:13.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3b8070bc0 0x7ff3b806e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41242/0 (socket says 172.21.15.40:41242) 2023-11-04T01:46:13.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b77fe640 1 -- 172.21.15.40:0/4228368873 learned_addr learned my addr 172.21.15.40:0/4228368873 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:13.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b6ffd640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3b806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/4228368873 >> v2:172.21.15.91:3300/0 conn(0x7ff3b80cd470 0x7ff3b80b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676032565 0 0) 0x7ff3b806d250 con 0x7ff3b8070bc0 2023-11-04T01:46:13.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a4003530 con 0x7ff3b8070bc0 2023-11-04T01:46:13.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244996711 0 0) 0x7ff3a4003530 con 0x7ff3b8070bc0 2023-11-04T01:46:13.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 msgr2=0x7ff3b806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3b806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 >> v2:172.21.15.91:3300/0 conn(0x7ff3b80cd470 msgr2=0x7ff3b80b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 --2- 172.21.15.40:0/4228368873 >> v2:172.21.15.91:3300/0 conn(0x7ff3b80cd470 0x7ff3b80b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b806daf0 con 0x7ff3b8070bc0 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff3a8001680 con 0x7ff3b8070bc0 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 >> v1:172.21.15.40:6789/0 conn(0x7ff3b8070bc0 legacy=0x7ff3b806e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a4004d10 0x7ff3a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b806d530 con 0x7ff3a4003f00 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b806d810 con 0x7ff3a4004d10 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a400b990 con 0x7ff3b8143ae0 2023-11-04T01:46:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b6ffd640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b77fe640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a4004d10 0x7ff3a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 -- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 msgr2=0x7ff3a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 -- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a4004d10 msgr2=0x7ff3a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3a4004d10 0x7ff3a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b67fc640 1 -- 172.21.15.40:0/4228368873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4003530 con 0x7ff3a4003f00 2023-11-04T01:46:13.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.956+0000 7ff3b6ffd640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b8143ae0 0x7ff3a4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3a40047d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009fc0 tx=0x7ff3b001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c90d5519f1b61c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00a5ba0 con 0x7ff3a4003f00 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000f040 con 0x7ff3a4003f00 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3b5ffb640 1 -- 172.21.15.40:0/4228368873 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00ad440 con 0x7ff3a4003f00 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/4228368873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 msgr2=0x7ff3a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/4228368873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3a40047d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009fc0 tx=0x7ff3b001cc40 comp rx=0 tx=0).stop 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3b77fe640 1 -- 172.21.15.40:0/4228368873 reap_dead start 2023-11-04T01:46:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/4228368873 shutdown_connections 2023-11-04T01:46:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/4228368873 >> 172.21.15.40:0/4228368873 conn(0x7ff3b80b18a0 msgr2=0x7ff3b80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/4228368873 shutdown_connections 2023-11-04T01:46:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.960+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/4228368873 wait complete. 2023-11-04T01:46:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 Processor -- start 2023-11-04T01:46:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- start start 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3b81f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b81398f0 0x7ff3b80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3b815be70 0x7ff3b815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b815c830 con 0x7ff3a4003f00 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8156750 con 0x7ff3b815be70 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80c5050 con 0x7ff3b81398f0 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3b81f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3b81f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57014/0 (socket says 172.21.15.40:57014) 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 -- 172.21.15.40:0/710722587 learned_addr learned my addr 172.21.15.40:0/710722587 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b77fe640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3b815be70 0x7ff3b815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b81398f0 0x7ff3b80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 -- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b81398f0 msgr2=0x7ff3b80c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b81398f0 0x7ff3b80c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 -- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3b815be70 msgr2=0x7ff3b815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3b815be70 0x7ff3b815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 -- 172.21.15.40:0/710722587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b81f1290 con 0x7ff3a4003f00 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3b6ffd640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3b81f5210 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00116a0 tx=0x7ff3a0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0004220 con 0x7ff3a4003f00 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0004380 con 0x7ff3a4003f00 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b8139d70 con 0x7ff3a4003f00 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000f9e0 con 0x7ff3a4003f00 2023-11-04T01:46:13.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b8156c80 con 0x7ff3a4003f00 2023-11-04T01:46:13.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b815d930 con 0x7ff3a4003f00 2023-11-04T01:46:13.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3a000fb40 con 0x7ff3a4003f00 2023-11-04T01:46:13.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.964+0000 7ff3affff640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3980664a0 0x7ff398068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.968+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7ff3a00849a0 con 0x7ff3a4003f00 2023-11-04T01:46:13.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.968+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3980664a0 0x7ff398068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.968+0000 7ff3b67fc640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3980664a0 0x7ff398068960 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00af000 tx=0x7ff3b00a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:13.972+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3a0051820 con 0x7ff3a4003f00 2023-11-04T01:46:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3b80b4270 con 0x7ff3a4003f00 2023-11-04T01:46:14.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3affff640 1 -- 172.21.15.40:0/710722587 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4932 (secure 0 0 0) 0x7ff3a0022090 con 0x7ff3a4003f00 2023-11-04T01:46:14.167 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:14.167 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:13.134943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 95 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3980664a0 msgr2=0x7ff398068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3980664a0 0x7ff398068960 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00af000 tx=0x7ff3b00a7040 comp rx=0 tx=0).stop 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 msgr2=0x7ff3b81f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3b81f5210 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00116a0 tx=0x7ff3a0011b60 comp rx=0 tx=0).stop 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 shutdown_connections 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff3980664a0 0x7ff398068960 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3b815be70 0x7ff3b815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3b81398f0 0x7ff3b80c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 --2- 172.21.15.40:0/710722587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4003f00 0x7ff3b81f5210 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 >> 172.21.15.40:0/710722587 conn(0x7ff3b80b18a0 msgr2=0x7ff3b806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 shutdown_connections 2023-11-04T01:46:14.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:14.164+0000 7ff3bd8a5640 1 -- 172.21.15.40:0/710722587 wait complete. 2023-11-04T01:46:14.186 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:46:15.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:15.275 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:46:15.274+0000 7f0ad10ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:15.275 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:46:15.274+0000 7f0ad10ce640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:15.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.316+0000 7f10986e1640 1 Processor -- start 2023-11-04T01:46:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.316+0000 7f10986e1640 1 -- start start 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f10986e1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f109006bde0 0x7f10900cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f10986e1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900c9ac0 con 0x7f10900c92b0 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f10986e1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900caf20 con 0x7f109006c1c0 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f10986e1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900c97e0 con 0x7f109006bde0 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1095c7c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10900c92b0 0x7f109015c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41244/0 (socket says 172.21.15.40:41244) 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1095c7c640 1 -- 172.21.15.40:0/3943700611 learned_addr learned my addr 172.21.15.40:0/3943700611 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:15.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109647d640 1 --2- 172.21.15.40:0/3943700611 >> v2:172.21.15.91:3300/0 conn(0x7f109006bde0 0x7f10900cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743346113 0 0) 0x7f10900c9ac0 con 0x7f10900c92b0 2023-11-04T01:46:15.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1078003530 con 0x7f10900c92b0 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138795405 0 0) 0x7f1078003530 con 0x7f10900c92b0 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 >> v2:172.21.15.91:3300/0 conn(0x7f109006bde0 msgr2=0x7f10900cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 --2- 172.21.15.40:0/3943700611 >> v2:172.21.15.91:3300/0 conn(0x7f109006bde0 0x7f10900cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 >> v1:172.21.15.91:6789/0 conn(0x7f109006c1c0 legacy=0x7f10901442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900cb1c0 con 0x7f10900c92b0 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1084001680 con 0x7f10900c92b0 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 >> v1:172.21.15.40:6789/0 conn(0x7f10900c92b0 legacy=0x7f109015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1078003980 0x7f1078003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10780047d0 0x7f1078004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078005190 0x7f107800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c97e0 con 0x7f1078005190 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107800c030 con 0x7f1078003980 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107800c1f0 con 0x7f10780047d0 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1096c7e640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078005190 0x7f107800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1095c7c640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10780047d0 0x7f1078004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f109647d640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1078003980 0x7f1078003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1096c7e640 1 -- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10780047d0 msgr2=0x7f1078004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1096c7e640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f10780047d0 0x7f1078004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1096c7e640 1 -- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1078003980 msgr2=0x7f1078003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1096c7e640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1078003980 0x7f1078003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.320+0000 7f1096c7e640 1 -- 172.21.15.40:0/3943700611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078003530 con 0x7f1078005190 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1096c7e640 1 -- 172.21.15.40:0/3943700611 reap_dead start 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1096c7e640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078005190 0x7f107800b990 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f1088001e70 tx=0x7f108801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45033ab819fc6e93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088003b80 con 0x7f1078005190 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088003d20 con 0x7f1078005190 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f109547b640 1 -- 172.21.15.40:0/3943700611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088005260 con 0x7f1078005190 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- 172.21.15.40:0/3943700611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078005190 msgr2=0x7f107800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078005190 0x7f107800b990 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f1088001e70 tx=0x7f108801c760 comp rx=0 tx=0).stop 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- 172.21.15.40:0/3943700611 shutdown_connections 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 --2- 172.21.15.40:0/3943700611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1078005190 0x7f107800b990 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- 172.21.15.40:0/3943700611 >> 172.21.15.40:0/3943700611 conn(0x7f10900b0890 msgr2=0x7f10900b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- 172.21.15.40:0/3943700611 shutdown_connections 2023-11-04T01:46:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- 172.21.15.40:0/3943700611 wait complete. 2023-11-04T01:46:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 Processor -- start 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- start start 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1078005190 0x7f109013a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 0x7f10900c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f109014d8f0 0x7f109013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c8bc0 con 0x7f109013c840 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c6630 con 0x7f109014d8f0 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f10986e1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c7b10 con 0x7f1078005190 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 0x7f10900c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 0x7f10900c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57032/0 (socket says 172.21.15.40:57032) 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 -- 172.21.15.40:0/3325568342 learned_addr learned my addr 172.21.15.40:0/3325568342 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f109647d640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1078005190 0x7f109013a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1096c7e640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f109014d8f0 0x7f109013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 -- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1078005190 msgr2=0x7f109013a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1078005190 0x7f109013a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 -- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f109014d8f0 msgr2=0x7f109013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f109014d8f0 0x7f109013ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 -- 172.21.15.40:0/3325568342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900c7df0 con 0x7f109013c840 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1096c7e640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f109014d8f0 0x7f109013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.324+0000 7f1095c7c640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 0x7f10900c8680 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f108400e7b0 tx=0x7f108400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400ee60 con 0x7f109013c840 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108400c8d0 con 0x7f109013c840 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10900c6070 con 0x7f109013c840 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400cc60 con 0x7f109013c840 2023-11-04T01:46:15.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109014dd70 con 0x7f109013c840 2023-11-04T01:46:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109004e4a0 con 0x7f109013c840 2023-11-04T01:46:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f108401d460 con 0x7f109013c840 2023-11-04T01:46:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f108effd640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f107c0664a0 0x7f107c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f1084084450 con 0x7f109013c840 2023-11-04T01:46:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f109647d640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f107c0664a0 0x7f107c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.328+0000 7f109647d640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f107c0664a0 0x7f107c068960 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1080009910 tx=0x7f1080008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.332+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1084051240 con 0x7f109013c840 2023-11-04T01:46:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.520+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f109006cf10 con 0x7f109013c840 2023-11-04T01:46:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.520+0000 7f108effd640 1 -- 172.21.15.40:0/3325568342 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f1084054860 con 0x7f109013c840 2023-11-04T01:46:15.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:15.525 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:14.127730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:15.525 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 96 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f107c0664a0 msgr2=0x7f107c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f107c0664a0 0x7f107c068960 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1080009910 tx=0x7f1080008040 comp rx=0 tx=0).stop 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 msgr2=0x7f10900c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 0x7f10900c8680 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f108400e7b0 tx=0x7f108400ec70 comp rx=0 tx=0).stop 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 shutdown_connections 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f107c0664a0 0x7f107c068960 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f109014d8f0 0x7f109013ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109013c840 0x7f10900c8680 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 --2- 172.21.15.40:0/3325568342 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1078005190 0x7f109013a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 >> 172.21.15.40:0/3325568342 conn(0x7f10900b0890 msgr2=0x7f109015abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 shutdown_connections 2023-11-04T01:46:15.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.524+0000 7f10986e1640 1 -- 172.21.15.40:0/3325568342 wait complete. 2023-11-04T01:46:15.543 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:46:15.543 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.779627084732056s 2023-11-04T01:46:15.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:15.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.656+0000 7f4735ac5640 1 Processor -- start 2023-11-04T01:46:15.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.656+0000 7f4735ac5640 1 -- start start 2023-11-04T01:46:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4735ac5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f473015cf80 0x7f47300ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4735ac5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47300add70 0x7f473015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4735ac5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47300c4910 con 0x7f47300ae200 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4735ac5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473006bbf0 con 0x7f47300add70 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4735ac5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473015dcf0 con 0x7f473015cf80 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47300add70 0x7f473015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47300add70 0x7f473015d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57038/0 (socket says 172.21.15.40:57038) 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 -- 172.21.15.40:0/768016303 learned_addr learned my addr 172.21.15.40:0/768016303 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f472f7fe640 1 --2- 172.21.15.40:0/768016303 >> v2:172.21.15.91:3300/0 conn(0x7f473015cf80 0x7f47300ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 -- 172.21.15.40:0/768016303 >> v2:172.21.15.91:3300/0 conn(0x7f473015cf80 msgr2=0x7f47300ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 --2- 172.21.15.40:0/768016303 >> v2:172.21.15.91:3300/0 conn(0x7f473015cf80 0x7f47300ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 -- 172.21.15.40:0/768016303 >> v1:172.21.15.91:6789/0 conn(0x7f47300ae200 legacy=0x7f47300cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 -- 172.21.15.40:0/768016303 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473015dfd0 con 0x7f47300add70 2023-11-04T01:46:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f472f7fe640 1 --2- 172.21.15.40:0/768016303 >> v2:172.21.15.91:3300/0 conn(0x7f473015cf80 0x7f47300ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f4727fff640 1 --2- 172.21.15.40:0/768016303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f473015d360 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f4730071f40 tx=0x7f471801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445e2a2772cbb2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f472effd640 1 -- 172.21.15.40:0/768016303 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180ac640 con 0x7f47300add70 2023-11-04T01:46:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f472effd640 1 -- 172.21.15.40:0/768016303 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47180ac7a0 con 0x7f47300add70 2023-11-04T01:46:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.660+0000 7f472effd640 1 -- 172.21.15.40:0/768016303 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180acb30 con 0x7f47300add70 2023-11-04T01:46:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/768016303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 msgr2=0x7f473015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 --2- 172.21.15.40:0/768016303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f473015d360 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f4730071f40 tx=0x7f471801c3e0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/768016303 shutdown_connections 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 --2- 172.21.15.40:0/768016303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f473015d360 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 --2- 172.21.15.40:0/768016303 >> v2:172.21.15.91:3300/0 conn(0x7f473015cf80 0x7f47300ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/768016303 >> 172.21.15.40:0/768016303 conn(0x7f47300b0890 msgr2=0x7f47300b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/768016303 shutdown_connections 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/768016303 wait complete. 2023-11-04T01:46:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 Processor -- start 2023-11-04T01:46:15.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- start start 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f47300b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f47300ae200 0x7f47300affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f473015cf80 0x7f473015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4730152e80 con 0x7f47300add70 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47301526b0 con 0x7f473015cf80 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47301528c0 con 0x7f47300ae200 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f47300b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f47300b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57046/0 (socket says 172.21.15.40:57046) 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 -- 172.21.15.40:0/550795364 learned_addr learned my addr 172.21.15.40:0/550795364 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4727fff640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f47300ae200 0x7f47300affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472ffff640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f473015cf80 0x7f473015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 -- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f47300ae200 msgr2=0x7f47300affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f47300ae200 0x7f47300affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 -- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f473015cf80 msgr2=0x7f473015a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f473015cf80 0x7f473015a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 -- 172.21.15.40:0/550795364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180094d0 con 0x7f47300add70 2023-11-04T01:46:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472f7fe640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f47300b1730 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f472000c7f0 tx=0x7f472000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720007820 con 0x7f47300add70 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720007980 con 0x7f47300add70 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4730152ba0 con 0x7f47300add70 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720007d30 con 0x7f47300add70 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.664+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4730157c10 con 0x7f47300add70 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.668+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4730157790 con 0x7f47300add70 2023-11-04T01:46:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.668+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47200113f0 con 0x7f47300add70 2023-11-04T01:46:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.668+0000 7f472cff9640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f47100664a0 0x7f4710068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.668+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f4720084830 con 0x7f47300add70 2023-11-04T01:46:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.668+0000 7f4727fff640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f47100664a0 0x7f4710068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.668+0000 7f4727fff640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f47100664a0 0x7f4710068960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47180ae000 tx=0x7f4718008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.672+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4730157790 con 0x7f47300add70 2023-11-04T01:46:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.852+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4730157790 con 0x7f47300add70 2023-11-04T01:46:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f472cff9640 1 -- 172.21.15.40:0/550795364 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f4730157790 con 0x7f47300add70 2023-11-04T01:46:15.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:14.127730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 96 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f47100664a0 msgr2=0x7f4710068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f47100664a0 0x7f4710068960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47180ae000 tx=0x7f4718008040 comp rx=0 tx=0).stop 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 msgr2=0x7f47300b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f47300b1730 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f472000c7f0 tx=0x7f472000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 shutdown_connections 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f47100664a0 0x7f4710068960 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f473015cf80 0x7f473015a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f47300ae200 0x7f47300affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 --2- 172.21.15.40:0/550795364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47300add70 0x7f47300b1730 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 >> 172.21.15.40:0/550795364 conn(0x7f47300b0890 msgr2=0x7f4730159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 shutdown_connections 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:15.856+0000 7f4735ac5640 1 -- 172.21.15.40:0/550795364 wait complete. 2023-11-04T01:46:15.875 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:46:16.016 INFO:teuthology.orchestra.run.smithi091.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"16":[5,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:16.016 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "16": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:16.016 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:46:16.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:16.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 Processor -- start 2023-11-04T01:46:16.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 -- start start 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efee0143ae0 0x7efee006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee00b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efee0070bc0 0x7efee0071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee0071570 con 0x7efee0070bc0 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee006d250 con 0x7efee0143ae0 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee83cc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee006d530 con 0x7efee00cd470 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efee0070bc0 0x7efee0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efee0070bc0 0x7efee0071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57048/0 (socket says 172.21.15.40:57048) 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 -- 172.21.15.40:0/590729403 learned_addr learned my addr 172.21.15.40:0/590729403 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6168640 1 --2- 172.21.15.40:0/590729403 >> v2:172.21.15.91:3300/0 conn(0x7efee0143ae0 0x7efee006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee5967640 1 --2- 172.21.15.40:0/590729403 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee00b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 -- 172.21.15.40:0/590729403 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 msgr2=0x7efee00b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 --2- 172.21.15.40:0/590729403 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee00b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 -- 172.21.15.40:0/590729403 >> v2:172.21.15.91:3300/0 conn(0x7efee0143ae0 msgr2=0x7efee006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 --2- 172.21.15.40:0/590729403 >> v2:172.21.15.91:3300/0 conn(0x7efee0143ae0 0x7efee006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6969640 1 -- 172.21.15.40:0/590729403 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee006d810 con 0x7efee0070bc0 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.144+0000 7efee6168640 1 --2- 172.21.15.40:0/590729403 >> v2:172.21.15.91:3300/0 conn(0x7efee0143ae0 0x7efee006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6969640 1 --2- 172.21.15.40:0/590729403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee0071030 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7efee00b2870 tx=0x7efed801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26b20d684c8996b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee5166640 1 -- 172.21.15.40:0/590729403 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80aa5f0 con 0x7efee0070bc0 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee5166640 1 -- 172.21.15.40:0/590729403 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed80aa750 con 0x7efee0070bc0 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee5166640 1 -- 172.21.15.40:0/590729403 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80aaae0 con 0x7efee0070bc0 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- 172.21.15.40:0/590729403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 msgr2=0x7efee0071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- 172.21.15.40:0/590729403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee0071030 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7efee00b2870 tx=0x7efed801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- 172.21.15.40:0/590729403 shutdown_connections 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- 172.21.15.40:0/590729403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee0071030 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- 172.21.15.40:0/590729403 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee00b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- 172.21.15.40:0/590729403 >> v2:172.21.15.91:3300/0 conn(0x7efee0143ae0 0x7efee006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- 172.21.15.40:0/590729403 >> 172.21.15.40:0/590729403 conn(0x7efee00b18a0 msgr2=0x7efee00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- 172.21.15.40:0/590729403 shutdown_connections 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- 172.21.15.40:0/590729403 wait complete. 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 Processor -- start 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- start start 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee01f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee0139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee0143ae0 0x7efee015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0155e30 con 0x7efee0070bc0 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee013be50 con 0x7efee0143ae0 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee83cc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee0155220 con 0x7efee00cd470 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee01f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee01f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57056/0 (socket says 172.21.15.40:57056) 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 -- 172.21.15.40:0/2326684133 learned_addr learned my addr 172.21.15.40:0/2326684133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6969640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee0143ae0 0x7efee015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 -- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 msgr2=0x7efee0139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee5967640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee0139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee0139d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 -- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee0143ae0 msgr2=0x7efee015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee0143ae0 0x7efee015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6168640 1 -- 172.21.15.40:0/2326684133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80094d0 con 0x7efee0070bc0 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee5967640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee0139d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.148+0000 7efee6969640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee0143ae0 0x7efee015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efee6168640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee01f36f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7efedc00ce30 tx=0x7efedc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00f890 con 0x7efee0070bc0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc00f9f0 con 0x7efee0070bc0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee0155500 con 0x7efee0070bc0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00fd80 con 0x7efee0070bc0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee0155ac0 con 0x7efee0070bc0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee015d930 con 0x7efee0070bc0 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efedc00b040 con 0x7efee0070bc0 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efed6ffd640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efec40664a0 0x7efec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7efedc084f00 con 0x7efee0070bc0 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efee5967640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efec40664a0 0x7efec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.152+0000 7efee5967640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efec40664a0 0x7efec4068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efee015a8e0 tx=0x7efed0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.156+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efedc051ce0 con 0x7efee0070bc0 2023-11-04T01:46:16.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.340+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efee00b4270 con 0x7efee0070bc0 2023-11-04T01:46:16.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.340+0000 7efed6ffd640 1 -- 172.21.15.40:0/2326684133 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4932 (secure 0 0 0) 0x7efedc055300 con 0x7efee0070bc0 2023-11-04T01:46:16.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:16.344 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:14.127730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:16.345 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 96 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efec40664a0 msgr2=0x7efec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efec40664a0 0x7efec4068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efee015a8e0 tx=0x7efed0008040 comp rx=0 tx=0).stop 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 msgr2=0x7efee01f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee01f36f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7efedc00ce30 tx=0x7efedc00a650 comp rx=0 tx=0).stop 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 shutdown_connections 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efec40664a0 0x7efec4068960 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efee0143ae0 0x7efee015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efee00cd470 0x7efee0139d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 --2- 172.21.15.40:0/2326684133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efee0070bc0 0x7efee01f36f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 >> 172.21.15.40:0/2326684133 conn(0x7efee00b18a0 msgr2=0x7efee00b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 shutdown_connections 2023-11-04T01:46:16.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.344+0000 7efee83cc640 1 -- 172.21.15.40:0/2326684133 wait complete. 2023-11-04T01:46:16.362 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:46:16.504 INFO:teuthology.orchestra.run.smithi091.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"16":[5,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:16.505 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "16": [ 5, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:16.505 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:16.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:46:16.519 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:46:16.519 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:46:16.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:46:16.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 Processor -- start 2023-11-04T01:46:16.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 -- start start 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa0c06bde0 0x7ffa0c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c0c92b0 0x7ffa0c15c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0c9ac0 con 0x7ffa0c06c1c0 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0caf20 con 0x7ffa0c06bde0 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa1166f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c15c5d0 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa0c06bde0 0x7ffa0c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa0c06bde0 0x7ffa0c0cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57070/0 (socket says 172.21.15.40:57070) 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 -- 172.21.15.40:0/205350840 learned_addr learned my addr 172.21.15.40:0/205350840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0a7fc640 1 --2- 172.21.15.40:0/205350840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c0c92b0 0x7ffa0c15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 -- 172.21.15.40:0/205350840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c0c92b0 msgr2=0x7ffa0c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 --2- 172.21.15.40:0/205350840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c0c92b0 0x7ffa0c15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 -- 172.21.15.40:0/205350840 >> v1:172.21.15.91:6789/0 conn(0x7ffa0c06c1c0 legacy=0x7ffa0c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.736+0000 7ffa0affd640 1 -- 172.21.15.40:0/205350840 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0c97e0 con 0x7ffa0c06bde0 2023-11-04T01:46:16.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0affd640 1 --2- 172.21.15.40:0/205350840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c0cbca0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009870 tx=0x7ff9fc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228a4373bc7c409d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa09ffb640 1 -- 172.21.15.40:0/205350840 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0ab600 con 0x7ffa0c06bde0 2023-11-04T01:46:16.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa09ffb640 1 -- 172.21.15.40:0/205350840 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0a7050 con 0x7ffa0c06bde0 2023-11-04T01:46:16.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa09ffb640 1 -- 172.21.15.40:0/205350840 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0ab980 con 0x7ffa0c06bde0 2023-11-04T01:46:16.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- 172.21.15.40:0/205350840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c06bde0 msgr2=0x7ffa0c0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 --2- 172.21.15.40:0/205350840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c0cbca0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009870 tx=0x7ff9fc01c540 comp rx=0 tx=0).stop 2023-11-04T01:46:16.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- 172.21.15.40:0/205350840 shutdown_connections 2023-11-04T01:46:16.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 --2- 172.21.15.40:0/205350840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c0c92b0 0x7ffa0c15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 --2- 172.21.15.40:0/205350840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c0cbca0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- 172.21.15.40:0/205350840 >> 172.21.15.40:0/205350840 conn(0x7ffa0c0b0890 msgr2=0x7ffa0c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- 172.21.15.40:0/205350840 shutdown_connections 2023-11-04T01:46:16.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- 172.21.15.40:0/205350840 wait complete. 2023-11-04T01:46:16.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 Processor -- start 2023-11-04T01:46:16.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- start start 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c13bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c06c1c0 0x7ffa0c0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 0x7ffa0c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0c5b50 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0c3b00 con 0x7ffa0c06bde0 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa1166f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0c4960 con 0x7ffa0c06c1c0 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 0x7ffa0c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 0x7ffa0c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57074/0 (socket says 172.21.15.40:57074) 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 -- 172.21.15.40:0/2239280432 learned_addr learned my addr 172.21.15.40:0/2239280432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0affd640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c13bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0a7fc640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c06c1c0 0x7ffa0c0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 -- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c06c1c0 msgr2=0x7ffa0c0c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c06c1c0 0x7ffa0c0c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 -- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa0c06bde0 msgr2=0x7ffa0c13bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c13bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 -- 172.21.15.40:0/2239280432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc0094d0 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ffa0b7fe640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 0x7ffa0c15ae20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c770 tx=0x7ffa0400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.740+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04003b80 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04003ce0 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0c3d50 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400aa90 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0c4310 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c04e4a0 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa0400abf0 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ff9f37fe640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff9f80664a0 0x7ff9f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7ffa04084370 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ffa0affd640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff9f80664a0 0x7ff9f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.744+0000 7ffa0affd640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff9f80664a0 0x7ff9f8068960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0ca7b0 tx=0x7ff9fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.748+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa04051160 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.904+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa0c0cc0a0 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ff9f37fe640 1 -- 172.21.15.40:0/2239280432 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+22634 (secure 0 0 0) 0x7ffa04054780 con 0x7ffa0c0c92b0 2023-11-04T01:46:16.910 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:16.910 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":104,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:46:13.094910+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/771372867":"2023-11-04T02:46:12.185534+0000","172.21.15.40:6834/2918977483":"2023-11-05T01:45:57.090700+0000","172.21.15.91:6836/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.40:6833/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6835/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6834/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6832/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.91:6837/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6835/2918977483":"2023-11-05T01:45:57.090700+0000","172.21.15.91:6836/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.91:6837/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.40:6835/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.40:6834/15089123":"2023-11-05T01:44:01.252782+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:46:16.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff9f80664a0 msgr2=0x7ff9f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff9f80664a0 0x7ff9f8068960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0ca7b0 tx=0x7ff9fc0a6000 comp rx=0 tx=0).stop 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 msgr2=0x7ffa0c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 0x7ffa0c15ae20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c770 tx=0x7ffa0400cc30 comp rx=0 tx=0).stop 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 shutdown_connections 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff9f80664a0 0x7ff9f8068960 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c0c92b0 0x7ffa0c15ae20 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ffa0c06c1c0 0x7ffa0c0c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 --2- 172.21.15.40:0/2239280432 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffa0c06bde0 0x7ffa0c13bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 >> 172.21.15.40:0/2239280432 conn(0x7ffa0c0b0890 msgr2=0x7ffa0c13d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 shutdown_connections 2023-11-04T01:46:16.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:16.908+0000 7ffa1166f640 1 -- 172.21.15.40:0/2239280432 wait complete. 2023-11-04T01:46:16.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:14.041287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:14.473992+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:46:16.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:46:17.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 Processor -- start 2023-11-04T01:46:17.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 -- start start 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 0x7f33880d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33880d1cb0 0x7f33880b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880d09b0 con 0x7f338815d5a0 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33880d0110 con 0x7f33880d1cb0 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338ffda640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33880d03f0 con 0x7f338815d1c0 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f338815d5a0 0x7f33880d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41256/0 (socket says 172.21.15.40:41256) 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 -- 172.21.15.40:0/1995142490 learned_addr learned my addr 172.21.15.40:0/1995142490 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338dd76640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 0x7f33880d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338e577640 1 --2- 172.21.15.40:0/1995142490 >> v2:172.21.15.91:3300/0 conn(0x7f33880d1cb0 0x7f33880b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766252935 0 0) 0x7f33880d09b0 con 0x7f338815d5a0 2023-11-04T01:46:17.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003530 con 0x7f338815d5a0 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1154129066 0 0) 0x7f3374003530 con 0x7f338815d5a0 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 msgr2=0x7f33880d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 0x7f33880d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 >> v2:172.21.15.91:3300/0 conn(0x7f33880d1cb0 msgr2=0x7f33880b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 --2- 172.21.15.40:0/1995142490 >> v2:172.21.15.91:3300/0 conn(0x7f33880d1cb0 0x7f33880b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880d06d0 con 0x7f338815d5a0 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3378001680 con 0x7f338815d5a0 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 >> v1:172.21.15.40:6789/0 conn(0x7f338815d5a0 legacy=0x7f33880d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 0x7f3374003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f33740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3374004d10 0x7f3374005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880d0110 con 0x7f3374003f00 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880d03f0 con 0x7f3374004d10 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337400b990 con 0x7f338815d1c0 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f33740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338e577640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3374004d10 0x7f3374005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338dd76640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 0x7f3374003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 -- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 msgr2=0x7f3374003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f338815d1c0 0x7f3374003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 -- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3374004d10 msgr2=0x7f3374005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3374004d10 0x7f3374005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.056+0000 7f338d575640 1 -- 172.21.15.40:0/1995142490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374003530 con 0x7f3374003f00 2023-11-04T01:46:17.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338d575640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f33740047d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f338815d9e0 tx=0x7f337801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73a4f4e6d73750a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378005ae0 con 0x7f3374003f00 2023-11-04T01:46:17.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780ab070 con 0x7f3374003f00 2023-11-04T01:46:17.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338cd74640 1 -- 172.21.15.40:0/1995142490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378005e80 con 0x7f3374003f00 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338ffda640 1 -- 172.21.15.40:0/1995142490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 msgr2=0x7f33740047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338ffda640 1 --2- 172.21.15.40:0/1995142490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f33740047d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f338815d9e0 tx=0x7f337801f3b0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338e577640 1 -- 172.21.15.40:0/1995142490 reap_dead start 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338ffda640 1 -- 172.21.15.40:0/1995142490 shutdown_connections 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338ffda640 1 -- 172.21.15.40:0/1995142490 >> 172.21.15.40:0/1995142490 conn(0x7f33880d2fc0 msgr2=0x7f33880d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338ffda640 1 -- 172.21.15.40:0/1995142490 shutdown_connections 2023-11-04T01:46:17.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.060+0000 7f338ffda640 1 -- 172.21.15.40:0/1995142490 wait complete. 2023-11-04T01:46:17.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 Processor -- start 2023-11-04T01:46:17.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- start start 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f3388150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33880b6620 0x7f33880b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33880b7de0 0x7f33880b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880b87b0 con 0x7f3374003f00 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880b76a0 con 0x7f33880b7de0 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33880cb5d0 con 0x7f33880b6620 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f3388150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f3388150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57086/0 (socket says 172.21.15.40:57086) 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 -- 172.21.15.40:0/1009833183 learned_addr learned my addr 172.21.15.40:0/1009833183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:17.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338d575640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33880b6620 0x7f33880b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338e577640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33880b7de0 0x7f33880b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 -- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33880b6620 msgr2=0x7f33880b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33880b6620 0x7f33880b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 -- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33880b7de0 msgr2=0x7f33880b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33880b7de0 0x7f33880b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 -- 172.21.15.40:0/1009833183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880b6b20 con 0x7f3374003f00 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338dd76640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f3388150590 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f33840115e0 tx=0x7f3384011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384015870 con 0x7f3374003f00 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840159d0 con 0x7f3374003f00 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33880b6e00 con 0x7f3374003f00 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384015d40 con 0x7f3374003f00 2023-11-04T01:46:17.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33880b73c0 con 0x7f3374003f00 2023-11-04T01:46:17.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33880d1520 con 0x7f3374003f00 2023-11-04T01:46:17.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f338400f480 con 0x7f3374003f00 2023-11-04T01:46:17.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f337e7fc640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f336c0664d0 0x7f336c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.064+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f3384084c20 con 0x7f3374003f00 2023-11-04T01:46:17.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.068+0000 7f338d575640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f336c0664d0 0x7f336c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.068+0000 7f338d575640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f336c0664d0 0x7f336c068990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f33780ae000 tx=0x7f3378001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.068+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3384051a10 con 0x7f3374003f00 2023-11-04T01:46:17.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f338804e4a0 con 0x7f3374003f00 2023-11-04T01:46:17.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f337e7fc640 1 -- 172.21.15.40:0/1009833183 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3384055030 con 0x7f3374003f00 2023-11-04T01:46:17.234 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:46:17.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f336c0664d0 msgr2=0x7f336c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f336c0664d0 0x7f336c068990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f33780ae000 tx=0x7f3378001a10 comp rx=0 tx=0).stop 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 msgr2=0x7f3388150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f3388150590 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f33840115e0 tx=0x7f3384011aa0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 shutdown_connections 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f336c0664d0 0x7f336c068990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33880b7de0 0x7f33880b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33880b6620 0x7f33880b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 --2- 172.21.15.40:0/1009833183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3374003f00 0x7f3388150590 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 >> 172.21.15.40:0/1009833183 conn(0x7f33880d2fc0 msgr2=0x7f338806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 shutdown_connections 2023-11-04T01:46:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.232+0000 7f338ffda640 1 -- 172.21.15.40:0/1009833183 wait complete. 2023-11-04T01:46:17.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:46:17.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 Processor -- start 2023-11-04T01:46:17.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 -- start start 2023-11-04T01:46:17.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f00ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00f00cd940 0x7f00f006a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f00716d0 con 0x7f00f015d4d0 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f0071ee0 con 0x7f00f00cd940 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f86f1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00cde00 con 0x7f00f015d0f0 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f6c8e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00f00cd940 0x7f00f006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f5c8c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f00f015d4d0 0x7f00f00aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53494/0 (socket says 172.21.15.40:53494) 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f5c8c640 1 -- 172.21.15.40:0/638952525 learned_addr learned my addr 172.21.15.40:0/638952525 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f648d640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f00ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f6c8e640 1 -- 172.21.15.40:0/638952525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 msgr2=0x7f00f00ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f6c8e640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f00ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f6c8e640 1 -- 172.21.15.40:0/638952525 >> v1:172.21.15.40:6789/0 conn(0x7f00f015d4d0 legacy=0x7f00f00aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f6c8e640 1 -- 172.21.15.40:0/638952525 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0071920 con 0x7f00f00cd940 2023-11-04T01:46:17.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.372+0000 7f00f648d640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f00ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:17.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f6c8e640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f00cd940 0x7f00f006a130 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df85da321b7d749 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f548b640 1 -- 172.21.15.40:0/638952525 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00ad640 con 0x7f00f00cd940 2023-11-04T01:46:17.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f548b640 1 -- 172.21.15.40:0/638952525 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e00ad7a0 con 0x7f00f00cd940 2023-11-04T01:46:17.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f548b640 1 -- 172.21.15.40:0/638952525 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00adb30 con 0x7f00f00cd940 2023-11-04T01:46:17.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 -- 172.21.15.40:0/638952525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f00cd940 msgr2=0x7f00f006a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f00cd940 0x7f00f006a130 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e001c480 comp rx=0 tx=0).stop 2023-11-04T01:46:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 -- 172.21.15.40:0/638952525 shutdown_connections 2023-11-04T01:46:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f00cd940 0x7f00f006a130 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 --2- 172.21.15.40:0/638952525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f00ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 -- 172.21.15.40:0/638952525 >> 172.21.15.40:0/638952525 conn(0x7f00f006b240 msgr2=0x7f00f006b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 -- 172.21.15.40:0/638952525 shutdown_connections 2023-11-04T01:46:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.376+0000 7f00f86f1640 1 -- 172.21.15.40:0/638952525 wait complete. 2023-11-04T01:46:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 Processor -- start 2023-11-04T01:46:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- start start 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00f00cd940 0x7f00f0158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f0158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 0x7f00f0159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00c3b20 con 0x7f00f015d4d0 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0158b50 con 0x7f00f00cd940 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f015a580 con 0x7f00f015d0f0 2023-11-04T01:46:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 0x7f00f0159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 0x7f00f0159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33780/0 (socket says 172.21.15.40:33780) 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 -- 172.21.15.40:0/2166262072 learned_addr learned my addr 172.21.15.40:0/2166262072 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f648d640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00f00cd940 0x7f00f0158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 -- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 msgr2=0x7f00f0158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f5c8c640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f0158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f0158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 -- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00f00cd940 msgr2=0x7f00f0158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00f00cd940 0x7f00f0158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 -- 172.21.15.40:0/2166262072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0009420 con 0x7f00f015d4d0 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f648d640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00f00cd940 0x7f00f0158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f6c8e640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 0x7f00f0159280 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00b6610 con 0x7f00f015d4d0 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e00a6040 con 0x7f00f015d4d0 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f00c61e0 con 0x7f00f015d4d0 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00b69b0 con 0x7f00f015d4d0 2023-11-04T01:46:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f00c67a0 con 0x7f00f015d4d0 2023-11-04T01:46:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.380+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f00b5cf0 con 0x7f00f015d4d0 2023-11-04T01:46:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.384+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00e00b4040 con 0x7f00f015d4d0 2023-11-04T01:46:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.384+0000 7f00eeffd640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00dc0664d0 0x7f00dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.384+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f00e011e770 con 0x7f00f015d4d0 2023-11-04T01:46:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.384+0000 7f00f648d640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00dc0664d0 0x7f00dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.384+0000 7f00f648d640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00dc0664d0 0x7f00dc068990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f00f015aad0 tx=0x7f00e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.388+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00e00eb4d0 con 0x7f00f015d4d0 2023-11-04T01:46:17.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.540+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f00f006e540 con 0x7f00f015d4d0 2023-11-04T01:46:17.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00eeffd640 1 -- 172.21.15.40:0/2166262072 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7f00e00eeaf0 con 0x7f00f015d4d0 2023-11-04T01:46:17.545 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:46:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00dc0664d0 msgr2=0x7f00dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00dc0664d0 0x7f00dc068990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f00f015aad0 tx=0x7f00e8008040 comp rx=0 tx=0).stop 2023-11-04T01:46:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 msgr2=0x7f00f0159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 0x7f00f0159280 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e0019220 comp rx=0 tx=0).stop 2023-11-04T01:46:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 shutdown_connections 2023-11-04T01:46:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f00dc0664d0 0x7f00dc068990 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f015d4d0 0x7f00f0159280 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f00f015d0f0 0x7f00f0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 --2- 172.21.15.40:0/2166262072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f00f00cd940 0x7f00f0158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 >> 172.21.15.40:0/2166262072 conn(0x7f00f006b240 msgr2=0x7f00f006d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 shutdown_connections 2023-11-04T01:46:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.544+0000 7f00f86f1640 1 -- 172.21.15.40:0/2166262072 wait complete. 2023-11-04T01:46:17.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:46:17.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f25dd640 1 Processor -- start 2023-11-04T01:46:17.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f25dd640 1 -- start start 2023-11-04T01:46:17.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f25dd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08ec15b120 0x7f08ec0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f25dd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ec15eca0 con 0x7f08ec0b2fb0 2023-11-04T01:46:17.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f25dd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ec15ef80 con 0x7f08ec0cff30 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f25dd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec15f260 con 0x7f08ec15b120 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f0b7a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f08ec0b2fb0 0x7f08ec0b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53508/0 (socket says 172.21.15.40:53508) 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f0b7a640 1 -- 172.21.15.40:0/2180186401 learned_addr learned my addr 172.21.15.40:0/2180186401 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08ebfff640 1 --2- 172.21.15.40:0/2180186401 >> v2:172.21.15.91:3300/0 conn(0x7f08ec15b120 0x7f08ec0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693781084 0 0) 0x7f08ec15eca0 con 0x7f08ec0b2fb0 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d8003530 con 0x7f08ec0b2fb0 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093453533 0 0) 0x7f08d8003530 con 0x7f08ec0b2fb0 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 >> v2:172.21.15.91:3300/0 conn(0x7f08ec15b120 msgr2=0x7f08ec0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 --2- 172.21.15.40:0/2180186401 >> v2:172.21.15.91:3300/0 conn(0x7f08ec15b120 0x7f08ec0d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 >> v1:172.21.15.91:6789/0 conn(0x7f08ec0cff30 legacy=0x7f08ec0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec15f540 con 0x7f08ec0b2fb0 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f08e4001680 con 0x7f08ec0b2fb0 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 >> v1:172.21.15.40:6789/0 conn(0x7f08ec0b2fb0 legacy=0x7f08ec0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d8003980 0x7f08d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08d8005190 0x7f08d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec15f260 con 0x7f08d80047d0 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d800c030 con 0x7f08d8005190 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d800c1f0 con 0x7f08d8003980 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eb7fe640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08ebfff640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d8003980 0x7f08d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f0b7a640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08d8005190 0x7f08d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eb7fe640 1 -- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d8003980 msgr2=0x7f08d8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eb7fe640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d8003980 0x7f08d8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eb7fe640 1 -- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08d8005190 msgr2=0x7f08d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:17.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eb7fe640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08d8005190 0x7f08d800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08eb7fe640 1 -- 172.21.15.40:0/2180186401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8003530 con 0x7f08d80047d0 2023-11-04T01:46:17.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.692+0000 7f08f0b7a640 1 -- 172.21.15.40:0/2180186401 reap_dead start 2023-11-04T01:46:17.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08eb7fe640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f08d4001e70 tx=0x7f08d401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a43639fd3b1a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4003b80 con 0x7f08d80047d0 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d4003ce0 con 0x7f08d80047d0 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08eaffd640 1 -- 172.21.15.40:0/2180186401 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40052c0 con 0x7f08d80047d0 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 -- 172.21.15.40:0/2180186401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08d80047d0 msgr2=0x7f08d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f08d4001e70 tx=0x7f08d401c740 comp rx=0 tx=0).stop 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 -- 172.21.15.40:0/2180186401 shutdown_connections 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2180186401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08d80047d0 0x7f08d8004c50 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 -- 172.21.15.40:0/2180186401 >> 172.21.15.40:0/2180186401 conn(0x7f08ec0cd8a0 msgr2=0x7f08ec0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 -- 172.21.15.40:0/2180186401 shutdown_connections 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 -- 172.21.15.40:0/2180186401 wait complete. 2023-11-04T01:46:17.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 Processor -- start 2023-11-04T01:46:17.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.696+0000 7f08f25dd640 1 -- start start 2023-11-04T01:46:17.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d80047d0 0x7f08ec0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08ec15b5b0 0x7f08ec15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 0x7f08ec0b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec15ba10 con 0x7f08ec0ca690 2023-11-04T01:46:17.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec155e70 con 0x7f08ec15b5b0 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec15d1d0 con 0x7f08d80047d0 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 0x7f08ec0b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 0x7f08ec0b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33804/0 (socket says 172.21.15.40:33804) 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 -- 172.21.15.40:0/2804716846 learned_addr learned my addr 172.21.15.40:0/2804716846 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08eb7fe640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08ec15b5b0 0x7f08ec15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08ebfff640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d80047d0 0x7f08ec0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 -- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d80047d0 msgr2=0x7f08ec0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d80047d0 0x7f08ec0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 -- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08ec15b5b0 msgr2=0x7f08ec15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08ec15b5b0 0x7f08ec15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 -- 172.21.15.40:0/2804716846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec15d4b0 con 0x7f08ec0ca690 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08ebfff640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d80047d0 0x7f08ec0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f0b7a640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 0x7f08ec0b20f0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0d1e80 tx=0x7f08e4011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400f840 con 0x7f08ec0ca690 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400fa00 con 0x7f08ec0ca690 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec15d790 con 0x7f08ec0ca690 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400fdb0 con 0x7f08ec0ca690 2023-11-04T01:46:17.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec0cab10 con 0x7f08ec0ca690 2023-11-04T01:46:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec15dc40 con 0x7f08ec0ca690 2023-11-04T01:46:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08e401f460 con 0x7f08ec0ca690 2023-11-04T01:46:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08e8ff9640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08cc0664d0 0x7f08cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f08e4087430 con 0x7f08ec0ca690 2023-11-04T01:46:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.700+0000 7f08ebfff640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08cc0664d0 0x7f08cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.704+0000 7f08ebfff640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08cc0664d0 0x7f08cc068990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009aa0 tx=0x7f08dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:17.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.704+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08e4054220 con 0x7f08ec0ca690 2023-11-04T01:46:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.860+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f08ec0cfb00 con 0x7f08ec0ca690 2023-11-04T01:46:17.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.860+0000 7f08e8ff9640 1 -- 172.21.15.40:0/2804716846 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08e4057840 con 0x7f08ec0ca690 2023-11-04T01:46:17.864 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08cc0664d0 msgr2=0x7f08cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08cc0664d0 0x7f08cc068990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009aa0 tx=0x7f08dc008040 comp rx=0 tx=0).stop 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 msgr2=0x7f08ec0b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 0x7f08ec0b20f0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0d1e80 tx=0x7f08e4011c20 comp rx=0 tx=0).stop 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 shutdown_connections 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f08cc0664d0 0x7f08cc068990 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08ec0ca690 0x7f08ec0b20f0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08ec15b5b0 0x7f08ec15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 --2- 172.21.15.40:0/2804716846 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f08d80047d0 0x7f08ec0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:17.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 >> 172.21.15.40:0/2804716846 conn(0x7f08ec0cd8a0 msgr2=0x7f08ec1598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 shutdown_connections 2023-11-04T01:46:17.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:17.864+0000 7f08f25dd640 1 -- 172.21.15.40:0/2804716846 wait complete. 2023-11-04T01:46:17.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:46:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda3a56640 1 Processor -- start 2023-11-04T01:46:18.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda3a56640 1 -- start start 2023-11-04T01:46:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda3a56640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdd9c15d3e0 0x7fdd9c160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda3a56640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0d0b30 con 0x7fdd9c06c780 2023-11-04T01:46:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda3a56640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0ceb90 con 0x7fdd9c0b2fb0 2023-11-04T01:46:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda3a56640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c0cee70 con 0x7fdd9c15d3e0 2023-11-04T01:46:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdd9c06c780 0x7fdd9c0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53516/0 (socket says 172.21.15.40:53516) 2023-11-04T01:46:18.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 -- 172.21.15.40:0/14267878 learned_addr learned my addr 172.21.15.40:0/14267878 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697034861 0 0) 0x7fdd9c0d0b30 con 0x7fdd9c06c780 2023-11-04T01:46:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda17f2640 1 --2- 172.21.15.40:0/14267878 >> v2:172.21.15.91:3300/0 conn(0x7fdd9c15d3e0 0x7fdd9c160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd88003530 con 0x7fdd9c06c780 2023-11-04T01:46:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481108481 0 0) 0x7fdd88003530 con 0x7fdd9c06c780 2023-11-04T01:46:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 >> v2:172.21.15.91:3300/0 conn(0x7fdd9c15d3e0 msgr2=0x7fdd9c160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 --2- 172.21.15.40:0/14267878 >> v2:172.21.15.91:3300/0 conn(0x7fdd9c15d3e0 0x7fdd9c160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 >> v1:172.21.15.91:6789/0 conn(0x7fdd9c0b2fb0 legacy=0x7fdd9c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0d0850 con 0x7fdd9c06c780 2023-11-04T01:46:18.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fdd90001680 con 0x7fdd9c06c780 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 >> v1:172.21.15.40:6789/0 conn(0x7fdd9c06c780 legacy=0x7fdd9c0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd88003980 0x7fdd88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd88005190 0x7fdd8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0cee70 con 0x7fdd880047d0 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8800c030 con 0x7fdd88005190 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8800c1f0 con 0x7fdd88003980 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda1ff3640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd88005190 0x7fdd8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda17f2640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd88003980 0x7fdd88003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 -- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd88003980 msgr2=0x7fdd88003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd88003980 0x7fdd88003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 -- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd88005190 msgr2=0x7fdd8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd88005190 0x7fdd8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda0ff1640 1 -- 172.21.15.40:0/14267878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88003530 con 0x7fdd880047d0 2023-11-04T01:46:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda1ff3640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd88005190 0x7fdd8800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:18.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.016+0000 7fdda1ff3640 1 -- 172.21.15.40:0/14267878 reap_dead start 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd88004c50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c240 tx=0x7fdd9001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b2ecd6a8ee4b5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90005ae0 con 0x7fdd880047d0 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd900ab070 con 0x7fdd880047d0 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdd8ffff640 1 -- 172.21.15.40:0/14267878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90005ea0 con 0x7fdd880047d0 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 -- 172.21.15.40:0/14267878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 msgr2=0x7fdd88004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd88004c50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c240 tx=0x7fdd9001f3b0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 -- 172.21.15.40:0/14267878 shutdown_connections 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 --2- 172.21.15.40:0/14267878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd88004c50 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 -- 172.21.15.40:0/14267878 >> 172.21.15.40:0/14267878 conn(0x7fdd9c0cd8a0 msgr2=0x7fdd9c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 -- 172.21.15.40:0/14267878 shutdown_connections 2023-11-04T01:46:18.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 -- 172.21.15.40:0/14267878 wait complete. 2023-11-04T01:46:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 Processor -- start 2023-11-04T01:46:18.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.020+0000 7fdda3a56640 1 -- start start 2023-11-04T01:46:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd9c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd9c15b400 0x7fdd9c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd9c0ccc40 0x7fdd9c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0ca400 con 0x7fdd880047d0 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c97f0 con 0x7fdd9c15b400 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c9ad0 con 0x7fdd9c0ccc40 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd9c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd9c0ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33822/0 (socket says 172.21.15.40:33822) 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 -- 172.21.15.40:0/3860368369 learned_addr learned my addr 172.21.15.40:0/3860368369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd9c15b400 0x7fdd9c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda1ff3640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd9c0ccc40 0x7fdd9c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 -- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd9c0ccc40 msgr2=0x7fdd9c0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd9c0ccc40 0x7fdd9c0ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 -- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd9c15b400 msgr2=0x7fdd9c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd9c15b400 0x7fdd9c1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 -- 172.21.15.40:0/3860368369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0c9db0 con 0x7fdd880047d0 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda1ff3640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd9c0ccc40 0x7fdd9c0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda17f2640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd9c0ca890 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fdd98011660 tx=0x7fdd98011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800f9c0 con 0x7fdd880047d0 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800fb20 con 0x7fdd880047d0 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c0ca090 con 0x7fdd880047d0 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800fe90 con 0x7fdd880047d0 2023-11-04T01:46:18.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c0c94e0 con 0x7fdd880047d0 2023-11-04T01:46:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c0b35b0 con 0x7fdd880047d0 2023-11-04T01:46:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd98015460 con 0x7fdd880047d0 2023-11-04T01:46:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdd8dffb640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdd800664d0 0x7fdd80068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7fdd98084e90 con 0x7fdd880047d0 2023-11-04T01:46:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.024+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdd800664d0 0x7fdd80068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.028+0000 7fdda0ff1640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdd800664d0 0x7fdd80068990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdd900af000 tx=0x7fdd900aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.028+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd98051d30 con 0x7fdd880047d0 2023-11-04T01:46:18.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.184+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fdd9c0b6d80 con 0x7fdd880047d0 2023-11-04T01:46:18.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdd8dffb640 1 -- 172.21.15.40:0/3860368369 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v104) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdd98055350 con 0x7fdd880047d0 2023-11-04T01:46:18.189 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:46:18.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdd800664d0 msgr2=0x7fdd80068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdd800664d0 0x7fdd80068990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdd900af000 tx=0x7fdd900aa000 comp rx=0 tx=0).stop 2023-11-04T01:46:18.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 msgr2=0x7fdd9c0ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd9c0ca890 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fdd98011660 tx=0x7fdd98011b20 comp rx=0 tx=0).stop 2023-11-04T01:46:18.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 shutdown_connections 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdd800664d0 0x7fdd80068990 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdd9c0ccc40 0x7fdd9c0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdd9c15b400 0x7fdd9c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 --2- 172.21.15.40:0/3860368369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd880047d0 0x7fdd9c0ca890 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 >> 172.21.15.40:0/3860368369 conn(0x7fdd9c0cd8a0 msgr2=0x7fdd9c06f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 shutdown_connections 2023-11-04T01:46:18.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.188+0000 7fdda3a56640 1 -- 172.21.15.40:0/3860368369 wait complete. 2023-11-04T01:46:18.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:46:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.336+0000 7fbc7ad8a640 1 Processor -- start 2023-11-04T01:46:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.336+0000 7fbc7ad8a640 1 -- start start 2023-11-04T01:46:18.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbc74159720 0x7fbc740c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc740cf830 0x7fbc740af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc740afa50 con 0x7fbc740af640 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc740ca5a0 con 0x7fbc740cf830 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc740c9d40 con 0x7fbc74159720 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc740cf830 0x7fbc740af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc740cf830 0x7fbc740af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33834/0 (socket says 172.21.15.40:33834) 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 -- 172.21.15.40:0/1425273515 learned_addr learned my addr 172.21.15.40:0/1425273515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 -- 172.21.15.40:0/1425273515 >> v2:172.21.15.91:3300/0 conn(0x7fbc74159720 msgr2=0x7fbc740c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 --2- 172.21.15.40:0/1425273515 >> v2:172.21.15.91:3300/0 conn(0x7fbc74159720 0x7fbc740c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 -- 172.21.15.40:0/1425273515 >> v1:172.21.15.91:6789/0 conn(0x7fbc740af640 legacy=0x7fbc740cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 -- 172.21.15.40:0/1425273515 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740c9fe0 con 0x7fbc740cf830 2023-11-04T01:46:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc73fff640 1 --2- 172.21.15.40:0/1425273515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc740cf830 0x7fbc740af100 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406f530 tx=0x7fbc6801d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a4c7ee35f33868 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc737fe640 1 -- 172.21.15.40:0/1425273515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680ab670 con 0x7fbc740cf830 2023-11-04T01:46:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc737fe640 1 -- 172.21.15.40:0/1425273515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc680ab7d0 con 0x7fbc740cf830 2023-11-04T01:46:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc737fe640 1 -- 172.21.15.40:0/1425273515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680abb60 con 0x7fbc740cf830 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/1425273515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc740cf830 msgr2=0x7fbc740af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/1425273515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc740cf830 0x7fbc740af100 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbc7406f530 tx=0x7fbc6801d5a0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/1425273515 shutdown_connections 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/1425273515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc740cf830 0x7fbc740af100 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/1425273515 >> v2:172.21.15.91:3300/0 conn(0x7fbc74159720 0x7fbc740c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/1425273515 >> 172.21.15.40:0/1425273515 conn(0x7fbc740ced10 msgr2=0x7fbc740cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/1425273515 shutdown_connections 2023-11-04T01:46:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.340+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/1425273515 wait complete. 2023-11-04T01:46:18.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 Processor -- start 2023-11-04T01:46:18.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- start start 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc740af640 0x7fbc740c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc740cf830 0x7fbc7406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 0x7fbc741f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740c5de0 con 0x7fbc74159720 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc741fa050 con 0x7fbc740af640 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7415a530 con 0x7fbc740cf830 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 0x7fbc741f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 0x7fbc741f91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33848/0 (socket says 172.21.15.40:33848) 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 -- 172.21.15.40:0/3639455080 learned_addr learned my addr 172.21.15.40:0/3639455080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc78b26640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc740af640 0x7fbc740c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 -- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc740cf830 msgr2=0x7fbc7406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc740cf830 0x7fbc7406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 -- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc740af640 msgr2=0x7fbc740c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc740af640 0x7fbc740c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 -- 172.21.15.40:0/3639455080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680094d0 con 0x7fbc74159720 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc78b26640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc740af640 0x7fbc740c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc79327640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 0x7fbc741f91f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00b410 tx=0x7fbc6c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c011830 con 0x7fbc74159720 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c011990 con 0x7fbc74159720 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc740c5ff0 con 0x7fbc74159720 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c011d40 con 0x7fbc74159720 2023-11-04T01:46:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc740c65b0 con 0x7fbc74159720 2023-11-04T01:46:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.344+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7404e4a0 con 0x7fbc74159720 2023-11-04T01:46:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.348+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc6c01a400 con 0x7fbc74159720 2023-11-04T01:46:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.348+0000 7fbc717fa640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc600664a0 0x7fbc60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.348+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7fbc6c084c20 con 0x7fbc74159720 2023-11-04T01:46:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.348+0000 7fbc78b26640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc600664a0 0x7fbc60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.348+0000 7fbc78b26640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc600664a0 0x7fbc60068960 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007eb0 tx=0x7fbc640073c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.352+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc6c084e60 con 0x7fbc74159720 2023-11-04T01:46:18.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.504+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc740c2620 con 0x7fbc74159720 2023-11-04T01:46:18.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.504+0000 7fbc717fa640 1 -- 172.21.15.40:0/3639455080 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc6c0150a0 con 0x7fbc74159720 2023-11-04T01:46:18.507 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc600664a0 msgr2=0x7fbc60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc600664a0 0x7fbc60068960 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007eb0 tx=0x7fbc640073c0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 msgr2=0x7fbc741f91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 0x7fbc741f91f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00b410 tx=0x7fbc6c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 shutdown_connections 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbc600664a0 0x7fbc60068960 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc74159720 0x7fbc741f91f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbc740cf830 0x7fbc7406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 --2- 172.21.15.40:0/3639455080 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbc740af640 0x7fbc740c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 >> 172.21.15.40:0/3639455080 conn(0x7fbc740ced10 msgr2=0x7fbc74158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 shutdown_connections 2023-11-04T01:46:18.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.508+0000 7fbc7ad8a640 1 -- 172.21.15.40:0/3639455080 wait complete. 2023-11-04T01:46:18.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:46:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.632+0000 7f96fe546640 1 Processor -- start 2023-11-04T01:46:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.632+0000 7f96fe546640 1 -- start start 2023-11-04T01:46:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f96f815d1c0 0x7f96f80d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96f815d5a0 0x7f96f80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f80d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f80d09b0 con 0x7f96f815d5a0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f80d0110 con 0x7f96f815d1c0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80d03f0 con 0x7f96f80b1ec0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96f815d5a0 0x7f96f80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96f815d5a0 0x7f96f80d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33854/0 (socket says 172.21.15.40:33854) 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 -- 172.21.15.40:0/2251791345 learned_addr learned my addr 172.21.15.40:0/2251791345 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96f7fff640 1 --2- 172.21.15.40:0/2251791345 >> v2:172.21.15.91:3300/0 conn(0x7f96f815d1c0 0x7f96f80d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fcae3640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f80d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 -- 172.21.15.40:0/2251791345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 msgr2=0x7f96f80d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f80d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 -- 172.21.15.40:0/2251791345 >> v2:172.21.15.91:3300/0 conn(0x7f96f815d1c0 msgr2=0x7f96f80d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 --2- 172.21.15.40:0/2251791345 >> v2:172.21.15.91:3300/0 conn(0x7f96f815d1c0 0x7f96f80d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 -- 172.21.15.40:0/2251791345 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f80d06d0 con 0x7f96f815d5a0 2023-11-04T01:46:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fcae3640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f80d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:18.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96effff640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f80d15a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f96f80b5bb0 tx=0x7f96e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc3813151a38131 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96f77fe640 1 -- 172.21.15.40:0/2251791345 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00ab600 con 0x7f96f815d5a0 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96f77fe640 1 -- 172.21.15.40:0/2251791345 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00a7050 con 0x7f96f815d5a0 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96f77fe640 1 -- 172.21.15.40:0/2251791345 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00ab980 con 0x7f96f815d5a0 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- 172.21.15.40:0/2251791345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 msgr2=0x7f96f80d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f80d15a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f96f80b5bb0 tx=0x7f96e001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- 172.21.15.40:0/2251791345 shutdown_connections 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f80d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- 172.21.15.40:0/2251791345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f80d15a0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 --2- 172.21.15.40:0/2251791345 >> v2:172.21.15.91:3300/0 conn(0x7f96f815d1c0 0x7f96f80d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- 172.21.15.40:0/2251791345 >> 172.21.15.40:0/2251791345 conn(0x7f96f80d2fc0 msgr2=0x7f96f80d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- 172.21.15.40:0/2251791345 shutdown_connections 2023-11-04T01:46:18.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.636+0000 7f96fe546640 1 -- 172.21.15.40:0/2251791345 wait complete. 2023-11-04T01:46:18.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 Processor -- start 2023-11-04T01:46:18.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- start start 2023-11-04T01:46:18.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f8151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96f815d1c0 0x7f96f815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f815c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8152770 con 0x7f96f815d5a0 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f81518b0 con 0x7f96f815d1c0 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8152280 con 0x7f96f80b1ec0 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f815c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33860/0 (socket says 172.21.15.40:33860) 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 -- 172.21.15.40:0/522915668 learned_addr learned my addr 172.21.15.40:0/522915668 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 -- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 msgr2=0x7f96f8151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f8151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 -- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96f815d1c0 msgr2=0x7f96f815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96f815d1c0 0x7f96f815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 -- 172.21.15.40:0/522915668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00094d0 con 0x7f96f815d5a0 2023-11-04T01:46:18.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fcae3640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f815c450 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f96f000ce20 tx=0x7f96f000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0003ba0 con 0x7f96f815d5a0 2023-11-04T01:46:18.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f0003d20 con 0x7f96f815d5a0 2023-11-04T01:46:18.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f8150f80 con 0x7f96f815d5a0 2023-11-04T01:46:18.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000d880 con 0x7f96f815d5a0 2023-11-04T01:46:18.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f8151540 con 0x7f96f815d5a0 2023-11-04T01:46:18.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.640+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f80d3eb0 con 0x7f96f815d5a0 2023-11-04T01:46:18.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.644+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96f000d9e0 con 0x7f96f815d5a0 2023-11-04T01:46:18.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.644+0000 7f96f57fa640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96d80664a0 0x7f96d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.644+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f96f0084d80 con 0x7f96f815d5a0 2023-11-04T01:46:18.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.644+0000 7f96f7fff640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96d80664a0 0x7f96d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.644+0000 7f96f7fff640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96d80664a0 0x7f96d8068960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f96f80b47a0 tx=0x7f96e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.648+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96f0051b70 con 0x7f96f815d5a0 2023-11-04T01:46:18.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.800+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96f804e4a0 con 0x7f96f815d5a0 2023-11-04T01:46:18.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96f57fa640 1 -- 172.21.15.40:0/522915668 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96f0055190 con 0x7f96f815d5a0 2023-11-04T01:46:18.806 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96d80664a0 msgr2=0x7f96d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96d80664a0 0x7f96d8068960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f96f80b47a0 tx=0x7f96e8008040 comp rx=0 tx=0).stop 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 msgr2=0x7f96f815c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f815c450 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f96f000ce20 tx=0x7f96f000a710 comp rx=0 tx=0).stop 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 shutdown_connections 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f96d80664a0 0x7f96d8068960 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96f815d5a0 0x7f96f815c450 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f96f815d1c0 0x7f96f815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 --2- 172.21.15.40:0/522915668 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f96f80b1ec0 0x7f96f8151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 >> 172.21.15.40:0/522915668 conn(0x7f96f80d2fc0 msgr2=0x7f96f80b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 shutdown_connections 2023-11-04T01:46:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.804+0000 7f96fe546640 1 -- 172.21.15.40:0/522915668 wait complete. 2023-11-04T01:46:18.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:46:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 Processor -- start 2023-11-04T01:46:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 -- start start 2023-11-04T01:46:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080cde70 0x7fd90806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9080ce920 0x7fd9080cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080cedb0 con 0x7fd90815d0e0 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9080b0420 con 0x7fd9080ce920 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd90df5b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd908160cf0 con 0x7fd9080cde70 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9080ce920 0x7fd9080cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9080ce920 0x7fd9080cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33868/0 (socket says 172.21.15.40:33868) 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 -- 172.21.15.40:0/573037415 learned_addr learned my addr 172.21.15.40:0/573037415 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd906ffd640 1 --2- 172.21.15.40:0/573037415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080cde70 0x7fd90806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 -- 172.21.15.40:0/573037415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080cde70 msgr2=0x7fd90806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 --2- 172.21.15.40:0/573037415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080cde70 0x7fd90806e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 -- 172.21.15.40:0/573037415 >> v1:172.21.15.91:6789/0 conn(0x7fd90815d0e0 legacy=0x7fd9080cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.936+0000 7fd907fff640 1 -- 172.21.15.40:0/573037415 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908160fd0 con 0x7fd9080ce920 2023-11-04T01:46:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd907fff640 1 --2- 172.21.15.40:0/573037415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080ce920 0x7fd9080cb430 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009870 tx=0x7fd8f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621e0913bb554706 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd9067fc640 1 -- 172.21.15.40:0/573037415 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80aa5f0 con 0x7fd9080ce920 2023-11-04T01:46:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd9067fc640 1 -- 172.21.15.40:0/573037415 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f80aa750 con 0x7fd9080ce920 2023-11-04T01:46:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd9067fc640 1 -- 172.21.15.40:0/573037415 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80aaae0 con 0x7fd9080ce920 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- 172.21.15.40:0/573037415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080ce920 msgr2=0x7fd9080cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 --2- 172.21.15.40:0/573037415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080ce920 0x7fd9080cb430 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009870 tx=0x7fd8f801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- 172.21.15.40:0/573037415 shutdown_connections 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 --2- 172.21.15.40:0/573037415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080ce920 0x7fd9080cb430 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 --2- 172.21.15.40:0/573037415 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080cde70 0x7fd90806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- 172.21.15.40:0/573037415 >> 172.21.15.40:0/573037415 conn(0x7fd90806a130 msgr2=0x7fd90806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- 172.21.15.40:0/573037415 shutdown_connections 2023-11-04T01:46:18.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- 172.21.15.40:0/573037415 wait complete. 2023-11-04T01:46:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 Processor -- start 2023-11-04T01:46:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- start start 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 0x7fd908155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080ce920 0x7fd90815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd90815d0e0 0x7fd9080c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90815bb40 con 0x7fd9080cde70 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b4e10 con 0x7fd90815d0e0 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.940+0000 7fd90df5b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90815b580 con 0x7fd9080ce920 2023-11-04T01:46:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 0x7fd908155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 0x7fd908155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33882/0 (socket says 172.21.15.40:33882) 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 -- 172.21.15.40:0/983174431 learned_addr learned my addr 172.21.15.40:0/983174431 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd906ffd640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080ce920 0x7fd90815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 -- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080ce920 msgr2=0x7fd90815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd907fff640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd90815d0e0 0x7fd9080c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080ce920 0x7fd90815abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 -- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd90815d0e0 msgr2=0x7fd9080c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd90815d0e0 0x7fd9080c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 -- 172.21.15.40:0/983174431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80094d0 con 0x7fd9080cde70 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd9077fe640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 0x7fd908155270 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b440 tx=0x7fd90000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900011890 con 0x7fd9080cde70 2023-11-04T01:46:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9000119f0 con 0x7fd9080cde70 2023-11-04T01:46:18.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90815b860 con 0x7fd9080cde70 2023-11-04T01:46:18.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900011da0 con 0x7fd9080cde70 2023-11-04T01:46:18.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9081557b0 con 0x7fd9080cde70 2023-11-04T01:46:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd908067610 con 0x7fd9080cde70 2023-11-04T01:46:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd90001a400 con 0x7fd9080cde70 2023-11-04T01:46:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd8fffff640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ec0664a0 0x7fd8ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7fd9000844f0 con 0x7fd9080cde70 2023-11-04T01:46:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd906ffd640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ec0664a0 0x7fd8ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.944+0000 7fd906ffd640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ec0664a0 0x7fd8ec068960 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd908156790 tx=0x7fd8f0008440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:18.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:18.948+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd900051370 con 0x7fd9080cde70 2023-11-04T01:46:19.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.112+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd90806e230 con 0x7fd9080cde70 2023-11-04T01:46:19.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.112+0000 7fd8fffff640 1 -- 172.21.15.40:0/983174431 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v104) v1 ==== 81+0+782 (secure 0 0 0) 0x7fd900054990 con 0x7fd9080cde70 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/771372867 2023-11-04T02:46:12.185534+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:46:19.116 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:46:19.117 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:46:19.117 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:46:19.117 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:46:19.117 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:46:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:listed 13 entries 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ec0664a0 msgr2=0x7fd8ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ec0664a0 0x7fd8ec068960 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd908156790 tx=0x7fd8f0008440 comp rx=0 tx=0).stop 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 msgr2=0x7fd908155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 0x7fd908155270 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b440 tx=0x7fd90000b900 comp rx=0 tx=0).stop 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 shutdown_connections 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8ec0664a0 0x7fd8ec068960 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd90815d0e0 0x7fd9080c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9080ce920 0x7fd90815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 --2- 172.21.15.40:0/983174431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9080cde70 0x7fd908155270 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 >> 172.21.15.40:0/983174431 conn(0x7fd90806a130 msgr2=0x7fd90806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 shutdown_connections 2023-11-04T01:46:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.116+0000 7fd90df5b640 1 -- 172.21.15.40:0/983174431 wait complete. 2023-11-04T01:46:19.133 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:46:19.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:mkdir: cannot create directory 'd1/dir/.snap/s22': Software caused connection abort 2023-11-04T01:46:19.158 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:46:19.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.158 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:46:19.206 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:46:19.206 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:46:19.253 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:46:19.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:46:19.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.420+0000 7f317e603640 1 Processor -- start 2023-11-04T01:46:19.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.420+0000 7f317e603640 1 -- start start 2023-11-04T01:46:19.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317e603640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3178142ad0 0x7f317815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317e603640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31780ca100 con 0x7f31780cbd80 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317e603640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31780ca3e0 con 0x7f3178142eb0 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317e603640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31780ca6c0 con 0x7f3178142ad0 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317cba0640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31780cbd80 0x7f31780c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53522/0 (socket says 172.21.15.40:53522) 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317cba0640 1 -- 172.21.15.40:0/2666587694 learned_addr learned my addr 172.21.15.40:0/2666587694 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f3177fff640 1 --2- 172.21.15.40:0/2666587694 >> v2:172.21.15.91:3300/0 conn(0x7f3178142ad0 0x7f317815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701024071 0 0) 0x7f31780ca100 con 0x7f31780cbd80 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3164003530 con 0x7f31780cbd80 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091751799 0 0) 0x7f3164003530 con 0x7f31780cbd80 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 >> v2:172.21.15.91:3300/0 conn(0x7f3178142ad0 msgr2=0x7f317815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 --2- 172.21.15.40:0/2666587694 >> v2:172.21.15.91:3300/0 conn(0x7f3178142ad0 0x7f317815e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 >> v1:172.21.15.91:6789/0 conn(0x7f3178142eb0 legacy=0x7f31780cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780ca9a0 con 0x7f31780cbd80 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3170001a00 con 0x7f31780cbd80 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 >> v1:172.21.15.40:6789/0 conn(0x7f31780cbd80 legacy=0x7f31780c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3164003980 0x7f3164003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31640047d0 0x7f3164004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640052b0 0x7f316400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780ca6c0 con 0x7f31640047d0 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316400c180 con 0x7f31640052b0 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316400c340 con 0x7f3164003980 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f3177fff640 1 --2- 172.21.15.40:0/2666587694 >> v2:172.21.15.91:3300/0 conn(0x7f3178142ad0 0x7f317815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31640047d0 0x7f3164004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317cba0640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640052b0 0x7f316400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f3177fff640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3164003980 0x7f3164003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 -- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3164003980 msgr2=0x7f3164003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3164003980 0x7f3164003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 -- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640052b0 msgr2=0x7f316400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640052b0 0x7f316400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 -- 172.21.15.40:0/2666587694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164003530 con 0x7f31640047d0 2023-11-04T01:46:19.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f317cba0640 1 -- 172.21.15.40:0/2666587694 reap_dead start 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.424+0000 7f316ffff640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31640047d0 0x7f3164004c50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3168001750 tx=0x7f316801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58568eae5409eb27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680052d0 con 0x7f31640047d0 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31680a7050 con 0x7f31640047d0 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f31777fe640 1 -- 172.21.15.40:0/2666587694 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168003600 con 0x7f31640047d0 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/2666587694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31640047d0 msgr2=0x7f3164004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31640047d0 0x7f3164004c50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3168001750 tx=0x7f316801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/2666587694 shutdown_connections 2023-11-04T01:46:19.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 --2- 172.21.15.40:0/2666587694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31640047d0 0x7f3164004c50 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/2666587694 >> 172.21.15.40:0/2666587694 conn(0x7f31780b0890 msgr2=0x7f31780b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/2666587694 shutdown_connections 2023-11-04T01:46:19.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/2666587694 wait complete. 2023-11-04T01:46:19.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 Processor -- start 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- start start 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640047d0 0x7f31780b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3178159980 0x7f31780c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 0x7f317813e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317813e8e0 con 0x7f317813df20 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780b23e0 con 0x7f31640047d0 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31780c85d0 con 0x7f3178159980 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 0x7f317813e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 0x7f317813e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33900/0 (socket says 172.21.15.40:33900) 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 -- 172.21.15.40:0/231297233 learned_addr learned my addr 172.21.15.40:0/231297233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f3177fff640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640047d0 0x7f31780b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f316ffff640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3178159980 0x7f31780c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 -- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3178159980 msgr2=0x7f31780c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3178159980 0x7f31780c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 -- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640047d0 msgr2=0x7f31780b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640047d0 0x7f31780b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 -- 172.21.15.40:0/231297233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780b4780 con 0x7f317813df20 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f3177fff640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640047d0 0x7f31780b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f316ffff640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3178159980 0x7f31780c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317cba0640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 0x7f317813e3a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f31780ce410 tx=0x7f317000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000eab0 con 0x7f317813df20 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317000ec10 con 0x7f317813df20 2023-11-04T01:46:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780b1ab0 con 0x7f317813df20 2023-11-04T01:46:19.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170014430 con 0x7f317813df20 2023-11-04T01:46:19.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.428+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31780b2070 con 0x7f317813df20 2023-11-04T01:46:19.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.432+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317804e4a0 con 0x7f317813df20 2023-11-04T01:46:19.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.432+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3170014590 con 0x7f317813df20 2023-11-04T01:46:19.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.432+0000 7f31757fa640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31580664d0 0x7f3158068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.432+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7388+0+0 (secure 0 0 0) 0x7f3170084170 con 0x7f317813df20 2023-11-04T01:46:19.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.432+0000 7f3177fff640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31580664d0 0x7f3158068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.432+0000 7f3177fff640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31580664d0 0x7f3158068990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f31780c8dd0 tx=0x7f3160008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.436+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31700549e0 con 0x7f317813df20 2023-11-04T01:46:19.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.628+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f317806d010 con 0x7f317813df20 2023-11-04T01:46:19.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.628+0000 7f31757fa640 1 -- 172.21.15.40:0/231297233 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3170054570 con 0x7f317813df20 2023-11-04T01:46:19.631 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:46:19.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.628+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31580664d0 msgr2=0x7f3158068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.628+0000 7f317e603640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31580664d0 0x7f3158068990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f31780c8dd0 tx=0x7f3160008040 comp rx=0 tx=0).stop 2023-11-04T01:46:19.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.628+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 msgr2=0x7f317813e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.628+0000 7f317e603640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 0x7f317813e3a0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f31780ce410 tx=0x7f317000e530 comp rx=0 tx=0).stop 2023-11-04T01:46:19.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 shutdown_connections 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31580664d0 0x7f3158068990 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317813df20 0x7f317813e3a0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3178159980 0x7f31780c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 --2- 172.21.15.40:0/231297233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31640047d0 0x7f31780b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 >> 172.21.15.40:0/231297233 conn(0x7f31780b0890 msgr2=0x7f31780c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 shutdown_connections 2023-11-04T01:46:19.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:19.632+0000 7f317e603640 1 -- 172.21.15.40:0/231297233 wait complete. 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:46:19.650 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:46:19.651 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:19.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.651 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 41894sec preferred_lft 41894sec 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:46:19.659 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:19.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.660 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:46:19.711 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:46:19.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.712 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:46:19.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.759 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:46:19.760 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:46:19.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:46:19.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:46:19.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:46:19.760 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:46:19.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.835 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:46:19.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:46:19.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:46:19.882 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:19.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:19.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:46:19.938 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:46:19.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:46:19.939 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:19.986 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:19.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:46:19.986 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:20.033 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:46:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:46:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:46:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:46:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:20.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:20.086 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:46:20.134 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:46:20.135 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:46:20.183 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:46:20.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:46:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:20.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:46:20.190 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:46:20.190 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:46:20.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:46:20.192 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:46:20.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:20.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:20.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:20.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:20.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:20.194 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:46:20.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:46:20.272+0000 7f55440ed580 -1 init, newargv = 0x561a84b48ce0 newargc=15 2023-11-04T01:46:20.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[58982]: starting ceph client 2023-11-04T01:46:20.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[58982]: starting fuse 2023-11-04T01:46:20.568 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:46:20.564+0000 7f7388ff9640 -1 client.7293 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:46:20.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[55853]: fuse finished with error 0 and tester_r 0 2023-11-04T01:46:20.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:46:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:21.347 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:46:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:46:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:46:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:21.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:21.360 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:46:21.406 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:46:21.406 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:46:21.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:46:21.406 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:46:21.406 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:46:21.406 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:46:21.406 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:46:21.407 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:46:21.408 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:46:21.534 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.58982.asok 2023-11-04T01:46:21.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:21.546 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58982.asok 2023-11-04T01:46:21.546 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:46:21.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.58982.asok status 2023-11-04T01:46:21.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "58982", 2023-11-04T01:46:21.749 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 8118, 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 8118 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:46:21.750 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2884841846 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2884841846 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.8118 192.168.0.1:0/2884841846", 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2884841846", 2023-11-04T01:46:21.751 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:46:21.752 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 96, 2023-11-04T01:46:21.752 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 105, 2023-11-04T01:46:21.752 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:46:21.752 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:46:21.752 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:46:21.752 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:46:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:21.770 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:46:21.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:46:21.770 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:21.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:21.817 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:46:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:21.824 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:21.824 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:46:21.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:21.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:21.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:21.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:46:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 Processor -- start 2023-11-04T01:46:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 -- start start 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef015d410 0x7fbef00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbef00caaa0 0x7fbef00c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbef00c98a0 0x7fbef0070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef006fe50 con 0x7fbef00c98a0 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef00aef20 con 0x7fbef00caaa0 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef7200640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c9d30 con 0x7fbef015d410 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbef00c98a0 0x7fbef0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbef00c98a0 0x7fbef0070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33904/0 (socket says 172.21.15.40:33904) 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 -- 172.21.15.40:0/2569180748 learned_addr learned my addr 172.21.15.40:0/2569180748 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbeeffff640 1 --2- 172.21.15.40:0/2569180748 >> v2:172.21.15.91:3300/0 conn(0x7fbef00caaa0 0x7fbef00c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/2569180748 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef015d410 0x7fbef00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 -- 172.21.15.40:0/2569180748 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef015d410 msgr2=0x7fbef00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 --2- 172.21.15.40:0/2569180748 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef015d410 0x7fbef00b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 -- 172.21.15.40:0/2569180748 >> v2:172.21.15.91:3300/0 conn(0x7fbef00caaa0 msgr2=0x7fbef00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 --2- 172.21.15.40:0/2569180748 >> v2:172.21.15.91:3300/0 conn(0x7fbef00caaa0 0x7fbef00c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.056+0000 7fbef579d640 1 -- 172.21.15.40:0/2569180748 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00ccdf0 con 0x7fbef00c98a0 2023-11-04T01:46:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef579d640 1 --2- 172.21.15.40:0/2569180748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef00c98a0 0x7fbef0070630 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbef006e030 tx=0x7fbee801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bc358eebd16b66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbeef7fe640 1 -- 172.21.15.40:0/2569180748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800b2d0 con 0x7fbef00c98a0 2023-11-04T01:46:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbeef7fe640 1 -- 172.21.15.40:0/2569180748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800b430 con 0x7fbef00c98a0 2023-11-04T01:46:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbeef7fe640 1 -- 172.21.15.40:0/2569180748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee80a7a80 con 0x7fbef00c98a0 2023-11-04T01:46:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- 172.21.15.40:0/2569180748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef00c98a0 msgr2=0x7fbef0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- 172.21.15.40:0/2569180748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef00c98a0 0x7fbef0070630 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbef006e030 tx=0x7fbee801ebd0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- 172.21.15.40:0/2569180748 shutdown_connections 2023-11-04T01:46:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- 172.21.15.40:0/2569180748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef00c98a0 0x7fbef0070630 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- 172.21.15.40:0/2569180748 >> v2:172.21.15.91:3300/0 conn(0x7fbef00caaa0 0x7fbef00c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- 172.21.15.40:0/2569180748 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef015d410 0x7fbef00b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- 172.21.15.40:0/2569180748 >> 172.21.15.40:0/2569180748 conn(0x7fbef00ced10 msgr2=0x7fbef00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- 172.21.15.40:0/2569180748 shutdown_connections 2023-11-04T01:46:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- 172.21.15.40:0/2569180748 wait complete. 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 Processor -- start 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- start start 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef00c98a0 0x7fbef0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef00caaa0 0x7fbef00c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 0x7fbef01567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c75a0 con 0x7fbef015d410 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c3440 con 0x7fbef00c98a0 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef7200640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c3720 con 0x7fbef00caaa0 2023-11-04T01:46:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef579d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 0x7fbef01567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.060+0000 7fbef579d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 0x7fbef01567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33912/0 (socket says 172.21.15.40:33912) 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 -- 172.21.15.40:0/1150485670 learned_addr learned my addr 172.21.15.40:0/1150485670 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeeffff640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef00caaa0 0x7fbef00c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef00c98a0 0x7fbef0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 -- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef00caaa0 msgr2=0x7fbef00c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef00caaa0 0x7fbef00c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 -- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef00c98a0 msgr2=0x7fbef0151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef00c98a0 0x7fbef0151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 -- 172.21.15.40:0/1150485670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee800bd40 con 0x7fbef015d410 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef00c98a0 0x7fbef0151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef579d640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 0x7fbef01567f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fbee80b1040 tx=0x7fbee801b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeed7fa640 1 -- 172.21.15.40:0/1150485670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8009800 con 0x7fbef015d410 2023-11-04T01:46:22.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeed7fa640 1 -- 172.21.15.40:0/1150485670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8009960 con 0x7fbef015d410 2023-11-04T01:46:22.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef00c3a00 con 0x7fbef015d410 2023-11-04T01:46:22.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeed7fa640 1 -- 172.21.15.40:0/1150485670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8009d10 con 0x7fbef015d410 2023-11-04T01:46:22.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef0151d70 con 0x7fbef015d410 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeed7fa640 1 -- 172.21.15.40:0/1150485670 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbee80ba470 con 0x7fbef015d410 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeed7fa640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664a0 0x7fbedc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbeed7fa640 1 -- 172.21.15.40:0/1150485670 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7fbee8121c30 con 0x7fbef015d410 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664a0 0x7fbedc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbefa32d000 1 Processor -- start 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbefa32d000 1 -- start start 2023-11-04T01:46:22.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.064+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664a0 0x7fbedc068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbef00c7110 tx=0x7fbee0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785762b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477843ed80 con 0x5647785c05f0 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647783cf7a0 con 0x5647785767f0 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647783cccd0 con 0x5647785c0f10 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33926/0 (socket says 172.21.15.40:33926) 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 -- 172.21.15.40:0/867902588 learned_addr learned my addr 172.21.15.40:0/867902588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef579d640 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbeeffff640 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 -- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 msgr2=0x5647785762b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785762b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 -- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 msgr2=0x564778576bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 -- 172.21.15.40:0/867902588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564778365180 con 0x5647785c05f0 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c09d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fbee000fae0 tx=0x7fbee0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8fee5106906327 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbed67fc640 1 -- 172.21.15.40:0/867902588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0014ca0 con 0x5647785c05f0 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbed67fc640 1 -- 172.21.15.40:0/867902588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee0019070 con 0x5647785c05f0 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbed67fc640 1 -- 172.21.15.40:0/867902588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0020440 con 0x5647785c05f0 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- 172.21.15.40:0/867902588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 msgr2=0x5647785c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c09d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fbee000fae0 tx=0x7fbee0012000 comp rx=0 tx=0).stop 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- 172.21.15.40:0/867902588 shutdown_connections 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785762b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- 172.21.15.40:0/867902588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c09d0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- 172.21.15.40:0/867902588 >> 172.21.15.40:0/867902588 conn(0x56477845ed50 msgr2=0x564778574b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- 172.21.15.40:0/867902588 shutdown_connections 2023-11-04T01:46:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- 172.21.15.40:0/867902588 wait complete. 2023-11-04T01:46:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- start start 2023-11-04T01:46:22.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 Processor -- start 2023-11-04T01:46:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x5647785c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647783c85c0 con 0x5647785c05f0 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647783868c0 con 0x5647785767f0 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x564778386560 con 0x5647785c0f10 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbefa32d000 10 client.0 _ll_register_callbacks cb 0x564778561ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33930/0 (socket says 172.21.15.40:33930) 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbeeffff640 1 -- 172.21.15.40:0/3901492445 learned_addr learned my addr 172.21.15.40:0/3901492445 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x5647785c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.068+0000 7fbef579d640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbeeffff640 1 -- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 msgr2=0x5647785a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbeeffff640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785a47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbeeffff640 1 -- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 msgr2=0x5647785c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbeeffff640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x5647785c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbeeffff640 1 -- 172.21.15.40:0/3901492445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee000e040 con 0x5647785c05f0 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbef579d640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbeeffff640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c7e90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fbee4010270 tx=0x7fbee4010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c1131af497b871 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 1 -- 172.21.15.40:0/3901492445 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4014800 con 0x5647785c05f0 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 1 -- 172.21.15.40:0/3901492445 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7fbee4014960 con 0x5647785c05f0 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564778393da0 con 0x5647785c05f0 2023-11-04T01:46:22.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 1 -- 172.21.15.40:0/3901492445 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbee4014b20 con 0x5647785c05f0 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 10 client.8130 fetch_fsmap learned FSMap version 96 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x5647780c0e20 con 0x5647785c05f0 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 1 -- 172.21.15.40:0/3901492445 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564778393da0 con 0x5647785c05f0 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 1 -- 172.21.15.40:0/3901492445 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 96) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fbee401a020 con 0x5647785c05f0 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 10 client.8130 fetch_fsmap finished waiting for FSMap version 96 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 10 client.8130 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 20 client.8130 populate_metadata read hostname 'smithi040' 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785a5550 0x5647785a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 4 client.8130 mds_command: new command op to 6766 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 --> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564778393b80 con 0x5647785a5550 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785a5550 0x5647785a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 10 client.8130 ms_handle_connect on v2:172.21.15.91:6836/1982091809 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785a5550 0x5647785a5960 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7f1538c49bc024 server_cookie=d8bfe6f65aac5593 in_seq=0 out_seq=0 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 1 -- 172.21.15.40:0/3901492445 <== mds.0 v2:172.21.15.91:6836/1982091809 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564778393b80 con 0x5647785a5550 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 10 client.8130 handle_command_reply: tid=0 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 client.8130 shutdown 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 msgr2=0x5647785c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c7e90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fbee4010270 tx=0x7fbee4010730 comp rx=0 tx=0).stop 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 shutdown_connections 2023-11-04T01:46:22.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785a5550 0x5647785a5960 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c05f0 0x5647785c7e90 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbecf7fe640 0 client.8130 ms_handle_reset on v2:172.21.15.91:6836/1982091809 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 --2- 172.21.15.40:0/3901492445 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785767f0 0x5647785c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 >> 172.21.15.40:0/3901492445 conn(0x56477845ed50 msgr2=0x564778574b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 shutdown_connections 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 1 -- 172.21.15.40:0/3901492445 wait complete. 2023-11-04T01:46:22.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.072+0000 7fbefa32d000 20 client.8130 trim_cache size 0 max 16384 2023-11-04T01:46:22.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 Processor -- start 2023-11-04T01:46:22.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- start start 2023-11-04T01:46:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778577110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564778081aa0 con 0x5647785767f0 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647783cb120 con 0x5647785c05f0 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647783bff70 con 0x5647785c0f10 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33946/0 (socket says 172.21.15.40:33946) 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 -- 172.21.15.40:0/1361621483 learned_addr learned my addr 172.21.15.40:0/1361621483 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 -- 172.21.15.40:0/1361621483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 msgr2=0x5647785c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 -- 172.21.15.40:0/1361621483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 msgr2=0x564778577110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778577110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 -- 172.21.15.40:0/1361621483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647783892f0 con 0x5647785767f0 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 0x564778576bd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fbee000f5b0 tx=0x7fbee0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731affe896c3b105 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbed6ffd640 1 -- 172.21.15.40:0/1361621483 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0032b00 con 0x5647785767f0 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbed6ffd640 1 -- 172.21.15.40:0/1361621483 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee0031070 con 0x5647785767f0 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbed6ffd640 1 -- 172.21.15.40:0/1361621483 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0032e80 con 0x5647785767f0 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- 172.21.15.40:0/1361621483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 msgr2=0x564778576bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 0x564778576bd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fbee000f5b0 tx=0x7fbee0014000 comp rx=0 tx=0).stop 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- 172.21.15.40:0/1361621483 shutdown_connections 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785c0f10 0x5647785c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778577110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1361621483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785767f0 0x564778576bd0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- 172.21.15.40:0/1361621483 >> 172.21.15.40:0/1361621483 conn(0x56477845ed50 msgr2=0x5647785a3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- 172.21.15.40:0/1361621483 shutdown_connections 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- 172.21.15.40:0/1361621483 wait complete. 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.088+0000 7fbefa32d000 1 -- start start 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 Processor -- start 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785767f0 0x564778621690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778621bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 0x5647785c5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647783cc5c0 con 0x5647785c0f10 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647783c3f30 con 0x5647785c05f0 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647785d6d10 con 0x5647785767f0 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 10 client.0 _ll_register_callbacks cb 0x564778479bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 0x5647785c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 0x5647785c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33952/0 (socket says 172.21.15.40:33952) 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 -- 172.21.15.40:0/1747709678 learned_addr learned my addr 172.21.15.40:0/1747709678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785767f0 0x564778621690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbeeffff640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778621bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 -- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785767f0 msgr2=0x564778621690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785767f0 0x564778621690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 -- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 msgr2=0x564778621bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778621bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 -- 172.21.15.40:0/1747709678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564778365180 con 0x5647785c0f10 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785767f0 0x564778621690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbeeffff640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778621bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef579d640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 0x5647785c5620 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fbee80f2310 tx=0x7fbee80f2150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797a61f93d84c379 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 1 -- 172.21.15.40:0/1747709678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee810b070 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564778579540 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 1 -- 172.21.15.40:0/1747709678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7fbee80f2d10 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 1 -- 172.21.15.40:0/1747709678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbee80f2610 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 10 client.8136 fetch_fsmap learned FSMap version 96 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x56477836f7f0 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 1 -- 172.21.15.40:0/1747709678 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564778579540 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 1 -- 172.21.15.40:0/1747709678 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 96) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fbee8005d20 con 0x5647785c0f10 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 10 client.8136 fetch_fsmap finished waiting for FSMap version 96 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 10 client.8136 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 20 client.8136 populate_metadata read hostname 'smithi040' 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785c5fe0 0x5647785c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 4 client.8136 mds_command: new command op to 6766 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 --> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5647783bf8b0 con 0x5647785c5fe0 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785c5fe0 0x5647785c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbecf7fe640 10 client.8136 ms_handle_connect on v2:172.21.15.91:6836/1982091809 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.092+0000 7fbef4f9c640 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785c5fe0 0x5647785c63f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddcb3e261d911ea0 server_cookie=fb6b39738b6889ea in_seq=0 out_seq=0 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbecf7fe640 1 -- 172.21.15.40:0/1747709678 <== mds.0 v2:172.21.15.91:6836/1982091809 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5647783bf8b0 con 0x5647785c5fe0 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbecf7fe640 10 client.8136 handle_command_reply: tid=0 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 client.8136 shutdown 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 msgr2=0x5647785c5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 0x5647785c5620 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fbee80f2310 tx=0x7fbee80f2150 comp rx=0 tx=0).stop 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 shutdown_connections 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:6836/1982091809,v1:172.21.15.91:6837/1982091809] conn(0x5647785c5fe0 0x5647785c63f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5647785c0f10 0x5647785c5620 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5647785c05f0 0x564778621bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbecf7fe640 0 client.8136 ms_handle_reset on v2:172.21.15.91:6836/1982091809 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 --2- 172.21.15.40:0/1747709678 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x5647785767f0 0x564778621690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 >> 172.21.15.40:0/1747709678 conn(0x56477845ed50 msgr2=0x56477857a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 shutdown_connections 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 1 -- 172.21.15.40:0/1747709678 wait complete. 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.112+0000 7fbefa32d000 20 client.8136 trim_cache size 0 max 16384 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:46:22.118 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "", 2023-11-04T01:46:22.119 INFO:teuthology.orchestra.run.smithi040.stdout: "return_code": 0 2023-11-04T01:46:22.119 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:46:22.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664a0 msgr2=0x7fbedc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664a0 0x7fbedc068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbef00c7110 tx=0x7fbee0008040 comp rx=0 tx=0).stop 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 msgr2=0x7fbef01567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 0x7fbef01567f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fbee80b1040 tx=0x7fbee801b970 comp rx=0 tx=0).stop 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 shutdown_connections 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbedc0664a0 0x7fbedc068960 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbef015d410 0x7fbef01567f0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbef00caaa0 0x7fbef00c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 --2- 172.21.15.40:0/1150485670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef00c98a0 0x7fbef0151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 >> 172.21.15.40:0/1150485670 conn(0x7fbef00ced10 msgr2=0x7fbef0158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 shutdown_connections 2023-11-04T01:46:22.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.116+0000 7fbef7200640 1 -- 172.21.15.40:0/1150485670 wait complete. 2023-11-04T01:46:22.134 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5, also kill snapclient 2023-11-04T01:46:22.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 Processor -- start 2023-11-04T01:46:22.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 -- start start 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f849813e220 0x7f849815c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84980cf8b0 0x7f849806a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849806aad0 con 0x7f849806a130 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498071a70 con 0x7f84980cf8b0 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849c94d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498070bc0 con 0x7f849813e220 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84980cf8b0 0x7f849806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84980cf8b0 0x7f849806a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33954/0 (socket says 172.21.15.40:33954) 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 -- 172.21.15.40:0/1294045920 learned_addr learned my addr 172.21.15.40:0/1294045920 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8495d9b640 1 --1- 172.21.15.40:0/1294045920 >> v1:172.21.15.40:6789/0 conn(0x7f849806a130 0x7f849815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53534/0 (socket says 172.21.15.40:53534) 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849659c640 1 --2- 172.21.15.40:0/1294045920 >> v2:172.21.15.91:3300/0 conn(0x7f849813e220 0x7f849815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849559a640 1 -- 172.21.15.40:0/1294045920 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562798247 0 0) 0x7f849806aad0 con 0x7f849806a130 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f849559a640 1 -- 172.21.15.40:0/1294045920 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8484003530 con 0x7f849806a130 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 -- 172.21.15.40:0/1294045920 >> v2:172.21.15.91:3300/0 conn(0x7f849813e220 msgr2=0x7f849815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 --2- 172.21.15.40:0/1294045920 >> v2:172.21.15.91:3300/0 conn(0x7f849813e220 0x7f849815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 -- 172.21.15.40:0/1294045920 >> v1:172.21.15.40:6789/0 conn(0x7f849806a130 legacy=0x7f849815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.248+0000 7f8496d9d640 1 -- 172.21.15.40:0/1294045920 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498070e60 con 0x7f84980cf8b0 2023-11-04T01:46:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8496d9d640 1 --2- 172.21.15.40:0/1294045920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f849806a590 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f849806b210 tx=0x7f848801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33fb292c8cd4a7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849559a640 1 -- 172.21.15.40:0/1294045920 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a5780 con 0x7f84980cf8b0 2023-11-04T01:46:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849559a640 1 -- 172.21.15.40:0/1294045920 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880a58e0 con 0x7f84980cf8b0 2023-11-04T01:46:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849559a640 1 -- 172.21.15.40:0/1294045920 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a5c70 con 0x7f84980cf8b0 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- 172.21.15.40:0/1294045920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 msgr2=0x7f849806a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 --2- 172.21.15.40:0/1294045920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f849806a590 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f849806b210 tx=0x7f848801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- 172.21.15.40:0/1294045920 shutdown_connections 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 --2- 172.21.15.40:0/1294045920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f849806a590 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 --2- 172.21.15.40:0/1294045920 >> v2:172.21.15.91:3300/0 conn(0x7f849813e220 0x7f849815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- 172.21.15.40:0/1294045920 >> 172.21.15.40:0/1294045920 conn(0x7f84980b18a0 msgr2=0x7f84980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- 172.21.15.40:0/1294045920 shutdown_connections 2023-11-04T01:46:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- 172.21.15.40:0/1294045920 wait complete. 2023-11-04T01:46:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 Processor -- start 2023-11-04T01:46:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- start start 2023-11-04T01:46:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f849806a130 0x7f8498151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f8498140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f849813e220 0x7f8498138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498152190 con 0x7f84980cf8b0 2023-11-04T01:46:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849806d980 con 0x7f849813e220 2023-11-04T01:46:22.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849c94d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849806dc60 con 0x7f849806a130 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f8498140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f8498140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33968/0 (socket says 172.21.15.40:33968) 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 -- 172.21.15.40:0/1633622959 learned_addr learned my addr 172.21.15.40:0/1633622959 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8496d9d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f849813e220 0x7f8498138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f849659c640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f849806a130 0x7f8498151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 -- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f849806a130 msgr2=0x7f8498151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f849806a130 0x7f8498151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 -- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f849813e220 msgr2=0x7f8498138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f849813e220 0x7f8498138010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.252+0000 7f8495d9b640 1 -- 172.21.15.40:0/1633622959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009b30 con 0x7f84980cf8b0 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f8495d9b640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f8498140e90 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f848000c410 tx=0x7f848000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800074e0 con 0x7f84980cf8b0 2023-11-04T01:46:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480007640 con 0x7f84980cf8b0 2023-11-04T01:46:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849806df40 con 0x7f84980cf8b0 2023-11-04T01:46:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480004a30 con 0x7f84980cf8b0 2023-11-04T01:46:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849806e500 con 0x7f84980cf8b0 2023-11-04T01:46:22.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8498165e00 con 0x7f84980cf8b0 2023-11-04T01:46:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8480004b90 con 0x7f84980cf8b0 2023-11-04T01:46:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f848effd640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84780664a0 0x7f8478068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7f8480083fb0 con 0x7f84980cf8b0 2023-11-04T01:46:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f849659c640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84780664a0 0x7f8478068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.256+0000 7f849659c640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84780664a0 0x7f8478068960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f84900096f0 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.260+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84800b5090 con 0x7f84980cf8b0 2023-11-04T01:46:22.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.452+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f849806cfd0 con 0x7f84980cf8b0 2023-11-04T01:46:22.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f848effd640 1 -- 172.21.15.40:0/1633622959 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f84800547f0 con 0x7f84980cf8b0 2023-11-04T01:46:22.457 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:22.458 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:14.127730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:22.458 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 96 2023-11-04T01:46:22.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84780664a0 msgr2=0x7f8478068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84780664a0 0x7f8478068960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f84900096f0 tx=0x7f8490008040 comp rx=0 tx=0).stop 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 msgr2=0x7f8498140e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f8498140e90 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f848000c410 tx=0x7f848000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 shutdown_connections 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84780664a0 0x7f8478068960 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f849813e220 0x7f8498138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84980cf8b0 0x7f8498140e90 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 --2- 172.21.15.40:0/1633622959 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f849806a130 0x7f8498151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 >> 172.21.15.40:0/1633622959 conn(0x7f84980b18a0 msgr2=0x7f84980cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 shutdown_connections 2023-11-04T01:46:22.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.456+0000 7f849c94d640 1 -- 172.21.15.40:0/1633622959 wait complete. 2023-11-04T01:46:22.477 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:46:22.618 INFO:teuthology.orchestra.run.smithi091.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:22.618 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:22.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:46:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.752+0000 7f8ff6a0e640 1 Processor -- start 2023-11-04T01:46:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.752+0000 7f8ff6a0e640 1 -- start start 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff6a0e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8ff015b120 0x7f8ff00d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff6a0e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff6a0e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ff00b2de0 0x7f8ff00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff6a0e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff00b3270 con 0x7f8ff00b2de0 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff6a0e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff015eca0 con 0x7f8ff015b120 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff6a0e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015ef80 con 0x7f8ff00cff30 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ff00b2de0 0x7f8ff00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ff00b2de0 0x7f8ff00b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33978/0 (socket says 172.21.15.40:33978) 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3108053289 learned_addr learned my addr 172.21.15.40:0/3108053289 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8feffff640 1 --2- 172.21.15.40:0/3108053289 >> v2:172.21.15.91:3300/0 conn(0x7f8ff015b120 0x7f8ff00d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8fef7fe640 1 --2- 172.21.15.40:0/3108053289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3108053289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 msgr2=0x7f8ff00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 --2- 172.21.15.40:0/3108053289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3108053289 >> v2:172.21.15.91:3300/0 conn(0x7f8ff015b120 msgr2=0x7f8ff00d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 --2- 172.21.15.40:0/3108053289 >> v2:172.21.15.91:3300/0 conn(0x7f8ff015b120 0x7f8ff00d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3108053289 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff015f260 con 0x7f8ff00b2de0 2023-11-04T01:46:22.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8feffff640 1 --2- 172.21.15.40:0/3108053289 >> v2:172.21.15.91:3300/0 conn(0x7f8ff015b120 0x7f8ff00d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:22.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8ff4fab640 1 --2- 172.21.15.40:0/3108053289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff00b2de0 0x7f8ff00b5c90 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0067540 tx=0x7f8fe801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79347fc76691cabd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8feeffd640 1 -- 172.21.15.40:0/3108053289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80a5870 con 0x7f8ff00b2de0 2023-11-04T01:46:22.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8feeffd640 1 -- 172.21.15.40:0/3108053289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe80a59d0 con 0x7f8ff00b2de0 2023-11-04T01:46:22.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.756+0000 7f8feeffd640 1 -- 172.21.15.40:0/3108053289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80a5d60 con 0x7f8ff00b2de0 2023-11-04T01:46:22.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3108053289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff00b2de0 msgr2=0x7f8ff00b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3108053289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff00b2de0 0x7f8ff00b5c90 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0067540 tx=0x7f8fe801c9d0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3108053289 shutdown_connections 2023-11-04T01:46:22.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3108053289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff00b2de0 0x7f8ff00b5c90 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3108053289 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3108053289 >> v2:172.21.15.91:3300/0 conn(0x7f8ff015b120 0x7f8ff00d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3108053289 >> 172.21.15.40:0/3108053289 conn(0x7f8ff00cd8a0 msgr2=0x7f8ff00cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3108053289 shutdown_connections 2023-11-04T01:46:22.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3108053289 wait complete. 2023-11-04T01:46:22.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 Processor -- start 2023-11-04T01:46:22.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- start start 2023-11-04T01:46:22.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ff00b2de0 0x7f8ff0147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 0x7f8ff006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015b500 con 0x7f8ff015b120 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0147850 con 0x7f8ff00b2de0 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015b7a0 con 0x7f8ff00cff30 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 0x7f8ff006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 0x7f8ff006b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33986/0 (socket says 172.21.15.40:33986) 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3317734388 learned_addr learned my addr 172.21.15.40:0/3317734388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8fef7fe640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8feffff640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ff00b2de0 0x7f8ff0147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 msgr2=0x7f8ff00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ff00b2de0 msgr2=0x7f8ff0147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ff00b2de0 0x7f8ff0147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 -- 172.21.15.40:0/3317734388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8009b30 con 0x7f8ff015b120 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff4fab640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 0x7f8ff006b5b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8fe801b080 tx=0x7f8fe8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b8670 con 0x7f8ff015b120 2023-11-04T01:46:22.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe80b87f0 con 0x7f8ff015b120 2023-11-04T01:46:22.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff015ba80 con 0x7f8ff015b120 2023-11-04T01:46:22.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80b8ba0 con 0x7f8ff015b120 2023-11-04T01:46:22.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.760+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff015c040 con 0x7f8ff015b120 2023-11-04T01:46:22.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.764+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff00cfb00 con 0x7f8ff015b120 2023-11-04T01:46:22.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.764+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8fe80b8d00 con 0x7f8ff015b120 2023-11-04T01:46:22.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.764+0000 7f8fecff9640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8fdc0664a0 0x7f8fdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.764+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7f8fe811fa30 con 0x7f8ff015b120 2023-11-04T01:46:22.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.764+0000 7f8feffff640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8fdc0664a0 0x7f8fdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.764+0000 7f8feffff640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8fdc0664a0 0x7f8fdc068960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00045f0 tx=0x7f8fe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.768+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8fe80ec800 con 0x7f8ff015b120 2023-11-04T01:46:22.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:22.984+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f8ff00b35b0 con 0x7f8ff015b120 2023-11-04T01:46:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8fecff9640 1 -- 172.21.15.40:0/3317734388 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6766 v97) v1 ==== 112+0+0 (secure 0 0 0) 0x7f8fe80efe20 con 0x7f8ff015b120 2023-11-04T01:46:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.6766 2023-11-04T01:46:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8fdc0664a0 msgr2=0x7f8fdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8fdc0664a0 0x7f8fdc068960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00045f0 tx=0x7f8fe0008040 comp rx=0 tx=0).stop 2023-11-04T01:46:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 msgr2=0x7f8ff006b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 0x7f8ff006b5b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8fe801b080 tx=0x7f8fe8019770 comp rx=0 tx=0).stop 2023-11-04T01:46:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 shutdown_connections 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f8fdc0664a0 0x7f8fdc068960 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ff015b120 0x7f8ff006b5b0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8ff00cff30 0x7f8ff00b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 --2- 172.21.15.40:0/3317734388 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8ff00b2de0 0x7f8ff0147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 >> 172.21.15.40:0/3317734388 conn(0x7f8ff00cd8a0 msgr2=0x7f8ff00cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 shutdown_connections 2023-11-04T01:46:23.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.184+0000 7f8ff6a0e640 1 -- 172.21.15.40:0/3317734388 wait complete. 2023-11-04T01:46:23.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:46:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.336+0000 7fbc037b8640 1 Processor -- start 2023-11-04T01:46:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.336+0000 7fbc037b8640 1 -- start start 2023-11-04T01:46:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc037b8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbbfc159720 0x7fbbfc0c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc037b8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 0x7fbbfc0af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc037b8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0afa90 con 0x7fbbfc0af640 2023-11-04T01:46:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc037b8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0ca5a0 con 0x7fbbfc159720 2023-11-04T01:46:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc037b8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0c9d40 con 0x7fbbfc0cf830 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc01d55640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbbfc0af640 0x7fbbfc0cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53540/0 (socket says 172.21.15.40:53540) 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc01d55640 1 -- 172.21.15.40:0/595494731 learned_addr learned my addr 172.21.15.40:0/595494731 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc01554640 1 --2- 172.21.15.40:0/595494731 >> v2:172.21.15.91:3300/0 conn(0x7fbbfc159720 0x7fbbfc0c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 0x7fbbfc0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284490470 0 0) 0x7fbbf4001120 con 0x7fbbfc0af640 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe8003530 con 0x7fbbfc0af640 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255364142 0 0) 0x7fbbe8003530 con 0x7fbbfc0af640 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 msgr2=0x7fbbfc0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 0x7fbbfc0af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 >> v2:172.21.15.91:3300/0 conn(0x7fbbfc159720 msgr2=0x7fbbfc0c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 --2- 172.21.15.40:0/595494731 >> v2:172.21.15.91:3300/0 conn(0x7fbbfc159720 0x7fbbfc0c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0c9fe0 con 0x7fbbfc0af640 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fbbf4001810 con 0x7fbbfc0af640 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 >> v1:172.21.15.40:6789/0 conn(0x7fbbfc0af640 legacy=0x7fbbfc0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 0x7fbbe8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe8003f00 0x7fbbe80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe8004d10 0x7fbbe8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0c9d40 con 0x7fbbe8003f00 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe800b990 con 0x7fbbe8004d10 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe800bb20 con 0x7fbbfc0cf830 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe8003f00 0x7fbbe80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc01554640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 0x7fbbe8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc01d55640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe8004d10 0x7fbbe8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 -- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 msgr2=0x7fbbe8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:23.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbfc0cf830 0x7fbbe8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 -- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe8004d10 msgr2=0x7fbbe8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:23.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbe8004d10 0x7fbbe8005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.340+0000 7fbc00d53640 1 -- 172.21.15.40:0/595494731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8003530 con 0x7fbbe8003f00 2023-11-04T01:46:23.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe8003f00 0x7fbbe80047d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00aa90 tx=0x7fbbec01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1606bf9f52025ada server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:23.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0a5c00 con 0x7fbbe8003f00 2023-11-04T01:46:23.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0a5d60 con 0x7fbbe8003f00 2023-11-04T01:46:23.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbbf3fff640 1 -- 172.21.15.40:0/595494731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ad680 con 0x7fbbe8003f00 2023-11-04T01:46:23.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- 172.21.15.40:0/595494731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe8003f00 msgr2=0x7fbbe80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:23.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 --2- 172.21.15.40:0/595494731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe8003f00 0x7fbbe80047d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00aa90 tx=0x7fbbec01cbe0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc01d55640 1 -- 172.21.15.40:0/595494731 reap_dead start 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- 172.21.15.40:0/595494731 shutdown_connections 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- 172.21.15.40:0/595494731 >> 172.21.15.40:0/595494731 conn(0x7fbbfc0ced10 msgr2=0x7fbbfc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- 172.21.15.40:0/595494731 shutdown_connections 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- 172.21.15.40:0/595494731 wait complete. 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 Processor -- start 2023-11-04T01:46:23.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- start start 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe8003f00 0x7fbbfc0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 0x7fbbfc15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbfc156ec0 0x7fbbfc157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc157880 con 0x7fbbfc14b260 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc14b6e0 con 0x7fbbfc156ec0 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc037b8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc15cb80 con 0x7fbbe8003f00 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 0x7fbbfc15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 0x7fbbfc15b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34004/0 (socket says 172.21.15.40:34004) 2023-11-04T01:46:23.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 -- 172.21.15.40:0/702429704 learned_addr learned my addr 172.21.15.40:0/702429704 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc01554640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe8003f00 0x7fbbfc0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc01d55640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbfc156ec0 0x7fbbfc157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 -- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe8003f00 msgr2=0x7fbbfc0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe8003f00 0x7fbbfc0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 -- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbfc156ec0 msgr2=0x7fbbfc157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbfc156ec0 0x7fbbfc157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 -- 172.21.15.40:0/702429704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc15bf70 con 0x7fbbfc14b260 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc01554640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe8003f00 0x7fbbfc0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc01d55640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbfc156ec0 0x7fbbfc157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.344+0000 7fbc00d53640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 0x7fbbfc15b690 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00aa90 tx=0x7fbbe8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec004020 con 0x7fbbfc14b260 2023-11-04T01:46:23.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0041a0 con 0x7fbbfc14b260 2023-11-04T01:46:23.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc15c250 con 0x7fbbfc14b260 2023-11-04T01:46:23.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0059a0 con 0x7fbbfc14b260 2023-11-04T01:46:23.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc15c810 con 0x7fbbfc14b260 2023-11-04T01:46:23.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbec0b4040 con 0x7fbbfc14b260 2023-11-04T01:46:23.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc04e4a0 con 0x7fbbfc14b260 2023-11-04T01:46:23.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbbf1ffb640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe00664a0 0x7fbbe0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:23.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7fbbec11e430 con 0x7fbbfc14b260 2023-11-04T01:46:23.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbc01554640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe00664a0 0x7fbbe0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:23.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.348+0000 7fbc01554640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe00664a0 0x7fbbe0068960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8007440 tx=0x7fbbf800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:23.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.352+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbec0eb1e0 con 0x7fbbfc14b260 2023-11-04T01:46:23.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:23.568+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fbbfc15ccc0 con 0x7fbbfc14b260 2023-11-04T01:46:24.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.196+0000 7fbbf1ffb640 1 -- 172.21.15.40:0/702429704 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7956 v98) v1 ==== 112+0+0 (secure 0 0 0) 0x7fbbec00b040 con 0x7fbbfc14b260 2023-11-04T01:46:24.198 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.7956 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe00664a0 msgr2=0x7fbbe0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe00664a0 0x7fbbe0068960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8007440 tx=0x7fbbf800b040 comp rx=0 tx=0).stop 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 msgr2=0x7fbbfc15b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 0x7fbbfc15b690 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00aa90 tx=0x7fbbe8005800 comp rx=0 tx=0).stop 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 shutdown_connections 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbbe00664a0 0x7fbbe0068960 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbbfc156ec0 0x7fbbfc157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbfc14b260 0x7fbbfc15b690 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 --2- 172.21.15.40:0/702429704 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbbe8003f00 0x7fbbfc0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 >> 172.21.15.40:0/702429704 conn(0x7fbbfc0ced10 msgr2=0x7fbbfc0cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 shutdown_connections 2023-11-04T01:46:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.200+0000 7fbc037b8640 1 -- 172.21.15.40:0/702429704 wait complete. 2023-11-04T01:46:24.226 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:46:24.370 INFO:teuthology.orchestra.run.smithi091.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:46:24.370 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:46:24.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:24.370 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s25) 2023-11-04T01:46:24.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:46:24.395 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f0ad38d3640 time 2023-11-04T01:46:24.397699+0000 2023-11-04T01:46:24.395 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ad99fffae] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.396 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:46:24.394+0000 7f0ad38d3640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f0ad38d3640 time 2023-11-04T01:46:24.397699+0000 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ad99fffae] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.397 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:46:24.398 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7f0ad38d3640 thread_name:ms_dispatch 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ad933a520] 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ad9a00008] 2023-11-04T01:46:24.399 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:46:24.394+0000 7f0ad38d3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7f0ad38d3640 thread_name:ms_dispatch 2023-11-04T01:46:24.400 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ad933a520] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ad9a00008] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.401 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.402 INFO:tasks.ceph.mds.b.smithi091.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.402 INFO:tasks.ceph.mds.b.smithi091.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.402 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:24.402 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.403 INFO:tasks.ceph.mds.b.smithi091.stderr: -1137> 2023-11-04T01:46:15.274+0000 7f0ad10ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:24.403 INFO:tasks.ceph.mds.b.smithi091.stderr: -1135> 2023-11-04T01:46:15.274+0000 7f0ad10ce640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:24.403 INFO:tasks.ceph.mds.b.smithi091.stderr: -1> 2023-11-04T01:46:24.394+0000 7f0ad38d3640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f0ad38d3640 time 2023-11-04T01:46:24.397699+0000 2023-11-04T01:46:24.403 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:24.403 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.403 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ad99fffae] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: 0> 2023-11-04T01:46:24.394+0000 7f0ad38d3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:24.404 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7f0ad38d3640 thread_name:ms_dispatch 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ad933a520] 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ad9a00008] 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.405 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: -1137> 2023-11-04T01:46:15.274+0000 7f0ad10ce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:24.406 INFO:tasks.ceph.mds.b.smithi091.stderr: -1135> 2023-11-04T01:46:15.274+0000 7f0ad10ce640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:24.407 INFO:tasks.ceph.mds.b.smithi091.stderr: -1> 2023-11-04T01:46:24.394+0000 7f0ad38d3640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f0ad38d3640 time 2023-11-04T01:46:24.397699+0000 2023-11-04T01:46:24.407 INFO:tasks.ceph.mds.b.smithi091.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:24.407 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ad99fffae] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.408 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 0> 2023-11-04T01:46:24.394+0000 7f0ad38d3640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: in thread 7f0ad38d3640 thread_name:ms_dispatch 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ad933a520] 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 2: pthread_kill() 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 3: raise() 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 4: abort() 2023-11-04T01:46:24.409 INFO:tasks.ceph.mds.b.smithi091.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ad9a00008] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f0ad9a00162] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x5573920e416d] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x557391e76969] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x557391e789eb] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557391e78ebc] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x557391e637f5] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f0ad9bebf2a] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f0ad9c7e7f1] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f0ad938cb43] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f0ad941ea00] 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:24.410 INFO:tasks.ceph.mds.b.smithi091.stderr: 2023-11-04T01:46:24.532 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:46:24.532 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:46:24.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:24.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114706e640 1 Processor -- start 2023-11-04T01:46:24.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114706e640 1 -- start start 2023-11-04T01:46:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114706e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11400b44d0 0x7f1140167d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114706e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400d0a00 con 0x7f11401605b0 2023-11-04T01:46:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114706e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400d3e20 con 0x7f11400d1560 2023-11-04T01:46:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114706e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400d1b30 con 0x7f11400b44d0 2023-11-04T01:46:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114560b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11400b44d0 0x7f1140167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f1144e0a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f11401605b0 0x7f11400cdaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53552/0 (socket says 172.21.15.40:53552) 2023-11-04T01:46:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f1144e0a640 1 -- 172.21.15.40:0/1327800985 learned_addr learned my addr 172.21.15.40:0/1327800985 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114560b640 1 -- 172.21.15.40:0/1327800985 >> v1:172.21.15.91:6789/0 conn(0x7f11400d1560 legacy=0x7f11400ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114560b640 1 -- 172.21.15.40:0/1327800985 >> v1:172.21.15.40:6789/0 conn(0x7f11401605b0 legacy=0x7f11400cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.648+0000 7f114560b640 1 -- 172.21.15.40:0/1327800985 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400d1e10 con 0x7f11400b44d0 2023-11-04T01:46:24.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114560b640 1 --2- 172.21.15.40:0/1327800985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11400b44d0 0x7f1140167d90 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f11380097f0 tx=0x7f113801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698e55f45922690c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:24.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f113f7fe640 1 -- 172.21.15.40:0/1327800985 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380a8930 con 0x7f11400b44d0 2023-11-04T01:46:24.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f113f7fe640 1 -- 172.21.15.40:0/1327800985 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380a8a90 con 0x7f11400b44d0 2023-11-04T01:46:24.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f113f7fe640 1 -- 172.21.15.40:0/1327800985 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380a8e20 con 0x7f11400b44d0 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 -- 172.21.15.40:0/1327800985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11400b44d0 msgr2=0x7f1140167d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 --2- 172.21.15.40:0/1327800985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11400b44d0 0x7f1140167d90 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f11380097f0 tx=0x7f113801ec30 comp rx=0 tx=0).stop 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 -- 172.21.15.40:0/1327800985 shutdown_connections 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 --2- 172.21.15.40:0/1327800985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11400b44d0 0x7f1140167d90 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 -- 172.21.15.40:0/1327800985 >> 172.21.15.40:0/1327800985 conn(0x7f11400d2fe0 msgr2=0x7f11400d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 -- 172.21.15.40:0/1327800985 shutdown_connections 2023-11-04T01:46:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 -- 172.21.15.40:0/1327800985 wait complete. 2023-11-04T01:46:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 Processor -- start 2023-11-04T01:46:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.652+0000 7f114706e640 1 -- start start 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11400b44d0 0x7f11400ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11400d1560 0x7f1140153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 0x7f11400ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c8900 con 0x7f11401605b0 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140154600 con 0x7f11400d1560 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c76f0 con 0x7f11400b44d0 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 0x7f11400ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 0x7f11400ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34030/0 (socket says 172.21.15.40:34030) 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 -- 172.21.15.40:0/3753216548 learned_addr learned my addr 172.21.15.40:0/3753216548 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f1144e0a640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11400b44d0 0x7f11400ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113ffff640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11400d1560 0x7f1140153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 -- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11400b44d0 msgr2=0x7f11400ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11400b44d0 0x7f11400ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 -- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11400d1560 msgr2=0x7f1140153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11400d1560 0x7f1140153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 -- 172.21.15.40:0/3753216548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009420 con 0x7f11401605b0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f1144e0a640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11400b44d0 0x7f11400ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114560b640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 0x7f11400ceee0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f11380b3040 tx=0x7f113801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380b0e40 con 0x7f11401605b0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380b9410 con 0x7f11401605b0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11400c79d0 con 0x7f11401605b0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380b97c0 con 0x7f11401605b0 2023-11-04T01:46:24.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11400c8590 con 0x7f11401605b0 2023-11-04T01:46:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11400c8a70 con 0x7f11401605b0 2023-11-04T01:46:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11380b7040 con 0x7f11401605b0 2023-11-04T01:46:24.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113d7fa640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f112c0664a0 0x7f112c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:24.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.656+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7444+0+0 (secure 0 0 0) 0x7f1138122240 con 0x7f11401605b0 2023-11-04T01:46:24.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.660+0000 7f1144e0a640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f112c0664a0 0x7f112c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:24.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.660+0000 7f1144e0a640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f112c0664a0 0x7f112c068960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1130005c10 tx=0x7f1130009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:24.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.660+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11380eeff0 con 0x7f11401605b0 2023-11-04T01:46:24.803 INFO:tasks.ceph.mds.b.smithi091.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:46:24.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.852+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11400c8a40 con 0x7f11401605b0 2023-11-04T01:46:24.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.852+0000 7f113d7fa640 1 -- 172.21.15.40:0/3753216548 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f11380f2610 con 0x7f11401605b0 2023-11-04T01:46:24.855 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:24.855 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:23.573240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:24.855 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 98 2023-11-04T01:46:24.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.852+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f112c0664a0 msgr2=0x7f112c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.852+0000 7f114706e640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f112c0664a0 0x7f112c068960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1130005c10 tx=0x7f1130009040 comp rx=0 tx=0).stop 2023-11-04T01:46:24.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.852+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 msgr2=0x7f11400ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:24.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.852+0000 7f114706e640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 0x7f11400ceee0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f11380b3040 tx=0x7f113801b9d0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 shutdown_connections 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f112c0664a0 0x7f112c068960 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11401605b0 0x7f11400ceee0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11400d1560 0x7f1140153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 --2- 172.21.15.40:0/3753216548 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f11400b44d0 0x7f11400ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 >> 172.21.15.40:0/3753216548 conn(0x7f11400d2fe0 msgr2=0x7f11400afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 shutdown_connections 2023-11-04T01:46:24.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:24.856+0000 7f114706e640 1 -- 172.21.15.40:0/3753216548 wait complete. 2023-11-04T01:46:24.874 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:27.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:27.766 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:28.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:46:29.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:30.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.008+0000 7febc66ca640 1 Processor -- start 2023-11-04T01:46:30.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc66ca640 1 -- start start 2023-11-04T01:46:30.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc66ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febc006c1c0 0x7febc00cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc66ca640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00c9ac0 con 0x7febc00c92b0 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc66ca640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00caf20 con 0x7febc006bde0 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc66ca640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00c97e0 con 0x7febc006c1c0 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febc006c1c0 0x7febc00cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febc006c1c0 0x7febc00cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56638/0 (socket says 172.21.15.40:56638) 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 -- 172.21.15.40:0/1001801889 learned_addr learned my addr 172.21.15.40:0/1001801889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febbf7fe640 1 --1- 172.21.15.40:0/1001801889 >> v1:172.21.15.40:6789/0 conn(0x7febc00c92b0 0x7febc01442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36884/0 (socket says 172.21.15.40:36884) 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 -- 172.21.15.40:0/1001801889 >> v1:172.21.15.91:6789/0 conn(0x7febc006bde0 legacy=0x7febc015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 -- 172.21.15.40:0/1001801889 >> v1:172.21.15.40:6789/0 conn(0x7febc00c92b0 legacy=0x7febc01442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 -- 172.21.15.40:0/1001801889 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00cb1c0 con 0x7febc006c1c0 2023-11-04T01:46:30.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.012+0000 7febc4c67640 1 --2- 172.21.15.40:0/1001801889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006c1c0 0x7febc00cbca0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05c342aa95c9c78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febbeffd640 1 -- 172.21.15.40:0/1001801889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80a5690 con 0x7febc006c1c0 2023-11-04T01:46:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febbeffd640 1 -- 172.21.15.40:0/1001801889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb80a57f0 con 0x7febc006c1c0 2023-11-04T01:46:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febbeffd640 1 -- 172.21.15.40:0/1001801889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80a5b80 con 0x7febc006c1c0 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 -- 172.21.15.40:0/1001801889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006c1c0 msgr2=0x7febc00cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 --2- 172.21.15.40:0/1001801889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006c1c0 0x7febc00cbca0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb801c9d0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 -- 172.21.15.40:0/1001801889 shutdown_connections 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 --2- 172.21.15.40:0/1001801889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006c1c0 0x7febc00cbca0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 -- 172.21.15.40:0/1001801889 >> 172.21.15.40:0/1001801889 conn(0x7febc00b0890 msgr2=0x7febc00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 -- 172.21.15.40:0/1001801889 shutdown_connections 2023-11-04T01:46:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 -- 172.21.15.40:0/1001801889 wait complete. 2023-11-04T01:46:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 Processor -- start 2023-11-04T01:46:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.016+0000 7febc66ca640 1 -- start start 2023-11-04T01:46:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 0x7febc00b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febc006c1c0 0x7febc013d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febc00c92b0 0x7febc013b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00b22b0 con 0x7febc006bde0 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00b2590 con 0x7febc00c92b0 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00b2870 con 0x7febc006c1c0 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 0x7febc00b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 0x7febc00b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56654/0 (socket says 172.21.15.40:56654) 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 -- 172.21.15.40:0/3965590441 learned_addr learned my addr 172.21.15.40:0/3965590441 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc4c67640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febc00c92b0 0x7febc013b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbf7fe640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febc006c1c0 0x7febc013d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 -- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febc006c1c0 msgr2=0x7febc013d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febc006c1c0 0x7febc013d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 -- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febc00c92b0 msgr2=0x7febc013b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febc00c92b0 0x7febc013b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 -- 172.21.15.40:0/3965590441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8009b30 con 0x7febc006bde0 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc4c67640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febc00c92b0 0x7febc013b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbffff640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 0x7febc00b3350 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7febb000c450 tx=0x7febb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0012830 con 0x7febc006bde0 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb00129b0 con 0x7febc006bde0 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc00b2b50 con 0x7febc006bde0 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0012d60 con 0x7febc006bde0 2023-11-04T01:46:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc00c4b40 con 0x7febc006bde0 2023-11-04T01:46:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc004e4a0 con 0x7febc006bde0 2023-11-04T01:46:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7febb001c460 con 0x7febc006bde0 2023-11-04T01:46:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbcff9640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feba00664a0 0x7feba0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7416+0+0 (secure 0 0 0) 0x7febb0084300 con 0x7febc006bde0 2023-11-04T01:46:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.020+0000 7febbf7fe640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feba00664a0 0x7feba0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.024+0000 7febbf7fe640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feba00664a0 0x7feba0068960 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feba8000f70 tx=0x7feba8007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:30.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.024+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7febb0051160 con 0x7febc006bde0 2023-11-04T01:46:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.216+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febc006cf10 con 0x7febc006bde0 2023-11-04T01:46:30.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.216+0000 7febbcff9640 1 -- 172.21.15.40:0/3965590441 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4932 (secure 0 0 0) 0x7febb0054780 con 0x7febc006bde0 2023-11-04T01:46:30.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:23.573240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 98 2023-11-04T01:46:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feba00664a0 msgr2=0x7feba0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feba00664a0 0x7feba0068960 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feba8000f70 tx=0x7feba8007cb0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 msgr2=0x7febc00b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 0x7febc00b3350 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7febb000c450 tx=0x7febb000c910 comp rx=0 tx=0).stop 2023-11-04T01:46:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 shutdown_connections 2023-11-04T01:46:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7feba00664a0 0x7feba0068960 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febc00c92b0 0x7febc013b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febc006c1c0 0x7febc013d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 --2- 172.21.15.40:0/3965590441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc006bde0 0x7febc00b3350 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 >> 172.21.15.40:0/3965590441 conn(0x7febc00b0890 msgr2=0x7febc013f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 shutdown_connections 2023-11-04T01:46:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:30.220+0000 7febc66ca640 1 -- 172.21.15.40:0/3965590441 wait complete. 2023-11-04T01:46:30.237 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:35.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:46:35.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:35.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 Processor -- start 2023-11-04T01:46:35.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 -- start start 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9900c92b0 0x7fd9900cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd99006c1c0 0x7fd9901442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900c9ac0 con 0x7fd99006bde0 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9900caf20 con 0x7fd9900c92b0 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd996060640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9900c97e0 con 0x7fd99006c1c0 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9900c92b0 0x7fd9900cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9900c92b0 0x7fd9900cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56656/0 (socket says 172.21.15.40:56656) 2023-11-04T01:46:35.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 -- 172.21.15.40:0/2694993705 learned_addr learned my addr 172.21.15.40:0/2694993705 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:35.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98ffff640 1 --2- 172.21.15.40:0/2694993705 >> v2:172.21.15.91:3300/0 conn(0x7fd99006c1c0 0x7fd9901442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:35.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 -- 172.21.15.40:0/2694993705 >> v2:172.21.15.91:3300/0 conn(0x7fd99006c1c0 msgr2=0x7fd9901442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:35.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 --2- 172.21.15.40:0/2694993705 >> v2:172.21.15.91:3300/0 conn(0x7fd99006c1c0 0x7fd9901442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 -- 172.21.15.40:0/2694993705 >> v1:172.21.15.91:6789/0 conn(0x7fd99006bde0 legacy=0x7fd99015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:35.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98effd640 1 -- 172.21.15.40:0/2694993705 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9900cb1c0 con 0x7fd9900c92b0 2023-11-04T01:46:35.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.372+0000 7fd98ffff640 1 --2- 172.21.15.40:0/2694993705 >> v2:172.21.15.91:3300/0 conn(0x7fd99006c1c0 0x7fd9901442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:35.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98effd640 1 --2- 172.21.15.40:0/2694993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9900c92b0 0x7fd9900cbca0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fd99015b660 tx=0x7fd98401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8a9e9eaf3e9c7c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:35.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98e7fc640 1 -- 172.21.15.40:0/2694993705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840ac410 con 0x7fd9900c92b0 2023-11-04T01:46:35.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98e7fc640 1 -- 172.21.15.40:0/2694993705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9840ac570 con 0x7fd9900c92b0 2023-11-04T01:46:35.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98e7fc640 1 -- 172.21.15.40:0/2694993705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840ac900 con 0x7fd9900c92b0 2023-11-04T01:46:35.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- 172.21.15.40:0/2694993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9900c92b0 msgr2=0x7fd9900cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 --2- 172.21.15.40:0/2694993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9900c92b0 0x7fd9900cbca0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fd99015b660 tx=0x7fd98401c4c0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- 172.21.15.40:0/2694993705 shutdown_connections 2023-11-04T01:46:35.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 --2- 172.21.15.40:0/2694993705 >> v2:172.21.15.91:3300/0 conn(0x7fd99006c1c0 0x7fd9901442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 --2- 172.21.15.40:0/2694993705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9900c92b0 0x7fd9900cbca0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- 172.21.15.40:0/2694993705 >> 172.21.15.40:0/2694993705 conn(0x7fd9900b0890 msgr2=0x7fd9900b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:35.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- 172.21.15.40:0/2694993705 shutdown_connections 2023-11-04T01:46:35.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- 172.21.15.40:0/2694993705 wait complete. 2023-11-04T01:46:35.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 Processor -- start 2023-11-04T01:46:35.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- start start 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 0x7fd9900b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd99006c1c0 0x7fd99013b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9900c92b0 0x7fd99015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b1f60 con 0x7fd99006bde0 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b25e0 con 0x7fd99006c1c0 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd996060640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b28c0 con 0x7fd9900c92b0 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 0x7fd9900b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 0x7fd9900b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56668/0 (socket says 172.21.15.40:56668) 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.376+0000 7fd98f7fe640 1 -- 172.21.15.40:0/3130461711 learned_addr learned my addr 172.21.15.40:0/3130461711 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:35.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98effd640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd99006c1c0 0x7fd99013b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98ffff640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9900c92b0 0x7fd99015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98f7fe640 1 -- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9900c92b0 msgr2=0x7fd99015c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98f7fe640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9900c92b0 0x7fd99015c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98f7fe640 1 -- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd99006c1c0 msgr2=0x7fd99013b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98f7fe640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd99006c1c0 0x7fd99013b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98f7fe640 1 -- 172.21.15.40:0/3130461711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840094d0 con 0x7fd99006bde0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98effd640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd99006c1c0 0x7fd99013b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98f7fe640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 0x7fd9900b1980 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c450 tx=0x7fd98000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980012830 con 0x7fd99006bde0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9800129b0 con 0x7fd99006bde0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980012d60 con 0x7fd99006bde0 2023-11-04T01:46:35.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9900b2ba0 con 0x7fd99006bde0 2023-11-04T01:46:35.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99013c760 con 0x7fd99006bde0 2023-11-04T01:46:35.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99004e4a0 con 0x7fd99006bde0 2023-11-04T01:46:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd98001c460 con 0x7fd99006bde0 2023-11-04T01:46:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd977fff640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd97c0664a0 0x7fd97c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7416+0+0 (secure 0 0 0) 0x7fd980084310 con 0x7fd99006bde0 2023-11-04T01:46:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98effd640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd97c0664a0 0x7fd97c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.380+0000 7fd98effd640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd97c0664a0 0x7fd97c068960 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd9840ae000 tx=0x7fd9840a6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.384+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd980051170 con 0x7fd99006bde0 2023-11-04T01:46:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd99006cf10 con 0x7fd99006bde0 2023-11-04T01:46:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd977fff640 1 -- 172.21.15.40:0/3130461711 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fd980054790 con 0x7fd99006bde0 2023-11-04T01:46:35.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:35.578 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:23.573240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 98 2023-11-04T01:46:35.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd97c0664a0 msgr2=0x7fd97c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd97c0664a0 0x7fd97c068960 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd9840ae000 tx=0x7fd9840a6040 comp rx=0 tx=0).stop 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 msgr2=0x7fd9900b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 0x7fd9900b1980 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c450 tx=0x7fd98000c910 comp rx=0 tx=0).stop 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 shutdown_connections 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd97c0664a0 0x7fd97c068960 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd9900c92b0 0x7fd99015c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd99006c1c0 0x7fd99013b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 --2- 172.21.15.40:0/3130461711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd99006bde0 0x7fd9900b1980 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 >> 172.21.15.40:0/3130461711 conn(0x7fd9900b0890 msgr2=0x7fd99015e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 shutdown_connections 2023-11-04T01:46:35.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:35.576+0000 7fd996060640 1 -- 172.21.15.40:0/3130461711 wait complete. 2023-11-04T01:46:35.598 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:40.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:40.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 Processor -- start 2023-11-04T01:46:40.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 -- start start 2023-11-04T01:46:40.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406bde0 0x7fafd40cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fafd40c92b0 0x7fafd415c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafd406c1c0 0x7fafd41442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40c9ac0 con 0x7fafd406c1c0 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40caf20 con 0x7fafd40c92b0 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd964d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd415c5d0 con 0x7fafd406bde0 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafd406c1c0 0x7fafd41442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafd406c1c0 0x7fafd41442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45694/0 (socket says 172.21.15.40:45694) 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 -- 172.21.15.40:0/482128919 learned_addr learned my addr 172.21.15.40:0/482128919 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd27fc640 1 --2- 172.21.15.40:0/482128919 >> v2:172.21.15.91:3300/0 conn(0x7fafd40c92b0 0x7fafd415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd2ffd640 1 --2- 172.21.15.40:0/482128919 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406bde0 0x7fafd40cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 -- 172.21.15.40:0/482128919 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406bde0 msgr2=0x7fafd40cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 --2- 172.21.15.40:0/482128919 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406bde0 0x7fafd40cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 -- 172.21.15.40:0/482128919 >> v2:172.21.15.91:3300/0 conn(0x7fafd40c92b0 msgr2=0x7fafd415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 --2- 172.21.15.40:0/482128919 >> v2:172.21.15.91:3300/0 conn(0x7fafd40c92b0 0x7fafd415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.731+0000 7fafd37fe640 1 -- 172.21.15.40:0/482128919 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40c97e0 con 0x7fafd406c1c0 2023-11-04T01:46:40.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd37fe640 1 --2- 172.21.15.40:0/482128919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406c1c0 0x7fafd41442b0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fafd406dc00 tx=0x7fafcc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961aba45110d8c75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:40.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd1ffb640 1 -- 172.21.15.40:0/482128919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0a5740 con 0x7fafd406c1c0 2023-11-04T01:46:40.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd1ffb640 1 -- 172.21.15.40:0/482128919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0a58a0 con 0x7fafd406c1c0 2023-11-04T01:46:40.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd1ffb640 1 -- 172.21.15.40:0/482128919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0a5c30 con 0x7fafd406c1c0 2023-11-04T01:46:40.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 -- 172.21.15.40:0/482128919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406c1c0 msgr2=0x7fafd41442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 --2- 172.21.15.40:0/482128919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406c1c0 0x7fafd41442b0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fafd406dc00 tx=0x7fafcc01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 -- 172.21.15.40:0/482128919 shutdown_connections 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 --2- 172.21.15.40:0/482128919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406c1c0 0x7fafd41442b0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 --2- 172.21.15.40:0/482128919 >> v2:172.21.15.91:3300/0 conn(0x7fafd40c92b0 0x7fafd415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 --2- 172.21.15.40:0/482128919 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406bde0 0x7fafd40cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 -- 172.21.15.40:0/482128919 >> 172.21.15.40:0/482128919 conn(0x7fafd40b0890 msgr2=0x7fafd40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 -- 172.21.15.40:0/482128919 shutdown_connections 2023-11-04T01:46:40.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 -- 172.21.15.40:0/482128919 wait complete. 2023-11-04T01:46:40.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 Processor -- start 2023-11-04T01:46:40.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.735+0000 7fafd964d640 1 -- start start 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 0x7fafd4070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406c1c0 0x7fafd413bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafd40c92b0 0x7fafd413c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40b1b90 con 0x7fafd406bde0 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40b2e40 con 0x7fafd40c92b0 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40b1da0 con 0x7fafd406c1c0 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 0x7fafd4070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 0x7fafd4070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45700/0 (socket says 172.21.15.40:45700) 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 -- 172.21.15.40:0/3129399860 learned_addr learned my addr 172.21.15.40:0/3129399860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd27fc640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406c1c0 0x7fafd413bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd37fe640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafd40c92b0 0x7fafd413c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 -- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406c1c0 msgr2=0x7fafd413bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406c1c0 0x7fafd413bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 -- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafd40c92b0 msgr2=0x7fafd413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafd40c92b0 0x7fafd413c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 -- 172.21.15.40:0/3129399860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc009b30 con 0x7fafd406bde0 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd37fe640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafd40c92b0 0x7fafd413c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd2ffd640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 0x7fafd4070b70 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fafc400d800 tx=0x7fafc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40096a0 con 0x7fafd406bde0 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4009800 con 0x7fafd406bde0 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd40b2080 con 0x7fafd406bde0 2023-11-04T01:46:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4009990 con 0x7fafd406bde0 2023-11-04T01:46:40.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd40b2640 con 0x7fafd406bde0 2023-11-04T01:46:40.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd404e4a0 con 0x7fafd406bde0 2023-11-04T01:46:40.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fafc4009af0 con 0x7fafd406bde0 2023-11-04T01:46:40.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafbb7fe640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafc00664d0 0x7fafc0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.739+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7416+0+0 (secure 0 0 0) 0x7fafc4084970 con 0x7fafd406bde0 2023-11-04T01:46:40.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.743+0000 7fafd27fc640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafc00664d0 0x7fafc0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.743+0000 7fafd27fc640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafc00664d0 0x7fafc0068990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fafd41423d0 tx=0x7fafc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.747+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fafc4051740 con 0x7fafd406bde0 2023-11-04T01:46:40.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.935+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafd406cf10 con 0x7fafd406bde0 2023-11-04T01:46:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.935+0000 7fafbb7fe640 1 -- 172.21.15.40:0/3129399860 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4980 (secure 0 0 0) 0x7fafc4009da0 con 0x7fafd406bde0 2023-11-04T01:46:40.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:40.940 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:38.010889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:46:38.010889+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 99 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafc00664d0 msgr2=0x7fafc0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafc00664d0 0x7fafc0068990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fafd41423d0 tx=0x7fafc8008040 comp rx=0 tx=0).stop 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 msgr2=0x7fafd4070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 0x7fafd4070b70 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fafc400d800 tx=0x7fafc400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 shutdown_connections 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fafc00664d0 0x7fafc0068990 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafd40c92b0 0x7fafd413c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fafd406c1c0 0x7fafd413bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 --2- 172.21.15.40:0/3129399860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd406bde0 0x7fafd4070b70 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 >> 172.21.15.40:0/3129399860 conn(0x7fafd40b0890 msgr2=0x7fafd40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:40.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 shutdown_connections 2023-11-04T01:46:40.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:40.939+0000 7fafd964d640 1 -- 172.21.15.40:0/3129399860 wait complete. 2023-11-04T01:46:40.958 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:46:40.959 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:46:40.971 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:46:40.973 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:46:40.973 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:46:41.037 INFO:teuthology.orchestra.run.smithi091.stdout:1699062384.44530.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:46:41.038 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062384.44530.core'] 2023-11-04T01:46:41.038 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062384.44530.core, deleting it 2023-11-04T01:46:41.039 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062384.44530.core 2023-11-04T01:46:41.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db3f2d640 1 Processor -- start 2023-11-04T01:46:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db3f2d640 1 -- start start 2023-11-04T01:46:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db3f2d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0dac0c92b0 0x7f0dac0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db3f2d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0c9ac0 con 0x7f0dac06c1c0 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db3f2d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0caf20 con 0x7f0dac06bde0 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db3f2d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac0c97e0 con 0x7f0dac0c92b0 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db24ca640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0dac06c1c0 0x7f0dac1442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57368/0 (socket says 172.21.15.40:57368) 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db14c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0dac0c92b0 0x7f0dac0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db24ca640 1 -- 172.21.15.40:0/371223424 learned_addr learned my addr 172.21.15.40:0/371223424 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db0cc7640 1 -- 172.21.15.40:0/371223424 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645917457 0 0) 0x7f0dac0c9ac0 con 0x7f0dac06c1c0 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db0cc7640 1 -- 172.21.15.40:0/371223424 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d98003530 con 0x7f0dac06c1c0 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db14c8640 1 -- 172.21.15.40:0/371223424 >> v1:172.21.15.91:6789/0 conn(0x7f0dac06bde0 legacy=0x7f0dac15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db14c8640 1 -- 172.21.15.40:0/371223424 >> v1:172.21.15.40:6789/0 conn(0x7f0dac06c1c0 legacy=0x7f0dac1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.223+0000 7f0db14c8640 1 -- 172.21.15.40:0/371223424 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0cb1c0 con 0x7f0dac0c92b0 2023-11-04T01:46:41.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db14c8640 1 --2- 172.21.15.40:0/371223424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac0cbca0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0097c0 tx=0x7f0d9c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d89fd7b669a3a9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:41.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db0cc7640 1 -- 172.21.15.40:0/371223424 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0ab600 con 0x7f0dac0c92b0 2023-11-04T01:46:41.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db0cc7640 1 -- 172.21.15.40:0/371223424 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0a7050 con 0x7f0dac0c92b0 2023-11-04T01:46:41.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db0cc7640 1 -- 172.21.15.40:0/371223424 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0ab980 con 0x7f0dac0c92b0 2023-11-04T01:46:41.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- 172.21.15.40:0/371223424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 msgr2=0x7f0dac0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/371223424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac0cbca0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0097c0 tx=0x7f0d9c01c480 comp rx=0 tx=0).stop 2023-11-04T01:46:41.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- 172.21.15.40:0/371223424 shutdown_connections 2023-11-04T01:46:41.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/371223424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac0cbca0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- 172.21.15.40:0/371223424 >> 172.21.15.40:0/371223424 conn(0x7f0dac0b0890 msgr2=0x7f0dac0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:41.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- 172.21.15.40:0/371223424 shutdown_connections 2023-11-04T01:46:41.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- 172.21.15.40:0/371223424 wait complete. 2023-11-04T01:46:41.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 Processor -- start 2023-11-04T01:46:41.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- start start 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dac06bde0 0x7f0dac13afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dac06c1c0 0x7f0dac0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac13f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1410d0 con 0x7f0dac0c92b0 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c6a50 con 0x7f0dac06c1c0 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db3f2d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1424a0 con 0x7f0dac06bde0 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.227+0000 7f0db24ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac13f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45720/0 (socket says 172.21.15.40:45720) 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 -- 172.21.15.40:0/2833366144 learned_addr learned my addr 172.21.15.40:0/2833366144 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:41.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db14c8640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dac06c1c0 0x7f0dac0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db1cc9640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dac06bde0 0x7f0dac13afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 -- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dac06bde0 msgr2=0x7f0dac13afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dac06bde0 0x7f0dac13afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 -- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dac06c1c0 msgr2=0x7f0dac0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dac06c1c0 0x7f0dac0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 -- 172.21.15.40:0/2833366144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009420 con 0x7f0dac0c92b0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db1cc9640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dac06bde0 0x7f0dac13afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db24ca640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac13f460 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f0da400cb70 tx=0x7f0da400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400ad40 con 0x7f0dac0c92b0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da4012400 con 0x7f0dac0c92b0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400aea0 con 0x7f0dac0c92b0 2023-11-04T01:46:41.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac1f8960 con 0x7f0dac0c92b0 2023-11-04T01:46:41.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac1f8680 con 0x7f0dac0c92b0 2023-11-04T01:46:41.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac04e4a0 con 0x7f0dac0c92b0 2023-11-04T01:46:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0da4007070 con 0x7f0dac0c92b0 2023-11-04T01:46:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0da27fc640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0d900664a0 0x7f0d90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7416+0+0 (secure 0 0 0) 0x7f0da40845e0 con 0x7f0dac0c92b0 2023-11-04T01:46:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.231+0000 7f0db1cc9640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0d900664a0 0x7f0d90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.235+0000 7f0db1cc9640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0d900664a0 0x7f0d90068960 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0da8000f70 tx=0x7f0da8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.235+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0da4051310 con 0x7f0dac0c92b0 2023-11-04T01:46:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.427+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dac06cf10 con 0x7f0dac0c92b0 2023-11-04T01:46:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.427+0000 7f0da27fc640 1 -- 172.21.15.40:0/2833366144 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4980 (secure 0 0 0) 0x7f0da4059e60 con 0x7f0dac0c92b0 2023-11-04T01:46:41.432 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:41.432 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:38.010889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6766,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6766":{"gid":6766,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/1982091809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":1982091809},{"type":"v1","addr":"172.21.15.91:6837","nonce":1982091809}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:46:38.010889+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 99 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0d900664a0 msgr2=0x7f0d90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0d900664a0 0x7f0d90068960 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0da8000f70 tx=0x7f0da8009040 comp rx=0 tx=0).stop 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 msgr2=0x7f0dac13f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac13f460 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f0da400cb70 tx=0x7f0da400a430 comp rx=0 tx=0).stop 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 shutdown_connections 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f0d900664a0 0x7f0d90068960 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dac0c92b0 0x7f0dac13f460 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0dac06c1c0 0x7f0dac0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 --2- 172.21.15.40:0/2833366144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f0dac06bde0 0x7f0dac13afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 >> 172.21.15.40:0/2833366144 conn(0x7f0dac0b0890 msgr2=0x7f0dac15beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 shutdown_connections 2023-11-04T01:46:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.431+0000 7f0db3f2d640 1 -- 172.21.15.40:0/2833366144 wait complete. 2023-11-04T01:46:41.452 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-04T01:46:41.452 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:41.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:41.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 down 2023-11-04T01:46:41.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:46:41.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 Processor -- start 2023-11-04T01:46:41.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 -- start start 2023-11-04T01:46:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f572015b0c0 0x7f5720071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5720070310 0x7f572015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b9e0 0x7f572015c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572006ab40 con 0x7f5720070310 2023-11-04T01:46:41.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572006b830 con 0x7f572015b0c0 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f572731b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5720072430 con 0x7f572015b9e0 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5720070310 0x7f572015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5720070310 0x7f572015b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45724/0 (socket says 172.21.15.40:45724) 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 -- 172.21.15.40:0/663072049 learned_addr learned my addr 172.21.15.40:0/663072049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57250b7640 1 --2- 172.21.15.40:0/663072049 >> v2:172.21.15.91:3300/0 conn(0x7f572015b0c0 0x7f5720071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57258b8640 1 --2- 172.21.15.40:0/663072049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b9e0 0x7f572015c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 -- 172.21.15.40:0/663072049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b9e0 msgr2=0x7f572015c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 --2- 172.21.15.40:0/663072049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b9e0 0x7f572015c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 -- 172.21.15.40:0/663072049 >> v2:172.21.15.91:3300/0 conn(0x7f572015b0c0 msgr2=0x7f5720071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 --2- 172.21.15.40:0/663072049 >> v2:172.21.15.91:3300/0 conn(0x7f572015b0c0 0x7f5720071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.627+0000 7f57248b6640 1 -- 172.21.15.40:0/663072049 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572006ad50 con 0x7f5720070310 2023-11-04T01:46:41.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57248b6640 1 --2- 172.21.15.40:0/663072049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5720070310 0x7f572015b4a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f57200cce30 tx=0x7f571401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8d01d146b430db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:41.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f571ffff640 1 -- 172.21.15.40:0/663072049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140ac410 con 0x7f5720070310 2023-11-04T01:46:41.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f571ffff640 1 -- 172.21.15.40:0/663072049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57140ac570 con 0x7f5720070310 2023-11-04T01:46:41.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f571ffff640 1 -- 172.21.15.40:0/663072049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140ac900 con 0x7f5720070310 2023-11-04T01:46:41.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- 172.21.15.40:0/663072049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5720070310 msgr2=0x7f572015b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- 172.21.15.40:0/663072049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5720070310 0x7f572015b4a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f57200cce30 tx=0x7f571401c500 comp rx=0 tx=0).stop 2023-11-04T01:46:41.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- 172.21.15.40:0/663072049 shutdown_connections 2023-11-04T01:46:41.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- 172.21.15.40:0/663072049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b9e0 0x7f572015c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- 172.21.15.40:0/663072049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5720070310 0x7f572015b4a0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- 172.21.15.40:0/663072049 >> v2:172.21.15.91:3300/0 conn(0x7f572015b0c0 0x7f5720071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- 172.21.15.40:0/663072049 >> 172.21.15.40:0/663072049 conn(0x7f57200b1050 msgr2=0x7f57200b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:41.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- 172.21.15.40:0/663072049 shutdown_connections 2023-11-04T01:46:41.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- 172.21.15.40:0/663072049 wait complete. 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 Processor -- start 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- start start 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5720070310 0x7f5720162f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b0c0 0x7f572014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 0x7f57201f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572014ea10 con 0x7f572015b9e0 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200cd960 con 0x7f5720070310 2023-11-04T01:46:41.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f572731b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57201f6c90 con 0x7f572015b0c0 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 0x7f57201f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 0x7f57201f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45728/0 (socket says 172.21.15.40:45728) 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 -- 172.21.15.40:0/3055263559 learned_addr learned my addr 172.21.15.40:0/3055263559 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57248b6640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b0c0 0x7f572014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57250b7640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5720070310 0x7f5720162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 -- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b0c0 msgr2=0x7f572014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b0c0 0x7f572014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 -- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5720070310 msgr2=0x7f5720162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5720070310 0x7f5720162f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 -- 172.21.15.40:0/3055263559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140094d0 con 0x7f572015b9e0 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.631+0000 7f57258b8640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 0x7f57201f61a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f5710007e60 tx=0x7f571000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:41.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710014420 con 0x7f572015b9e0 2023-11-04T01:46:41.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57100145a0 con 0x7f572015b9e0 2023-11-04T01:46:41.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57201f6f70 con 0x7f572015b9e0 2023-11-04T01:46:41.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710014950 con 0x7f572015b9e0 2023-11-04T01:46:41.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57200cde90 con 0x7f572015b9e0 2023-11-04T01:46:41.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200ce080 con 0x7f572015b9e0 2023-11-04T01:46:41.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5710014ab0 con 0x7f572015b9e0 2023-11-04T01:46:41.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f571dffb640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f570c0664a0 0x7f570c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7416+0+0 (secure 0 0 0) 0x7f5710084e50 con 0x7f572015b9e0 2023-11-04T01:46:41.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f57250b7640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f570c0664a0 0x7f570c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.635+0000 7f57250b7640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f570c0664a0 0x7f570c068960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f571800ba30 tx=0x7f5718008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:41.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.639+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5710051c20 con 0x7f572015b9e0 2023-11-04T01:46:41.653 INFO:tasks.ceph.mds.c.smithi040.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:46:41.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:46:41.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.847+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f5720072070 con 0x7f572015b9e0 2023-11-04T01:46:41.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f571dffb640 1 -- 172.21.15.40:0/3055263559 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6766 v100) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5710055240 con 0x7f572015b9e0 2023-11-04T01:46:41.855 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 6766 2023-11-04T01:46:41.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f570c0664a0 msgr2=0x7f570c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f570c0664a0 0x7f570c068960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f571800ba30 tx=0x7f5718008040 comp rx=0 tx=0).stop 2023-11-04T01:46:41.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 msgr2=0x7f57201f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:41.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 0x7f57201f61a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f5710007e60 tx=0x7f571000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 shutdown_connections 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f570c0664a0 0x7f570c068960 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f572015b9e0 0x7f57201f61a0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f572015b0c0 0x7f572014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 --2- 172.21.15.40:0/3055263559 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5720070310 0x7f5720162f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 >> 172.21.15.40:0/3055263559 conn(0x7f57200b1050 msgr2=0x7f572015a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.851+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 shutdown_connections 2023-11-04T01:46:41.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.855+0000 7f572731b640 1 -- 172.21.15.40:0/3055263559 wait complete. 2023-11-04T01:46:41.873 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:46:41.873 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:46:41.873 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:46:41.873 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:41.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:41.874 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:46:41.874 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:46:41.874 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:46:41.877 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:46:41.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:41.949 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:46:41.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe826e5b640 1 Processor -- start 2023-11-04T01:46:41.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe826e5b640 1 -- start start 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe826e5b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe820142ad0 0x7fe82015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe826e5b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200ca100 con 0x7fe820142eb0 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe826e5b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200ca3e0 con 0x7fe8200cbd80 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe826e5b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8200ca6c0 con 0x7fe820142ad0 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe81ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe820142eb0 0x7fe8200cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57382/0 (socket says 172.21.15.40:57382) 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe81ffff640 1 -- 172.21.15.40:0/2693140456 learned_addr learned my addr 172.21.15.40:0/2693140456 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe824bf7640 1 --2- 172.21.15.40:0/2693140456 >> v2:172.21.15.40:3300/0 conn(0x7fe820142ad0 0x7fe82015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe81f7fe640 1 -- 172.21.15.40:0/2693140456 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293240458 0 0) 0x7fe8200ca100 con 0x7fe820142eb0 2023-11-04T01:46:41.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe81f7fe640 1 -- 172.21.15.40:0/2693140456 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003530 con 0x7fe820142eb0 2023-11-04T01:46:42.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe824bf7640 1 -- 172.21.15.40:0/2693140456 >> v1:172.21.15.91:6789/0 conn(0x7fe8200cbd80 legacy=0x7fe8200c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe824bf7640 1 -- 172.21.15.40:0/2693140456 >> v1:172.21.15.40:6789/0 conn(0x7fe820142eb0 legacy=0x7fe8200cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.995+0000 7fe824bf7640 1 -- 172.21.15.40:0/2693140456 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8200ca9a0 con 0x7fe820142ad0 2023-11-04T01:46:42.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe824bf7640 1 --2- 172.21.15.40:0/2693140456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142ad0 0x7fe82015e4e0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fe8100097c0 tx=0x7fe81001e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7512245020106c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:42.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe81f7fe640 1 -- 172.21.15.40:0/2693140456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8100ad600 con 0x7fe820142ad0 2023-11-04T01:46:42.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe81f7fe640 1 -- 172.21.15.40:0/2693140456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8100a9050 con 0x7fe820142ad0 2023-11-04T01:46:42.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe81f7fe640 1 -- 172.21.15.40:0/2693140456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8100ad980 con 0x7fe820142ad0 2023-11-04T01:46:42.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- 172.21.15.40:0/2693140456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142ad0 msgr2=0x7fe82015e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 --2- 172.21.15.40:0/2693140456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142ad0 0x7fe82015e4e0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fe8100097c0 tx=0x7fe81001e600 comp rx=0 tx=0).stop 2023-11-04T01:46:42.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- 172.21.15.40:0/2693140456 shutdown_connections 2023-11-04T01:46:42.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 --2- 172.21.15.40:0/2693140456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142ad0 0x7fe82015e4e0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- 172.21.15.40:0/2693140456 >> 172.21.15.40:0/2693140456 conn(0x7fe8200b0890 msgr2=0x7fe8200b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:42.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- 172.21.15.40:0/2693140456 shutdown_connections 2023-11-04T01:46:42.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- 172.21.15.40:0/2693140456 wait complete. 2023-11-04T01:46:42.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 Processor -- start 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- start start 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8200cbd80 0x7fe8200b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe820142ad0 0x7fe8200b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 0x7fe8200c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200b3a70 con 0x7fe820142eb0 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200b27e0 con 0x7fe8200cbd80 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe826e5b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200b2a50 con 0x7fe820142ad0 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 0x7fe8200c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 0x7fe8200c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45744/0 (socket says 172.21.15.40:45744) 2023-11-04T01:46:42.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 -- 172.21.15.40:0/1466992156 learned_addr learned my addr 172.21.15.40:0/1466992156 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe81ffff640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe820142ad0 0x7fe8200b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe824bf7640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8200cbd80 0x7fe8200b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 -- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe820142ad0 msgr2=0x7fe8200b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe820142ad0 0x7fe8200b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 -- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8200cbd80 msgr2=0x7fe8200b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8200cbd80 0x7fe8200b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 -- 172.21.15.40:0/1466992156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810009420 con 0x7fe820142eb0 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe824bf7640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8200cbd80 0x7fe8200b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:41.999+0000 7fe8253f8640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 0x7fe8200c7de0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c400 tx=0x7fe81800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180052d0 con 0x7fe820142eb0 2023-11-04T01:46:42.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818005430 con 0x7fe820142eb0 2023-11-04T01:46:42.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8200b2d30 con 0x7fe820142eb0 2023-11-04T01:46:42.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818003800 con 0x7fe820142eb0 2023-11-04T01:46:42.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8200b4800 con 0x7fe820142eb0 2023-11-04T01:46:42.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82004e4a0 con 0x7fe820142eb0 2023-11-04T01:46:42.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe818003960 con 0x7fe820142eb0 2023-11-04T01:46:42.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe81d7fa640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe80c0664d0 0x7fe80c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:42.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7474+0+0 (secure 0 0 0) 0x7fe818083a50 con 0x7fe820142eb0 2023-11-04T01:46:42.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe824bf7640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe80c0664d0 0x7fe80c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:42.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.003+0000 7fe824bf7640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe80c0664d0 0x7fe80c068990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8100af000 tx=0x7fe8100a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:42.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.007+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe818050770 con 0x7fe820142eb0 2023-11-04T01:46:42.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.199+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8200b31e0 con 0x7fe820142eb0 2023-11-04T01:46:42.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.199+0000 7fe81d7fa640 1 -- 172.21.15.40:0/1466992156 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4143 (secure 0 0 0) 0x7fe818053d90 con 0x7fe820142eb0 2023-11-04T01:46:42.204 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:42.204 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":101,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:41.862510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:replay","state_seq":1,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:42.204 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 101 2023-11-04T01:46:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe80c0664d0 msgr2=0x7fe80c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe80c0664d0 0x7fe80c068990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8100af000 tx=0x7fe8100a8000 comp rx=0 tx=0).stop 2023-11-04T01:46:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 msgr2=0x7fe8200c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 0x7fe8200c7de0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c400 tx=0x7fe81800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 shutdown_connections 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe80c0664d0 0x7fe80c068990 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe820142eb0 0x7fe8200c7de0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe820142ad0 0x7fe8200b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 --2- 172.21.15.40:0/1466992156 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe8200cbd80 0x7fe8200b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 >> 172.21.15.40:0/1466992156 conn(0x7fe8200b0890 msgr2=0x7fe8200b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 shutdown_connections 2023-11-04T01:46:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:42.203+0000 7fe826e5b640 1 -- 172.21.15.40:0/1466992156 wait complete. 2023-11-04T01:46:42.223 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:47.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f697dec7640 1 Processor -- start 2023-11-04T01:46:47.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f697dec7640 1 -- start start 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f697dec7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f69780ccf10 0x7f69780b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f697dec7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6978158d80 con 0x7f69780b3260 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f697dec7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780cda60 con 0x7f69780ccb30 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f697dec7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780cdd40 con 0x7f69780ccf10 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6977fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f69780b3260 0x7f697815b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48674/0 (socket says 172.21.15.40:48674) 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6977fff640 1 -- 172.21.15.40:0/2684739885 learned_addr learned my addr 172.21.15.40:0/2684739885 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6976ffd640 1 --2- 172.21.15.40:0/2684739885 >> v2:172.21.15.91:3300/0 conn(0x7f69780ccf10 0x7f69780b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921130302 0 0) 0x7f6978158d80 con 0x7f69780b3260 2023-11-04T01:46:47.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6964003530 con 0x7f69780b3260 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156199847 0 0) 0x7f6964003530 con 0x7f69780b3260 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 >> v2:172.21.15.91:3300/0 conn(0x7f69780ccf10 msgr2=0x7f69780b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 --2- 172.21.15.40:0/2684739885 >> v2:172.21.15.91:3300/0 conn(0x7f69780ccf10 0x7f69780b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 >> v1:172.21.15.91:6789/0 conn(0x7f69780ccb30 legacy=0x7f6978070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780ce020 con 0x7f69780b3260 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f69680016d0 con 0x7f69780b3260 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 >> v1:172.21.15.40:6789/0 conn(0x7f69780b3260 legacy=0x7f697815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6964003980 0x7f6964003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640047d0 0x7f6964004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964005190 0x7f696400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780cdd40 con 0x7f6964003980 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696400c030 con 0x7f69640047d0 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696400c1f0 con 0x7f6964005190 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69777fe640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6964003980 0x7f6964003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6976ffd640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640047d0 0x7f6964004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6977fff640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964005190 0x7f696400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69777fe640 1 -- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964005190 msgr2=0x7f696400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69777fe640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964005190 0x7f696400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69777fe640 1 -- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640047d0 msgr2=0x7f6964004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69777fe640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69640047d0 0x7f6964004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f69777fe640 1 -- 172.21.15.40:0/2684739885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964003530 con 0x7f6964003980 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6977fff640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964005190 0x7f696400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:47.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.355+0000 7f6977fff640 1 -- 172.21.15.40:0/2684739885 reap_dead start 2023-11-04T01:46:47.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f69777fe640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6964003980 0x7f6964003da0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6970001e70 tx=0x7f697001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17985ee5cad3a36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:47.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970003b80 con 0x7f6964003980 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970003ce0 con 0x7f6964003980 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f69767fc640 1 -- 172.21.15.40:0/2684739885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970005310 con 0x7f6964003980 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 -- 172.21.15.40:0/2684739885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6964003980 msgr2=0x7f6964003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6964003980 0x7f6964003da0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6970001e70 tx=0x7f697001c710 comp rx=0 tx=0).stop 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 -- 172.21.15.40:0/2684739885 shutdown_connections 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 --2- 172.21.15.40:0/2684739885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6964003980 0x7f6964003da0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 -- 172.21.15.40:0/2684739885 >> 172.21.15.40:0/2684739885 conn(0x7f697806dd80 msgr2=0x7f697806e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 -- 172.21.15.40:0/2684739885 shutdown_connections 2023-11-04T01:46:47.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 -- 172.21.15.40:0/2684739885 wait complete. 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 Processor -- start 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.359+0000 7f697dec7640 1 -- start start 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964003980 0x7f69780c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69780c6700 0x7f69781e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 0x7f69781e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c9950 con 0x7f69780c6b60 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780c9ec0 con 0x7f69780c6700 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780ca140 con 0x7f6964003980 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 0x7f69781e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 0x7f69781e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52534/0 (socket says 172.21.15.40:52534) 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 -- 172.21.15.40:0/1081521964 learned_addr learned my addr 172.21.15.40:0/1081521964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6976ffd640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69780c6700 0x7f69781e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f69777fe640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964003980 0x7f69780c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 -- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964003980 msgr2=0x7f69780c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964003980 0x7f69780c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 -- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69780c6700 msgr2=0x7f69781e78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69780c6700 0x7f69781e78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 -- 172.21.15.40:0/1081521964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780ca420 con 0x7f69780c6b60 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f6977fff640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 0x7f69781e7df0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6968001050 tx=0x7f696800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968004c50 con 0x7f69780c6b60 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968004dd0 con 0x7f69780c6b60 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69780ca700 con 0x7f69780c6b60 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680072b0 con 0x7f69780c6b60 2023-11-04T01:46:47.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69780cacc0 con 0x7f69780c6b60 2023-11-04T01:46:47.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69780caeb0 con 0x7f69780c6b60 2023-11-04T01:46:47.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6968007410 con 0x7f69780c6b60 2023-11-04T01:46:47.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f696ffff640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69580664d0 0x7f6958068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7474+0+0 (secure 0 0 0) 0x7f6968083fe0 con 0x7f69780c6b60 2023-11-04T01:46:47.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.363+0000 7f69777fe640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69580664d0 0x7f6958068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.367+0000 7f69777fe640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69580664d0 0x7f6958068990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f69700ac000 tx=0x7f6970001520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:47.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.367+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6968050ca0 con 0x7f69780c6b60 2023-11-04T01:46:47.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.559+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f697804e4a0 con 0x7f69780c6b60 2023-11-04T01:46:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.559+0000 7f696ffff640 1 -- 172.21.15.40:0/1081521964 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4937 (secure 0 0 0) 0x7f69680542c0 con 0x7f69780c6b60 2023-11-04T01:46:47.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:47.563 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:41.898365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:resolve","state_seq":11,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 102 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69580664d0 msgr2=0x7f6958068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69580664d0 0x7f6958068990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f69700ac000 tx=0x7f6970001520 comp rx=0 tx=0).stop 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 msgr2=0x7f69781e7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 0x7f69781e7df0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6968001050 tx=0x7f696800d950 comp rx=0 tx=0).stop 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 shutdown_connections 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f69580664d0 0x7f6958068990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780c6b60 0x7f69781e7df0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f69780c6700 0x7f69781e78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 --2- 172.21.15.40:0/1081521964 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6964003980 0x7f69780c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 >> 172.21.15.40:0/1081521964 conn(0x7f697806dd80 msgr2=0x7f6978158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:47.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 shutdown_connections 2023-11-04T01:46:47.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.563+0000 7f697dec7640 1 -- 172.21.15.40:0/1081521964 wait complete. 2023-11-04T01:46:47.583 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:47.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:47.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7d569f640 1 Processor -- start 2023-11-04T01:46:47.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7d569f640 1 -- start start 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7d569f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7d00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7d569f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d00cf000 con 0x7fc7d00ce7f0 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7d569f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d00b5de0 con 0x7fc7d0160a60 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7d569f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00d09b0 con 0x7fc7d0160680 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cf7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc7d00ce7f0 0x7fc7d00b62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48680/0 (socket says 172.21.15.40:48680) 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cf7fe640 1 -- 172.21.15.40:0/1226719693 learned_addr learned my addr 172.21.15.40:0/1226719693 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:47.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7ceffd640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7d00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946783745 0 0) 0x7fc7d00cf000 con 0x7fc7d00ce7f0 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b8003530 con 0x7fc7d00ce7f0 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061112390 0 0) 0x7fc7b8003530 con 0x7fc7d00ce7f0 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 msgr2=0x7fc7d00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7d00cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 >> v1:172.21.15.91:6789/0 conn(0x7fc7d0160a60 legacy=0x7fc7d00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00d1610 con 0x7fc7d00ce7f0 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fc7c8001a00 con 0x7fc7d00ce7f0 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 >> v1:172.21.15.40:6789/0 conn(0x7fc7d00ce7f0 legacy=0x7fc7d00b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7b80039b0 0x7fc7b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.695+0000 7fc7cdffb640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00d09b0 con 0x7fc7b80047d0 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b800ba40 con 0x7fc7b80039b0 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b800bc00 con 0x7fc7d0160680 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ceffd640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7b80039b0 0x7fc7b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cf7fe640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 -- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 msgr2=0x7fc7b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7b8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 -- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7b80039b0 msgr2=0x7fc7b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7b80039b0 0x7fc7b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 -- 172.21.15.40:0/1226719693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8003530 con 0x7fc7b80047d0 2023-11-04T01:46:47.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cf7fe640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d0160680 0x7fc7b8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7b8004c50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001750 tx=0x7fc7c401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3522f882417be90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40052d0 con 0x7fc7b80047d0 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c40a7050 con 0x7fc7b80047d0 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cdffb640 1 -- 172.21.15.40:0/1226719693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4003600 con 0x7fc7b80047d0 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7d569f640 1 -- 172.21.15.40:0/1226719693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 msgr2=0x7fc7b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7d569f640 1 --2- 172.21.15.40:0/1226719693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7b8004c50 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001750 tx=0x7fc7c401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7cf7fe640 1 -- 172.21.15.40:0/1226719693 reap_dead start 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7d569f640 1 -- 172.21.15.40:0/1226719693 shutdown_connections 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7d569f640 1 -- 172.21.15.40:0/1226719693 >> 172.21.15.40:0/1226719693 conn(0x7fc7d00d2f90 msgr2=0x7fc7d00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:47.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7d569f640 1 -- 172.21.15.40:0/1226719693 shutdown_connections 2023-11-04T01:46:47.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.699+0000 7fc7d569f640 1 -- 172.21.15.40:0/1226719693 wait complete. 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 Processor -- start 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- start start 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7d01f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7d00ca590 0x7fc7d00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d01e65c0 0x7fc7d01e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01e6f80 con 0x7fc7b80047d0 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00c8880 con 0x7fc7d00ca590 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00c8b60 con 0x7fc7d01e65c0 2023-11-04T01:46:47.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7d01f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7d01f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52562/0 (socket says 172.21.15.40:52562) 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 -- 172.21.15.40:0/2253543700 learned_addr learned my addr 172.21.15.40:0/2253543700 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7d00ca590 0x7fc7d00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7cf7fe640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d01e65c0 0x7fc7d01e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 -- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d01e65c0 msgr2=0x7fc7d01e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d01e65c0 0x7fc7d01e6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 -- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7d00ca590 msgr2=0x7fc7d00c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7d00ca590 0x7fc7d00c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 -- 172.21.15.40:0/2253543700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00c8e40 con 0x7fc7b80047d0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7ceffd640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7d01f5b80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00115e0 tx=0x7fc7c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000f8f0 con 0x7fc7b80047d0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c000fa50 con 0x7fc7b80047d0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000fdc0 con 0x7fc7b80047d0 2023-11-04T01:46:47.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d00c9120 con 0x7fc7b80047d0 2023-11-04T01:46:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d00c8590 con 0x7fc7b80047d0 2023-11-04T01:46:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d004e4a0 con 0x7fc7b80047d0 2023-11-04T01:46:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.703+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc7c0015460 con 0x7fc7b80047d0 2023-11-04T01:46:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.707+0000 7fc7b77fe640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7bc0664d0 0x7fc7bc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.707+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7474+0+0 (secure 0 0 0) 0x7fc7c00848c0 con 0x7fc7b80047d0 2023-11-04T01:46:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.707+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7bc0664d0 0x7fc7bc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.707+0000 7fc7ce7fc640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7bc0664d0 0x7fc7bc068990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80057b0 tx=0x7fc7c40011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:47.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.711+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7c00516f0 con 0x7fc7b80047d0 2023-11-04T01:46:47.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.899+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d015ee80 con 0x7fc7b80047d0 2023-11-04T01:46:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.899+0000 7fc7b77fe640 1 -- 172.21.15.40:0/2253543700 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4937 (secure 0 0 0) 0x7fc7c0054d10 con 0x7fc7b80047d0 2023-11-04T01:46:47.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:47.904 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:41.898365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:resolve","state_seq":11,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:47.904 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 102 2023-11-04T01:46:47.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7bc0664d0 msgr2=0x7fc7bc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7bc0664d0 0x7fc7bc068990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80057b0 tx=0x7fc7c40011a0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 msgr2=0x7fc7d01f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7d01f5b80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00115e0 tx=0x7fc7c0011aa0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 shutdown_connections 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc7bc0664d0 0x7fc7bc068990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc7d01e65c0 0x7fc7d01e6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc7d00ca590 0x7fc7d00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 --2- 172.21.15.40:0/2253543700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7b80047d0 0x7fc7d01f5b80 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 >> 172.21.15.40:0/2253543700 conn(0x7fc7d00d2f90 msgr2=0x7fc7d00cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 shutdown_connections 2023-11-04T01:46:47.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:47.903+0000 7fc7d569f640 1 -- 172.21.15.40:0/2253543700 wait complete. 2023-11-04T01:46:47.922 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:46:47.922 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3389902114868164s 2023-11-04T01:46:47.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:48.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 Processor -- start 2023-11-04T01:46:48.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 -- start start 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2ae4153ae0 0x7f2ae40cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ae415d840 0x7f2ae406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae40ca010 con 0x7f2ae40caf00 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae40cd7b0 con 0x7f2ae415d840 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2aea23b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae40ca260 con 0x7f2ae4153ae0 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ae415d840 0x7f2ae406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ae415d840 0x7f2ae406bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52566/0 (socket says 172.21.15.40:52566) 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 -- 172.21.15.40:0/79525973 learned_addr learned my addr 172.21.15.40:0/79525973 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae37fe640 1 --2- 172.21.15.40:0/79525973 >> v2:172.21.15.91:3300/0 conn(0x7f2ae4153ae0 0x7f2ae40cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 -- 172.21.15.40:0/79525973 >> v2:172.21.15.91:3300/0 conn(0x7f2ae4153ae0 msgr2=0x7f2ae40cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 --2- 172.21.15.40:0/79525973 >> v2:172.21.15.91:3300/0 conn(0x7f2ae4153ae0 0x7f2ae40cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 -- 172.21.15.40:0/79525973 >> v1:172.21.15.91:6789/0 conn(0x7f2ae40caf00 legacy=0x7f2ae415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 -- 172.21.15.40:0/79525973 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40ca540 con 0x7f2ae415d840 2023-11-04T01:46:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.043+0000 7f2ae3fff640 1 --2- 172.21.15.40:0/79525973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae415d840 0x7f2ae406bc80 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40c3c90 tx=0x7f2ad401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d439c89d6a600035 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae27fc640 1 -- 172.21.15.40:0/79525973 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40a5660 con 0x7f2ae415d840 2023-11-04T01:46:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae27fc640 1 -- 172.21.15.40:0/79525973 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40a57c0 con 0x7f2ae415d840 2023-11-04T01:46:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae27fc640 1 -- 172.21.15.40:0/79525973 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40a5b50 con 0x7f2ae415d840 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- 172.21.15.40:0/79525973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae415d840 msgr2=0x7f2ae406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 --2- 172.21.15.40:0/79525973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae415d840 0x7f2ae406bc80 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40c3c90 tx=0x7f2ad401c990 comp rx=0 tx=0).stop 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- 172.21.15.40:0/79525973 shutdown_connections 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 --2- 172.21.15.40:0/79525973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae415d840 0x7f2ae406bc80 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 --2- 172.21.15.40:0/79525973 >> v2:172.21.15.91:3300/0 conn(0x7f2ae4153ae0 0x7f2ae40cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- 172.21.15.40:0/79525973 >> 172.21.15.40:0/79525973 conn(0x7f2ae40b0890 msgr2=0x7f2ae40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- 172.21.15.40:0/79525973 shutdown_connections 2023-11-04T01:46:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- 172.21.15.40:0/79525973 wait complete. 2023-11-04T01:46:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 Processor -- start 2023-11-04T01:46:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- start start 2023-11-04T01:46:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ae40caf00 0x7f2ae414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 0x7f2ae4146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ae415d840 0x7f2ae41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4147050 con 0x7f2ae4153ae0 2023-11-04T01:46:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4163f00 con 0x7f2ae40caf00 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2aea23b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41635b0 con 0x7f2ae415d840 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 0x7f2ae4146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 0x7f2ae4146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52582/0 (socket says 172.21.15.40:52582) 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 -- 172.21.15.40:0/1446355805 learned_addr learned my addr 172.21.15.40:0/1446355805 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae3fff640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ae415d840 0x7f2ae41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae37fe640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ae40caf00 0x7f2ae414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 -- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ae415d840 msgr2=0x7f2ae41588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ae415d840 0x7f2ae41588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 -- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ae40caf00 msgr2=0x7f2ae414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ae40caf00 0x7f2ae414fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 -- 172.21.15.40:0/1446355805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009b30 con 0x7f2ae4153ae0 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae37fe640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ae40caf00 0x7f2ae414fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.047+0000 7f2ae2ffd640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 0x7f2ae4146b10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c450 tx=0x7f2acc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc012830 con 0x7f2ae4153ae0 2023-11-04T01:46:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc0129b0 con 0x7f2ae4153ae0 2023-11-04T01:46:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae41f91c0 con 0x7f2ae4153ae0 2023-11-04T01:46:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc012d60 con 0x7f2ae4153ae0 2023-11-04T01:46:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae41f9780 con 0x7f2ae4153ae0 2023-11-04T01:46:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae41f99a0 con 0x7f2ae4153ae0 2023-11-04T01:46:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2acc01c460 con 0x7f2ae4153ae0 2023-11-04T01:46:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2adbfff640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ac40664a0 0x7f2ac4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.051+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7474+0+0 (secure 0 0 0) 0x7f2acc084300 con 0x7f2ae4153ae0 2023-11-04T01:46:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.055+0000 7f2ae37fe640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ac40664a0 0x7f2ac4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.055+0000 7f2ae37fe640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ac40664a0 0x7f2ac4068960 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009840 tx=0x7f2adc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.059+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2acc051120 con 0x7f2ae4153ae0 2023-11-04T01:46:48.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.243+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ae404e4a0 con 0x7f2ae4153ae0 2023-11-04T01:46:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2adbfff640 1 -- 172.21.15.40:0/1446355805 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4937 (secure 0 0 0) 0x7f2acc054740 con 0x7f2ae4153ae0 2023-11-04T01:46:48.249 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:48.249 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:41.898365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":7956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7956":{"gid":7956,"name":"c","rank":1,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.40:6833/3717165508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3717165508},{"type":"v1","addr":"172.21.15.40:6833","nonce":3717165508}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:resolve","state_seq":11,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:48.250 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 102 2023-11-04T01:46:48.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ac40664a0 msgr2=0x7f2ac4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ac40664a0 0x7f2ac4068960 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009840 tx=0x7f2adc008040 comp rx=0 tx=0).stop 2023-11-04T01:46:48.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 msgr2=0x7f2ae4146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 0x7f2ae4146b10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c450 tx=0x7f2acc00c910 comp rx=0 tx=0).stop 2023-11-04T01:46:48.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 shutdown_connections 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f2ac40664a0 0x7f2ac4068960 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2ae415d840 0x7f2ae41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ae4153ae0 0x7f2ae4146b10 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 --2- 172.21.15.40:0/1446355805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2ae40caf00 0x7f2ae414fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 >> 172.21.15.40:0/1446355805 conn(0x7f2ae40b0890 msgr2=0x7f2ae40af910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 shutdown_connections 2023-11-04T01:46:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.247+0000 7f2aea23b640 1 -- 172.21.15.40:0/1446355805 wait complete. 2023-11-04T01:46:48.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:46:48.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:46:48.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:46:48.390 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":11,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":22,"snapinfo":{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:24.386602+0000","name":"s25","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:46:48.390 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:24.386602+0000" }, "version": 22 } ], "snaps": [] } 2023-11-04T01:46:48.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:46:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 Processor -- start 2023-11-04T01:46:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 -- start start 2023-11-04T01:46:48.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe8006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efe80071740 0x7efe8006a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8006dbb0 con 0x7efe80071ba0 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800cdce0 con 0x7efe80071740 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe865d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe80070c60 con 0x7efe801607e0 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efe80071ba0 0x7efe800ac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48688/0 (socket says 172.21.15.40:48688) 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 -- 172.21.15.40:0/1069471366 learned_addr learned my addr 172.21.15.40:0/1069471366 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056365919 0 0) 0x7efe8006dbb0 con 0x7efe80071ba0 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe68003530 con 0x7efe80071ba0 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7ffff640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe8006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7f7fe640 1 --2- 172.21.15.40:0/1069471366 >> v2:172.21.15.91:3300/0 conn(0x7efe80071740 0x7efe8006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220464530 0 0) 0x7efe68003530 con 0x7efe80071ba0 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 msgr2=0x7efe8006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe8006d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 >> v2:172.21.15.91:3300/0 conn(0x7efe80071740 msgr2=0x7efe8006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 --2- 172.21.15.40:0/1069471366 >> v2:172.21.15.91:3300/0 conn(0x7efe80071740 0x7efe8006a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80070f40 con 0x7efe80071ba0 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7efe78001a00 con 0x7efe80071ba0 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7ffff640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe8006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 >> v1:172.21.15.40:6789/0 conn(0x7efe80071ba0 legacy=0x7efe800ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe68003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe68003f70 0x7efe680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800cdce0 con 0x7efe68004d10 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80070c60 con 0x7efe68003f70 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6800ba70 con 0x7efe801607e0 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7f7fe640 1 --2- 172.21.15.40:0/1069471366 >> v2:172.21.15.91:3300/0 conn(0x7efe80071740 0x7efe8006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7ffff640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe68003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe7f7fe640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe68003f70 0x7efe680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 -- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 msgr2=0x7efe68003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe801607e0 0x7efe68003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 -- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe68003f70 msgr2=0x7efe680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe68003f70 0x7efe680047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.499+0000 7efe84b72640 1 -- 172.21.15.40:0/1069471366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68003530 con 0x7efe68004d10 2023-11-04T01:46:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe84b72640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe68005190 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7efe7800a860 tx=0x7efe7801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933de75a3d4a923d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780ad630 con 0x7efe68004d10 2023-11-04T01:46:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe780a8070 con 0x7efe68004d10 2023-11-04T01:46:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe7effd640 1 -- 172.21.15.40:0/1069471366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780ada30 con 0x7efe68004d10 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- 172.21.15.40:0/1069471366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 msgr2=0x7efe68005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 --2- 172.21.15.40:0/1069471366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe68005190 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7efe7800a860 tx=0x7efe7801d360 comp rx=0 tx=0).stop 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe84b72640 1 -- 172.21.15.40:0/1069471366 reap_dead start 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- 172.21.15.40:0/1069471366 shutdown_connections 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- 172.21.15.40:0/1069471366 >> 172.21.15.40:0/1069471366 conn(0x7efe800b1940 msgr2=0x7efe800b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- 172.21.15.40:0/1069471366 shutdown_connections 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- 172.21.15.40:0/1069471366 wait complete. 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 Processor -- start 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- start start 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe801506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe80156d20 0x7efe801571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe80152c40 0x7efe801530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe801576e0 con 0x7efe68004d10 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80150c00 con 0x7efe80152c40 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe865d5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe80151f30 con 0x7efe80156d20 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.503+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe801506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe801506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52594/0 (socket says 172.21.15.40:52594) 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 -- 172.21.15.40:0/2058654068 learned_addr learned my addr 172.21.15.40:0/2058654068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7f7fe640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe80156d20 0x7efe801571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe84b72640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe80152c40 0x7efe801530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 -- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe80156d20 msgr2=0x7efe801571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe80156d20 0x7efe801571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 -- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe80152c40 msgr2=0x7efe801530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe80152c40 0x7efe801530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 -- 172.21.15.40:0/2058654068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80150e90 con 0x7efe68004d10 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7ffff640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe801506c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7efe70010890 tx=0x7efe70010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000cb40 con 0x7efe68004d10 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000cca0 con 0x7efe68004d10 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe80151170 con 0x7efe68004d10 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700156b0 con 0x7efe68004d10 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe80151730 con 0x7efe68004d10 2023-11-04T01:46:48.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8004e4a0 con 0x7efe68004d10 2023-11-04T01:46:48.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe70015810 con 0x7efe68004d10 2023-11-04T01:46:48.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7cff9640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efe6c0664d0 0x7efe6c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7474+0+0 (secure 0 0 0) 0x7efe70084e40 con 0x7efe68004d10 2023-11-04T01:46:48.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7f7fe640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efe6c0664d0 0x7efe6c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.507+0000 7efe7f7fe640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efe6c0664d0 0x7efe6c068990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efe801565b0 tx=0x7efe74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.511+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe70051bd0 con 0x7efe68004d10 2023-11-04T01:46:48.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.723+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7efe800b0220 con 0x7efe68004d10 2023-11-04T01:46:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe7cff9640 1 -- 172.21.15.40:0/2058654068 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7956 v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe700551f0 con 0x7efe68004d10 2023-11-04T01:46:48.730 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 7956 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efe6c0664d0 msgr2=0x7efe6c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efe6c0664d0 0x7efe6c068990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efe801565b0 tx=0x7efe74008040 comp rx=0 tx=0).stop 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 msgr2=0x7efe801506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe801506c0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7efe70010890 tx=0x7efe70010d50 comp rx=0 tx=0).stop 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 shutdown_connections 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7efe6c0664d0 0x7efe6c068990 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efe80152c40 0x7efe801530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7efe80156d20 0x7efe801571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 --2- 172.21.15.40:0/2058654068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe68004d10 0x7efe801506c0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 >> 172.21.15.40:0/2058654068 conn(0x7efe800b1940 msgr2=0x7efe800adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 shutdown_connections 2023-11-04T01:46:48.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.727+0000 7efe865d5640 1 -- 172.21.15.40:0/2058654068 wait complete. 2023-11-04T01:46:48.750 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:46:48.750 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:46:48.750 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:46:48.750 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:48.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:48.750 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:46:48.750 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:46:48.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:46:48.753 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:46:48.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:48.820 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-11-04T01:46:48.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 Processor -- start 2023-11-04T01:46:48.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 -- start start 2023-11-04T01:46:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4413e220 0x7f9c4415c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c4406a130 0x7f9c4406a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4406aad0 con 0x7f9c4415ec90 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c44071a70 con 0x7f9c4406a130 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c4972f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44070bc0 con 0x7f9c4413e220 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c427fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c4406a130 0x7f9c4406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c437fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c4415ec90 0x7f9c4415f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48702/0 (socket says 172.21.15.40:48702) 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c437fe640 1 -- 172.21.15.40:0/2030063812 learned_addr learned my addr 172.21.15.40:0/2030063812 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c42ffd640 1 --2- 172.21.15.40:0/2030063812 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4413e220 0x7f9c4415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c427fc640 1 -- 172.21.15.40:0/2030063812 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4413e220 msgr2=0x7f9c4415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c427fc640 1 --2- 172.21.15.40:0/2030063812 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4413e220 0x7f9c4415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c427fc640 1 -- 172.21.15.40:0/2030063812 >> v1:172.21.15.40:6789/0 conn(0x7f9c4415ec90 legacy=0x7f9c4415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c41ffb640 1 -- 172.21.15.40:0/2030063812 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289792807 0 0) 0x7f9c4406aad0 con 0x7f9c4415ec90 2023-11-04T01:46:48.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.871+0000 7f9c427fc640 1 -- 172.21.15.40:0/2030063812 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44070e60 con 0x7f9c4406a130 2023-11-04T01:46:48.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c427fc640 1 --2- 172.21.15.40:0/2030063812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4406a130 0x7f9c4406a590 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097c0 tx=0x7f9c2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcab03994c8753b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c41ffb640 1 -- 172.21.15.40:0/2030063812 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0ab650 con 0x7f9c4406a130 2023-11-04T01:46:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c41ffb640 1 -- 172.21.15.40:0/2030063812 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0ab7b0 con 0x7f9c4406a130 2023-11-04T01:46:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c41ffb640 1 -- 172.21.15.40:0/2030063812 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0abb40 con 0x7f9c4406a130 2023-11-04T01:46:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 -- 172.21.15.40:0/2030063812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4406a130 msgr2=0x7f9c4406a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 --2- 172.21.15.40:0/2030063812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4406a130 0x7f9c4406a590 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097c0 tx=0x7f9c2c01c450 comp rx=0 tx=0).stop 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 -- 172.21.15.40:0/2030063812 shutdown_connections 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 --2- 172.21.15.40:0/2030063812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4406a130 0x7f9c4406a590 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 --2- 172.21.15.40:0/2030063812 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4413e220 0x7f9c4415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 -- 172.21.15.40:0/2030063812 >> 172.21.15.40:0/2030063812 conn(0x7f9c440b18a0 msgr2=0x7f9c440b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 -- 172.21.15.40:0/2030063812 shutdown_connections 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 -- 172.21.15.40:0/2030063812 wait complete. 2023-11-04T01:46:48.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 Processor -- start 2023-11-04T01:46:48.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.875+0000 7f9c4972f640 1 -- start start 2023-11-04T01:46:48.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c4406a130 0x7f9c44152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 0x7f9c441543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4415ec90 0x7f9c440b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44152f70 con 0x7f9c4413e220 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44155790 con 0x7f9c4406a130 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44154c10 con 0x7f9c4415ec90 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 0x7f9c441543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 0x7f9c441543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52626/0 (socket says 172.21.15.40:52626) 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 -- 172.21.15.40:0/3073218366 learned_addr learned my addr 172.21.15.40:0/3073218366 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c437fe640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4415ec90 0x7f9c440b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c42ffd640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c4406a130 0x7f9c44152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 -- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4415ec90 msgr2=0x7f9c440b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4415ec90 0x7f9c440b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 -- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c4406a130 msgr2=0x7f9c44152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c4406a130 0x7f9c44152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 -- 172.21.15.40:0/3073218366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009420 con 0x7f9c4413e220 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c427fc640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 0x7f9c441543a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01ab00 tx=0x7f9c2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0bf610 con 0x7f9c4413e220 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0bf790 con 0x7f9c4413e220 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0bfb40 con 0x7f9c4413e220 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44154ef0 con 0x7f9c4413e220 2023-11-04T01:46:48.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c441554b0 con 0x7f9c4413e220 2023-11-04T01:46:48.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4413c150 con 0x7f9c4413e220 2023-11-04T01:46:48.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c2c0b5400 con 0x7f9c4413e220 2023-11-04T01:46:48.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c3b7fe640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c240664a0 0x7f9c24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:48.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7560+0+0 (secure 0 0 0) 0x7f9c2c11f540 con 0x7f9c4413e220 2023-11-04T01:46:48.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.879+0000 7f9c42ffd640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c240664a0 0x7f9c24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:48.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.883+0000 7f9c42ffd640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c240664a0 0x7f9c24068960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0096f0 tx=0x7f9c3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:48.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:48.883+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c4413c150 con 0x7f9c4413e220 2023-11-04T01:46:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.067+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c4413c150 con 0x7f9c4413e220 2023-11-04T01:46:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.067+0000 7f9c3b7fe640 1 -- 172.21.15.40:0/3073218366 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4146 (secure 0 0 0) 0x7f9c4413c150 con 0x7f9c4413e220 2023-11-04T01:46:49.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:49.073 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:48.738726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:replay","state_seq":1,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:resolve","state_seq":11,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:49.073 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 104 2023-11-04T01:46:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c240664a0 msgr2=0x7f9c24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c240664a0 0x7f9c24068960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0096f0 tx=0x7f9c3c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 msgr2=0x7f9c441543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 0x7f9c441543a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01ab00 tx=0x7f9c2c01ac90 comp rx=0 tx=0).stop 2023-11-04T01:46:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 shutdown_connections 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9c240664a0 0x7f9c24068960 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9c4415ec90 0x7f9c440b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c4413e220 0x7f9c441543a0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 --2- 172.21.15.40:0/3073218366 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9c4406a130 0x7f9c44152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 >> 172.21.15.40:0/3073218366 conn(0x7f9c440b18a0 msgr2=0x7f9c4415a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 shutdown_connections 2023-11-04T01:46:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:49.071+0000 7f9c4972f640 1 -- 172.21.15.40:0/3073218366 wait complete. 2023-11-04T01:46:49.090 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:54.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:54.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f4882ac8640 1 Processor -- start 2023-11-04T01:46:54.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f4882ac8640 1 -- start start 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f4882ac8640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f487c0cbd80 0x7f487c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f4882ac8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0ca100 con 0x7f487c142eb0 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f4882ac8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0ca3e0 con 0x7f487c142ad0 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f4882ac8640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0ca6c0 con 0x7f487c0cbd80 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f487bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f487c142eb0 0x7f487c0c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48706/0 (socket says 172.21.15.40:48706) 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.251+0000 7f487bfff640 1 -- 172.21.15.40:0/2769917633 learned_addr learned my addr 172.21.15.40:0/2769917633 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f4881065640 1 --2- 172.21.15.40:0/2769917633 >> v2:172.21.15.91:3300/0 conn(0x7f487c0cbd80 0x7f487c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081806118 0 0) 0x7f487c0ca100 con 0x7f487c142eb0 2023-11-04T01:46:54.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4868005740 con 0x7f487c142eb0 2023-11-04T01:46:54.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967976167 0 0) 0x7f4868005740 con 0x7f487c142eb0 2023-11-04T01:46:54.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 >> v2:172.21.15.91:3300/0 conn(0x7f487c0cbd80 msgr2=0x7f487c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2769917633 >> v2:172.21.15.91:3300/0 conn(0x7f487c0cbd80 0x7f487c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 >> v1:172.21.15.91:6789/0 conn(0x7f487c142ad0 legacy=0x7f487c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0ca9a0 con 0x7f487c142eb0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f486c001680 con 0x7f487c142eb0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 >> v1:172.21.15.40:6789/0 conn(0x7f487c142eb0 legacy=0x7f487c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4868005be0 0x7f4868006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48680069e0 0x7f4868006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680073f0 0x7f486800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0ca6c0 con 0x7f48680069e0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486800e340 con 0x7f48680073f0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486800e500 con 0x7f4868005be0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48680069e0 0x7f4868006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f4881065640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680073f0 0x7f486800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f4880864640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4868005be0 0x7f4868006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 -- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4868005be0 msgr2=0x7f4868006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4868005be0 0x7f4868006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 -- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680073f0 msgr2=0x7f486800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680073f0 0x7f486800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 -- 172.21.15.40:0/2769917633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868005740 con 0x7f48680069e0 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f4881065640 1 -- 172.21.15.40:0/2769917633 reap_dead start 2023-11-04T01:46:54.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f4880864640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4868005be0 0x7f4868006000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:54.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487bfff640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48680069e0 0x7f4868006e60 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f486c001ec0 tx=0x7f486c01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d90c8404257f24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c005ae0 con 0x7f48680069e0 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c005c40 con 0x7f48680069e0 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.255+0000 7f487b7fe640 1 -- 172.21.15.40:0/2769917633 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0a5a40 con 0x7f48680069e0 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2769917633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48680069e0 msgr2=0x7f4868006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48680069e0 0x7f4868006e60 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f486c001ec0 tx=0x7f486c01cb00 comp rx=0 tx=0).stop 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2769917633 shutdown_connections 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2769917633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48680069e0 0x7f4868006e60 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2769917633 >> 172.21.15.40:0/2769917633 conn(0x7f487c0b0890 msgr2=0x7f487c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2769917633 shutdown_connections 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2769917633 wait complete. 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 Processor -- start 2023-11-04T01:46:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- start start 2023-11-04T01:46:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680069e0 0x7f487c13b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 0x7f487c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487c0ad530 0x7f487c0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c159b30 con 0x7f487c0c85b0 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b2ee0 con 0x7f48680069e0 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0c8a90 con 0x7f487c0ad530 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 0x7f487c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 0x7f487c1595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52648/0 (socket says 172.21.15.40:52648) 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 -- 172.21.15.40:0/2105855935 learned_addr learned my addr 172.21.15.40:0/2105855935 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4880864640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680069e0 0x7f487c13b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4881065640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487c0ad530 0x7f487c0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 -- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487c0ad530 msgr2=0x7f487c0ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487c0ad530 0x7f487c0ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 -- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680069e0 msgr2=0x7f487c13b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680069e0 0x7f487c13b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 -- 172.21.15.40:0/2105855935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0c8d70 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4880864640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680069e0 0x7f487c13b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f487bfff640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 0x7f487c1595f0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f486c01cb40 tx=0x7f4868007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0b4070 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c001480 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c0b4180 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0a5a40 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.259+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c0b4740 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.263+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c04e4a0 con 0x7f487c0c85b0 2023-11-04T01:46:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.263+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f486c0a5ba0 con 0x7f487c0c85b0 2023-11-04T01:46:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.263+0000 7f48797fa640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664d0 0x7f485c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.263+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7560+0+0 (secure 0 0 0) 0x7f486c11d980 con 0x7f487c0c85b0 2023-11-04T01:46:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.263+0000 7f4880864640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664d0 0x7f485c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.263+0000 7f4880864640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664d0 0x7f485c068990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f487c0ae580 tx=0x7f4864009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.267+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f486c0ea6c0 con 0x7f487c0c85b0 2023-11-04T01:46:54.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.455+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f487c0b4e70 con 0x7f487c0c85b0 2023-11-04T01:46:54.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.455+0000 7f48797fa640 1 -- 172.21.15.40:0/2105855935 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f486c0edce0 con 0x7f487c0c85b0 2023-11-04T01:46:54.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:54.460 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:49.755098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:54.461 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 106 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664d0 msgr2=0x7f485c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664d0 0x7f485c068990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f487c0ae580 tx=0x7f4864009040 comp rx=0 tx=0).stop 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 msgr2=0x7f487c1595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 0x7f487c1595f0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f486c01cb40 tx=0x7f4868007a10 comp rx=0 tx=0).stop 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 shutdown_connections 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f485c0664d0 0x7f485c068990 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f487c0ad530 0x7f487c0ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487c0c85b0 0x7f487c1595f0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 --2- 172.21.15.40:0/2105855935 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f48680069e0 0x7f487c13b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 >> 172.21.15.40:0/2105855935 conn(0x7f487c0b0890 msgr2=0x7f487c0ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 shutdown_connections 2023-11-04T01:46:54.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.459+0000 7f4882ac8640 1 -- 172.21.15.40:0/2105855935 wait complete. 2023-11-04T01:46:54.479 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:54.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 Processor -- start 2023-11-04T01:46:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 -- start start 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d500c92b0 0x7f7d500cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d5006c1c0 0x7f7d501442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d500c9ac0 con 0x7f7d5006bde0 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500caf20 con 0x7f7d500c92b0 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d54ed4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500c97e0 con 0x7f7d5006c1c0 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.587+0000 7f7d4dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d500c92b0 0x7f7d500cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d500c92b0 0x7f7d500cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52660/0 (socket says 172.21.15.40:52660) 2023-11-04T01:46:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 -- 172.21.15.40:0/2908223097 learned_addr learned my addr 172.21.15.40:0/2908223097 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4ed9d640 1 --2- 172.21.15.40:0/2908223097 >> v2:172.21.15.91:3300/0 conn(0x7f7d5006c1c0 0x7f7d501442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 -- 172.21.15.40:0/2908223097 >> v2:172.21.15.91:3300/0 conn(0x7f7d5006c1c0 msgr2=0x7f7d501442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 --2- 172.21.15.40:0/2908223097 >> v2:172.21.15.91:3300/0 conn(0x7f7d5006c1c0 0x7f7d501442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 -- 172.21.15.40:0/2908223097 >> v1:172.21.15.91:6789/0 conn(0x7f7d5006bde0 legacy=0x7f7d5015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 -- 172.21.15.40:0/2908223097 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500cb1c0 con 0x7f7d500c92b0 2023-11-04T01:46:54.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4dd9b640 1 --2- 172.21.15.40:0/2908223097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d500cbca0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7d5015b660 tx=0x7f7d4401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807bd5f00247f6b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4d59a640 1 -- 172.21.15.40:0/2908223097 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440ac410 con 0x7f7d500c92b0 2023-11-04T01:46:54.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4d59a640 1 -- 172.21.15.40:0/2908223097 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440ac570 con 0x7f7d500c92b0 2023-11-04T01:46:54.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d4d59a640 1 -- 172.21.15.40:0/2908223097 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440ac900 con 0x7f7d500c92b0 2023-11-04T01:46:54.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 -- 172.21.15.40:0/2908223097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 msgr2=0x7f7d500cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/2908223097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d500cbca0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7d5015b660 tx=0x7f7d4401c4c0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 -- 172.21.15.40:0/2908223097 shutdown_connections 2023-11-04T01:46:54.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/2908223097 >> v2:172.21.15.91:3300/0 conn(0x7f7d5006c1c0 0x7f7d501442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/2908223097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d500cbca0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 -- 172.21.15.40:0/2908223097 >> 172.21.15.40:0/2908223097 conn(0x7f7d500b0890 msgr2=0x7f7d500b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 -- 172.21.15.40:0/2908223097 shutdown_connections 2023-11-04T01:46:54.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.591+0000 7f7d54ed4640 1 -- 172.21.15.40:0/2908223097 wait complete. 2023-11-04T01:46:54.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 Processor -- start 2023-11-04T01:46:54.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- start start 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d5006bde0 0x7f7d5015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d5006c1c0 0x7f7d5015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d50142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d50142650 con 0x7f7d500c92b0 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5013b6e0 con 0x7f7d5006bde0 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5013a900 con 0x7f7d5006c1c0 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d50142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d50142a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52662/0 (socket says 172.21.15.40:52662) 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 -- 172.21.15.40:0/4057976459 learned_addr learned my addr 172.21.15.40:0/4057976459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4dd9b640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d5006c1c0 0x7f7d5015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4e59c640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d5006bde0 0x7f7d5015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 -- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d5006c1c0 msgr2=0x7f7d5015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d5006c1c0 0x7f7d5015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 -- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d5006bde0 msgr2=0x7f7d5015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d5006bde0 0x7f7d5015a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 -- 172.21.15.40:0/4057976459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440094d0 con 0x7f7d500c92b0 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d4ed9d640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d50142a70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f7d48007e40 tx=0x7f7d4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48014620 con 0x7f7d500c92b0 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800ee90 con 0x7f7d500c92b0 2023-11-04T01:46:54.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480149e0 con 0x7f7d500c92b0 2023-11-04T01:46:54.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5013a060 con 0x7f7d500c92b0 2023-11-04T01:46:54.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5013a620 con 0x7f7d500c92b0 2023-11-04T01:46:54.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d50142790 con 0x7f7d500c92b0 2023-11-04T01:46:54.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d48014b40 con 0x7f7d500c92b0 2023-11-04T01:46:54.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d3effd640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.595+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7560+0+0 (secure 0 0 0) 0x7f7d48084ed0 con 0x7f7d500c92b0 2023-11-04T01:46:54.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.599+0000 7f7d4e59c640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.599+0000 7f7d4e59c640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7d40004e30 tx=0x7f7d40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.603+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d50142790 con 0x7f7d500c92b0 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.787+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d50142790 con 0x7f7d500c92b0 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.787+0000 7f7d3effd640 1 -- 172.21.15.40:0/4057976459 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f7d50142790 con 0x7f7d500c92b0 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:49.755098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 106 2023-11-04T01:46:54.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 msgr2=0x7f7d30068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7d40004e30 tx=0x7f7d40009040 comp rx=0 tx=0).stop 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 msgr2=0x7f7d50142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d50142a70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f7d48007e40 tx=0x7f7d4800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 shutdown_connections 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7d300664d0 0x7f7d30068990 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d500c92b0 0x7f7d50142a70 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7d5006c1c0 0x7f7d5015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 --2- 172.21.15.40:0/4057976459 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d5006bde0 0x7f7d5015a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 >> 172.21.15.40:0/4057976459 conn(0x7f7d500b0890 msgr2=0x7f7d500713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 shutdown_connections 2023-11-04T01:46:54.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:54.791+0000 7f7d54ed4640 1 -- 172.21.15.40:0/4057976459 wait complete. 2023-11-04T01:46:54.810 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:55.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:46:55.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:55.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.939+0000 7f6c8de0e640 1 Processor -- start 2023-11-04T01:46:55.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.939+0000 7f6c8de0e640 1 -- start start 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c8de0e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c8815cf80 0x7f6c880ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c8de0e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880add70 0x7f6c8815d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c8de0e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f6c880ae200 0x7f6c880cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c8de0e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8806bbf0 con 0x7f6c8815cf80 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c8de0e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880c4910 con 0x7f6c880ae200 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c8de0e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8815dcf0 con 0x7f6c880add70 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c8815cf80 0x7f6c880ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c8815cf80 0x7f6c880ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52666/0 (socket says 172.21.15.40:52666) 2023-11-04T01:46:55.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 -- 172.21.15.40:0/2227052144 learned_addr learned my addr 172.21.15.40:0/2227052144 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c87fff640 1 --2- 172.21.15.40:0/2227052144 >> v2:172.21.15.91:3300/0 conn(0x7f6c880ae200 0x7f6c880cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c86ffd640 1 --2- 172.21.15.40:0/2227052144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880add70 0x7f6c8815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 -- 172.21.15.40:0/2227052144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880add70 msgr2=0x7f6c8815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2227052144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880add70 0x7f6c8815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 -- 172.21.15.40:0/2227052144 >> v2:172.21.15.91:3300/0 conn(0x7f6c880ae200 msgr2=0x7f6c880cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2227052144 >> v2:172.21.15.91:3300/0 conn(0x7f6c880ae200 0x7f6c880cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 -- 172.21.15.40:0/2227052144 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8815dfd0 con 0x7f6c8815cf80 2023-11-04T01:46:55.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2227052144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c880ac8e0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6c8806cee0 tx=0x7f6c7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327f007f95f81a73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:55.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c867fc640 1 -- 172.21.15.40:0/2227052144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0ac600 con 0x7f6c8815cf80 2023-11-04T01:46:55.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c867fc640 1 -- 172.21.15.40:0/2227052144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0a8050 con 0x7f6c8815cf80 2023-11-04T01:46:55.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.943+0000 7f6c867fc640 1 -- 172.21.15.40:0/2227052144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0ac980 con 0x7f6c8815cf80 2023-11-04T01:46:55.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2227052144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 msgr2=0x7f6c880ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2227052144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c880ac8e0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6c8806cee0 tx=0x7f6c7c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2227052144 shutdown_connections 2023-11-04T01:46:55.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2227052144 >> v2:172.21.15.91:3300/0 conn(0x7f6c880ae200 0x7f6c880cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2227052144 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880add70 0x7f6c8815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2227052144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c880ac8e0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2227052144 >> 172.21.15.40:0/2227052144 conn(0x7f6c880b0890 msgr2=0x7f6c880b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:55.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2227052144 shutdown_connections 2023-11-04T01:46:55.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2227052144 wait complete. 2023-11-04T01:46:55.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 Processor -- start 2023-11-04T01:46:55.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- start start 2023-11-04T01:46:55.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c880add70 0x7f6c8814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880ae200 0x7f6c8814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c8814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88152900 con 0x7f6c8815cf80 2023-11-04T01:46:55.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88071290 con 0x7f6c880add70 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8814fce0 con 0x7f6c880ae200 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c8814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c8814f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52678/0 (socket says 172.21.15.40:52678) 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 -- 172.21.15.40:0/2649533173 learned_addr learned my addr 172.21.15.40:0/2649533173 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c86ffd640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880ae200 0x7f6c8814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c880add70 0x7f6c8814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 -- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880ae200 msgr2=0x7f6c8814f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880ae200 0x7f6c8814f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 -- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c880add70 msgr2=0x7f6c8814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c880add70 0x7f6c8814e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 -- 172.21.15.40:0/2649533173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0094d0 con 0x7f6c8815cf80 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c880add70 0x7f6c8814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:55.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c87fff640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c8814f6b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000efc0 tx=0x7f6c8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:55.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80014480 con 0x7f6c8815cf80 2023-11-04T01:46:55.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000f040 con 0x7f6c8815cf80 2023-11-04T01:46:55.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8814ffc0 con 0x7f6c8815cf80 2023-11-04T01:46:55.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80014820 con 0x7f6c8815cf80 2023-11-04T01:46:55.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.947+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88150580 con 0x7f6c8815cf80 2023-11-04T01:46:55.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.951+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88152ab0 con 0x7f6c8815cf80 2023-11-04T01:46:55.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.951+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c80014980 con 0x7f6c8815cf80 2023-11-04T01:46:55.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.951+0000 7f6c6ffff640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6c740664a0 0x7f6c74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.951+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7560+0+0 (secure 0 0 0) 0x7f6c80085490 con 0x7f6c8815cf80 2023-11-04T01:46:55.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.951+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6c740664a0 0x7f6c74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.951+0000 7f6c877fe640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6c740664a0 0x7f6c74068960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0ae000 tx=0x7f6c7c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:55.955+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c88152ab0 con 0x7f6c8815cf80 2023-11-04T01:46:56.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.143+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c8804e4a0 con 0x7f6c8815cf80 2023-11-04T01:46:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.143+0000 7f6c6ffff640 1 -- 172.21.15.40:0/2649533173 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4940 (secure 0 0 0) 0x7f6c80052240 con 0x7f6c8815cf80 2023-11-04T01:46:56.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:56.149 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:49.755098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 106 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6c740664a0 msgr2=0x7f6c74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6c740664a0 0x7f6c74068960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0ae000 tx=0x7f6c7c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 msgr2=0x7f6c8814f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c8814f6b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000efc0 tx=0x7f6c8000c490 comp rx=0 tx=0).stop 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 shutdown_connections 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6c740664a0 0x7f6c74068960 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8815cf80 0x7f6c8814f6b0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6c880ae200 0x7f6c8814f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 --2- 172.21.15.40:0/2649533173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6c880add70 0x7f6c8814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 >> 172.21.15.40:0/2649533173 conn(0x7f6c880b0890 msgr2=0x7f6c880cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 shutdown_connections 2023-11-04T01:46:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:56.147+0000 7f6c8de0e640 1 -- 172.21.15.40:0/2649533173 wait complete. 2023-11-04T01:46:56.167 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:57.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:57.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.295+0000 7ff48f2b2640 1 Processor -- start 2023-11-04T01:46:57.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.295+0000 7ff48f2b2640 1 -- start start 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48f2b2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815c9e0 0x7ff48806d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48f2b2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4880c98b0 0x7ff48806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48f2b2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48806cc80 con 0x7ff48815c600 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48f2b2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48806d650 con 0x7ff4880c98b0 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48f2b2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48806c070 con 0x7ff48815c9e0 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff48815c600 0x7ff4880c91a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42444/0 (socket says 172.21.15.40:42444) 2023-11-04T01:46:57.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 -- 172.21.15.40:0/963155135 learned_addr learned my addr 172.21.15.40:0/963155135 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:57.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886502354 0 0) 0x7ff48806cc80 con 0x7ff48815c600 2023-11-04T01:46:57.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48c84d640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815c9e0 0x7ff48806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff474003530 con 0x7ff48815c600 2023-11-04T01:46:57.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d84f640 1 --2- 172.21.15.40:0/963155135 >> v2:172.21.15.91:3300/0 conn(0x7ff4880c98b0 0x7ff48806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661696916 0 0) 0x7ff474003530 con 0x7ff48815c600 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815c9e0 msgr2=0x7ff48806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815c9e0 0x7ff48806d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 >> v2:172.21.15.91:3300/0 conn(0x7ff4880c98b0 msgr2=0x7ff48806fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 --2- 172.21.15.40:0/963155135 >> v2:172.21.15.91:3300/0 conn(0x7ff4880c98b0 0x7ff48806fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48806c350 con 0x7ff48815c600 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff484001680 con 0x7ff48815c600 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d84f640 1 --2- 172.21.15.40:0/963155135 >> v2:172.21.15.91:3300/0 conn(0x7ff4880c98b0 0x7ff48806fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 >> v1:172.21.15.40:6789/0 conn(0x7ff48815c600 legacy=0x7ff4880c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff474003980 0x7ff474003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4740047d0 0x7ff474004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474005150 0x7ff47400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48806c070 con 0x7ff474003980 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47400bed0 con 0x7ff474005150 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47400c010 con 0x7ff4740047d0 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff474003980 0x7ff474003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48c84d640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4740047d0 0x7ff474004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d84f640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474005150 0x7ff47400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 -- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4740047d0 msgr2=0x7ff474004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4740047d0 0x7ff474004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 -- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474005150 msgr2=0x7ff47400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474005150 0x7ff47400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.299+0000 7ff48d04e640 1 -- 172.21.15.40:0/963155135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474003530 con 0x7ff474003980 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48d04e640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff474003980 0x7ff474003da0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c290 tx=0x7ff48401ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7038e6170e320301 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840a5900 con 0x7ff474003980 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4840a5a60 con 0x7ff474003980 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff47ffff640 1 -- 172.21.15.40:0/963155135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4840a5e10 con 0x7ff474003980 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- 172.21.15.40:0/963155135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff474003980 msgr2=0x7ff474003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/963155135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff474003980 0x7ff474003da0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff48400c290 tx=0x7ff48401ccb0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48d84f640 1 -- 172.21.15.40:0/963155135 reap_dead start 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- 172.21.15.40:0/963155135 shutdown_connections 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- 172.21.15.40:0/963155135 >> 172.21.15.40:0/963155135 conn(0x7ff4880ceb50 msgr2=0x7ff4880cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:57.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- 172.21.15.40:0/963155135 shutdown_connections 2023-11-04T01:46:57.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- 172.21.15.40:0/963155135 wait complete. 2023-11-04T01:46:57.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 Processor -- start 2023-11-04T01:46:57.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- start start 2023-11-04T01:46:57.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474003980 0x7ff488154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 0x7ff48815d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815e270 0x7ff48815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815dc50 con 0x7ff488153c70 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48815ec30 con 0x7ff474003980 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48f2b2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881540f0 con 0x7ff48815e270 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48c84d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 0x7ff48815d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48c84d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 0x7ff48815d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36468/0 (socket says 172.21.15.40:36468) 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48c84d640 1 -- 172.21.15.40:0/3375508848 learned_addr learned my addr 172.21.15.40:0/3375508848 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48d84f640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815e270 0x7ff48815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.303+0000 7ff48d04e640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474003980 0x7ff488154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48c84d640 1 -- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815e270 msgr2=0x7ff48815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48c84d640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815e270 0x7ff48815e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48c84d640 1 -- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474003980 msgr2=0x7ff488154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48c84d640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474003980 0x7ff488154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48c84d640 1 -- 172.21.15.40:0/3375508848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488154a10 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48d04e640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474003980 0x7ff488154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48c84d640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 0x7ff48815d710 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff47800ba20 tx=0x7ff47800bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478010040 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478008e40 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488154cf0 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478004230 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881552b0 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48804e4a0 con 0x7ff488153c70 2023-11-04T01:46:57.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff478004390 con 0x7ff488153c70 2023-11-04T01:46:57.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff47dffb640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff46c0664d0 0x7ff46c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7ff478085680 con 0x7ff488153c70 2023-11-04T01:46:57.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48d04e640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff46c0664d0 0x7ff46c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.307+0000 7ff48d04e640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff46c0664d0 0x7ff46c068990 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff4840aa000 tx=0x7ff484001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.311+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff478052390 con 0x7ff488153c70 2023-11-04T01:46:57.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.499+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4880cf740 con 0x7ff488153c70 2023-11-04T01:46:57.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff47dffb640 1 -- 172.21.15.40:0/3375508848 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4940 (secure 0 0 0) 0x7ff4780559b0 con 0x7ff488153c70 2023-11-04T01:46:57.505 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:57.505 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:49.755098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:57.506 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 106 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff46c0664d0 msgr2=0x7ff46c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff46c0664d0 0x7ff46c068990 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff4840aa000 tx=0x7ff484001a10 comp rx=0 tx=0).stop 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 msgr2=0x7ff48815d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 0x7ff48815d710 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff47800ba20 tx=0x7ff47800bee0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 shutdown_connections 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff46c0664d0 0x7ff46c068990 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff48815e270 0x7ff48815e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff488153c70 0x7ff48815d710 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 --2- 172.21.15.40:0/3375508848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff474003980 0x7ff488154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 >> 172.21.15.40:0/3375508848 conn(0x7ff4880ceb50 msgr2=0x7ff488156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:57.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 shutdown_connections 2023-11-04T01:46:57.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:57.503+0000 7ff48f2b2640 1 -- 172.21.15.40:0/3375508848 wait complete. 2023-11-04T01:46:57.525 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:57.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:57.879 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:58.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:58.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 Processor -- start 2023-11-04T01:46:58.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 -- start start 2023-11-04T01:46:58.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f861c15b0c0 0x7f861c071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c15bbb0 0x7f861c164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c06b830 con 0x7f861c070310 2023-11-04T01:46:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c15c010 con 0x7f861c15b0c0 2023-11-04T01:46:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8622d19640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c06ab40 con 0x7f861c15bbb0 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f8620ab5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f861c15b0c0 0x7f861c071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f86212b6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c15bbb0 0x7f861c164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f861bfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f861c070310 0x7f861c15b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:36942/0 (socket says 172.21.15.40:36942) 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f861bfff640 1 -- 172.21.15.40:0/356023525 learned_addr learned my addr 172.21.15.40:0/356023525 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f86212b6640 1 -- 172.21.15.40:0/356023525 >> v2:172.21.15.91:3300/0 conn(0x7f861c15b0c0 msgr2=0x7f861c071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f86212b6640 1 --2- 172.21.15.40:0/356023525 >> v2:172.21.15.91:3300/0 conn(0x7f861c15b0c0 0x7f861c071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f86212b6640 1 -- 172.21.15.40:0/356023525 >> v1:172.21.15.91:6789/0 conn(0x7f861c070310 legacy=0x7f861c15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.659+0000 7f86212b6640 1 -- 172.21.15.40:0/356023525 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c072430 con 0x7f861c15bbb0 2023-11-04T01:46:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f86212b6640 1 --2- 172.21.15.40:0/356023525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c15bbb0 0x7f861c164b90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f861401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87443d5a852161f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f861b7fe640 1 -- 172.21.15.40:0/356023525 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140a5900 con 0x7f861c15bbb0 2023-11-04T01:46:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f861b7fe640 1 -- 172.21.15.40:0/356023525 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86140a5a60 con 0x7f861c15bbb0 2023-11-04T01:46:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f861b7fe640 1 -- 172.21.15.40:0/356023525 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140a5df0 con 0x7f861c15bbb0 2023-11-04T01:46:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 -- 172.21.15.40:0/356023525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c15bbb0 msgr2=0x7f861c164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 --2- 172.21.15.40:0/356023525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c15bbb0 0x7f861c164b90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f861401c950 comp rx=0 tx=0).stop 2023-11-04T01:46:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 -- 172.21.15.40:0/356023525 shutdown_connections 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 --2- 172.21.15.40:0/356023525 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c15bbb0 0x7f861c164b90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 --2- 172.21.15.40:0/356023525 >> v2:172.21.15.91:3300/0 conn(0x7f861c15b0c0 0x7f861c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 -- 172.21.15.40:0/356023525 >> 172.21.15.40:0/356023525 conn(0x7f861c0b1050 msgr2=0x7f861c0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 -- 172.21.15.40:0/356023525 shutdown_connections 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 -- 172.21.15.40:0/356023525 wait complete. 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 Processor -- start 2023-11-04T01:46:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.663+0000 7f8622d19640 1 -- start start 2023-11-04T01:46:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c070310 0x7f861c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f861c15b0c0 0x7f861c152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 0x7f861c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0cbd80 con 0x7f861c15bbb0 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0cb170 con 0x7f861c15b0c0 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0cb450 con 0x7f861c070310 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 0x7f861c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 0x7f861c1529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36472/0 (socket says 172.21.15.40:36472) 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 -- 172.21.15.40:0/1681489439 learned_addr learned my addr 172.21.15.40:0/1681489439 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8620ab5640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c070310 0x7f861c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f861bfff640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f861c15b0c0 0x7f861c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 -- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c070310 msgr2=0x7f861c154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c070310 0x7f861c154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 -- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f861c15b0c0 msgr2=0x7f861c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f861c15b0c0 0x7f861c152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 -- 172.21.15.40:0/1681489439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614009a70 con 0x7f861c15bbb0 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f861bfff640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f861c15b0c0 0x7f861c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86212b6640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 0x7f861c1529d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f86140196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140ad850 con 0x7f861c15bbb0 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86140ad9b0 con 0x7f861c15bbb0 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c0cb730 con 0x7f861c15bbb0 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140add60 con 0x7f861c15bbb0 2023-11-04T01:46:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c154b40 con 0x7f861c15bbb0 2023-11-04T01:46:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c0b2980 con 0x7f861c15bbb0 2023-11-04T01:46:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86140b4070 con 0x7f861c15bbb0 2023-11-04T01:46:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86197fa640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f86080664a0 0x7f8608068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f861411f320 con 0x7f861c15bbb0 2023-11-04T01:46:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.667+0000 7f8620ab5640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f86080664a0 0x7f8608068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.671+0000 7f8620ab5640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f86080664a0 0x7f8608068960 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f860c009b60 tx=0x7f860c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.671+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86140ec0d0 con 0x7f861c15bbb0 2023-11-04T01:46:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f861c0aeca0 con 0x7f861c15bbb0 2023-11-04T01:46:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f86197fa640 1 -- 172.21.15.40:0/1681489439 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f86140ef6f0 con 0x7f861c15bbb0 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:57.111615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 107 2023-11-04T01:46:58.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f86080664a0 msgr2=0x7f8608068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f86080664a0 0x7f8608068960 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f860c009b60 tx=0x7f860c009190 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 msgr2=0x7f861c1529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 0x7f861c1529d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f8614009d90 tx=0x7f86140196f0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 shutdown_connections 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f86080664a0 0x7f8608068960 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c15bbb0 0x7f861c1529d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f861c15b0c0 0x7f861c152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 --2- 172.21.15.40:0/1681489439 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f861c070310 0x7f861c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 >> 172.21.15.40:0/1681489439 conn(0x7f861c0b1050 msgr2=0x7f861c15b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 shutdown_connections 2023-11-04T01:46:58.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:46:58.867+0000 7f8622d19640 1 -- 172.21.15.40:0/1681489439 wait complete. 2023-11-04T01:46:58.891 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:46:59.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:00.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 Processor -- start 2023-11-04T01:47:00.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 -- start start 2023-11-04T01:47:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd03813e220 0x7fd03815c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd03806a130 0x7fd03806a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03806aad0 con 0x7fd03815ec90 2023-11-04T01:47:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd038071a70 con 0x7fd03813e220 2023-11-04T01:47:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03e82d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd038070bc0 con 0x7fd03806a130 2023-11-04T01:47:00.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd037fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd03813e220 0x7fd03815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03cdca640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd03815ec90 0x7fd03815f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42460/0 (socket says 172.21.15.40:42460) 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd03cdca640 1 -- 172.21.15.40:0/1855287195 learned_addr learned my addr 172.21.15.40:0/1855287195 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd0377fe640 1 --2- 172.21.15.40:0/1855287195 >> v2:172.21.15.91:3300/0 conn(0x7fd03806a130 0x7fd03806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd037fff640 1 -- 172.21.15.40:0/1855287195 >> v2:172.21.15.91:3300/0 conn(0x7fd03806a130 msgr2=0x7fd03806a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd037fff640 1 --2- 172.21.15.40:0/1855287195 >> v2:172.21.15.91:3300/0 conn(0x7fd03806a130 0x7fd03806a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd037fff640 1 -- 172.21.15.40:0/1855287195 >> v1:172.21.15.40:6789/0 conn(0x7fd03815ec90 legacy=0x7fd03815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd036ffd640 1 -- 172.21.15.40:0/1855287195 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645539012 0 0) 0x7fd03806aad0 con 0x7fd03815ec90 2023-11-04T01:47:00.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.023+0000 7fd037fff640 1 -- 172.21.15.40:0/1855287195 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038070e60 con 0x7fd03813e220 2023-11-04T01:47:00.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd037fff640 1 --2- 172.21.15.40:0/1855287195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03813e220 0x7fd03815c020 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fd0380cd770 tx=0x7fd03001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf5b23dd93f1588 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd036ffd640 1 -- 172.21.15.40:0/1855287195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300a7070 con 0x7fd03813e220 2023-11-04T01:47:00.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd036ffd640 1 -- 172.21.15.40:0/1855287195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300ab430 con 0x7fd03813e220 2023-11-04T01:47:00.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd036ffd640 1 -- 172.21.15.40:0/1855287195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300ab7c0 con 0x7fd03813e220 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- 172.21.15.40:0/1855287195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03813e220 msgr2=0x7fd03815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 --2- 172.21.15.40:0/1855287195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03813e220 0x7fd03815c020 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fd0380cd770 tx=0x7fd03001c430 comp rx=0 tx=0).stop 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- 172.21.15.40:0/1855287195 shutdown_connections 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 --2- 172.21.15.40:0/1855287195 >> v2:172.21.15.91:3300/0 conn(0x7fd03806a130 0x7fd03806a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 --2- 172.21.15.40:0/1855287195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03813e220 0x7fd03815c020 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- 172.21.15.40:0/1855287195 >> 172.21.15.40:0/1855287195 conn(0x7fd0380b18a0 msgr2=0x7fd0380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- 172.21.15.40:0/1855287195 shutdown_connections 2023-11-04T01:47:00.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- 172.21.15.40:0/1855287195 wait complete. 2023-11-04T01:47:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 Processor -- start 2023-11-04T01:47:00.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- start start 2023-11-04T01:47:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 0x7fd03813ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd03813e220 0x7fd0381583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd03815ec90 0x7fd0381588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381f6400 con 0x7fd03806a130 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd038158ec0 con 0x7fd03813e220 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd03e82d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381f5db0 con 0x7fd03815ec90 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd037fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 0x7fd03813ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd037fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 0x7fd03813ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36490/0 (socket says 172.21.15.40:36490) 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.027+0000 7fd037fff640 1 -- 172.21.15.40:0/3405864664 learned_addr learned my addr 172.21.15.40:0/3405864664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd0377fe640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd03813e220 0x7fd0381583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd03cdca640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd03815ec90 0x7fd0381588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd037fff640 1 -- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd03815ec90 msgr2=0x7fd0381588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd037fff640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd03815ec90 0x7fd0381588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd037fff640 1 -- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd03813e220 msgr2=0x7fd0381583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd037fff640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd03813e220 0x7fd0381583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd037fff640 1 -- 172.21.15.40:0/3405864664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd030009420 con 0x7fd03806a130 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd0377fe640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd03813e220 0x7fd0381583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd037fff640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 0x7fd03813ccc0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fd030019040 tx=0x7fd03001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300b5610 con 0x7fd03806a130 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0300b5790 con 0x7fd03806a130 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0381f6090 con 0x7fd03806a130 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0300b5b40 con 0x7fd03806a130 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd038157690 con 0x7fd03806a130 2023-11-04T01:47:00.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03806cfd0 con 0x7fd03806a130 2023-11-04T01:47:00.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0300b5ca0 con 0x7fd03806a130 2023-11-04T01:47:00.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd034ff9640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0180664a0 0x7fd018068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.031+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fd03011f150 con 0x7fd03806a130 2023-11-04T01:47:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.035+0000 7fd0377fe640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0180664a0 0x7fd018068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.035+0000 7fd0377fe640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0180664a0 0x7fd018068960 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd03813db20 tx=0x7fd020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.035+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0300ebeb0 con 0x7fd03806a130 2023-11-04T01:47:00.069 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:47:00.067+0000 7f2c1a5bb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:00.069 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:47:00.067+0000 7f2c1a5bb640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:00.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.235+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd03806e760 con 0x7fd03806a130 2023-11-04T01:47:00.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.235+0000 7fd034ff9640 1 -- 172.21.15.40:0/3405864664 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fd0300c1ed0 con 0x7fd03806a130 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:58.125046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 108 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0180664a0 msgr2=0x7fd018068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0180664a0 0x7fd018068960 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd03813db20 tx=0x7fd020008040 comp rx=0 tx=0).stop 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 msgr2=0x7fd03813ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 0x7fd03813ccc0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fd030019040 tx=0x7fd03001ac70 comp rx=0 tx=0).stop 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 shutdown_connections 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd0180664a0 0x7fd018068960 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd03815ec90 0x7fd0381588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd03813e220 0x7fd0381583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 --2- 172.21.15.40:0/3405864664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd03806a130 0x7fd03813ccc0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 >> 172.21.15.40:0/3405864664 conn(0x7fd0380b18a0 msgr2=0x7fd0381641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 shutdown_connections 2023-11-04T01:47:00.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.239+0000 7fd03e82d640 1 -- 172.21.15.40:0/3405864664 wait complete. 2023-11-04T01:47:00.258 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:47:00.258 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.779322385787964s 2023-11-04T01:47:00.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:00.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.371+0000 7f27c28c8640 1 Processor -- start 2023-11-04T01:47:00.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.371+0000 7f27c28c8640 1 -- start start 2023-11-04T01:47:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27c28c8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27bc1658b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27c28c8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc161da0 con 0x7f27bc0cb8b0 2023-11-04T01:47:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27c28c8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc165ed0 con 0x7f27bc0ccf40 2023-11-04T01:47:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27c28c8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc161bb0 con 0x7f27bc162860 2023-11-04T01:47:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f27bc0cb8b0 0x7f27bc0cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42462/0 (socket says 172.21.15.40:42462) 2023-11-04T01:47:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 -- 172.21.15.40:0/2471663659 learned_addr learned my addr 172.21.15.40:0/2471663659 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27c0e65640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27bc1658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132006455 0 0) 0x7f27bc161da0 con 0x7f27bc0cb8b0 2023-11-04T01:47:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a4003530 con 0x7f27bc0cb8b0 2023-11-04T01:47:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2605343510 0 0) 0x7f27a4003530 con 0x7f27bc0cb8b0 2023-11-04T01:47:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 msgr2=0x7f27bc1658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27bc1658b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 >> v1:172.21.15.91:6789/0 conn(0x7f27bc0ccf40 legacy=0x7f27bc1651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc162060 con 0x7f27bc0cb8b0 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f27ac001680 con 0x7f27bc0cb8b0 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 >> v1:172.21.15.40:6789/0 conn(0x7f27bc0cb8b0 legacy=0x7f27bc0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a4004d10 0x7f27a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400ba40 con 0x7f27a40039b0 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400bb80 con 0x7f27a4004d10 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400bd40 con 0x7f27bc162860 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27c0e65640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a4004d10 0x7f27a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bb7fe640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 -- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 msgr2=0x7f27a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 -- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a4004d10 msgr2=0x7f27a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27a4004d10 0x7f27a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bbfff640 1 -- 172.21.15.40:0/2471663659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4003530 con 0x7f27a40039b0 2023-11-04T01:47:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.375+0000 7f27bb7fe640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27bc162860 0x7f27a40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27bbfff640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c210 tx=0x7f27ac01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2f23d4c2f7d337 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac005ae0 con 0x7f27a40039b0 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac005c40 con 0x7f27a40039b0 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27baffd640 1 -- 172.21.15.40:0/2471663659 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0a5810 con 0x7f27a40039b0 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- 172.21.15.40:0/2471663659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27a40039b0 msgr2=0x7f27a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 --2- 172.21.15.40:0/2471663659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27a40039b0 0x7f27a4003dd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c210 tx=0x7f27ac01cc20 comp rx=0 tx=0).stop 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c0e65640 1 -- 172.21.15.40:0/2471663659 reap_dead start 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- 172.21.15.40:0/2471663659 shutdown_connections 2023-11-04T01:47:00.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- 172.21.15.40:0/2471663659 >> 172.21.15.40:0/2471663659 conn(0x7f27bc0b0890 msgr2=0x7f27bc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- 172.21.15.40:0/2471663659 shutdown_connections 2023-11-04T01:47:00.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- 172.21.15.40:0/2471663659 wait complete. 2023-11-04T01:47:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 Processor -- start 2023-11-04T01:47:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- start start 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27a40039b0 0x7f27bc157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 0x7f27bc0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15fa80 0x7f27bc15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc160440 con 0x7f27bc0b1850 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc168f80 con 0x7f27bc15fa80 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c28c8640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0b22d0 con 0x7f27a40039b0 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 0x7f27bc0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 0x7f27bc0b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36518/0 (socket says 172.21.15.40:36518) 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27bb7fe640 1 -- 172.21.15.40:0/3995171106 learned_addr learned my addr 172.21.15.40:0/3995171106 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27bbfff640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27a40039b0 0x7f27bc157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.379+0000 7f27c0e65640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15fa80 0x7f27bc15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bb7fe640 1 -- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27a40039b0 msgr2=0x7f27bc157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bb7fe640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27a40039b0 0x7f27bc157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bb7fe640 1 -- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15fa80 msgr2=0x7f27bc15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bb7fe640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15fa80 0x7f27bc15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bb7fe640 1 -- 172.21.15.40:0/3995171106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0b25b0 con 0x7f27bc0b1850 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bb7fe640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 0x7f27bc0b1cd0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f27b000d770 tx=0x7f27b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0005270 con 0x7f27bc0b1850 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00053d0 con 0x7f27bc0b1850 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc168c10 con 0x7f27bc0b1850 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000b870 con 0x7f27bc0b1850 2023-11-04T01:47:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc143010 con 0x7f27bc0b1850 2023-11-04T01:47:00.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc0b2740 con 0x7f27bc0b1850 2023-11-04T01:47:00.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27b000b9d0 con 0x7f27bc0b1850 2023-11-04T01:47:00.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27b8ff9640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a80664a0 0x7f27a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f27b0084520 con 0x7f27bc0b1850 2023-11-04T01:47:00.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bbfff640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a80664a0 0x7f27a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.383+0000 7f27bbfff640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a80664a0 0x7f27a8068960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0ab000 tx=0x7f27ac0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.387+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27b0051230 con 0x7f27bc0b1850 2023-11-04T01:47:00.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.579+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27bc04e4a0 con 0x7f27bc0b1850 2023-11-04T01:47:00.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27b8ff9640 1 -- 172.21.15.40:0/3995171106 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f27b0054850 con 0x7f27bc0b1850 2023-11-04T01:47:00.585 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:00.586 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:58.125046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:00.586 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 108 2023-11-04T01:47:00.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a80664a0 msgr2=0x7f27a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a80664a0 0x7f27a8068960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0ab000 tx=0x7f27ac0a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 msgr2=0x7f27bc0b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 0x7f27bc0b1cd0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f27b000d770 tx=0x7f27b000dc30 comp rx=0 tx=0).stop 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 shutdown_connections 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27a80664a0 0x7f27a8068960 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f27bc15fa80 0x7f27bc15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27bc0b1850 0x7f27bc0b1cd0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 --2- 172.21.15.40:0/3995171106 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27a40039b0 0x7f27bc157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 >> 172.21.15.40:0/3995171106 conn(0x7f27bc0b0890 msgr2=0x7f27bc160c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 shutdown_connections 2023-11-04T01:47:00.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.583+0000 7f27c28c8640 1 -- 172.21.15.40:0/3995171106 wait complete. 2023-11-04T01:47:00.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:47:00.745 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:24.386602+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:00.746 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:24.386602+0000" } ] } 2023-11-04T01:47:00.746 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:47:00.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.859+0000 7fa81c56e640 1 Processor -- start 2023-11-04T01:47:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.859+0000 7fa81c56e640 1 -- start start 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81c56e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa81415cf80 0x7fa8140ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81c56e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81c56e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa8140ae200 0x7fa8140cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81c56e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81406bbf0 con 0x7fa81415cf80 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81c56e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140c4910 con 0x7fa8140ae200 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81c56e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81415dcf0 con 0x7fa8140add70 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa81415cf80 0x7fa8140ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa81415cf80 0x7fa8140ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36530/0 (socket says 172.21.15.40:36530) 2023-11-04T01:47:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 -- 172.21.15.40:0/2358826934 learned_addr learned my addr 172.21.15.40:0/2358826934 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa819b09640 1 --2- 172.21.15.40:0/2358826934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81ab0b640 1 --2- 172.21.15.40:0/2358826934 >> v2:172.21.15.91:3300/0 conn(0x7fa8140ae200 0x7fa8140cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 -- 172.21.15.40:0/2358826934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 msgr2=0x7fa81415d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 --2- 172.21.15.40:0/2358826934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 -- 172.21.15.40:0/2358826934 >> v2:172.21.15.91:3300/0 conn(0x7fa8140ae200 msgr2=0x7fa8140cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 --2- 172.21.15.40:0/2358826934 >> v2:172.21.15.91:3300/0 conn(0x7fa8140ae200 0x7fa8140cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.863+0000 7fa81a30a640 1 -- 172.21.15.40:0/2358826934 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81415dfd0 con 0x7fa81415cf80 2023-11-04T01:47:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81a30a640 1 --2- 172.21.15.40:0/2358826934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa8140ac8e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa81406cee0 tx=0x7fa80401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12530d414bcaade2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa819308640 1 -- 172.21.15.40:0/2358826934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040ac600 con 0x7fa81415cf80 2023-11-04T01:47:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa819308640 1 -- 172.21.15.40:0/2358826934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8040a8050 con 0x7fa81415cf80 2023-11-04T01:47:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa819308640 1 -- 172.21.15.40:0/2358826934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040ac980 con 0x7fa81415cf80 2023-11-04T01:47:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- 172.21.15.40:0/2358826934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 msgr2=0x7fa8140ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- 172.21.15.40:0/2358826934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa8140ac8e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa81406cee0 tx=0x7fa80401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- 172.21.15.40:0/2358826934 shutdown_connections 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- 172.21.15.40:0/2358826934 >> v2:172.21.15.91:3300/0 conn(0x7fa8140ae200 0x7fa8140cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- 172.21.15.40:0/2358826934 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- 172.21.15.40:0/2358826934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa8140ac8e0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- 172.21.15.40:0/2358826934 >> 172.21.15.40:0/2358826934 conn(0x7fa8140b0890 msgr2=0x7fa8140b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- 172.21.15.40:0/2358826934 shutdown_connections 2023-11-04T01:47:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- 172.21.15.40:0/2358826934 wait complete. 2023-11-04T01:47:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 Processor -- start 2023-11-04T01:47:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- start start 2023-11-04T01:47:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8140ae200 0x7fa814141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa81415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81415aa70 con 0x7fa81415cf80 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140af890 con 0x7fa8140ae200 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81c56e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140afb30 con 0x7fa8140add70 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81ab0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa81415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81ab0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa81415b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36540/0 (socket says 172.21.15.40:36540) 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81ab0b640 1 -- 172.21.15.40:0/4152718938 learned_addr learned my addr 172.21.15.40:0/4152718938 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa819b09640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8140ae200 0x7fa814141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.867+0000 7fa81a30a640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81ab0b640 1 -- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 msgr2=0x7fa81415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81ab0b640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81ab0b640 1 -- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8140ae200 msgr2=0x7fa814141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81ab0b640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8140ae200 0x7fa814141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81ab0b640 1 -- 172.21.15.40:0/4152718938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040094d0 con 0x7fa81415cf80 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa819b09640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8140ae200 0x7fa814141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81a30a640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81ab0b640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa81415b1e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00efc0 tx=0x7fa80c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c014480 con 0x7fa81415cf80 2023-11-04T01:47:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00f040 con 0x7fa81415cf80 2023-11-04T01:47:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8140afe10 con 0x7fa81415cf80 2023-11-04T01:47:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c014820 con 0x7fa81415cf80 2023-11-04T01:47:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8140b03d0 con 0x7fa81415cf80 2023-11-04T01:47:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140b05f0 con 0x7fa81415cf80 2023-11-04T01:47:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa80c014980 con 0x7fa81415cf80 2023-11-04T01:47:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa80affd640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7f80664a0 0x7fa7f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fa80c085b60 con 0x7fa81415cf80 2023-11-04T01:47:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81a30a640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7f80664a0 0x7fa7f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.871+0000 7fa81a30a640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7f80664a0 0x7fa7f8068960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa8040ae000 tx=0x7fa8040a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:00.875+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa80c0527c0 con 0x7fa81415cf80 2023-11-04T01:47:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.067+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa81404e4a0 con 0x7fa81415cf80 2023-11-04T01:47:01.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.067+0000 7fa80affd640 1 -- 172.21.15.40:0/4152718938 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fa80c018070 con 0x7fa81415cf80 2023-11-04T01:47:01.072 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:01.073 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:58.125046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 108 2023-11-04T01:47:01.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7f80664a0 msgr2=0x7fa7f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7f80664a0 0x7fa7f8068960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa8040ae000 tx=0x7fa8040a7000 comp rx=0 tx=0).stop 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 msgr2=0x7fa81415b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa81415b1e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00efc0 tx=0x7fa80c00c490 comp rx=0 tx=0).stop 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 shutdown_connections 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa7f80664a0 0x7fa7f8068960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa81415cf80 0x7fa81415b1e0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8140ae200 0x7fa814141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 --2- 172.21.15.40:0/4152718938 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa8140add70 0x7fa81415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 >> 172.21.15.40:0/4152718938 conn(0x7fa8140b0890 msgr2=0x7fa8140cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 shutdown_connections 2023-11-04T01:47:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.071+0000 7fa81c56e640 1 -- 172.21.15.40:0/4152718938 wait complete. 2023-11-04T01:47:01.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:47:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:24.386602+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:01.225 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:24.386602+0000" } ] } 2023-11-04T01:47:01.225 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:01.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:47:01.238 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:47:01.238 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:01.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:47:01.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 Processor -- start 2023-11-04T01:47:01.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 -- start start 2023-11-04T01:47:01.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcaa415cf80 0x7fcaa40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa415d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40c4910 con 0x7fcaa40ae200 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa406bbf0 con 0x7fcaa415cf80 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa9cff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa415dcf0 con 0x7fcaa40add70 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcaa415cf80 0x7fcaa40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcaa415cf80 0x7fcaa40ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36556/0 (socket says 172.21.15.40:36556) 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 -- 172.21.15.40:0/2265971786 learned_addr learned my addr 172.21.15.40:0/2265971786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa2ffd640 1 --2- 172.21.15.40:0/2265971786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa415d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 -- 172.21.15.40:0/2265971786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 msgr2=0x7fcaa415d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 --2- 172.21.15.40:0/2265971786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa415d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 -- 172.21.15.40:0/2265971786 >> v1:172.21.15.91:6789/0 conn(0x7fcaa40ae200 legacy=0x7fcaa40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.455+0000 7fcaa37fe640 1 -- 172.21.15.40:0/2265971786 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa415dfd0 con 0x7fcaa415cf80 2023-11-04T01:47:01.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa37fe640 1 --2- 172.21.15.40:0/2265971786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa40ac8e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fca94009870 tx=0x7fca9401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7e372f52baa7b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa27fc640 1 -- 172.21.15.40:0/2265971786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940aa5f0 con 0x7fcaa415cf80 2023-11-04T01:47:01.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa27fc640 1 -- 172.21.15.40:0/2265971786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca940aa750 con 0x7fcaa415cf80 2023-11-04T01:47:01.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa27fc640 1 -- 172.21.15.40:0/2265971786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940aaae0 con 0x7fcaa415cf80 2023-11-04T01:47:01.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- 172.21.15.40:0/2265971786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 msgr2=0x7fcaa40ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/2265971786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa40ac8e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fca94009870 tx=0x7fca9401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- 172.21.15.40:0/2265971786 shutdown_connections 2023-11-04T01:47:01.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/2265971786 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa415d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/2265971786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa40ac8e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- 172.21.15.40:0/2265971786 >> 172.21.15.40:0/2265971786 conn(0x7fcaa40b0890 msgr2=0x7fcaa40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- 172.21.15.40:0/2265971786 shutdown_connections 2023-11-04T01:47:01.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- 172.21.15.40:0/2265971786 wait complete. 2023-11-04T01:47:01.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 Processor -- start 2023-11-04T01:47:01.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- start start 2023-11-04T01:47:01.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa40b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcaa40ae200 0x7fcaa4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa4157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b3ea0 con 0x7fcaa415cf80 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b1c70 con 0x7fcaa40ae200 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa9cff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b32f0 con 0x7fcaa40add70 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa4157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa4157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36568/0 (socket says 172.21.15.40:36568) 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.459+0000 7fcaa3fff640 1 -- 172.21.15.40:0/1861675847 learned_addr learned my addr 172.21.15.40:0/1861675847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa2ffd640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcaa40ae200 0x7fcaa4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa37fe640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa40b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa3fff640 1 -- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 msgr2=0x7fcaa40b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa3fff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa40b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa3fff640 1 -- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcaa40ae200 msgr2=0x7fcaa4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa3fff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcaa40ae200 0x7fcaa4156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa3fff640 1 -- 172.21.15.40:0/1861675847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca940094d0 con 0x7fcaa415cf80 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa37fe640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa40b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa3fff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa4157140 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c780 tx=0x7fca9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c004b70 con 0x7fcaa415cf80 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c00ce90 con 0x7fcaa415cf80 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40b3570 con 0x7fcaa415cf80 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00a850 con 0x7fcaa415cf80 2023-11-04T01:47:01.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40b3b30 con 0x7fcaa415cf80 2023-11-04T01:47:01.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40b4050 con 0x7fcaa415cf80 2023-11-04T01:47:01.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca9c00a9b0 con 0x7fcaa415cf80 2023-11-04T01:47:01.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fca8bfff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fca900664a0 0x7fca90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fca9c084b00 con 0x7fcaa415cf80 2023-11-04T01:47:01.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa37fe640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fca900664a0 0x7fca90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.463+0000 7fcaa37fe640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fca900664a0 0x7fca90068960 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fca940ae000 tx=0x7fca940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.467+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcaa40b4050 con 0x7fcaa415cf80 2023-11-04T01:47:01.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.627+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaa40b4050 con 0x7fcaa415cf80 2023-11-04T01:47:01.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.627+0000 7fca8bfff640 1 -- 172.21.15.40:0/1861675847 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+22957 (secure 0 0 0) 0x7fcaa40b4050 con 0x7fcaa415cf80 2023-11-04T01:47:01.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:01.632 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":109,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:46:57.076690+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2884841846":"2023-11-04T02:46:56.954663+0000","172.21.15.91:6836/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.40:6835/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6837/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.91:6836/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6833/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.40:6835/2918977483":"2023-11-05T01:45:57.090700+0000","172.21.15.40:6832/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.91:6837/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6832/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.91:6837/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.40:6834/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6835/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6833/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6836/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.40:6834/2918977483":"2023-11-05T01:45:57.090700+0000","192.168.0.1:0/771372867":"2023-11-04T02:46:12.185534+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fca900664a0 msgr2=0x7fca90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fca900664a0 0x7fca90068960 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fca940ae000 tx=0x7fca940a7000 comp rx=0 tx=0).stop 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 msgr2=0x7fcaa4157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa4157140 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c780 tx=0x7fca9c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 shutdown_connections 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fca900664a0 0x7fca90068960 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa415cf80 0x7fcaa4157140 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcaa40ae200 0x7fcaa4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 --2- 172.21.15.40:0/1861675847 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fcaa40add70 0x7fcaa40b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 >> 172.21.15.40:0/1861675847 conn(0x7fcaa40b0890 msgr2=0x7fcaa415f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 shutdown_connections 2023-11-04T01:47:01.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.631+0000 7fcaa9cff640 1 -- 172.21.15.40:0/1861675847 wait complete. 2023-11-04T01:47:01.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:14.041287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:14.473992+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:47:01.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:47:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.779+0000 7fa1d0f11640 1 Processor -- start 2023-11-04T01:47:01.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.779+0000 7fa1d0f11640 1 -- start start 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1d0f11640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc15b120 0x7fa1cc0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1d0f11640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1cc0b2fb0 0x7fa1cc0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1d0f11640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc15eca0 con 0x7fa1cc0cff30 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1d0f11640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc15ef80 con 0x7fa1cc0b2fb0 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1d0f11640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc15f260 con 0x7fa1cc15b120 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1cc0b2fb0 0x7fa1cc0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1cc0b2fb0 0x7fa1cc0b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36576/0 (socket says 172.21.15.40:36576) 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 -- 172.21.15.40:0/2679247329 learned_addr learned my addr 172.21.15.40:0/2679247329 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1ca59c640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc15b120 0x7fa1cc0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 -- 172.21.15.40:0/2679247329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc15b120 msgr2=0x7fa1cc0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc15b120 0x7fa1cc0d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 -- 172.21.15.40:0/2679247329 >> v1:172.21.15.91:6789/0 conn(0x7fa1cc0cff30 legacy=0x7fa1cc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 -- 172.21.15.40:0/2679247329 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc15f540 con 0x7fa1cc0b2fb0 2023-11-04T01:47:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1ca59c640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc15b120 0x7fa1cc0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:01.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1cad9d640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0b2fb0 0x7fa1cc0b5c90 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8373e48250e03b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1c959a640 1 -- 172.21.15.40:0/2679247329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40a5870 con 0x7fa1cc0b2fb0 2023-11-04T01:47:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1c959a640 1 -- 172.21.15.40:0/2679247329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c40a59d0 con 0x7fa1cc0b2fb0 2023-11-04T01:47:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.783+0000 7fa1c959a640 1 -- 172.21.15.40:0/2679247329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40a5d60 con 0x7fa1cc0b2fb0 2023-11-04T01:47:01.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2679247329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0b2fb0 msgr2=0x7fa1cc0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0b2fb0 0x7fa1cc0b5c90 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2679247329 shutdown_connections 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0b2fb0 0x7fa1cc0b5c90 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2679247329 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc15b120 0x7fa1cc0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2679247329 >> 172.21.15.40:0/2679247329 conn(0x7fa1cc0cd8a0 msgr2=0x7fa1cc0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2679247329 shutdown_connections 2023-11-04T01:47:01.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2679247329 wait complete. 2023-11-04T01:47:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 Processor -- start 2023-11-04T01:47:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- start start 2023-11-04T01:47:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc0b2fb0 0x7fa1cc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 0x7fa1cc0c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1cc15b120 0x7fa1cc153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0c64d0 con 0x7fa1cc0cff30 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0caa50 con 0x7fa1cc15b120 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0c5b30 con 0x7fa1cc0b2fb0 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 0x7fa1cc0c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 0x7fa1cc0c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36592/0 (socket says 172.21.15.40:36592) 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 -- 172.21.15.40:0/2104512372 learned_addr learned my addr 172.21.15.40:0/2104512372 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1ca59c640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc0b2fb0 0x7fa1cc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1cad9d640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1cc15b120 0x7fa1cc153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 -- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc0b2fb0 msgr2=0x7fa1cc1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc0b2fb0 0x7fa1cc1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 -- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1cc15b120 msgr2=0x7fa1cc153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1cc15b120 0x7fa1cc153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 -- 172.21.15.40:0/2104512372 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009b30 con 0x7fa1cc0cff30 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1cad9d640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1cc15b120 0x7fa1cc153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1c9d9b640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 0x7fa1cc0c68f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000c450 tx=0x7fa1c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0012830 con 0x7fa1cc0cff30 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c00129b0 con 0x7fa1cc0cff30 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc0c5e10 con 0x7fa1cc0cff30 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0012d60 con 0x7fa1cc0cff30 2023-11-04T01:47:01.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.787+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc153540 con 0x7fa1cc0cff30 2023-11-04T01:47:01.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.791+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc0cfb00 con 0x7fa1cc0cff30 2023-11-04T01:47:01.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.791+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1c001c460 con 0x7fa1cc0cff30 2023-11-04T01:47:01.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.791+0000 7fa1baffd640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1ac0664a0 0x7fa1ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.791+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fa1c00842d0 con 0x7fa1cc0cff30 2023-11-04T01:47:01.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.791+0000 7fa1ca59c640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1ac0664a0 0x7fa1ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.791+0000 7fa1ca59c640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1ac0664a0 0x7fa1ac068960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006fd0 tx=0x7fa1bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.795+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1c0051070 con 0x7fa1cc0cff30 2023-11-04T01:47:01.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.951+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1cc0b0560 con 0x7fa1cc0cff30 2023-11-04T01:47:01.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.951+0000 7fa1baffd640 1 -- 172.21.15.40:0/2104512372 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1c0054690 con 0x7fa1cc0cff30 2023-11-04T01:47:01.955 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1ac0664a0 msgr2=0x7fa1ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1ac0664a0 0x7fa1ac068960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006fd0 tx=0x7fa1bc008040 comp rx=0 tx=0).stop 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 msgr2=0x7fa1cc0c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 0x7fa1cc0c68f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000c450 tx=0x7fa1c000c910 comp rx=0 tx=0).stop 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 shutdown_connections 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1ac0664a0 0x7fa1ac068960 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1cc15b120 0x7fa1cc153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1cc0cff30 0x7fa1cc0c68f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 --2- 172.21.15.40:0/2104512372 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1cc0b2fb0 0x7fa1cc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 >> 172.21.15.40:0/2104512372 conn(0x7fa1cc0cd8a0 msgr2=0x7fa1cc0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 shutdown_connections 2023-11-04T01:47:01.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:01.955+0000 7fa1d0f11640 1 -- 172.21.15.40:0/2104512372 wait complete. 2023-11-04T01:47:01.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:47:02.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 Processor -- start 2023-11-04T01:47:02.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 -- start start 2023-11-04T01:47:02.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fec540b4a80 0x7fec540721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 0x7fec5406b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec540734a0 con 0x7fec5406b7b0 2023-11-04T01:47:02.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5406ade0 con 0x7fec540b4a80 2023-11-04T01:47:02.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec59027640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5406a1d0 con 0x7fec5415c210 2023-11-04T01:47:02.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec5359e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fec5406b7b0 0x7fec540cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42466/0 (socket says 172.21.15.40:42466) 2023-11-04T01:47:02.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec5359e640 1 -- 172.21.15.40:0/1412371096 learned_addr learned my addr 172.21.15.40:0/1412371096 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec5259c640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 0x7fec5406b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1412371096 >> v2:172.21.15.91:3300/0 conn(0x7fec540b4a80 0x7fec540721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294115894 0 0) 0x7fec540734a0 con 0x7fec5406b7b0 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec3c003530 con 0x7fec5406b7b0 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3598663429 0 0) 0x7fec3c003530 con 0x7fec5406b7b0 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 msgr2=0x7fec5406b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 0x7fec5406b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 >> v2:172.21.15.91:3300/0 conn(0x7fec540b4a80 msgr2=0x7fec540721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 --2- 172.21.15.40:0/1412371096 >> v2:172.21.15.91:3300/0 conn(0x7fec540b4a80 0x7fec540721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5406a4b0 con 0x7fec5406b7b0 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fec4c001a00 con 0x7fec5406b7b0 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 >> v1:172.21.15.40:6789/0 conn(0x7fec5406b7b0 legacy=0x7fec540cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec3c003980 0x7fec3c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c0047d0 0x7fec3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 0x7fec3c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5406ade0 con 0x7fec3c003980 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5406a1d0 con 0x7fec3c0047d0 2023-11-04T01:47:02.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c00b990 con 0x7fec5415c210 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec3c003980 0x7fec3c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec5259c640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c0047d0 0x7fec3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec5359e640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 0x7fec3c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 -- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 msgr2=0x7fec3c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5415c210 0x7fec3c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 -- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c0047d0 msgr2=0x7fec3c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c0047d0 0x7fec3c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.095+0000 7fec52d9d640 1 -- 172.21.15.40:0/1412371096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c003530 con 0x7fec3c003980 2023-11-04T01:47:02.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec3c003980 0x7fec3c003da0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fec44009b10 tx=0x7fec4401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326c814f198984db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440a6470 con 0x7fec3c003980 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec440a65d0 con 0x7fec3c003980 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec51d9b640 1 -- 172.21.15.40:0/1412371096 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440a6980 con 0x7fec3c003980 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 -- 172.21.15.40:0/1412371096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec3c003980 msgr2=0x7fec3c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 --2- 172.21.15.40:0/1412371096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec3c003980 0x7fec3c003da0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fec44009b10 tx=0x7fec4401ca60 comp rx=0 tx=0).stop 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec5359e640 1 -- 172.21.15.40:0/1412371096 reap_dead start 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 -- 172.21.15.40:0/1412371096 shutdown_connections 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 -- 172.21.15.40:0/1412371096 >> 172.21.15.40:0/1412371096 conn(0x7fec540cf520 msgr2=0x7fec540cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 -- 172.21.15.40:0/1412371096 shutdown_connections 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 -- 172.21.15.40:0/1412371096 wait complete. 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 Processor -- start 2023-11-04T01:47:02.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.099+0000 7fec59027640 1 -- start start 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c003980 0x7fec54143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5414e9c0 0x7fec540c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 0x7fec540b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54143da0 con 0x7fec540c7860 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540c8a10 con 0x7fec3c003980 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec540c93e0 con 0x7fec5414e9c0 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 0x7fec540b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 0x7fec540b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36600/0 (socket says 172.21.15.40:36600) 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 -- 172.21.15.40:0/1479713460 learned_addr learned my addr 172.21.15.40:0/1479713460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c003980 0x7fec54143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5259c640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5414e9c0 0x7fec540c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 -- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5414e9c0 msgr2=0x7fec540c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5414e9c0 0x7fec540c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 -- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c003980 msgr2=0x7fec54143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c003980 0x7fec54143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 -- 172.21.15.40:0/1479713460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540c7e00 con 0x7fec540c7860 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c003980 0x7fec54143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec5359e640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 0x7fec540b3a80 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fec54066b30 tx=0x7fec4c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00eaa0 con 0x7fec540c7860 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00ec00 con 0x7fec540c7860 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec540c80e0 con 0x7fec540c7860 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c013420 con 0x7fec540c7860 2023-11-04T01:47:02.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec540c86a0 con 0x7fec540c7860 2023-11-04T01:47:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec540d03c0 con 0x7fec540c7860 2023-11-04T01:47:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec4c013580 con 0x7fec540c7860 2023-11-04T01:47:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec3b7fe640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec400664a0 0x7fec40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fec4c084a40 con 0x7fec540c7860 2023-11-04T01:47:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.103+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec400664a0 0x7fec40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.107+0000 7fec52d9d640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec400664a0 0x7fec40068960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fec440ad000 tx=0x7fec440b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.107+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec4c0516b0 con 0x7fec540c7860 2023-11-04T01:47:02.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.263+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fec54157d50 con 0x7fec540c7860 2023-11-04T01:47:02.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.263+0000 7fec3b7fe640 1 -- 172.21.15.40:0/1479713460 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v109) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec4c054cd0 con 0x7fec540c7860 2023-11-04T01:47:02.267 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec400664a0 msgr2=0x7fec40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec400664a0 0x7fec40068960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fec440ad000 tx=0x7fec440b2040 comp rx=0 tx=0).stop 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 msgr2=0x7fec540b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 0x7fec540b3a80 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fec54066b30 tx=0x7fec4c007bc0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 shutdown_connections 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fec400664a0 0x7fec40068960 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec540c7860 0x7fec540b3a80 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fec5414e9c0 0x7fec540c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 --2- 172.21.15.40:0/1479713460 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec3c003980 0x7fec54143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 >> 172.21.15.40:0/1479713460 conn(0x7fec540cf520 msgr2=0x7fec5415a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 shutdown_connections 2023-11-04T01:47:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.267+0000 7fec59027640 1 -- 172.21.15.40:0/1479713460 wait complete. 2023-11-04T01:47:02.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:47:02.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.403+0000 7fbf3be71640 1 Processor -- start 2023-11-04T01:47:02.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.403+0000 7fbf3be71640 1 -- start start 2023-11-04T01:47:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3be71640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf340cd9f0 0x7fbf340ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3be71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf340cddd0 0x7fbf340cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3be71640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3415e950 con 0x7fbf3415ddd0 2023-11-04T01:47:02.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3be71640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340cf3d0 con 0x7fbf340cddd0 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3be71640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3415ebb0 con 0x7fbf340cd9f0 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf340cddd0 0x7fbf340cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf340cddd0 0x7fbf340cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36616/0 (socket says 172.21.15.40:36616) 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 -- 172.21.15.40:0/3139422764 learned_addr learned my addr 172.21.15.40:0/3139422764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf39c0d640 1 --2- 172.21.15.40:0/3139422764 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf340cd9f0 0x7fbf340ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 -- 172.21.15.40:0/3139422764 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf340cd9f0 msgr2=0x7fbf340ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 --2- 172.21.15.40:0/3139422764 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf340cd9f0 0x7fbf340ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 -- 172.21.15.40:0/3139422764 >> v1:172.21.15.91:6789/0 conn(0x7fbf3415ddd0 legacy=0x7fbf3415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 -- 172.21.15.40:0/3139422764 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf341613c0 con 0x7fbf340cddd0 2023-11-04T01:47:02.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf3940c640 1 --2- 172.21.15.40:0/3139422764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cddd0 0x7fbf340cee90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009e50 tx=0x7fbf2801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cea9b1da963b25 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf38c0b640 1 -- 172.21.15.40:0/3139422764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280a5740 con 0x7fbf340cddd0 2023-11-04T01:47:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf38c0b640 1 -- 172.21.15.40:0/3139422764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf280a58a0 con 0x7fbf340cddd0 2023-11-04T01:47:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.407+0000 7fbf38c0b640 1 -- 172.21.15.40:0/3139422764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280a5c30 con 0x7fbf340cddd0 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/3139422764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cddd0 msgr2=0x7fbf340cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 --2- 172.21.15.40:0/3139422764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cddd0 0x7fbf340cee90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009e50 tx=0x7fbf2801c9d0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/3139422764 shutdown_connections 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 --2- 172.21.15.40:0/3139422764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cddd0 0x7fbf340cee90 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 --2- 172.21.15.40:0/3139422764 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf340cd9f0 0x7fbf340ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/3139422764 >> 172.21.15.40:0/3139422764 conn(0x7fbf3406dd20 msgr2=0x7fbf3406e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:02.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/3139422764 shutdown_connections 2023-11-04T01:47:02.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/3139422764 wait complete. 2023-11-04T01:47:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 Processor -- start 2023-11-04T01:47:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- start start 2023-11-04T01:47:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 0x7fbf34152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf340cddd0 0x7fbf340af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf3415ddd0 0x7fbf340af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34157e80 con 0x7fbf340cd9f0 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf341575e0 con 0x7fbf340cddd0 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf341578c0 con 0x7fbf3415ddd0 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 0x7fbf34152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 0x7fbf34152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36624/0 (socket says 172.21.15.40:36624) 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 -- 172.21.15.40:0/1400051225 learned_addr learned my addr 172.21.15.40:0/1400051225 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3a40e640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf3415ddd0 0x7fbf340af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3940c640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf340cddd0 0x7fbf340af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 -- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf3415ddd0 msgr2=0x7fbf340af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf3415ddd0 0x7fbf340af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 -- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf340cddd0 msgr2=0x7fbf340af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf340cddd0 0x7fbf340af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 -- 172.21.15.40:0/1400051225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28009b30 con 0x7fbf340cd9f0 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3940c640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf340cddd0 0x7fbf340af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf39c0d640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 0x7fbf34152290 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00d800 tx=0x7fbf2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00b6c0 con 0x7fbf340cd9f0 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00b820 con 0x7fbf340cd9f0 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf34157ba0 con 0x7fbf340cd9f0 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00bb90 con 0x7fbf340cd9f0 2023-11-04T01:47:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.411+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf341527d0 con 0x7fbf340cd9f0 2023-11-04T01:47:02.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.415+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3404e4a0 con 0x7fbf340cd9f0 2023-11-04T01:47:02.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.415+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf2c00bcf0 con 0x7fbf340cd9f0 2023-11-04T01:47:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.415+0000 7fbf327fc640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbf200664a0 0x7fbf20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.415+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fbf2c084b80 con 0x7fbf340cd9f0 2023-11-04T01:47:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.415+0000 7fbf3940c640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbf200664a0 0x7fbf20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.415+0000 7fbf3940c640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbf200664a0 0x7fbf20068960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbf280ae000 tx=0x7fbf280a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.419+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf2c051890 con 0x7fbf340cd9f0 2023-11-04T01:47:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.571+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fbf34070080 con 0x7fbf340cd9f0 2023-11-04T01:47:02.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.571+0000 7fbf327fc640 1 -- 172.21.15.40:0/1400051225 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v109) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbf2c011340 con 0x7fbf340cd9f0 2023-11-04T01:47:02.576 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbf200664a0 msgr2=0x7fbf20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbf200664a0 0x7fbf20068960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbf280ae000 tx=0x7fbf280a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 msgr2=0x7fbf34152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 0x7fbf34152290 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00d800 tx=0x7fbf2c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 shutdown_connections 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbf200664a0 0x7fbf20068960 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbf3415ddd0 0x7fbf340af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbf340cddd0 0x7fbf340af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 --2- 172.21.15.40:0/1400051225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf340cd9f0 0x7fbf34152290 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 >> 172.21.15.40:0/1400051225 conn(0x7fbf3406dd20 msgr2=0x7fbf34160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 shutdown_connections 2023-11-04T01:47:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.575+0000 7fbf3be71640 1 -- 172.21.15.40:0/1400051225 wait complete. 2023-11-04T01:47:02.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:47:02.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 Processor -- start 2023-11-04T01:47:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 -- start start 2023-11-04T01:47:02.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 0x7f41500ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f415015a380 0x7f41500c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500d0040 con 0x7f41500ce150 2023-11-04T01:47:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41500cd420 con 0x7f415015a380 2023-11-04T01:47:02.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f415518e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500d0290 con 0x7f4150159fa0 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 0x7f41500ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414e59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f415015a380 0x7f41500c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 0x7f41500ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:48354/0 (socket says 172.21.15.40:48354) 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 -- 172.21.15.40:0/1738851954 learned_addr learned my addr 172.21.15.40:0/1738851954 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 -- 172.21.15.40:0/1738851954 >> v2:172.21.15.91:3300/0 conn(0x7f415015a380 msgr2=0x7f41500c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 --2- 172.21.15.40:0/1738851954 >> v2:172.21.15.91:3300/0 conn(0x7f415015a380 0x7f41500c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 -- 172.21.15.40:0/1738851954 >> v1:172.21.15.91:6789/0 conn(0x7f41500ce150 legacy=0x7f41500ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.719+0000 7f414ed9d640 1 -- 172.21.15.40:0/1738851954 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500cd670 con 0x7f4150159fa0 2023-11-04T01:47:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f414ed9d640 1 --2- 172.21.15.40:0/1738851954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 0x7f41500ae9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414401e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a7c2709efdf2cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f414dd9b640 1 -- 172.21.15.40:0/1738851954 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440b2600 con 0x7f4150159fa0 2023-11-04T01:47:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f414dd9b640 1 -- 172.21.15.40:0/1738851954 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440b2760 con 0x7f4150159fa0 2023-11-04T01:47:02.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f414dd9b640 1 -- 172.21.15.40:0/1738851954 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440b2af0 con 0x7f4150159fa0 2023-11-04T01:47:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 -- 172.21.15.40:0/1738851954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 msgr2=0x7f41500ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 --2- 172.21.15.40:0/1738851954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 0x7f41500ae9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414401e6c0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 -- 172.21.15.40:0/1738851954 shutdown_connections 2023-11-04T01:47:02.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 --2- 172.21.15.40:0/1738851954 >> v2:172.21.15.91:3300/0 conn(0x7f415015a380 0x7f41500c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 --2- 172.21.15.40:0/1738851954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4150159fa0 0x7f41500ae9e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 -- 172.21.15.40:0/1738851954 >> 172.21.15.40:0/1738851954 conn(0x7f41500cf520 msgr2=0x7f41500cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 -- 172.21.15.40:0/1738851954 shutdown_connections 2023-11-04T01:47:02.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 -- 172.21.15.40:0/1738851954 wait complete. 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 Processor -- start 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.723+0000 7f415518e640 1 -- start start 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 0x7f41501512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4150159fa0 0x7f4150157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f415015a380 0x7f4150153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41501519b0 con 0x7f41500ce150 2023-11-04T01:47:02.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150151c90 con 0x7f4150159fa0 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4150151f70 con 0x7f415015a380 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 0x7f41501512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 0x7f41501512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36638/0 (socket says 172.21.15.40:36638) 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 -- 172.21.15.40:0/3727597560 learned_addr learned my addr 172.21.15.40:0/3727597560 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414f59e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f415015a380 0x7f4150153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414e59c640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4150159fa0 0x7f4150157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 -- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f415015a380 msgr2=0x7f4150153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f415015a380 0x7f4150153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 -- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4150159fa0 msgr2=0x7f4150157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4150159fa0 0x7f4150157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 -- 172.21.15.40:0/3727597560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440094d0 con 0x7f41500ce150 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414ed9d640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 0x7f41501512d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f414401cd70 tx=0x7f414401b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440bd5f0 con 0x7f41500ce150 2023-11-04T01:47:02.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440bd750 con 0x7f41500ce150 2023-11-04T01:47:02.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4150152250 con 0x7f41500ce150 2023-11-04T01:47:02.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440bdb00 con 0x7f41500ce150 2023-11-04T01:47:02.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4150152a50 con 0x7f41500ce150 2023-11-04T01:47:02.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4150073410 con 0x7f41500ce150 2023-11-04T01:47:02.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41440aa3f0 con 0x7f41500ce150 2023-11-04T01:47:02.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f41377fe640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f413c0664a0 0x7f413c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:02.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f4144121290 con 0x7f41500ce150 2023-11-04T01:47:02.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.727+0000 7f414e59c640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f413c0664a0 0x7f413c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:02.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.731+0000 7f414e59c640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f413c0664a0 0x7f413c068960 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4140009a50 tx=0x7f4140008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:02.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.731+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41440ee030 con 0x7f41500ce150 2023-11-04T01:47:02.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.887+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f41500667a0 con 0x7f41500ce150 2023-11-04T01:47:02.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.887+0000 7f41377fe640 1 -- 172.21.15.40:0/3727597560 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v109) v1 ==== 107+0+11 (secure 0 0 0) 0x7f41440f1650 con 0x7f41500ce150 2023-11-04T01:47:02.891 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:02.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f413c0664a0 msgr2=0x7f413c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f413c0664a0 0x7f413c068960 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4140009a50 tx=0x7f4140008040 comp rx=0 tx=0).stop 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 msgr2=0x7f41501512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 0x7f41501512d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f414401cd70 tx=0x7f414401b460 comp rx=0 tx=0).stop 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 shutdown_connections 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f413c0664a0 0x7f413c068960 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f415015a380 0x7f4150153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4150159fa0 0x7f4150157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 --2- 172.21.15.40:0/3727597560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41500ce150 0x7f41501512d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 >> 172.21.15.40:0/3727597560 conn(0x7f41500cf520 msgr2=0x7f4150071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 shutdown_connections 2023-11-04T01:47:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:02.891+0000 7f415518e640 1 -- 172.21.15.40:0/3727597560 wait complete. 2023-11-04T01:47:02.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:47:03.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 Processor -- start 2023-11-04T01:47:03.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 -- start start 2023-11-04T01:47:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f875815d0f0 0x7f87580ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580716d0 con 0x7f87580cd940 2023-11-04T01:47:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8758071ee0 con 0x7f875815d0f0 2023-11-04T01:47:03.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875d166640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87580cde00 con 0x7f875815d4d0 2023-11-04T01:47:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f8756d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f875815d0f0 0x7f87580ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875659c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875759e640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f87580cd940 0x7f875806a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:36986/0 (socket says 172.21.15.40:36986) 2023-11-04T01:47:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875759e640 1 -- 172.21.15.40:0/2222129546 learned_addr learned my addr 172.21.15.40:0/2222129546 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:03.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875659c640 1 -- 172.21.15.40:0/2222129546 >> v2:172.21.15.91:3300/0 conn(0x7f875815d0f0 msgr2=0x7f87580ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875659c640 1 --2- 172.21.15.40:0/2222129546 >> v2:172.21.15.91:3300/0 conn(0x7f875815d0f0 0x7f87580ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875659c640 1 -- 172.21.15.40:0/2222129546 >> v1:172.21.15.91:6789/0 conn(0x7f87580cd940 legacy=0x7f875806a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f875659c640 1 -- 172.21.15.40:0/2222129546 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758071920 con 0x7f875815d4d0 2023-11-04T01:47:03.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.031+0000 7f8756d9d640 1 --2- 172.21.15.40:0/2222129546 >> v2:172.21.15.91:3300/0 conn(0x7f875815d0f0 0x7f87580ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:03.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875659c640 1 --2- 172.21.15.40:0/2222129546 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580aefe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f874c0097c0 tx=0x7f874c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4f52567212dccd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f8755d9b640 1 -- 172.21.15.40:0/2222129546 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0ab670 con 0x7f875815d4d0 2023-11-04T01:47:03.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f8755d9b640 1 -- 172.21.15.40:0/2222129546 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c0ab7d0 con 0x7f875815d4d0 2023-11-04T01:47:03.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f8755d9b640 1 -- 172.21.15.40:0/2222129546 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0abb60 con 0x7f875815d4d0 2023-11-04T01:47:03.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 -- 172.21.15.40:0/2222129546 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 msgr2=0x7f87580aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 --2- 172.21.15.40:0/2222129546 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580aefe0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f874c0097c0 tx=0x7f874c01c450 comp rx=0 tx=0).stop 2023-11-04T01:47:03.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 -- 172.21.15.40:0/2222129546 shutdown_connections 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 --2- 172.21.15.40:0/2222129546 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580aefe0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 --2- 172.21.15.40:0/2222129546 >> v2:172.21.15.91:3300/0 conn(0x7f875815d0f0 0x7f87580ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 -- 172.21.15.40:0/2222129546 >> 172.21.15.40:0/2222129546 conn(0x7f875806b240 msgr2=0x7f875806b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 -- 172.21.15.40:0/2222129546 shutdown_connections 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 -- 172.21.15.40:0/2222129546 wait complete. 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 Processor -- start 2023-11-04T01:47:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.035+0000 7f875d166640 1 -- start start 2023-11-04T01:47:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 0x7f87580af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f875815d0f0 0x7f87581f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87581f99a0 con 0x7f87580cd940 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580afc80 con 0x7f875815d0f0 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87580aff60 con 0x7f875815d4d0 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 0x7f87580af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 0x7f87580af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36640/0 (socket says 172.21.15.40:36640) 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 -- 172.21.15.40:0/2290732479 learned_addr learned my addr 172.21.15.40:0/2290732479 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875659c640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f875815d0f0 0x7f87581f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875759e640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 -- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 msgr2=0x7f87580b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 -- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f875815d0f0 msgr2=0x7f87581f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f875815d0f0 0x7f87581f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 -- 172.21.15.40:0/2290732479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009a70 con 0x7f87580cd940 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875659c640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f875815d0f0 0x7f87581f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f8756d9d640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 0x7f87580af6a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f874800efc0 tx=0x7f874800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748014680 con 0x7f87580cd940 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800f040 con 0x7f87580cd940 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c009420 con 0x7f87580cd940 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748014a00 con 0x7f87580cd940 2023-11-04T01:47:03.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87580b0520 con 0x7f87580cd940 2023-11-04T01:47:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87580b5cf0 con 0x7f87580cd940 2023-11-04T01:47:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8748014b60 con 0x7f87580cd940 2023-11-04T01:47:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f873f7fe640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87440664a0 0x7f8744068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f87480856f0 con 0x7f87580cd940 2023-11-04T01:47:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.039+0000 7f875659c640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87440664a0 0x7f8744068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.043+0000 7f875659c640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87440664a0 0x7f8744068960 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f874c0af000 tx=0x7f874c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.043+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8748052400 con 0x7f87580cd940 2023-11-04T01:47:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.199+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f875806b950 con 0x7f87580cd940 2023-11-04T01:47:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.199+0000 7f873f7fe640 1 -- 172.21.15.40:0/2290732479 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8748055a20 con 0x7f87580cd940 2023-11-04T01:47:03.203 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87440664a0 msgr2=0x7f8744068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87440664a0 0x7f8744068960 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f874c0af000 tx=0x7f874c0b6040 comp rx=0 tx=0).stop 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 msgr2=0x7f87580af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 0x7f87580af6a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f874800efc0 tx=0x7f874800c490 comp rx=0 tx=0).stop 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 shutdown_connections 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f87440664a0 0x7f8744068960 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f875815d4d0 0x7f87580b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f875815d0f0 0x7f87581f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 --2- 172.21.15.40:0/2290732479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87580cd940 0x7f87580af6a0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 >> 172.21.15.40:0/2290732479 conn(0x7f875806b240 msgr2=0x7f875806d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 shutdown_connections 2023-11-04T01:47:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.203+0000 7f875d166640 1 -- 172.21.15.40:0/2290732479 wait complete. 2023-11-04T01:47:03.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:47:03.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:47:03.283+0000 7f55297fa640 -1 client.8118 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:47:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 Processor -- start 2023-11-04T01:47:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 -- start start 2023-11-04T01:47:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 0x7febd40cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40ccdf0 con 0x7febd40caaa0 2023-11-04T01:47:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd406fe50 con 0x7febd40c9a70 2023-11-04T01:47:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febdb4a6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40aef20 con 0x7febd415d410 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9242640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9a43640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 0x7febd40cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9a43640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 0x7febd40cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:57320/0 (socket says 172.21.15.40:57320) 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd8a41640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7febd40caaa0 0x7febd40c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:36990/0 (socket says 172.21.15.40:36990) 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9a43640 1 -- 172.21.15.40:0/3361400970 learned_addr learned my addr 172.21.15.40:0/3361400970 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9242640 1 -- 172.21.15.40:0/3361400970 >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 msgr2=0x7febd40cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9242640 1 --2- 172.21.15.40:0/3361400970 >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 0x7febd40cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9242640 1 -- 172.21.15.40:0/3361400970 >> v1:172.21.15.91:6789/0 conn(0x7febd40caaa0 legacy=0x7febd40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9242640 1 -- 172.21.15.40:0/3361400970 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd40b0750 con 0x7febd415d410 2023-11-04T01:47:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.347+0000 7febd9a43640 1 --2- 172.21.15.40:0/3361400970 >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 0x7febd40cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febd9242640 1 --2- 172.21.15.40:0/3361400970 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b0210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febc40097f0 tx=0x7febc401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b74c250172f54024 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febcbfff640 1 -- 172.21.15.40:0/3361400970 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc40ab600 con 0x7febd415d410 2023-11-04T01:47:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febcbfff640 1 -- 172.21.15.40:0/3361400970 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc40a7050 con 0x7febd415d410 2023-11-04T01:47:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febcbfff640 1 -- 172.21.15.40:0/3361400970 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc40ab980 con 0x7febd415d410 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 -- 172.21.15.40:0/3361400970 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 msgr2=0x7febd40b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 --2- 172.21.15.40:0/3361400970 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b0210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febc40097f0 tx=0x7febc401c480 comp rx=0 tx=0).stop 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 -- 172.21.15.40:0/3361400970 shutdown_connections 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 --2- 172.21.15.40:0/3361400970 >> v2:172.21.15.91:3300/0 conn(0x7febd40c9a70 0x7febd40cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 --2- 172.21.15.40:0/3361400970 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b0210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 -- 172.21.15.40:0/3361400970 >> 172.21.15.40:0/3361400970 conn(0x7febd40ced10 msgr2=0x7febd40cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 -- 172.21.15.40:0/3361400970 shutdown_connections 2023-11-04T01:47:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.351+0000 7febdb4a6640 1 -- 172.21.15.40:0/3361400970 wait complete. 2023-11-04T01:47:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 Processor -- start 2023-11-04T01:47:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- start start 2023-11-04T01:47:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 0x7febd40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febd40caaa0 0x7febd40c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40c41a0 con 0x7febd40c9a70 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40b3c30 con 0x7febd40caaa0 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40c37d0 con 0x7febd415d410 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 0x7febd40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 0x7febd40b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36642/0 (socket says 172.21.15.40:36642) 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 -- 172.21.15.40:0/4024088153 learned_addr learned my addr 172.21.15.40:0/4024088153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9a43640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd8a41640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febd40caaa0 0x7febd40c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 -- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 msgr2=0x7febd40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 -- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febd40caaa0 msgr2=0x7febd40c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febd40caaa0 0x7febd40c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 -- 172.21.15.40:0/4024088153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009b30 con 0x7febd40c9a70 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febd9242640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 0x7febd40b4610 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7febc401a0b0 tx=0x7febc4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4006e20 con 0x7febd40c9a70 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc40b5410 con 0x7febd40c9a70 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc40b5780 con 0x7febd40c9a70 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc4009420 con 0x7febd40c9a70 2023-11-04T01:47:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd40c2ea0 con 0x7febd40c9a70 2023-11-04T01:47:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.355+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd404e4a0 con 0x7febd40c9a70 2023-11-04T01:47:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.359+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7febc40b2070 con 0x7febd40c9a70 2023-11-04T01:47:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.359+0000 7febc9ffb640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7febb80664d0 0x7febb8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.359+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7febc411e890 con 0x7febd40c9a70 2023-11-04T01:47:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.359+0000 7febd8a41640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7febb80664d0 0x7febb8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.359+0000 7febd8a41640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7febb80664d0 0x7febb8068990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7febd41f8f70 tx=0x7febd0007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.363+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7febc40eb5b0 con 0x7febd40c9a70 2023-11-04T01:47:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.519+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febd40c5770 con 0x7febd40c9a70 2023-11-04T01:47:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.519+0000 7febc9ffb640 1 -- 172.21.15.40:0/4024088153 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7febc40eebd0 con 0x7febd40c9a70 2023-11-04T01:47:03.524 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:47:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7febb80664d0 msgr2=0x7febb8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7febb80664d0 0x7febb8068990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7febd41f8f70 tx=0x7febd0007cd0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 msgr2=0x7febd40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 0x7febd40b4610 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7febc401a0b0 tx=0x7febc4019220 comp rx=0 tx=0).stop 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 shutdown_connections 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7febb80664d0 0x7febb8068990 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7febd415d410 0x7febd40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febd40caaa0 0x7febd40c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 --2- 172.21.15.40:0/4024088153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd40c9a70 0x7febd40b4610 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 >> 172.21.15.40:0/4024088153 conn(0x7febd40ced10 msgr2=0x7febd40ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 shutdown_connections 2023-11-04T01:47:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.523+0000 7febdb4a6640 1 -- 172.21.15.40:0/4024088153 wait complete. 2023-11-04T01:47:03.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:47:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.667+0000 7f84f152e640 1 Processor -- start 2023-11-04T01:47:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.667+0000 7f84f152e640 1 -- start start 2023-11-04T01:47:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84f152e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f84ec160680 0x7f84ec0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84f152e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160a60 0x7f84ec0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84f152e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84ec0b3e30 0x7f84ec0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84f152e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0ceb60 con 0x7f84ec0b3e30 2023-11-04T01:47:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84f152e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0cf000 con 0x7f84ec160680 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84f152e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0b5de0 con 0x7f84ec160a60 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84ec0b3e30 0x7f84ec0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84ec0b3e30 0x7f84ec0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36656/0 (socket says 172.21.15.40:36656) 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 -- 172.21.15.40:0/583241622 learned_addr learned my addr 172.21.15.40:0/583241622 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84ea7fc640 1 --2- 172.21.15.40:0/583241622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160a60 0x7f84ec0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eaffd640 1 --2- 172.21.15.40:0/583241622 >> v2:172.21.15.91:3300/0 conn(0x7f84ec160680 0x7f84ec0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 -- 172.21.15.40:0/583241622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160a60 msgr2=0x7f84ec0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 --2- 172.21.15.40:0/583241622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160a60 0x7f84ec0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 -- 172.21.15.40:0/583241622 >> v2:172.21.15.91:3300/0 conn(0x7f84ec160680 msgr2=0x7f84ec0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 --2- 172.21.15.40:0/583241622 >> v2:172.21.15.91:3300/0 conn(0x7f84ec160680 0x7f84ec0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.671+0000 7f84eb7fe640 1 -- 172.21.15.40:0/583241622 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0d1610 con 0x7f84ec0b3e30 2023-11-04T01:47:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eb7fe640 1 --2- 172.21.15.40:0/583241622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec0ce620 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f84ec08d010 tx=0x7f84e401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddeac8ef4ad6b67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84e9ffb640 1 -- 172.21.15.40:0/583241622 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0d09b0 con 0x7f84ec0b3e30 2023-11-04T01:47:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84e9ffb640 1 -- 172.21.15.40:0/583241622 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40a5790 con 0x7f84ec0b3e30 2023-11-04T01:47:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84e9ffb640 1 -- 172.21.15.40:0/583241622 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40a5b20 con 0x7f84ec0b3e30 2023-11-04T01:47:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- 172.21.15.40:0/583241622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 msgr2=0x7f84ec0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- 172.21.15.40:0/583241622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec0ce620 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f84ec08d010 tx=0x7f84e401c910 comp rx=0 tx=0).stop 2023-11-04T01:47:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- 172.21.15.40:0/583241622 shutdown_connections 2023-11-04T01:47:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- 172.21.15.40:0/583241622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec0ce620 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- 172.21.15.40:0/583241622 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160a60 0x7f84ec0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- 172.21.15.40:0/583241622 >> v2:172.21.15.91:3300/0 conn(0x7f84ec160680 0x7f84ec0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- 172.21.15.40:0/583241622 >> 172.21.15.40:0/583241622 conn(0x7f84ec0d2f90 msgr2=0x7f84ec0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- 172.21.15.40:0/583241622 shutdown_connections 2023-11-04T01:47:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- 172.21.15.40:0/583241622 wait complete. 2023-11-04T01:47:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 Processor -- start 2023-11-04T01:47:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- start start 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec15db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160680 0x7f84ec06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84ec160a60 0x7f84ec0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec1508c0 con 0x7f84ec0b3e30 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec15e3e0 con 0x7f84ec160a60 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84f152e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec150aa0 con 0x7f84ec160680 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec15db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36660/0 (socket says 172.21.15.40:36660) 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 -- 172.21.15.40:0/4050142551 learned_addr learned my addr 172.21.15.40:0/4050142551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84ea7fc640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160680 0x7f84ec06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eb7fe640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84ec160a60 0x7f84ec0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 -- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160680 msgr2=0x7f84ec06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160680 0x7f84ec06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 -- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84ec160a60 msgr2=0x7f84ec0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84ec160a60 0x7f84ec0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.675+0000 7f84eaffd640 1 -- 172.21.15.40:0/4050142551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009b30 con 0x7f84ec0b3e30 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84eaffd640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec15db00 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00d800 tx=0x7f84dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0096a0 con 0x7f84ec0b3e30 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc009800 con 0x7f84ec0b3e30 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec150d80 con 0x7f84ec0b3e30 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc009b70 con 0x7f84ec0b3e30 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec15e040 con 0x7f84ec0b3e30 2023-11-04T01:47:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec0d1e90 con 0x7f84ec0b3e30 2023-11-04T01:47:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84dc009cd0 con 0x7f84ec0b3e30 2023-11-04T01:47:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84e37fe640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84cc0664d0 0x7f84cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f84dc084ce0 con 0x7f84ec0b3e30 2023-11-04T01:47:03.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84ea7fc640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84cc0664d0 0x7f84cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.679+0000 7f84ea7fc640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84cc0664d0 0x7f84cc068990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f84ec150850 tx=0x7f84d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.683+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84ec0d1e90 con 0x7f84ec0b3e30 2023-11-04T01:47:03.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.851+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84ec0d1e60 con 0x7f84ec0b3e30 2023-11-04T01:47:03.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.851+0000 7f84e37fe640 1 -- 172.21.15.40:0/4050142551 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 18 entries v109) v1 ==== 81+0+1083 (secure 0 0 0) 0x7f84dc0519f0 con 0x7f84ec0b3e30 2023-11-04T01:47:03.856 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/2884841846 2023-11-04T02:46:56.954663+0000 2023-11-04T01:47:03.856 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:47:03.856 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:47:03.857 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:47:03.858 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:47:03.858 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:47:03.858 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/771372867 2023-11-04T02:46:12.185534+0000 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:listed 18 entries 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84cc0664d0 msgr2=0x7f84cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84cc0664d0 0x7f84cc068990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f84ec150850 tx=0x7f84d4008040 comp rx=0 tx=0).stop 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 msgr2=0x7f84ec15db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec15db00 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00d800 tx=0x7f84dc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 shutdown_connections 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f84cc0664d0 0x7f84cc068990 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f84ec160a60 0x7f84ec0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f84ec160680 0x7f84ec06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 --2- 172.21.15.40:0/4050142551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ec0b3e30 0x7f84ec15db00 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 >> 172.21.15.40:0/4050142551 conn(0x7f84ec0d2f90 msgr2=0x7f84ec0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 shutdown_connections 2023-11-04T01:47:03.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:03.855+0000 7f84f152e640 1 -- 172.21.15.40:0/4050142551 wait complete. 2023-11-04T01:47:03.876 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:47:03.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:03.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:03.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[58982]: fuse finished with error 0 and tester_r 0 2023-11-04T01:47:03.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:47:03.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:03.890 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:47:03.938 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:47:03.938 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:03.985 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:47:03.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:47:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f7dc2a640 1 Processor -- start 2023-11-04T01:47:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f7dc2a640 1 -- start start 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f7dc2a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9f78142eb0 0x7f9f7815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f7dc2a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780ca100 con 0x7f9f78142ad0 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f7dc2a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780ca3e0 con 0x7f9f780cbd80 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f7dc2a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780ca6c0 con 0x7f9f78142eb0 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f777fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f78142ad0 0x7f9f780cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42470/0 (socket says 172.21.15.40:42470) 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f777fe640 1 -- 172.21.15.40:0/2112670115 learned_addr learned my addr 172.21.15.40:0/2112670115 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f76ffd640 1 --2- 172.21.15.40:0/2112670115 >> v2:172.21.15.91:3300/0 conn(0x7f9f78142eb0 0x7f9f7815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f76ffd640 1 -- 172.21.15.40:0/2112670115 >> v1:172.21.15.91:6789/0 conn(0x7f9f780cbd80 legacy=0x7f9f780c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f76ffd640 1 -- 172.21.15.40:0/2112670115 >> v1:172.21.15.40:6789/0 conn(0x7f9f78142ad0 legacy=0x7f9f780cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.159+0000 7f9f76ffd640 1 -- 172.21.15.40:0/2112670115 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780ca9a0 con 0x7f9f78142eb0 2023-11-04T01:47:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.163+0000 7f9f76ffd640 1 --2- 172.21.15.40:0/2112670115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f78142eb0 0x7f9f7815e4e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097c0 tx=0x7f9f6001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdbc24e2bf46363 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f767fc640 1 -- 172.21.15.40:0/2112670115 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600ab600 con 0x7f9f78142eb0 2023-11-04T01:47:04.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f767fc640 1 -- 172.21.15.40:0/2112670115 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f600a7050 con 0x7f9f78142eb0 2023-11-04T01:47:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f767fc640 1 -- 172.21.15.40:0/2112670115 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600ab980 con 0x7f9f78142eb0 2023-11-04T01:47:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/2112670115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f78142eb0 msgr2=0x7f9f7815e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/2112670115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f78142eb0 0x7f9f7815e4e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097c0 tx=0x7f9f6001c3f0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/2112670115 shutdown_connections 2023-11-04T01:47:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/2112670115 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f78142eb0 0x7f9f7815e4e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/2112670115 >> 172.21.15.40:0/2112670115 conn(0x7f9f780b0890 msgr2=0x7f9f780b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/2112670115 shutdown_connections 2023-11-04T01:47:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.167+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/2112670115 wait complete. 2023-11-04T01:47:04.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 Processor -- start 2023-11-04T01:47:04.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 -- start start 2023-11-04T01:47:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f780cbd80 0x7f9f78165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 0x7f9f780cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f78142eb0 0x7f9f7813d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780b2070 con 0x7f9f78142ad0 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780cd930 con 0x7f9f780cbd80 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781657c0 con 0x7f9f78142eb0 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 0x7f9f780cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 0x7f9f780cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36672/0 (socket says 172.21.15.40:36672) 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 -- 172.21.15.40:0/1389756172 learned_addr learned my addr 172.21.15.40:0/1389756172 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f777fe640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f780cbd80 0x7f9f78165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f77fff640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f78142eb0 0x7f9f7813d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 -- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f78142eb0 msgr2=0x7f9f7813d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f78142eb0 0x7f9f7813d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 -- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f780cbd80 msgr2=0x7f9f78165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f780cbd80 0x7f9f78165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 -- 172.21.15.40:0/1389756172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009420 con 0x7f9f78142ad0 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f777fe640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f780cbd80 0x7f9f78165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f77fff640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f78142eb0 0x7f9f7813d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f76ffd640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 0x7f9f780cd3f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f9f600ae040 tx=0x7f9f60019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600b4610 con 0x7f9f78142ad0 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f600b4790 con 0x7f9f78142ad0 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f78165aa0 con 0x7f9f78142ad0 2023-11-04T01:47:04.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600b4b40 con 0x7f9f78142ad0 2023-11-04T01:47:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.171+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f780b1d00 con 0x7f9f78142ad0 2023-11-04T01:47:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.175+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7804e4a0 con 0x7f9f78142ad0 2023-11-04T01:47:04.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.175+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f600b2040 con 0x7f9f78142ad0 2023-11-04T01:47:04.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.175+0000 7f9f6ffff640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f580664a0 0x7f9f58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.175+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f9f6011e5a0 con 0x7f9f78142ad0 2023-11-04T01:47:04.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.175+0000 7f9f777fe640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f580664a0 0x7f9f58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.175+0000 7f9f777fe640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f580664a0 0x7f9f58068960 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9f68005c10 tx=0x7f9f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.179+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f600eb220 con 0x7f9f78142ad0 2023-11-04T01:47:04.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:47:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.371+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f780cbb30 con 0x7f9f78142ad0 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.371+0000 7f9f6ffff640 1 -- 172.21.15.40:0/1389756172 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v108) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9f600ee840 con 0x7f9f78142ad0 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f580664a0 msgr2=0x7f9f58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f580664a0 0x7f9f58068960 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9f68005c10 tx=0x7f9f68009040 comp rx=0 tx=0).stop 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 msgr2=0x7f9f780cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 0x7f9f780cd3f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f9f600ae040 tx=0x7f9f60019190 comp rx=0 tx=0).stop 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 shutdown_connections 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9f580664a0 0x7f9f58068960 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9f78142eb0 0x7f9f7813d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f78142ad0 0x7f9f780cd3f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 --2- 172.21.15.40:0/1389756172 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f780cbd80 0x7f9f78165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 >> 172.21.15.40:0/1389756172 conn(0x7f9f780b0890 msgr2=0x7f9f780c3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 shutdown_connections 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:04.375+0000 7f9f7dc2a640 1 -- 172.21.15.40:0/1389756172 wait complete. 2023-11-04T01:47:04.395 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:47:04.395 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:47:04.395 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:47:04.395 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:47:04.395 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:04.396 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:47:04.396 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:47:04.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:47:04.396 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:04.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.396 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:47:04.402 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:47:04.402 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:47:04.402 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:47:04.402 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:47:04.403 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 41849sec preferred_lft 41849sec 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.404 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:04.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.405 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:47:04.457 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:47:04.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.458 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:47:04.506 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:47:04.506 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:47:04.506 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:47:04.507 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:47:04.507 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:47:04.507 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:47:04.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.507 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:47:04.507 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:47:04.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:47:04.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:47:04.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:47:04.507 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:47:04.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.586 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:47:04.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:47:04.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:47:04.635 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:04.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:47:04.690 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:47:04.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:04.690 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:04.738 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:04.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:04.738 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:04.785 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:04.834 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:47:04.834 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:47:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:04.837 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:04.837 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:04.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.837 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:47:04.885 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:47:04.885 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:47:04.930 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:04.938 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:47:04.939 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:04.939 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:04.939 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:04.939 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:04.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:04.940 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:47:05.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:47:05.015+0000 7f2b9b41b580 -1 init, newargv = 0x55ccd80146b0 newargc=15 2023-11-04T01:47:05.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[60024]: starting ceph client 2023-11-04T01:47:05.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[60024]: starting fuse 2023-11-04T01:47:06.086 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:06.094 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:47:06.094 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:47:06.094 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:47:06.094 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:47:06.094 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:47:06.095 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:06.097 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:06.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:06.097 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:47:06.146 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:47:06.146 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:47:06.146 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:47:06.147 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:47:06.148 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:47:06.148 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:47:06.148 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:47:06.148 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:47:06.148 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:47:06.273 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.60024.asok 2023-11-04T01:47:06.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:06.285 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60024.asok 2023-11-04T01:47:06.286 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:06.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.60024.asok status 2023-11-04T01:47:06.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:06.482 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "60024", 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:47:06.483 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 8352, 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 8352 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1658130781 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:47:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1658130781 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.8352 192.168.0.1:0/1658130781", 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/1658130781", 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 108, 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 109, 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:47:06.485 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:47:06.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:06.503 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:06.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:47:06.503 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:06.556 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:47:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:06.563 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:06.563 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:06.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:06.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:06.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:06.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:47:06.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28e0ffc640 1 Processor -- start 2023-11-04T01:47:06.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28e0ffc640 1 -- start start 2023-11-04T01:47:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28e0ffc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f28dc0d0570 0x7f28dc165c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28e0ffc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc06ffb0 con 0x7f28dc15aea0 2023-11-04T01:47:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28e0ffc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc0d0b50 con 0x7f28dc06e1f0 2023-11-04T01:47:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28e0ffc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0b3c10 con 0x7f28dc0d0570 2023-11-04T01:47:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28da59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f28dc15aea0 0x7f28dc06dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42478/0 (socket says 172.21.15.40:42478) 2023-11-04T01:47:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28da59c640 1 -- 172.21.15.40:0/3706674763 learned_addr learned my addr 172.21.15.40:0/3706674763 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28dad9d640 1 --2- 172.21.15.40:0/3706674763 >> v2:172.21.15.91:3300/0 conn(0x7f28dc0d0570 0x7f28dc165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475191533 0 0) 0x7f28dc06ffb0 con 0x7f28dc15aea0 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c8003530 con 0x7f28dc15aea0 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895493281 0 0) 0x7f28dc0d0b50 con 0x7f28dc06e1f0 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28dc06ffb0 con 0x7f28dc06e1f0 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828261498 0 0) 0x7f28c8003530 con 0x7f28dc15aea0 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 >> v2:172.21.15.91:3300/0 conn(0x7f28dc0d0570 msgr2=0x7f28dc165c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 --2- 172.21.15.40:0/3706674763 >> v2:172.21.15.91:3300/0 conn(0x7f28dc0d0570 0x7f28dc165c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 >> v1:172.21.15.91:6789/0 conn(0x7f28dc06e1f0 legacy=0x7f28dc0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc070440 con 0x7f28dc15aea0 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f28cc001680 con 0x7f28dc15aea0 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 >> v1:172.21.15.40:6789/0 conn(0x7f28dc15aea0 legacy=0x7f28dc06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28c8003b60 0x7f28c8003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28c80047d0 0x7f28c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80051e0 0x7f28c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c800c0e0 con 0x7f28c80047d0 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c800c250 con 0x7f28c80051e0 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c800c410 con 0x7f28c8003b60 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28c80047d0 0x7f28c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28da59c640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28c8003b60 0x7f28c8003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.743+0000 7f28dad9d640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80051e0 0x7f28c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28c8003b60 msgr2=0x7f28c8003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28c8003b60 0x7f28c8003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80051e0 msgr2=0x7f28c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80051e0 0x7f28c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3706674763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8003530 con 0x7f28c80047d0 2023-11-04T01:47:06.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28dad9d640 1 -- 172.21.15.40:0/3706674763 reap_dead start 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28c80047d0 0x7f28c8004c50 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f28c40018d0 tx=0x7f28c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5cdaf134e35dbb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40052d0 con 0x7f28c80047d0 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c40a7050 con 0x7f28c80047d0 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28d959a640 1 -- 172.21.15.40:0/3706674763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4003600 con 0x7f28c80047d0 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3706674763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28c80047d0 msgr2=0x7f28c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28c80047d0 0x7f28c8004c50 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f28c40018d0 tx=0x7f28c401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3706674763 shutdown_connections 2023-11-04T01:47:06.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3706674763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28c80047d0 0x7f28c8004c50 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3706674763 >> 172.21.15.40:0/3706674763 conn(0x7f28dc0d0dc0 msgr2=0x7f28dc0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3706674763 shutdown_connections 2023-11-04T01:47:06.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.747+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3706674763 wait complete. 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 Processor -- start 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 -- start start 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80047d0 0x7f28dc158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 0x7f28dc0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28dc15ca80 0x7f28dc15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c6010 con 0x7f28dc0c48f0 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc15d440 con 0x7f28c80047d0 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c5390 con 0x7f28dc15ca80 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 0x7f28dc0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 0x7f28dc0c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36688/0 (socket says 172.21.15.40:36688) 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3272702494 learned_addr learned my addr 172.21.15.40:0/3272702494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28da59c640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80047d0 0x7f28dc158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28dad9d640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28dc15ca80 0x7f28dc15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28dc15ca80 msgr2=0x7f28dc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28dc15ca80 0x7f28dc15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80047d0 msgr2=0x7f28dc158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80047d0 0x7f28dc158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3272702494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0c5670 con 0x7f28dc0c48f0 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 0x7f28dc0c4d70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f28c40ad040 tx=0x7f28c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d2ffd640 1 -- 172.21.15.40:0/3272702494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40069e0 con 0x7f28dc0c48f0 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d2ffd640 1 -- 172.21.15.40:0/3272702494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4006b40 con 0x7f28dc0c48f0 2023-11-04T01:47:06.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28d2ffd640 1 -- 172.21.15.40:0/3272702494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40037c0 con 0x7f28dc0c48f0 2023-11-04T01:47:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0c5950 con 0x7f28dc0c48f0 2023-11-04T01:47:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.751+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc0c6430 con 0x7f28dc0c48f0 2023-11-04T01:47:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28d2ffd640 1 -- 172.21.15.40:0/3272702494 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28c4003920 con 0x7f28dc0c48f0 2023-11-04T01:47:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28d2ffd640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28bc0664a0 0x7f28bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28d2ffd640 1 -- 172.21.15.40:0/3272702494 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f28c411e680 con 0x7f28dc0c48f0 2023-11-04T01:47:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28bc0664a0 0x7f28bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 Processor -- start 2023-11-04T01:47:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 -- start start 2023-11-04T01:47:06.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28bc0664a0 0x7f28bc068960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0c78f0 tx=0x7f28cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 0x557848a9e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a547f0 0x557848a54bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784891cd80 con 0x557848a9e5f0 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578488ad7a0 con 0x557848a9ef10 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578488aacd0 con 0x557848a547f0 2023-11-04T01:47:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 0x557848a9e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 0x557848a9e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36704/0 (socket says 172.21.15.40:36704) 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 -- 172.21.15.40:0/2551907514 learned_addr learned my addr 172.21.15.40:0/2551907514 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28dad9d640 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a547f0 0x557848a54bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 -- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a547f0 msgr2=0x557848a54bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a547f0 0x557848a54bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 -- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 msgr2=0x557848a542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 -- 172.21.15.40:0/2551907514 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557848843180 con 0x557848a9e5f0 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28da59c640 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 0x557848a9e9d0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f28cc001760 tx=0x7f28cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3369ecf290df4da2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28bbfff640 1 -- 172.21.15.40:0/2551907514 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0157c0 con 0x557848a9e5f0 2023-11-04T01:47:06.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28bbfff640 1 -- 172.21.15.40:0/2551907514 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc015920 con 0x557848a9e5f0 2023-11-04T01:47:06.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.755+0000 7f28bbfff640 1 -- 172.21.15.40:0/2551907514 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc015c90 con 0x557848a9e5f0 2023-11-04T01:47:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/2551907514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 msgr2=0x557848a9e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 0x557848a9e9d0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f28cc001760 tx=0x7f28cc014000 comp rx=0 tx=0).stop 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/2551907514 shutdown_connections 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a547f0 0x557848a54bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- 172.21.15.40:0/2551907514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a9e5f0 0x557848a9e9d0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/2551907514 >> 172.21.15.40:0/2551907514 conn(0x55784893cd50 msgr2=0x557848a52b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/2551907514 shutdown_connections 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/2551907514 wait complete. 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- start start 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 Processor -- start 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848a82bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848a83110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a83650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578488a65c0 con 0x557848a547f0 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578488648c0 con 0x557848a9ef10 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x557848864560 con 0x557848a9e5f0 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 10 client.0 _ll_register_callbacks cb 0x557848a3fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848a82bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848a82bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36720/0 (socket says 172.21.15.40:36720) 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 -- 172.21.15.40:0/83019603 learned_addr learned my addr 172.21.15.40:0/83019603 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848a83110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28dad9d640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a83650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 -- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 msgr2=0x557848a83110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848a83110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 -- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 msgr2=0x557848a83650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a83650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 -- 172.21.15.40:0/83019603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc070440 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28dad9d640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a83650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28da59c640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848a82bd0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000c10 tx=0x7f28cc001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c6ef9c3020dab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 1 -- 172.21.15.40:0/83019603 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc022930 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 1 -- 172.21.15.40:0/83019603 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f28cc01d050 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557848871da0 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 1 -- 172.21.15.40:0/83019603 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28cc022a90 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 10 client.8364 fetch_fsmap learned FSMap version 108 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55784859ee20 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 1 -- 172.21.15.40:0/83019603 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557848871da0 con 0x557848a547f0 2023-11-04T01:47:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 1 -- 172.21.15.40:0/83019603 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 108) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f28cc022bf0 con 0x557848a547f0 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 10 client.8364 fetch_fsmap finished waiting for FSMap version 108 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 10 client.8364 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 20 client.8364 populate_metadata read hostname 'smithi040' 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a83f20 0x557848aafd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 4 client.8364 mds_command: new command op to 7995 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 --> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557848871b80 con 0x557848a83f20 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a83f20 0x557848aafd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a83f20 0x557848aafd70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27236562ed1da310 server_cookie=920301e1bed792a5 in_seq=0 out_seq=0 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.759+0000 7f28b97fa640 10 client.8364 ms_handle_connect on v2:172.21.15.40:6834/3996815211 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28b97fa640 1 -- 172.21.15.40:0/83019603 <== mds.0 v2:172.21.15.40:6834/3996815211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557848871b80 con 0x557848a83f20 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28b97fa640 10 client.8364 handle_command_reply: tid=0 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 client.8364 shutdown 2023-11-04T01:47:06.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 msgr2=0x557848a82bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848a82bd0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000c10 tx=0x7f28cc001940 comp rx=0 tx=0).stop 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 shutdown_connections 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a83f20 0x557848aafd70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a9ef10 0x557848a83650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848a83110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28b97fa640 0 client.8364 ms_handle_reset on v2:172.21.15.40:6834/3996815211 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 --2- 172.21.15.40:0/83019603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848a82bd0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 >> 172.21.15.40:0/83019603 conn(0x55784893cd50 msgr2=0x557848a52b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 shutdown_connections 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 1 -- 172.21.15.40:0/83019603 wait complete. 2023-11-04T01:47:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.763+0000 7f28e4129000 20 client.8364 trim_cache size 0 max 16384 2023-11-04T01:47:06.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 Processor -- start 2023-11-04T01:47:06.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 -- start start 2023-11-04T01:47:06.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 0x557848aafd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a547f0 0x557848ab02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848ab07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784855faa0 con 0x55784893cd50 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784889df70 con 0x557848a547f0 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578488a08c0 con 0x557848a9e5f0 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 0x557848aafd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 0x557848aafd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36734/0 (socket says 172.21.15.40:36734) 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 -- 172.21.15.40:0/681322532 learned_addr learned my addr 172.21.15.40:0/681322532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 -- 172.21.15.40:0/681322532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 msgr2=0x557848ab07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848ab07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 -- 172.21.15.40:0/681322532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a547f0 msgr2=0x557848ab02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a547f0 0x557848ab02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 -- 172.21.15.40:0/681322532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578488672f0 con 0x55784893cd50 2023-11-04T01:47:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28da59c640 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 0x557848aafd70 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0224d0 tx=0x7f28cc02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990267e4f5de9fb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28d0ff9640 1 -- 172.21.15.40:0/681322532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0016f0 con 0x55784893cd50 2023-11-04T01:47:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28d0ff9640 1 -- 172.21.15.40:0/681322532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc022730 con 0x55784893cd50 2023-11-04T01:47:06.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.775+0000 7f28d0ff9640 1 -- 172.21.15.40:0/681322532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc022ae0 con 0x55784893cd50 2023-11-04T01:47:06.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/681322532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 msgr2=0x557848aafd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 0x557848aafd70 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0224d0 tx=0x7f28cc02d000 comp rx=0 tx=0).stop 2023-11-04T01:47:06.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/681322532 shutdown_connections 2023-11-04T01:47:06.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848ab07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x557848a547f0 0x557848ab02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- 172.21.15.40:0/681322532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55784893cd50 0x557848aafd70 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/681322532 >> 172.21.15.40:0/681322532 conn(0x557848a81a70 msgr2=0x557848a55cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/681322532 shutdown_connections 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/681322532 wait complete. 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- start start 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 Processor -- start 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55784893cd50 0x557848aff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848affd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848aba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578488a5450 con 0x557848a547f0 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578488a3dd0 con 0x55784893cd50 2023-11-04T01:47:06.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578488631e0 con 0x557848a9e5f0 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 10 client.0 _ll_register_callbacks cb 0x557848957bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848affd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848affd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36744/0 (socket says 172.21.15.40:36744) 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3213640724 learned_addr learned my addr 172.21.15.40:0/3213640724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28da59c640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55784893cd50 0x557848aff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28dad9d640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848aba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 msgr2=0x557848aba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848aba840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55784893cd50 msgr2=0x557848aff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55784893cd50 0x557848aff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 -- 172.21.15.40:0/3213640724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55784859ee20 con 0x557848a547f0 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28da59c640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55784893cd50 0x557848aff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28d9d9b640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848affd30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f28c40050a0 tx=0x7f28c40ef7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e01dfab62399e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 1 -- 172.21.15.40:0/3213640724 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40f7340 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 1 -- 172.21.15.40:0/3213640724 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f28c4001520 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557848a574e0 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 1 -- 172.21.15.40:0/3213640724 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c40eb750 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 10 client.8370 fetch_fsmap learned FSMap version 108 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55784884d7f0 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 1 -- 172.21.15.40:0/3213640724 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557848a574e0 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 1 -- 172.21.15.40:0/3213640724 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 108) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f28c40f50b0 con 0x557848a547f0 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 10 client.8370 fetch_fsmap finished waiting for FSMap version 108 2023-11-04T01:47:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 10 client.8370 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 20 client.8370 populate_metadata read hostname 'smithi040' 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a9ef10 0x557848abb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 4 client.8370 mds_command: new command op to 7995 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 --> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55784889d8b0 con 0x557848a9ef10 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28da59c640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a9ef10 0x557848abb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28da59c640 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a9ef10 0x557848abb230 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bab280f54fb4a14 server_cookie=a3351469d6cc9798 in_seq=0 out_seq=0 2023-11-04T01:47:06.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.779+0000 7f28b97fa640 10 client.8370 ms_handle_connect on v2:172.21.15.40:6834/3996815211 2023-11-04T01:47:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28b97fa640 1 -- 172.21.15.40:0/3213640724 <== mds.0 v2:172.21.15.40:6834/3996815211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55784889d8b0 con 0x557848a9ef10 2023-11-04T01:47:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28b97fa640 10 client.8370 handle_command_reply: tid=0 2023-11-04T01:47:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 client.8370 shutdown 2023-11-04T01:47:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 msgr2=0x557848affd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848affd30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f28c40050a0 tx=0x7f28c40ef7d0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 shutdown_connections 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:6834/3996815211,v1:172.21.15.40:6835/3996815211] conn(0x557848a9ef10 0x557848abb230 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x557848a9e5f0 0x557848aba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557848a547f0 0x557848affd30 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28b97fa640 0 client.8370 ms_handle_reset on v2:172.21.15.40:6834/3996815211 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 --2- 172.21.15.40:0/3213640724 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55784893cd50 0x557848aff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 >> 172.21.15.40:0/3213640724 conn(0x557848a81a70 msgr2=0x557848a58350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 shutdown_connections 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 1 -- 172.21.15.40:0/3213640724 wait complete. 2023-11-04T01:47:06.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.791+0000 7f28e4129000 20 client.8370 trim_cache size 0 max 16384 2023-11-04T01:47:06.798 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:47:06.798 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "", 2023-11-04T01:47:06.798 INFO:teuthology.orchestra.run.smithi040.stdout: "return_code": 0 2023-11-04T01:47:06.798 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28bc0664a0 msgr2=0x7f28bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28bc0664a0 0x7f28bc068960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0c78f0 tx=0x7f28cc009040 comp rx=0 tx=0).stop 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 msgr2=0x7f28dc0c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 0x7f28dc0c4d70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f28c40ad040 tx=0x7f28c8005800 comp rx=0 tx=0).stop 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 shutdown_connections 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f28bc0664a0 0x7f28bc068960 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f28dc15ca80 0x7f28dc15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28dc0c48f0 0x7f28dc0c4d70 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 --2- 172.21.15.40:0/3272702494 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f28c80047d0 0x7f28dc158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 >> 172.21.15.40:0/3272702494 conn(0x7f28dc0d0dc0 msgr2=0x7f28dc0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 shutdown_connections 2023-11-04T01:47:06.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.795+0000 7f28e0ffc640 1 -- 172.21.15.40:0/3272702494 wait complete. 2023-11-04T01:47:06.814 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6, also kill snapclient 2023-11-04T01:47:06.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.923+0000 7f244bc03640 1 Processor -- start 2023-11-04T01:47:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.923+0000 7f244bc03640 1 -- start start 2023-11-04T01:47:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244bc03640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f244415d380 0x7f244406a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244bc03640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244406d990 con 0x7f24440aed30 2023-11-04T01:47:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244bc03640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440719e0 con 0x7f2444160f50 2023-11-04T01:47:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244bc03640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244406cd80 con 0x7f244415d380 2023-11-04T01:47:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244919e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f24440aed30 0x7f2444070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42488/0 (socket says 172.21.15.40:42488) 2023-11-04T01:47:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244919e640 1 -- 172.21.15.40:0/1547612988 learned_addr learned my addr 172.21.15.40:0/1547612988 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244999f640 1 --2- 172.21.15.40:0/1547612988 >> v2:172.21.15.91:3300/0 conn(0x7f244415d380 0x7f244406a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130786694 0 0) 0x7f244406d990 con 0x7f24440aed30 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2430003530 con 0x7f24440aed30 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3211034890 0 0) 0x7f2430003530 con 0x7f24440aed30 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 >> v2:172.21.15.91:3300/0 conn(0x7f244415d380 msgr2=0x7f244406a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 --2- 172.21.15.40:0/1547612988 >> v2:172.21.15.91:3300/0 conn(0x7f244415d380 0x7f244406a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 >> v1:172.21.15.91:6789/0 conn(0x7f2444160f50 legacy=0x7f24440712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244406d060 con 0x7f24440aed30 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f2434001680 con 0x7f24440aed30 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 >> v1:172.21.15.40:6789/0 conn(0x7f24440aed30 legacy=0x7f2444070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2430003980 0x7f2430003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24300047d0 0x7f2430004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2430005190 0x7f243000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244406cd80 con 0x7f2430005190 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243000c130 con 0x7f24300047d0 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243000c2f0 con 0x7f2430003980 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244a1a0640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2430005190 0x7f243000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244999f640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2430003980 0x7f2430003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244919e640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24300047d0 0x7f2430004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244a1a0640 1 -- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2430003980 msgr2=0x7f2430003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244a1a0640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f2430003980 0x7f2430003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244a1a0640 1 -- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24300047d0 msgr2=0x7f2430004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244a1a0640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24300047d0 0x7f2430004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244a1a0640 1 -- 172.21.15.40:0/1547612988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430003530 con 0x7f2430005190 2023-11-04T01:47:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.927+0000 7f244919e640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24300047d0 0x7f2430004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244a1a0640 1 -- 172.21.15.40:0/1547612988 reap_dead start 2023-11-04T01:47:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244a1a0640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2430005190 0x7f243000b990 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f243c001e70 tx=0x7f243c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f5119f60df32f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c003b80 con 0x7f2430005190 2023-11-04T01:47:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c003d00 con 0x7f2430005190 2023-11-04T01:47:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244899d640 1 -- 172.21.15.40:0/1547612988 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c005260 con 0x7f2430005190 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- 172.21.15.40:0/1547612988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2430005190 msgr2=0x7f243000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2430005190 0x7f243000b990 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f243c001e70 tx=0x7f243c01c760 comp rx=0 tx=0).stop 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- 172.21.15.40:0/1547612988 shutdown_connections 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 --2- 172.21.15.40:0/1547612988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2430005190 0x7f243000b990 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- 172.21.15.40:0/1547612988 >> 172.21.15.40:0/1547612988 conn(0x7f24440b18a0 msgr2=0x7f24440b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- 172.21.15.40:0/1547612988 shutdown_connections 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- 172.21.15.40:0/1547612988 wait complete. 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 Processor -- start 2023-11-04T01:47:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- start start 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2430005190 0x7f24441f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f244415b580 0x7f24441547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 0x7f2444154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441598d0 con 0x7f244415b9e0 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444158f50 con 0x7f2430005190 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244bc03640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2444159210 con 0x7f244415b580 2023-11-04T01:47:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244a1a0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 0x7f2444154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244a1a0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 0x7f2444154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36768/0 (socket says 172.21.15.40:36768) 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244a1a0640 1 -- 172.21.15.40:0/208044485 learned_addr learned my addr 172.21.15.40:0/208044485 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244919e640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f244415b580 0x7f24441547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.931+0000 7f244999f640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2430005190 0x7f24441f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244a1a0640 1 -- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f244415b580 msgr2=0x7f24441547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244a1a0640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f244415b580 0x7f24441547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244a1a0640 1 -- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2430005190 msgr2=0x7f24441f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244a1a0640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2430005190 0x7f24441f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244a1a0640 1 -- 172.21.15.40:0/208044485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24441594f0 con 0x7f244415b9e0 2023-11-04T01:47:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244a1a0640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 0x7f2444154cf0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f243c01cc40 tx=0x7f2430005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0ac070 con 0x7f244415b9e0 2023-11-04T01:47:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c003b90 con 0x7f244415b9e0 2023-11-04T01:47:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c006d60 con 0x7f244415b9e0 2023-11-04T01:47:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24441f41c0 con 0x7f244415b9e0 2023-11-04T01:47:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444159ec0 con 0x7f244415b9e0 2023-11-04T01:47:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2444159a10 con 0x7f244415b9e0 2023-11-04T01:47:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f243c0054e0 con 0x7f244415b9e0 2023-11-04T01:47:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f243a7fc640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24280664a0 0x7f2428068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f243c11d370 con 0x7f244415b9e0 2023-11-04T01:47:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.935+0000 7f244999f640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24280664a0 0x7f2428068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.939+0000 7f244999f640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24280664a0 0x7f2428068960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ae0 tx=0x7f2440008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:06.939+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2444159a10 con 0x7f244415b9e0 2023-11-04T01:47:07.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.127+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2444159a10 con 0x7f244415b9e0 2023-11-04T01:47:07.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.127+0000 7f243a7fc640 1 -- 172.21.15.40:0/208044485 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f2444159a10 con 0x7f244415b9e0 2023-11-04T01:47:07.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:07.133 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:46:58.125046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:07.133 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 108 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24280664a0 msgr2=0x7f2428068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24280664a0 0x7f2428068960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ae0 tx=0x7f2440008040 comp rx=0 tx=0).stop 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 msgr2=0x7f2444154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 0x7f2444154cf0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f243c01cc40 tx=0x7f2430005800 comp rx=0 tx=0).stop 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 shutdown_connections 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f24280664a0 0x7f2428068960 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244415b9e0 0x7f2444154cf0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f244415b580 0x7f24441547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 --2- 172.21.15.40:0/208044485 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2430005190 0x7f24441f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 >> 172.21.15.40:0/208044485 conn(0x7f24440b18a0 msgr2=0x7f2444157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 shutdown_connections 2023-11-04T01:47:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.131+0000 7f244bc03640 1 -- 172.21.15.40:0/208044485 wait complete. 2023-11-04T01:47:07.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:47:07.290 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:24.386602+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:07.291 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:24.386602+0000" } ] } 2023-11-04T01:47:07.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:47:07.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 Processor -- start 2023-11-04T01:47:07.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 -- start start 2023-11-04T01:47:07.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a40d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:07.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a40d1cb0 0x7f12a40b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:07.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40d09b0 con 0x7f12a415d5a0 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40d0110 con 0x7f12a40d1cb0 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12ac6ee640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40d03f0 con 0x7f12a415d1c0 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a40d1cb0 0x7f12a40b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12a9c89640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f12a415d5a0 0x7f12a40d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52398/0 (socket says 172.21.15.40:52398) 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a40d1cb0 0x7f12a40b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43740/0 (socket says 172.21.15.40:43740) 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12a9c89640 1 -- 172.21.15.40:0/1614823019 learned_addr learned my addr 172.21.15.40:0/1614823019 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aa48a640 1 --2- 172.21.15.40:0/1614823019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a40d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 -- 172.21.15.40:0/1614823019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 msgr2=0x7f12a40d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 --2- 172.21.15.40:0/1614823019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a40d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 -- 172.21.15.40:0/1614823019 >> v1:172.21.15.40:6789/0 conn(0x7f12a415d5a0 legacy=0x7f12a40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12a9488640 1 -- 172.21.15.40:0/1614823019 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253063468 0 0) 0x7f12a40d09b0 con 0x7f12a415d5a0 2023-11-04T01:47:07.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 -- 172.21.15.40:0/1614823019 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40d06d0 con 0x7f12a40d1cb0 2023-11-04T01:47:07.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12aac8b640 1 --2- 172.21.15.40:0/1614823019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b0240 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d90 tx=0x7f129c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca4f230af9e7acb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:07.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12a9488640 1 -- 172.21.15.40:0/1614823019 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0a59c0 con 0x7f12a40d1cb0 2023-11-04T01:47:07.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.411+0000 7f12a9488640 1 -- 172.21.15.40:0/1614823019 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c0a5b20 con 0x7f12a40d1cb0 2023-11-04T01:47:07.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12a9488640 1 -- 172.21.15.40:0/1614823019 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0ad440 con 0x7f12a40d1cb0 2023-11-04T01:47:07.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/1614823019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a40d1cb0 msgr2=0x7f12a40b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:07.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/1614823019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b0240 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f129c009d90 tx=0x7f129c01c920 comp rx=0 tx=0).stop 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/1614823019 shutdown_connections 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/1614823019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b0240 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/1614823019 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a40d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/1614823019 >> 172.21.15.40:0/1614823019 conn(0x7f12a40d2fc0 msgr2=0x7f12a40d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/1614823019 shutdown_connections 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/1614823019 wait complete. 2023-11-04T01:47:07.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 Processor -- start 2023-11-04T01:47:07.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- start start 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a41f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 0x7f12a40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b8a70 con 0x7f12a415d5a0 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40ca880 con 0x7f12a40d1cb0 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b8790 con 0x7f12a415d1c0 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 0x7f12a40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 0x7f12a40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43744/0 (socket says 172.21.15.40:43744) 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 -- 172.21.15.40:0/2034319240 learned_addr learned my addr 172.21.15.40:0/2034319240 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:07.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12a9c89640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a41f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aa48a640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 -- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 msgr2=0x7f12a41f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a41f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 -- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12a40d1cb0 msgr2=0x7f12a40b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 -- 172.21.15.40:0/2034319240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c009a70 con 0x7f12a415d5a0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12a9c89640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a41f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aa48a640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12aac8b640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 0x7f12a40b5f70 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f129c01afd0 tx=0x7f129c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0ade40 con 0x7f12a415d5a0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c009450 con 0x7f12a415d5a0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40ca230 con 0x7f12a415d5a0 2023-11-04T01:47:07.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0b9670 con 0x7f12a415d5a0 2023-11-04T01:47:07.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.415+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a41f99a0 con 0x7f12a415d5a0 2023-11-04T01:47:07.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.419+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a40ca090 con 0x7f12a415d5a0 2023-11-04T01:47:07.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.419+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f129c0b97d0 con 0x7f12a415d5a0 2023-11-04T01:47:07.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.419+0000 7f129affd640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12880664a0 0x7f1288068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:07.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.419+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f129c11fe60 con 0x7f12a415d5a0 2023-11-04T01:47:07.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.419+0000 7f12aa48a640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12880664a0 0x7f1288068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:07.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.419+0000 7f12aa48a640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12880664a0 0x7f1288068960 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009840 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:07.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.423+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12a40ca090 con 0x7f12a415d5a0 2023-11-04T01:47:07.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:07.635+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f12a40ca090 con 0x7f12a415d5a0 2023-11-04T01:47:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.183+0000 7f129affd640 1 -- 172.21.15.40:0/2034319240 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7995 v109) v1 ==== 112+0+0 (secure 0 0 0) 0x7f12a40ca090 con 0x7f12a415d5a0 2023-11-04T01:47:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.7995 2023-11-04T01:47:08.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12880664a0 msgr2=0x7f1288068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12880664a0 0x7f1288068960 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009840 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 msgr2=0x7f12a40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 0x7f12a40b5f70 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f129c01afd0 tx=0x7f129c0196c0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 shutdown_connections 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f12880664a0 0x7f1288068960 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a415d5a0 0x7f12a40b5f70 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f12a415d1c0 0x7f12a41f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 --2- 172.21.15.40:0/2034319240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f12a40d1cb0 0x7f12a40b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 >> 172.21.15.40:0/2034319240 conn(0x7f12a40d2fc0 msgr2=0x7f12a40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 shutdown_connections 2023-11-04T01:47:08.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.187+0000 7f12ac6ee640 1 -- 172.21.15.40:0/2034319240 wait complete. 2023-11-04T01:47:08.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:47:08.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.339+0000 7f991cc84640 1 Processor -- start 2023-11-04T01:47:08.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.339+0000 7f991cc84640 1 -- start start 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991cc84640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f991815d1c0 0x7f99180d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991cc84640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f99180b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991cc84640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180d09b0 con 0x7f991815d5a0 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991cc84640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180d0110 con 0x7f991815d1c0 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991cc84640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99180d03f0 con 0x7f99180d1cb0 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f991815d1c0 0x7f99180d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f9915d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f991815d5a0 0x7f99180d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52414/0 (socket says 172.21.15.40:52414) 2023-11-04T01:47:08.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f9915d9b640 1 -- 172.21.15.40:0/939113228 learned_addr learned my addr 172.21.15.40:0/939113228 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:08.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991659c640 1 -- 172.21.15.40:0/939113228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 msgr2=0x7f99180b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:08.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991659c640 1 --2- 172.21.15.40:0/939113228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f99180b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991659c640 1 -- 172.21.15.40:0/939113228 >> v1:172.21.15.40:6789/0 conn(0x7f991815d5a0 legacy=0x7f99180d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:08.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991559a640 1 -- 172.21.15.40:0/939113228 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438419 0 0) 0x7f99180d09b0 con 0x7f991815d5a0 2023-11-04T01:47:08.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991659c640 1 -- 172.21.15.40:0/939113228 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180d06d0 con 0x7f991815d1c0 2023-11-04T01:47:08.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991659c640 1 --2- 172.21.15.40:0/939113228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d1c0 0x7f99180d3ae0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f9908009d90 tx=0x7f990801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9e7020232f781e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:08.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991559a640 1 -- 172.21.15.40:0/939113228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080a59c0 con 0x7f991815d1c0 2023-11-04T01:47:08.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991559a640 1 -- 172.21.15.40:0/939113228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99080a5b20 con 0x7f991815d1c0 2023-11-04T01:47:08.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.343+0000 7f991559a640 1 -- 172.21.15.40:0/939113228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080ad440 con 0x7f991815d1c0 2023-11-04T01:47:08.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/939113228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d1c0 msgr2=0x7f99180d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:08.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 --2- 172.21.15.40:0/939113228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d1c0 0x7f99180d3ae0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f9908009d90 tx=0x7f990801c920 comp rx=0 tx=0).stop 2023-11-04T01:47:08.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/939113228 shutdown_connections 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 --2- 172.21.15.40:0/939113228 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f99180b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 --2- 172.21.15.40:0/939113228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d1c0 0x7f99180d3ae0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/939113228 >> 172.21.15.40:0/939113228 conn(0x7f99180d2fc0 msgr2=0x7f99180d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/939113228 shutdown_connections 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/939113228 wait complete. 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 Processor -- start 2023-11-04T01:47:08.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- start start 2023-11-04T01:47:08.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f9918158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:08.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f991815d1c0 0x7f99180ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:08.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 0x7f99180b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99181574e0 con 0x7f991815d5a0 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b54a0 con 0x7f991815d1c0 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99180ca5d0 con 0x7f99180d1cb0 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 0x7f99180b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 0x7f99180b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43752/0 (socket says 172.21.15.40:43752) 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 -- 172.21.15.40:0/998477633 learned_addr learned my addr 172.21.15.40:0/998477633 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991659c640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f9918158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9915d9b640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f991815d1c0 0x7f99180ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 -- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 msgr2=0x7f9918158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f9918158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 -- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f991815d1c0 msgr2=0x7f99180ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f991815d1c0 0x7f99180ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:08.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 -- 172.21.15.40:0/998477633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009a70 con 0x7f991815d5a0 2023-11-04T01:47:08.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9916d9d640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 0x7f99180b2670 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f991000b440 tx=0x7f991000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:08.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910011890 con 0x7f991815d5a0 2023-11-04T01:47:08.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910011a10 con 0x7f991815d5a0 2023-11-04T01:47:08.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910011dc0 con 0x7f991815d5a0 2023-11-04T01:47:08.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99180b2ec0 con 0x7f991815d5a0 2023-11-04T01:47:08.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.347+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9918156e20 con 0x7f991815d5a0 2023-11-04T01:47:08.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.351+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9918157620 con 0x7f991815d5a0 2023-11-04T01:47:08.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.351+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f991001a400 con 0x7f991815d5a0 2023-11-04T01:47:08.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.351+0000 7f9906ffd640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98f80664a0 0x7f98f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:08.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.351+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f99100848b0 con 0x7f991815d5a0 2023-11-04T01:47:08.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.351+0000 7f991659c640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98f80664a0 0x7f98f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:08.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.351+0000 7f991659c640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98f80664a0 0x7f98f8068960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f99080af000 tx=0x7f99080a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:08.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.355+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9918157620 con 0x7f991815d5a0 2023-11-04T01:47:08.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:08.571+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f9918157620 con 0x7f991815d5a0 2023-11-04T01:47:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.195+0000 7f9906ffd640 1 -- 172.21.15.40:0/998477633 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.6994 v110) v1 ==== 112+0+0 (secure 0 0 0) 0x7f9918157620 con 0x7f991815d5a0 2023-11-04T01:47:09.199 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.6994 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98f80664a0 msgr2=0x7f98f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98f80664a0 0x7f98f8068960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f99080af000 tx=0x7f99080a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 msgr2=0x7f99180b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 0x7f99180b2670 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f991000b440 tx=0x7f991000b900 comp rx=0 tx=0).stop 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 shutdown_connections 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f98f80664a0 0x7f98f8068960 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991815d5a0 0x7f99180b2670 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f991815d1c0 0x7f99180ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 --2- 172.21.15.40:0/998477633 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f99180d1cb0 0x7f9918158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 >> 172.21.15.40:0/998477633 conn(0x7f99180d2fc0 msgr2=0x7f991815c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 shutdown_connections 2023-11-04T01:47:09.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.199+0000 7f991cc84640 1 -- 172.21.15.40:0/998477633 wait complete. 2023-11-04T01:47:09.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:47:09.363 INFO:teuthology.orchestra.run.smithi040.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:47:09.363 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:47:09.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:09.364 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s26) 2023-11-04T01:47:09.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:47:09.512 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:47:09.513 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:47:09.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726ee35640 1 Processor -- start 2023-11-04T01:47:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726ee35640 1 -- start start 2023-11-04T01:47:09.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726ee35640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 0x7f726806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726ee35640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72680b2200 con 0x7f72680ac940 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726ee35640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72680ad130 con 0x7f726806d770 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726ee35640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72680ad410 con 0x7f72680cb350 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f72680ac940 0x7f726806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52422/0 (socket says 172.21.15.40:52422) 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 -- 172.21.15.40:0/4265192822 learned_addr learned my addr 172.21.15.40:0/4265192822 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726cbd1640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 0x7f726806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532500277 0 0) 0x7f72680b2200 con 0x7f72680ac940 2023-11-04T01:47:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7258003530 con 0x7f72680ac940 2023-11-04T01:47:09.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473927772 0 0) 0x7f72680ad130 con 0x7f726806d770 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72680b2200 con 0x7f726806d770 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3704939976 0 0) 0x7f7258003530 con 0x7f72680ac940 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 msgr2=0x7f726806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 0x7f726806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 >> v1:172.21.15.91:6789/0 conn(0x7f726806d770 legacy=0x7f72680b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680b2470 con 0x7f72680ac940 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f7254001680 con 0x7f72680ac940 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 >> v1:172.21.15.40:6789/0 conn(0x7f72680ac940 legacy=0x7f726806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7258003b40 0x7f7258003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580047d0 0x7f7258004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 0x7f7258005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680ad410 con 0x7f72580047d0 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725800ba40 con 0x7f7258003b40 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725800bc00 con 0x7f72680cb350 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580047d0 0x7f7258004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726cbd1640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7258003b40 0x7f7258003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f726d3d2640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 0x7f7258005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 -- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 msgr2=0x7f7258005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f72680cb350 0x7f7258005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 -- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7258003b40 msgr2=0x7f7258003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7258003b40 0x7f7258003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.627+0000 7f7267fff640 1 -- 172.21.15.40:0/4265192822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7258003530 con 0x7f72580047d0 2023-11-04T01:47:09.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f7267fff640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580047d0 0x7f7258004c50 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f7254007fa0 tx=0x7f725401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1314684b75451d8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:09.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254005ae0 con 0x7f72580047d0 2023-11-04T01:47:09.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254005c40 con 0x7f72580047d0 2023-11-04T01:47:09.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f72677fe640 1 -- 172.21.15.40:0/4265192822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72540a57e0 con 0x7f72580047d0 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 -- 172.21.15.40:0/4265192822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580047d0 msgr2=0x7f7258004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 --2- 172.21.15.40:0/4265192822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580047d0 0x7f7258004c50 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f7254007fa0 tx=0x7f725401cae0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726d3d2640 1 -- 172.21.15.40:0/4265192822 reap_dead start 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 -- 172.21.15.40:0/4265192822 shutdown_connections 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 -- 172.21.15.40:0/4265192822 >> 172.21.15.40:0/4265192822 conn(0x7f72680cbd90 msgr2=0x7f72680cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 -- 172.21.15.40:0/4265192822 shutdown_connections 2023-11-04T01:47:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 -- 172.21.15.40:0/4265192822 wait complete. 2023-11-04T01:47:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 Processor -- start 2023-11-04T01:47:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.631+0000 7f726ee35640 1 -- start start 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72580047d0 0x7f7268148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7268099a70 0x7f7268099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 0x7f72680c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680c7e60 con 0x7f72680c63e0 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680c8420 con 0x7f72580047d0 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268158ee0 con 0x7f7268099a70 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 0x7f72680c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 0x7f72680c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43770/0 (socket says 172.21.15.40:43770) 2023-11-04T01:47:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 -- 172.21.15.40:0/2629458531 learned_addr learned my addr 172.21.15.40:0/2629458531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726cbd1640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72580047d0 0x7f7268148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f7267fff640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7268099a70 0x7f7268099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 -- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7268099a70 msgr2=0x7f7268099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7268099a70 0x7f7268099ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 -- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72580047d0 msgr2=0x7f7268148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72580047d0 0x7f7268148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 -- 172.21.15.40:0/2629458531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680c6f10 con 0x7f72680c63e0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726cbd1640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72580047d0 0x7f7268148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726d3d2640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 0x7f72680c6860 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f72680aed00 tx=0x7f726000f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000fd50 con 0x7f72680c63e0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726000fed0 con 0x7f72680c63e0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260015650 con 0x7f72680c63e0 2023-11-04T01:47:09.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72680c71f0 con 0x7f72680c63e0 2023-11-04T01:47:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7268148b40 con 0x7f72680c63e0 2023-11-04T01:47:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7268067610 con 0x7f72680c63e0 2023-11-04T01:47:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.635+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72600157b0 con 0x7f72680c63e0 2023-11-04T01:47:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.639+0000 7f72657fa640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f724c0664a0 0x7f724c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:09.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.639+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f7260088570 con 0x7f72680c63e0 2023-11-04T01:47:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.639+0000 7f726cbd1640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f724c0664a0 0x7f724c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.639+0000 7f726cbd1640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f724c0664a0 0x7f724c068960 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f725c00bc30 tx=0x7f725c00b3a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:09.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.639+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7260058d80 con 0x7f72680c63e0 2023-11-04T01:47:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.831+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72680c8560 con 0x7f72680c63e0 2023-11-04T01:47:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.831+0000 7f72657fa640 1 -- 172.21.15.40:0/2629458531 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f7260058910 con 0x7f72680c63e0 2023-11-04T01:47:09.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:09.836 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:08.577017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 110 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f724c0664a0 msgr2=0x7f724c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f724c0664a0 0x7f724c068960 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f725c00bc30 tx=0x7f725c00b3a0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 msgr2=0x7f72680c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 0x7f72680c6860 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f72680aed00 tx=0x7f726000f170 comp rx=0 tx=0).stop 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 shutdown_connections 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f724c0664a0 0x7f724c068960 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72680c63e0 0x7f72680c6860 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7268099a70 0x7f7268099ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 --2- 172.21.15.40:0/2629458531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f72580047d0 0x7f7268148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:09.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 >> 172.21.15.40:0/2629458531 conn(0x7f72680cbd90 msgr2=0x7f72680cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:09.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 shutdown_connections 2023-11-04T01:47:09.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:09.835+0000 7f726ee35640 1 -- 172.21.15.40:0/2629458531 wait complete. 2023-11-04T01:47:09.854 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:14.133 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2c16db4640 time 2023-11-04T01:47:14.133753+0000 2023-11-04T01:47:14.133 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:14.134 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c22eecfae] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:47:14.135 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7f2c16db4640 thread_name:MR_Finisher 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:47:14.131+0000 7f2c16db4640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2c16db4640 time 2023-11-04T01:47:14.133753+0000 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c22eecfae] 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.136 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c22827520] 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:47:14.137 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c22eed008] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:47:14.131+0000 7f2c16db4640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7f2c16db4640 thread_name:MR_Finisher 2023-11-04T01:47:14.138 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c22827520] 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c22eed008] 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.139 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:14.140 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.148 INFO:tasks.ceph.mds.a.smithi040.stderr: -1100> 2023-11-04T01:47:00.067+0000 7f2c1a5bb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:14.148 INFO:tasks.ceph.mds.a.smithi040.stderr: -1098> 2023-11-04T01:47:00.067+0000 7f2c1a5bb640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: -4> 2023-11-04T01:47:14.131+0000 7f2c16db4640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2c16db4640 time 2023-11-04T01:47:14.133753+0000 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c22eecfae] 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.152 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 0> 2023-11-04T01:47:14.131+0000 7f2c16db4640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7f2c16db4640 thread_name:MR_Finisher 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c22827520] 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:47:14.153 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c22eed008] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:14.154 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.161 INFO:tasks.ceph.mds.a.smithi040.stderr: -1100> 2023-11-04T01:47:00.067+0000 7f2c1a5bb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:14.161 INFO:tasks.ceph.mds.a.smithi040.stderr: -1098> 2023-11-04T01:47:00.067+0000 7f2c1a5bb640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:14.164 INFO:tasks.ceph.mds.a.smithi040.stderr: -4> 2023-11-04T01:47:14.131+0000 7f2c16db4640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f2c16db4640 time 2023-11-04T01:47:14.133753+0000 2023-11-04T01:47:14.164 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:14.164 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c22eecfae] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.165 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: 0> 2023-11-04T01:47:14.131+0000 7f2c16db4640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7f2c16db4640 thread_name:MR_Finisher 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c22827520] 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:47:14.166 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:47:14.167 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:47:14.167 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c22eed008] 2023-11-04T01:47:14.167 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2c22eed162] 2023-11-04T01:47:14.167 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561a0f7d5da5] 2023-11-04T01:47:14.167 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561a0f80608c] 2023-11-04T01:47:14.168 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561a0f8064bc] 2023-11-04T01:47:14.168 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561a0f8065f3] 2023-11-04T01:47:14.168 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f2c22f93305] 2023-11-04T01:47:14.168 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2c22879b43] 2023-11-04T01:47:14.168 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2c2290ba00] 2023-11-04T01:47:14.169 INFO:tasks.ceph.mds.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:14.169 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:47:14.405 INFO:tasks.ceph.mds.a.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:47:14.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:14.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 Processor -- start 2023-11-04T01:47:14.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 -- start start 2023-11-04T01:47:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 0x7f829c0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f829c0ce7f0 0x7f829c0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0cf000 con 0x7f829c160680 2023-11-04T01:47:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0d09b0 con 0x7f829c0ce7f0 2023-11-04T01:47:14.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f82a1308640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0b5de0 con 0x7f829c160a60 2023-11-04T01:47:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f829affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f829c160680 0x7f829c0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52438/0 (socket says 172.21.15.40:52438) 2023-11-04T01:47:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f829affd640 1 -- 172.21.15.40:0/2315022669 learned_addr learned my addr 172.21.15.40:0/2315022669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f829a7fc640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 0x7f829c0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f829b7fe640 1 --2- 172.21.15.40:0/2315022669 >> v2:172.21.15.91:3300/0 conn(0x7f829c0ce7f0 0x7f829c0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417055458 0 0) 0x7f829c0cf000 con 0x7f829c160680 2023-11-04T01:47:14.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.987+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8288003530 con 0x7f829c160680 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086213035 0 0) 0x7f8288003530 con 0x7f829c160680 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 msgr2=0x7f829c0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 0x7f829c0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 >> v2:172.21.15.91:3300/0 conn(0x7f829c0ce7f0 msgr2=0x7f829c0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 --2- 172.21.15.40:0/2315022669 >> v2:172.21.15.91:3300/0 conn(0x7f829c0ce7f0 0x7f829c0b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0d1610 con 0x7f829c160680 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f8294001a00 con 0x7f829c160680 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 >> v1:172.21.15.40:6789/0 conn(0x7f829c160680 legacy=0x7f829c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8288003980 0x7f8288003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:14.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 0x7f82880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8288004d10 0x7f8288005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0d09b0 con 0x7f8288003980 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0b5de0 con 0x7f8288004d10 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828800b990 con 0x7f829c160a60 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8288003980 0x7f8288003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829a7fc640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 0x7f82880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829b7fe640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8288004d10 0x7f8288005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 -- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 msgr2=0x7f82880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f829c160a60 0x7f82880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 -- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8288004d10 msgr2=0x7f8288005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8288004d10 0x7f8288005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:14.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 -- 172.21.15.40:0/2315022669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288003530 con 0x7f8288003980 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829affd640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8288003980 0x7f8288003da0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f829400a900 tx=0x7f829401d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d9f83d5d0b4a65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82940a5ea0 con 0x7f8288003980 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82940a8070 con 0x7f8288003980 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f8299ffb640 1 -- 172.21.15.40:0/2315022669 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82940ad870 con 0x7f8288003980 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f82a1308640 1 -- 172.21.15.40:0/2315022669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8288003980 msgr2=0x7f8288003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f82a1308640 1 --2- 172.21.15.40:0/2315022669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8288003980 0x7f8288003da0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f829400a900 tx=0x7f829401d390 comp rx=0 tx=0).stop 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f829b7fe640 1 -- 172.21.15.40:0/2315022669 reap_dead start 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f82a1308640 1 -- 172.21.15.40:0/2315022669 shutdown_connections 2023-11-04T01:47:14.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f82a1308640 1 -- 172.21.15.40:0/2315022669 >> 172.21.15.40:0/2315022669 conn(0x7f829c0d2f90 msgr2=0x7f829c0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:14.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f82a1308640 1 -- 172.21.15.40:0/2315022669 shutdown_connections 2023-11-04T01:47:14.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.991+0000 7f82a1308640 1 -- 172.21.15.40:0/2315022669 wait complete. 2023-11-04T01:47:14.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 Processor -- start 2023-11-04T01:47:14.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- start start 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8288003980 0x7f829c0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c15d130 0x7f829c0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 0x7f829c146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c15c6b0 con 0x7f829c146410 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c9770 con 0x7f829c15d130 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c161060 con 0x7f8288003980 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 0x7f829c146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 0x7f829c146890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43790/0 (socket says 172.21.15.40:43790) 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 -- 172.21.15.40:0/3627136479 learned_addr learned my addr 172.21.15.40:0/3627136479 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829affd640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8288003980 0x7f829c0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:15.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829a7fc640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c15d130 0x7f829c0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 -- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8288003980 msgr2=0x7f829c0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8288003980 0x7f829c0cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 -- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c15d130 msgr2=0x7f829c0c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c15d130 0x7f829c0c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 -- 172.21.15.40:0/3627136479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c161340 con 0x7f829c146410 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f829b7fe640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 0x7f829c146890 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f829c08b4c0 tx=0x7f828c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c004500 con 0x7f829c146410 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c003620 con 0x7f829c146410 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c15c930 con 0x7f829c146410 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c003a10 con 0x7f829c146410 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c15d570 con 0x7f829c146410 2023-11-04T01:47:15.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.995+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0cf810 con 0x7f829c146410 2023-11-04T01:47:15.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.999+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f828c003b70 con 0x7f829c146410 2023-11-04T01:47:15.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.999+0000 7f82937fe640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f827c0664a0 0x7f827c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:15.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.999+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f828c084820 con 0x7f829c146410 2023-11-04T01:47:15.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.999+0000 7f829affd640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f827c0664a0 0x7f827c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:15.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:14.999+0000 7f829affd640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f827c0664a0 0x7f827c068960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f82940ad000 tx=0x7f8294001d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:15.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.003+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f828c051530 con 0x7f829c146410 2023-11-04T01:47:15.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:47:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.191+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f829c1614d0 con 0x7f829c146410 2023-11-04T01:47:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.191+0000 7f82937fe640 1 -- 172.21.15.40:0/3627136479 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4934 (secure 0 0 0) 0x7f828c054b50 con 0x7f829c146410 2023-11-04T01:47:15.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:15.195 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:08.577017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 110 2023-11-04T01:47:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f827c0664a0 msgr2=0x7f827c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f827c0664a0 0x7f827c068960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f82940ad000 tx=0x7f8294001d90 comp rx=0 tx=0).stop 2023-11-04T01:47:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 msgr2=0x7f829c146890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 0x7f829c146890 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f829c08b4c0 tx=0x7f828c011920 comp rx=0 tx=0).stop 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 shutdown_connections 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f827c0664a0 0x7f827c068960 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c146410 0x7f829c146890 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f829c15d130 0x7f829c0c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 --2- 172.21.15.40:0/3627136479 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f8288003980 0x7f829c0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 >> 172.21.15.40:0/3627136479 conn(0x7f829c0d2f90 msgr2=0x7f829c0ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:15.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 shutdown_connections 2023-11-04T01:47:15.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:15.195+0000 7f82a1308640 1 -- 172.21.15.40:0/3627136479 wait complete. 2023-11-04T01:47:15.213 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:20.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 Processor -- start 2023-11-04T01:47:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 -- start start 2023-11-04T01:47:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 0x7fb490071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb4900719a0 0x7fb49006a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4900cd1a0 con 0x7fb49013ddb0 2023-11-04T01:47:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49015f3e0 con 0x7fb4900719a0 2023-11-04T01:47:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb496e52640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49015c6f0 con 0x7fb49013e190 2023-11-04T01:47:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb494bee640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb49013ddb0 0x7fb49015ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33772/0 (socket says 172.21.15.40:33772) 2023-11-04T01:47:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb494bee640 1 -- 172.21.15.40:0/2780506666 learned_addr learned my addr 172.21.15.40:0/2780506666 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 0x7fb490071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb4953ef640 1 --2- 172.21.15.40:0/2780506666 >> v2:172.21.15.91:3300/0 conn(0x7fb4900719a0 0x7fb49006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951118111 0 0) 0x7fb4900cd1a0 con 0x7fb49013ddb0 2023-11-04T01:47:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c003530 con 0x7fb49013ddb0 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1136796107 0 0) 0x7fb47c003530 con 0x7fb49013ddb0 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 msgr2=0x7fb490071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 0x7fb490071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 >> v2:172.21.15.91:3300/0 conn(0x7fb4900719a0 msgr2=0x7fb49006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 --2- 172.21.15.40:0/2780506666 >> v2:172.21.15.91:3300/0 conn(0x7fb4900719a0 0x7fb49006a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49015f5d0 con 0x7fb49013ddb0 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fb480001a00 con 0x7fb49013ddb0 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 >> v1:172.21.15.40:6789/0 conn(0x7fb49013ddb0 legacy=0x7fb49015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 0x7fb47c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb47c003f00 0x7fb47c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c004d10 0x7fb47c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49015c6f0 con 0x7fb47c003f00 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c00b990 con 0x7fb47c004d10 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c00bad0 con 0x7fb49013e190 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb47c003f00 0x7fb47c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb494bee640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 0x7fb47c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb4953ef640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c004d10 0x7fb47c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 -- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 msgr2=0x7fb47c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49013e190 0x7fb47c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 -- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c004d10 msgr2=0x7fb47c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c004d10 0x7fb47c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.347+0000 7fb48ffff640 1 -- 172.21.15.40:0/2780506666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c003530 con 0x7fb47c003f00 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb48ffff640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb47c003f00 0x7fb47c0047d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb478009ae0 tx=0x7fb47801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2780a4973f698477 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780a5530 con 0x7fb47c003f00 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780a5690 con 0x7fb47c003f00 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb48f7fe640 1 -- 172.21.15.40:0/2780506666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780a5a40 con 0x7fb47c003f00 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb496e52640 1 -- 172.21.15.40:0/2780506666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb47c003f00 msgr2=0x7fb47c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb496e52640 1 --2- 172.21.15.40:0/2780506666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb47c003f00 0x7fb47c0047d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb478009ae0 tx=0x7fb47801c9f0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb4953ef640 1 -- 172.21.15.40:0/2780506666 reap_dead start 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb496e52640 1 -- 172.21.15.40:0/2780506666 shutdown_connections 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb496e52640 1 -- 172.21.15.40:0/2780506666 >> 172.21.15.40:0/2780506666 conn(0x7fb4900b18a0 msgr2=0x7fb4900b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:20.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb496e52640 1 -- 172.21.15.40:0/2780506666 shutdown_connections 2023-11-04T01:47:20.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.351+0000 7fb496e52640 1 -- 172.21.15.40:0/2780506666 wait complete. 2023-11-04T01:47:20.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 Processor -- start 2023-11-04T01:47:20.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- start start 2023-11-04T01:47:20.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c003f00 0x7fb4901542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49006e0a0 0x7fb490157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 0x7fb49013f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901586c0 con 0x7fb49013eef0 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901589a0 con 0x7fb47c003f00 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49013e6f0 con 0x7fb49006e0a0 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 0x7fb49013f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 0x7fb49013f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36054/0 (socket says 172.21.15.40:36054) 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 -- 172.21.15.40:0/1395634882 learned_addr learned my addr 172.21.15.40:0/1395634882 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb48ffff640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49006e0a0 0x7fb490157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb494bee640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c003f00 0x7fb4901542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 -- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49006e0a0 msgr2=0x7fb490157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49006e0a0 0x7fb490157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 -- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c003f00 msgr2=0x7fb4901542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c003f00 0x7fb4901542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 -- 172.21.15.40:0/1395634882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49013e9d0 con 0x7fb49013eef0 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb4953ef640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 0x7fb49013f3a0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fb490155d20 tx=0x7fb488011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488004500 con 0x7fb49013eef0 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb488003620 con 0x7fb49013eef0 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490154800 con 0x7fb49013eef0 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488003a10 con 0x7fb49013eef0 2023-11-04T01:47:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb490158480 con 0x7fb49013eef0 2023-11-04T01:47:20.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.355+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49013ebc0 con 0x7fb49013eef0 2023-11-04T01:47:20.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.359+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb488003b70 con 0x7fb49013eef0 2023-11-04T01:47:20.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.359+0000 7fb48d7fa640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4700664a0 0x7fb470068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:20.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.359+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fb488084530 con 0x7fb49013eef0 2023-11-04T01:47:20.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.359+0000 7fb494bee640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4700664a0 0x7fb470068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:20.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.359+0000 7fb494bee640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4700664a0 0x7fb470068960 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb4800013e0 tx=0x7fb480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:20.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.363+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4880512d0 con 0x7fb49013eef0 2023-11-04T01:47:20.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.551+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb490158480 con 0x7fb49013eef0 2023-11-04T01:47:20.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.551+0000 7fb48d7fa640 1 -- 172.21.15.40:0/1395634882 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fb490158480 con 0x7fb49013eef0 2023-11-04T01:47:20.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:20.555 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:08.577017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:20.555 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 110 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.551+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4700664a0 msgr2=0x7fb470068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.551+0000 7fb496e52640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4700664a0 0x7fb470068960 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb4800013e0 tx=0x7fb480009040 comp rx=0 tx=0).stop 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.551+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 msgr2=0x7fb49013f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.551+0000 7fb496e52640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 0x7fb49013f3a0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fb490155d20 tx=0x7fb488011920 comp rx=0 tx=0).stop 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 shutdown_connections 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb4700664a0 0x7fb470068960 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb49013eef0 0x7fb49013f3a0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb49006e0a0 0x7fb490157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 --2- 172.21.15.40:0/1395634882 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb47c003f00 0x7fb4901542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 >> 172.21.15.40:0/1395634882 conn(0x7fb4900b18a0 msgr2=0x7fb49006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:20.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 shutdown_connections 2023-11-04T01:47:20.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:20.555+0000 7fb496e52640 1 -- 172.21.15.40:0/1395634882 wait complete. 2023-11-04T01:47:20.573 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:21.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:47:25.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd849277640 1 Processor -- start 2023-11-04T01:47:25.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd849277640 1 -- start start 2023-11-04T01:47:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd849277640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 0x7fd844167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd849277640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440cf000 con 0x7fd844160680 2023-11-04T01:47:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd849277640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440b5de0 con 0x7fd844160a60 2023-11-04T01:47:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd849277640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440d09b0 con 0x7fd8440b72f0 2023-11-04T01:47:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd842ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd844160680 0x7fd8440cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33782/0 (socket says 172.21.15.40:33782) 2023-11-04T01:47:25.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd842ffd640 1 -- 172.21.15.40:0/1042409954 learned_addr learned my addr 172.21.15.40:0/1042409954 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd8437fe640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 0x7fd844167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245853623 0 0) 0x7fd8440cf000 con 0x7fd844160680 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd82c003530 con 0x7fd844160680 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170584031 0 0) 0x7fd82c003530 con 0x7fd844160680 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 msgr2=0x7fd844167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 0x7fd844167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 >> v1:172.21.15.91:6789/0 conn(0x7fd844160a60 legacy=0x7fd8440ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440d1610 con 0x7fd844160680 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd834001680 con 0x7fd844160680 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 >> v1:172.21.15.40:6789/0 conn(0x7fd844160680 legacy=0x7fd8440cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd82c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 0x7fd82c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd82c004d10 0x7fd82c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440d09b0 con 0x7fd82c0039b0 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00ba40 con 0x7fd82c004d10 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00bc00 con 0x7fd8440b72f0 2023-11-04T01:47:25.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd842ffd640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd82c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd8427fc640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 0x7fd82c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd8437fe640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd82c004d10 0x7fd82c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd842ffd640 1 -- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 msgr2=0x7fd82c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd842ffd640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd8440b72f0 0x7fd82c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.711+0000 7fd842ffd640 1 -- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd82c004d10 msgr2=0x7fd82c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd842ffd640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd82c004d10 0x7fd82c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd842ffd640 1 -- 172.21.15.40:0/1042409954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c003530 con 0x7fd82c0039b0 2023-11-04T01:47:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd842ffd640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd82c003dd0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c210 tx=0x7fd83401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440c75148b84a1d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834005ae0 con 0x7fd82c0039b0 2023-11-04T01:47:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834005c40 con 0x7fd82c0039b0 2023-11-04T01:47:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd841ffb640 1 -- 172.21.15.40:0/1042409954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340a58d0 con 0x7fd82c0039b0 2023-11-04T01:47:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd849277640 1 -- 172.21.15.40:0/1042409954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 msgr2=0x7fd82c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd849277640 1 --2- 172.21.15.40:0/1042409954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd82c003dd0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd83400c210 tx=0x7fd83401cbf0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd8437fe640 1 -- 172.21.15.40:0/1042409954 reap_dead start 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd849277640 1 -- 172.21.15.40:0/1042409954 shutdown_connections 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd849277640 1 -- 172.21.15.40:0/1042409954 >> 172.21.15.40:0/1042409954 conn(0x7fd8440d2f90 msgr2=0x7fd8440d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd849277640 1 -- 172.21.15.40:0/1042409954 shutdown_connections 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.715+0000 7fd849277640 1 -- 172.21.15.40:0/1042409954 wait complete. 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 Processor -- start 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- start start 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd8441f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd844152f10 0x7fd844152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd844151390 0x7fd8440b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844151120 con 0x7fd82c0039b0 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844157fc0 con 0x7fd844151390 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd844153390 con 0x7fd844152f10 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd8441f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd8441f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36078/0 (socket says 172.21.15.40:36078) 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 -- 172.21.15.40:0/3426152423 learned_addr learned my addr 172.21.15.40:0/3426152423 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd8427fc640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd844152f10 0x7fd844152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd8437fe640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd844151390 0x7fd8440b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 -- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd844152f10 msgr2=0x7fd844152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd844152f10 0x7fd844152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 -- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd844151390 msgr2=0x7fd8440b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd844151390 0x7fd8440b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 -- 172.21.15.40:0/3426152423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844153640 con 0x7fd82c0039b0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd842ffd640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd8441f69b0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd83401cc30 tx=0x7fd82c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340b4070 con 0x7fd82c0039b0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834005db0 con 0x7fd82c0039b0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd844153920 con 0x7fd82c0039b0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834001640 con 0x7fd82c0039b0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd844152650 con 0x7fd82c0039b0 2023-11-04T01:47:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84404e4a0 con 0x7fd82c0039b0 2023-11-04T01:47:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8340a58d0 con 0x7fd82c0039b0 2023-11-04T01:47:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.719+0000 7fd82b7fe640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8300664a0 0x7fd830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.723+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fd83411e0a0 con 0x7fd82c0039b0 2023-11-04T01:47:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.723+0000 7fd8427fc640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8300664a0 0x7fd830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.723+0000 7fd8427fc640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8300664a0 0x7fd830068960 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd838005210 tx=0x7fd838009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.727+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8340eade0 con 0x7fd82c0039b0 2023-11-04T01:47:25.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.911+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd84415e510 con 0x7fd82c0039b0 2023-11-04T01:47:25.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.911+0000 7fd82b7fe640 1 -- 172.21.15.40:0/3426152423 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fd8340ee400 con 0x7fd82c0039b0 2023-11-04T01:47:25.916 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:25.916 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:08.577017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:25.916 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 110 2023-11-04T01:47:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8300664a0 msgr2=0x7fd830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8300664a0 0x7fd830068960 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd838005210 tx=0x7fd838009040 comp rx=0 tx=0).stop 2023-11-04T01:47:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 msgr2=0x7fd8441f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd8441f69b0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd83401cc30 tx=0x7fd82c005800 comp rx=0 tx=0).stop 2023-11-04T01:47:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 shutdown_connections 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd8300664a0 0x7fd830068960 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd844151390 0x7fd8440b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd844152f10 0x7fd844152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 --2- 172.21.15.40:0/3426152423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82c0039b0 0x7fd8441f69b0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 >> 172.21.15.40:0/3426152423 conn(0x7fd8440d2f90 msgr2=0x7fd84406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 shutdown_connections 2023-11-04T01:47:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:25.915+0000 7fd849277640 1 -- 172.21.15.40:0/3426152423 wait complete. 2023-11-04T01:47:25.935 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:27.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:27.958 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:28.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:47:30.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:31.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb7235db640 1 Processor -- start 2023-11-04T01:47:31.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb7235db640 1 -- start start 2023-11-04T01:47:31.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb7235db640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb71c0cd1d0 0x7fb71c15d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb7235db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c15dac0 con 0x7fb71c153ae0 2023-11-04T01:47:31.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb7235db640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c0ca010 con 0x7fb71c15d670 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb7235db640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c0cd7b0 con 0x7fb71c0cd1d0 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb721377640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb71c153ae0 0x7fb71c0caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50820/0 (socket says 172.21.15.40:50820) 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb721377640 1 -- 172.21.15.40:0/3386787073 learned_addr learned my addr 172.21.15.40:0/3386787073 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb720b76640 1 --2- 172.21.15.40:0/3386787073 >> v2:172.21.15.40:3300/0 conn(0x7fb71c0cd1d0 0x7fb71c15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb713fff640 1 -- 172.21.15.40:0/3386787073 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095744032 0 0) 0x7fb70c0014a0 con 0x7fb71c153ae0 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb713fff640 1 -- 172.21.15.40:0/3386787073 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb704003530 con 0x7fb71c153ae0 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb720b76640 1 -- 172.21.15.40:0/3386787073 >> v1:172.21.15.91:6789/0 conn(0x7fb71c15d670 legacy=0x7fb71c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb720b76640 1 -- 172.21.15.40:0/3386787073 >> v1:172.21.15.40:6789/0 conn(0x7fb71c153ae0 legacy=0x7fb71c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb713fff640 1 -- 172.21.15.40:0/3386787073 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663853169 0 0) 0x7fb704003530 con 0x7fb71c153ae0 2023-11-04T01:47:31.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.067+0000 7fb720b76640 1 -- 172.21.15.40:0/3386787073 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0ca260 con 0x7fb71c0cd1d0 2023-11-04T01:47:31.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb720b76640 1 --2- 172.21.15.40:0/3386787073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c0cd1d0 0x7fb71c15d130 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb71800a960 tx=0x7fb71801d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1ecbb3d7265b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:31.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb713fff640 1 -- 172.21.15.40:0/3386787073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c001b90 con 0x7fb71c0cd1d0 2023-11-04T01:47:31.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb713fff640 1 -- 172.21.15.40:0/3386787073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7180a7420 con 0x7fb71c0cd1d0 2023-11-04T01:47:31.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb713fff640 1 -- 172.21.15.40:0/3386787073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180a77b0 con 0x7fb71c0cd1d0 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 -- 172.21.15.40:0/3386787073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c0cd1d0 msgr2=0x7fb71c15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 --2- 172.21.15.40:0/3386787073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c0cd1d0 0x7fb71c15d130 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb71800a960 tx=0x7fb71801d770 comp rx=0 tx=0).stop 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 -- 172.21.15.40:0/3386787073 shutdown_connections 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 --2- 172.21.15.40:0/3386787073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c0cd1d0 0x7fb71c15d130 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 -- 172.21.15.40:0/3386787073 >> 172.21.15.40:0/3386787073 conn(0x7fb71c0b0890 msgr2=0x7fb71c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 -- 172.21.15.40:0/3386787073 shutdown_connections 2023-11-04T01:47:31.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 -- 172.21.15.40:0/3386787073 wait complete. 2023-11-04T01:47:31.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 Processor -- start 2023-11-04T01:47:31.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.071+0000 7fb7235db640 1 -- start start 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb71c0cd1d0 0x7fb71c163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 0x7fb71c13b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb71c15d670 0x7fb71c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1510e0 con 0x7fb71c153ae0 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1513c0 con 0x7fb71c15d670 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0b1e70 con 0x7fb71c0cd1d0 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 0x7fb71c13b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 0x7fb71c13b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38940/0 (socket says 172.21.15.40:38940) 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 -- 172.21.15.40:0/2600390664 learned_addr learned my addr 172.21.15.40:0/2600390664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb721b78640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb71c15d670 0x7fb71c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 -- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb71c0cd1d0 msgr2=0x7fb71c163ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb721377640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb71c0cd1d0 0x7fb71c163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb71c0cd1d0 0x7fb71c163ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 -- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb71c15d670 msgr2=0x7fb71c13b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb71c15d670 0x7fb71c13b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 -- 172.21.15.40:0/2600390664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71800a5c0 con 0x7fb71c153ae0 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb721377640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb71c0cd1d0 0x7fb71c163ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb720b76640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 0x7fb71c13b240 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb718099230 tx=0x7fb71801a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180b6070 con 0x7fb71c153ae0 2023-11-04T01:47:31.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718004020 con 0x7fb71c153ae0 2023-11-04T01:47:31.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c15c4a0 con 0x7fb71c153ae0 2023-11-04T01:47:31.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718004390 con 0x7fb71c153ae0 2023-11-04T01:47:31.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c15ca60 con 0x7fb71c153ae0 2023-11-04T01:47:31.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c04e4a0 con 0x7fb71c153ae0 2023-11-04T01:47:31.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb718003620 con 0x7fb71c153ae0 2023-11-04T01:47:31.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb711ffb640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7080664a0 0x7fb708068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7fb71811e950 con 0x7fb71c153ae0 2023-11-04T01:47:31.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.075+0000 7fb721377640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7080664a0 0x7fb708068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.079+0000 7fb721377640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7080664a0 0x7fb708068960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb70c002240 tx=0x7fb70c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:31.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.079+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7180eb6f0 con 0x7fb71c153ae0 2023-11-04T01:47:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.275+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb71c0cc5f0 con 0x7fb71c153ae0 2023-11-04T01:47:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.279+0000 7fb711ffb640 1 -- 172.21.15.40:0/2600390664 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fb7180eed10 con 0x7fb71c153ae0 2023-11-04T01:47:31.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:08.577017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 110 2023-11-04T01:47:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7080664a0 msgr2=0x7fb708068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7080664a0 0x7fb708068960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb70c002240 tx=0x7fb70c009040 comp rx=0 tx=0).stop 2023-11-04T01:47:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 msgr2=0x7fb71c13b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 0x7fb71c13b240 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fb718099230 tx=0x7fb71801a510 comp rx=0 tx=0).stop 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 shutdown_connections 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb7080664a0 0x7fb708068960 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb71c15d670 0x7fb71c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c153ae0 0x7fb71c13b240 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 --2- 172.21.15.40:0/2600390664 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb71c0cd1d0 0x7fb71c163ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 >> 172.21.15.40:0/2600390664 conn(0x7fb71c0b0890 msgr2=0x7fb71c06bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 shutdown_connections 2023-11-04T01:47:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:31.283+0000 7fb7235db640 1 -- 172.21.15.40:0/2600390664 wait complete. 2023-11-04T01:47:31.303 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:34.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-11-04T01:47:36.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 Processor -- start 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 -- start start 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e180cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5e180c92b0 0x7f5e1815c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e180c9ac0 con 0x7f5e1806c1c0 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e180caf20 con 0x7f5e180c92b0 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1ed88640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1815c5d0 con 0x7f5e1806bde0 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1d325640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e1806c1c0 0x7f5e181442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50822/0 (socket says 172.21.15.40:50822) 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1d325640 1 -- 172.21.15.40:0/1835436976 learned_addr learned my addr 172.21.15.40:0/1835436976 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e180cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e17fff640 1 --2- 172.21.15.40:0/1835436976 >> v2:172.21.15.91:3300/0 conn(0x7f5e180c92b0 0x7f5e1815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116749313 0 0) 0x7f5e180c9ac0 con 0x7f5e1806c1c0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e00003530 con 0x7f5e1806c1c0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720616716 0 0) 0x7f5e00003530 con 0x7f5e1806c1c0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 msgr2=0x7f5e180cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e180cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 >> v2:172.21.15.91:3300/0 conn(0x7f5e180c92b0 msgr2=0x7f5e1815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 --2- 172.21.15.40:0/1835436976 >> v2:172.21.15.91:3300/0 conn(0x7f5e180c92b0 0x7f5e1815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180c97e0 con 0x7f5e1806c1c0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f5e10001a00 con 0x7f5e1806c1c0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 >> v1:172.21.15.40:6789/0 conn(0x7f5e1806c1c0 legacy=0x7f5e181442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e000047d0 0x7f5e00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180caf20 con 0x7f5e00003980 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1815c5d0 con 0x7f5e000047d0 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0000b990 con 0x7f5e1806bde0 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e17fff640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e000047d0 0x7f5e00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1d325640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 msgr2=0x7f5e00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e000047d0 msgr2=0x7f5e00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e000047d0 0x7f5e00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1835436976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00003530 con 0x7f5e00003980 2023-11-04T01:47:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.439+0000 7f5e1d325640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e1806bde0 0x7f5e00005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e00003da0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009ae0 tx=0x7f5e0801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7661ddefccddb90d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080a9450 con 0x7f5e00003980 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e080a95b0 con 0x7f5e00003980 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e177fe640 1 -- 172.21.15.40:0/1835436976 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080a9960 con 0x7f5e00003980 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1835436976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 msgr2=0x7f5e00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1835436976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e00003da0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009ae0 tx=0x7f5e0801ca50 comp rx=0 tx=0).stop 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1d325640 1 -- 172.21.15.40:0/1835436976 reap_dead start 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1835436976 shutdown_connections 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1835436976 >> 172.21.15.40:0/1835436976 conn(0x7f5e180b0890 msgr2=0x7f5e180b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1835436976 shutdown_connections 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1835436976 wait complete. 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 Processor -- start 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.443+0000 7f5e1ed88640 1 -- start start 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e181f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e180b0130 0x7f5e180b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e180b4190 0x7f5e180b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1815b470 con 0x7f5e00003980 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180b20f0 con 0x7f5e180b4190 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180b05b0 con 0x7f5e180b0130 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e181f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e181f68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38964/0 (socket says 172.21.15.40:38964) 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1854464127 learned_addr learned my addr 172.21.15.40:0/1854464127 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e17fff640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e180b0130 0x7f5e180b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1d325640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e180b4190 0x7f5e180b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e180b0130 msgr2=0x7f5e180b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e180b0130 0x7f5e180b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e180b4190 msgr2=0x7f5e180b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e180b4190 0x7f5e180b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 -- 172.21.15.40:0/1854464127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e181f7870 con 0x7f5e00003980 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1d325640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e180b4190 0x7f5e180b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1cb24640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e181f68f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009ae0 tx=0x7f5e00005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080b6070 con 0x7f5e00003980 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0800f000 con 0x7f5e00003980 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e181f6fd0 con 0x7f5e00003980 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080bc420 con 0x7f5e00003980 2023-11-04T01:47:36.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e181f7590 con 0x7f5e00003980 2023-11-04T01:47:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1804e4a0 con 0x7f5e00003980 2023-11-04T01:47:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e080ba070 con 0x7f5e00003980 2023-11-04T01:47:36.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e157fa640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e040664d0 0x7f5e04068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f5e0811e5d0 con 0x7f5e00003980 2023-11-04T01:47:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.447+0000 7f5e17fff640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e040664d0 0x7f5e04068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.451+0000 7f5e17fff640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e040664d0 0x7f5e04068990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e180c6d10 tx=0x7f5e0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.451+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e080eb2e0 con 0x7f5e00003980 2023-11-04T01:47:36.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.643+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e180b06f0 con 0x7f5e00003980 2023-11-04T01:47:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.643+0000 7f5e157fa640 1 -- 172.21.15.40:0/1854464127 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4982 (secure 0 0 0) 0x7f5e180b06f0 con 0x7f5e00003980 2023-11-04T01:47:36.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:36.648 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":111,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:33.031733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:47:33.031733+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 111 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e040664d0 msgr2=0x7f5e04068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e040664d0 0x7f5e04068990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e180c6d10 tx=0x7f5e0c008040 comp rx=0 tx=0).stop 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 msgr2=0x7f5e181f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e181f68f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009ae0 tx=0x7f5e00005800 comp rx=0 tx=0).stop 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 shutdown_connections 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e040664d0 0x7f5e04068990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e180b4190 0x7f5e180b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e180b0130 0x7f5e180b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 --2- 172.21.15.40:0/1854464127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e00003980 0x7f5e181f68f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 >> 172.21.15.40:0/1854464127 conn(0x7f5e180b0890 msgr2=0x7f5e180717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 shutdown_connections 2023-11-04T01:47:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.647+0000 7f5e1ed88640 1 -- 172.21.15.40:0/1854464127 wait complete. 2023-11-04T01:47:36.668 DEBUG:tasks.ceph_test_case:wait_until_true: success in 25s and 0 retries 2023-11-04T01:47:36.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:47:36.680 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:47:36.681 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:47:36.681 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:47:36.739 INFO:teuthology.orchestra.run.smithi040.stdout:1699062434.58455.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:47:36.740 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062434.58455.core'] 2023-11-04T01:47:36.741 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062434.58455.core, deleting it 2023-11-04T01:47:36.741 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062434.58455.core 2023-11-04T01:47:36.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:36.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 Processor -- start 2023-11-04T01:47:36.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 -- start start 2023-11-04T01:47:36.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1420153ae0 0x7f14200cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f142015d840 0x7f142006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200ca010 con 0x7f14200caf00 2023-11-04T01:47:36.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200cd7b0 con 0x7f142015d840 2023-11-04T01:47:36.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1424eaa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14200ca260 con 0x7f1420153ae0 2023-11-04T01:47:36.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141ed9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f142015d840 0x7f142006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141e59c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1420153ae0 0x7f14200cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1417fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f14200caf00 0x7f142015d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:50148/0 (socket says 172.21.15.40:50148) 2023-11-04T01:47:36.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f1417fff640 1 -- 172.21.15.40:0/1068283950 learned_addr learned my addr 172.21.15.40:0/1068283950 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:36.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141e59c640 1 -- 172.21.15.40:0/1068283950 >> v2:172.21.15.91:3300/0 conn(0x7f142015d840 msgr2=0x7f142006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141e59c640 1 --2- 172.21.15.40:0/1068283950 >> v2:172.21.15.91:3300/0 conn(0x7f142015d840 0x7f142006bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141e59c640 1 -- 172.21.15.40:0/1068283950 >> v1:172.21.15.91:6789/0 conn(0x7f14200caf00 legacy=0x7f142015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141e59c640 1 -- 172.21.15.40:0/1068283950 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200ca540 con 0x7f1420153ae0 2023-11-04T01:47:36.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.971+0000 7f141ed9d640 1 --2- 172.21.15.40:0/1068283950 >> v2:172.21.15.91:3300/0 conn(0x7f142015d840 0x7f142006bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:36.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f141e59c640 1 --2- 172.21.15.40:0/1068283950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1420153ae0 0x7f14200cd1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14100097c0 tx=0x7f141001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aea1f9815d822441 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f141dd9b640 1 -- 172.21.15.40:0/1068283950 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100ad640 con 0x7f1420153ae0 2023-11-04T01:47:36.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f141dd9b640 1 -- 172.21.15.40:0/1068283950 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14100ad7a0 con 0x7f1420153ae0 2023-11-04T01:47:36.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f141dd9b640 1 -- 172.21.15.40:0/1068283950 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100adb30 con 0x7f1420153ae0 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- 172.21.15.40:0/1068283950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1420153ae0 msgr2=0x7f14200cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1068283950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1420153ae0 0x7f14200cd1d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14100097c0 tx=0x7f141001c480 comp rx=0 tx=0).stop 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- 172.21.15.40:0/1068283950 shutdown_connections 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1068283950 >> v2:172.21.15.91:3300/0 conn(0x7f142015d840 0x7f142006bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1068283950 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1420153ae0 0x7f14200cd1d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- 172.21.15.40:0/1068283950 >> 172.21.15.40:0/1068283950 conn(0x7f14200b0890 msgr2=0x7f14200b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- 172.21.15.40:0/1068283950 shutdown_connections 2023-11-04T01:47:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- 172.21.15.40:0/1068283950 wait complete. 2023-11-04T01:47:36.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 Processor -- start 2023-11-04T01:47:36.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- start start 2023-11-04T01:47:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f14200caf00 0x7f142015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 0x7f14201f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f142015d840 0x7f14200afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142015bb70 con 0x7f1420153ae0 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142015af80 con 0x7f142015d840 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.975+0000 7f1424eaa640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142015c4d0 con 0x7f14200caf00 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 0x7f14201f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 0x7f14201f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38978/0 (socket says 172.21.15.40:38978) 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 -- 172.21.15.40:0/1411021861 learned_addr learned my addr 172.21.15.40:0/1411021861 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f141ed9d640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f142015d840 0x7f14200afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f141e59c640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f14200caf00 0x7f142015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 -- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f14200caf00 msgr2=0x7f142015bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f14200caf00 0x7f142015bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 -- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f142015d840 msgr2=0x7f14200afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f142015d840 0x7f14200afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 -- 172.21.15.40:0/1411021861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418009a70 con 0x7f1420153ae0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1417fff640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 0x7f14201f63d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f140800c420 tx=0x7f140800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408005cf0 con 0x7f1420153ae0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408005e50 con 0x7f1420153ae0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1410009420 con 0x7f1420153ae0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080072f0 con 0x7f1420153ae0 2023-11-04T01:47:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142015b4b0 con 0x7f1420153ae0 2023-11-04T01:47:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142015bcb0 con 0x7f1420153ae0 2023-11-04T01:47:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1408007450 con 0x7f1420153ae0 2023-11-04T01:47:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1416ffd640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14000664a0 0x7f1400068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f1408083b00 con 0x7f1420153ae0 2023-11-04T01:47:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.979+0000 7f141e59c640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14000664a0 0x7f1400068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.983+0000 7f141e59c640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14000664a0 0x7f1400068960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f14100af000 tx=0x7f14100a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:36.983+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f142015bcb0 con 0x7f1420153ae0 2023-11-04T01:47:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f142015bcb0 con 0x7f1420153ae0 2023-11-04T01:47:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1416ffd640 1 -- 172.21.15.40:0/1411021861 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4982 (secure 0 0 0) 0x7f142015bcb0 con 0x7f1420153ae0 2023-11-04T01:47:37.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:37.175 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":111,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:33.031733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7995,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7995":{"gid":7995,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.40:6835/3996815211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3996815211},{"type":"v1","addr":"172.21.15.40:6835","nonce":3996815211}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:47:33.031733+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:37.175 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 111 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14000664a0 msgr2=0x7f1400068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14000664a0 0x7f1400068960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f14100af000 tx=0x7f14100a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 msgr2=0x7f14201f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 0x7f14201f63d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f140800c420 tx=0x7f140800c8e0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 shutdown_connections 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f14000664a0 0x7f1400068960 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f142015d840 0x7f14200afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1420153ae0 0x7f14201f63d0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 --2- 172.21.15.40:0/1411021861 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f14200caf00 0x7f142015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.171+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 >> 172.21.15.40:0/1411021861 conn(0x7f14200b0890 msgr2=0x7f14200ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.175+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 shutdown_connections 2023-11-04T01:47:37.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.175+0000 7f1424eaa640 1 -- 172.21.15.40:0/1411021861 wait complete. 2023-11-04T01:47:37.192 INFO:tasks.ceph.mds.b:Sent signal 9 2023-11-04T01:47:37.192 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:37.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:37.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 down 2023-11-04T01:47:37.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:47:37.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 Processor -- start 2023-11-04T01:47:37.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 -- start start 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ba4160680 0x7f6ba40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba40ce7f0 0x7f6ba40b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40cf000 con 0x7f6ba4160a60 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba40d09b0 con 0x7f6ba4160680 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6baba4b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40b5de0 con 0x7f6ba40ce7f0 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ba4160680 0x7f6ba40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ba4160680 0x7f6ba40cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35078/0 (socket says 172.21.15.40:35078) 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 -- 172.21.15.40:0/2983628998 learned_addr learned my addr 172.21.15.40:0/2983628998 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba9fe8640 1 --2- 172.21.15.40:0/2983628998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba40ce7f0 0x7f6ba40b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 -- 172.21.15.40:0/2983628998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba40ce7f0 msgr2=0x7f6ba40b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 --2- 172.21.15.40:0/2983628998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba40ce7f0 0x7f6ba40b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 -- 172.21.15.40:0/2983628998 >> v1:172.21.15.91:6789/0 conn(0x7f6ba4160a60 legacy=0x7f6ba40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.371+0000 7f6ba97e7640 1 -- 172.21.15.40:0/2983628998 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40d1610 con 0x7f6ba4160680 2023-11-04T01:47:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6ba97e7640 1 --2- 172.21.15.40:0/2983628998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160680 0x7f6ba40cdba0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009870 tx=0x7f6ba001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd80f0d702b1253 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6b9bfff640 1 -- 172.21.15.40:0/2983628998 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00aa5f0 con 0x7f6ba4160680 2023-11-04T01:47:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6b9bfff640 1 -- 172.21.15.40:0/2983628998 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba00aa750 con 0x7f6ba4160680 2023-11-04T01:47:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6b9bfff640 1 -- 172.21.15.40:0/2983628998 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00aaae0 con 0x7f6ba4160680 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 -- 172.21.15.40:0/2983628998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160680 msgr2=0x7f6ba40cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 --2- 172.21.15.40:0/2983628998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160680 0x7f6ba40cdba0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009870 tx=0x7f6ba001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 -- 172.21.15.40:0/2983628998 shutdown_connections 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 --2- 172.21.15.40:0/2983628998 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba40ce7f0 0x7f6ba40b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 --2- 172.21.15.40:0/2983628998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160680 0x7f6ba40cdba0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 -- 172.21.15.40:0/2983628998 >> 172.21.15.40:0/2983628998 conn(0x7f6ba40d2f90 msgr2=0x7f6ba40d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 -- 172.21.15.40:0/2983628998 shutdown_connections 2023-11-04T01:47:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 -- 172.21.15.40:0/2983628998 wait complete. 2023-11-04T01:47:37.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 Processor -- start 2023-11-04T01:47:37.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 -- start start 2023-11-04T01:47:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ba40ce7f0 0x7f6ba414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.375+0000 7f6baba4b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba4160680 0x7f6ba415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 0x7f6ba414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba415f730 con 0x7f6ba4160a60 2023-11-04T01:47:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4158430 con 0x7f6ba40ce7f0 2023-11-04T01:47:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba415e6c0 con 0x7f6ba4160680 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 0x7f6ba414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 0x7f6ba414d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35082/0 (socket says 172.21.15.40:35082) 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 -- 172.21.15.40:0/118104942 learned_addr learned my addr 172.21.15.40:0/118104942 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba97e7640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ba40ce7f0 0x7f6ba414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba8fe6640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba4160680 0x7f6ba415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 -- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba4160680 msgr2=0x7f6ba415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba4160680 0x7f6ba415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 -- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ba40ce7f0 msgr2=0x7f6ba414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ba40ce7f0 0x7f6ba414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 -- 172.21.15.40:0/118104942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00094d0 con 0x7f6ba4160a60 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba97e7640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ba40ce7f0 0x7f6ba414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba8fe6640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba4160680 0x7f6ba415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba9fe8640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 0x7f6ba414d550 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c007e60 tx=0x7f6b9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c014620 con 0x7f6ba4160a60 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c014780 con 0x7f6ba4160a60 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba4157de0 con 0x7f6ba4160a60 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c014b30 con 0x7f6ba4160a60 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba414da90 con 0x7f6ba4160a60 2023-11-04T01:47:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba404e4a0 con 0x7f6ba4160a60 2023-11-04T01:47:37.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b9c014c90 con 0x7f6ba4160a60 2023-11-04T01:47:37.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6b99ffb640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b880664a0 0x7f6b88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7603+0+0 (secure 0 0 0) 0x7f6b9c0859b0 con 0x7f6ba4160a60 2023-11-04T01:47:37.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba97e7640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b880664a0 0x7f6b88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.379+0000 7f6ba97e7640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b880664a0 0x7f6b88068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00ae000 tx=0x7f6ba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.383+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b9c0527a0 con 0x7f6ba4160a60 2023-11-04T01:47:37.394 INFO:tasks.ceph.mds.b.smithi091.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:47:37.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.587+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f6ba41590e0 con 0x7f6ba4160a60 2023-11-04T01:47:37.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.591+0000 7f6b99ffb640 1 -- 172.21.15.40:0/118104942 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7995 v112) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6b9c055dc0 con 0x7f6ba4160a60 2023-11-04T01:47:37.595 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 7995 2023-11-04T01:47:37.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.591+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b880664a0 msgr2=0x7f6b88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.591+0000 7f6baba4b640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b880664a0 0x7f6b88068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00ae000 tx=0x7f6ba0008040 comp rx=0 tx=0).stop 2023-11-04T01:47:37.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 msgr2=0x7f6ba414d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 0x7f6ba414d550 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c007e60 tx=0x7f6b9c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 shutdown_connections 2023-11-04T01:47:37.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f6b880664a0 0x7f6b88068960 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba4160a60 0x7f6ba414d550 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f6ba4160680 0x7f6ba415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 --2- 172.21.15.40:0/118104942 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6ba40ce7f0 0x7f6ba414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 >> 172.21.15.40:0/118104942 conn(0x7f6ba40d2f90 msgr2=0x7f6ba41598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 shutdown_connections 2023-11-04T01:47:37.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.595+0000 7f6baba4b640 1 -- 172.21.15.40:0/118104942 wait complete. 2023-11-04T01:47:37.614 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:47:37.614 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:47:37.614 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:47:37.614 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:47:37.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:47:37.615 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:47:37.615 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:47:37.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:47:37.620 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:47:37.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:37.681 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-11-04T01:47:37.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.727+0000 7f5cc77bb640 1 Processor -- start 2023-11-04T01:47:37.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.727+0000 7f5cc77bb640 1 -- start start 2023-11-04T01:47:37.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5cc00ce7f0 0x7f5cc00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00cf000 con 0x7f5cc0160a60 2023-11-04T01:47:37.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00d09b0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00b5de0 con 0x7f5cc0160680 2023-11-04T01:47:37.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5d58640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5cc00ce7f0 0x7f5cc00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc4d56640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5cc0160a60 0x7f5cc00ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33012/0 (socket says 172.21.15.40:33012) 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc4d56640 1 -- 172.21.15.40:0/4143439220 learned_addr learned my addr 172.21.15.40:0/4143439220 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5557640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5d58640 1 -- 172.21.15.40:0/4143439220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 msgr2=0x7f5cc00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5d58640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc00cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5d58640 1 -- 172.21.15.40:0/4143439220 >> v1:172.21.15.40:6789/0 conn(0x7f5cc0160a60 legacy=0x7f5cc00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cb7fff640 1 -- 172.21.15.40:0/4143439220 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769489875 0 0) 0x7f5cc00cf000 con 0x7f5cc0160a60 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5d58640 1 -- 172.21.15.40:0/4143439220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00d1610 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5557640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc00cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:37.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc5d58640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00b62e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009d90 tx=0x7f5cb801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f6e10cf0892776 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cb7fff640 1 -- 172.21.15.40:0/4143439220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80a59e0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cb7fff640 1 -- 172.21.15.40:0/4143439220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb80a5b40 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cb7fff640 1 -- 172.21.15.40:0/4143439220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80ad440 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- 172.21.15.40:0/4143439220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 msgr2=0x7f5cc00b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00b62e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009d90 tx=0x7f5cb801c920 comp rx=0 tx=0).stop 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- 172.21.15.40:0/4143439220 shutdown_connections 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00b62e0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/4143439220 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc00cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- 172.21.15.40:0/4143439220 >> 172.21.15.40:0/4143439220 conn(0x7f5cc00d2f90 msgr2=0x7f5cc00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- 172.21.15.40:0/4143439220 shutdown_connections 2023-11-04T01:47:37.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.731+0000 7f5cc77bb640 1 -- 172.21.15.40:0/4143439220 wait complete. 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 Processor -- start 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 -- start start 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc0160a60 0x7f5cc00c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00cc190 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00cc470 con 0x7f5cc0160a60 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00cc750 con 0x7f5cc0160680 2023-11-04T01:47:37.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35112/0 (socket says 172.21.15.40:35112) 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 -- 172.21.15.40:0/1624299299 learned_addr learned my addr 172.21.15.40:0/1624299299 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5d58640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc0160a60 0x7f5cc00c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 -- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 msgr2=0x7f5cc015a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc4d56640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 -- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc0160a60 msgr2=0x7f5cc00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc0160a60 0x7f5cc00c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 -- 172.21.15.40:0/1624299299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009a70 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5d58640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc0160a60 0x7f5cc00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc5557640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00c7c90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c7c0 tx=0x7f5cbc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc007a30 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc007b90 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00ce70 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc00cca30 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.735+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc009e520 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.739+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5cbc0113f0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.739+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc004e4a0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.739+0000 7f5cb5ffb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5ca40664d0 0x7f5ca4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.739+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7689+0+0 (secure 0 0 0) 0x7f5cbc0849e0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.739+0000 7f5cc4d56640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5ca40664d0 0x7f5ca4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.739+0000 7f5cc4d56640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5ca40664d0 0x7f5ca4068990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5cc009e040 tx=0x7f5cb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.743+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5cbc051730 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.927+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cc00cc2d0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.927+0000 7f5cb5ffb640 1 -- 172.21.15.40:0/1624299299 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4141 (secure 0 0 0) 0x7f5cc00cc2d0 con 0x7f5cc00ce7f0 2023-11-04T01:47:37.932 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:37.932 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":113,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:37.601063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:replay","state_seq":1,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:37.933 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 113 2023-11-04T01:47:37.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5ca40664d0 msgr2=0x7f5ca4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5ca40664d0 0x7f5ca4068990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5cc009e040 tx=0x7f5cb0009040 comp rx=0 tx=0).stop 2023-11-04T01:47:37.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 msgr2=0x7f5cc00c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00c7c90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c7c0 tx=0x7f5cbc00cc80 comp rx=0 tx=0).stop 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 shutdown_connections 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5ca40664d0 0x7f5ca4068990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5cc0160a60 0x7f5cc00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5cc0160680 0x7f5cc015a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 --2- 172.21.15.40:0/1624299299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cc00ce7f0 0x7f5cc00c7c90 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 >> 172.21.15.40:0/1624299299 conn(0x7f5cc00d2f90 msgr2=0x7f5cc00b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 shutdown_connections 2023-11-04T01:47:37.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:37.931+0000 7f5cc77bb640 1 -- 172.21.15.40:0/1624299299 wait complete. 2023-11-04T01:47:37.950 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:47:41.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:47:41.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:47:42.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:43.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.087+0000 7f7b16a94640 1 Processor -- start 2023-11-04T01:47:43.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.087+0000 7f7b16a94640 1 -- start start 2023-11-04T01:47:43.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b16a94640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 0x7f7b100ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b16a94640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b100cf000 con 0x7f7b10160680 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b16a94640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b100b5de0 con 0x7f7b100ce7f0 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b16a94640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100d09b0 con 0x7f7b10160a60 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7b10160680 0x7f7b100cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33024/0 (socket says 172.21.15.40:33024) 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 -- 172.21.15.40:0/2150872767 learned_addr learned my addr 172.21.15.40:0/2150872767 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0ffff640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 0x7f7b100ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106450191 0 0) 0x7f7b100cf000 con 0x7f7b10160680 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b00003530 con 0x7f7b10160680 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3665427746 0 0) 0x7f7b00003530 con 0x7f7b10160680 2023-11-04T01:47:43.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 msgr2=0x7f7b100ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 0x7f7b100ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 >> v1:172.21.15.91:6789/0 conn(0x7f7b100ce7f0 legacy=0x7f7b100b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100d1610 con 0x7f7b10160680 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f7b04001680 con 0x7f7b10160680 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 >> v1:172.21.15.40:6789/0 conn(0x7f7b10160680 legacy=0x7f7b100cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b000039b0 0x7f7b00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 0x7f7b000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b00004d10 0x7f7b00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100d09b0 con 0x7f7b000039b0 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0000ba70 con 0x7f7b00004d10 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0000bc30 con 0x7f7b10160a60 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b000039b0 0x7f7b00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b15031640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b00004d10 0x7f7b00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 -- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 msgr2=0x7f7b000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b0ffff640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 0x7f7b000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b10160a60 0x7f7b000047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 -- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b00004d10 msgr2=0x7f7b00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b00004d10 0x7f7b00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b14830640 1 -- 172.21.15.40:0/2150872767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00003530 con 0x7f7b000039b0 2023-11-04T01:47:43.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.091+0000 7f7b15031640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b00004d10 0x7f7b00005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b14830640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b000039b0 0x7f7b00003dd0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c210 tx=0x7f7b0401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1068538e219115 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b04005ae0 con 0x7f7b000039b0 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04005c60 con 0x7f7b000039b0 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b0f7fe640 1 -- 172.21.15.40:0/2150872767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b040a58d0 con 0x7f7b000039b0 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- 172.21.15.40:0/2150872767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b000039b0 msgr2=0x7f7b00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 --2- 172.21.15.40:0/2150872767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b000039b0 0x7f7b00003dd0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400c210 tx=0x7f7b0401cbf0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b15031640 1 -- 172.21.15.40:0/2150872767 reap_dead start 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- 172.21.15.40:0/2150872767 shutdown_connections 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- 172.21.15.40:0/2150872767 >> 172.21.15.40:0/2150872767 conn(0x7f7b100d2f90 msgr2=0x7f7b100d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- 172.21.15.40:0/2150872767 shutdown_connections 2023-11-04T01:47:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- 172.21.15.40:0/2150872767 wait complete. 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 Processor -- start 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- start start 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b000039b0 0x7f7b1014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 0x7f7b100caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b1014b040 0x7f7b1015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10162e40 con 0x7f7b1014abc0 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100cb9a0 con 0x7f7b000039b0 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b16a94640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10162510 con 0x7f7b1014b040 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b0ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 0x7f7b100caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b0ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 0x7f7b100caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35128/0 (socket says 172.21.15.40:35128) 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.095+0000 7f7b0ffff640 1 -- 172.21.15.40:0/1665325892 learned_addr learned my addr 172.21.15.40:0/1665325892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b14830640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b000039b0 0x7f7b1014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b15031640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b1014b040 0x7f7b1015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0ffff640 1 -- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b1014b040 msgr2=0x7f7b1015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0ffff640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b1014b040 0x7f7b1015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0ffff640 1 -- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b000039b0 msgr2=0x7f7b1014a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0ffff640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b000039b0 0x7f7b1014a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0ffff640 1 -- 172.21.15.40:0/1665325892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b101627f0 con 0x7f7b1014abc0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0ffff640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 0x7f7b100caf50 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f7afc010890 tx=0x7f7afc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc009630 con 0x7f7b1014abc0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00eb60 con 0x7f7b1014abc0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b10162ad0 con 0x7f7b1014abc0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc01c400 con 0x7f7b1014abc0 2023-11-04T01:47:43.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b10158ec0 con 0x7f7b1014abc0 2023-11-04T01:47:43.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1004e4a0 con 0x7f7b1014abc0 2023-11-04T01:47:43.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7afc01c560 con 0x7f7b1014abc0 2023-11-04T01:47:43.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0d7fa640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7af40664a0 0x7f7af4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7689+0+0 (secure 0 0 0) 0x7f7afc084b20 con 0x7f7b1014abc0 2023-11-04T01:47:43.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b14830640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7af40664a0 0x7f7af4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.099+0000 7f7b14830640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7af40664a0 0x7f7af4068960 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7b040ab000 tx=0x7f7b040a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.103+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7afc051890 con 0x7f7b1014abc0 2023-11-04T01:47:43.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.291+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b100663b0 con 0x7f7b1014abc0 2023-11-04T01:47:43.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.291+0000 7f7b0d7fa640 1 -- 172.21.15.40:0/1665325892 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4929 (secure 0 0 0) 0x7f7afc054eb0 con 0x7f7b1014abc0 2023-11-04T01:47:43.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:43.295 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:37.630472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:resolve","state_seq":14,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:43.295 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 114 2023-11-04T01:47:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7af40664a0 msgr2=0x7f7af4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7af40664a0 0x7f7af4068960 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7b040ab000 tx=0x7f7b040a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 msgr2=0x7f7b100caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 0x7f7b100caf50 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f7afc010890 tx=0x7f7afc010d50 comp rx=0 tx=0).stop 2023-11-04T01:47:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 shutdown_connections 2023-11-04T01:47:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7af40664a0 0x7f7af4068960 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b1014b040 0x7f7b1015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b1014abc0 0x7f7b100caf50 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 --2- 172.21.15.40:0/1665325892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b000039b0 0x7f7b1014a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 >> 172.21.15.40:0/1665325892 conn(0x7f7b100d2f90 msgr2=0x7f7b100cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 shutdown_connections 2023-11-04T01:47:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.295+0000 7f7b16a94640 1 -- 172.21.15.40:0/1665325892 wait complete. 2023-11-04T01:47:43.314 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:47:43.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fee051640 1 Processor -- start 2023-11-04T01:47:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fee051640 1 -- start start 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fee051640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fe806c1c0 0x7f4fe80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fee051640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe80c9ac0 con 0x7f4fe806bde0 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fee051640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe80caf20 con 0x7f4fe80c92b0 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fee051640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80c97e0 con 0x7f4fe806c1c0 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4fe806bde0 0x7f4fe815c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33030/0 (socket says 172.21.15.40:33030) 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe77fe640 1 -- 172.21.15.40:0/904859755 learned_addr learned my addr 172.21.15.40:0/904859755 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:43.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe7fff640 1 --2- 172.21.15.40:0/904859755 >> v2:172.21.15.40:3300/0 conn(0x7f4fe806c1c0 0x7f4fe80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe7fff640 1 -- 172.21.15.40:0/904859755 >> v1:172.21.15.91:6789/0 conn(0x7f4fe80c92b0 legacy=0x7f4fe81442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe7fff640 1 -- 172.21.15.40:0/904859755 >> v1:172.21.15.40:6789/0 conn(0x7f4fe806bde0 legacy=0x7f4fe815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe7fff640 1 -- 172.21.15.40:0/904859755 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe80cb1c0 con 0x7f4fe806c1c0 2023-11-04T01:47:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.435+0000 7f4fe67fc640 1 -- 172.21.15.40:0/904859755 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997087986 0 0) 0x7f4fe80c9ac0 con 0x7f4fe806bde0 2023-11-04T01:47:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe7fff640 1 --2- 172.21.15.40:0/904859755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe80cbca0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009d90 tx=0x7f4fe001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3ffc2d3c8cfdfe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe67fc640 1 -- 172.21.15.40:0/904859755 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00a5810 con 0x7f4fe806c1c0 2023-11-04T01:47:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe67fc640 1 -- 172.21.15.40:0/904859755 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe00a5970 con 0x7f4fe806c1c0 2023-11-04T01:47:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe67fc640 1 -- 172.21.15.40:0/904859755 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00a5d00 con 0x7f4fe806c1c0 2023-11-04T01:47:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- 172.21.15.40:0/904859755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 msgr2=0x7f4fe80cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 --2- 172.21.15.40:0/904859755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe80cbca0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009d90 tx=0x7f4fe001c950 comp rx=0 tx=0).stop 2023-11-04T01:47:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- 172.21.15.40:0/904859755 shutdown_connections 2023-11-04T01:47:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 --2- 172.21.15.40:0/904859755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe80cbca0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- 172.21.15.40:0/904859755 >> 172.21.15.40:0/904859755 conn(0x7f4fe80b0890 msgr2=0x7f4fe80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- 172.21.15.40:0/904859755 shutdown_connections 2023-11-04T01:47:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- 172.21.15.40:0/904859755 wait complete. 2023-11-04T01:47:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 Processor -- start 2023-11-04T01:47:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- start start 2023-11-04T01:47:43.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4fe806bde0 0x7f4fe8142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe8140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4fe80c92b0 0x7f4fe813de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8141170 con 0x7f4fe806c1c0 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8141450 con 0x7f4fe80c92b0 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fee051640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8141730 con 0x7f4fe806bde0 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe8140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe8140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35156/0 (socket says 172.21.15.40:35156) 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 -- 172.21.15.40:0/1922480284 learned_addr learned my addr 172.21.15.40:0/1922480284 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe77fe640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4fe806bde0 0x7f4fe8142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe7fff640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4fe80c92b0 0x7f4fe813de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 -- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4fe806bde0 msgr2=0x7f4fe8142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4fe806bde0 0x7f4fe8142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 -- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4fe80c92b0 msgr2=0x7f4fe813de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.439+0000 7f4fe6ffd640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4fe80c92b0 0x7f4fe813de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fe6ffd640 1 -- 172.21.15.40:0/1922480284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0009a70 con 0x7f4fe806c1c0 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fe7fff640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4fe80c92b0 0x7f4fe813de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fe77fe640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4fe806bde0 0x7f4fe8142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fe6ffd640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe8140840 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c3c0 tx=0x7f4fd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00052d0 con 0x7f4fe806c1c0 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0005430 con 0x7f4fe806c1c0 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe8141a10 con 0x7f4fe806c1c0 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0003840 con 0x7f4fe806c1c0 2023-11-04T01:47:43.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe8140d80 con 0x7f4fe806c1c0 2023-11-04T01:47:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe804e4a0 con 0x7f4fe806c1c0 2023-11-04T01:47:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fd00039a0 con 0x7f4fe806c1c0 2023-11-04T01:47:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fdffff640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4fc80664a0 0x7f4fc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7689+0+0 (secure 0 0 0) 0x7f4fd0083c30 con 0x7f4fe806c1c0 2023-11-04T01:47:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fe77fe640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4fc80664a0 0x7f4fc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.443+0000 7f4fe77fe640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4fc80664a0 0x7f4fc8068960 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8000f70 tx=0x7f4fd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.447+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4fd0050850 con 0x7f4fe806c1c0 2023-11-04T01:47:43.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.635+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fe806cf10 con 0x7f4fe806c1c0 2023-11-04T01:47:43.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.635+0000 7f4fdffff640 1 -- 172.21.15.40:0/1922480284 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4929 (secure 0 0 0) 0x7f4fd0053e70 con 0x7f4fe806c1c0 2023-11-04T01:47:43.640 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:43.640 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:37.630472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:resolve","state_seq":14,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:43.640 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 114 2023-11-04T01:47:43.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4fc80664a0 msgr2=0x7f4fc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4fc80664a0 0x7f4fc8068960 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8000f70 tx=0x7f4fd8009040 comp rx=0 tx=0).stop 2023-11-04T01:47:43.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 msgr2=0x7f4fe8140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe8140840 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c3c0 tx=0x7f4fd000c880 comp rx=0 tx=0).stop 2023-11-04T01:47:43.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 shutdown_connections 2023-11-04T01:47:43.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4fc80664a0 0x7f4fc8068960 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4fe80c92b0 0x7f4fe813de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe806c1c0 0x7f4fe8140840 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 --2- 172.21.15.40:0/1922480284 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4fe806bde0 0x7f4fe8142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 >> 172.21.15.40:0/1922480284 conn(0x7f4fe80b0890 msgr2=0x7f4fe80cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 shutdown_connections 2023-11-04T01:47:43.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.639+0000 7f4fee051640 1 -- 172.21.15.40:0/1922480284 wait complete. 2023-11-04T01:47:43.657 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:47:43.658 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.34374308586120605s 2023-11-04T01:47:43.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 Processor -- start 2023-11-04T01:47:43.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 -- start start 2023-11-04T01:47:43.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f924806bde0 0x7f92480cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480c9ac0 con 0x7f92480c92b0 2023-11-04T01:47:43.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92480caf20 con 0x7f924806bde0 2023-11-04T01:47:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f924d36c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480c97e0 con 0x7f924806c1c0 2023-11-04T01:47:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f924806bde0 0x7f92480cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f92477fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f92477fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:60158/0 (socket says 172.21.15.40:60158) 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f924806bde0 0x7f92480cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:44872/0 (socket says 172.21.15.40:44872) 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f92467fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f92480c92b0 0x7f924815c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:57598/0 (socket says 172.21.15.40:57598) 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 -- 172.21.15.40:0/2302912263 learned_addr learned my addr 172.21.15.40:0/2302912263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 -- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 msgr2=0x7f92481442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 --2- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 -- 172.21.15.40:0/2302912263 >> v1:172.21.15.91:6789/0 conn(0x7f92480c92b0 legacy=0x7f924815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.775+0000 7f9246ffd640 1 -- 172.21.15.40:0/2302912263 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480cb1c0 con 0x7f924806bde0 2023-11-04T01:47:43.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f9246ffd640 1 --2- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f92480cbca0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9238009e50 tx=0x7f923801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a47996a94340bdc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f9245ffb640 1 -- 172.21.15.40:0/2302912263 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380a5730 con 0x7f924806bde0 2023-11-04T01:47:43.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f9245ffb640 1 -- 172.21.15.40:0/2302912263 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92380a5890 con 0x7f924806bde0 2023-11-04T01:47:43.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f9245ffb640 1 -- 172.21.15.40:0/2302912263 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380a5c20 con 0x7f924806bde0 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 -- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 msgr2=0x7f92480cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 --2- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f92480cbca0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9238009e50 tx=0x7f923801c980 comp rx=0 tx=0).stop 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 -- 172.21.15.40:0/2302912263 shutdown_connections 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 --2- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 --2- 172.21.15.40:0/2302912263 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f92480cbca0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 -- 172.21.15.40:0/2302912263 >> 172.21.15.40:0/2302912263 conn(0x7f92480b0890 msgr2=0x7f92480b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 -- 172.21.15.40:0/2302912263 shutdown_connections 2023-11-04T01:47:43.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 -- 172.21.15.40:0/2302912263 wait complete. 2023-11-04T01:47:43.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 Processor -- start 2023-11-04T01:47:43.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.779+0000 7f924d36c640 1 -- start start 2023-11-04T01:47:43.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f9248158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 0x7f924813dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924813bfd0 con 0x7f92480c92b0 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9248159360 con 0x7f924806bde0 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9248159f80 con 0x7f924806c1c0 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 0x7f924813dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 0x7f924813dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35160/0 (socket says 172.21.15.40:35160) 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 -- 172.21.15.40:0/342200571 learned_addr learned my addr 172.21.15.40:0/342200571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f9246ffd640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f9248158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92467fc640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 -- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 msgr2=0x7f92481595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 -- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 msgr2=0x7f9248158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f9248158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 -- 172.21.15.40:0/342200571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009b30 con 0x7f92480c92b0 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f92477fe640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 0x7f924813dec0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f924000e930 tx=0x7f924000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92400096b0 con 0x7f92480c92b0 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000c9a0 con 0x7f92480c92b0 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924815a260 con 0x7f92480c92b0 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000cd30 con 0x7f92480c92b0 2023-11-04T01:47:43.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924815a820 con 0x7f92480c92b0 2023-11-04T01:47:43.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924804e4a0 con 0x7f92480c92b0 2023-11-04T01:47:43.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.783+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9240013470 con 0x7f92480c92b0 2023-11-04T01:47:43.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.787+0000 7f923f7fe640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92280664a0 0x7f9228068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.787+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7689+0+0 (secure 0 0 0) 0x7f92400847d0 con 0x7f92480c92b0 2023-11-04T01:47:43.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.787+0000 7f9246ffd640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92280664a0 0x7f9228068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.787+0000 7f9246ffd640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92280664a0 0x7f9228068960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f92380ae000 tx=0x7f92380a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.791+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92400515e0 con 0x7f92480c92b0 2023-11-04T01:47:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.983+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92480cc490 con 0x7f92480c92b0 2023-11-04T01:47:43.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f923f7fe640 1 -- 172.21.15.40:0/342200571 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4929 (secure 0 0 0) 0x7f9240054c00 con 0x7f92480c92b0 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:37.630472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:resolve","state_seq":14,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 114 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92280664a0 msgr2=0x7f9228068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92280664a0 0x7f9228068960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f92380ae000 tx=0x7f92380a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 msgr2=0x7f924813dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 0x7f924813dec0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f924000e930 tx=0x7f924000edf0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 shutdown_connections 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f92280664a0 0x7f9228068960 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92480c92b0 0x7f924813dec0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f924806c1c0 0x7f92481595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 --2- 172.21.15.40:0/342200571 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f924806bde0 0x7f9248158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 >> 172.21.15.40:0/342200571 conn(0x7f92480b0890 msgr2=0x7f9248071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 shutdown_connections 2023-11-04T01:47:43.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:43.987+0000 7f924d36c640 1 -- 172.21.15.40:0/342200571 wait complete. 2023-11-04T01:47:44.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:47:44.141 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:24.386602+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:47:09.381741+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:44.141 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:24.386602+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:47:09.381741+0000" } ] } 2023-11-04T01:47:44.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:44.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 Processor -- start 2023-11-04T01:47:44.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 -- start start 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 0x7f94ec06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f94ec0cd470 0x7f94ec0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec06d250 con 0x7f94ec070bc0 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec06d530 con 0x7f94ec0cd470 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f3bc3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec06d810 con 0x7f94ec143ae0 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 0x7f94ec06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 0x7f94ec06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:60176/0 (socket says 172.21.15.40:60176) 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 -- 172.21.15.40:0/1937049996 learned_addr learned my addr 172.21.15.40:0/1937049996 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:44.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f115e640 1 --2- 172.21.15.40:0/1937049996 >> v2:172.21.15.91:3300/0 conn(0x7f94ec0cd470 0x7f94ec0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 -- 172.21.15.40:0/1937049996 >> v2:172.21.15.91:3300/0 conn(0x7f94ec0cd470 msgr2=0x7f94ec0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 --2- 172.21.15.40:0/1937049996 >> v2:172.21.15.91:3300/0 conn(0x7f94ec0cd470 0x7f94ec0b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 -- 172.21.15.40:0/1937049996 >> v1:172.21.15.91:6789/0 conn(0x7f94ec070bc0 legacy=0x7f94ec06e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.263+0000 7f94f195f640 1 -- 172.21.15.40:0/1937049996 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec06daf0 con 0x7f94ec143ae0 2023-11-04T01:47:44.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f195f640 1 --2- 172.21.15.40:0/1937049996 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 0x7f94ec06cc50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009870 tx=0x7f94e801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4639b641d52e3b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f095d640 1 -- 172.21.15.40:0/1937049996 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80aa650 con 0x7f94ec143ae0 2023-11-04T01:47:44.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f095d640 1 -- 172.21.15.40:0/1937049996 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80aa7b0 con 0x7f94ec143ae0 2023-11-04T01:47:44.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f095d640 1 -- 172.21.15.40:0/1937049996 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80aab40 con 0x7f94ec143ae0 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 -- 172.21.15.40:0/1937049996 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 msgr2=0x7f94ec06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/1937049996 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 0x7f94ec06cc50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009870 tx=0x7f94e801c510 comp rx=0 tx=0).stop 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 -- 172.21.15.40:0/1937049996 shutdown_connections 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/1937049996 >> v2:172.21.15.91:3300/0 conn(0x7f94ec0cd470 0x7f94ec0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/1937049996 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec143ae0 0x7f94ec06cc50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 -- 172.21.15.40:0/1937049996 >> 172.21.15.40:0/1937049996 conn(0x7f94ec0b18a0 msgr2=0x7f94ec0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 -- 172.21.15.40:0/1937049996 shutdown_connections 2023-11-04T01:47:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 -- 172.21.15.40:0/1937049996 wait complete. 2023-11-04T01:47:44.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 Processor -- start 2023-11-04T01:47:44.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.267+0000 7f94f3bc3640 1 -- start start 2023-11-04T01:47:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 0x7f94ec137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec0cd470 0x7f94ec15e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94ec143ae0 0x7f94ec15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec137f40 con 0x7f94ec070bc0 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec138ac0 con 0x7f94ec143ae0 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec138190 con 0x7f94ec0cd470 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 0x7f94ec137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 0x7f94ec137700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35170/0 (socket says 172.21.15.40:35170) 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 -- 172.21.15.40:0/2294912402 learned_addr learned my addr 172.21.15.40:0/2294912402 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f115e640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec0cd470 0x7f94ec15e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f2160640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94ec143ae0 0x7f94ec15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 -- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec0cd470 msgr2=0x7f94ec15e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec0cd470 0x7f94ec15e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 -- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94ec143ae0 msgr2=0x7f94ec15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94ec143ae0 0x7f94ec15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 -- 172.21.15.40:0/2294912402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80094d0 con 0x7f94ec070bc0 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f2160640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94ec143ae0 0x7f94ec15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f195f640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 0x7f94ec137700 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f94e80ac040 tx=0x7f94e80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b4600 con 0x7f94ec070bc0 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80b47a0 con 0x7f94ec070bc0 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec071560 con 0x7f94ec070bc0 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b4b50 con 0x7f94ec070bc0 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec138750 con 0x7f94ec070bc0 2023-11-04T01:47:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec15d930 con 0x7f94ec070bc0 2023-11-04T01:47:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94e80b4cb0 con 0x7f94ec070bc0 2023-11-04T01:47:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94e27fc640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94d00664a0 0x7f94d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7689+0+0 (secure 0 0 0) 0x7f94e811f0a0 con 0x7f94ec070bc0 2023-11-04T01:47:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f115e640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94d00664a0 0x7f94d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.271+0000 7f94f115e640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94d00664a0 0x7f94d0068960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f94ec141ba0 tx=0x7f94dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.275+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94e80ebd90 con 0x7f94ec070bc0 2023-11-04T01:47:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.463+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94ec13edb0 con 0x7f94ec070bc0 2023-11-04T01:47:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.463+0000 7f94e27fc640 1 -- 172.21.15.40:0/2294912402 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4929 (secure 0 0 0) 0x7f94e80ef3b0 con 0x7f94ec070bc0 2023-11-04T01:47:44.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:44.468 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:37.630472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":6994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6994":{"gid":6994,"name":"b","rank":1,"incarnation":104,"state":"up:active","state_seq":7,"addr":"172.21.15.91:6837/2209627414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2209627414},{"type":"v1","addr":"172.21.15.91:6837","nonce":2209627414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:resolve","state_seq":14,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 114 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94d00664a0 msgr2=0x7f94d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94d00664a0 0x7f94d0068960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f94ec141ba0 tx=0x7f94dc008040 comp rx=0 tx=0).stop 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 msgr2=0x7f94ec137700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 0x7f94ec137700 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f94e80ac040 tx=0x7f94e80192b0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 shutdown_connections 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94d00664a0 0x7f94d0068960 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f94ec143ae0 0x7f94ec15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f94ec0cd470 0x7f94ec15e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 --2- 172.21.15.40:0/2294912402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ec070bc0 0x7f94ec137700 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 >> 172.21.15.40:0/2294912402 conn(0x7f94ec0b18a0 msgr2=0x7f94ec0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 shutdown_connections 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.467+0000 7f94f3bc3640 1 -- 172.21.15.40:0/2294912402 wait complete. 2023-11-04T01:47:44.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:47:44.611 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:24.386602+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:47:09.381741+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:44.611 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:24.386602+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:47:09.381741+0000" } ] } 2023-11-04T01:47:44.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:47:44.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 Processor -- start 2023-11-04T01:47:44.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 -- start start 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33cc0add70 0x7f33cc15d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 0x7f33cc0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc0c4910 con 0x7f33cc15cf80 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc06bbf0 con 0x7f33cc0add70 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d296a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0acff0 con 0x7f33cc0ae200 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d0f07640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 0x7f33cc0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33cb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33cc0add70 0x7f33cc15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33cb7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33cc0add70 0x7f33cc15d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.40:44906/0 (socket says 172.21.15.40:44906) 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d0f07640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 0x7f33cc0cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:60206/0 (socket says 172.21.15.40:60206) 2023-11-04T01:47:44.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33cb7fe640 1 -- 172.21.15.40:0/3588425238 learned_addr learned my addr 172.21.15.40:0/3588425238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:44.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33cbfff640 1 --1- 172.21.15.40:0/3588425238 >> v1:172.21.15.91:6789/0 conn(0x7f33cc15cf80 0x7f33cc0ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:57626/0 (socket says 172.21.15.40:57626) 2023-11-04T01:47:44.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d0f07640 1 -- 172.21.15.40:0/3588425238 >> v2:172.21.15.91:3300/0 conn(0x7f33cc0add70 msgr2=0x7f33cc15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d0f07640 1 --2- 172.21.15.40:0/3588425238 >> v2:172.21.15.91:3300/0 conn(0x7f33cc0add70 0x7f33cc15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d0f07640 1 -- 172.21.15.40:0/3588425238 >> v1:172.21.15.91:6789/0 conn(0x7f33cc15cf80 legacy=0x7f33cc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.735+0000 7f33d0f07640 1 -- 172.21.15.40:0/3588425238 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc15dcf0 con 0x7f33cc0ae200 2023-11-04T01:47:44.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d0f07640 1 --2- 172.21.15.40:0/3588425238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 0x7f33cc0cb600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33c40097c0 tx=0x7f33c401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343c83191094691b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33caffd640 1 -- 172.21.15.40:0/3588425238 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40ad660 con 0x7f33cc0ae200 2023-11-04T01:47:44.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33caffd640 1 -- 172.21.15.40:0/3588425238 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c40ad7c0 con 0x7f33cc0ae200 2023-11-04T01:47:44.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33caffd640 1 -- 172.21.15.40:0/3588425238 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40adb50 con 0x7f33cc0ae200 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 -- 172.21.15.40:0/3588425238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 msgr2=0x7f33cc0cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 --2- 172.21.15.40:0/3588425238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 0x7f33cc0cb600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33c40097c0 tx=0x7f33c401c450 comp rx=0 tx=0).stop 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 -- 172.21.15.40:0/3588425238 shutdown_connections 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 --2- 172.21.15.40:0/3588425238 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0ae200 0x7f33cc0cb600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 --2- 172.21.15.40:0/3588425238 >> v2:172.21.15.91:3300/0 conn(0x7f33cc0add70 0x7f33cc15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 -- 172.21.15.40:0/3588425238 >> 172.21.15.40:0/3588425238 conn(0x7f33cc0b0890 msgr2=0x7f33cc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 -- 172.21.15.40:0/3588425238 shutdown_connections 2023-11-04T01:47:44.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 -- 172.21.15.40:0/3588425238 wait complete. 2023-11-04T01:47:44.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 Processor -- start 2023-11-04T01:47:44.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.739+0000 7f33d296a640 1 -- start start 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0add70 0x7f33cc1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 0x7f33cc14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33cc15cf80 0x7f33cc1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc071280 con 0x7f33cc0ae200 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc070fa0 con 0x7f33cc15cf80 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc154bc0 con 0x7f33cc0add70 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 0x7f33cc14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 0x7f33cc14cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35182/0 (socket says 172.21.15.40:35182) 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 -- 172.21.15.40:0/4004977183 learned_addr learned my addr 172.21.15.40:0/4004977183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d0f07640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33cc15cf80 0x7f33cc1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cbfff640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0add70 0x7f33cc1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 -- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0add70 msgr2=0x7f33cc1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0add70 0x7f33cc1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 -- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33cc15cf80 msgr2=0x7f33cc1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33cc15cf80 0x7f33cc1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 -- 172.21.15.40:0/4004977183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009420 con 0x7f33cc0ae200 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cbfff640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0add70 0x7f33cc1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33cb7fe640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 0x7f33cc14cd30 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e890 tx=0x7f33c000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0009620 con 0x7f33cc0ae200 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000c940 con 0x7f33cc0ae200 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc154ea0 con 0x7f33cc0ae200 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000ccf0 con 0x7f33cc0ae200 2023-11-04T01:47:44.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc14d270 con 0x7f33cc0ae200 2023-11-04T01:47:44.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc154a20 con 0x7f33cc0ae200 2023-11-04T01:47:44.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33c0013470 con 0x7f33cc0ae200 2023-11-04T01:47:44.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.743+0000 7f33c8ff9640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33b80664a0 0x7f33b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.747+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7689+0+0 (secure 0 0 0) 0x7f33c00846f0 con 0x7f33cc0ae200 2023-11-04T01:47:44.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.747+0000 7f33cbfff640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33b80664a0 0x7f33b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.747+0000 7f33cbfff640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33b80664a0 0x7f33b8068960 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f33bc005fd0 tx=0x7f33bc005b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.751+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33cc154a20 con 0x7f33cc0ae200 2023-11-04T01:47:44.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.955+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f33cc154a20 con 0x7f33cc0ae200 2023-11-04T01:47:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.959+0000 7f33c8ff9640 1 -- 172.21.15.40:0/4004977183 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 6994 v115) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33cc154a20 con 0x7f33cc0ae200 2023-11-04T01:47:44.964 INFO:teuthology.orchestra.run.smithi040.stderr:failed mds gid 6994 2023-11-04T01:47:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33b80664a0 msgr2=0x7f33b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33b80664a0 0x7f33b8068960 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f33bc005fd0 tx=0x7f33bc005b80 comp rx=0 tx=0).stop 2023-11-04T01:47:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 msgr2=0x7f33cc14cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 0x7f33cc14cd30 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e890 tx=0x7f33c000ed50 comp rx=0 tx=0).stop 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 shutdown_connections 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f33b80664a0 0x7f33b8068960 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33cc15cf80 0x7f33cc1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33cc0ae200 0x7f33cc14cd30 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 --2- 172.21.15.40:0/4004977183 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f33cc0add70 0x7f33cc1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 >> 172.21.15.40:0/4004977183 conn(0x7f33cc0b0890 msgr2=0x7f33cc0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 shutdown_connections 2023-11-04T01:47:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:44.963+0000 7f33d296a640 1 -- 172.21.15.40:0/4004977183 wait complete. 2023-11-04T01:47:44.983 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:47:44.983 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:47:44.983 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:47:44.984 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:47:44.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:47:44.984 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi091 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:47:44.984 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:47:44.984 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:47:44.987 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:47:44.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:45.068 INFO:tasks.ceph.mds.b.smithi091.stdout:starting mds.b at 2023-11-04T01:47:45.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 Processor -- start 2023-11-04T01:47:45.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 -- start start 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c143ae0 0x7f9d7c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d7c070bc0 0x7f9d7c071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c06d250 con 0x7f9d7c0cd470 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c071570 con 0x7f9d7c070bc0 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.091+0000 7f9d82465640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c06d530 con 0x7f9d7c143ae0 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d7c070bc0 0x7f9d7c071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d7c070bc0 0x7f9d7c071030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35184/0 (socket says 172.21.15.40:35184) 2023-11-04T01:47:45.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 -- 172.21.15.40:0/3955803785 learned_addr learned my addr 172.21.15.40:0/3955803785 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:45.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d7bfff640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c143ae0 0x7f9d7c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 -- 172.21.15.40:0/3955803785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c143ae0 msgr2=0x7f9d7c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:45.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c143ae0 0x7f9d7c06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 -- 172.21.15.40:0/3955803785 >> v1:172.21.15.91:6789/0 conn(0x7f9d7c0cd470 legacy=0x7f9d7c0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 -- 172.21.15.40:0/3955803785 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c06d810 con 0x7f9d7c070bc0 2023-11-04T01:47:45.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d7bfff640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c143ae0 0x7f9d7c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:45.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d80a02640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c071030 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400d150 tx=0x7f9d7401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575945606e4fcf97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:45.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d7b7fe640 1 -- 172.21.15.40:0/3955803785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400b2d0 con 0x7f9d7c070bc0 2023-11-04T01:47:45.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d7b7fe640 1 -- 172.21.15.40:0/3955803785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7400b430 con 0x7f9d7c070bc0 2023-11-04T01:47:45.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d7b7fe640 1 -- 172.21.15.40:0/3955803785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740a7cd0 con 0x7f9d7c070bc0 2023-11-04T01:47:45.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 -- 172.21.15.40:0/3955803785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 msgr2=0x7f9d7c071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c071030 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400d150 tx=0x7f9d7401ebe0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 -- 172.21.15.40:0/3955803785 shutdown_connections 2023-11-04T01:47:45.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c071030 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 --2- 172.21.15.40:0/3955803785 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c143ae0 0x7f9d7c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 -- 172.21.15.40:0/3955803785 >> 172.21.15.40:0/3955803785 conn(0x7f9d7c0b18a0 msgr2=0x7f9d7c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:45.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 -- 172.21.15.40:0/3955803785 shutdown_connections 2023-11-04T01:47:45.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.095+0000 7f9d82465640 1 -- 172.21.15.40:0/3955803785 wait complete. 2023-11-04T01:47:45.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 Processor -- start 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- start start 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c1391b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c0cd470 0x7f9d7c1396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d7c143ae0 0x7f9d7c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c139c30 con 0x7f9d7c070bc0 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c13b450 con 0x7f9d7c143ae0 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0d07d0 con 0x7f9d7c0cd470 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c1391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c1391b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35196/0 (socket says 172.21.15.40:35196) 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 -- 172.21.15.40:0/367600065 learned_addr learned my addr 172.21.15.40:0/367600065 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:45.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d80a02640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d7c143ae0 0x7f9d7c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d73fff640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c0cd470 0x7f9d7c1396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 -- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c0cd470 msgr2=0x7f9d7c1396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c0cd470 0x7f9d7c1396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 -- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d7c143ae0 msgr2=0x7f9d7c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d7c143ae0 0x7f9d7c15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 -- 172.21.15.40:0/367600065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7400bd40 con 0x7f9d7c070bc0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d7bfff640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c1391b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00d800 tx=0x7f9d6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0096c0 con 0x7f9d7c070bc0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c009820 con 0x7f9d7c070bc0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c13b6f0 con 0x7f9d7c070bc0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c009bd0 con 0x7f9d7c070bc0 2023-11-04T01:47:45.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c0d0ab0 con 0x7f9d7c070bc0 2023-11-04T01:47:45.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c15d930 con 0x7f9d7c070bc0 2023-11-04T01:47:45.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.099+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d6c009d30 con 0x7f9d7c070bc0 2023-11-04T01:47:45.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.103+0000 7f9d797fa640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d5c0664a0 0x7f9d5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.103+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7775+0+0 (secure 0 0 0) 0x7f9d6c084c00 con 0x7f9d7c070bc0 2023-11-04T01:47:45.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.103+0000 7f9d73fff640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d5c0664a0 0x7f9d5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.103+0000 7f9d73fff640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d5c0664a0 0x7f9d5c068960 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c13abd0 tx=0x7f9d64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:45.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.107+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d6c08b080 con 0x7f9d7c070bc0 2023-11-04T01:47:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.295+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d7c0b4270 con 0x7f9d7c070bc0 2023-11-04T01:47:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.295+0000 7f9d797fa640 1 -- 172.21.15.40:0/367600065 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4137 (secure 0 0 0) 0x7f9d6c051920 con 0x7f9d7c070bc0 2023-11-04T01:47:45.299 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:45.300 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:44.967905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:resolve","state_seq":14,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:replay","state_seq":1,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 116 2023-11-04T01:47:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d5c0664a0 msgr2=0x7f9d5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d5c0664a0 0x7f9d5c068960 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c13abd0 tx=0x7f9d64009040 comp rx=0 tx=0).stop 2023-11-04T01:47:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 msgr2=0x7f9d7c1391b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c1391b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00d800 tx=0x7f9d6c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 shutdown_connections 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f9d5c0664a0 0x7f9d5c068960 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9d7c143ae0 0x7f9d7c15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9d7c0cd470 0x7f9d7c1396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 --2- 172.21.15.40:0/367600065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7c070bc0 0x7f9d7c1391b0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 >> 172.21.15.40:0/367600065 conn(0x7f9d7c0b18a0 msgr2=0x7f9d7c0b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 shutdown_connections 2023-11-04T01:47:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:45.299+0000 7f9d82465640 1 -- 172.21.15.40:0/367600065 wait complete. 2023-11-04T01:47:45.318 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:47:48.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:47:50.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 Processor -- start 2023-11-04T01:47:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 -- start start 2023-11-04T01:47:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb2f4153ae0 0x7fb2f40cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2f415d840 0x7fb2f406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f40ca010 con 0x7fb2f40caf00 2023-11-04T01:47:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f40cd7b0 con 0x7fb2f415d840 2023-11-04T01:47:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fc122640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f40ca260 con 0x7fb2f4153ae0 2023-11-04T01:47:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fa6bf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2f415d840 0x7fb2f406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2f96bd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb2f40caf00 0x7fb2f415d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46624/0 (socket says 172.21.15.40:46624) 2023-11-04T01:47:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2f96bd640 1 -- 172.21.15.40:0/2933400898 learned_addr learned my addr 172.21.15.40:0/2933400898 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2f9ebe640 1 --2- 172.21.15.40:0/2933400898 >> v2:172.21.15.91:3300/0 conn(0x7fb2f4153ae0 0x7fb2f40cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2f8ebc640 1 -- 172.21.15.40:0/2933400898 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790118720 0 0) 0x7fb2f40ca010 con 0x7fb2f40caf00 2023-11-04T01:47:50.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2f8ebc640 1 -- 172.21.15.40:0/2933400898 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0003430 con 0x7fb2f40caf00 2023-11-04T01:47:50.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fa6bf640 1 -- 172.21.15.40:0/2933400898 >> v2:172.21.15.91:3300/0 conn(0x7fb2f4153ae0 msgr2=0x7fb2f40cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:50.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fa6bf640 1 --2- 172.21.15.40:0/2933400898 >> v2:172.21.15.91:3300/0 conn(0x7fb2f4153ae0 0x7fb2f40cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fa6bf640 1 -- 172.21.15.40:0/2933400898 >> v1:172.21.15.40:6789/0 conn(0x7fb2f40caf00 legacy=0x7fb2f415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.451+0000 7fb2fa6bf640 1 -- 172.21.15.40:0/2933400898 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f40ca540 con 0x7fb2f415d840 2023-11-04T01:47:50.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fa6bf640 1 --2- 172.21.15.40:0/2933400898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f415d840 0x7fb2f406bc80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40c3c90 tx=0x7fb2ec025120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e438511b0627c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:50.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f8ebc640 1 -- 172.21.15.40:0/2933400898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0b4600 con 0x7fb2f415d840 2023-11-04T01:47:50.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f8ebc640 1 -- 172.21.15.40:0/2933400898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec0b0050 con 0x7fb2f415d840 2023-11-04T01:47:50.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f8ebc640 1 -- 172.21.15.40:0/2933400898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0b4980 con 0x7fb2f415d840 2023-11-04T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- 172.21.15.40:0/2933400898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f415d840 msgr2=0x7fb2f406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2933400898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f415d840 0x7fb2f406bc80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40c3c90 tx=0x7fb2ec025120 comp rx=0 tx=0).stop 2023-11-04T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- 172.21.15.40:0/2933400898 shutdown_connections 2023-11-04T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2933400898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f415d840 0x7fb2f406bc80 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2933400898 >> v2:172.21.15.91:3300/0 conn(0x7fb2f4153ae0 0x7fb2f40cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- 172.21.15.40:0/2933400898 >> 172.21.15.40:0/2933400898 conn(0x7fb2f40b0890 msgr2=0x7fb2f40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- 172.21.15.40:0/2933400898 shutdown_connections 2023-11-04T01:47:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- 172.21.15.40:0/2933400898 wait complete. 2023-11-04T01:47:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 Processor -- start 2023-11-04T01:47:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- start start 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2f40caf00 0x7fb2f40aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 0x7fb2f4149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2f415d840 0x7fb2f415bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4149610 con 0x7fb2f4153ae0 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f415caa0 con 0x7fb2f415d840 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fc122640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f414d8d0 con 0x7fb2f40caf00 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 0x7fb2f4149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 0x7fb2f4149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57082/0 (socket says 172.21.15.40:57082) 2023-11-04T01:47:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 -- 172.21.15.40:0/2848443720 learned_addr learned my addr 172.21.15.40:0/2848443720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2fa6bf640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2f415d840 0x7fb2f415bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f9ebe640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2f40caf00 0x7fb2f40aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 -- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2f40caf00 msgr2=0x7fb2f40aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2f40caf00 0x7fb2f40aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 -- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2f415d840 msgr2=0x7fb2f415bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2f415d840 0x7fb2f415bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f96bd640 1 -- 172.21.15.40:0/2848443720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec009a70 con 0x7fb2f4153ae0 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.455+0000 7fb2f9ebe640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2f40caf00 0x7fb2f40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2f96bd640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 0x7fb2f4149aa0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c500 tx=0x7fb2e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4005cf0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e4005e50 con 0x7fb2f4153ae0 2023-11-04T01:47:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f414dbb0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40072f0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f41492a0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f41497c0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2e4007450 con 0x7fb2f4153ae0 2023-11-04T01:47:50.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2ea7fc640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2d80664d0 0x7fb2d8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7775+0+0 (secure 0 0 0) 0x7fb2e4083b70 con 0x7fb2f4153ae0 2023-11-04T01:47:50.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2f9ebe640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2d80664d0 0x7fb2d8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.459+0000 7fb2f9ebe640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2d80664d0 0x7fb2d8068990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40c8f80 tx=0x7fb2f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:50.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.463+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2f41497c0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.651+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2f41497c0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.651+0000 7fb2ea7fc640 1 -- 172.21.15.40:0/2848443720 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fb2f41497c0 con 0x7fb2f4153ae0 2023-11-04T01:47:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:50.681 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:45.989812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 118 2023-11-04T01:47:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2d80664d0 msgr2=0x7fb2d8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2d80664d0 0x7fb2d8068990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40c8f80 tx=0x7fb2f0008040 comp rx=0 tx=0).stop 2023-11-04T01:47:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 msgr2=0x7fb2f4149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 0x7fb2f4149aa0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c500 tx=0x7fb2e400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 shutdown_connections 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb2d80664d0 0x7fb2d8068990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb2f415d840 0x7fb2f415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f4153ae0 0x7fb2f4149aa0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 --2- 172.21.15.40:0/2848443720 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb2f40caf00 0x7fb2f40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 >> 172.21.15.40:0/2848443720 conn(0x7fb2f40b0890 msgr2=0x7fb2f4157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 shutdown_connections 2023-11-04T01:47:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.655+0000 7fb2fc122640 1 -- 172.21.15.40:0/2848443720 wait complete. 2023-11-04T01:47:50.683 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:47:50.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.791+0000 7fd44ac2f640 1 Processor -- start 2023-11-04T01:47:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.791+0000 7fd44ac2f640 1 -- start start 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd44ac2f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4440c92b0 0x7fd4440cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd44ac2f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4440c9ac0 con 0x7fd44406bde0 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd44ac2f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4440caf20 con 0x7fd44406c1c0 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd44ac2f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440c97e0 con 0x7fd4440c92b0 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd44406bde0 0x7fd44415c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46638/0 (socket says 172.21.15.40:46638) 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 -- 172.21.15.40:0/3443690379 learned_addr learned my addr 172.21.15.40:0/3443690379 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd443fff640 1 --2- 172.21.15.40:0/3443690379 >> v2:172.21.15.91:3300/0 conn(0x7fd4440c92b0 0x7fd4440cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424313539 0 0) 0x7fd4440c9ac0 con 0x7fd44406bde0 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd42c003530 con 0x7fd44406bde0 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726044429 0 0) 0x7fd42c003530 con 0x7fd44406bde0 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 >> v2:172.21.15.91:3300/0 conn(0x7fd4440c92b0 msgr2=0x7fd4440cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 --2- 172.21.15.40:0/3443690379 >> v2:172.21.15.91:3300/0 conn(0x7fd4440c92b0 0x7fd4440cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 >> v1:172.21.15.91:6789/0 conn(0x7fd44406c1c0 legacy=0x7fd4441442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440cb1c0 con 0x7fd44406bde0 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fd434001680 con 0x7fd44406bde0 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 >> v1:172.21.15.40:6789/0 conn(0x7fd44406bde0 legacy=0x7fd44415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd42c003980 0x7fd42c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c0047d0 0x7fd42c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd42c005190 0x7fd42c00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440c97e0 con 0x7fd42c003980 2023-11-04T01:47:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c010440 con 0x7fd42c005190 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c010600 con 0x7fd42c0047d0 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd42c003980 0x7fd42c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4491cc640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd42c005190 0x7fd42c00fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd443fff640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c0047d0 0x7fd42c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 -- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c0047d0 msgr2=0x7fd42c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c0047d0 0x7fd42c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 -- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd42c005190 msgr2=0x7fd42c00fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd42c005190 0x7fd42c00fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4489cb640 1 -- 172.21.15.40:0/3443690379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c003530 con 0x7fd42c003980 2023-11-04T01:47:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.795+0000 7fd4491cc640 1 -- 172.21.15.40:0/3443690379 reap_dead start 2023-11-04T01:47:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd4489cb640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd42c003980 0x7fd42c003da0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c1c0 tx=0x7fd43401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375fa8e67515823a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434005ae0 con 0x7fd42c003980 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434005c40 con 0x7fd42c003980 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd4437fe640 1 -- 172.21.15.40:0/3443690379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340072b0 con 0x7fd42c003980 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- 172.21.15.40:0/3443690379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd42c003980 msgr2=0x7fd42c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd42c003980 0x7fd42c003da0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c1c0 tx=0x7fd43401cc20 comp rx=0 tx=0).stop 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- 172.21.15.40:0/3443690379 shutdown_connections 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/3443690379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd42c003980 0x7fd42c003da0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- 172.21.15.40:0/3443690379 >> 172.21.15.40:0/3443690379 conn(0x7fd4440b0890 msgr2=0x7fd4440b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- 172.21.15.40:0/3443690379 shutdown_connections 2023-11-04T01:47:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- 172.21.15.40:0/3443690379 wait complete. 2023-11-04T01:47:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 Processor -- start 2023-11-04T01:47:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- start start 2023-11-04T01:47:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c003980 0x7fd4440c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 0x7fd4441f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd44415dcd0 0x7fd44415e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441f6210 con 0x7fd44413e0e0 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44415e6a0 con 0x7fd44415dcd0 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd44ac2f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441f5340 con 0x7fd42c003980 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 0x7fd4441f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 0x7fd4441f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57110/0 (socket says 172.21.15.40:57110) 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 -- 172.21.15.40:0/2260382336 learned_addr learned my addr 172.21.15.40:0/2260382336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd4489cb640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c003980 0x7fd4440c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd4491cc640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd44415dcd0 0x7fd44415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 -- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c003980 msgr2=0x7fd4440c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c003980 0x7fd4440c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 -- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd44415dcd0 msgr2=0x7fd44415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd44415dcd0 0x7fd44415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.799+0000 7fd443fff640 1 -- 172.21.15.40:0/2260382336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440c9080 con 0x7fd44413e0e0 2023-11-04T01:47:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd443fff640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 0x7fd4441f4a00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd438011690 tx=0x7fd438011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800f9c0 con 0x7fd44413e0e0 2023-11-04T01:47:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43800fb20 con 0x7fd44413e0e0 2023-11-04T01:47:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4441f5590 con 0x7fd44413e0e0 2023-11-04T01:47:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800fe90 con 0x7fd44413e0e0 2023-11-04T01:47:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4441f5b50 con 0x7fd44413e0e0 2023-11-04T01:47:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44404e4a0 con 0x7fd44413e0e0 2023-11-04T01:47:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd438015460 con 0x7fd44413e0e0 2023-11-04T01:47:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4417fa640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4300664d0 0x7fd430068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7775+0+0 (secure 0 0 0) 0x7fd438084e00 con 0x7fd44413e0e0 2023-11-04T01:47:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4489cb640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4300664d0 0x7fd430068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.803+0000 7fd4489cb640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4300664d0 0x7fd430068990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd4340ab000 tx=0x7fd4340b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.807+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd438051bb0 con 0x7fd44413e0e0 2023-11-04T01:47:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4440b05e0 con 0x7fd44413e0e0 2023-11-04T01:47:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd4417fa640 1 -- 172.21.15.40:0/2260382336 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fd4380551d0 con 0x7fd44413e0e0 2023-11-04T01:47:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:50.998 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:45.989812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 118 2023-11-04T01:47:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4300664d0 msgr2=0x7fd430068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4300664d0 0x7fd430068990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd4340ab000 tx=0x7fd4340b1040 comp rx=0 tx=0).stop 2023-11-04T01:47:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 msgr2=0x7fd4441f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 0x7fd4441f4a00 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd438011690 tx=0x7fd438011b50 comp rx=0 tx=0).stop 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 shutdown_connections 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4300664d0 0x7fd430068990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd44415dcd0 0x7fd44415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd44413e0e0 0x7fd4441f4a00 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 --2- 172.21.15.40:0/2260382336 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd42c003980 0x7fd4440c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 >> 172.21.15.40:0/2260382336 conn(0x7fd4440b0890 msgr2=0x7fd4440ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 shutdown_connections 2023-11-04T01:47:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:50.995+0000 7fd44ac2f640 1 -- 172.21.15.40:0/2260382336 wait complete. 2023-11-04T01:47:51.016 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:47:52.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:52.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.147+0000 7fc2f69b5640 1 Processor -- start 2023-11-04T01:47:52.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.147+0000 7fc2f69b5640 1 -- start start 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f69b5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f00c92b0 0x7fc2f00cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f69b5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2f006c1c0 0x7fc2f01442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f69b5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00c9ac0 con 0x7fc2f006bde0 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f69b5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f00caf20 con 0x7fc2f006c1c0 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f69b5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c97e0 con 0x7fc2f00c92b0 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2effff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2f006bde0 0x7fc2f015c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46652/0 (socket says 172.21.15.40:46652) 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2effff640 1 -- 172.21.15.40:0/326556465 learned_addr learned my addr 172.21.15.40:0/326556465 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f4f52640 1 --2- 172.21.15.40:0/326556465 >> v2:172.21.15.40:3300/0 conn(0x7fc2f006c1c0 0x7fc2f01442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2eeffd640 1 -- 172.21.15.40:0/326556465 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530040661 0 0) 0x7fc2f00c9ac0 con 0x7fc2f006bde0 2023-11-04T01:47:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2eeffd640 1 -- 172.21.15.40:0/326556465 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003530 con 0x7fc2f006bde0 2023-11-04T01:47:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2ef7fe640 1 --2- 172.21.15.40:0/326556465 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f00c92b0 0x7fc2f00cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f4f52640 1 -- 172.21.15.40:0/326556465 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f00c92b0 msgr2=0x7fc2f00cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f4f52640 1 --2- 172.21.15.40:0/326556465 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f00c92b0 0x7fc2f00cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f4f52640 1 -- 172.21.15.40:0/326556465 >> v1:172.21.15.40:6789/0 conn(0x7fc2f006bde0 legacy=0x7fc2f015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f4f52640 1 -- 172.21.15.40:0/326556465 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00cb1c0 con 0x7fc2f006c1c0 2023-11-04T01:47:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2f4f52640 1 --2- 172.21.15.40:0/326556465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f01442b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097f0 tx=0x7fc2e801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f633a35917879167 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2eeffd640 1 -- 172.21.15.40:0/326556465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ab600 con 0x7fc2f006c1c0 2023-11-04T01:47:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2eeffd640 1 -- 172.21.15.40:0/326556465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80a7050 con 0x7fc2f006c1c0 2023-11-04T01:47:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.151+0000 7fc2eeffd640 1 -- 172.21.15.40:0/326556465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ab960 con 0x7fc2f006c1c0 2023-11-04T01:47:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/326556465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 msgr2=0x7fc2f01442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/326556465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f01442b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097f0 tx=0x7fc2e801c480 comp rx=0 tx=0).stop 2023-11-04T01:47:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/326556465 shutdown_connections 2023-11-04T01:47:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/326556465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f01442b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/326556465 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f00c92b0 0x7fc2f00cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/326556465 >> 172.21.15.40:0/326556465 conn(0x7fc2f00b0890 msgr2=0x7fc2f00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/326556465 shutdown_connections 2023-11-04T01:47:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/326556465 wait complete. 2023-11-04T01:47:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 Processor -- start 2023-11-04T01:47:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- start start 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f006bde0 0x7fc2f015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2f00c92b0 0x7fc2f00cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f015aec0 con 0x7fc2f006c1c0 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00b4000 con 0x7fc2f00c92b0 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00b33f0 con 0x7fc2f006bde0 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f00c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f00c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57122/0 (socket says 172.21.15.40:57122) 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 -- 172.21.15.40:0/2996046504 learned_addr learned my addr 172.21.15.40:0/2996046504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2effff640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f006bde0 0x7fc2f015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 -- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f006bde0 msgr2=0x7fc2f015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f006bde0 0x7fc2f015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f4f52640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2f00c92b0 0x7fc2f00cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 -- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2f00c92b0 msgr2=0x7fc2f00cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2f00c92b0 0x7fc2f00cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 -- 172.21.15.40:0/2996046504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009420 con 0x7fc2f006c1c0 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ef7fe640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f00c8740 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0007e60 tx=0x7fc2e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0003ba0 con 0x7fc2f006c1c0 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000ee90 con 0x7fc2f006c1c0 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00b36d0 con 0x7fc2f006c1c0 2023-11-04T01:47:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0004030 con 0x7fc2f006c1c0 2023-11-04T01:47:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.155+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f00b3c90 con 0x7fc2f006c1c0 2023-11-04T01:47:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.159+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f004e4a0 con 0x7fc2f006c1c0 2023-11-04T01:47:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.159+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2e0004190 con 0x7fc2f006c1c0 2023-11-04T01:47:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.159+0000 7fc2ecff9640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2d00664a0 0x7fc2d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.159+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7775+0+0 (secure 0 0 0) 0x7fc2e00849e0 con 0x7fc2f006c1c0 2023-11-04T01:47:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.159+0000 7fc2effff640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2d00664a0 0x7fc2d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.159+0000 7fc2effff640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2d00664a0 0x7fc2d0068960 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8005890 tx=0x7fc2d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.163+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2e0051700 con 0x7fc2f006c1c0 2023-11-04T01:47:52.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.343+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2f00b4140 con 0x7fc2f006c1c0 2023-11-04T01:47:52.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.343+0000 7fc2ecff9640 1 -- 172.21.15.40:0/2996046504 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fc2e001a020 con 0x7fc2f006c1c0 2023-11-04T01:47:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:52.349 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:45.989812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:52.349 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 118 2023-11-04T01:47:52.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2d00664a0 msgr2=0x7fc2d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2d00664a0 0x7fc2d0068960 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8005890 tx=0x7fc2d8009040 comp rx=0 tx=0).stop 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 msgr2=0x7fc2f00c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f00c8740 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0007e60 tx=0x7fc2e000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 shutdown_connections 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc2d00664a0 0x7fc2d0068960 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc2f00c92b0 0x7fc2f00cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2f006c1c0 0x7fc2f00c8740 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 --2- 172.21.15.40:0/2996046504 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc2f006bde0 0x7fc2f015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 >> 172.21.15.40:0/2996046504 conn(0x7fc2f00b0890 msgr2=0x7fc2f00b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 shutdown_connections 2023-11-04T01:47:52.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:52.347+0000 7fc2f69b5640 1 -- 172.21.15.40:0/2996046504 wait complete. 2023-11-04T01:47:52.366 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:47:53.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:53.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 Processor -- start 2023-11-04T01:47:53.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 -- start start 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc00c0add70 0x7fc00c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc00c0ae200 0x7fc00c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0c4910 con 0x7fc00c15cf80 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c06bbf0 con 0x7fc00c0add70 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc0125f5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0acff0 con 0x7fc00c0ae200 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc00c0add70 0x7fc00c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc00c15cf80 0x7fc00c0ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46658/0 (socket says 172.21.15.40:46658) 2023-11-04T01:47:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00bfff640 1 -- 172.21.15.40:0/1602168609 learned_addr learned my addr 172.21.15.40:0/1602168609 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc010b92640 1 --2- 172.21.15.40:0/1602168609 >> v2:172.21.15.91:3300/0 conn(0x7fc00c0ae200 0x7fc00c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00affd640 1 -- 172.21.15.40:0/1602168609 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000841772 0 0) 0x7fc00c0c4910 con 0x7fc00c15cf80 2023-11-04T01:47:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00affd640 1 -- 172.21.15.40:0/1602168609 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff4003530 con 0x7fc00c15cf80 2023-11-04T01:47:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00b7fe640 1 -- 172.21.15.40:0/1602168609 >> v2:172.21.15.91:3300/0 conn(0x7fc00c0ae200 msgr2=0x7fc00c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00b7fe640 1 --2- 172.21.15.40:0/1602168609 >> v2:172.21.15.91:3300/0 conn(0x7fc00c0ae200 0x7fc00c0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00b7fe640 1 -- 172.21.15.40:0/1602168609 >> v1:172.21.15.40:6789/0 conn(0x7fc00c15cf80 legacy=0x7fc00c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.499+0000 7fc00b7fe640 1 -- 172.21.15.40:0/1602168609 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c15dcf0 con 0x7fc00c0add70 2023-11-04T01:47:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc00b7fe640 1 --2- 172.21.15.40:0/1602168609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c0add70 0x7fc00c15d360 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc00c15e8a0 tx=0x7fbffc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d942559fc14f63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc00affd640 1 -- 172.21.15.40:0/1602168609 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0ab600 con 0x7fc00c0add70 2023-11-04T01:47:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc00affd640 1 -- 172.21.15.40:0/1602168609 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a7050 con 0x7fc00c0add70 2023-11-04T01:47:53.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc00affd640 1 -- 172.21.15.40:0/1602168609 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0ab980 con 0x7fc00c0add70 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 -- 172.21.15.40:0/1602168609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c0add70 msgr2=0x7fc00c15d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 --2- 172.21.15.40:0/1602168609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c0add70 0x7fc00c15d360 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc00c15e8a0 tx=0x7fbffc01c3a0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 -- 172.21.15.40:0/1602168609 shutdown_connections 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 --2- 172.21.15.40:0/1602168609 >> v2:172.21.15.91:3300/0 conn(0x7fc00c0ae200 0x7fc00c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 --2- 172.21.15.40:0/1602168609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c0add70 0x7fc00c15d360 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 -- 172.21.15.40:0/1602168609 >> 172.21.15.40:0/1602168609 conn(0x7fc00c0b0890 msgr2=0x7fc00c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 -- 172.21.15.40:0/1602168609 shutdown_connections 2023-11-04T01:47:53.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.503+0000 7fc0125f5640 1 -- 172.21.15.40:0/1602168609 wait complete. 2023-11-04T01:47:53.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 Processor -- start 2023-11-04T01:47:53.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- start start 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc00c0add70 0x7fc00c13afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc00c0ae200 0x7fc00c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 0x7fc00c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c14f930 con 0x7fc00c15cf80 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1501d0 con 0x7fc00c0ae200 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c13b500 con 0x7fc00c0add70 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 0x7fc00c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 0x7fc00c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57132/0 (socket says 172.21.15.40:57132) 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 -- 172.21.15.40:0/3197226267 learned_addr learned my addr 172.21.15.40:0/3197226267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc00bfff640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc00c0add70 0x7fc00c13afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc00b7fe640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc00c0ae200 0x7fc00c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 -- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc00c0add70 msgr2=0x7fc00c13afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc00c0add70 0x7fc00c13afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 -- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc00c0ae200 msgr2=0x7fc00c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc00c0ae200 0x7fc00c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 -- 172.21.15.40:0/3197226267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009420 con 0x7fc00c15cf80 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc010b92640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 0x7fc00c157ce0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc004007e40 tx=0x7fc00400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004014620 con 0x7fc00c15cf80 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400ee90 con 0x7fc00c15cf80 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040149e0 con 0x7fc00c15cf80 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c0cd9b0 con 0x7fc00c15cf80 2023-11-04T01:47:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c14fe60 con 0x7fc00c15cf80 2023-11-04T01:47:53.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c150340 con 0x7fc00c15cf80 2023-11-04T01:47:53.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.507+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc004014b40 con 0x7fc00c15cf80 2023-11-04T01:47:53.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.511+0000 7fc008ff9640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff80664d0 0x7fbff8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.511+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7fc0040850f0 con 0x7fc00c15cf80 2023-11-04T01:47:53.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.511+0000 7fc00bfff640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff80664d0 0x7fbff8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.511+0000 7fc00bfff640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff80664d0 0x7fbff8068990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc000005890 tx=0x7fc000009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:53.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.515+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc004051ca0 con 0x7fc00c15cf80 2023-11-04T01:47:53.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc00c04e4a0 con 0x7fc00c15cf80 2023-11-04T01:47:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc008ff9640 1 -- 172.21.15.40:0/3197226267 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4934 (secure 0 0 0) 0x7fc0040552c0 con 0x7fc00c15cf80 2023-11-04T01:47:53.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:53.711 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:45.989812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 118 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff80664d0 msgr2=0x7fbff8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff80664d0 0x7fbff8068990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc000005890 tx=0x7fc000009040 comp rx=0 tx=0).stop 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 msgr2=0x7fc00c157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 0x7fc00c157ce0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc004007e40 tx=0x7fc00400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 shutdown_connections 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbff80664d0 0x7fbff8068990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00c15cf80 0x7fc00c157ce0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc00c0ae200 0x7fc00c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 --2- 172.21.15.40:0/3197226267 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc00c0add70 0x7fc00c13afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.707+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 >> 172.21.15.40:0/3197226267 conn(0x7fc00c0b0890 msgr2=0x7fc00c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.711+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 shutdown_connections 2023-11-04T01:47:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:53.711+0000 7fc0125f5640 1 -- 172.21.15.40:0/3197226267 wait complete. 2023-11-04T01:47:53.730 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:47:54.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52db8fe640 1 Processor -- start 2023-11-04T01:47:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52db8fe640 1 -- start start 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52db8fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f52d40ae200 0x7f52d40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52db8fe640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40c4910 con 0x7f52d415cf80 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52db8fe640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d415da70 con 0x7f52d40add70 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52db8fe640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d406bbf0 con 0x7f52d40ae200 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d969a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52d415cf80 0x7f52d40ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46662/0 (socket says 172.21.15.40:46662) 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d969a640 1 -- 172.21.15.40:0/930367779 learned_addr learned my addr 172.21.15.40:0/930367779 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 --2- 172.21.15.40:0/930367779 >> v2:172.21.15.91:3300/0 conn(0x7f52d40ae200 0x7f52d40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498140798 0 0) 0x7f52d40c4910 con 0x7f52d415cf80 2023-11-04T01:47:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c0003530 con 0x7f52d415cf80 2023-11-04T01:47:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.1 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132150113 0 0) 0x7f52d415da70 con 0x7f52d40add70 2023-11-04T01:47:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d40c4910 con 0x7f52d40add70 2023-11-04T01:47:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901283746 0 0) 0x7f52c0003530 con 0x7f52d415cf80 2023-11-04T01:47:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 >> v2:172.21.15.91:3300/0 conn(0x7f52d40ae200 msgr2=0x7f52d40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 --2- 172.21.15.40:0/930367779 >> v2:172.21.15.91:3300/0 conn(0x7f52d40ae200 0x7f52d40cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 >> v1:172.21.15.91:6789/0 conn(0x7f52d40add70 legacy=0x7f52d415d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d415dcf0 con 0x7f52d415cf80 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f52d00016a0 con 0x7f52d415cf80 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 >> v1:172.21.15.40:6789/0 conn(0x7f52d415cf80 legacy=0x7f52d40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52c0003b10 0x7f52c0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52c00047d0 0x7f52c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d406bbf0 con 0x7f52c0005190 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c000c0c0 con 0x7f52c00047d0 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c000c280 con 0x7f52c0003b10 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d969a640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52c0003b10 0x7f52c0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 -- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52c0003b10 msgr2=0x7f52c0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52c0003b10 0x7f52c0003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 -- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52c00047d0 msgr2=0x7f52c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52c00047d0 0x7f52c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d9e9b640 1 -- 172.21.15.40:0/930367779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0003530 con 0x7f52c0005190 2023-11-04T01:47:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.863+0000 7f52d969a640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52c0003b10 0x7f52c0003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52d9e9b640 1 -- 172.21.15.40:0/930367779 reap_dead start 2023-11-04T01:47:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52d9e9b640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52c000b990 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009fc0 tx=0x7f52cc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd4096b40204004 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0a5cb0 con 0x7f52c0005190 2023-11-04T01:47:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00f040 con 0x7f52c0005190 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52cbfff640 1 -- 172.21.15.40:0/930367779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003be0 con 0x7f52c0005190 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 -- 172.21.15.40:0/930367779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 msgr2=0x7f52c000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52c000b990 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009fc0 tx=0x7f52cc01cca0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 -- 172.21.15.40:0/930367779 shutdown_connections 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 --2- 172.21.15.40:0/930367779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52c000b990 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 -- 172.21.15.40:0/930367779 >> 172.21.15.40:0/930367779 conn(0x7f52d40b0890 msgr2=0x7f52d40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 -- 172.21.15.40:0/930367779 shutdown_connections 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 -- 172.21.15.40:0/930367779 wait complete. 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 Processor -- start 2023-11-04T01:47:54.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.867+0000 7f52db8fe640 1 -- start start 2023-11-04T01:47:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52d4150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d415a930 0x7f52d40b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b31c0 0x7f52d40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4150e50 con 0x7f52c0005190 2023-11-04T01:47:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40b3640 con 0x7f52d40b31c0 2023-11-04T01:47:54.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d415b110 con 0x7f52d415a930 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52d4150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52d4150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57150/0 (socket says 172.21.15.40:57150) 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 -- 172.21.15.40:0/4080136958 learned_addr learned my addr 172.21.15.40:0/4080136958 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 -- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d415a930 msgr2=0x7f52d40b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d8e99640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d415a930 0x7f52d40b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d9e9b640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b31c0 0x7f52d40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d415a930 0x7f52d40b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 -- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b31c0 msgr2=0x7f52d40b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b31c0 0x7f52d40b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 -- 172.21.15.40:0/4080136958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d414fb90 con 0x7f52c0005190 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d8e99640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d415a930 0x7f52d40b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d969a640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52d4150910 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f52d0007fd0 tx=0x7f52d000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:54.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d00072d0 con 0x7f52c0005190 2023-11-04T01:47:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0007430 con 0x7f52c0005190 2023-11-04T01:47:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d414fe30 con 0x7f52c0005190 2023-11-04T01:47:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d00047f0 con 0x7f52c0005190 2023-11-04T01:47:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d41503f0 con 0x7f52c0005190 2023-11-04T01:47:54.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d41505b0 con 0x7f52c0005190 2023-11-04T01:47:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52d0004b60 con 0x7f52c0005190 2023-11-04T01:47:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52c9ffb640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52b80664a0 0x7f52b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f52d0084490 con 0x7f52c0005190 2023-11-04T01:47:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.871+0000 7f52d8e99640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52b80664a0 0x7f52b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.875+0000 7f52d8e99640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52b80664a0 0x7f52b8068960 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f52d40ccc10 tx=0x7f52c400c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:54.875+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52d0051160 con 0x7f52c0005190 2023-11-04T01:47:55.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.063+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52d404e4a0 con 0x7f52c0005190 2023-11-04T01:47:55.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.063+0000 7f52c9ffb640 1 -- 172.21.15.40:0/4080136958 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4928 (secure 0 0 0) 0x7f52d0019090 con 0x7f52c0005190 2023-11-04T01:47:55.069 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:55.069 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:53.117024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:55.069 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 119 2023-11-04T01:47:55.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52b80664a0 msgr2=0x7f52b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52b80664a0 0x7f52b8068960 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f52d40ccc10 tx=0x7f52c400c040 comp rx=0 tx=0).stop 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 msgr2=0x7f52d4150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52d4150910 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f52d0007fd0 tx=0x7f52d000db90 comp rx=0 tx=0).stop 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 shutdown_connections 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f52b80664a0 0x7f52b8068960 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52d40b31c0 0x7f52d40b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f52d415a930 0x7f52d40b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 --2- 172.21.15.40:0/4080136958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52c0005190 0x7f52d4150910 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 >> 172.21.15.40:0/4080136958 conn(0x7f52d40b0890 msgr2=0x7f52d4071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 shutdown_connections 2023-11-04T01:47:55.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:55.067+0000 7f52db8fe640 1 -- 172.21.15.40:0/4080136958 wait complete. 2023-11-04T01:47:55.086 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:47:56.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 Processor -- start 2023-11-04T01:47:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 -- start start 2023-11-04T01:47:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1780cf080 0x7fa178161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1780c9af0 0x7fa1780cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa178070310 con 0x7fa17815d130 2023-11-04T01:47:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa178161c70 con 0x7fa1780c9af0 2023-11-04T01:47:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17eb33640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17806a1d0 con 0x7fa1780cf080 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1780c9af0 0x7fa1780cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1780c9af0 0x7fa1780cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57162/0 (socket says 172.21.15.40:57162) 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 -- 172.21.15.40:0/2756795490 learned_addr learned my addr 172.21.15.40:0/2756795490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa177fff640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1780cf080 0x7fa178161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 -- 172.21.15.40:0/2756795490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1780cf080 msgr2=0x7fa178161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1780cf080 0x7fa178161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 -- 172.21.15.40:0/2756795490 >> v1:172.21.15.91:6789/0 conn(0x7fa17815d130 legacy=0x7fa1780ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa17d0d0640 1 -- 172.21.15.40:0/2756795490 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17806a4b0 con 0x7fa1780c9af0 2023-11-04T01:47:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.223+0000 7fa177fff640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1780cf080 0x7fa178161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17d0d0640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780c9af0 0x7fa1780cb6d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fa168009e50 tx=0x7fa16801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8f2046bce5c6ad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa1777fe640 1 -- 172.21.15.40:0/2756795490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680a57d0 con 0x7fa1780c9af0 2023-11-04T01:47:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa1777fe640 1 -- 172.21.15.40:0/2756795490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1680a5930 con 0x7fa1780c9af0 2023-11-04T01:47:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa1777fe640 1 -- 172.21.15.40:0/2756795490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680a5cc0 con 0x7fa1780c9af0 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 -- 172.21.15.40:0/2756795490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780c9af0 msgr2=0x7fa1780cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780c9af0 0x7fa1780cb6d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fa168009e50 tx=0x7fa16801ca10 comp rx=0 tx=0).stop 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 -- 172.21.15.40:0/2756795490 shutdown_connections 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780c9af0 0x7fa1780cb6d0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 --2- 172.21.15.40:0/2756795490 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa1780cf080 0x7fa178161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 -- 172.21.15.40:0/2756795490 >> 172.21.15.40:0/2756795490 conn(0x7fa1780b1050 msgr2=0x7fa1780b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 -- 172.21.15.40:0/2756795490 shutdown_connections 2023-11-04T01:47:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 -- 172.21.15.40:0/2756795490 wait complete. 2023-11-04T01:47:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 Processor -- start 2023-11-04T01:47:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 -- start start 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.227+0000 7fa17eb33640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1780c9af0 0x7fa1780b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 0x7fa178158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa17815d130 0x7fa178159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781586d0 con 0x7fa1780cf080 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780b47b0 con 0x7fa1780c9af0 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780b2230 con 0x7fa17815d130 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 0x7fa178158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 0x7fa178158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57170/0 (socket says 172.21.15.40:57170) 2023-11-04T01:47:56.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 -- 172.21.15.40:0/243062233 learned_addr learned my addr 172.21.15.40:0/243062233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17d0d0640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa17815d130 0x7fa178159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17c8cf640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1780c9af0 0x7fa1780b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 -- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa17815d130 msgr2=0x7fa178159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa17815d130 0x7fa178159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 -- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1780c9af0 msgr2=0x7fa1780b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1780c9af0 0x7fa1780b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 -- 172.21.15.40:0/243062233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009b30 con 0x7fa1780cf080 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa177fff640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 0x7fa178158190 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa16000e810 tx=0x7fa16000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000c8d0 con 0x7fa1780cf080 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16000ca30 con 0x7fa1780cf080 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1780b2510 con 0x7fa1780cf080 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000cdc0 con 0x7fa1780cf080 2023-11-04T01:47:56.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1781599d0 con 0x7fa1780cf080 2023-11-04T01:47:56.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1780b2090 con 0x7fa1780cf080 2023-11-04T01:47:56.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa160013410 con 0x7fa1780cf080 2023-11-04T01:47:56.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa1757fa640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1580664d0 0x7fa158068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7fa160084400 con 0x7fa1780cf080 2023-11-04T01:47:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17c8cf640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1580664d0 0x7fa158068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.231+0000 7fa17c8cf640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1580664d0 0x7fa158068990 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa170001650 tx=0x7fa170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:56.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.235+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1780b2090 con 0x7fa1780cf080 2023-11-04T01:47:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.423+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1780b2090 con 0x7fa1780cf080 2023-11-04T01:47:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.423+0000 7fa1757fa640 1 -- 172.21.15.40:0/243062233 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4928 (secure 0 0 0) 0x7fa1780b2090 con 0x7fa1780cf080 2023-11-04T01:47:56.428 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:56.429 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:54.123797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 120 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1580664d0 msgr2=0x7fa158068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1580664d0 0x7fa158068990 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa170001650 tx=0x7fa170009040 comp rx=0 tx=0).stop 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 msgr2=0x7fa178158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 0x7fa178158190 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa16000e810 tx=0x7fa16000ecd0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 shutdown_connections 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa1580664d0 0x7fa158068990 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa17815d130 0x7fa178159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1780cf080 0x7fa178158190 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 --2- 172.21.15.40:0/243062233 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa1780c9af0 0x7fa1780b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 >> 172.21.15.40:0/243062233 conn(0x7fa1780b1050 msgr2=0x7fa178070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 shutdown_connections 2023-11-04T01:47:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.427+0000 7fa17eb33640 1 -- 172.21.15.40:0/243062233 wait complete. 2023-11-04T01:47:56.448 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:47:56.448 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.764333724975586s 2023-11-04T01:47:56.448 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:56.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:56.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:47:56.462 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:47:56.463 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:56.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:47:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 Processor -- start 2023-11-04T01:47:56.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 -- start start 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f943c160680 0x7f943c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f943c160a60 0x7f943c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c0b3e30 0x7f943c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0ceb60 con 0x7f943c160680 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0cf000 con 0x7f943c160a60 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f94433ef640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0b5de0 con 0x7f943c0b3e30 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f943c160680 0x7f943c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f943c160680 0x7f943c0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57186/0 (socket says 172.21.15.40:57186) 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 -- 172.21.15.40:0/1314043806 learned_addr learned my addr 172.21.15.40:0/1314043806 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944098a640 1 --2- 172.21.15.40:0/1314043806 >> v2:172.21.15.91:3300/0 conn(0x7f943c160a60 0x7f943c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944198c640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c0b3e30 0x7f943c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 -- 172.21.15.40:0/1314043806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c0b3e30 msgr2=0x7f943c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c0b3e30 0x7f943c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 -- 172.21.15.40:0/1314043806 >> v2:172.21.15.91:3300/0 conn(0x7f943c160a60 msgr2=0x7f943c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 --2- 172.21.15.40:0/1314043806 >> v2:172.21.15.91:3300/0 conn(0x7f943c160a60 0x7f943c0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944118b640 1 -- 172.21.15.40:0/1314043806 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0d1610 con 0x7f943c160680 2023-11-04T01:47:56.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.679+0000 7f944198c640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c0b3e30 0x7f943c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:56.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f944118b640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c0cdba0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f943c08bc00 tx=0x7f942c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7e5f2285397c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:56.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f943bfff640 1 -- 172.21.15.40:0/1314043806 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c0d09b0 con 0x7f943c160680 2023-11-04T01:47:56.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f943bfff640 1 -- 172.21.15.40:0/1314043806 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0a5820 con 0x7f943c160680 2023-11-04T01:47:56.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f943bfff640 1 -- 172.21.15.40:0/1314043806 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0a5bb0 con 0x7f943c160680 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 -- 172.21.15.40:0/1314043806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 msgr2=0x7f943c0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c0cdba0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f943c08bc00 tx=0x7f942c01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 -- 172.21.15.40:0/1314043806 shutdown_connections 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c0b3e30 0x7f943c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 --2- 172.21.15.40:0/1314043806 >> v2:172.21.15.91:3300/0 conn(0x7f943c160a60 0x7f943c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 --2- 172.21.15.40:0/1314043806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c0cdba0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 -- 172.21.15.40:0/1314043806 >> 172.21.15.40:0/1314043806 conn(0x7f943c0d2f90 msgr2=0x7f943c0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 -- 172.21.15.40:0/1314043806 shutdown_connections 2023-11-04T01:47:56.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 -- 172.21.15.40:0/1314043806 wait complete. 2023-11-04T01:47:56.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 Processor -- start 2023-11-04T01:47:56.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.683+0000 7f94433ef640 1 -- start start 2023-11-04T01:47:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f943c0b3e30 0x7f943c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c160a60 0x7f943c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c157890 con 0x7f943c160680 2023-11-04T01:47:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15e090 con 0x7f943c0b3e30 2023-11-04T01:47:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15e370 con 0x7f943c160a60 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57194/0 (socket says 172.21.15.40:57194) 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 -- 172.21.15.40:0/3222842145 learned_addr learned my addr 172.21.15.40:0/3222842145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944198c640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c160a60 0x7f943c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 -- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c160a60 msgr2=0x7f943c157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c160a60 0x7f943c157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944118b640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f943c0b3e30 0x7f943c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 -- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f943c0b3e30 msgr2=0x7f943c15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f943c0b3e30 0x7f943c15f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 -- 172.21.15.40:0/3222842145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009b30 con 0x7f943c160680 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944198c640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c160a60 0x7f943c157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944118b640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f943c0b3e30 0x7f943c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944098a640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c150340 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f943000d5f0 tx=0x7f943000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300125f0 con 0x7f943c160680 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430012750 con 0x7f943c160680 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c150880 con 0x7f943c160680 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430012ae0 con 0x7f943c160680 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c151cc0 con 0x7f943c160680 2023-11-04T01:47:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c157a00 con 0x7f943c160680 2023-11-04T01:47:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9430012c40 con 0x7f943c160680 2023-11-04T01:47:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f9439ffb640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94280664a0 0x7f9428068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f9430084b30 con 0x7f943c160680 2023-11-04T01:47:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.687+0000 7f944118b640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94280664a0 0x7f9428068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.691+0000 7f944118b640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94280664a0 0x7f9428068960 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f942c0ae000 tx=0x7f942c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:56.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.691+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9430051800 con 0x7f943c160680 2023-11-04T01:47:56.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.851+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f943c04e4a0 con 0x7f943c160680 2023-11-04T01:47:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f9439ffb640 1 -- 172.21.15.40:0/3222842145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+23278 (secure 0 0 0) 0x7f9430007380 con 0x7f943c160680 2023-11-04T01:47:56.858 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:47:56.858 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":112,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:47:53.084298+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/1658130781":"2023-11-04T02:47:52.686288+0000","172.21.15.91:6836/2209627414":"2023-11-05T01:47:44.960567+0000","192.168.0.1:0/2884841846":"2023-11-04T02:46:56.954663+0000","172.21.15.40:6835/3996815211":"2023-11-05T01:47:37.592112+0000","172.21.15.91:6836/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.91:6837/2209627414":"2023-11-05T01:47:44.960567+0000","172.21.15.40:6835/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6837/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.91:6836/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6833/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.40:6835/2918977483":"2023-11-05T01:45:57.090700+0000","172.21.15.40:6832/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.91:6837/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6832/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/3996815211":"2023-11-05T01:47:37.592112+0000","172.21.15.91:6837/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.40:6834/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6835/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6833/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6836/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.40:6834/2918977483":"2023-11-05T01:45:57.090700+0000","192.168.0.1:0/771372867":"2023-11-04T02:46:12.185534+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:47:56.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94280664a0 msgr2=0x7f9428068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94280664a0 0x7f9428068960 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f942c0ae000 tx=0x7f942c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:56.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 msgr2=0x7f943c150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c150340 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f943000d5f0 tx=0x7f943000dab0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 shutdown_connections 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f94280664a0 0x7f9428068960 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f943c160a60 0x7f943c157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943c160680 0x7f943c150340 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 --2- 172.21.15.40:0/3222842145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f943c0b3e30 0x7f943c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 >> 172.21.15.40:0/3222842145 conn(0x7f943c0d2f90 msgr2=0x7f943c0d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 shutdown_connections 2023-11-04T01:47:56.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:56.855+0000 7f94433ef640 1 -- 172.21.15.40:0/3222842145 wait complete. 2023-11-04T01:47:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:14.041287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:14.473992+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:47:56.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:47:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.003+0000 7f78b153d640 1 Processor -- start 2023-11-04T01:47:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.003+0000 7f78b153d640 1 -- start start 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78b153d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac0cd2d0 0x7f78ac0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78b153d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78ac070ef0 0x7f78ac0ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78b153d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac0ad8e0 con 0x7f78ac15d2f0 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78b153d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac0adbc0 con 0x7f78ac070ef0 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78b153d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0adea0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78ac070ef0 0x7f78ac0ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78ac070ef0 0x7f78ac0ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57206/0 (socket says 172.21.15.40:57206) 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 -- 172.21.15.40:0/1270156337 learned_addr learned my addr 172.21.15.40:0/1270156337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78aa7fc640 1 --2- 172.21.15.40:0/1270156337 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac0cd2d0 0x7f78ac0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 -- 172.21.15.40:0/1270156337 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac0cd2d0 msgr2=0x7f78ac0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:57.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 --2- 172.21.15.40:0/1270156337 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac0cd2d0 0x7f78ac0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 -- 172.21.15.40:0/1270156337 >> v1:172.21.15.91:6789/0 conn(0x7f78ac15d2f0 legacy=0x7f78ac0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 -- 172.21.15.40:0/1270156337 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0ae180 con 0x7f78ac070ef0 2023-11-04T01:47:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78ab7fe640 1 --2- 172.21.15.40:0/1270156337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac070ef0 0x7f78ac0ae5c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7faa9b733516393 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78a9ffb640 1 -- 172.21.15.40:0/1270156337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0a9620 con 0x7f78ac070ef0 2023-11-04T01:47:57.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78a9ffb640 1 -- 172.21.15.40:0/1270156337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c0a9780 con 0x7f78ac070ef0 2023-11-04T01:47:57.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.007+0000 7f78a9ffb640 1 -- 172.21.15.40:0/1270156337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0a9b10 con 0x7f78ac070ef0 2023-11-04T01:47:57.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/1270156337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac070ef0 msgr2=0x7f78ac0ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 --2- 172.21.15.40:0/1270156337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac070ef0 0x7f78ac0ae5c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f789c009870 tx=0x7f789c01c540 comp rx=0 tx=0).stop 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/1270156337 shutdown_connections 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 --2- 172.21.15.40:0/1270156337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac070ef0 0x7f78ac0ae5c0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 --2- 172.21.15.40:0/1270156337 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac0cd2d0 0x7f78ac0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/1270156337 >> 172.21.15.40:0/1270156337 conn(0x7f78ac0ced10 msgr2=0x7f78ac0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/1270156337 shutdown_connections 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/1270156337 wait complete. 2023-11-04T01:47:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 Processor -- start 2023-11-04T01:47:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- start start 2023-11-04T01:47:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78ac070ef0 0x7f78ac158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 0x7f78ac0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac15d2f0 0x7f78ac0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0c6ae0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0c5f10 con 0x7f78ac070ef0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0c61b0 con 0x7f78ac15d2f0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 0x7f78ac0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 0x7f78ac0c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57216/0 (socket says 172.21.15.40:57216) 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 -- 172.21.15.40:0/4056750651 learned_addr learned my addr 172.21.15.40:0/4056750651 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aaffd640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78ac070ef0 0x7f78ac158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78ab7fe640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac15d2f0 0x7f78ac0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 -- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac15d2f0 msgr2=0x7f78ac0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac15d2f0 0x7f78ac0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 -- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78ac070ef0 msgr2=0x7f78ac158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78ac070ef0 0x7f78ac158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 -- 172.21.15.40:0/4056750651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c0094d0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78ab7fe640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac15d2f0 0x7f78ac0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78aa7fc640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 0x7f78ac0c4ad0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007ec0 tx=0x7f78a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0014620 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a00147a0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac0c6490 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0014b50 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.011+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac158860 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.015+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac0c6c90 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.015+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78a0014cb0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.015+0000 7f78937fe640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f78980664d0 0x7f7898068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.015+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f78a0085c20 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.015+0000 7f78aaffd640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f78980664d0 0x7f7898068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.019+0000 7f78aaffd640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f78980664d0 0x7f7898068990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0b03f0 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.019+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78a00529d0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.175+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78ac04e4a0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.175+0000 7f78937fe640 1 -- 172.21.15.40:0/4056750651 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78a0055ff0 con 0x7f78ac0cd2d0 2023-11-04T01:47:57.180 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:47:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f78980664d0 msgr2=0x7f7898068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f78980664d0 0x7f7898068990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0b03f0 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2023-11-04T01:47:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 msgr2=0x7f78ac0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 0x7f78ac0c4ad0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007ec0 tx=0x7f78a000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 shutdown_connections 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f78980664d0 0x7f7898068990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78ac15d2f0 0x7f78ac0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78ac0cd2d0 0x7f78ac0c4ad0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 --2- 172.21.15.40:0/4056750651 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78ac070ef0 0x7f78ac158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 >> 172.21.15.40:0/4056750651 conn(0x7f78ac0ced10 msgr2=0x7f78ac159600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 shutdown_connections 2023-11-04T01:47:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.179+0000 7f78b153d640 1 -- 172.21.15.40:0/4056750651 wait complete. 2023-11-04T01:47:57.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:47:57.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 Processor -- start 2023-11-04T01:47:57.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 -- start start 2023-11-04T01:47:57.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15d415d1c0 0x7f15d40d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d40d1cb0 0x7f15d40b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40d09b0 con 0x7f15d415d5a0 2023-11-04T01:47:57.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40d0110 con 0x7f15d415d1c0 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15db687640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40d03f0 con 0x7f15d40d1cb0 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9423640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15d415d1c0 0x7f15d40d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d8c22640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f15d415d5a0 0x7f15d40d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37166/0 (socket says 172.21.15.40:37166) 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d8c22640 1 -- 172.21.15.40:0/1743462436 learned_addr learned my addr 172.21.15.40:0/1743462436 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9c24640 1 --2- 172.21.15.40:0/1743462436 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d40d1cb0 0x7f15d40b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9423640 1 -- 172.21.15.40:0/1743462436 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d40d1cb0 msgr2=0x7f15d40b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9423640 1 --2- 172.21.15.40:0/1743462436 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d40d1cb0 0x7f15d40b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9423640 1 -- 172.21.15.40:0/1743462436 >> v1:172.21.15.40:6789/0 conn(0x7f15d415d5a0 legacy=0x7f15d40d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9423640 1 -- 172.21.15.40:0/1743462436 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40d06d0 con 0x7f15d415d1c0 2023-11-04T01:47:57.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.311+0000 7f15d9423640 1 --2- 172.21.15.40:0/1743462436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d1c0 0x7f15d40d3ae0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f15d00097c0 tx=0x7f15d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7439329ce125cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15cbfff640 1 -- 172.21.15.40:0/1743462436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d00a7070 con 0x7f15d415d1c0 2023-11-04T01:47:57.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15cbfff640 1 -- 172.21.15.40:0/1743462436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d00ab430 con 0x7f15d415d1c0 2023-11-04T01:47:57.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15cbfff640 1 -- 172.21.15.40:0/1743462436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d00ab7c0 con 0x7f15d415d1c0 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/1743462436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d1c0 msgr2=0x7f15d40d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 --2- 172.21.15.40:0/1743462436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d1c0 0x7f15d40d3ae0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f15d00097c0 tx=0x7f15d001c450 comp rx=0 tx=0).stop 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/1743462436 shutdown_connections 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 --2- 172.21.15.40:0/1743462436 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d40d1cb0 0x7f15d40b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 --2- 172.21.15.40:0/1743462436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d1c0 0x7f15d40d3ae0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/1743462436 >> 172.21.15.40:0/1743462436 conn(0x7f15d40d2fc0 msgr2=0x7f15d40d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/1743462436 shutdown_connections 2023-11-04T01:47:57.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/1743462436 wait complete. 2023-11-04T01:47:57.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 Processor -- start 2023-11-04T01:47:57.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- start start 2023-11-04T01:47:57.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15d40d1cb0 0x7f15d40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d415d1c0 0x7f15d4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 0x7f15d41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40b85e0 con 0x7f15d415d5a0 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41551d0 con 0x7f15d40d1cb0 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40b8300 con 0x7f15d415d1c0 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 0x7f15d41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 0x7f15d41561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40340/0 (socket says 172.21.15.40:40340) 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 -- 172.21.15.40:0/333043726 learned_addr learned my addr 172.21.15.40:0/333043726 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 -- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d415d1c0 msgr2=0x7f15d4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d415d1c0 0x7f15d4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 -- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15d40d1cb0 msgr2=0x7f15d40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15d40d1cb0 0x7f15d40c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 -- 172.21.15.40:0/333043726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009420 con 0x7f15d415d5a0 2023-11-04T01:47:57.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15d9c24640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 0x7f15d41561c0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00cd60 tx=0x7f15cc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc003ba0 con 0x7f15d415d5a0 2023-11-04T01:47:57.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc003d20 con 0x7f15d415d5a0 2023-11-04T01:47:57.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc004260 con 0x7f15d415d5a0 2023-11-04T01:47:57.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d40b2e00 con 0x7f15d415d5a0 2023-11-04T01:47:57.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.315+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d40b33c0 con 0x7f15d415d5a0 2023-11-04T01:47:57.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.319+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d40b2c60 con 0x7f15d415d5a0 2023-11-04T01:47:57.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.319+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15cc0043c0 con 0x7f15d415d5a0 2023-11-04T01:47:57.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.319+0000 7f15c9ffb640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15b80664a0 0x7f15b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.319+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f15cc012070 con 0x7f15d415d5a0 2023-11-04T01:47:57.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.319+0000 7f15d9423640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15b80664a0 0x7f15b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.319+0000 7f15d9423640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15b80664a0 0x7f15b8068960 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f15d00af000 tx=0x7f15d0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.323+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15d40b2c60 con 0x7f15d415d5a0 2023-11-04T01:47:57.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f15d40b2c60 con 0x7f15d415d5a0 2023-11-04T01:47:57.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15c9ffb640 1 -- 172.21.15.40:0/333043726 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7f15d40b2c60 con 0x7f15d415d5a0 2023-11-04T01:47:57.474 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15b80664a0 msgr2=0x7f15b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15b80664a0 0x7f15b8068960 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f15d00af000 tx=0x7f15d0004740 comp rx=0 tx=0).stop 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 msgr2=0x7f15d41561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 0x7f15d41561c0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00cd60 tx=0x7f15cc00a660 comp rx=0 tx=0).stop 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 shutdown_connections 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f15b80664a0 0x7f15b8068960 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d415d5a0 0x7f15d41561c0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f15d415d1c0 0x7f15d4155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 --2- 172.21.15.40:0/333043726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f15d40d1cb0 0x7f15d40c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.471+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 >> 172.21.15.40:0/333043726 conn(0x7f15d40d2fc0 msgr2=0x7f15d415c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.475+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 shutdown_connections 2023-11-04T01:47:57.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.475+0000 7f15db687640 1 -- 172.21.15.40:0/333043726 wait complete. 2023-11-04T01:47:57.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:47:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 Processor -- start 2023-11-04T01:47:57.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 -- start start 2023-11-04T01:47:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f022815d410 0x7f02280b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f02280caaa0 0x7f02280c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02280ce290 con 0x7f02280c98a0 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022806fe50 con 0x7f022815d410 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f0230376640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02280aef20 con 0x7f02280caaa0 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e913640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f02280c98a0 0x7f0228070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37174/0 (socket says 172.21.15.40:37174) 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e913640 1 -- 172.21.15.40:0/1030936842 learned_addr learned my addr 172.21.15.40:0/1030936842 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e112640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f022815d410 0x7f02280b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022d911640 1 --2- 172.21.15.40:0/1030936842 >> v2:172.21.15.91:3300/0 conn(0x7f02280caaa0 0x7f02280c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e112640 1 -- 172.21.15.40:0/1030936842 >> v2:172.21.15.91:3300/0 conn(0x7f02280caaa0 msgr2=0x7f02280c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e112640 1 --2- 172.21.15.40:0/1030936842 >> v2:172.21.15.91:3300/0 conn(0x7f02280caaa0 0x7f02280c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e112640 1 -- 172.21.15.40:0/1030936842 >> v1:172.21.15.40:6789/0 conn(0x7f02280c98a0 legacy=0x7f0228070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.619+0000 7f022e112640 1 -- 172.21.15.40:0/1030936842 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280ccdf0 con 0x7f022815d410 2023-11-04T01:47:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 --2- 172.21.15.40:0/1030936842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f022815d410 0x7f02280b0210 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f02280c5d70 tx=0x7f022401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906866532a8c6ca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022d110640 1 -- 172.21.15.40:0/1030936842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02240ab600 con 0x7f022815d410 2023-11-04T01:47:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022d110640 1 -- 172.21.15.40:0/1030936842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02240a7050 con 0x7f022815d410 2023-11-04T01:47:57.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022d110640 1 -- 172.21.15.40:0/1030936842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02240ab980 con 0x7f022815d410 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/1030936842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f022815d410 msgr2=0x7f02280b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 --2- 172.21.15.40:0/1030936842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f022815d410 0x7f02280b0210 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f02280c5d70 tx=0x7f022401c460 comp rx=0 tx=0).stop 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/1030936842 shutdown_connections 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 --2- 172.21.15.40:0/1030936842 >> v2:172.21.15.91:3300/0 conn(0x7f02280caaa0 0x7f02280c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 --2- 172.21.15.40:0/1030936842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f022815d410 0x7f02280b0210 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/1030936842 >> 172.21.15.40:0/1030936842 conn(0x7f02280ced10 msgr2=0x7f02280cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/1030936842 shutdown_connections 2023-11-04T01:47:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/1030936842 wait complete. 2023-11-04T01:47:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 Processor -- start 2023-11-04T01:47:57.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- start start 2023-11-04T01:47:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 0x7f02280adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280caaa0 0x7f02281589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f022815d410 0x7f02280af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022806dbd0 con 0x7f02280c98a0 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022814bce0 con 0x7f02280caaa0 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022814bfc0 con 0x7f022815d410 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 0x7f02280adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 0x7f02280adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40348/0 (socket says 172.21.15.40:40348) 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 -- 172.21.15.40:0/324118469 learned_addr learned my addr 172.21.15.40:0/324118469 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 -- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f022815d410 msgr2=0x7f02280af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f022815d410 0x7f02280af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 -- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280caaa0 msgr2=0x7f02281589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280caaa0 0x7f02281589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 -- 172.21.15.40:0/324118469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224009420 con 0x7f02280c98a0 2023-11-04T01:47:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f022e112640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 0x7f02280adc50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f02240ae040 tx=0x7f0224019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02240b4610 con 0x7f02280c98a0 2023-11-04T01:47:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02240b4770 con 0x7f02280c98a0 2023-11-04T01:47:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02240b4b20 con 0x7f02280c98a0 2023-11-04T01:47:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022814c2a0 con 0x7f02280c98a0 2023-11-04T01:47:57.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.623+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022814c860 con 0x7f02280c98a0 2023-11-04T01:47:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.627+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022814ca50 con 0x7f02280c98a0 2023-11-04T01:47:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.627+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02240b2040 con 0x7f02280c98a0 2023-11-04T01:47:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.627+0000 7f021effd640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f020c0664d0 0x7f020c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.627+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f022411e760 con 0x7f02280c98a0 2023-11-04T01:47:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.627+0000 7f022d911640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f020c0664d0 0x7f020c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.627+0000 7f022d911640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f020c0664d0 0x7f020c068990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f02281f9430 tx=0x7f0218008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.631+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02240eb310 con 0x7f02280c98a0 2023-11-04T01:47:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.791+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f022804e4a0 con 0x7f02280c98a0 2023-11-04T01:47:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.791+0000 7f021effd640 1 -- 172.21.15.40:0/324118469 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02240b0030 con 0x7f02280c98a0 2023-11-04T01:47:57.794 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.791+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f020c0664d0 msgr2=0x7f020c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.791+0000 7f0230376640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f020c0664d0 0x7f020c068990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f02281f9430 tx=0x7f0218008040 comp rx=0 tx=0).stop 2023-11-04T01:47:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.791+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 msgr2=0x7f02280adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.791+0000 7f0230376640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 0x7f02280adc50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f02240ae040 tx=0x7f0224019200 comp rx=0 tx=0).stop 2023-11-04T01:47:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 shutdown_connections 2023-11-04T01:47:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f020c0664d0 0x7f020c068990 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f022815d410 0x7f02280af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f02280caaa0 0x7f02281589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 --2- 172.21.15.40:0/324118469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02280c98a0 0x7f02280adc50 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 >> 172.21.15.40:0/324118469 conn(0x7f02280ced10 msgr2=0x7f02280b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 shutdown_connections 2023-11-04T01:47:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.795+0000 7f0230376640 1 -- 172.21.15.40:0/324118469 wait complete. 2023-11-04T01:47:57.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:47:57.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.927+0000 7f1cceeed640 1 Processor -- start 2023-11-04T01:47:57.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.927+0000 7f1cceeed640 1 -- start start 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.927+0000 7f1cceeed640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1cc815dae0 0x7f1cc815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cceeed640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 0x7f1cc80710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cceeed640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc815e530 con 0x7f1cc815aed0 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cceeed640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc8071600 con 0x7f1cc815dae0 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cceeed640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc806cca0 con 0x7f1cc8070c30 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 0x7f1cc80710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cc7fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1cc815dae0 0x7f1cc815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 0x7f1cc80710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:36448/0 (socket says 172.21.15.40:36448) 2023-11-04T01:47:57.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 -- 172.21.15.40:0/985270252 learned_addr learned my addr 172.21.15.40:0/985270252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:57.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 -- 172.21.15.40:0/985270252 >> v2:172.21.15.91:3300/0 conn(0x7f1cc815dae0 msgr2=0x7f1cc815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:57.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 --2- 172.21.15.40:0/985270252 >> v2:172.21.15.91:3300/0 conn(0x7f1cc815dae0 0x7f1cc815df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 -- 172.21.15.40:0/985270252 >> v1:172.21.15.91:6789/0 conn(0x7f1cc815aed0 legacy=0x7f1cc806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 -- 172.21.15.40:0/985270252 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc815e810 con 0x7f1cc8070c30 2023-11-04T01:47:57.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1ccd48a640 1 --2- 172.21.15.40:0/985270252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 0x7f1cc80710c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e93171cbb909c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cc77fe640 1 -- 172.21.15.40:0/985270252 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00a58a0 con 0x7f1cc8070c30 2023-11-04T01:47:57.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cc77fe640 1 -- 172.21.15.40:0/985270252 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00a5a00 con 0x7f1cc8070c30 2023-11-04T01:47:57.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cc77fe640 1 -- 172.21.15.40:0/985270252 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00a5d90 con 0x7f1cc8070c30 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cceeed640 1 -- 172.21.15.40:0/985270252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 msgr2=0x7f1cc80710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.931+0000 7f1cceeed640 1 --2- 172.21.15.40:0/985270252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 0x7f1cc80710c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009e50 tx=0x7f1cc001c9e0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/985270252 shutdown_connections 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 --2- 172.21.15.40:0/985270252 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc8070c30 0x7f1cc80710c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 --2- 172.21.15.40:0/985270252 >> v2:172.21.15.91:3300/0 conn(0x7f1cc815dae0 0x7f1cc815df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/985270252 >> 172.21.15.40:0/985270252 conn(0x7f1cc806b240 msgr2=0x7f1cc806b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/985270252 shutdown_connections 2023-11-04T01:47:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/985270252 wait complete. 2023-11-04T01:47:57.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 Processor -- start 2023-11-04T01:47:57.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- start start 2023-11-04T01:47:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cc8070c30 0x7f1cc81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc815aed0 0x7f1cc814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 0x7f1cc814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80b1460 con 0x7f1cc815dae0 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc814b970 con 0x7f1cc8070c30 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80b5600 con 0x7f1cc815aed0 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 0x7f1cc814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 0x7f1cc814d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40358/0 (socket says 172.21.15.40:40358) 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 -- 172.21.15.40:0/834882369 learned_addr learned my addr 172.21.15.40:0/834882369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cc7fff640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc815aed0 0x7f1cc814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cccc89640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cc8070c30 0x7f1cc81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 -- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc815aed0 msgr2=0x7f1cc814c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc815aed0 0x7f1cc814c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 -- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cc8070c30 msgr2=0x7f1cc81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cc8070c30 0x7f1cc81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 -- 172.21.15.40:0/834882369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009b30 con 0x7f1cc815dae0 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cc7fff640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc815aed0 0x7f1cc814c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1ccd48a640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 0x7f1cc814d2c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f1cc001a610 tx=0x7f1cc0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00b8670 con 0x7f1cc815dae0 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00b87d0 con 0x7f1cc815dae0 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc814bbc0 con 0x7f1cc815dae0 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00b8b80 con 0x7f1cc815dae0 2023-11-04T01:47:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc814c180 con 0x7f1cc815dae0 2023-11-04T01:47:57.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.935+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc814c370 con 0x7f1cc815dae0 2023-11-04T01:47:57.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.939+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1cc00b8ce0 con 0x7f1cc815dae0 2023-11-04T01:47:57.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.939+0000 7f1cc57fa640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1cac0664a0 0x7f1cac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:57.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.939+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f1cc011fe50 con 0x7f1cc815dae0 2023-11-04T01:47:57.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.939+0000 7f1cccc89640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1cac0664a0 0x7f1cac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:57.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.939+0000 7f1cccc89640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1cac0664a0 0x7f1cac068960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc000f70 tx=0x7f1cbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:57.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:57.943+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1cc00ecbd0 con 0x7f1cc815dae0 2023-11-04T01:47:58.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:58.011 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:58.031 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:47:58.027+0000 7f2b84ff9640 -1 client.8352 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:47:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.091+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f1cc80b5cf0 con 0x7f1cc815dae0 2023-11-04T01:47:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.091+0000 7f1cc57fa640 1 -- 172.21.15.40:0/834882369 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v112) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1cc00f01f0 con 0x7f1cc815dae0 2023-11-04T01:47:58.097 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1cac0664a0 msgr2=0x7f1cac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1cac0664a0 0x7f1cac068960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc000f70 tx=0x7f1cbc009040 comp rx=0 tx=0).stop 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 msgr2=0x7f1cc814d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 0x7f1cc814d2c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f1cc001a610 tx=0x7f1cc0019780 comp rx=0 tx=0).stop 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 shutdown_connections 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f1cac0664a0 0x7f1cac068960 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc815dae0 0x7f1cc814d2c0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f1cc815aed0 0x7f1cc814c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 --2- 172.21.15.40:0/834882369 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1cc8070c30 0x7f1cc81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 >> 172.21.15.40:0/834882369 conn(0x7f1cc806b240 msgr2=0x7f1cc80ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 shutdown_connections 2023-11-04T01:47:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.095+0000 7f1cceeed640 1 -- 172.21.15.40:0/834882369 wait complete. 2023-11-04T01:47:58.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:47:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f13a5bb2640 1 Processor -- start 2023-11-04T01:47:58.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f13a5bb2640 1 -- start start 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f13a5bb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 0x7f13a00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f13a5bb2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00ccdf0 con 0x7f13a00caaa0 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f13a5bb2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00b0750 con 0x7f13a00c9a70 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f13a5bb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a006fe50 con 0x7f13a015d410 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f13a00caaa0 0x7f13a00c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37188/0 (socket says 172.21.15.40:37188) 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139effd640 1 -- 172.21.15.40:0/3002623489 learned_addr learned my addr 172.21.15.40:0/3002623489 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139f7fe640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 0x7f13a00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706485742 0 0) 0x7f13a00ccdf0 con 0x7f13a00caaa0 2023-11-04T01:47:58.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f138c003530 con 0x7f13a00caaa0 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3587812989 0 0) 0x7f138c003530 con 0x7f13a00caaa0 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 msgr2=0x7f13a00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 0x7f13a00b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 >> v1:172.21.15.91:6789/0 conn(0x7f13a00c9a70 legacy=0x7f13a00cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00ae960 con 0x7f13a00caaa0 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f1388001a00 con 0x7f13a00caaa0 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 >> v1:172.21.15.40:6789/0 conn(0x7f13a00caaa0 legacy=0x7f13a00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f138c0039b0 0x7f138c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 0x7f138c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138c004d10 0x7f138c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c00b990 con 0x7f138c004d10 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c00bad0 con 0x7f138c0039b0 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c00bc90 con 0x7f13a015d410 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139ffff640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138c004d10 0x7f138c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139f7fe640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f138c0039b0 0x7f138c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139effd640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 0x7f138c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139ffff640 1 -- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 msgr2=0x7f138c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139ffff640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13a015d410 0x7f138c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139ffff640 1 -- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f138c0039b0 msgr2=0x7f138c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139ffff640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f138c0039b0 0x7f138c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.291+0000 7f139ffff640 1 -- 172.21.15.40:0/3002623489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c003530 con 0x7f138c004d10 2023-11-04T01:47:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f139ffff640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138c004d10 0x7f138c005190 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f13a00c5d90 tx=0x7f139801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbec753872592d7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980ab600 con 0x7f138c004d10 2023-11-04T01:47:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980a7050 con 0x7f138c004d10 2023-11-04T01:47:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f139e7fc640 1 -- 172.21.15.40:0/3002623489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980ab9a0 con 0x7f138c004d10 2023-11-04T01:47:58.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 -- 172.21.15.40:0/3002623489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138c004d10 msgr2=0x7f138c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/3002623489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138c004d10 0x7f138c005190 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f13a00c5d90 tx=0x7f139801c4a0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f139ffff640 1 -- 172.21.15.40:0/3002623489 reap_dead start 2023-11-04T01:47:58.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 -- 172.21.15.40:0/3002623489 shutdown_connections 2023-11-04T01:47:58.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 -- 172.21.15.40:0/3002623489 >> 172.21.15.40:0/3002623489 conn(0x7f13a00ced10 msgr2=0x7f13a00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:58.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 -- 172.21.15.40:0/3002623489 shutdown_connections 2023-11-04T01:47:58.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 -- 172.21.15.40:0/3002623489 wait complete. 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 Processor -- start 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.295+0000 7f13a5bb2640 1 -- start start 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f138c004d10 0x7f13a00c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 0x7f13a01f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a00af890 0x7f13a01f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a014e8f0 con 0x7f13a00af410 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01f6960 con 0x7f13a00af890 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01f6680 con 0x7f138c004d10 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 0x7f13a01f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 0x7f13a01f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40376/0 (socket says 172.21.15.40:40376) 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 -- 172.21.15.40:0/1699469674 learned_addr learned my addr 172.21.15.40:0/1699469674 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:58.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139f7fe640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f138c004d10 0x7f13a00c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139ffff640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a00af890 0x7f13a01f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 -- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f138c004d10 msgr2=0x7f13a00c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f138c004d10 0x7f13a00c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 -- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a00af890 msgr2=0x7f13a01f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a00af890 0x7f13a01f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 -- 172.21.15.40:0/1699469674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00c7f70 con 0x7f13a00af410 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139f7fe640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f138c004d10 0x7f13a00c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f139effd640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 0x7f13a01f5a70 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f13880013e0 tx=0x7f1388011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800fc20 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138800fda0 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a00c8250 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388015650 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a00c5de0 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a00c7dd0 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13880157b0 con 0x7f13a00af410 2023-11-04T01:47:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f1397fff640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13800664a0 0x7f1380068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.299+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f1388087ae0 con 0x7f13a00af410 2023-11-04T01:47:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.303+0000 7f139f7fe640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13800664a0 0x7f1380068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.303+0000 7f139f7fe640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13800664a0 0x7f1380068960 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1390009af0 tx=0x7f1390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.303+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13a00c7dd0 con 0x7f13a00af410 2023-11-04T01:47:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.459+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13a00c7dd0 con 0x7f13a00af410 2023-11-04T01:47:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.459+0000 7f1397fff640 1 -- 172.21.15.40:0/1699469674 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13a00c7dd0 con 0x7f13a00af410 2023-11-04T01:47:58.463 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13800664a0 msgr2=0x7f1380068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13800664a0 0x7f1380068960 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1390009af0 tx=0x7f1390008040 comp rx=0 tx=0).stop 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 msgr2=0x7f13a01f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 0x7f13a01f5a70 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f13880013e0 tx=0x7f1388011de0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 shutdown_connections 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f13800664a0 0x7f1380068960 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f13a00af890 0x7f13a01f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13a00af410 0x7f13a01f5a70 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 --2- 172.21.15.40:0/1699469674 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f138c004d10 0x7f13a00c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 >> 172.21.15.40:0/1699469674 conn(0x7f13a00ced10 msgr2=0x7f13a00ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 shutdown_connections 2023-11-04T01:47:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.463+0000 7f13a5bb2640 1 -- 172.21.15.40:0/1699469674 wait complete. 2023-11-04T01:47:58.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:47:58.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 Processor -- start 2023-11-04T01:47:58.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 -- start start 2023-11-04T01:47:58.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc1556c0 0x7fc3fc15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3fc0cb050 0x7fc3fc0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc15c600 con 0x7fc3fc0cabd0 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0cb4e0 con 0x7fc3fc0cb050 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc40372f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc06fe50 con 0x7fc3fc1556c0 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc401ccc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3fc0cb050 0x7fc3fc0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc4014cb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc1556c0 0x7fc3fc15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc401ccc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3fc0cb050 0x7fc3fc0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40384/0 (socket says 172.21.15.40:40384) 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc401ccc640 1 -- 172.21.15.40:0/825302641 learned_addr learned my addr 172.21.15.40:0/825302641 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.595+0000 7fc4014cb640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc1556c0 0x7fc3fc15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:36494/0 (socket says 172.21.15.40:36494) 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc401ccc640 1 -- 172.21.15.40:0/825302641 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc1556c0 msgr2=0x7fc3fc15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc401ccc640 1 --2- 172.21.15.40:0/825302641 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc1556c0 0x7fc3fc15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc401ccc640 1 -- 172.21.15.40:0/825302641 >> v1:172.21.15.91:6789/0 conn(0x7fc3fc0cabd0 legacy=0x7fc3fc0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc401ccc640 1 -- 172.21.15.40:0/825302641 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0ae7f0 con 0x7fc3fc0cb050 2023-11-04T01:47:58.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc401ccc640 1 --2- 172.21.15.40:0/825302641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc0cb050 0x7fc3fc0c9a70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009870 tx=0x7fc3ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce16cd223d9315b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc3fbfff640 1 -- 172.21.15.40:0/825302641 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0aa670 con 0x7fc3fc0cb050 2023-11-04T01:47:58.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc3fbfff640 1 -- 172.21.15.40:0/825302641 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0aa7d0 con 0x7fc3fc0cb050 2023-11-04T01:47:58.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc3fbfff640 1 -- 172.21.15.40:0/825302641 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0aab60 con 0x7fc3fc0cb050 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 -- 172.21.15.40:0/825302641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc0cb050 msgr2=0x7fc3fc0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 --2- 172.21.15.40:0/825302641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc0cb050 0x7fc3fc0c9a70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009870 tx=0x7fc3ec01c510 comp rx=0 tx=0).stop 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 -- 172.21.15.40:0/825302641 shutdown_connections 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 --2- 172.21.15.40:0/825302641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc0cb050 0x7fc3fc0c9a70 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 --2- 172.21.15.40:0/825302641 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc1556c0 0x7fc3fc15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 -- 172.21.15.40:0/825302641 >> 172.21.15.40:0/825302641 conn(0x7fc3fc0ced10 msgr2=0x7fc3fc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 -- 172.21.15.40:0/825302641 shutdown_connections 2023-11-04T01:47:58.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.599+0000 7fc40372f640 1 -- 172.21.15.40:0/825302641 wait complete. 2023-11-04T01:47:58.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 Processor -- start 2023-11-04T01:47:58.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 -- start start 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0cabd0 0x7fc3fc0c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc0cb050 0x7fc3fc147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 0x7fc3fc14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc147980 con 0x7fc3fc1556c0 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc0c24c0 con 0x7fc3fc0cabd0 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc146d00 con 0x7fc3fc0cb050 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 0x7fc3fc14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 0x7fc3fc14d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40394/0 (socket says 172.21.15.40:40394) 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 -- 172.21.15.40:0/3113864599 learned_addr learned my addr 172.21.15.40:0/3113864599 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:58.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc400cca640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc0cb050 0x7fc3fc147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc4014cb640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0cabd0 0x7fc3fc0c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 -- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc0cb050 msgr2=0x7fc3fc147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc0cb050 0x7fc3fc147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 -- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0cabd0 msgr2=0x7fc3fc0c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0cabd0 0x7fc3fc0c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 -- 172.21.15.40:0/3113864599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0094d0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc401ccc640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 0x7fc3fc14d600 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0ac040 tx=0x7fc3ec01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0b3800 con 0x7fc3fc1556c0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0b3980 con 0x7fc3fc1556c0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc146fe0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0b3d30 con 0x7fc3fc1556c0 2023-11-04T01:47:58.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.603+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc1475a0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.607+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc147ac0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.607+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3ec0c6390 con 0x7fc3fc1556c0 2023-11-04T01:47:58.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.607+0000 7fc3f9ffb640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3e80664d0 0x7fc3e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.607+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7fc3ec11f340 con 0x7fc3fc1556c0 2023-11-04T01:47:58.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.607+0000 7fc4014cb640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3e80664d0 0x7fc3e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.607+0000 7fc4014cb640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3e80664d0 0x7fc3e8068990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40074a0 tx=0x7fc3f400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.611+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3fc147ac0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.759+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3fc147ac0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.759+0000 7fc3f9ffb640 1 -- 172.21.15.40:0/3113864599 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3fc147ac0 con 0x7fc3fc1556c0 2023-11-04T01:47:58.765 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3e80664d0 msgr2=0x7fc3e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3e80664d0 0x7fc3e8068990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40074a0 tx=0x7fc3f400b040 comp rx=0 tx=0).stop 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 msgr2=0x7fc3fc14d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 0x7fc3fc14d600 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0ac040 tx=0x7fc3ec01ad50 comp rx=0 tx=0).stop 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 shutdown_connections 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc3e80664d0 0x7fc3e8068990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3fc1556c0 0x7fc3fc14d600 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc3fc0cb050 0x7fc3fc147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 --2- 172.21.15.40:0/3113864599 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc3fc0cabd0 0x7fc3fc0c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 >> 172.21.15.40:0/3113864599 conn(0x7fc3fc0ced10 msgr2=0x7fc3fc0cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:58.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 shutdown_connections 2023-11-04T01:47:58.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.763+0000 7fc40372f640 1 -- 172.21.15.40:0/3113864599 wait complete. 2023-11-04T01:47:58.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:47:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 Processor -- start 2023-11-04T01:47:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 -- start start 2023-11-04T01:47:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78bc15d130 0x7f78bc161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0cf080 0x7f78bc0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc070310 con 0x7f78bc0c9af0 2023-11-04T01:47:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc161c70 con 0x7f78bc15d130 2023-11-04T01:47:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78c0bb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc06a1d0 con 0x7f78bc0cf080 2023-11-04T01:47:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78ba59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78bc15d130 0x7f78bc161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78b9d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f78bc0c9af0 0x7f78bc0ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37194/0 (socket says 172.21.15.40:37194) 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78b9d9b640 1 -- 172.21.15.40:0/4242536049 learned_addr learned my addr 172.21.15.40:0/4242536049 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78ba59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78bc15d130 0x7f78bc161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40402/0 (socket says 172.21.15.40:40402) 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78bad9d640 1 --2- 172.21.15.40:0/4242536049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0cf080 0x7f78bc0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78ba59c640 1 -- 172.21.15.40:0/4242536049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0cf080 msgr2=0x7f78bc0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78ba59c640 1 --2- 172.21.15.40:0/4242536049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0cf080 0x7f78bc0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78ba59c640 1 -- 172.21.15.40:0/4242536049 >> v1:172.21.15.40:6789/0 conn(0x7f78bc0c9af0 legacy=0x7f78bc0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78ba59c640 1 -- 172.21.15.40:0/4242536049 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc06a4b0 con 0x7f78bc15d130 2023-11-04T01:47:58.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.899+0000 7f78b959a640 1 -- 172.21.15.40:0/4242536049 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408629778 0 0) 0x7f78bc070310 con 0x7f78bc0c9af0 2023-11-04T01:47:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78ba59c640 1 --2- 172.21.15.40:0/4242536049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc161730 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0097c0 tx=0x7f78ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebfdcf351898b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78b959a640 1 -- 172.21.15.40:0/4242536049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0ab650 con 0x7f78bc15d130 2023-11-04T01:47:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78b959a640 1 -- 172.21.15.40:0/4242536049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0ab7b0 con 0x7f78bc15d130 2023-11-04T01:47:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78b959a640 1 -- 172.21.15.40:0/4242536049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0abb40 con 0x7f78bc15d130 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4242536049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 msgr2=0x7f78bc161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4242536049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc161730 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0097c0 tx=0x7f78ac01c450 comp rx=0 tx=0).stop 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4242536049 shutdown_connections 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4242536049 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0cf080 0x7f78bc0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4242536049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc161730 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4242536049 >> 172.21.15.40:0/4242536049 conn(0x7f78bc0b1050 msgr2=0x7f78bc0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4242536049 shutdown_connections 2023-11-04T01:47:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.903+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4242536049 wait complete. 2023-11-04T01:47:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 Processor -- start 2023-11-04T01:47:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- start start 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0c9af0 0x7f78bc0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc0cf080 0x7f78bc145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0b2890 con 0x7f78bc15d130 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15e420 con 0x7f78bc0cf080 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc15d810 con 0x7f78bc0c9af0 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40408/0 (socket says 172.21.15.40:40408) 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 -- 172.21.15.40:0/4164939359 learned_addr learned my addr 172.21.15.40:0/4164939359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78ba59c640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0c9af0 0x7f78bc0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78b9d9b640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc0cf080 0x7f78bc145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 -- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0c9af0 msgr2=0x7f78bc0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0c9af0 0x7f78bc0b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 -- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc0cf080 msgr2=0x7f78bc145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc0cf080 0x7f78bc145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 -- 172.21.15.40:0/4164939359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009420 con 0x7f78bc15d130 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78bad9d640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc070cb0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007e70 tx=0x7f78b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4014620 con 0x7f78bc15d130 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b40147a0 con 0x7f78bc15d130 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc15daf0 con 0x7f78bc15d130 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4014b50 con 0x7f78bc15d130 2023-11-04T01:47:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc15e0b0 con 0x7f78bc15d130 2023-11-04T01:47:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc15e5b0 con 0x7f78bc15d130 2023-11-04T01:47:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.907+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78b4014cb0 con 0x7f78bc15d130 2023-11-04T01:47:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.911+0000 7f78aaffd640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f789c0664a0 0x7f789c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.911+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f78b40850d0 con 0x7f78bc15d130 2023-11-04T01:47:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.911+0000 7f78ba59c640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f789c0664a0 0x7f789c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:58.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.911+0000 7f78ba59c640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f789c0664a0 0x7f789c068960 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0af000 tx=0x7f78ac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:58.915+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78b4051d10 con 0x7f78bc15d130 2023-11-04T01:47:59.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.083+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78bc0aea90 con 0x7f78bc15d130 2023-11-04T01:47:59.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.083+0000 7f78aaffd640 1 -- 172.21.15.40:0/4164939359 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v112) v1 ==== 81+0+1384 (secure 0 0 0) 0x7f78b4055330 con 0x7f78bc15d130 2023-11-04T01:47:59.087 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/1658130781 2023-11-04T02:47:52.686288+0000 2023-11-04T01:47:59.087 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2209627414 2023-11-05T01:47:44.960567+0000 2023-11-04T01:47:59.087 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/2884841846 2023-11-04T02:46:56.954663+0000 2023-11-04T01:47:59.087 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/3996815211 2023-11-05T01:47:37.592112+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2209627414 2023-11-05T01:47:44.960567+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:47:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/3996815211 2023-11-05T01:47:37.592112+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:47:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/771372867 2023-11-04T02:46:12.185534+0000 2023-11-04T01:47:59.090 INFO:teuthology.orchestra.run.smithi040.stderr:listed 23 entries 2023-11-04T01:47:59.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f789c0664a0 msgr2=0x7f789c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f789c0664a0 0x7f789c068960 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0af000 tx=0x7f78ac0a7000 comp rx=0 tx=0).stop 2023-11-04T01:47:59.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 msgr2=0x7f78bc070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc070cb0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007e70 tx=0x7f78b400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 shutdown_connections 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f789c0664a0 0x7f789c068960 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78bc15d130 0x7f78bc070cb0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f78bc0cf080 0x7f78bc145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 --2- 172.21.15.40:0/4164939359 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f78bc0c9af0 0x7f78bc0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 >> 172.21.15.40:0/4164939359 conn(0x7f78bc0b1050 msgr2=0x7f78bc0b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 shutdown_connections 2023-11-04T01:47:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.087+0000 7f78c0bb2640 1 -- 172.21.15.40:0/4164939359 wait complete. 2023-11-04T01:47:59.104 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:47:59.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:59.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[60024]: fuse finished with error 0 and tester_r 0 2023-11-04T01:47:59.118 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:47:59.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.118 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:47:59.165 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:47:59.165 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:59.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:47:59.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:47:59.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.379+0000 7fb12a0f6640 1 Processor -- start 2023-11-04T01:47:59.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.379+0000 7fb12a0f6640 1 -- start start 2023-11-04T01:47:59.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb12415cf80 0x7fb1240ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1240ae200 0x7fb1240cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1240c4910 con 0x7fb1240add70 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12406bbf0 con 0x7fb1240ae200 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12415da70 con 0x7fb12415cf80 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb123fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1240ae200 0x7fb1240cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb122ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb1240add70 0x7fb12415d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37208/0 (socket says 172.21.15.40:37208) 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb122ffd640 1 -- 172.21.15.40:0/840154205 learned_addr learned my addr 172.21.15.40:0/840154205 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb1237fe640 1 --2- 172.21.15.40:0/840154205 >> v2:172.21.15.91:3300/0 conn(0x7fb12415cf80 0x7fb1240ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb123fff640 1 -- 172.21.15.40:0/840154205 >> v2:172.21.15.91:3300/0 conn(0x7fb12415cf80 msgr2=0x7fb1240ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:59.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb123fff640 1 --2- 172.21.15.40:0/840154205 >> v2:172.21.15.91:3300/0 conn(0x7fb12415cf80 0x7fb1240ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb123fff640 1 -- 172.21.15.40:0/840154205 >> v1:172.21.15.40:6789/0 conn(0x7fb1240add70 legacy=0x7fb12415d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb123fff640 1 -- 172.21.15.40:0/840154205 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12415dcf0 con 0x7fb1240ae200 2023-11-04T01:47:59.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb1227fc640 1 -- 172.21.15.40:0/840154205 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876782808 0 0) 0x7fb1240c4910 con 0x7fb1240add70 2023-11-04T01:47:59.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb123fff640 1 --2- 172.21.15.40:0/840154205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1240ae200 0x7fb1240cb600 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fb12406dcf0 tx=0x7fb11c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dc1431c7f4c705 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb1227fc640 1 -- 172.21.15.40:0/840154205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0a5820 con 0x7fb1240ae200 2023-11-04T01:47:59.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb1227fc640 1 -- 172.21.15.40:0/840154205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0a5980 con 0x7fb1240ae200 2023-11-04T01:47:59.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb1227fc640 1 -- 172.21.15.40:0/840154205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0a5d10 con 0x7fb1240ae200 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- 172.21.15.40:0/840154205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1240ae200 msgr2=0x7fb1240cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/840154205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1240ae200 0x7fb1240cb600 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fb12406dcf0 tx=0x7fb11c01c850 comp rx=0 tx=0).stop 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- 172.21.15.40:0/840154205 shutdown_connections 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/840154205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1240ae200 0x7fb1240cb600 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/840154205 >> v2:172.21.15.91:3300/0 conn(0x7fb12415cf80 0x7fb1240ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- 172.21.15.40:0/840154205 >> 172.21.15.40:0/840154205 conn(0x7fb1240b0890 msgr2=0x7fb1240b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- 172.21.15.40:0/840154205 shutdown_connections 2023-11-04T01:47:59.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.383+0000 7fb12a0f6640 1 -- 172.21.15.40:0/840154205 wait complete. 2023-11-04T01:47:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 Processor -- start 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- start start 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1240add70 0x7fb124142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1240ae200 0x7fb124142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 0x7fb124142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1240c60e0 con 0x7fb12415cf80 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124142570 con 0x7fb1240ae200 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb124143430 con 0x7fb1240add70 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 0x7fb124142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 0x7fb124142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40424/0 (socket says 172.21.15.40:40424) 2023-11-04T01:47:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 -- 172.21.15.40:0/2542754834 learned_addr learned my addr 172.21.15.40:0/2542754834 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb1237fe640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1240add70 0x7fb124142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb122ffd640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1240ae200 0x7fb124142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 -- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1240add70 msgr2=0x7fb124142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1240add70 0x7fb124142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 -- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1240ae200 msgr2=0x7fb124142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1240ae200 0x7fb124142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 -- 172.21.15.40:0/2542754834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009a70 con 0x7fb12415cf80 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb1237fe640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1240add70 0x7fb124142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:59.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb122ffd640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1240ae200 0x7fb124142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb123fff640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 0x7fb124142d60 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fb11c01a480 tx=0x7fb11c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0b9860 con 0x7fb12415cf80 2023-11-04T01:47:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0b99c0 con 0x7fb12415cf80 2023-11-04T01:47:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124143710 con 0x7fb12415cf80 2023-11-04T01:47:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0b9d70 con 0x7fb12415cf80 2023-11-04T01:47:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124143cd0 con 0x7fb12415cf80 2023-11-04T01:47:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.387+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12404e4a0 con 0x7fb12415cf80 2023-11-04T01:47:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.391+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb11c0ad440 con 0x7fb12415cf80 2023-11-04T01:47:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.391+0000 7fb10bfff640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1100664a0 0x7fb110068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.391+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7fb11c11fa90 con 0x7fb12415cf80 2023-11-04T01:47:59.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.391+0000 7fb1237fe640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1100664a0 0x7fb110068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.391+0000 7fb1237fe640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1100664a0 0x7fb110068960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb1240b4d30 tx=0x7fb114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.395+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb11c0ec7f0 con 0x7fb12415cf80 2023-11-04T01:47:59.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1240ce220 con 0x7fb12415cf80 2023-11-04T01:47:59.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb10bfff640 1 -- 172.21.15.40:0/2542754834 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v120) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb11c0b2060 con 0x7fb12415cf80 2023-11-04T01:47:59.589 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1100664a0 msgr2=0x7fb110068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1100664a0 0x7fb110068960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb1240b4d30 tx=0x7fb114008040 comp rx=0 tx=0).stop 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 msgr2=0x7fb124142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 0x7fb124142d60 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fb11c01a480 tx=0x7fb11c0195f0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 shutdown_connections 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1100664a0 0x7fb110068960 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb12415cf80 0x7fb124142d60 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1240ae200 0x7fb124142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 --2- 172.21.15.40:0/2542754834 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1240add70 0x7fb124142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 >> 172.21.15.40:0/2542754834 conn(0x7fb1240b0890 msgr2=0x7fb12415d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:59.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 shutdown_connections 2023-11-04T01:47:59.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:47:59.587+0000 7fb12a0f6640 1 -- 172.21.15.40:0/2542754834 wait complete. 2023-11-04T01:47:59.609 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:47:59.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:47:59.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-11-04T01:47:59.609 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:47:59.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:59.610 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:47:59.610 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:47:59.610 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:47:59.610 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:59.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.610 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:47:59.616 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 41794sec preferred_lft 41794sec 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:83:29:1f:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:59.618 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:59.619 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:47:59.619 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:59.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.619 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:47:59.666 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-11-04T01:47:59.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.668 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:47:59.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.719 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-11-04T01:47:59.719 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-11-04T01:47:59.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:47:59.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:47:59.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:47:59.719 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-11-04T01:47:59.764 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:47:59.759+0000 7f5d77706640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:59.764 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:47:59.759+0000 7f5d77706640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:59.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.793 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:47:59.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:47:59.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:47:59.846 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:59.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:59.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-11-04T01:47:59.900 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:47:59.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:59.901 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:59.949 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:59.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:59.950 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:59.998 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:48:00.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:48:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:00.045 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:48:00.045 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:48:00.045 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:48:00.045 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:48:00.045 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:48:00.046 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:00.047 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:00.048 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:00.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:00.048 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:48:00.101 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:48:00.101 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:48:00.146 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:48:00.152 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:48:00.152 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:48:00.152 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:48:00.152 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:48:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:00.155 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:00.155 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:00.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:00.155 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:48:00.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:48:00.227+0000 7f0bc8bc4580 -1 init, newargv = 0x559780ef19e0 newargc=15 2023-11-04T01:48:00.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[61109]: starting ceph client 2023-11-04T01:48:00.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[61109]: starting fuse 2023-11-04T01:48:01.302 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:48:01.310 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-11-04T01:48:01.310 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-11-04T01:48:01.311 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-11-04T01:48:01.312 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:01.313 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:01.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:01.314 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-11-04T01:48:01.361 INFO:teuthology.orchestra.run.smithi040.stdout:45 2023-11-04T01:48:01.362 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:48:01.362 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:48:01.363 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-11-04T01:48:01.364 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-11-04T01:48:01.364 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-11-04T01:48:01.364 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:48:01.364 DEBUG:teuthology.orchestra.run.smithi040:> 2023-11-04T01:48:01.364 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-11-04T01:48:01.364 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:48:01.492 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.61109.asok 2023-11-04T01:48:01.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:01.504 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61109.asok 2023-11-04T01:48:01.504 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:01.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.61109.asok status 2023-11-04T01:48:01.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:48:01.706 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "61109", 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 8604, 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 8604 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:48:01.707 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1781589139 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1781589139 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.8604 192.168.0.1:0/1781589139", 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/1781589139", 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 120, 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 112, 2023-11-04T01:48:01.708 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:48:01.709 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-11-04T01:48:01.709 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-11-04T01:48:01.709 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:48:01.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:01.727 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:01.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:48:01.727 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:01.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:01.778 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-11-04T01:48:01.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:01.785 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:01.785 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:01.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:01.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:01.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:01.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:48:02.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.007+0000 7f7b52644640 1 Processor -- start 2023-11-04T01:48:02.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.007+0000 7f7b52644640 1 -- start start 2023-11-04T01:48:02.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7b4c15d410 0x7f7b4c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b4c0caaa0 0x7f7b4c0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c0ce290 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c06fe50 con 0x7f7b4c0caaa0 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c0aef20 con 0x7f7b4c15d410 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b4c0caaa0 0x7f7b4c0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b4c0caaa0 0x7f7b4c0c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40434/0 (socket says 172.21.15.40:40434) 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/338787146 learned_addr learned my addr 172.21.15.40:0/338787146 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/338787146 >> v2:172.21.15.91:3300/0 conn(0x7f7b4c15d410 0x7f7b4c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/338787146 >> v2:172.21.15.91:3300/0 conn(0x7f7b4c15d410 msgr2=0x7f7b4c0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/338787146 >> v2:172.21.15.91:3300/0 conn(0x7f7b4c15d410 0x7f7b4c0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/338787146 >> v1:172.21.15.91:6789/0 conn(0x7f7b4c0c98a0 legacy=0x7f7b4c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/338787146 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0ccdf0 con 0x7f7b4c0caaa0 2023-11-04T01:48:02.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/338787146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c0c9360 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0680c0 tx=0x7f7b4001eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfad12d2f8b807a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4affd640 1 -- 172.21.15.40:0/338787146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400a7a60 con 0x7f7b4c0caaa0 2023-11-04T01:48:02.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4affd640 1 -- 172.21.15.40:0/338787146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400a7bc0 con 0x7f7b4c0caaa0 2023-11-04T01:48:02.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b4affd640 1 -- 172.21.15.40:0/338787146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400af440 con 0x7f7b4c0caaa0 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 -- 172.21.15.40:0/338787146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0caaa0 msgr2=0x7f7b4c0c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.011+0000 7f7b52644640 1 --2- 172.21.15.40:0/338787146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c0c9360 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0680c0 tx=0x7f7b4001eb90 comp rx=0 tx=0).stop 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- 172.21.15.40:0/338787146 shutdown_connections 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 --2- 172.21.15.40:0/338787146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c0c9360 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 --2- 172.21.15.40:0/338787146 >> v2:172.21.15.91:3300/0 conn(0x7f7b4c15d410 0x7f7b4c0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- 172.21.15.40:0/338787146 >> 172.21.15.40:0/338787146 conn(0x7f7b4c0ced10 msgr2=0x7f7b4c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- 172.21.15.40:0/338787146 shutdown_connections 2023-11-04T01:48:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- 172.21.15.40:0/338787146 wait complete. 2023-11-04T01:48:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 Processor -- start 2023-11-04T01:48:02.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- start start 2023-11-04T01:48:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 0x7f7b4c0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b4c15d410 0x7f7b4c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c15b6d0 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1547f0 con 0x7f7b4c0caaa0 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c15aac0 con 0x7f7b4c15d410 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 0x7f7b4c0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 0x7f7b4c0c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40444/0 (socket says 172.21.15.40:40444) 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1736064146 learned_addr learned my addr 172.21.15.40:0/1736064146 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b4c15d410 msgr2=0x7f7b4c15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b50be1640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b4c15d410 0x7f7b4c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b4c15d410 0x7f7b4c15bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b4c0caaa0 msgr2=0x7f7b4c1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1736064146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4000b770 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b50be1640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b4c15d410 0x7f7b4c15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 0x7f7b4c0c5350 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00d830 tx=0x7f7b3c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b48ff9640 1 -- 172.21.15.40:0/1736064146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00b6c0 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b48ff9640 1 -- 172.21.15.40:0/1736064146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00b820 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b48ff9640 1 -- 172.21.15.40:0/1736064146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00bb90 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c15ada0 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.015+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c15b360 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b48ff9640 1 -- 172.21.15.40:0/1736064146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b3c01e460 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b48ff9640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7b380664a0 0x7f7b38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b48ff9640 1 -- 172.21.15.40:0/1736064146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f7b3c084e10 con 0x7f7b4c0c98a0 2023-11-04T01:48:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 Processor -- start 2023-11-04T01:48:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7b380664a0 0x7f7b38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 -- start start 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f85f0 0x559bd02f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd02ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02ae7f0 0x559bd02aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7b380664a0 0x7f7b38068960 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b400b1000 tx=0x7f7b40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd0176d80 con 0x559bd02f8f10 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd01077a0 con 0x559bd02ae7f0 2023-11-04T01:48:02.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x559bd0104cd0 con 0x559bd02f85f0 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd02ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd02ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40460/0 (socket says 172.21.15.40:40460) 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/355155904 learned_addr learned my addr 172.21.15.40:0/355155904 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f85f0 0x559bd02f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b50be1640 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02ae7f0 0x559bd02aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f85f0 msgr2=0x559bd02f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f85f0 0x559bd02f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02ae7f0 msgr2=0x559bd02aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02ae7f0 0x559bd02aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b4b7fe640 1 -- 172.21.15.40:0/355155904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bd009d180 con 0x559bd02f8f10 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.019+0000 7f7b50be1640 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02ae7f0 0x559bd02aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd02ae2b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f7b40008010 tx=0x7f7b40004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4e195b658de81b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b31ffb640 1 -- 172.21.15.40:0/355155904 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400bf070 con 0x559bd02f8f10 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b31ffb640 1 -- 172.21.15.40:0/355155904 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400afba0 con 0x559bd02f8f10 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b31ffb640 1 -- 172.21.15.40:0/355155904 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400ba480 con 0x559bd02f8f10 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/355155904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 msgr2=0x559bd02ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd02ae2b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f7b40008010 tx=0x7f7b40004740 comp rx=0 tx=0).stop 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/355155904 shutdown_connections 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02ae7f0 0x559bd02aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd02ae2b0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- 172.21.15.40:0/355155904 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f85f0 0x559bd02f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/355155904 >> 172.21.15.40:0/355155904 conn(0x559bd0196d50 msgr2=0x559bd02acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/355155904 shutdown_connections 2023-11-04T01:48:02.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/355155904 wait complete. 2023-11-04T01:48:02.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- start start 2023-11-04T01:48:02.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 Processor -- start 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd02dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd02dd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd02dd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd01005c0 con 0x559bd02ae7f0 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd00be8c0 con 0x559bd02f85f0 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x559bd00be560 con 0x559bd02f8f10 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 10 client.0 _ll_register_callbacks cb 0x559bd0299ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:48:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd02dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd02dcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40468/0 (socket says 172.21.15.40:40468) 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1566681055 learned_addr learned my addr 172.21.15.40:0/1566681055 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b50be1640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd02dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd02dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 msgr2=0x559bd02dd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd02dd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 msgr2=0x559bd02dd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd02dd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 -- 172.21.15.40:0/1566681055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c0ccdf0 con 0x559bd02ae7f0 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd02dcbd0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c055730 tx=0x7f7b3c055860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc9458390c47997 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b2affd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:48:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b2affd640 1 -- 172.21.15.40:0/1566681055 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c054c90 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b2affd640 1 -- 172.21.15.40:0/1566681055 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f7b3c054df0 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bd00cbda0 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b2affd640 1 -- 172.21.15.40:0/1566681055 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b3c05d610 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 10 client.8616 fetch_fsmap learned FSMap version 120 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) v3 -- 0x559bcfdf8e20 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b2affd640 1 -- 172.21.15.40:0/1566681055 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559bd00cbda0 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b2affd640 1 -- 172.21.15.40:0/1566681055 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 120) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f7b3c072020 con 0x559bd02ae7f0 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 10 client.8616 fetch_fsmap finished waiting for FSMap version 120 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 10 client.8616 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 20 client.8616 populate_metadata read hostname 'smithi040' 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd02ddef0 0x559bd0309d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 4 client.8616 mds_command: new command op to 8247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 --> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559bd00cbb80 con 0x559bd02ddef0 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.023+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd02ddef0 0x559bd0309d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b2affd640 10 client.8616 ms_handle_connect on v2:172.21.15.40:6832/685602585 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd02ddef0 0x559bd0309d70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409f6a4ac17a21eb server_cookie=227f21b106fdf6d9 in_seq=0 out_seq=0 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b2affd640 1 -- 172.21.15.40:0/1566681055 <== mds.0 v2:172.21.15.40:6832/685602585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559bd00cbb80 con 0x559bd02ddef0 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b2affd640 10 client.8616 handle_command_reply: tid=0 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 client.8616 shutdown 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 msgr2=0x559bd02dcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd02dcbd0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c055730 tx=0x7f7b3c055860 comp rx=0 tx=0).stop 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 shutdown_connections 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd02ddef0 0x559bd0309d70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd02dd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd02dd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 --2- 172.21.15.40:0/1566681055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd02dcbd0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b2affd640 0 client.8616 ms_handle_reset on v2:172.21.15.40:6832/685602585 2023-11-04T01:48:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 >> 172.21.15.40:0/1566681055 conn(0x559bd0196d50 msgr2=0x559bd02acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 shutdown_connections 2023-11-04T01:48:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 1 -- 172.21.15.40:0/1566681055 wait complete. 2023-11-04T01:48:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.027+0000 7f7b55771000 20 client.8616 trim_cache size 0 max 16384 2023-11-04T01:48:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 Processor -- start 2023-11-04T01:48:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 -- start start 2023-11-04T01:48:02.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd0309d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd030a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd030a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bcfdb9aa0 con 0x559bd02ae7f0 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd00ff450 con 0x559bd02f85f0 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x559bd00fa8c0 con 0x559bd02f8f10 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd0309d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd0309d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40480/0 (socket says 172.21.15.40:40480) 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 -- 172.21.15.40:0/2304923418 learned_addr learned my addr 172.21.15.40:0/2304923418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 -- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 msgr2=0x559bd030a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd030a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 -- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 msgr2=0x559bd030a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd030a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd030a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.039+0000 7f7b4bfff640 1 -- 172.21.15.40:0/2304923418 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bd00c12f0 con 0x559bd02ae7f0 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd0309d70 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c055450 tx=0x7f7b3c084050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8507fb1f09d1c7f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b327fc640 1 -- 172.21.15.40:0/2304923418 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0598f0 con 0x559bd02ae7f0 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b327fc640 1 -- 172.21.15.40:0/2304923418 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c055ea0 con 0x559bd02ae7f0 2023-11-04T01:48:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b327fc640 1 -- 172.21.15.40:0/2304923418 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c051590 con 0x559bd02ae7f0 2023-11-04T01:48:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/2304923418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 msgr2=0x559bd0309d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd0309d70 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c055450 tx=0x7f7b3c084050 comp rx=0 tx=0).stop 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/2304923418 shutdown_connections 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02f8f10 0x559bd030a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd030a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- 172.21.15.40:0/2304923418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02ae7f0 0x559bd0309d70 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/2304923418 >> 172.21.15.40:0/2304923418 conn(0x559bd0196d50 msgr2=0x559bd02af460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/2304923418 shutdown_connections 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/2304923418 wait complete. 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- start start 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 Processor -- start 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02ae7f0 0x559bd0359a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd0359f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd0314840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd00bd7b0 con 0x559bd02f8f10 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bd0299e40 con 0x559bd02f85f0 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x559bd00fddd0 con 0x559bd02ae7f0 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 10 client.0 _ll_register_callbacks cb 0x559bd01b1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd0314840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd0314840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40486/0 (socket says 172.21.15.40:40486) 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 -- 172.21.15.40:0/3241631615 learned_addr learned my addr 172.21.15.40:0/3241631615 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b4b7fe640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd0359f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02ae7f0 0x559bd0359a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 -- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02ae7f0 msgr2=0x559bd0359a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02ae7f0 0x559bd0359a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 -- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 msgr2=0x559bd0359f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd0359f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 -- 172.21.15.40:0/3241631615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bcfdf8e20 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02ae7f0 0x559bd0359a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b50be1640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd0314840 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f9b0 tx=0x7f7b4400fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cf708f74925d31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b2affd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b2affd640 1 -- 172.21.15.40:0/3241631615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400ddc0 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b2affd640 1 -- 172.21.15.40:0/3241631615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f7b44016070 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bd02b14e0 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b2affd640 1 -- 172.21.15.40:0/3241631615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b4401b480 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 10 client.8622 fetch_fsmap learned FSMap version 120 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) v3 -- 0x559bd00a77f0 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b2affd640 1 -- 172.21.15.40:0/3241631615 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559bd02b14e0 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b2affd640 1 -- 172.21.15.40:0/3241631615 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 120) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f7b4401b5e0 con 0x559bd02f8f10 2023-11-04T01:48:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 10 client.8622 fetch_fsmap finished waiting for FSMap version 120 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 10 client.8622 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 20 client.8622 populate_metadata read hostname 'smithi040' 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd0315830 0x559bd0315c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 4 client.8622 mds_command: new command op to 8247 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 --> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559bd00f78b0 con 0x559bd0315830 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.043+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd0315830 0x559bd0315c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.047+0000 7f7b2affd640 10 client.8622 ms_handle_connect on v2:172.21.15.40:6832/685602585 2023-11-04T01:48:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.047+0000 7f7b4bfff640 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd0315830 0x559bd0315c40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450d9a33ebd87c76 server_cookie=58b6017c47608515 in_seq=0 out_seq=0 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b2affd640 1 -- 172.21.15.40:0/3241631615 <== mds.0 v2:172.21.15.40:6832/685602585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559bd00f78b0 con 0x559bd0315830 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b2affd640 10 client.8622 handle_command_reply: tid=0 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 client.8622 shutdown 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 msgr2=0x559bd0314840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd0314840 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f9b0 tx=0x7f7b4400fe70 comp rx=0 tx=0).stop 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 shutdown_connections 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:6832/685602585,v1:172.21.15.40:6833/685602585] conn(0x559bd0315830 0x559bd0315c40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559bd02f8f10 0x559bd0314840 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b2affd640 0 client.8622 ms_handle_reset on v2:172.21.15.40:6832/685602585 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x559bd02f85f0 0x559bd0359f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 --2- 172.21.15.40:0/3241631615 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x559bd02ae7f0 0x559bd0359a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 >> 172.21.15.40:0/3241631615 conn(0x559bd0196d50 msgr2=0x559bd02afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 shutdown_connections 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 1 -- 172.21.15.40:0/3241631615 wait complete. 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b55771000 20 client.8622 trim_cache size 0 max 16384 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stdout: "message": "", 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stdout: "return_code": 0 2023-11-04T01:48:02.064 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-11-04T01:48:02.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7b380664a0 msgr2=0x7f7b38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7b380664a0 0x7f7b38068960 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b400b1000 tx=0x7f7b40008040 comp rx=0 tx=0).stop 2023-11-04T01:48:02.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 msgr2=0x7f7b4c0c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 0x7f7b4c0c5350 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00d830 tx=0x7f7b3c00dcf0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 shutdown_connections 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f7b380664a0 0x7f7b38068960 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7b4c15d410 0x7f7b4c15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b4c0caaa0 0x7f7b4c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 --2- 172.21.15.40:0/1736064146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4c0c98a0 0x7f7b4c0c5350 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 >> 172.21.15.40:0/1736064146 conn(0x7f7b4c0ced10 msgr2=0x7f7b4c1581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 shutdown_connections 2023-11-04T01:48:02.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.059+0000 7f7b52644640 1 -- 172.21.15.40:0/1736064146 wait complete. 2023-11-04T01:48:02.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:02.080 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:48:02.111 INFO:tasks.cephfs.test_snapshots:testing snapclient mds_kill_mdstable_at=3 2023-11-04T01:48:02.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:02.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.271+0000 7f3191691640 1 Processor -- start 2023-11-04T01:48:02.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.271+0000 7f3191691640 1 -- start start 2023-11-04T01:48:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3191691640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f318c153ae0 0x7f318c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3191691640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f318c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3191691640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0ca010 con 0x7f318c0caf00 2023-11-04T01:48:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3191691640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0cd7b0 con 0x7f318c153ae0 2023-11-04T01:48:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3191691640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0ca260 con 0x7f318c15d840 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f318c0caf00 0x7f318c15d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37210/0 (socket says 172.21.15.40:37210) 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 -- 172.21.15.40:0/450356766 learned_addr learned my addr 172.21.15.40:0/450356766 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318b7fe640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f318c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318affd640 1 --2- 172.21.15.40:0/450356766 >> v2:172.21.15.91:3300/0 conn(0x7f318c153ae0 0x7f318c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312948983 0 0) 0x7f318c0ca010 con 0x7f318c0caf00 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3174005740 con 0x7f318c0caf00 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235783242 0 0) 0x7f3174005740 con 0x7f318c0caf00 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 msgr2=0x7f318c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f318c06bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 >> v2:172.21.15.91:3300/0 conn(0x7f318c153ae0 msgr2=0x7f318c0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 --2- 172.21.15.40:0/450356766 >> v2:172.21.15.91:3300/0 conn(0x7f318c153ae0 0x7f318c0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0ca540 con 0x7f318c0caf00 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f3180001680 con 0x7f318c0caf00 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 >> v1:172.21.15.40:6789/0 conn(0x7f318c0caf00 legacy=0x7f318c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3174005b90 0x7f3174005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31740069e0 0x7f3174006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f31740073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0cd7b0 con 0x7f31740069e0 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0ca260 con 0x7f3174005b90 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317400dba0 con 0x7f318c15d840 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31740069e0 0x7f3174006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318affd640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3174005b90 0x7f3174005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318b7fe640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f31740073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 -- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 msgr2=0x7f31740073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f31740073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 -- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3174005b90 msgr2=0x7f3174005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3174005b90 0x7f3174005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318a7fc640 1 -- 172.21.15.40:0/450356766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174005740 con 0x7f31740069e0 2023-11-04T01:48:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318affd640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3174005b90 0x7f3174005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.275+0000 7f318b7fe640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c15d840 0x7f31740073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318a7fc640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31740069e0 0x7f3174006e60 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f318000c160 tx=0x7f318001f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a62666d3b0422e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800a8c10 con 0x7f31740069e0 2023-11-04T01:48:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800a8d70 con 0x7f31740069e0 2023-11-04T01:48:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3189ffb640 1 -- 172.21.15.40:0/450356766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180005b20 con 0x7f31740069e0 2023-11-04T01:48:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- 172.21.15.40:0/450356766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31740069e0 msgr2=0x7f3174006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 --2- 172.21.15.40:0/450356766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31740069e0 0x7f3174006e60 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f318000c160 tx=0x7f318001f2f0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 -- 172.21.15.40:0/450356766 reap_dead start 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- 172.21.15.40:0/450356766 shutdown_connections 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- 172.21.15.40:0/450356766 >> 172.21.15.40:0/450356766 conn(0x7f318c0b0890 msgr2=0x7f318c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- 172.21.15.40:0/450356766 shutdown_connections 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- 172.21.15.40:0/450356766 wait complete. 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 Processor -- start 2023-11-04T01:48:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- start start 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31740069e0 0x7f318c0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c0c4040 0x7f318c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 0x7f318c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b3090 con 0x7f318c1512c0 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b24e0 con 0x7f31740069e0 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f3191691640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b2760 con 0x7f318c0c4040 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 0x7f318c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 0x7f318c15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40512/0 (socket says 172.21.15.40:40512) 2023-11-04T01:48:02.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 -- 172.21.15.40:0/1498232071 learned_addr learned my addr 172.21.15.40:0/1498232071 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318affd640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31740069e0 0x7f318c0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318a7fc640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c0c4040 0x7f318c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 -- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c0c4040 msgr2=0x7f318c15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c0c4040 0x7f318c15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 -- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31740069e0 msgr2=0x7f318c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31740069e0 0x7f318c0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.279+0000 7f318b7fe640 1 -- 172.21.15.40:0/1498232071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0cb500 con 0x7f318c1512c0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f318b7fe640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 0x7f318c15b960 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f318c157710 tx=0x7f318400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184017400 con 0x7f318c1512c0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184011040 con 0x7f318c1512c0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c0b2a40 con 0x7f318c1512c0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840177c0 con 0x7f318c1512c0 2023-11-04T01:48:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c0b3520 con 0x7f318c1512c0 2023-11-04T01:48:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c0b4cf0 con 0x7f318c1512c0 2023-11-04T01:48:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31840203b0 con 0x7f318c1512c0 2023-11-04T01:48:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f31737fe640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31780664d0 0x7f3178068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f31840848a0 con 0x7f318c1512c0 2023-11-04T01:48:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f318affd640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31780664d0 0x7f3178068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.283+0000 7f318affd640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31780664d0 0x7f3178068990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f317c009ac0 tx=0x7f317c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.287+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3184051570 con 0x7f318c1512c0 2023-11-04T01:48:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.475+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f318c04e4a0 con 0x7f318c1512c0 2023-11-04T01:48:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f31737fe640 1 -- 172.21.15.40:0/1498232071 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4928 (secure 0 0 0) 0x7f318401c090 con 0x7f318c1512c0 2023-11-04T01:48:02.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:02.481 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:54.123797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 120 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31780664d0 msgr2=0x7f3178068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31780664d0 0x7f3178068990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f317c009ac0 tx=0x7f317c008040 comp rx=0 tx=0).stop 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 msgr2=0x7f318c15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 0x7f318c15b960 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f318c157710 tx=0x7f318400f4a0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 shutdown_connections 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f31780664d0 0x7f3178068990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f318c1512c0 0x7f318c15b960 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f318c0c4040 0x7f318c15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 --2- 172.21.15.40:0/1498232071 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f31740069e0 0x7f318c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 >> 172.21.15.40:0/1498232071 conn(0x7f318c0b0890 msgr2=0x7f318c0aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 shutdown_connections 2023-11-04T01:48:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.479+0000 7f3191691640 1 -- 172.21.15.40:0/1498232071 wait complete. 2023-11-04T01:48:02.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:48:02.639 INFO:teuthology.orchestra.run.smithi040.stdout:{"last_snap":14,"last_created":12,"last_destroyed":13,"pending_noop":[],"snaps":[{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:47:09.381741+0000","name":"s26","metadata":{}}],"need_to_purge":{"16":[11,13]},"pending_update":[],"pending_destroy":[{"version":28,"removed_snap":12,"seq":14}]} 2023-11-04T01:48:02.639 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 13, "last_snap": 14, "need_to_purge": { "16": [ 11, 13 ] }, "pending_destroy": [ { "removed_snap": 12, "seq": 14, "version": 28 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:47:09.381741+0000" } ] } 2023-11-04T01:48:02.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 Processor -- start 2023-11-04T01:48:02.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 -- start start 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f534415d100 0x7f5344160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53440ce8b0 0x7f53440cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440cdf30 con 0x7f53440ce8b0 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440cb460 con 0x7f534415d100 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f534a12e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5344161110 con 0x7f53440cdaa0 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53440ce8b0 0x7f53440cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53440ce8b0 0x7f53440cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40526/0 (socket says 172.21.15.40:40526) 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 -- 172.21.15.40:0/1836111551 learned_addr learned my addr 172.21.15.40:0/1836111551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f53437fe640 1 --2- 172.21.15.40:0/1836111551 >> v2:172.21.15.91:3300/0 conn(0x7f534415d100 0x7f5344160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5343fff640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 -- 172.21.15.40:0/1836111551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 msgr2=0x7f53440b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 -- 172.21.15.40:0/1836111551 >> v2:172.21.15.91:3300/0 conn(0x7f534415d100 msgr2=0x7f5344160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 --2- 172.21.15.40:0/1836111551 >> v2:172.21.15.91:3300/0 conn(0x7f534415d100 0x7f5344160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5342ffd640 1 -- 172.21.15.40:0/1836111551 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53441613f0 con 0x7f53440ce8b0 2023-11-04T01:48:02.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.755+0000 7f5343fff640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:02.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f5342ffd640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53440ce8b0 0x7f53440cd560 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f53440ce7e0 tx=0x7f533801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63d2ccffba02c3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f53427fc640 1 -- 172.21.15.40:0/1836111551 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380a5560 con 0x7f53440ce8b0 2023-11-04T01:48:02.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f53427fc640 1 -- 172.21.15.40:0/1836111551 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53380a56c0 con 0x7f53440ce8b0 2023-11-04T01:48:02.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f53427fc640 1 -- 172.21.15.40:0/1836111551 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380a5a50 con 0x7f53440ce8b0 2023-11-04T01:48:02.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 -- 172.21.15.40:0/1836111551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53440ce8b0 msgr2=0x7f53440cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53440ce8b0 0x7f53440cd560 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f53440ce7e0 tx=0x7f533801c6e0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 -- 172.21.15.40:0/1836111551 shutdown_connections 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 --2- 172.21.15.40:0/1836111551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53440ce8b0 0x7f53440cd560 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 --2- 172.21.15.40:0/1836111551 >> v2:172.21.15.91:3300/0 conn(0x7f534415d100 0x7f5344160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 -- 172.21.15.40:0/1836111551 >> 172.21.15.40:0/1836111551 conn(0x7f534406dd80 msgr2=0x7f534406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 -- 172.21.15.40:0/1836111551 shutdown_connections 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 -- 172.21.15.40:0/1836111551 wait complete. 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 Processor -- start 2023-11-04T01:48:02.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.759+0000 7f534a12e640 1 -- start start 2023-11-04T01:48:02.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53440ce8b0 0x7f534415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534415d100 0x7f53441561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c4d10 con 0x7f534415d100 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534415c6a0 con 0x7f53440ce8b0 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c4f60 con 0x7f53440cdaa0 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534415d100 0x7f53441561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f53437fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f53437fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:36652/0 (socket says 172.21.15.40:36652) 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f53437fe640 1 -- 172.21.15.40:0/3028466980 learned_addr learned my addr 172.21.15.40:0/3028466980 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5342ffd640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53440ce8b0 0x7f534415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 -- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 msgr2=0x7f53440c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 -- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53440ce8b0 msgr2=0x7f534415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53440ce8b0 0x7f534415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 -- 172.21.15.40:0/3028466980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338009b30 con 0x7f534415d100 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f5343fff640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534415d100 0x7f53441561a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c540 tx=0x7f533c00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c005bf0 con 0x7f534415d100 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c005d50 con 0x7f534415d100 2023-11-04T01:48:02.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c011840 con 0x7f534415d100 2023-11-04T01:48:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53440c5240 con 0x7f534415d100 2023-11-04T01:48:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534415c380 con 0x7f534415d100 2023-11-04T01:48:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534404e4a0 con 0x7f534415d100 2023-11-04T01:48:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f533c0119a0 con 0x7f534415d100 2023-11-04T01:48:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f532bfff640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:02.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.763+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f533c0846d0 con 0x7f534415d100 2023-11-04T01:48:02.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.767+0000 7f53437fe640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:02.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.767+0000 7f53437fe640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53300664a0 0x7f5330068960 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5334007a70 tx=0x7f5334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:02.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.771+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f533c051450 con 0x7f534415d100 2023-11-04T01:48:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.959+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53440b1600 con 0x7f534415d100 2023-11-04T01:48:02.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.959+0000 7f532bfff640 1 -- 172.21.15.40:0/3028466980 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4928 (secure 0 0 0) 0x7f533c054a70 con 0x7f534415d100 2023-11-04T01:48:02.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:02.964 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:47:54.123797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:02.964 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 120 2023-11-04T01:48:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53300664a0 msgr2=0x7f5330068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53300664a0 0x7f5330068960 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5334007a70 tx=0x7f5334008040 comp rx=0 tx=0).stop 2023-11-04T01:48:02.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534415d100 msgr2=0x7f53441561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534415d100 0x7f53441561a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c540 tx=0x7f533c00ca00 comp rx=0 tx=0).stop 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 shutdown_connections 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f53300664a0 0x7f5330068960 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534415d100 0x7f53441561a0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53440ce8b0 0x7f534415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 --2- 172.21.15.40:0/3028466980 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f53440cdaa0 0x7f53440c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 >> 172.21.15.40:0/3028466980 conn(0x7f534406dd80 msgr2=0x7f5344159750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 shutdown_connections 2023-11-04T01:48:02.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:02.963+0000 7f534a12e640 1 -- 172.21.15.40:0/3028466980 wait complete. 2023-11-04T01:48:02.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:48:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.099+0000 7f138fa2f640 1 Processor -- start 2023-11-04T01:48:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.099+0000 7f138fa2f640 1 -- start start 2023-11-04T01:48:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1388159720 0x7f13880c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880cf830 0x7f13880af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13880af640 0x7f13880cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880ca5a0 con 0x7f13880af640 2023-11-04T01:48:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880afa90 con 0x7f1388159720 2023-11-04T01:48:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13880c9d40 con 0x7f13880cf830 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13880af640 0x7f13880cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13880af640 0x7f13880cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40548/0 (socket says 172.21.15.40:40548) 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138d7cb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1388159720 0x7f13880c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 -- 172.21.15.40:0/556346583 learned_addr learned my addr 172.21.15.40:0/556346583 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138cfca640 1 --2- 172.21.15.40:0/556346583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880cf830 0x7f13880af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 -- 172.21.15.40:0/556346583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880cf830 msgr2=0x7f13880af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 --2- 172.21.15.40:0/556346583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880cf830 0x7f13880af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 -- 172.21.15.40:0/556346583 >> v2:172.21.15.91:3300/0 conn(0x7f1388159720 msgr2=0x7f13880c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 --2- 172.21.15.40:0/556346583 >> v2:172.21.15.91:3300/0 conn(0x7f1388159720 0x7f13880c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 -- 172.21.15.40:0/556346583 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880c9fe0 con 0x7f13880af640 2023-11-04T01:48:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138dfcc640 1 --2- 172.21.15.40:0/556346583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880af640 0x7f13880cc8e0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f138806f530 tx=0x7f138001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ab1a42fbe72f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f137bfff640 1 -- 172.21.15.40:0/556346583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13800ad680 con 0x7f13880af640 2023-11-04T01:48:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f137bfff640 1 -- 172.21.15.40:0/556346583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13800ad7e0 con 0x7f13880af640 2023-11-04T01:48:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f137bfff640 1 -- 172.21.15.40:0/556346583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13800adb70 con 0x7f13880af640 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 -- 172.21.15.40:0/556346583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880af640 msgr2=0x7f13880cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.103+0000 7f138fa2f640 1 --2- 172.21.15.40:0/556346583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880af640 0x7f13880cc8e0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f138806f530 tx=0x7f138001c440 comp rx=0 tx=0).stop 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- 172.21.15.40:0/556346583 shutdown_connections 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 --2- 172.21.15.40:0/556346583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880af640 0x7f13880cc8e0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 --2- 172.21.15.40:0/556346583 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880cf830 0x7f13880af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 --2- 172.21.15.40:0/556346583 >> v2:172.21.15.91:3300/0 conn(0x7f1388159720 0x7f13880c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- 172.21.15.40:0/556346583 >> 172.21.15.40:0/556346583 conn(0x7f13880ced10 msgr2=0x7f13880cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- 172.21.15.40:0/556346583 shutdown_connections 2023-11-04T01:48:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- 172.21.15.40:0/556346583 wait complete. 2023-11-04T01:48:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 Processor -- start 2023-11-04T01:48:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- start start 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880af640 0x7f1388149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 0x7f1388152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1388159720 0x7f13880cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13881531c0 con 0x7f13880cf830 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1388152ee0 con 0x7f1388159720 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138806c2e0 con 0x7f13880af640 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 0x7f1388152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 0x7f1388152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40560/0 (socket says 172.21.15.40:40560) 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 -- 172.21.15.40:0/691047751 learned_addr learned my addr 172.21.15.40:0/691047751 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138dfcc640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1388159720 0x7f13880cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138d7cb640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880af640 0x7f1388149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 -- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880af640 msgr2=0x7f1388149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880af640 0x7f1388149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 -- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1388159720 msgr2=0x7f13880cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1388159720 0x7f13880cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 -- 172.21.15.40:0/691047751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800094d0 con 0x7f13880cf830 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138dfcc640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1388159720 0x7f13880cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138d7cb640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880af640 0x7f1388149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138cfca640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 0x7f1388152490 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1384009de0 tx=0x7f13840075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384011070 con 0x7f13880cf830 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384007c50 con 0x7f13880cf830 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138806c5c0 con 0x7f13880cf830 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384016470 con 0x7f13880cf830 2023-11-04T01:48:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.107+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1388149aa0 con 0x7f13880cf830 2023-11-04T01:48:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.111+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138804e4a0 con 0x7f13880cf830 2023-11-04T01:48:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.111+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13840165d0 con 0x7f13880cf830 2023-11-04T01:48:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.111+0000 7f1379ffb640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f136c0664a0 0x7f136c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.111+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7818+0+0 (secure 0 0 0) 0x7f1384084880 con 0x7f13880cf830 2023-11-04T01:48:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.111+0000 7f138d7cb640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f136c0664a0 0x7f136c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.111+0000 7f138d7cb640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f136c0664a0 0x7f136c068960 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f137c009ae0 tx=0x7f137c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:03.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.115+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1384051550 con 0x7f13880cf830 2023-11-04T01:48:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:03.331+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f13880c2620 con 0x7f13880cf830 2023-11-04T01:48:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.179+0000 7f1379ffb640 1 -- 172.21.15.40:0/691047751 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8445 v121) v1 ==== 112+0+0 (secure 0 0 0) 0x7f138401b030 con 0x7f13880cf830 2023-11-04T01:48:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:freezing mds.8445 2023-11-04T01:48:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f136c0664a0 msgr2=0x7f136c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f136c0664a0 0x7f136c068960 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f137c009ae0 tx=0x7f137c008040 comp rx=0 tx=0).stop 2023-11-04T01:48:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 msgr2=0x7f1388152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 0x7f1388152490 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1384009de0 tx=0x7f13840075c0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 shutdown_connections 2023-11-04T01:48:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f136c0664a0 0x7f136c068960 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1388159720 0x7f13880cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13880cf830 0x7f1388152490 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 --2- 172.21.15.40:0/691047751 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f13880af640 0x7f1388149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.183+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 >> 172.21.15.40:0/691047751 conn(0x7f13880ced10 msgr2=0x7f13880715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:04.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.187+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 shutdown_connections 2023-11-04T01:48:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.187+0000 7f138fa2f640 1 -- 172.21.15.40:0/691047751 wait complete. 2023-11-04T01:48:04.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 3 2023-11-04T01:48:04.355 INFO:teuthology.orchestra.run.smithi040.stdout:{"success":"mds_kill_mdstable_at = '3' (not observed, change may require restart) "} 2023-11-04T01:48:04.355 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '3' (not observed, change may require restart) " } 2023-11-04T01:48:04.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:04.356 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s33) 2023-11-04T01:48:04.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:48:04.383 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fd906944640 time 2023-11-04T01:48:04.383606+0000 2023-11-04T01:48:04.383 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:48:04.385 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.385 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd90ca70fae] 2023-11-04T01:48:04.385 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7fd906944640 thread_name:ms_dispatch 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.386 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd90c3ab520] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd90ca71008] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.387 INFO:tasks.ceph.mds.a.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:48:04.379+0000 7fd906944640 -1 ./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fd906944640 time 2023-11-04T01:48:04.383606+0000 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd90ca70fae] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.388 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-11-04T01:48:04.383+0000 7fd906944640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7fd906944640 thread_name:ms_dispatch 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd90c3ab520] 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:48:04.389 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd90ca71008] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.390 INFO:tasks.ceph.mds.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:48:04.391 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr: -1> 2023-11-04T01:48:04.379+0000 7fd906944640 -1 ./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fd906944640 time 2023-11-04T01:48:04.383606+0000 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd90ca70fae] 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.396 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 0> 2023-11-04T01:48:04.383+0000 7fd906944640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7fd906944640 thread_name:ms_dispatch 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.397 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd90c3ab520] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd90ca71008] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.398 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.399 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.399 INFO:tasks.ceph.mds.a.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.399 INFO:tasks.ceph.mds.a.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.399 INFO:tasks.ceph.mds.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:48:04.399 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: -1> 2023-11-04T01:48:04.379+0000 7fd906944640 -1 ./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fd906944640 time 2023-11-04T01:48:04.383606+0000 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd90ca70fae] 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.403 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 0> 2023-11-04T01:48:04.383+0000 7fd906944640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: in thread 7fd906944640 thread_name:ms_dispatch 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd90c3ab520] 2023-11-04T01:48:04.404 INFO:tasks.ceph.mds.a.smithi040.stderr: 2: pthread_kill() 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 3: raise() 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 4: abort() 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd90ca71008] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fd90ca71162] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x5573a129168e] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x5573a1029585] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x5573a102a9eb] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5573a102aebc] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5573a10157f5] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7fd90cc5cf2a] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7fd90ccef7f1] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fd90c3fdb43] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fd90c48fa00] 2023-11-04T01:48:04.405 INFO:tasks.ceph.mds.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:48:04.406 INFO:tasks.ceph.mds.a.smithi040.stderr: 2023-11-04T01:48:04.515 INFO:teuthology.orchestra.run.smithi040.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:48:04.515 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:48:04.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:04.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 Processor -- start 2023-11-04T01:48:04.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 -- start start 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd340142ad0 0x7fd34015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3400cbd80 0x7fd3400cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3400ca100 con 0x7fd340142eb0 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400ca3e0 con 0x7fd3400cbd80 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd345264640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400ca6c0 con 0x7fd340142ad0 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33e7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd340142eb0 0x7fd3400cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37220/0 (socket says 172.21.15.40:37220) 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33e7fc640 1 -- 172.21.15.40:0/880066077 learned_addr learned my addr 172.21.15.40:0/880066077 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:04.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33f7fe640 1 --2- 172.21.15.40:0/880066077 >> v2:172.21.15.40:3300/0 conn(0x7fd3400cbd80 0x7fd3400cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33effd640 1 --2- 172.21.15.40:0/880066077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd340142ad0 0x7fd34015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33dffb640 1 -- 172.21.15.40:0/880066077 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557073950 0 0) 0x7fd3400ca100 con 0x7fd340142eb0 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33dffb640 1 -- 172.21.15.40:0/880066077 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd328005740 con 0x7fd340142eb0 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33f7fe640 1 -- 172.21.15.40:0/880066077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd340142ad0 msgr2=0x7fd34015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33f7fe640 1 --2- 172.21.15.40:0/880066077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd340142ad0 0x7fd34015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33f7fe640 1 -- 172.21.15.40:0/880066077 >> v1:172.21.15.40:6789/0 conn(0x7fd340142eb0 legacy=0x7fd3400cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.679+0000 7fd33f7fe640 1 -- 172.21.15.40:0/880066077 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400ca9a0 con 0x7fd3400cbd80 2023-11-04T01:48:04.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33f7fe640 1 --2- 172.21.15.40:0/880066077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3400cbd80 0x7fd3400cc830 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd338009d90 tx=0x7fd33801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772f34889b88cb74 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:04.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33dffb640 1 -- 172.21.15.40:0/880066077 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3380a59a0 con 0x7fd3400cbd80 2023-11-04T01:48:04.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33dffb640 1 -- 172.21.15.40:0/880066077 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380a5b00 con 0x7fd3400cbd80 2023-11-04T01:48:04.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33dffb640 1 -- 172.21.15.40:0/880066077 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3380a5e70 con 0x7fd3400cbd80 2023-11-04T01:48:04.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- 172.21.15.40:0/880066077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3400cbd80 msgr2=0x7fd3400cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 --2- 172.21.15.40:0/880066077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3400cbd80 0x7fd3400cc830 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd338009d90 tx=0x7fd33801c8c0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- 172.21.15.40:0/880066077 shutdown_connections 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 --2- 172.21.15.40:0/880066077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3400cbd80 0x7fd3400cc830 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 --2- 172.21.15.40:0/880066077 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd340142ad0 0x7fd34015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- 172.21.15.40:0/880066077 >> 172.21.15.40:0/880066077 conn(0x7fd3400b0890 msgr2=0x7fd3400b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- 172.21.15.40:0/880066077 shutdown_connections 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- 172.21.15.40:0/880066077 wait complete. 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 Processor -- start 2023-11-04T01:48:04.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- start start 2023-11-04T01:48:04.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3400cbd80 0x7fd340070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd340142ad0 0x7fd34013ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 0x7fd3400afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400705f0 con 0x7fd340142eb0 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd340070f80 con 0x7fd340142ad0 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd345264640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34013e2f0 con 0x7fd3400cbd80 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 0x7fd3400afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 0x7fd3400afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40570/0 (socket says 172.21.15.40:40570) 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.683+0000 7fd33f7fe640 1 -- 172.21.15.40:0/2476678454 learned_addr learned my addr 172.21.15.40:0/2476678454 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33effd640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3400cbd80 0x7fd340070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33e7fc640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd340142ad0 0x7fd34013ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33f7fe640 1 -- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3400cbd80 msgr2=0x7fd340070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33f7fe640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3400cbd80 0x7fd340070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33f7fe640 1 -- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd340142ad0 msgr2=0x7fd34013ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33f7fe640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd340142ad0 0x7fd34013ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33f7fe640 1 -- 172.21.15.40:0/2476678454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009a70 con 0x7fd340142eb0 2023-11-04T01:48:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33f7fe640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 0x7fd3400afab0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fd338009d90 tx=0x7fd338019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338004450 con 0x7fd340142eb0 2023-11-04T01:48:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380045b0 con 0x7fd340142eb0 2023-11-04T01:48:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3400b20e0 con 0x7fd340142eb0 2023-11-04T01:48:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338003e60 con 0x7fd340142eb0 2023-11-04T01:48:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3400b1e00 con 0x7fd340142eb0 2023-11-04T01:48:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3400703c0 con 0x7fd340142eb0 2023-11-04T01:48:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3380b4030 con 0x7fd340142eb0 2023-11-04T01:48:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd3277fe640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd32c0664d0 0x7fd32c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7906+0+0 (secure 0 0 0) 0x7fd33811f630 con 0x7fd340142eb0 2023-11-04T01:48:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.687+0000 7fd33effd640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd32c0664d0 0x7fd32c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.691+0000 7fd33effd640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd32c0664d0 0x7fd32c068990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd330009af0 tx=0x7fd330008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.691+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3400703c0 con 0x7fd340142eb0 2023-11-04T01:48:04.697 INFO:tasks.ceph.mds.a.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:48:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.883+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3400703c0 con 0x7fd340142eb0 2023-11-04T01:48:04.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.883+0000 7fd3277fe640 1 -- 172.21.15.40:0/2476678454 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4928 (secure 0 0 0) 0x7fd3400703c0 con 0x7fd340142eb0 2023-11-04T01:48:04.887 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:04.887 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":121,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:48:03.335158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:04.888 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 121 2023-11-04T01:48:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd32c0664d0 msgr2=0x7fd32c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd32c0664d0 0x7fd32c068990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd330009af0 tx=0x7fd330008040 comp rx=0 tx=0).stop 2023-11-04T01:48:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 msgr2=0x7fd3400afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 0x7fd3400afab0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fd338009d90 tx=0x7fd338019660 comp rx=0 tx=0).stop 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 shutdown_connections 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd32c0664d0 0x7fd32c068990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd340142eb0 0x7fd3400afab0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd340142ad0 0x7fd34013ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 --2- 172.21.15.40:0/2476678454 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd3400cbd80 0x7fd340070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 >> 172.21.15.40:0/2476678454 conn(0x7fd3400b0890 msgr2=0x7fd3400cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 shutdown_connections 2023-11-04T01:48:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:04.887+0000 7fd345264640 1 -- 172.21.15.40:0/2476678454 wait complete. 2023-11-04T01:48:04.907 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:08.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:48:09.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.039+0000 7fe1185ce640 1 Processor -- start 2023-11-04T01:48:10.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe1185ce640 1 -- start start 2023-11-04T01:48:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe1185ce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe110160680 0x7fe1100cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe1185ce640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160a60 0x7fe1100ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe1185ce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1100cf000 con 0x7fe1100b3e30 2023-11-04T01:48:10.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe1185ce640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100b5de0 con 0x7fe110160680 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe1185ce640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100d1610 con 0x7fe110160a60 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe11636a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe110160680 0x7fe1100cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe116b6b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1100b3e30 0x7fe1100cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52000/0 (socket says 172.21.15.40:52000) 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe116b6b640 1 -- 172.21.15.40:0/2909811031 learned_addr learned my addr 172.21.15.40:0/2909811031 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe115b69640 1 --2- 172.21.15.40:0/2909811031 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160a60 0x7fe1100ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe115368640 1 -- 172.21.15.40:0/2909811031 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930424452 0 0) 0x7fe1100cf000 con 0x7fe1100b3e30 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe115368640 1 -- 172.21.15.40:0/2909811031 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0fc003530 con 0x7fe1100b3e30 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe11636a640 1 -- 172.21.15.40:0/2909811031 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160a60 msgr2=0x7fe1100ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe11636a640 1 --2- 172.21.15.40:0/2909811031 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160a60 0x7fe1100ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe11636a640 1 -- 172.21.15.40:0/2909811031 >> v1:172.21.15.40:6789/0 conn(0x7fe1100b3e30 legacy=0x7fe1100cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe11636a640 1 -- 172.21.15.40:0/2909811031 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100d18f0 con 0x7fe110160680 2023-11-04T01:48:10.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe11636a640 1 --2- 172.21.15.40:0/2909811031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160680 0x7fe1100cdba0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0097c0 tx=0x7fe10c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390030ba92fe432d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:10.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.043+0000 7fe115368640 1 -- 172.21.15.40:0/2909811031 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0ac620 con 0x7fe110160680 2023-11-04T01:48:10.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe115368640 1 -- 172.21.15.40:0/2909811031 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0ac780 con 0x7fe110160680 2023-11-04T01:48:10.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe115368640 1 -- 172.21.15.40:0/2909811031 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0acb10 con 0x7fe110160680 2023-11-04T01:48:10.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2909811031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160680 msgr2=0x7fe1100cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2909811031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160680 0x7fe1100cdba0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0097c0 tx=0x7fe10c01c3c0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2909811031 shutdown_connections 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2909811031 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160a60 0x7fe1100ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2909811031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160680 0x7fe1100cdba0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2909811031 >> 172.21.15.40:0/2909811031 conn(0x7fe1100d2f90 msgr2=0x7fe1100d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2909811031 shutdown_connections 2023-11-04T01:48:10.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2909811031 wait complete. 2023-11-04T01:48:10.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 Processor -- start 2023-11-04T01:48:10.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- start start 2023-11-04T01:48:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1100b3e30 0x7fe110156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160680 0x7fe1100c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 0x7fe1100cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100cb360 con 0x7fe110160a60 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100cbbe0 con 0x7fe1100b3e30 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1100ca060 con 0x7fe110160680 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 0x7fe1100cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 0x7fe1100cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35858/0 (socket says 172.21.15.40:35858) 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 -- 172.21.15.40:0/2253491173 learned_addr learned my addr 172.21.15.40:0/2253491173 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe11636a640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1100b3e30 0x7fe110156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe115b69640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160680 0x7fe1100c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 -- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160680 msgr2=0x7fe1100c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160680 0x7fe1100c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 -- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1100b3e30 msgr2=0x7fe110156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1100b3e30 0x7fe110156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 -- 172.21.15.40:0/2253491173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009420 con 0x7fe110160a60 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe11636a640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1100b3e30 0x7fe110156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe115b69640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160680 0x7fe1100c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe116b6b640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 0x7fe1100cae20 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe10800cb40 tx=0x7fe10800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800aca0 con 0x7fe110160a60 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800ae00 con 0x7fe110160a60 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108012620 con 0x7fe110160a60 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100ca340 con 0x7fe110160a60 2023-11-04T01:48:10.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.047+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1100ca900 con 0x7fe110160a60 2023-11-04T01:48:10.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.051+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1100caaf0 con 0x7fe110160a60 2023-11-04T01:48:10.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.051+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe108007070 con 0x7fe110160a60 2023-11-04T01:48:10.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.051+0000 7fe106ffd640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0f40664a0 0x7fe0f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.051+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 7906+0+0 (secure 0 0 0) 0x7fe108084790 con 0x7fe110160a60 2023-11-04T01:48:10.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.051+0000 7fe11636a640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0f40664a0 0x7fe0f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.051+0000 7fe11636a640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0f40664a0 0x7fe0f4068960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0ae000 tx=0x7fe10c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:10.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.055+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe108051360 con 0x7fe110160a60 2023-11-04T01:48:10.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.243+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe11004e4a0 con 0x7fe110160a60 2023-11-04T01:48:10.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.243+0000 7fe106ffd640 1 -- 172.21.15.40:0/2253491173 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4928 (secure 0 0 0) 0x7fe108017090 con 0x7fe110160a60 2023-11-04T01:48:10.248 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:10.248 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":121,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:48:03.335158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:10.249 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 121 2023-11-04T01:48:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0f40664a0 msgr2=0x7fe0f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0f40664a0 0x7fe0f4068960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0ae000 tx=0x7fe10c008040 comp rx=0 tx=0).stop 2023-11-04T01:48:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 msgr2=0x7fe1100cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 0x7fe1100cae20 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe10800cb40 tx=0x7fe10800a060 comp rx=0 tx=0).stop 2023-11-04T01:48:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 shutdown_connections 2023-11-04T01:48:10.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fe0f40664a0 0x7fe0f4068960 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110160a60 0x7fe1100cae20 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fe110160680 0x7fe1100c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 --2- 172.21.15.40:0/2253491173 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe1100b3e30 0x7fe110156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 >> 172.21.15.40:0/2253491173 conn(0x7fe1100d2f90 msgr2=0x7fe110158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 shutdown_connections 2023-11-04T01:48:10.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:10.247+0000 7fe1185ce640 1 -- 172.21.15.40:0/2253491173 wait complete. 2023-11-04T01:48:10.267 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:14.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:48:15.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.399+0000 7f3655716640 1 Processor -- start 2023-11-04T01:48:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.399+0000 7f3655716640 1 -- start start 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f3655716640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160680 0x7f36500cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f3655716640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3650160a60 0x7f36500ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f3655716640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36500cf000 con 0x7f36500b3e30 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f3655716640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500b5de0 con 0x7f3650160a60 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f3655716640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500d1610 con 0x7f3650160680 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3650160a60 0x7f36500ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f36500b3e30 0x7f36500cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52012/0 (socket says 172.21.15.40:52012) 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364f7fe640 1 -- 172.21.15.40:0/2844375584 learned_addr learned my addr 172.21.15.40:0/2844375584 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364effd640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160680 0x7f36500cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364e7fc640 1 -- 172.21.15.40:0/2844375584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160680 msgr2=0x7f36500cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364e7fc640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160680 0x7f36500cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364e7fc640 1 -- 172.21.15.40:0/2844375584 >> v1:172.21.15.40:6789/0 conn(0x7f36500b3e30 legacy=0x7f36500cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364e7fc640 1 -- 172.21.15.40:0/2844375584 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500d18f0 con 0x7f3650160a60 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364effd640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160680 0x7f36500cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364e7fc640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3650160a60 0x7f36500ce0e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f36440097c0 tx=0x7f364401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e984097e135d2d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364dffb640 1 -- 172.21.15.40:0/2844375584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440ac620 con 0x7f3650160a60 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364dffb640 1 -- 172.21.15.40:0/2844375584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36440ac780 con 0x7f3650160a60 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.403+0000 7f364dffb640 1 -- 172.21.15.40:0/2844375584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440acb10 con 0x7f3650160a60 2023-11-04T01:48:15.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- 172.21.15.40:0/2844375584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3650160a60 msgr2=0x7f36500ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3650160a60 0x7f36500ce0e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f36440097c0 tx=0x7f364401c3c0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- 172.21.15.40:0/2844375584 shutdown_connections 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3650160a60 0x7f36500ce0e0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 --2- 172.21.15.40:0/2844375584 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160680 0x7f36500cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- 172.21.15.40:0/2844375584 >> 172.21.15.40:0/2844375584 conn(0x7f36500d2f90 msgr2=0x7f36500d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- 172.21.15.40:0/2844375584 shutdown_connections 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- 172.21.15.40:0/2844375584 wait complete. 2023-11-04T01:48:15.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 Processor -- start 2023-11-04T01:48:15.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- start start 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 0x7f36500ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3650160680 0x7f3650155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160a60 0x7f3650156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cd570 con 0x7f36500b3e30 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501578e0 con 0x7f3650160680 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f3655716640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500ccfb0 con 0x7f3650160a60 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 0x7f36500ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 0x7f36500ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35874/0 (socket says 172.21.15.40:35874) 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 -- 172.21.15.40:0/2224691221 learned_addr learned my addr 172.21.15.40:0/2224691221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364f7fe640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160a60 0x7f3650156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364e7fc640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3650160680 0x7f3650155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 -- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160a60 msgr2=0x7f3650156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160a60 0x7f3650156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 -- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3650160680 msgr2=0x7f3650155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3650160680 0x7f3650155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 -- 172.21.15.40:0/2224691221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644009420 con 0x7f36500b3e30 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364f7fe640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160a60 0x7f3650156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364e7fc640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3650160680 0x7f3650155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.407+0000 7f364effd640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 0x7f36500ca060 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f364000c7c0 tx=0x7f364000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640007a30 con 0x7f36500b3e30 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640007b90 con 0x7f36500b3e30 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500cd290 con 0x7f36500b3e30 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000ce70 con 0x7f36500b3e30 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365015c8c0 con 0x7f36500b3e30 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365015c440 con 0x7f36500b3e30 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36400113f0 con 0x7f36500b3e30 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f36377fe640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664d0 0x7f363c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f3640084ab0 con 0x7f36500b3e30 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f364e7fc640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664d0 0x7f363c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.411+0000 7f364e7fc640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664d0 0x7f363c068990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f36440ae000 tx=0x7f36440a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.415+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f365015c440 con 0x7f36500b3e30 2023-11-04T01:48:15.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.603+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f365015c440 con 0x7f36500b3e30 2023-11-04T01:48:15.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.603+0000 7f36377fe640 1 -- 172.21.15.40:0/2224691221 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4928 (secure 0 0 0) 0x7f365015c440 con 0x7f36500b3e30 2023-11-04T01:48:15.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:15.607 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":121,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:48:03.335158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:15.608 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 121 2023-11-04T01:48:15.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664d0 msgr2=0x7f363c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664d0 0x7f363c068990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f36440ae000 tx=0x7f36440a7000 comp rx=0 tx=0).stop 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 msgr2=0x7f36500ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 0x7f36500ca060 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f364000c7c0 tx=0x7f364000cc80 comp rx=0 tx=0).stop 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 shutdown_connections 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f363c0664d0 0x7f363c068990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f3650160a60 0x7f3650156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3650160680 0x7f3650155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 --2- 172.21.15.40:0/2224691221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36500b3e30 0x7f36500ca060 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 >> 172.21.15.40:0/2224691221 conn(0x7f36500d2f90 msgr2=0x7f36500d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 shutdown_connections 2023-11-04T01:48:15.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:15.607+0000 7f3655716640 1 -- 172.21.15.40:0/2224691221 wait complete. 2023-11-04T01:48:15.627 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:20.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.755+0000 7fbd37903640 1 Processor -- start 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.755+0000 7fbd37903640 1 -- start start 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd37903640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 0x7fbd3015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd37903640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbd300cbd80 0x7fbd300cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd37903640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd300ca100 con 0x7fbd30142ad0 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd37903640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd300ca3e0 con 0x7fbd300cbd80 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd37903640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300ca6c0 con 0x7fbd30142eb0 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd3569f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbd30142ad0 0x7fbd300cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43948/0 (socket says 172.21.15.40:43948) 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd3569f640 1 -- 172.21.15.40:0/3085257948 learned_addr learned my addr 172.21.15.40:0/3085257948 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd34e9e640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 0x7fbd3015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/3085257948 >> v2:172.21.15.91:3300/0 conn(0x7fbd300cbd80 0x7fbd300cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384329896 0 0) 0x7fbd300ca100 con 0x7fbd30142ad0 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd1c003530 con 0x7fbd30142ad0 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3048855510 0 0) 0x7fbd1c003530 con 0x7fbd30142ad0 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 msgr2=0x7fbd3015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 0x7fbd3015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 >> v2:172.21.15.91:3300/0 conn(0x7fbd300cbd80 msgr2=0x7fbd300cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 --2- 172.21.15.40:0/3085257948 >> v2:172.21.15.91:3300/0 conn(0x7fbd300cbd80 0x7fbd300cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd300ca9a0 con 0x7fbd30142ad0 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fbd240016a0 con 0x7fbd30142ad0 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 >> v1:172.21.15.40:6789/0 conn(0x7fbd30142ad0 legacy=0x7fbd300cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd1c003980 0x7fbd1c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 0x7fbd1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c004d10 0x7fbd1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300ca3e0 con 0x7fbd1c004d10 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300ca6c0 con 0x7fbd1c003980 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c00b9c0 con 0x7fbd30142eb0 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c004d10 0x7fbd1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd34e9e640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 0x7fbd1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd3569f640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd1c003980 0x7fbd1c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 -- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 msgr2=0x7fbd1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd30142eb0 0x7fbd1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 -- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd1c003980 msgr2=0x7fbd1c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd1c003980 0x7fbd1c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd35ea0640 1 -- 172.21.15.40:0/3085257948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c003530 con 0x7fbd1c004d10 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.759+0000 7fbd3569f640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd1c003980 0x7fbd1c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c004d10 0x7fbd1c005190 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009fc0 tx=0x7fbd2801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb6baf8ae808a9e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a5cb0 con 0x7fbd1c004d10 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2800f040 con 0x7fbd1c004d10 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd23fff640 1 -- 172.21.15.40:0/3085257948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280ad680 con 0x7fbd1c004d10 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- 172.21.15.40:0/3085257948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c004d10 msgr2=0x7fbd1c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 --2- 172.21.15.40:0/3085257948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c004d10 0x7fbd1c005190 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009fc0 tx=0x7fbd2801cca0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd35ea0640 1 -- 172.21.15.40:0/3085257948 reap_dead start 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- 172.21.15.40:0/3085257948 shutdown_connections 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- 172.21.15.40:0/3085257948 >> 172.21.15.40:0/3085257948 conn(0x7fbd300b0890 msgr2=0x7fbd300b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- 172.21.15.40:0/3085257948 shutdown_connections 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- 172.21.15.40:0/3085257948 wait complete. 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 Processor -- start 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- start start 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd30159a80 0x7fbd300c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 0x7fbd300c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd3013d810 0x7fbd300c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300b4850 con 0x7fbd300c75f0 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c5d30 con 0x7fbd30159a80 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd37903640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c6010 con 0x7fbd3013d810 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd34e9e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 0x7fbd300c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd34e9e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 0x7fbd300c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54808/0 (socket says 172.21.15.40:54808) 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd34e9e640 1 -- 172.21.15.40:0/590241382 learned_addr learned my addr 172.21.15.40:0/590241382 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd3569f640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd30159a80 0x7fbd300c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.763+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd3013d810 0x7fbd300c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd34e9e640 1 -- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd3013d810 msgr2=0x7fbd300c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd34e9e640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd3013d810 0x7fbd300c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd34e9e640 1 -- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd30159a80 msgr2=0x7fbd300c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd34e9e640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd30159a80 0x7fbd300c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd34e9e640 1 -- 172.21.15.40:0/590241382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd300c62f0 con 0x7fbd300c75f0 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd3569f640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd30159a80 0x7fbd300c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd35ea0640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd3013d810 0x7fbd300c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd34e9e640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 0x7fbd300c7fb0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0115e0 tx=0x7fbd2c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00f8f0 con 0x7fbd300c75f0 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00fa50 con 0x7fbd300c75f0 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd300c65d0 con 0x7fbd300c75f0 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00fdc0 con 0x7fbd300c75f0 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd300c6b90 con 0x7fbd300c75f0 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3004e4a0 con 0x7fbd300c75f0 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd2c015460 con 0x7fbd300c75f0 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd21ffb640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd140664a0 0x7fbd14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fbd2c084fd0 con 0x7fbd300c75f0 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.767+0000 7fbd3569f640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd140664a0 0x7fbd14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.771+0000 7fbd3569f640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd140664a0 0x7fbd14068960 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000fe0 tx=0x7fbd240015a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.771+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd2c051be0 con 0x7fbd300c75f0 2023-11-04T01:48:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.959+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd3006d010 con 0x7fbd300c75f0 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.959+0000 7fbd21ffb640 1 -- 172.21.15.40:0/590241382 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4976 (secure 0 0 0) 0x7fbd2c055200 con 0x7fbd300c75f0 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":122,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5738,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/1834274207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":1834274207},{"type":"v1","addr":"172.21.15.91:6835","nonce":1834274207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7237,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/2492094545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":2492094545},{"type":"v1","addr":"172.21.15.91:6837","nonce":2492094545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:15.493516+0000","modified":"2023-11-04T01:48:18.086256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8247,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":113,"state":"up:active","state_seq":20,"addr":"172.21.15.40:6833/685602585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":685602585},{"type":"v1","addr":"172.21.15.40:6833","nonce":685602585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":116,"state":"up:active","state_seq":7,"addr":"172.21.15.40:6835/41697885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":41697885},{"type":"v1","addr":"172.21.15.40:6835","nonce":41697885}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:48:18.086256+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 122 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd140664a0 msgr2=0x7fbd14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd140664a0 0x7fbd14068960 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000fe0 tx=0x7fbd240015a0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 msgr2=0x7fbd300c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 0x7fbd300c7fb0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0115e0 tx=0x7fbd2c011aa0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 shutdown_connections 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fbd140664a0 0x7fbd14068960 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fbd3013d810 0x7fbd300c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd300c75f0 0x7fbd300c7fb0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 --2- 172.21.15.40:0/590241382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbd30159a80 0x7fbd300c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 >> 172.21.15.40:0/590241382 conn(0x7fbd300b0890 msgr2=0x7fbd300c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 shutdown_connections 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:20.963+0000 7fbd37903640 1 -- 172.21.15.40:0/590241382 wait complete. 2023-11-04T01:48:20.984 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:48:20.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:48:20.993 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:48:20.994 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:48:20.994 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:48:21.050 INFO:teuthology.orchestra.run.smithi040.stdout:1699062484.60454.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:48:21.052 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062484.60454.core'] 2023-11-04T01:48:21.052 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062484.60454.core, deleting it 2023-11-04T01:48:21.053 DEBUG:teuthology.orchestra.run.smithi040:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062484.60454.core 2023-11-04T01:48:21.113 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:48:21.113 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:21.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 down 2023-11-04T01:48:21.175 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:48:21.175 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:48:21.175 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:21.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:48:21.269 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:48:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 Processor -- start 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 -- start start 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70480cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f70480ce7f0 0x7f70480b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70480cf000 con 0x7f7048160a60 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70480d09b0 con 0x7f70480ce7f0 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704ee82640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480b5de0 con 0x7f7048160680 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f7047fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7048160a60 0x7f70480ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43964/0 (socket says 172.21.15.40:43964) 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f7047fff640 1 -- 172.21.15.40:0/1949934346 learned_addr learned my addr 172.21.15.40:0/1949934346 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704d41f640 1 --2- 172.21.15.40:0/1949934346 >> v2:172.21.15.91:3300/0 conn(0x7f70480ce7f0 0x7f70480b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70480cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026043304 0 0) 0x7f70480cf000 con 0x7f7048160a60 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7030003530 con 0x7f7048160a60 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933231878 0 0) 0x7f7030003530 con 0x7f7048160a60 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 msgr2=0x7f70480cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70480cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 >> v2:172.21.15.91:3300/0 conn(0x7f70480ce7f0 msgr2=0x7f70480b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 --2- 172.21.15.40:0/1949934346 >> v2:172.21.15.91:3300/0 conn(0x7f70480ce7f0 0x7f70480b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480d1610 con 0x7f7048160a60 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f703c001680 con 0x7f7048160a60 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 >> v1:172.21.15.40:6789/0 conn(0x7f7048160a60 legacy=0x7f70480ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7030003980 0x7f7030003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7030004d10 0x7f7030005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480d09b0 con 0x7f7030003980 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480b5de0 con 0x7f7030004d10 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703000b990 con 0x7f7048160680 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7030003980 0x7f7030003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f7047fff640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 -- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 msgr2=0x7f70300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704d41f640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7030004d10 0x7f7030005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 -- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7030004d10 msgr2=0x7f7030005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7030004d10 0x7f7030005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f704cc1e640 1 -- 172.21.15.40:0/1949934346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030003530 con 0x7f7030003980 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.399+0000 7f7047fff640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7048160680 0x7f70300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7030003980 0x7f7030003da0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ae0 tx=0x7f703801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced4ecd83ec26315 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380a55f0 con 0x7f7030003980 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70380a5750 con 0x7f7030003980 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f70477fe640 1 -- 172.21.15.40:0/1949934346 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380a5b00 con 0x7f7030003980 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 -- 172.21.15.40:0/1949934346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7030003980 msgr2=0x7f7030003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 --2- 172.21.15.40:0/1949934346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7030003980 0x7f7030003da0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ae0 tx=0x7f703801ca20 comp rx=0 tx=0).stop 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704d41f640 1 -- 172.21.15.40:0/1949934346 reap_dead start 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 -- 172.21.15.40:0/1949934346 shutdown_connections 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 -- 172.21.15.40:0/1949934346 >> 172.21.15.40:0/1949934346 conn(0x7f70480d2f90 msgr2=0x7f70480d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 -- 172.21.15.40:0/1949934346 shutdown_connections 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 -- 172.21.15.40:0/1949934346 wait complete. 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 Processor -- start 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.403+0000 7f704ee82640 1 -- start start 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7030003980 0x7f704809ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 0x7f704806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f704815ce10 0x7f704815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704809f420 con 0x7f70480c99d0 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70481f6bb0 con 0x7f704815ce10 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480c9e50 con 0x7f7030003980 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 0x7f704806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 0x7f704806bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54830/0 (socket says 172.21.15.40:54830) 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 -- 172.21.15.40:0/1032013733 learned_addr learned my addr 172.21.15.40:0/1032013733 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7030003980 0x7f704809ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704d41f640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f704815ce10 0x7f704815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 -- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7030003980 msgr2=0x7f704809ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7030003980 0x7f704809ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 -- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f704815ce10 msgr2=0x7f704815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f704815ce10 0x7f704815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 -- 172.21.15.40:0/1032013733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70481f5b30 con 0x7f70480c99d0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f7047fff640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 0x7f704806bc90 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d810 tx=0x7f703c00dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0074e0 con 0x7f70480c99d0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c007640 con 0x7f70480c99d0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0049f0 con 0x7f70480c99d0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70481f5e10 con 0x7f70480c99d0 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70481f63d0 con 0x7f70480c99d0 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704804e4a0 con 0x7f70480c99d0 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f703c004b50 con 0x7f70480c99d0 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f70457fa640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70340664a0 0x7f7034068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f703c0843b0 con 0x7f70480c99d0 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.407+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70340664a0 0x7f7034068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.411+0000 7f704cc1e640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70340664a0 0x7f7034068960 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f70380af000 tx=0x7f70380046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.411+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f703c0510a0 con 0x7f70480c99d0 2023-11-04T01:48:21.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:48:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.571+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70480725f0 con 0x7f70480c99d0 2023-11-04T01:48:21.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f70457fa640 1 -- 172.21.15.40:0/1032013733 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23348 (secure 0 0 0) 0x7f703c019090 con 0x7f70480c99d0 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":116,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:48:13.050549+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":114,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/1658130781":"2023-11-04T02:47:52.686288+0000","172.21.15.91:6836/2209627414":"2023-11-05T01:47:44.960567+0000","192.168.0.1:0/2884841846":"2023-11-04T02:46:56.954663+0000","172.21.15.40:6835/3996815211":"2023-11-05T01:47:37.592112+0000","172.21.15.91:6836/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.91:6837/2209627414":"2023-11-05T01:47:44.960567+0000","172.21.15.40:6835/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6837/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.91:6836/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6833/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.40:6835/2918977483":"2023-11-05T01:45:57.090700+0000","172.21.15.40:6832/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.91:6837/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6832/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/3996815211":"2023-11-05T01:47:37.592112+0000","172.21.15.91:6837/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.40:6834/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6835/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6833/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6836/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.40:6834/2918977483":"2023-11-05T01:45:57.090700+0000","192.168.0.1:0/771372867":"2023-11-04T02:46:12.185534+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":12,"length":1},{"begin":14,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:48:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70340664a0 msgr2=0x7f7034068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70340664a0 0x7f7034068960 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f70380af000 tx=0x7f70380046d0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 msgr2=0x7f704806bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 0x7f704806bc90 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d810 tx=0x7f703c00dcd0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 shutdown_connections 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f70340664a0 0x7f7034068960 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f704815ce10 0x7f704815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70480c99d0 0x7f704806bc90 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 --2- 172.21.15.40:0/1032013733 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f7030003980 0x7f704809ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 >> 172.21.15.40:0/1032013733 conn(0x7f70480d2f90 msgr2=0x7f70480b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 shutdown_connections 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.575+0000 7f704ee82640 1 -- 172.21.15.40:0/1032013733 wait complete. 2023-11-04T01:48:21.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:14.041287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:14.473992+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 114, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:48:21.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 Processor -- start 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 -- start start 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f27600d1cb0 0x7f27600d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 0x7f27600b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27600d09b0 con 0x7f276015d1c0 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600d0110 con 0x7f27600d1cb0 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2766979640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600d03f0 con 0x7f276015d5a0 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f276015d1c0 0x7f27600d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43968/0 (socket says 172.21.15.40:43968) 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275ffff640 1 -- 172.21.15.40:0/3602636357 learned_addr learned my addr 172.21.15.40:0/3602636357 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499428388 0 0) 0x7f27600d09b0 con 0x7f276015d1c0 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c003530 con 0x7f276015d1c0 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 0x7f27600b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275f7fe640 1 --2- 172.21.15.40:0/3602636357 >> v2:172.21.15.91:3300/0 conn(0x7f27600d1cb0 0x7f27600d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3666350640 0 0) 0x7f274c003530 con 0x7f276015d1c0 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 msgr2=0x7f27600b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 0x7f27600b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 >> v2:172.21.15.91:3300/0 conn(0x7f27600d1cb0 msgr2=0x7f27600d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 --2- 172.21.15.40:0/3602636357 >> v2:172.21.15.91:3300/0 conn(0x7f27600d1cb0 0x7f27600d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600d06d0 con 0x7f276015d1c0 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f27500016a0 con 0x7f276015d1c0 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 >> v1:172.21.15.40:6789/0 conn(0x7f276015d1c0 legacy=0x7f27600d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c003980 0x7f274c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 0x7f274c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f274c004d10 0x7f274c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600d0110 con 0x7f274c004d10 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600d03f0 con 0x7f274c003980 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c00bac0 con 0x7f276015d5a0 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f274c004d10 0x7f274c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275f7fe640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 0x7f274c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f275ffff640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c003980 0x7f274c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 -- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 msgr2=0x7f274c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f276015d5a0 0x7f274c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 -- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c003980 msgr2=0x7f274c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c003980 0x7f274c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.723+0000 7f2764f16640 1 -- 172.21.15.40:0/3602636357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c003530 con 0x7f274c004d10 2023-11-04T01:48:21.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2764f16640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f274c004d10 0x7f274c005190 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f2758007360 tx=0x7f275801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd66777eaefc6c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580a5d20 con 0x7f274c004d10 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27580a5e80 con 0x7f274c004d10 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f275effd640 1 -- 172.21.15.40:0/3602636357 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580ad660 con 0x7f274c004d10 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 -- 172.21.15.40:0/3602636357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f274c004d10 msgr2=0x7f274c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 --2- 172.21.15.40:0/3602636357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f274c004d10 0x7f274c005190 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f2758007360 tx=0x7f275801ce20 comp rx=0 tx=0).stop 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2764f16640 1 -- 172.21.15.40:0/3602636357 reap_dead start 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 -- 172.21.15.40:0/3602636357 shutdown_connections 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 -- 172.21.15.40:0/3602636357 >> 172.21.15.40:0/3602636357 conn(0x7f27600d2fc0 msgr2=0x7f27600d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 -- 172.21.15.40:0/3602636357 shutdown_connections 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 -- 172.21.15.40:0/3602636357 wait complete. 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.727+0000 7f2766979640 1 Processor -- start 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- start start 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c004d10 0x7f27600b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 0x7f276015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27600b2bc0 0x7f27600b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b59a0 con 0x7f27601f30e0 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b3590 con 0x7f274c004d10 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b56c0 con 0x7f27600b2bc0 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 0x7f276015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 0x7f276015a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54844/0 (socket says 172.21.15.40:54844) 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 -- 172.21.15.40:0/2706053730 learned_addr learned my addr 172.21.15.40:0/2706053730 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275ffff640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c004d10 0x7f27600b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2764f16640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27600b2bc0 0x7f27600b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 -- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27600b2bc0 msgr2=0x7f27600b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27600b2bc0 0x7f27600b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 -- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c004d10 msgr2=0x7f27600b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c004d10 0x7f27600b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 -- 172.21.15.40:0/2706053730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27601f39c0 con 0x7f27601f30e0 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275ffff640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c004d10 0x7f27600b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2764f16640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27600b2bc0 0x7f27600b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275f7fe640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 0x7f276015a650 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f274800f630 tx=0x7f274800faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748014870 con 0x7f27601f30e0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480149d0 con 0x7f27601f30e0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27601f3ca0 con 0x7f27601f30e0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748014d80 con 0x7f27601f30e0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27601f3560 con 0x7f27601f30e0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27601f3820 con 0x7f27601f30e0 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f274800d490 con 0x7f27601f30e0 2023-11-04T01:48:21.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275cff9640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27400664a0 0x7f2740068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.731+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f2748085190 con 0x7f27601f30e0 2023-11-04T01:48:21.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.735+0000 7f275ffff640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27400664a0 0x7f2740068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.735+0000 7f275ffff640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27400664a0 0x7f2740068960 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f276006ab30 tx=0x7f2750001c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.735+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27601f3820 con 0x7f27601f30e0 2023-11-04T01:48:21.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.891+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27601f3820 con 0x7f27601f30e0 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f275cff9640 1 -- 172.21.15.40:0/2706053730 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27601f3820 con 0x7f27601f30e0 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27400664a0 msgr2=0x7f2740068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27400664a0 0x7f2740068960 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f276006ab30 tx=0x7f2750001c00 comp rx=0 tx=0).stop 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 msgr2=0x7f276015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 0x7f276015a650 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f274800f630 tx=0x7f274800faf0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 shutdown_connections 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f27400664a0 0x7f2740068960 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f27600b2bc0 0x7f27600b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27601f30e0 0x7f276015a650 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 --2- 172.21.15.40:0/2706053730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f274c004d10 0x7f27600b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 >> 172.21.15.40:0/2706053730 conn(0x7f27600d2fc0 msgr2=0x7f27600b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 shutdown_connections 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:21.895+0000 7f2766979640 1 -- 172.21.15.40:0/2706053730 wait complete. 2023-11-04T01:48:21.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:48:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.027+0000 7f2702add640 1 Processor -- start 2023-11-04T01:48:22.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.027+0000 7f2702add640 1 -- start start 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2702add640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f26fc0d0790 0x7f26fc0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2702add640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc0d0ba0 con 0x7f26fc15b120 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2702add640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc15eca0 con 0x7f26fc0b2fb0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2702add640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc0d0470 con 0x7f26fc0d0790 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f26fc15b120 0x7f26fc0b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43982/0 (socket says 172.21.15.40:43982) 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 -- 172.21.15.40:0/381497210 learned_addr learned my addr 172.21.15.40:0/381497210 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079028864 0 0) 0x7f26fc0d0ba0 con 0x7f26fc15b120 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f270107a640 1 --2- 172.21.15.40:0/381497210 >> v2:172.21.15.91:3300/0 conn(0x7f26fc0d0790 0x7f26fc0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e4003530 con 0x7f26fc15b120 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2928147644 0 0) 0x7f26e4003530 con 0x7f26fc15b120 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 >> v2:172.21.15.91:3300/0 conn(0x7f26fc0d0790 msgr2=0x7f26fc0cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 --2- 172.21.15.40:0/381497210 >> v2:172.21.15.91:3300/0 conn(0x7f26fc0d0790 0x7f26fc0cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 >> v1:172.21.15.91:6789/0 conn(0x7f26fc0b2fb0 legacy=0x7f26fc0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc15ef80 con 0x7f26fc15b120 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f26f8001680 con 0x7f26fc15b120 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 >> v1:172.21.15.40:6789/0 conn(0x7f26fc15b120 legacy=0x7f26fc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26e4003980 0x7f26e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e40047d0 0x7f26e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26e4005190 0x7f26e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0d0470 con 0x7f26e4003980 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e400c030 con 0x7f26e40047d0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e400c1f0 con 0x7f26e4005190 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26e4003980 0x7f26e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f26f3fff640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e40047d0 0x7f26e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f270107a640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26e4005190 0x7f26e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 -- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26e4005190 msgr2=0x7f26e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26e4005190 0x7f26e400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 -- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e40047d0 msgr2=0x7f26e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e40047d0 0x7f26e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f2700879640 1 -- 172.21.15.40:0/381497210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4003530 con 0x7f26e4003980 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.031+0000 7f270107a640 1 -- 172.21.15.40:0/381497210 reap_dead start 2023-11-04T01:48:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2700879640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26e4003980 0x7f26e4003da0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c240 tx=0x7f26f801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150f052a45fc950a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8005ae0 con 0x7f26e4003980 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8005c40 con 0x7f26e4003980 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f26f37fe640 1 -- 172.21.15.40:0/381497210 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80072b0 con 0x7f26e4003980 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- 172.21.15.40:0/381497210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26e4003980 msgr2=0x7f26e4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26e4003980 0x7f26e4003da0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c240 tx=0x7f26f801cbc0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- 172.21.15.40:0/381497210 shutdown_connections 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 --2- 172.21.15.40:0/381497210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26e4003980 0x7f26e4003da0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- 172.21.15.40:0/381497210 >> 172.21.15.40:0/381497210 conn(0x7f26fc0cd8a0 msgr2=0x7f26fc0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- 172.21.15.40:0/381497210 shutdown_connections 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- 172.21.15.40:0/381497210 wait complete. 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 Processor -- start 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- start start 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e4003980 0x7f26fc1f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26fc0c9ee0 0x7f26fc0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 0x7f26fc144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc144590 con 0x7f26fc143bc0 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0caf90 con 0x7f26e4003980 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2702add640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc1f8cf0 con 0x7f26fc0c9ee0 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 0x7f26fc144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 0x7f26fc144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54864/0 (socket says 172.21.15.40:54864) 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 -- 172.21.15.40:0/978580532 learned_addr learned my addr 172.21.15.40:0/978580532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f2700879640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e4003980 0x7f26fc1f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f26f3fff640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26fc0c9ee0 0x7f26fc0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 -- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26fc0c9ee0 msgr2=0x7f26fc0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26fc0c9ee0 0x7f26fc0c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 -- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e4003980 msgr2=0x7f26fc1f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e4003980 0x7f26fc1f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.035+0000 7f270107a640 1 -- 172.21.15.40:0/978580532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0ca380 con 0x7f26fc143bc0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f270107a640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 0x7f26fc144050 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f26fc070940 tx=0x7f26f400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f401a070 con 0x7f26fc143bc0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f400fe50 con 0x7f26fc143bc0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc0ca660 con 0x7f26fc143bc0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4003bc0 con 0x7f26fc143bc0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc0cac20 con 0x7f26fc143bc0 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc15ea80 con 0x7f26fc143bc0 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26f4016420 con 0x7f26fc143bc0 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f26f17fa640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26e80664d0 0x7f26e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f26f4084da0 con 0x7f26fc143bc0 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f2700879640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26e80664d0 0x7f26e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.039+0000 7f2700879640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26e80664d0 0x7f26e8068990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26f80ab000 tx=0x7f26f80b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.043+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26f4051a40 con 0x7f26fc143bc0 2023-11-04T01:48:22.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.195+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f26fc0cb370 con 0x7f26fc143bc0 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f26f17fa640 1 -- 172.21.15.40:0/978580532 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f26f4055060 con 0x7f26fc143bc0 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26e80664d0 msgr2=0x7f26e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26e80664d0 0x7f26e8068990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26f80ab000 tx=0x7f26f80b1040 comp rx=0 tx=0).stop 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 msgr2=0x7f26fc144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 0x7f26fc144050 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f26fc070940 tx=0x7f26f400f520 comp rx=0 tx=0).stop 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 shutdown_connections 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f26e80664d0 0x7f26e8068990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26fc143bc0 0x7f26fc144050 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f26fc0c9ee0 0x7f26fc0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 --2- 172.21.15.40:0/978580532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f26e4003980 0x7f26fc1f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 >> 172.21.15.40:0/978580532 conn(0x7f26fc0cd8a0 msgr2=0x7f26fc06f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 shutdown_connections 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.199+0000 7f2702add640 1 -- 172.21.15.40:0/978580532 wait complete. 2023-11-04T01:48:22.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:48:22.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 Processor -- start 2023-11-04T01:48:22.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 -- start start 2023-11-04T01:48:22.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640cabd0 0x7fc9640cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9640af2d0 0x7fc9640af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96406fe50 con 0x7fc9641556c0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640cb590 con 0x7fc9640af2d0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96c29a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640ae7f0 con 0x7fc9640cabd0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9640af2d0 0x7fc9640af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9640af2d0 0x7fc9640af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54878/0 (socket says 172.21.15.40:54878) 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 -- 172.21.15.40:0/1420502840 learned_addr learned my addr 172.21.15.40:0/1420502840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc969835640 1 --2- 172.21.15.40:0/1420502840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640cabd0 0x7fc9640cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 -- 172.21.15.40:0/1420502840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640cabd0 msgr2=0x7fc9640cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 --2- 172.21.15.40:0/1420502840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640cabd0 0x7fc9640cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 -- 172.21.15.40:0/1420502840 >> v1:172.21.15.91:6789/0 conn(0x7fc9641556c0 legacy=0x7fc96415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.347+0000 7fc96a837640 1 -- 172.21.15.40:0/1420502840 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640aead0 con 0x7fc9640af2d0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 --2- 172.21.15.40:0/1420502840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640af2d0 0x7fc9640af760 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009e50 tx=0x7fc95c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1952ee9ec3080f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc969034640 1 -- 172.21.15.40:0/1420502840 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a57c0 con 0x7fc9640af2d0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc969034640 1 -- 172.21.15.40:0/1420502840 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0a5920 con 0x7fc9640af2d0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc969034640 1 -- 172.21.15.40:0/1420502840 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a5cb0 con 0x7fc9640af2d0 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- 172.21.15.40:0/1420502840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640af2d0 msgr2=0x7fc9640af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1420502840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640af2d0 0x7fc9640af760 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009e50 tx=0x7fc95c01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- 172.21.15.40:0/1420502840 shutdown_connections 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1420502840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9640af2d0 0x7fc9640af760 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1420502840 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640cabd0 0x7fc9640cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- 172.21.15.40:0/1420502840 >> 172.21.15.40:0/1420502840 conn(0x7fc9640ced10 msgr2=0x7fc9640cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- 172.21.15.40:0/1420502840 shutdown_connections 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- 172.21.15.40:0/1420502840 wait complete. 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 Processor -- start 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- start start 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640af2d0 0x7fc964150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9640cabd0 0x7fc964165460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 0x7fc964152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964156100 con 0x7fc9641556c0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964155dd0 con 0x7fc9640cabd0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96c29a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964158520 con 0x7fc9640af2d0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 0x7fc964152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 0x7fc964152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54888/0 (socket says 172.21.15.40:54888) 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 -- 172.21.15.40:0/1783149675 learned_addr learned my addr 172.21.15.40:0/1783149675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a036640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640af2d0 0x7fc964150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc969835640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9640cabd0 0x7fc964165460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 -- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640af2d0 msgr2=0x7fc964150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640af2d0 0x7fc964150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 -- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9640cabd0 msgr2=0x7fc964165460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9640cabd0 0x7fc964165460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 -- 172.21.15.40:0/1783149675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009b30 con 0x7fc9641556c0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc96a837640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 0x7fc964152cd0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0af040 tx=0x7fc95c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0bd070 con 0x7fc9641556c0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0b8470 con 0x7fc9641556c0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.351+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0b8840 con 0x7fc9641556c0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc964158800 con 0x7fc9641556c0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc964158ae0 con 0x7fc9641556c0 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc964068460 con 0x7fc9641556c0 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc95c0b89a0 con 0x7fc9641556c0 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc95affd640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9480664d0 0x7fc948068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fc95c11f1d0 con 0x7fc9641556c0 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc96a036640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9480664d0 0x7fc948068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.355+0000 7fc96a036640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9480664d0 0x7fc948068990 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc964154d40 tx=0x7fc960009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.359+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc95c0ebe70 con 0x7fc9641556c0 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.511+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc964068460 con 0x7fc9641556c0 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.511+0000 7fc95affd640 1 -- 172.21.15.40:0/1783149675 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc95c0ef490 con 0x7fc9641556c0 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:22.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9480664d0 msgr2=0x7fc948068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9480664d0 0x7fc948068990 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc964154d40 tx=0x7fc960009040 comp rx=0 tx=0).stop 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 msgr2=0x7fc964152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 0x7fc964152cd0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0af040 tx=0x7fc95c019740 comp rx=0 tx=0).stop 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 shutdown_connections 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fc9480664d0 0x7fc948068990 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9641556c0 0x7fc964152cd0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc9640cabd0 0x7fc964165460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 --2- 172.21.15.40:0/1783149675 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fc9640af2d0 0x7fc964150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 >> 172.21.15.40:0/1783149675 conn(0x7fc9640ced10 msgr2=0x7fc9640b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 shutdown_connections 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.515+0000 7fc96c29a640 1 -- 172.21.15.40:0/1783149675 wait complete. 2023-11-04T01:48:22.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 Processor -- start 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 -- start start 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f061c1556c0 0x7f061c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f061c0cabd0 0x7f061c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c15c600 con 0x7f061c0c9360 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0cb5c0 con 0x7f061c1556c0 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f062461c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c06fe50 con 0x7f061c0cabd0 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f06223b8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f061c1556c0 0x7f061c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f0622bb9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f061c0c9360 0x7f061c0c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43992/0 (socket says 172.21.15.40:43992) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f0622bb9640 1 -- 172.21.15.40:0/207229349 learned_addr learned my addr 172.21.15.40:0/207229349 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f0621bb7640 1 --2- 172.21.15.40:0/207229349 >> v2:172.21.15.91:3300/0 conn(0x7f061c0cabd0 0x7f061c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f06223b8640 1 -- 172.21.15.40:0/207229349 >> v2:172.21.15.91:3300/0 conn(0x7f061c0cabd0 msgr2=0x7f061c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f06223b8640 1 --2- 172.21.15.40:0/207229349 >> v2:172.21.15.91:3300/0 conn(0x7f061c0cabd0 0x7f061c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f06223b8640 1 -- 172.21.15.40:0/207229349 >> v1:172.21.15.40:6789/0 conn(0x7f061c0c9360 legacy=0x7f061c0c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f06213b6640 1 -- 172.21.15.40:0/207229349 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418064435 0 0) 0x7f061c15c600 con 0x7f061c0c9360 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f06223b8640 1 -- 172.21.15.40:0/207229349 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0ae7f0 con 0x7f061c1556c0 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.659+0000 7f0621bb7640 1 --2- 172.21.15.40:0/207229349 >> v2:172.21.15.91:3300/0 conn(0x7f061c0cabd0 0x7f061c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f06223b8640 1 --2- 172.21.15.40:0/207229349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c1556c0 0x7f061c15c0c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f0618009d90 tx=0x7f061801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff626b0f2f58daa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f06213b6640 1 -- 172.21.15.40:0/207229349 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180a59a0 con 0x7f061c1556c0 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f06213b6640 1 -- 172.21.15.40:0/207229349 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180a5b00 con 0x7f061c1556c0 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f06213b6640 1 -- 172.21.15.40:0/207229349 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180a5e90 con 0x7f061c1556c0 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- 172.21.15.40:0/207229349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c1556c0 msgr2=0x7f061c15c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 --2- 172.21.15.40:0/207229349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c1556c0 0x7f061c15c0c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f0618009d90 tx=0x7f061801c8e0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- 172.21.15.40:0/207229349 shutdown_connections 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 --2- 172.21.15.40:0/207229349 >> v2:172.21.15.91:3300/0 conn(0x7f061c0cabd0 0x7f061c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 --2- 172.21.15.40:0/207229349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c1556c0 0x7f061c15c0c0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- 172.21.15.40:0/207229349 >> 172.21.15.40:0/207229349 conn(0x7f061c0ced10 msgr2=0x7f061c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- 172.21.15.40:0/207229349 shutdown_connections 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- 172.21.15.40:0/207229349 wait complete. 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 Processor -- start 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- start start 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f061c0c9360 0x7f061c148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 0x7f061c0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f061c1556c0 0x7f061c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b3fa0 con 0x7f061c0cabd0 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b30d0 con 0x7f061c0c9360 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f062461c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b3320 con 0x7f061c1556c0 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 0x7f061c0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 0x7f061c0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54902/0 (socket says 172.21.15.40:54902) 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 -- 172.21.15.40:0/1043204736 learned_addr learned my addr 172.21.15.40:0/1043204736 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f06223b8640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f061c0c9360 0x7f061c148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0622bb9640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f061c1556c0 0x7f061c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 -- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f061c1556c0 msgr2=0x7f061c0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f061c1556c0 0x7f061c0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 -- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f061c0c9360 msgr2=0x7f061c148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f061c0c9360 0x7f061c148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.663+0000 7f0621bb7640 1 -- 172.21.15.40:0/1043204736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009a70 con 0x7f061c0cabd0 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0621bb7640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 0x7f061c0c82d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f060c00d800 tx=0x7f060c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c0096c0 con 0x7f061c0cabd0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c009820 con 0x7f061c0cabd0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c0b3600 con 0x7f061c0cabd0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c009bd0 con 0x7f061c0cabd0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0b3bc0 con 0x7f061c0cabd0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c04e4a0 con 0x7f061c0cabd0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f060c009d30 con 0x7f061c0cabd0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0612ffd640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06000664a0 0x7f0600068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f060c084df0 con 0x7f061c0cabd0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f06223b8640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06000664a0 0x7f0600068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.667+0000 7f06223b8640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06000664a0 0x7f0600068960 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f06180af000 tx=0x7f06180a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.671+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f060c051a90 con 0x7f061c0cabd0 2023-11-04T01:48:22.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f061c14f590 con 0x7f061c0cabd0 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f0612ffd640 1 -- 172.21.15.40:0/1043204736 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7f060c0550b0 con 0x7f061c0cabd0 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06000664a0 msgr2=0x7f0600068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06000664a0 0x7f0600068960 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f06180af000 tx=0x7f06180a7070 comp rx=0 tx=0).stop 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 msgr2=0x7f061c0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 0x7f061c0c82d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f060c00d800 tx=0x7f060c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 shutdown_connections 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f06000664a0 0x7f0600068960 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f061c1556c0 0x7f061c0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c0cabd0 0x7f061c0c82d0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 --2- 172.21.15.40:0/1043204736 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f061c0c9360 0x7f061c148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 >> 172.21.15.40:0/1043204736 conn(0x7f061c0ced10 msgr2=0x7f061c152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 shutdown_connections 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.827+0000 7f062461c640 1 -- 172.21.15.40:0/1043204736 wait complete. 2023-11-04T01:48:22.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.959+0000 7fd487c6a640 1 Processor -- start 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.959+0000 7fd487c6a640 1 -- start start 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.959+0000 7fd487c6a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4800d1cb0 0x7fd4800d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.959+0000 7fd487c6a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd48015d5a0 0x7fd4800b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.959+0000 7fd487c6a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4800d09b0 con 0x7fd48015d1c0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd487c6a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800d0110 con 0x7fd4800d1cb0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd487c6a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800d03f0 con 0x7fd48015d5a0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd486207640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd48015d5a0 0x7fd4800b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd485205640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4800d1cb0 0x7fd4800d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd486207640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd48015d5a0 0x7fd4800b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3301/0 says I am v2:172.21.15.40:33958/0 (socket says 172.21.15.40:33958) 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd486207640 1 -- 172.21.15.40:0/1069851810 learned_addr learned my addr 172.21.15.40:0/1069851810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd485205640 1 -- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd48015d5a0 msgr2=0x7fd4800b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd485205640 1 --2- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd48015d5a0 0x7fd4800b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd485205640 1 -- 172.21.15.40:0/1069851810 >> v1:172.21.15.91:6789/0 conn(0x7fd48015d1c0 legacy=0x7fd4800d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd485205640 1 -- 172.21.15.40:0/1069851810 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800d06d0 con 0x7fd4800d1cb0 2023-11-04T01:48:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd485205640 1 --2- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4800d1cb0 0x7fd4800d3ae0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd4700097c0 tx=0x7fd47001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e4e911c3709fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd484a04640 1 -- 172.21.15.40:0/1069851810 <== mon.1 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700a7070 con 0x7fd4800d1cb0 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd484a04640 1 -- 172.21.15.40:0/1069851810 <== mon.1 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700ab430 con 0x7fd4800d1cb0 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.963+0000 7fd484a04640 1 -- 172.21.15.40:0/1069851810 <== mon.1 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700ab7c0 con 0x7fd4800d1cb0 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4800d1cb0 msgr2=0x7fd4800d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 --2- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4800d1cb0 0x7fd4800d3ae0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd4700097c0 tx=0x7fd47001c450 comp rx=0 tx=0).stop 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/1069851810 shutdown_connections 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 --2- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd48015d5a0 0x7fd4800b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 --2- 172.21.15.40:0/1069851810 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4800d1cb0 0x7fd4800d3ae0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/1069851810 >> 172.21.15.40:0/1069851810 conn(0x7fd4800d2fc0 msgr2=0x7fd4800d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/1069851810 shutdown_connections 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/1069851810 wait complete. 2023-11-04T01:48:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 Processor -- start 2023-11-04T01:48:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- start start 2023-11-04T01:48:22.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4800d1cb0 0x7fd4800b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd48015d1c0 0x7fd4800cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 0x7fd4800ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800b88b0 con 0x7fd48015d5a0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480154c40 con 0x7fd48015d1c0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4801552e0 con 0x7fd4800d1cb0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 0x7fd4800ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 0x7fd4800ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54918/0 (socket says 172.21.15.40:54918) 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 -- 172.21.15.40:0/182061153 learned_addr learned my addr 172.21.15.40:0/182061153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd485a06640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4800d1cb0 0x7fd4800b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd485205640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd48015d1c0 0x7fd4800cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 -- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4800d1cb0 msgr2=0x7fd4800b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4800d1cb0 0x7fd4800b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 -- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd48015d1c0 msgr2=0x7fd4800cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd48015d1c0 0x7fd4800cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 -- 172.21.15.40:0/182061153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470009420 con 0x7fd48015d5a0 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd486207640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 0x7fd4800ca280 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fd47800efc0 tx=0x7fd47800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478009b60 con 0x7fd48015d5a0 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800f040 con 0x7fd48015d5a0 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800b8260 con 0x7fd48015d5a0 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4780039a0 con 0x7fd48015d5a0 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.967+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4801555c0 con 0x7fd48015d5a0 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.971+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48004e4a0 con 0x7fd48015d5a0 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.971+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd478003b00 con 0x7fd48015d5a0 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.971+0000 7fd4767fc640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664a0 0x7fd464068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.971+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fd478084b00 con 0x7fd48015d5a0 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.971+0000 7fd485a06640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664a0 0x7fd464068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.971+0000 7fd485a06640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664a0 0x7fd464068960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd47c007fd0 tx=0x7fd47c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:22.975+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd478086e60 con 0x7fd48015d5a0 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.127+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4800b89f0 con 0x7fd48015d5a0 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.127+0000 7fd4767fc640 1 -- 172.21.15.40:0/182061153 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4780517b0 con 0x7fd48015d5a0 2023-11-04T01:48:23.132 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664a0 msgr2=0x7fd464068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664a0 0x7fd464068960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd47c007fd0 tx=0x7fd47c009040 comp rx=0 tx=0).stop 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 msgr2=0x7fd4800ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 0x7fd4800ca280 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fd47800efc0 tx=0x7fd47800c490 comp rx=0 tx=0).stop 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 shutdown_connections 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fd4640664a0 0x7fd464068960 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48015d5a0 0x7fd4800ca280 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd48015d1c0 0x7fd4800cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 --2- 172.21.15.40:0/182061153 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fd4800d1cb0 0x7fd4800b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 >> 172.21.15.40:0/182061153 conn(0x7fd4800d2fc0 msgr2=0x7fd4801591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 shutdown_connections 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.131+0000 7fd487c6a640 1 -- 172.21.15.40:0/182061153 wait complete. 2023-11-04T01:48:23.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 Processor -- start 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 -- start start 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff30815d1c0 0x7ff3080d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30815d5a0 0x7ff3080d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3080d09b0 con 0x7ff3080b1ec0 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3080d0110 con 0x7ff30815d5a0 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30cc32640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080d03f0 con 0x7ff30815d1c0 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff305d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30815d5a0 0x7ff3080d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff305d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30815d5a0 0x7ff3080d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54922/0 (socket says 172.21.15.40:54922) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff305d9b640 1 -- 172.21.15.40:0/1848294483 learned_addr learned my addr 172.21.15.40:0/1848294483 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.271+0000 7ff30659c640 1 --2- 172.21.15.40:0/1848294483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff30815d1c0 0x7ff3080d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff305d9b640 1 -- 172.21.15.40:0/1848294483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff30815d1c0 msgr2=0x7ff3080d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff305d9b640 1 --2- 172.21.15.40:0/1848294483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff30815d1c0 0x7ff3080d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff305d9b640 1 -- 172.21.15.40:0/1848294483 >> v1:172.21.15.91:6789/0 conn(0x7ff3080b1ec0 legacy=0x7ff3080cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff305d9b640 1 -- 172.21.15.40:0/1848294483 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080d06d0 con 0x7ff30815d5a0 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff305d9b640 1 --2- 172.21.15.40:0/1848294483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d5a0 0x7ff3080d15a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009870 tx=0x7ff2fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbc83f766088a6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff30559a640 1 -- 172.21.15.40:0/1848294483 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0aa650 con 0x7ff30815d5a0 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff30559a640 1 -- 172.21.15.40:0/1848294483 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc0aa7b0 con 0x7ff30815d5a0 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.275+0000 7ff30559a640 1 -- 172.21.15.40:0/1848294483 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0aab40 con 0x7ff30815d5a0 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- 172.21.15.40:0/1848294483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d5a0 msgr2=0x7ff3080d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 --2- 172.21.15.40:0/1848294483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d5a0 0x7ff3080d15a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009870 tx=0x7ff2fc01c510 comp rx=0 tx=0).stop 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- 172.21.15.40:0/1848294483 shutdown_connections 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 --2- 172.21.15.40:0/1848294483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d5a0 0x7ff3080d15a0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 --2- 172.21.15.40:0/1848294483 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff30815d1c0 0x7ff3080d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- 172.21.15.40:0/1848294483 >> 172.21.15.40:0/1848294483 conn(0x7ff3080d2fc0 msgr2=0x7ff3080d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- 172.21.15.40:0/1848294483 shutdown_connections 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- 172.21.15.40:0/1848294483 wait complete. 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 Processor -- start 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- start start 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3080b1ec0 0x7ff308157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 0x7ff3081541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff30815d5a0 0x7ff3080cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff308156160 con 0x7ff30815d1c0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff308156440 con 0x7ff30815d5a0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080b68a0 con 0x7ff3080b1ec0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 0x7ff3081541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 0x7ff3081541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54938/0 (socket says 172.21.15.40:54938) 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 -- 172.21.15.40:0/2157013174 learned_addr learned my addr 172.21.15.40:0/2157013174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30659c640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3080b1ec0 0x7ff308157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff306d9d640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff30815d5a0 0x7ff3080cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 -- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3080b1ec0 msgr2=0x7ff308157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3080b1ec0 0x7ff308157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 -- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff30815d5a0 msgr2=0x7ff3080cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff30815d5a0 0x7ff3080cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 -- 172.21.15.40:0/2157013174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0094d0 con 0x7ff30815d1c0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff305d9b640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 0x7ff3081541d0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0ac040 tx=0x7ff2fc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0b3800 con 0x7ff30815d1c0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc0b3980 con 0x7ff30815d1c0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3080b6b80 con 0x7ff30815d1c0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.279+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0b3d30 con 0x7ff30815d1c0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff308155da0 con 0x7ff30815d1c0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3080b6dc0 con 0x7ff30815d1c0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2fc0c73e0 con 0x7ff30815d1c0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff2f6ffd640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2e80664a0 0x7ff2e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7ff2fc11f090 con 0x7ff30815d1c0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff30659c640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2e80664a0 0x7ff2e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.283+0000 7ff30659c640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2e80664a0 0x7ff2e8068960 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800b9d0 tx=0x7ff2f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.287+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2fc0ebec0 con 0x7ff30815d1c0 2023-11-04T01:48:23.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.443+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3080b6dc0 con 0x7ff30815d1c0 2023-11-04T01:48:23.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.443+0000 7ff2f6ffd640 1 -- 172.21.15.40:0/2157013174 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3080b6dc0 con 0x7ff30815d1c0 2023-11-04T01:48:23.447 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2e80664a0 msgr2=0x7ff2e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2e80664a0 0x7ff2e8068960 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800b9d0 tx=0x7ff2f8008040 comp rx=0 tx=0).stop 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 msgr2=0x7ff3081541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 0x7ff3081541d0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0ac040 tx=0x7ff2fc01ad50 comp rx=0 tx=0).stop 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 shutdown_connections 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff2e80664a0 0x7ff2e8068960 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff30815d5a0 0x7ff3080cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30815d1c0 0x7ff3081541d0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 --2- 172.21.15.40:0/2157013174 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff3080b1ec0 0x7ff308157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 >> 172.21.15.40:0/2157013174 conn(0x7ff3080d2fc0 msgr2=0x7ff30806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 shutdown_connections 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.447+0000 7ff30cc32640 1 -- 172.21.15.40:0/2157013174 wait complete. 2023-11-04T01:48:23.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:48:23.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 Processor -- start 2023-11-04T01:48:23.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 -- start start 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 0x7fb1e806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb1e80ce920 0x7fb1e80cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80ced80 con 0x7fb1e80cdca0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e80ce130 con 0x7fb1e80ce920 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ef2dd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b0420 con 0x7fb1e815d0e0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ed87a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb1e80cdca0 0x7fb1e80b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44006/0 (socket says 172.21.15.40:44006) 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ed87a640 1 -- 172.21.15.40:0/3510404902 learned_addr learned my addr 172.21.15.40:0/3510404902 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ed079640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 0x7fb1e806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 --2- 172.21.15.40:0/3510404902 >> v2:172.21.15.91:3300/0 conn(0x7fb1e80ce920 0x7fb1e80cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387257188 0 0) 0x7fb1e80ced80 con 0x7fb1e80cdca0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d0003530 con 0x7fb1e80cdca0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301390982 0 0) 0x7fb1d0003530 con 0x7fb1e80cdca0 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 msgr2=0x7fb1e806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 0x7fb1e806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 >> v2:172.21.15.91:3300/0 conn(0x7fb1e80ce920 msgr2=0x7fb1e80cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 --2- 172.21.15.40:0/3510404902 >> v2:172.21.15.91:3300/0 conn(0x7fb1e80ce920 0x7fb1e80cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8160cf0 con 0x7fb1e80cdca0 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fb1d8001680 con 0x7fb1e80cdca0 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 >> v1:172.21.15.40:6789/0 conn(0x7fb1e80cdca0 legacy=0x7fb1e80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d0003980 0x7fb1d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d00047d0 0x7fb1d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 0x7fb1d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80ce130 con 0x7fb1d00047d0 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b0420 con 0x7fb1d0003980 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d000b990 con 0x7fb1e815d0e0 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d00047d0 0x7fb1d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ed079640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d0003980 0x7fb1d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ed87a640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 0x7fb1d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 -- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 msgr2=0x7fb1d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815d0e0 0x7fb1d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 -- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d0003980 msgr2=0x7fb1d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d0003980 0x7fb1d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.591+0000 7fb1ec878640 1 -- 172.21.15.40:0/3510404902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0003530 con 0x7fb1d00047d0 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ec878640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d00047d0 0x7fb1d0004c50 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009ae0 tx=0x7fb1dc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20938686e87c5b17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0a64a0 con 0x7fb1d00047d0 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0a6600 con 0x7fb1d00047d0 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1e7fff640 1 -- 172.21.15.40:0/3510404902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0a69b0 con 0x7fb1d00047d0 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/3510404902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d00047d0 msgr2=0x7fb1d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/3510404902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d00047d0 0x7fb1d0004c50 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009ae0 tx=0x7fb1dc01ca90 comp rx=0 tx=0).stop 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ed87a640 1 -- 172.21.15.40:0/3510404902 reap_dead start 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/3510404902 shutdown_connections 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/3510404902 >> 172.21.15.40:0/3510404902 conn(0x7fb1e806a130 msgr2=0x7fb1e806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/3510404902 shutdown_connections 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/3510404902 wait complete. 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 Processor -- start 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.595+0000 7fb1ef2dd640 1 -- start start 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d00047d0 0x7fb1e8158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 0x7fb1e80b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815f130 0x7fb1e815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e815faf0 con 0x7fb1e80b66d0 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b4b70 con 0x7fb1d00047d0 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b4e50 con 0x7fb1e815f130 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 0x7fb1e80b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 0x7fb1e80b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54958/0 (socket says 172.21.15.40:54958) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 -- 172.21.15.40:0/1549402553 learned_addr learned my addr 172.21.15.40:0/1549402553 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ed079640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d00047d0 0x7fb1e8158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ed87a640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815f130 0x7fb1e815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 -- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815f130 msgr2=0x7fb1e815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815f130 0x7fb1e815f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 -- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d00047d0 msgr2=0x7fb1e8158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d00047d0 0x7fb1e8158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 -- 172.21.15.40:0/1549402553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80b5130 con 0x7fb1e80b66d0 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ec878640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 0x7fb1e80b42f0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc01cf70 tx=0x7fb1d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0a7690 con 0x7fb1e80b66d0 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0a77f0 con 0x7fb1e80b66d0 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e80b5410 con 0x7fb1e80b66d0 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0a7ba0 con 0x7fb1e80b66d0 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e80b4830 con 0x7fb1e80b66d0 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e8067610 con 0x7fb1e80b66d0 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1dc0a7d00 con 0x7fb1e80b66d0 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1e5ffb640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1d40664d0 0x7fb1d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fb1dc11f170 con 0x7fb1e80b66d0 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.599+0000 7fb1ed079640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1d40664d0 0x7fb1d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.603+0000 7fb1ed079640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1d40664d0 0x7fb1d4068990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007440 tx=0x7fb1e000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.603+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1dc0ebce0 con 0x7fb1e80b66d0 2023-11-04T01:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.767+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1e806e230 con 0x7fb1e80b66d0 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1e5ffb640 1 -- 172.21.15.40:0/1549402553 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1384 (secure 0 0 0) 0x7fb1dc0ef300 con 0x7fb1e80b66d0 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/1658130781 2023-11-04T02:47:52.686288+0000 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2209627414 2023-11-05T01:47:44.960567+0000 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/2884841846 2023-11-04T02:46:56.954663+0000 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/3996815211 2023-11-05T01:47:37.592112+0000 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2209627414 2023-11-05T01:47:44.960567+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/3996815211 2023-11-05T01:47:37.592112+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/771372867 2023-11-04T02:46:12.185534+0000 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:listed 23 entries 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1d40664d0 msgr2=0x7fb1d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1d40664d0 0x7fb1d4068990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0007440 tx=0x7fb1e000b040 comp rx=0 tx=0).stop 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 msgr2=0x7fb1e80b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 0x7fb1e80b42f0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc01cf70 tx=0x7fb1d0005800 comp rx=0 tx=0).stop 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 shutdown_connections 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fb1d40664d0 0x7fb1d4068990 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fb1e815f130 0x7fb1e815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1e80b66d0 0x7fb1e80b42f0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 --2- 172.21.15.40:0/1549402553 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1d00047d0 0x7fb1e8158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 >> 172.21.15.40:0/1549402553 conn(0x7fb1e806a130 msgr2=0x7fb1e80b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 shutdown_connections 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.771+0000 7fb1ef2dd640 1 -- 172.21.15.40:0/1549402553 wait complete. 2023-11-04T01:48:23.790 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:48:23.790 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:23.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:48:23.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e49b30640 1 Processor -- start 2023-11-04T01:48:23.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e49b30640 1 -- start start 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e49b30640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e4406bde0 0x7f5e440cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e49b30640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c9ac0 con 0x7f5e440c92b0 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e49b30640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440caf20 con 0x7f5e4406c1c0 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e49b30640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440c97e0 con 0x7f5e4406bde0 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e437fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e4406bde0 0x7f5e440cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e42ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e440c92b0 0x7f5e4415c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44012/0 (socket says 172.21.15.40:44012) 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e42ffd640 1 -- 172.21.15.40:0/2405974007 learned_addr learned my addr 172.21.15.40:0/2405974007 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e437fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e4406bde0 0x7f5e440cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54970/0 (socket says 172.21.15.40:54970) 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e437fe640 1 -- 172.21.15.40:0/2405974007 >> v1:172.21.15.91:6789/0 conn(0x7f5e4406c1c0 legacy=0x7f5e441442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e437fe640 1 -- 172.21.15.40:0/2405974007 >> v1:172.21.15.40:6789/0 conn(0x7f5e440c92b0 legacy=0x7f5e4415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e437fe640 1 -- 172.21.15.40:0/2405974007 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440cb1c0 con 0x7f5e4406bde0 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.959+0000 7f5e427fc640 1 -- 172.21.15.40:0/2405974007 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428485130 0 0) 0x7f5e440c9ac0 con 0x7f5e440c92b0 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e437fe640 1 --2- 172.21.15.40:0/2405974007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406bde0 0x7f5e440cbca0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f5e340097c0 tx=0x7f5e3401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633dd3ed5353378c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e427fc640 1 -- 172.21.15.40:0/2405974007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340ab600 con 0x7f5e4406bde0 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e427fc640 1 -- 172.21.15.40:0/2405974007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e340a7050 con 0x7f5e4406bde0 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e427fc640 1 -- 172.21.15.40:0/2405974007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340ab980 con 0x7f5e4406bde0 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/2405974007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406bde0 msgr2=0x7f5e440cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 --2- 172.21.15.40:0/2405974007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406bde0 0x7f5e440cbca0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f5e340097c0 tx=0x7f5e3401c440 comp rx=0 tx=0).stop 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/2405974007 shutdown_connections 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 --2- 172.21.15.40:0/2405974007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406bde0 0x7f5e440cbca0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/2405974007 >> 172.21.15.40:0/2405974007 conn(0x7f5e440b0890 msgr2=0x7f5e440b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/2405974007 shutdown_connections 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/2405974007 wait complete. 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 Processor -- start 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- start start 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e4406bde0 0x7f5e4413aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 0x7f5e4413b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c92b0 0x7f5e440c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c7020 con 0x7f5e4406c1c0 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4413b970 con 0x7f5e440c92b0 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c6610 con 0x7f5e4406bde0 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 0x7f5e4413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 0x7f5e4413b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54976/0 (socket says 172.21.15.40:54976) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 -- 172.21.15.40:0/897713239 learned_addr learned my addr 172.21.15.40:0/897713239 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e437fe640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e4406bde0 0x7f5e4413aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e43fff640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c92b0 0x7f5e440c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 -- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e4406bde0 msgr2=0x7f5e4413aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e4406bde0 0x7f5e4413aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 -- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c92b0 msgr2=0x7f5e440c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c92b0 0x7f5e440c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 -- 172.21.15.40:0/897713239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009420 con 0x7f5e4406c1c0 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e42ffd640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 0x7f5e4413b430 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800c480 tx=0x7f5e3800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380074e0 con 0x7f5e4406c1c0 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e38007660 con 0x7f5e4406c1c0 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e440c7230 con 0x7f5e4406c1c0 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38004a30 con 0x7f5e4406c1c0 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.963+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e440c77f0 con 0x7f5e4406c1c0 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.967+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4404e4a0 con 0x7f5e4406c1c0 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.967+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e38004b90 con 0x7f5e4406c1c0 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.967+0000 7f5e2bfff640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e300664a0 0x7f5e30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.967+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f5e38083be0 con 0x7f5e4406c1c0 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.967+0000 7f5e437fe640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e300664a0 0x7f5e30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.967+0000 7f5e437fe640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e300664a0 0x7f5e30068960 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5e340ad000 tx=0x7f5e340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:23.971+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e38054310 con 0x7f5e4406c1c0 2023-11-04T01:48:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.123+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e44143d00 con 0x7f5e4406c1c0 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.127+0000 7f5e2bfff640 1 -- 172.21.15.40:0/897713239 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+23348 (secure 0 0 0) 0x7f5e38018020 con 0x7f5e4406c1c0 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":116,"fsid":"f3a701bf-cf4d-4d3c-a05f-e31ef1aa671d","created":"2023-11-04T01:39:33.147176+0000","modified":"2023-11-04T01:48:13.050549+0000","last_up_change":"2023-11-04T01:39:44.413570+0000","last_in_change":"2023-11-04T01:39:35.437613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:45.826844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:10.718588+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:18.179027+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:19.454273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:14.041287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:14.473992+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":114,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f79021a9-1c37-4e56-b6b9-55cf9d93f960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6801","nonce":3235912228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6803","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6805","nonce":3235912228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6813","nonce":3235912228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6807","nonce":3235912228},{"type":"v1","addr":"172.21.15.40:6809","nonce":3235912228}]},"public_addr":"172.21.15.40:6801/3235912228","cluster_addr":"172.21.15.40:6805/3235912228","heartbeat_back_addr":"172.21.15.40:6813/3235912228","heartbeat_front_addr":"172.21.15.40:6809/3235912228","state":["exists","up"]},{"osd":1,"uuid":"0ef244d7-56b1-4291-a58a-b5ec353cb581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6804","nonce":865841018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6808","nonce":865841018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6815","nonce":865841018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":865841018},{"type":"v1","addr":"172.21.15.40:6812","nonce":865841018}]},"public_addr":"172.21.15.40:6804/865841018","cluster_addr":"172.21.15.40:6808/865841018","heartbeat_back_addr":"172.21.15.40:6815/865841018","heartbeat_front_addr":"172.21.15.40:6812/865841018","state":["exists","up"]},{"osd":2,"uuid":"1dc3282c-ecbd-47ec-8c89-ee2dc120078b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6819","nonce":788033951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6823","nonce":788033951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6831","nonce":788033951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":788033951},{"type":"v1","addr":"172.21.15.40:6828","nonce":788033951}]},"public_addr":"172.21.15.40:6819/788033951","cluster_addr":"172.21.15.40:6823/788033951","heartbeat_back_addr":"172.21.15.40:6831/788033951","heartbeat_front_addr":"172.21.15.40:6828/788033951","state":["exists","up"]},{"osd":3,"uuid":"a6b52471-c1d1-49b7-bc2c-c4d4868c7198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6818","nonce":4092378766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6822","nonce":4092378766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6829","nonce":4092378766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4092378766},{"type":"v1","addr":"172.21.15.40:6825","nonce":4092378766}]},"public_addr":"172.21.15.40:6818/4092378766","cluster_addr":"172.21.15.40:6822/4092378766","heartbeat_back_addr":"172.21.15.40:6829/4092378766","heartbeat_front_addr":"172.21.15.40:6825/4092378766","state":["exists","up"]},{"osd":4,"uuid":"1ea8df65-fb5d-455f-8eda-35a437eef186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6801","nonce":3214346669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6803","nonce":3214346669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6807","nonce":3214346669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":3214346669},{"type":"v1","addr":"172.21.15.91:6805","nonce":3214346669}]},"public_addr":"172.21.15.91:6801/3214346669","cluster_addr":"172.21.15.91:6803/3214346669","heartbeat_back_addr":"172.21.15.91:6807/3214346669","heartbeat_front_addr":"172.21.15.91:6805/3214346669","state":["exists","up"]},{"osd":5,"uuid":"7f6b1537-bfc8-4462-9f5d-78d30ad492e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6809","nonce":2194189179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6811","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6813","nonce":2194189179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6819","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6821","nonce":2194189179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6815","nonce":2194189179},{"type":"v1","addr":"172.21.15.91:6817","nonce":2194189179}]},"public_addr":"172.21.15.91:6809/2194189179","cluster_addr":"172.21.15.91:6813/2194189179","heartbeat_back_addr":"172.21.15.91:6821/2194189179","heartbeat_front_addr":"172.21.15.91:6817/2194189179","state":["exists","up"]},{"osd":6,"uuid":"c3b9bb64-dca0-4141-9c80-024ad4f169ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6825","nonce":3197908777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6827","nonce":3197908777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6831","nonce":3197908777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":3197908777},{"type":"v1","addr":"172.21.15.91:6829","nonce":3197908777}]},"public_addr":"172.21.15.91:6825/3197908777","cluster_addr":"172.21.15.91:6827/3197908777","heartbeat_back_addr":"172.21.15.91:6831/3197908777","heartbeat_front_addr":"172.21.15.91:6829/3197908777","state":["exists","up"]},{"osd":7,"uuid":"ab1edd79-8d9f-45a8-abfd-2263a72bf439","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6812","nonce":2470646827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6816","nonce":2470646827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6823","nonce":2470646827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2470646827},{"type":"v1","addr":"172.21.15.91:6820","nonce":2470646827}]},"public_addr":"172.21.15.91:6812/2470646827","cluster_addr":"172.21.15.91:6816/2470646827","heartbeat_back_addr":"172.21.15.91:6823/2470646827","heartbeat_front_addr":"172.21.15.91:6820/2470646827","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.082625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.098155+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.988746+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.136912+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:40.974545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.089463+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.109590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:41.078656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/1658130781":"2023-11-04T02:47:52.686288+0000","172.21.15.91:6836/2209627414":"2023-11-05T01:47:44.960567+0000","192.168.0.1:0/2884841846":"2023-11-04T02:46:56.954663+0000","172.21.15.40:6835/3996815211":"2023-11-05T01:47:37.592112+0000","172.21.15.91:6836/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.91:6837/2209627414":"2023-11-05T01:47:44.960567+0000","172.21.15.40:6835/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6837/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.91:6836/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6833/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.40:6835/2918977483":"2023-11-05T01:45:57.090700+0000","172.21.15.40:6832/3717165508":"2023-11-05T01:46:48.727255+0000","172.21.15.91:6837/3698962796":"2023-11-05T01:44:32.632378+0000","172.21.15.40:6832/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/3996815211":"2023-11-05T01:47:37.592112+0000","172.21.15.91:6837/1982091809":"2023-11-05T01:46:41.851397+0000","172.21.15.40:6834/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6835/1813470604":"2023-11-05T01:45:03.687333+0000","172.21.15.40:6833/960586799":"2023-11-05T01:46:04.035367+0000","172.21.15.40:6834/15089123":"2023-11-05T01:44:01.252782+0000","172.21.15.91:6836/2523798790":"2023-11-05T01:45:29.242234+0000","172.21.15.40:6834/2918977483":"2023-11-05T01:45:57.090700+0000","192.168.0.1:0/771372867":"2023-11-04T02:46:12.185534+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":12,"length":1},{"begin":14,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e300664a0 msgr2=0x7f5e30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e300664a0 0x7f5e30068960 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5e340ad000 tx=0x7f5e340a6000 comp rx=0 tx=0).stop 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 msgr2=0x7f5e4413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 0x7f5e4413b430 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800c480 tx=0x7f5e3800c940 comp rx=0 tx=0).stop 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 shutdown_connections 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f5e300664a0 0x7f5e30068960 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e440c92b0 0x7f5e440c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e4406c1c0 0x7f5e4413b430 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 --2- 172.21.15.40:0/897713239 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f5e4406bde0 0x7f5e4413aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 >> 172.21.15.40:0/897713239 conn(0x7f5e440b0890 msgr2=0x7f5e4415bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 shutdown_connections 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.131+0000 7f5e49b30640 1 -- 172.21.15.40:0/897713239 wait complete. 2023-11-04T01:48:24.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:45.826844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:10.718588+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:18.179027+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 66, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:19.454273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:14.041287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:14.473992+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 114, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:48:24.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.259+0000 7ff7ade97640 1 Processor -- start 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7ade97640 1 -- start start 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7ade97640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff7a80cb080 0x7ff7a80af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7ade97640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80cb4f0 con 0x7ff7a80cabd0 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7ade97640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a806fe50 con 0x7ff7a81556c0 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7ade97640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80ae7f0 con 0x7ff7a80cb080 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7a80cabd0 0x7ff7a80af2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44028/0 (socket says 172.21.15.40:44028) 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/2530904726 learned_addr learned my addr 172.21.15.40:0/2530904726 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a7fff640 1 --2- 172.21.15.40:0/2530904726 >> v2:172.21.15.91:3300/0 conn(0x7ff7a80cb080 0x7ff7a80af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626079764 0 0) 0x7ff7a80cb4f0 con 0x7ff7a80cabd0 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff790003530 con 0x7ff7a80cabd0 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1795097092 0 0) 0x7ff790003530 con 0x7ff7a80cabd0 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 >> v2:172.21.15.91:3300/0 conn(0x7ff7a80cb080 msgr2=0x7ff7a80af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 --2- 172.21.15.40:0/2530904726 >> v2:172.21.15.91:3300/0 conn(0x7ff7a80cb080 0x7ff7a80af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 >> v1:172.21.15.91:6789/0 conn(0x7ff7a81556c0 legacy=0x7ff7a815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80aead0 con 0x7ff7a80cabd0 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7ff79c001a00 con 0x7ff7a80cabd0 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 >> v1:172.21.15.40:6789/0 conn(0x7ff7a80cabd0 legacy=0x7ff7a80af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff790003980 0x7ff790003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff790004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff790005190 0x7ff79000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a80ae7f0 con 0x7ff7900047d0 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79000c030 con 0x7ff790003980 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79000c1f0 con 0x7ff790005190 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff790004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a7fff640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff790005190 0x7ff79000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff790003980 0x7ff790003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff790005190 msgr2=0x7ff79000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff790005190 0x7ff79000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff790003980 msgr2=0x7ff790003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff790003980 0x7ff790003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a7fff640 1 -- 172.21.15.40:0/2530904726 reap_dead start 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.263+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/2530904726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790003530 con 0x7ff7900047d0 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff790004c50 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00a830 tx=0x7ff79c01fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90e92ce33598a54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0072d0 con 0x7ff7900047d0 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c007430 con 0x7ff7900047d0 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a67fc640 1 -- 172.21.15.40:0/2530904726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c007800 con 0x7ff7900047d0 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- 172.21.15.40:0/2530904726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 msgr2=0x7ff790004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff790004c50 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00a830 tx=0x7ff79c01fa20 comp rx=0 tx=0).stop 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- 172.21.15.40:0/2530904726 shutdown_connections 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 --2- 172.21.15.40:0/2530904726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff790004c50 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- 172.21.15.40:0/2530904726 >> 172.21.15.40:0/2530904726 conn(0x7ff7a80ced10 msgr2=0x7ff7a80cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- 172.21.15.40:0/2530904726 shutdown_connections 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- 172.21.15.40:0/2530904726 wait complete. 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 Processor -- start 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- start start 2023-11-04T01:48:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff7a81481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7a81e4a50 0x7ff7a81e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c7e80 0x7ff7a80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8148700 con 0x7ff7900047d0 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a81e5410 con 0x7ff7a80c7e80 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7ade97640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8157e40 con 0x7ff7a81e4a50 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff7a81481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff7a81481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54990/0 (socket says 172.21.15.40:54990) 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 -- 172.21.15.40:0/1384965968 learned_addr learned my addr 172.21.15.40:0/1384965968 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a7fff640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c7e80 0x7ff7a80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7a81e4a50 0x7ff7a81e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 -- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7a81e4a50 msgr2=0x7ff7a81e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7a81e4a50 0x7ff7a81e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 -- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c7e80 msgr2=0x7ff7a80c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.267+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c7e80 0x7ff7a80c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7a77fe640 1 -- 172.21.15.40:0/1384965968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80c8b40 con 0x7ff7900047d0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff7a81481c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000d4d0 tx=0x7ff7a000d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0005480 con 0x7ff7900047d0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0003620 con 0x7ff7900047d0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a80c8e20 con 0x7ff7900047d0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0003990 con 0x7ff7900047d0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a80c93e0 con 0x7ff7900047d0 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a804e4a0 con 0x7ff7900047d0 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7a0003af0 con 0x7ff7900047d0 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff78ffff640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7940664a0 0x7ff794068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7ff7a0084450 con 0x7ff7900047d0 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7940664a0 0x7ff794068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.271+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7940664a0 0x7ff794068960 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0b1000 tx=0x7ff79c009050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.275+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7a0051050 con 0x7ff7900047d0 2023-11-04T01:48:24.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.431+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7a8157f80 con 0x7ff7900047d0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff78ffff640 1 -- 172.21.15.40:0/1384965968 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7a8157f80 con 0x7ff7900047d0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7940664a0 msgr2=0x7ff794068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7940664a0 0x7ff794068960 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0b1000 tx=0x7ff79c009050 comp rx=0 tx=0).stop 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 msgr2=0x7ff7a81481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff7a81481c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000d4d0 tx=0x7ff7a000d990 comp rx=0 tx=0).stop 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 shutdown_connections 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7ff7940664a0 0x7ff794068960 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c7e80 0x7ff7a80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff7a81e4a50 0x7ff7a81e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 --2- 172.21.15.40:0/1384965968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7900047d0 0x7ff7a81481c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 >> 172.21.15.40:0/1384965968 conn(0x7ff7a80ced10 msgr2=0x7ff7a80afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 shutdown_connections 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.435+0000 7ff7ade97640 1 -- 172.21.15.40:0/1384965968 wait complete. 2023-11-04T01:48:24.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 Processor -- start 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 -- start start 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa4100d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa41015d5a0 0x7fa4100d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa4100b1ec0 0x7fa4100d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100d09b0 con 0x7fa41015d5a0 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100d0110 con 0x7fa4100b1ec0 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa414ca9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100d03f0 con 0x7fa41015d1c0 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa41015d5a0 0x7fa4100d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa41015d5a0 0x7fa4100d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55006/0 (socket says 172.21.15.40:55006) 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 -- 172.21.15.40:0/1636004131 learned_addr learned my addr 172.21.15.40:0/1636004131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40ed9d640 1 --2- 172.21.15.40:0/1636004131 >> v2:172.21.15.91:3300/0 conn(0x7fa4100b1ec0 0x7fa4100d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40e59c640 1 --2- 172.21.15.40:0/1636004131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa4100d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 -- 172.21.15.40:0/1636004131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 msgr2=0x7fa4100d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 --2- 172.21.15.40:0/1636004131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa4100d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 -- 172.21.15.40:0/1636004131 >> v2:172.21.15.91:3300/0 conn(0x7fa4100b1ec0 msgr2=0x7fa4100d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 --2- 172.21.15.40:0/1636004131 >> v2:172.21.15.91:3300/0 conn(0x7fa4100b1ec0 0x7fa4100d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.583+0000 7fa40dd9b640 1 -- 172.21.15.40:0/1636004131 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100d06d0 con 0x7fa41015d5a0 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa40dd9b640 1 --2- 172.21.15.40:0/1636004131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41015d5a0 0x7fa4100d15a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa41008d4c0 tx=0x7fa3f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecae1461fec3cf3d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa40d59a640 1 -- 172.21.15.40:0/1636004131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80ab600 con 0x7fa41015d5a0 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa40d59a640 1 -- 172.21.15.40:0/1636004131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f80a7050 con 0x7fa41015d5a0 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa40d59a640 1 -- 172.21.15.40:0/1636004131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80ab980 con 0x7fa41015d5a0 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 -- 172.21.15.40:0/1636004131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41015d5a0 msgr2=0x7fa4100d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 --2- 172.21.15.40:0/1636004131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41015d5a0 0x7fa4100d15a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa41008d4c0 tx=0x7fa3f801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 -- 172.21.15.40:0/1636004131 shutdown_connections 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 --2- 172.21.15.40:0/1636004131 >> v2:172.21.15.91:3300/0 conn(0x7fa4100b1ec0 0x7fa4100d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 --2- 172.21.15.40:0/1636004131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41015d5a0 0x7fa4100d15a0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 --2- 172.21.15.40:0/1636004131 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa4100d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 -- 172.21.15.40:0/1636004131 >> 172.21.15.40:0/1636004131 conn(0x7fa4100d2fc0 msgr2=0x7fa4100d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 -- 172.21.15.40:0/1636004131 shutdown_connections 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 -- 172.21.15.40:0/1636004131 wait complete. 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 Processor -- start 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.587+0000 7fa414ca9640 1 -- start start 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 0x7fa4101504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa410150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa41015d5a0 0x7fa4101511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41015ca00 con 0x7fa4100b1ec0 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa410151820 con 0x7fa41015d5a0 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410151b00 con 0x7fa41015d1c0 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 0x7fa4101504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 0x7fa4101504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55018/0 (socket says 172.21.15.40:55018) 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 -- 172.21.15.40:0/536536727 learned_addr learned my addr 172.21.15.40:0/536536727 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40ed9d640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa41015d5a0 0x7fa4101511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40dd9b640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa410150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 -- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 msgr2=0x7fa410150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa410150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 -- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa41015d5a0 msgr2=0x7fa4101511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa41015d5a0 0x7fa4101511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 -- 172.21.15.40:0/536536727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094d0 con 0x7fa4100b1ec0 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40e59c640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 0x7fa4101504b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa400007ef0 tx=0x7fa40000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400014620 con 0x7fa4100b1ec0 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400014780 con 0x7fa4100b1ec0 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400014b30 con 0x7fa4100b1ec0 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa410151de0 con 0x7fa4100b1ec0 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4101523a0 con 0x7fa4100b1ec0 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41004e4a0 con 0x7fa4100b1ec0 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa400014c90 con 0x7fa4100b1ec0 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa406ffd640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa3f40664a0 0x7fa3f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fa400085090 con 0x7fa4100b1ec0 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.591+0000 7fa40dd9b640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa3f40664a0 0x7fa3f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.595+0000 7fa40dd9b640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa3f40664a0 0x7fa3f4068960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80ad000 tx=0x7fa3f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.595+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa400051d30 con 0x7fa4100b1ec0 2023-11-04T01:48:24.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.751+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fa4100b0a80 con 0x7fa4100b1ec0 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.751+0000 7fa406ffd640 1 -- 172.21.15.40:0/536536727 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4000840a0 con 0x7fa4100b1ec0 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa3f40664a0 msgr2=0x7fa3f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa3f40664a0 0x7fa3f4068960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80ad000 tx=0x7fa3f8008040 comp rx=0 tx=0).stop 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 msgr2=0x7fa4101504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 0x7fa4101504b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa400007ef0 tx=0x7fa40000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 shutdown_connections 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fa3f40664a0 0x7fa3f4068960 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa41015d5a0 0x7fa4101511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fa41015d1c0 0x7fa410150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 --2- 172.21.15.40:0/536536727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4100b1ec0 0x7fa4101504b0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 >> 172.21.15.40:0/536536727 conn(0x7fa4100d2fc0 msgr2=0x7fa4100b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 shutdown_connections 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.755+0000 7fa414ca9640 1 -- 172.21.15.40:0/536536727 wait complete. 2023-11-04T01:48:24.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f972ad50640 1 Processor -- start 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f972ad50640 1 -- start start 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f972ad50640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f97240cf830 0x7f97240af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f972ad50640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240afa50 con 0x7f9724159720 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f972ad50640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97240c9fe0 con 0x7f97240af640 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f972ad50640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97240ca5a0 con 0x7f97240cf830 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9728aec640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9724159720 0x7f97240c9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44032/0 (socket says 172.21.15.40:44032) 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9728aec640 1 -- 172.21.15.40:0/1632042687 learned_addr learned my addr 172.21.15.40:0/1632042687 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828618440 0 0) 0x7f97240afa50 con 0x7f9724159720 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 --2- 172.21.15.40:0/1632042687 >> v2:172.21.15.91:3300/0 conn(0x7f97240cf830 0x7f97240af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9714003450 con 0x7f9724159720 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389729004 0 0) 0x7f9714003450 con 0x7f9724159720 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 >> v2:172.21.15.91:3300/0 conn(0x7f97240cf830 msgr2=0x7f97240af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 --2- 172.21.15.40:0/1632042687 >> v2:172.21.15.91:3300/0 conn(0x7f97240cf830 0x7f97240af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 >> v1:172.21.15.91:6789/0 conn(0x7f97240af640 legacy=0x7f9724070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240ca2c0 con 0x7f9724159720 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7f9718001680 con 0x7f9724159720 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 >> v1:172.21.15.40:6789/0 conn(0x7f9724159720 legacy=0x7f97240c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9714003a70 0x7f9714003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f971400ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f971400b530 0x7f971400d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971400e2a0 con 0x7f9714008860 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971400e410 con 0x7f9714003a70 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971400e5d0 con 0x7f971400b530 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f971400ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9728aec640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9714003a70 0x7f9714003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 -- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f971400b530 msgr2=0x7f971400d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f971400b530 0x7f971400d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 -- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9714003a70 msgr2=0x7f9714003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9714003a70 0x7f9714003e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f9723fff640 1 -- 172.21.15.40:0/1632042687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714003450 con 0x7f9714008860 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.895+0000 7f97292ed640 1 -- 172.21.15.40:0/1632042687 reap_dead start 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f9723fff640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f971400ac90 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f9710009ae0 tx=0x7f971001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f9ccb741f87462 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100a5610 con 0x7f9714008860 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97100a5770 con 0x7f9714008860 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f97237fe640 1 -- 172.21.15.40:0/1632042687 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97100a5b20 con 0x7f9714008860 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 -- 172.21.15.40:0/1632042687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 msgr2=0x7f971400ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f971400ac90 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f9710009ae0 tx=0x7f971001ca40 comp rx=0 tx=0).stop 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 -- 172.21.15.40:0/1632042687 shutdown_connections 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 --2- 172.21.15.40:0/1632042687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f971400ac90 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 -- 172.21.15.40:0/1632042687 >> 172.21.15.40:0/1632042687 conn(0x7f97240ced10 msgr2=0x7f97240cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 -- 172.21.15.40:0/1632042687 shutdown_connections 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 -- 172.21.15.40:0/1632042687 wait complete. 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 Processor -- start 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.899+0000 7f972ad50640 1 -- start start 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f97241f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97240c7f70 0x7f97240c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9724155960 0x7f9724155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97241e57f0 con 0x7f9714008860 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97241f5620 con 0x7f97240c7f70 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9724156320 con 0x7f9724155960 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f97241f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97292ed640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9724155960 0x7f9724155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f97241f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55044/0 (socket says 172.21.15.40:55044) 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 -- 172.21.15.40:0/75213954 learned_addr learned my addr 172.21.15.40:0/75213954 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9723fff640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97240c7f70 0x7f97240c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 -- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9724155960 msgr2=0x7f9724155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9724155960 0x7f9724155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 -- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97240c7f70 msgr2=0x7f97240c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97240c7f70 0x7f97240c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 -- 172.21.15.40:0/75213954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240c8dc0 con 0x7f9714008860 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9723fff640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97240c7f70 0x7f97240c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9728aec640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f97241f50e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f97180017b0 tx=0x7f971800dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180074e0 con 0x7f9714008860 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718007640 con 0x7f9714008860 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97240c8ae0 con 0x7f9714008860 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97241e5410 con 0x7f9714008860 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718004a30 con 0x7f9714008860 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972404e4a0 con 0x7f9714008860 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9718004b90 con 0x7f9714008860 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97217fa640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97080664a0 0x7f9708068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f9718084330 con 0x7f9714008860 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.903+0000 7f9723fff640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97080664a0 0x7f9708068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.907+0000 7f9723fff640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97080664a0 0x7f9708068960 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f97100af000 tx=0x7f9710008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:24.907+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9718051080 con 0x7f9714008860 2023-11-04T01:48:25.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.059+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f97240c2620 con 0x7f9714008860 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.059+0000 7f97217fa640 1 -- 172.21.15.40:0/75213954 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v116) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97180190a0 con 0x7f9714008860 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97080664a0 msgr2=0x7f9708068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97080664a0 0x7f9708068960 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f97100af000 tx=0x7f9710008040 comp rx=0 tx=0).stop 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 msgr2=0x7f97241f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f97241f50e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f97180017b0 tx=0x7f971800dd60 comp rx=0 tx=0).stop 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 shutdown_connections 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f97080664a0 0x7f9708068960 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f9724155960 0x7f9724155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f97240c7f70 0x7f97240c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 --2- 172.21.15.40:0/75213954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9714008860 0x7f97241f50e0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 >> 172.21.15.40:0/75213954 conn(0x7f97240ced10 msgr2=0x7f97240706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 shutdown_connections 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.063+0000 7f972ad50640 1 -- 172.21.15.40:0/75213954 wait complete. 2023-11-04T01:48:25.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 Processor -- start 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 -- start start 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdab80d1cb0 0x7fdab80d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdab80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab80d09b0 con 0x7fdab815d1c0 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab80d0110 con 0x7fdab80d1cb0 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabecce640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80d03f0 con 0x7fdab815d5a0 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabca6a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdab815d1c0 0x7fdab80d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44036/0 (socket says 172.21.15.40:44036) 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabca6a640 1 -- 172.21.15.40:0/2483631966 learned_addr learned my addr 172.21.15.40:0/2483631966 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab7fff640 1 --2- 172.21.15.40:0/2483631966 >> v2:172.21.15.91:3300/0 conn(0x7fdab80d1cb0 0x7fdab80d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdab80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134055410 0 0) 0x7fdab80d09b0 con 0x7fdab815d1c0 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa0003530 con 0x7fdab815d1c0 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 252262409 0 0) 0x7fdaa0003530 con 0x7fdab815d1c0 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 msgr2=0x7fdab80b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdab80b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 >> v2:172.21.15.91:3300/0 conn(0x7fdab80d1cb0 msgr2=0x7fdab80d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 --2- 172.21.15.40:0/2483631966 >> v2:172.21.15.91:3300/0 conn(0x7fdab80d1cb0 0x7fdab80d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80d06d0 con 0x7fdab815d1c0 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3555336673 0 0) 0x7fdaa80016a0 con 0x7fdab815d1c0 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 >> v1:172.21.15.40:6789/0 conn(0x7fdab815d1c0 legacy=0x7fdab80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdaa00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80d0110 con 0x7fdaa0004d10 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80d03f0 con 0x7fdaa0003980 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa000b990 con 0x7fdab815d5a0 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabca6a640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 -- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 msgr2=0x7fdaa00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab7fff640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdaa00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdaa00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 -- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdaa0003980 msgr2=0x7fdaa0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabd26b640 1 -- 172.21.15.40:0/2483631966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0003530 con 0x7fdaa0004d10 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdabca6a640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdaa0003980 0x7fdaa0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.195+0000 7fdab7fff640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab815d5a0 0x7fdaa00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabd26b640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009fc0 tx=0x7fdab001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e856fd5bae396b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab00a5c70 con 0x7fdaa0004d10 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab000f040 con 0x7fdaa0004d10 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab77fe640 1 -- 172.21.15.40:0/2483631966 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab00ad440 con 0x7fdaa0004d10 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/2483631966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa0004d10 msgr2=0x7fdaa0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 --2- 172.21.15.40:0/2483631966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa0004d10 0x7fdaa0005190 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009fc0 tx=0x7fdab001cc60 comp rx=0 tx=0).stop 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabd26b640 1 -- 172.21.15.40:0/2483631966 reap_dead start 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/2483631966 shutdown_connections 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/2483631966 >> 172.21.15.40:0/2483631966 conn(0x7fdab80d2fc0 msgr2=0x7fdab80d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/2483631966 shutdown_connections 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/2483631966 wait complete. 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 Processor -- start 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- start start 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdab81f2290 0x7fdab815e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 0x7fdab80d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab80cb320 0x7fdab80d3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab815dcd0 con 0x7fdab815e6a0 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab815d980 con 0x7fdab81f2290 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab81f32c0 con 0x7fdab80cb320 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 0x7fdab80d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 0x7fdab80d33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55074/0 (socket says 172.21.15.40:55074) 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 -- 172.21.15.40:0/1323919042 learned_addr learned my addr 172.21.15.40:0/1323919042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabca6a640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdab81f2290 0x7fdab815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabd26b640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab80cb320 0x7fdab80d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 -- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab80cb320 msgr2=0x7fdab80d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab80cb320 0x7fdab80d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 -- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdab81f2290 msgr2=0x7fdab815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdab81f2290 0x7fdab815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 -- 172.21.15.40:0/1323919042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab81f35a0 con 0x7fdab815e6a0 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabd26b640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab80cb320 0x7fdab80d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabca6a640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdab81f2290 0x7fdab815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab7fff640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 0x7fdab80d33d0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0109d0 tx=0x7fdaac010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00ec20 con 0x7fdab815e6a0 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac00ed80 con 0x7fdab815e6a0 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab81f3880 con 0x7fdab815e6a0 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac004240 con 0x7fdab815e6a0 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.199+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab815ecf0 con 0x7fdab815e6a0 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.203+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab815de40 con 0x7fdab815e6a0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.203+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdaac0043a0 con 0x7fdab815e6a0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.203+0000 7fdab57fa640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdaa40664a0 0x7fdaa4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.203+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fdaac084740 con 0x7fdab815e6a0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.203+0000 7fdabca6a640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdaa40664a0 0x7fdaa4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.203+0000 7fdabca6a640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdaa40664a0 0x7fdaa4068960 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdab80d28f0 tx=0x7fdaa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.207+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdaac051350 con 0x7fdab815e6a0 2023-11-04T01:48:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.359+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fdab804e4a0 con 0x7fdab815e6a0 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.359+0000 7fdab57fa640 1 -- 172.21.15.40:0/1323919042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v116) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdaac054970 con 0x7fdab815e6a0 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdaa40664a0 msgr2=0x7fdaa4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdaa40664a0 0x7fdaa4068960 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdab80d28f0 tx=0x7fdaa8009040 comp rx=0 tx=0).stop 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 msgr2=0x7fdab80d33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 0x7fdab80d33d0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0109d0 tx=0x7fdaac010e90 comp rx=0 tx=0).stop 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 shutdown_connections 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fdaa40664a0 0x7fdaa4068960 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fdab80cb320 0x7fdab80d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdab815e6a0 0x7fdab80d33d0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 --2- 172.21.15.40:0/1323919042 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdab81f2290 0x7fdab815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 >> 172.21.15.40:0/1323919042 conn(0x7fdab80d2fc0 msgr2=0x7fdab80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 shutdown_connections 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.363+0000 7fdabecce640 1 -- 172.21.15.40:0/1323919042 wait complete. 2023-11-04T01:48:25.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.503+0000 7f4c7255c640 1 Processor -- start 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.503+0000 7f4c7255c640 1 -- start start 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c7255c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c6c1556c0 0x7f4c6c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c7255c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c0cabd0 0x7f4c6c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c7255c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4c6c0c9360 0x7f4c6c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c7255c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c0cb590 con 0x7f4c6c1556c0 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c7255c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c15c600 con 0x7f4c6c0c9360 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c7255c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c06fe50 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c6c1556c0 0x7f4c6c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c6c1556c0 0x7f4c6c15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55076/0 (socket says 172.21.15.40:55076) 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 -- 172.21.15.40:0/1317543314 learned_addr learned my addr 172.21.15.40:0/1317543314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6b7fe640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c0cabd0 0x7f4c6c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c70af9640 1 --2- 172.21.15.40:0/1317543314 >> v2:172.21.15.91:3300/0 conn(0x7f4c6c0c9360 0x7f4c6c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 -- 172.21.15.40:0/1317543314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c0cabd0 msgr2=0x7f4c6c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c0cabd0 0x7f4c6c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 -- 172.21.15.40:0/1317543314 >> v2:172.21.15.91:3300/0 conn(0x7f4c6c0c9360 msgr2=0x7f4c6c0c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 --2- 172.21.15.40:0/1317543314 >> v2:172.21.15.91:3300/0 conn(0x7f4c6c0c9360 0x7f4c6c0c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 -- 172.21.15.40:0/1317543314 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c0ae7f0 con 0x7f4c6c1556c0 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6b7fe640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c0cabd0 0x7f4c6c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6bfff640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c1556c0 0x7f4c6c15c0c0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c06bac0 tx=0x7f4c5c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96566f572ff85b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6affd640 1 -- 172.21.15.40:0/1317543314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0aa5f0 con 0x7f4c6c1556c0 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6affd640 1 -- 172.21.15.40:0/1317543314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0aa750 con 0x7f4c6c1556c0 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.507+0000 7f4c6affd640 1 -- 172.21.15.40:0/1317543314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0aaae0 con 0x7f4c6c1556c0 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/1317543314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c1556c0 msgr2=0x7f4c6c15c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c1556c0 0x7f4c6c15c0c0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c06bac0 tx=0x7f4c5c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/1317543314 shutdown_connections 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- 172.21.15.40:0/1317543314 >> v2:172.21.15.91:3300/0 conn(0x7f4c6c0c9360 0x7f4c6c0c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c0cabd0 0x7f4c6c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- 172.21.15.40:0/1317543314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c1556c0 0x7f4c6c15c0c0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/1317543314 >> 172.21.15.40:0/1317543314 conn(0x7f4c6c0ced10 msgr2=0x7f4c6c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/1317543314 shutdown_connections 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/1317543314 wait complete. 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 Processor -- start 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- start start 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c6c0c9360 0x7f4c6c13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 0x7f4c6c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c1556c0 0x7f4c6c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c14b560 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c13e4b0 con 0x7f4c6c0c9360 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c152e00 con 0x7f4c6c1556c0 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 0x7f4c6c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 0x7f4c6c0b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55082/0 (socket says 172.21.15.40:55082) 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 -- 172.21.15.40:0/3704041247 learned_addr learned my addr 172.21.15.40:0/3704041247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c70af9640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c1556c0 0x7f4c6c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6bfff640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c6c0c9360 0x7f4c6c13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 -- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c1556c0 msgr2=0x7f4c6c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c1556c0 0x7f4c6c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 -- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c6c0c9360 msgr2=0x7f4c6c13df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c6c0c9360 0x7f4c6c13df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 -- 172.21.15.40:0/3704041247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0094d0 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c6b7fe640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 0x7f4c6c0b33f0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c7f0 tx=0x7f4c6000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60007820 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c60007980 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c1530e0 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60007d30 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.511+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c150680 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.515+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c150ba0 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.515+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c600113f0 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.515+0000 7f4c68ff9640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c580664a0 0x7f4c58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.515+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7f4c60084b00 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.515+0000 7f4c6bfff640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c580664a0 0x7f4c58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.515+0000 7f4c6bfff640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c580664a0 0x7f4c58068960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0ae000 tx=0x7f4c5c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.519+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4c60086e60 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.675+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c6c04e4a0 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.675+0000 7f4c68ff9640 1 -- 172.21.15.40:0/3704041247 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c6001f0a0 con 0x7f4c6c0cabd0 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c580664a0 msgr2=0x7f4c58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c580664a0 0x7f4c58068960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0ae000 tx=0x7f4c5c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 msgr2=0x7f4c6c0b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 0x7f4c6c0b33f0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c7f0 tx=0x7f4c6000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 shutdown_connections 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7f4c580664a0 0x7f4c58068960 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7f4c6c1556c0 0x7f4c6c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c6c0cabd0 0x7f4c6c0b33f0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 --2- 172.21.15.40:0/3704041247 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c6c0c9360 0x7f4c6c13df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 >> 172.21.15.40:0/3704041247 conn(0x7f4c6c0ced10 msgr2=0x7f4c6c14bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 shutdown_connections 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.679+0000 7f4c7255c640 1 -- 172.21.15.40:0/3704041247 wait complete. 2023-11-04T01:48:25.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 Processor -- start 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 -- start start 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cddd0 0x7faa500cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa5015ddd0 0x7faa5015e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5015ebb0 con 0x7faa500cd9f0 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa501613c0 con 0x7faa5015ddd0 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa54ef7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa501616a0 con 0x7faa500cddd0 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa5015ddd0 0x7faa5015e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa5015ddd0 0x7faa5015e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55084/0 (socket says 172.21.15.40:55084) 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4dd9b640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cddd0 0x7faa500cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4e59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7faa500cd9f0 0x7faa500ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.40:46900/0 (socket says 172.21.15.40:46900) 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 -- 172.21.15.40:0/587230933 learned_addr learned my addr 172.21.15.40:0/587230933 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 -- 172.21.15.40:0/587230933 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cddd0 msgr2=0x7faa500cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 --2- 172.21.15.40:0/587230933 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cddd0 0x7faa500cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 -- 172.21.15.40:0/587230933 >> v1:172.21.15.91:6789/0 conn(0x7faa500cd9f0 legacy=0x7faa500ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.815+0000 7faa4ed9d640 1 -- 172.21.15.40:0/587230933 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50161980 con 0x7faa5015ddd0 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4ed9d640 1 --2- 172.21.15.40:0/587230933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5015e260 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7faa48009e50 tx=0x7faa4801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7032d760734a48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4d59a640 1 -- 172.21.15.40:0/587230933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a56e0 con 0x7faa5015ddd0 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4d59a640 1 -- 172.21.15.40:0/587230933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480a5840 con 0x7faa5015ddd0 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4d59a640 1 -- 172.21.15.40:0/587230933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a5bd0 con 0x7faa5015ddd0 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- 172.21.15.40:0/587230933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 msgr2=0x7faa5015e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 --2- 172.21.15.40:0/587230933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5015e260 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7faa48009e50 tx=0x7faa4801ca10 comp rx=0 tx=0).stop 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- 172.21.15.40:0/587230933 shutdown_connections 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 --2- 172.21.15.40:0/587230933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5015e260 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 --2- 172.21.15.40:0/587230933 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cddd0 0x7faa500cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- 172.21.15.40:0/587230933 >> 172.21.15.40:0/587230933 conn(0x7faa5006dd20 msgr2=0x7faa5006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- 172.21.15.40:0/587230933 shutdown_connections 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- 172.21.15.40:0/587230933 wait complete. 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 Processor -- start 2023-11-04T01:48:25.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- start start 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cd9f0 0x7faa5014be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cddd0 0x7faa5014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5014f310 con 0x7faa5015ddd0 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501559c0 con 0x7faa500cddd0 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa54ef7640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa501550b0 con 0x7faa500cd9f0 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5014ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55090/0 (socket says 172.21.15.40:55090) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.819+0000 7faa4ed9d640 1 -- 172.21.15.40:0/1618945972 learned_addr learned my addr 172.21.15.40:0/1618945972 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4dd9b640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cddd0 0x7faa5014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4e59c640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cd9f0 0x7faa5014be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4ed9d640 1 -- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cd9f0 msgr2=0x7faa5014be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4ed9d640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cd9f0 0x7faa5014be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4ed9d640 1 -- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cddd0 msgr2=0x7faa5014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4ed9d640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cddd0 0x7faa5014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4ed9d640 1 -- 172.21.15.40:0/1618945972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009b30 con 0x7faa5015ddd0 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4ed9d640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5014ce20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7faa4801a640 tx=0x7faa480197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480b8670 con 0x7faa5015ddd0 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480b87f0 con 0x7faa5015ddd0 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5014d650 con 0x7faa5015ddd0 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480b8ba0 con 0x7faa5015ddd0 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50155650 con 0x7faa5015ddd0 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50155b50 con 0x7faa5015ddd0 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa480b8d00 con 0x7faa5015ddd0 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa3effd640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa300664a0 0x7faa30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7faa4811f670 con 0x7faa5015ddd0 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4e59c640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa300664a0 0x7faa30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.823+0000 7faa4e59c640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa300664a0 0x7faa30068960 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7faa44000f70 tx=0x7faa44007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.827+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa480ec430 con 0x7faa5015ddd0 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.979+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa5004e4a0 con 0x7faa5015ddd0 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.979+0000 7faa3effd640 1 -- 172.21.15.40:0/1618945972 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa48009510 con 0x7faa5015ddd0 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-11-04T01:48:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa300664a0 msgr2=0x7faa30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa300664a0 0x7faa30068960 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7faa44000f70 tx=0x7faa44007cb0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 msgr2=0x7faa5014ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5014ce20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7faa4801a640 tx=0x7faa480197b0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 shutdown_connections 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7faa300664a0 0x7faa30068960 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5015ddd0 0x7faa5014ce20 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faa500cddd0 0x7faa5014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 --2- 172.21.15.40:0/1618945972 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa500cd9f0 0x7faa5014be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 >> 172.21.15.40:0/1618945972 conn(0x7faa5006dd20 msgr2=0x7faa5015c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 shutdown_connections 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:25.983+0000 7faa54ef7640 1 -- 172.21.15.40:0/1618945972 wait complete. 2023-11-04T01:48:26.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:48:26.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 Processor -- start 2023-11-04T01:48:26.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 -- start start 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fefe415d2a0 0x7fefe4160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe41614b0 con 0x7fefe406d190 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40b38d0 con 0x7fefe415d2a0 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe9886640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40b3bb0 con 0x7fefe40b4be0 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fefe406d190 0x7fefe406a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44052/0 (socket says 172.21.15.40:44052) 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe37fe640 1 -- 172.21.15.40:0/2497344908 learned_addr learned my addr 172.21.15.40:0/2497344908 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe27fc640 1 --2- 172.21.15.40:0/2497344908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe2ffd640 1 --2- 172.21.15.40:0/2497344908 >> v2:172.21.15.91:3300/0 conn(0x7fefe415d2a0 0x7fefe4160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe1ffb640 1 -- 172.21.15.40:0/2497344908 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703298714 0 0) 0x7fefdc0014a0 con 0x7fefe406d190 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe1ffb640 1 -- 172.21.15.40:0/2497344908 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefcc003530 con 0x7fefe406d190 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe27fc640 1 -- 172.21.15.40:0/2497344908 >> v2:172.21.15.91:3300/0 conn(0x7fefe415d2a0 msgr2=0x7fefe4160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe27fc640 1 --2- 172.21.15.40:0/2497344908 >> v2:172.21.15.91:3300/0 conn(0x7fefe415d2a0 0x7fefe4160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe27fc640 1 -- 172.21.15.40:0/2497344908 >> v1:172.21.15.40:6789/0 conn(0x7fefe406d190 legacy=0x7fefe406a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe1ffb640 1 -- 172.21.15.40:0/2497344908 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3978554183 0 0) 0x7fefcc003530 con 0x7fefe406d190 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.115+0000 7fefe27fc640 1 -- 172.21.15.40:0/2497344908 --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe41616f0 con 0x7fefe40b4be0 2023-11-04T01:48:26.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe27fc640 1 --2- 172.21.15.40:0/2497344908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe406cc50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fefd80097c0 tx=0x7fefd801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575f58bf8bfb0613 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe1ffb640 1 -- 172.21.15.40:0/2497344908 <== mon.2 v2:172.21.15.91:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc001b90 con 0x7fefe40b4be0 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe1ffb640 1 -- 172.21.15.40:0/2497344908 <== mon.2 v2:172.21.15.91:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd80a7050 con 0x7fefe40b4be0 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe1ffb640 1 -- 172.21.15.40:0/2497344908 <== mon.2 v2:172.21.15.91:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80ab600 con 0x7fefe40b4be0 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- 172.21.15.40:0/2497344908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 msgr2=0x7fefe406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 --2- 172.21.15.40:0/2497344908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe406cc50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fefd80097c0 tx=0x7fefd801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- 172.21.15.40:0/2497344908 shutdown_connections 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 --2- 172.21.15.40:0/2497344908 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe406cc50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 --2- 172.21.15.40:0/2497344908 >> v2:172.21.15.91:3300/0 conn(0x7fefe415d2a0 0x7fefe4160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- 172.21.15.40:0/2497344908 >> 172.21.15.40:0/2497344908 conn(0x7fefe40b18a0 msgr2=0x7fefe40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- 172.21.15.40:0/2497344908 shutdown_connections 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- 172.21.15.40:0/2497344908 wait complete. 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 Processor -- start 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- start start 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe406d190 0x7fefe4148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 0x7fefe4148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4153750 con 0x7fefe415d2a0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe41524f0 con 0x7fefe406d190 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe9886640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe41527d0 con 0x7fefe40b4be0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 0x7fefe4148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 0x7fefe4148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55096/0 (socket says 172.21.15.40:55096) 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.119+0000 7fefe37fe640 1 -- 172.21.15.40:0/1093067772 learned_addr learned my addr 172.21.15.40:0/1093067772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe27fc640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe2ffd640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe406d190 0x7fefe4148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe37fe640 1 -- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 msgr2=0x7fefe4151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe37fe640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe4151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe37fe640 1 -- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe406d190 msgr2=0x7fefe4148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe37fe640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe406d190 0x7fefe4148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe37fe640 1 -- 172.21.15.40:0/1093067772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8009420 con 0x7fefe415d2a0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe2ffd640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe406d190 0x7fefe4148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe37fe640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 0x7fefe4148c10 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00cc10 tx=0x7fefdc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00ce20 con 0x7fefe415d2a0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc012400 con 0x7fefe415d2a0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0127b0 con 0x7fefe415d2a0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe4152ab0 con 0x7fefe415d2a0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe41488b0 con 0x7fefe415d2a0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe41538c0 con 0x7fefe415d2a0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefdc012910 con 0x7fefe415d2a0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefcbfff640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefd00664a0 0x7fefd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7862+0+0 (secure 0 0 0) 0x7fefdc084db0 con 0x7fefe415d2a0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.123+0000 7fefe2ffd640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefd00664a0 0x7fefd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.127+0000 7fefe2ffd640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefd00664a0 0x7fefd0068960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009ae0 tx=0x7fefd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.127+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fefdc089070 con 0x7fefe415d2a0 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.291+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fefe41614b0 con 0x7fefe415d2a0 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.291+0000 7fefcbfff640 1 -- 172.21.15.40:0/1093067772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v116) v1 ==== 81+0+1384 (secure 0 0 0) 0x7fefe41614b0 con 0x7fefe415d2a0 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/1658130781 2023-11-04T02:47:52.686288+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2209627414 2023-11-05T01:47:44.960567+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/2884841846 2023-11-04T02:46:56.954663+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/3996815211 2023-11-05T01:47:37.592112+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2209627414 2023-11-05T01:47:44.960567+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/3717165508 2023-11-05T01:46:48.727255+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/3698962796 2023-11-05T01:44:32.632378+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6832/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/3996815211 2023-11-05T01:47:37.592112+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6837/1982091809 2023-11-05T01:46:41.851397+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6835/1813470604 2023-11-05T01:45:03.687333+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6833/960586799 2023-11-05T01:46:04.035367+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/15089123 2023-11-05T01:44:01.252782+0000 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.91:6836/2523798790 2023-11-05T01:45:29.242234+0000 2023-11-04T01:48:26.297 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6834/2918977483 2023-11-05T01:45:57.090700+0000 2023-11-04T01:48:26.297 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.1:0/771372867 2023-11-04T02:46:12.185534+0000 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:listed 23 entries 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.291+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefd00664a0 msgr2=0x7fefd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.291+0000 7fefe9886640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefd00664a0 0x7fefd0068960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009ae0 tx=0x7fefd4008040 comp rx=0 tx=0).stop 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.291+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 msgr2=0x7fefe4148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.291+0000 7fefe9886640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 0x7fefe4148c10 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00cc10 tx=0x7fefdc00a430 comp rx=0 tx=0).stop 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 shutdown_connections 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:6832/3202656120,v1:172.21.15.91:6833/3202656120] conn(0x7fefd00664a0 0x7fefd0068960 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d2a0 0x7fefe4148c10 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fefe40b4be0 0x7fefe4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 --2- 172.21.15.40:0/1093067772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fefe406d190 0x7fefe4148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 >> 172.21.15.40:0/1093067772 conn(0x7fefe40b18a0 msgr2=0x7fefe40ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 shutdown_connections 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26.295+0000 7fefe9886640 1 -- 172.21.15.40:0/1093067772 wait complete. 2023-11-04T01:48:26.312 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-11-04T01:48:26.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:26.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:26 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-04T01:48:26.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:26.360 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi040.front.sepia.ceph.com, aborting... 2023-11-04T01:48:26.360 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:26.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer --timeout=300 -- env PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-04T01:48:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 3w CHR 1,11 0t0 11 /dev/kmsg 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 6r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 7r DIR 0,28 0 1 /sys/fs/cgroup 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 9u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 10r REG 0,23 0 22989 /proc/1/mountinfo 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 11r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 12r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 14r REG 0,23 0 4026532081 /proc/swaps 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 15u netlink 0t0 22990 KOBJECT_UEVENT 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 16r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 17r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 18u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 19u unix 0xffff9c3b9372e600 0t0 22994 /run/systemd/private type=STREAM 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 20u unix 0xffff9c3b9372dd80 0t0 22996 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 21u unix 0xffff9c3b9372d940 0t0 22997 /run/systemd/io.system.ManagedOOM type=STREAM 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 25u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 26u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 27u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 28r CHR 10,235 0t0 430 /dev/autofs 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 29u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 30u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 31u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 32u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 33u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 34u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 36u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 37u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 38u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 40u unix 0xffff9c3b9372bfc0 0t0 22991 /run/systemd/notify type=DGRAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 41u unix 0xffff9c3b9372a200 0t0 22992 type=DGRAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 45u unix 0xffff9c3b9097d500 0t0 139587 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 52u unix 0xffff9c3b9372a640 0t0 23014 type=DGRAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 53u netlink 0t0 23015 AUDIT 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 58u unix 0xffff9c3b9372f2c0 0t0 22993 type=DGRAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 59u unix 0xffff9c3b90aa8440 0t0 16160 type=DGRAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 60u unix 0xffff9c3b90aab300 0t0 16161 type=DGRAM 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 61u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 64u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 69u unix 0xffff9c3b91d58880 0t0 16829 /run/udev/control type=SEQPACKET 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 70u unix 0xffff9c3b9097c400 0t0 23829 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 71u unix 0xffff9c3b91d58440 0t0 16822 /run/systemd/journal/dev-log type=DGRAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 72u unix 0xffff9c3b90aac840 0t0 16166 type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 73u FIFO 0,25 0t0 420 /run/initctl 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 74r FIFO 0,13 0t0 16796 pipe 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 75u unix 0xffff9c3b9097bb80 0t0 23836 /run/uuidd/request type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 82u unix 0xffff9c3b9097d0c0 0t0 23835 @ISCSIADM_ABSTRACT_NAMESPACE type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 83u unix 0xffff9c3b91d5bb80 0t0 16799 /run/lvm/lvmpolld.socket type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 84u netlink 0t0 16831 KOBJECT_UEVENT 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 85u unix 0xffff9c3b91d5d0c0 0t0 16801 /run/rpcbind.sock type=STREAM 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 86u IPv4 19518 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 87u IPv4 19519 0t0 UDP *:sunrpc 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 102u IPv6 17488 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 103u IPv6 19520 0t0 UDP *:sunrpc 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 114u unix 0xffff9c3b91d5c400 0t0 16813 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 117u unix 0xffff9c3b8a175500 0t0 136818 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 118u unix 0xffff9c3b8ab46a40 0t0 132308 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 119u unix 0xffff9c3b9352d940 0t0 73150 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 120u unix 0xffff9c3b93528440 0t0 27671 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 121u unix 0xffff9c3b91d5dd80 0t0 21945 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 122u unix 0xffff9c3b90aaea40 0t0 26323 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 125u unix 0xffff9c3b9444d0c0 0t0 16329 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 126u unix 0xffff9c3b9372c840 0t0 16327 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 127u unix 0xffff9c3b90979dc0 0t0 16304 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 128u unix 0xffff9c3b91d59dc0 0t0 23173 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 129u unix 0xffff9c3b91d59540 0t0 19763 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 130u unix 0xffff9c3b91d5e600 0t0 19751 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 131u unix 0xffff9c3b9444c840 0t0 23171 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 132u unix 0xffff9c3b90aa9980 0t0 23170 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 133u unix 0xffff9c3b94441dc0 0t0 17095 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 134u unix 0xffff9c3b94448440 0t0 17094 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 135u unix 0xffff9c3b94442a80 0t0 17034 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 136u unix 0xffff9c3b90aae1c0 0t0 25633 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 137u unix 0xffff9c3b90dffb40 0t0 24586 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 138u unix 0xffff9c3b9352aa80 0t0 123350 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 139u unix 0xffff9c3b94446a40 0t0 132602 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 152u unix 0xffff9c3b91d58000 0t0 16815 /run/systemd/fsck.progress type=STREAM 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 153u netlink 0t0 16821 AUDIT 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 154u CHR 10,242 0t0 3 /dev/rfkill 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 155u unix 0xffff9c3b91d5b300 0t0 16824 /run/systemd/journal/socket type=DGRAM 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 156u unix 0xffff9c3b91d5c840 0t0 16826 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 157u FIFO 0,25 0t0 413 /run/dmeventd-server 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 158u FIFO 0,25 0t0 414 /run/dmeventd-client 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1 root 159u netlink 0t0 16828 ROUTE 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 13 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 13 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 13 root txt unknown /proc/13/exe 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_sched 14 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_sched 14 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:rcu_sched 14 root txt unknown /proc/14/exe 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:migration 15 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:migration 15 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:migration 15 root txt unknown /proc/15/exe 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 16 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 16 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 16 root txt unknown /proc/16/exe 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/0 18 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/0 18 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/0 18 root txt unknown /proc/18/exe 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/1 19 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/1 19 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/1 19 root txt unknown /proc/19/exe 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:migration 21 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:migration 21 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:migration 21 root txt unknown /proc/21/exe 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 22 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 22 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 22 root txt unknown /proc/22/exe 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 24 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 24 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 24 root txt unknown /proc/24/exe 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/2 25 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/2 25 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/2 25 root txt unknown /proc/25/exe 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 26 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 26 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 26 root txt unknown /proc/26/exe 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:migration 27 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:migration 27 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:migration 27 root txt unknown /proc/27/exe 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 28 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 28 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 28 root txt unknown /proc/28/exe 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 30 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 30 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 30 root txt unknown /proc/30/exe 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/3 31 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/3 31 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/3 31 root txt unknown /proc/31/exe 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 32 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 32 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 32 root txt unknown /proc/32/exe 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:migration 33 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:migration 33 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:migration 33 root txt unknown /proc/33/exe 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 34 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 34 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 34 root txt unknown /proc/34/exe 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 36 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 36 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 36 root txt unknown /proc/36/exe 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/4 37 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/4 37 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/4 37 root txt unknown /proc/37/exe 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 38 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 38 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 38 root txt unknown /proc/38/exe 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:migration 39 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:migration 39 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:migration 39 root txt unknown /proc/39/exe 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 40 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 40 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 40 root txt unknown /proc/40/exe 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 42 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 42 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 42 root txt unknown /proc/42/exe 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/5 43 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/5 43 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/5 43 root txt unknown /proc/43/exe 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 44 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 44 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 44 root txt unknown /proc/44/exe 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:migration 45 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:migration 45 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:migration 45 root txt unknown /proc/45/exe 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 46 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 46 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 46 root txt unknown /proc/46/exe 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 48 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 48 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 48 root txt unknown /proc/48/exe 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/6 49 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/6 49 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/6 49 root txt unknown /proc/49/exe 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 50 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 50 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 50 root txt unknown /proc/50/exe 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:migration 51 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:migration 51 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:migration 51 root txt unknown /proc/51/exe 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 52 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 52 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 52 root txt unknown /proc/52/exe 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 54 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 54 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 54 root txt unknown /proc/54/exe 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/7 55 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/7 55 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:cpuhp/7 55 root txt unknown /proc/55/exe 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 56 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 56 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:idle_inje 56 root txt unknown /proc/56/exe 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:migration 57 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi040.stdout:migration 57 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:migration 57 root txt unknown /proc/57/exe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 58 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 58 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:ksoftirqd 58 root txt unknown /proc/58/exe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 60 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 60 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 60 root txt unknown /proc/60/exe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:kdevtmpfs 61 root cwd DIR 0,5 4280 1 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:kdevtmpfs 61 root rtd DIR 0,5 4280 1 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:kdevtmpfs 61 root txt unknown /proc/61/exe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:inet_frag 62 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:inet_frag 62 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi040.stdout:inet_frag 62 root txt unknown /proc/62/exe 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:kauditd 63 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:kauditd 63 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:kauditd 63 root txt unknown /proc/63/exe 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:khungtask 64 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:khungtask 64 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:khungtask 64 root txt unknown /proc/64/exe 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:oom_reape 65 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:oom_reape 65 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:oom_reape 65 root txt unknown /proc/65/exe 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:writeback 66 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:writeback 66 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:writeback 66 root txt unknown /proc/66/exe 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:kcompactd 67 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:kcompactd 67 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:kcompactd 67 root txt unknown /proc/67/exe 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:ksmd 68 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:ksmd 68 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:ksmd 68 root txt unknown /proc/68/exe 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:khugepage 69 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:khugepage 69 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:khugepage 69 root txt unknown /proc/69/exe 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:kintegrit 116 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi040.stdout:kintegrit 116 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:kintegrit 116 root txt unknown /proc/116/exe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:kblockd 117 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:kblockd 117 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:kblockd 117 root txt unknown /proc/117/exe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:blkcg_pun 118 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:blkcg_pun 118 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:blkcg_pun 118 root txt unknown /proc/118/exe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:tpm_dev_w 119 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:tpm_dev_w 119 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:tpm_dev_w 119 root txt unknown /proc/119/exe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:ata_sff 120 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:ata_sff 120 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:ata_sff 120 root txt unknown /proc/120/exe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi040.stdout:md 121 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:md 121 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:md 121 root txt unknown /proc/121/exe 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:edac-poll 122 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:edac-poll 122 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:edac-poll 122 root txt unknown /proc/122/exe 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:devfreq_w 123 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:devfreq_w 123 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:devfreq_w 123 root txt unknown /proc/123/exe 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:watchdogd 124 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:watchdogd 124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:watchdogd 124 root txt unknown /proc/124/exe 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 127 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 127 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 127 root txt unknown /proc/127/exe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kswapd0 134 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kswapd0 134 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kswapd0 134 root txt unknown /proc/134/exe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:ecryptfs- 135 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:ecryptfs- 135 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:ecryptfs- 135 root txt unknown /proc/135/exe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kthrotld 137 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kthrotld 137 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:kthrotld 137 root txt unknown /proc/137/exe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi040.stdout:acpi_ther 138 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:acpi_ther 138 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:acpi_ther 138 root txt unknown /proc/138/exe 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:vfio-irqf 141 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:vfio-irqf 141 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:vfio-irqf 141 root txt unknown /proc/141/exe 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:mld 142 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:mld 142 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:mld 142 root txt unknown /proc/142/exe 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:ipv6_addr 143 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:ipv6_addr 143 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:ipv6_addr 143 root txt unknown /proc/143/exe 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:kstrp 152 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi040.stdout:kstrp 152 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:kstrp 152 root txt unknown /proc/152/exe 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:zswap-shr 157 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:zswap-shr 157 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:zswap-shr 157 root txt unknown /proc/157/exe 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 158 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 158 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 158 root txt unknown /proc/158/exe 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:charger_m 163 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:charger_m 163 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:charger_m 163 root txt unknown /proc/163/exe 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 185 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 185 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 185 root txt unknown /proc/185/exe 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-wq 217 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-wq 217 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-wq 217 root txt unknown /proc/217/exe 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-rese 219 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-rese 219 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-rese 219 root txt unknown /proc/219/exe 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-dele 220 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-dele 220 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:nvme-dele 220 root txt unknown /proc/220/exe 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_0 221 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_0 221 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_0 221 root txt unknown /proc/221/exe 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 222 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 222 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 222 root txt unknown /proc/222/exe 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_1 223 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_1 223 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_1 223 root txt unknown /proc/223/exe 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 224 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 224 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 224 root txt unknown /proc/224/exe 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_2 225 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_2 225 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_2 225 root txt unknown /proc/225/exe 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 226 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 226 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 226 root txt unknown /proc/226/exe 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_3 227 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_3 227 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_3 227 root txt unknown /proc/227/exe 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 228 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 228 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 228 root txt unknown /proc/228/exe 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_4 234 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_4 234 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_4 234 root txt unknown /proc/234/exe 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 235 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 235 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 235 root txt unknown /proc/235/exe 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_5 236 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_5 236 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_5 236 root txt unknown /proc/236/exe 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 237 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 237 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 237 root txt unknown /proc/237/exe 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_6 238 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_6 238 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_6 238 root txt unknown /proc/238/exe 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 239 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 239 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 239 root txt unknown /proc/239/exe 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_7 240 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_7 240 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_7 240 root txt unknown /proc/240/exe 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 241 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 241 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 241 root txt unknown /proc/241/exe 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_8 242 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_8 242 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_8 242 root txt unknown /proc/242/exe 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 243 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 243 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 243 root txt unknown /proc/243/exe 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_9 244 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_9 244 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_eh_9 244 root txt unknown /proc/244/exe 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 245 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 245 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:scsi_tmf_ 245 root txt unknown /proc/245/exe 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 249 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 249 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 249 root txt unknown /proc/249/exe 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:ixgbe 252 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:ixgbe 252 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:ixgbe 252 root txt unknown /proc/252/exe 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 254 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 254 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 254 root txt unknown /proc/254/exe 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 261 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 261 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 261 root txt unknown /proc/261/exe 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 262 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 262 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 262 root txt unknown /proc/262/exe 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 273 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 273 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 273 root txt unknown /proc/273/exe 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 276 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 276 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 276 root txt unknown /proc/276/exe 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 309 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 309 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 309 root txt unknown /proc/309/exe 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:jbd2/sda1 311 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:jbd2/sda1 311 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:jbd2/sda1 311 root txt unknown /proc/311/exe 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi040.stdout:ext4-rsv- 312 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:ext4-rsv- 312 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:ext4-rsv- 312 root txt unknown /proc/312/exe 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root txt REG 8,1 162176 19789 /usr/lib/systemd/systemd-journald 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 8388608 6735 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 8388608 6719 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 8388608 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000@4ce013ac886c43ebae14f651312da1b9-0000000000006586-000609494a16c7c2.journal 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root mem REG 0,25 8 433 /run/systemd/journal/kernel-seqnum 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 3u unix 0xffff9c3b91d5b300 0t0 16824 /run/systemd/journal/socket type=DGRAM 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 4u unix 0xffff9c3b91d5c840 0t0 16826 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 5u netlink 0t0 16821 AUDIT 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 6u unix 0xffff9c3b91d58440 0t0 16822 /run/systemd/journal/dev-log type=DGRAM 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 7w CHR 1,11 0t0 11 /dev/kmsg 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 9u CHR 1,11 0t0 11 /dev/kmsg 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 10u unix 0xffff9c3b9444dd80 0t0 21572 /run/systemd/journal/io.systemd.journal type=STREAM 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 11r REG 0,23 0 21573 /proc/sys/kernel/hostname 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 12u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 13u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 14u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 15u unix 0xffff9c3b9444d940 0t0 21574 type=DGRAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 16u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 17u unix 0xffff9c3b94448440 0t0 17094 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 18u unix 0xffff9c3b90dffb40 0t0 24586 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 19u unix 0xffff9c3b90aae1c0 0t0 25633 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 20u unix 0xffff9c3b9352aa80 0t0 123350 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 21u unix 0xffff9c3b94442a80 0t0 17034 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 22u unix 0xffff9c3b94441dc0 0t0 17095 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 23u unix 0xffff9c3b9352d940 0t0 73150 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 24u unix 0xffff9c3b93528440 0t0 27671 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 25u unix 0xffff9c3b90aa9980 0t0 23170 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 26u unix 0xffff9c3b9444c840 0t0 23171 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 27u unix 0xffff9c3b91d5e600 0t0 19751 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 28u REG 8,1 8388608 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000@4ce013ac886c43ebae14f651312da1b9-0000000000006586-000609494a16c7c2.journal 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 29u unix 0xffff9c3b90979dc0 0t0 16304 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 30u unix 0xffff9c3b91d59540 0t0 19763 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 31u unix 0xffff9c3b91d5dd80 0t0 21945 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 32u unix 0xffff9c3b91d59dc0 0t0 23173 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 33u REG 8,1 8388608 6719 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 34u REG 8,1 8388608 6735 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 35u unix 0xffff9c3b9372c840 0t0 16327 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 36u unix 0xffff9c3b8ab46a40 0t0 132308 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 37u unix 0xffff9c3b9444d0c0 0t0 16329 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 38u unix 0xffff9c3b90aaea40 0t0 26323 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 39u unix 0xffff9c3b94446a40 0t0 132602 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 40u unix 0xffff9c3b8a175500 0t0 136818 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-j 359 root 43u unix 0xffff9c3b9097d500 0t0 139587 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:rpciod 360 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:rpciod 360 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:rpciod 360 root txt unknown /proc/360/exe 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:xprtiod 361 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:xprtiod 361 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:xprtiod 361 root txt unknown /proc/361/exe 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:ext4lazyi 387 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:ext4lazyi 387 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:ext4lazyi 387 root txt unknown /proc/387/exe 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi_eh 390 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi_eh 390 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi_eh 390 root txt unknown /proc/390/exe 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi_con 391 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi_con 391 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:iscsi_con 391 root txt unknown /proc/391/exe 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root txt REG 8,1 1131856 13517 /usr/bin/udevadm 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 11124932 33003 /usr/lib/udev/hwdb.bin 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 1u unix 0xffff9c3b90df8880 0t0 19606 type=STREAM 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 2u unix 0xffff9c3b90df8880 0t0 19606 type=STREAM 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 3u unix 0xffff9c3b91d58880 0t0 16829 /run/udev/control type=SEQPACKET 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 4u netlink 0t0 16831 KOBJECT_UEVENT 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 5u unix 0xffff9c3b90dfb740 0t0 19615 type=DGRAM 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 6u unix 0xffff9c3b90dfd500 0t0 19619 type=DGRAM 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 7u unix 0xffff9c3b90df9980 0t0 19620 type=DGRAM 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 9u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 10u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 11u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 12r REG 8,1 11124932 33003 /usr/lib/udev/hwdb.bin 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-u 428 root 13u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:ipmi-msgh 491 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:ipmi-msgh 491 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:ipmi-msgh 491 root txt unknown /proc/491/exe 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc txt REG 8,1 63912 4337 /usr/sbin/rpcbind 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 1u unix 0xffff9c3b90aa9dc0 0t0 16121 type=STREAM 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 2u unix 0xffff9c3b90aa9dc0 0t0 16121 type=STREAM 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 3u unix 0xffff9c3b91d5d0c0 0t0 16801 /run/rpcbind.sock type=STREAM 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 4u IPv4 19518 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 5u IPv4 19519 0t0 UDP *:sunrpc 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 6u IPv6 17488 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 7u IPv6 19520 0t0 UDP *:sunrpc 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 8rW REG 0,25 0 1289 /run/rpcbind.lock 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi040.stdout:rpcbind 498 _rpc 9u unix 0xffff9c3b9372d500 0t0 18782 /run/rpcbind.sock type=STREAM 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network txt REG 8,1 1513936 19795 /usr/lib/systemd/systemd-networkd 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 1u unix 0xffff9c3b94440cc0 0t0 18580 type=STREAM 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 2u unix 0xffff9c3b94440cc0 0t0 18580 type=STREAM 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 3u netlink 0t0 16828 ROUTE 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 4u unix 0xffff9c3b94442ec0 0t0 18594 type=DGRAM 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 6u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 7u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 9u netlink 0t0 18598 GENERIC 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 10u netlink 0t0 18599 KOBJECT_UEVENT 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 11u unix 0xffff9c3b94443fc0 0t0 18600 type=DGRAM 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 12u unix 0xffff9c3b94442200 0t0 18601 type=DGRAM 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 13u unix 0xffff9c3b944472c0 0t0 18602 type=DGRAM 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 14u unix 0xffff9c3b94446600 0t0 18603 type=DGRAM 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 16u sock 0,8 0t0 18606 protocol: UDP 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-n 499 systemd-network 17u unix 0xffff9c3b94441540 0t0 18634 type=STREAM 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:cryptd 539 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:cryptd 539 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:cryptd 539 root txt unknown /proc/539/exe 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:kipmi0 580 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:kipmi0 580 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:kipmi0 580 root txt unknown /proc/580/exe 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root txt REG 8,1 39224 2570 /usr/sbin/blkmapd 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root 3wW REG 0,25 4 1302 /run/blkmapd.pid 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root 4r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:blkmapd 589 root 5u unix 0xffff9c3b90978440 0t0 23819 type=DGRAM 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root txt REG 8,1 55864 3888 /usr/sbin/nfsdcld 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root mem REG 8,1 211136 486 /usr/lib/x86_64-linux-gnu/libevent_core-2.1.so.7.0.1 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 4r FIFO 0,13 0t0 23137 pipe 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 5w FIFO 0,13 0t0 23137 pipe 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 6u REG 8,1 32768 139416 /var/lib/nfs/nfsdcld/main.sqlite 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:nfsdcld 591 root 8u FIFO 0,36 0t0 113 /run/rpc_pipefs/nfsd/cld 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root txt REG 8,1 47592 3135 /usr/sbin/rpc.idmapd 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root mem REG 8,1 211136 486 /usr/lib/x86_64-linux-gnu/libevent_core-2.1.so.7.0.1 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root mem REG 8,1 39584 4155 /usr/lib/x86_64-linux-gnu/libnfsidmap.so.1.0.0 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root mem REG 8,1 35480 48372 /usr/lib/x86_64-linux-gnu/libnfsidmap/nsswitch.so 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 4u unix 0xffff9c3b91d5a200 0t0 17066 type=DGRAM 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 6r FIFO 0,13 0t0 17069 pipe 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 7w FIFO 0,13 0t0 17069 pipe 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 8u REG 0,23 0 4026532453 /proc/592/net/rpc/nfs4.nametoid/channel 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 9u REG 0,23 0 4026532449 /proc/592/net/rpc/nfs4.idtoname/channel 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.idmap 592 root 10r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 3u unix 0xffff9c3b90978000 0t0 23820 type=DGRAM 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 4r FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 6w FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 7w REG 8,1 1105 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 8u pack 21843 0t0 ALL type=SOCK_RAW 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 root 9u IPv4 21847 0t0 UDP *:bootpc 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 3u unix 0xffff9c3b90978000 0t0 23820 type=DGRAM 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 4r FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 6w FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 7w REG 8,1 1105 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 8u pack 21843 0t0 ALL type=SOCK_RAW 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 596 isc-worke root 9u IPv4 21847 0t0 UDP *:bootpc 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 3u unix 0xffff9c3b90978000 0t0 23820 type=DGRAM 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 4r FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 6w FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 7w REG 8,1 1105 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 8u pack 21843 0t0 ALL type=SOCK_RAW 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 597 isc-socke root 9u IPv4 21847 0t0 UDP *:bootpc 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 3u unix 0xffff9c3b90978000 0t0 23820 type=DGRAM 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 4r FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 6w FIFO 0,13 0t0 18621 pipe 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 7w REG 8,1 1105 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 8u pack 21843 0t0 ALL type=SOCK_RAW 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:dhclient 593 598 isc-timer root 9u IPv4 21847 0t0 UDP *:bootpc 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 1u unix 0xffff9c3b94448000 0t0 21732 type=STREAM 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 2u unix 0xffff9c3b94448000 0t0 21732 type=STREAM 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 5u sock 0,8 0t0 23854 protocol: UNIX-STREAM 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 1u unix 0xffff9c3b94448000 0t0 21732 type=STREAM 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 2u unix 0xffff9c3b94448000 0t0 21732 type=STREAM 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 5u sock 0,8 0t0 23854 protocol: UNIX-STREAM 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 636 gmain root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 1u unix 0xffff9c3b94448000 0t0 21732 type=STREAM 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 2u unix 0xffff9c3b94448000 0t0 21732 type=STREAM 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 5u sock 0,8 0t0 23854 protocol: UNIX-STREAM 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:accounts- 625 651 gdbus root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus txt REG 8,1 232776 9094 /usr/bin/dbus-daemon 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 1u unix 0xffff9c3b94446e80 0t0 18645 type=STREAM 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 2u unix 0xffff9c3b94446e80 0t0 18645 type=STREAM 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 3u unix 0xffff9c3b9097c400 0t0 23829 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 5u sock 0,8 0t0 21779 protocol: NETLINK 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 6u unix 0xffff9c3b9444b740 0t0 21783 type=DGRAM 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 8u unix 0xffff9c3b9444d500 0t0 21784 type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 9u unix 0xffff9c3b94449980 0t0 21785 type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 10u unix 0xffff9c3b94442640 0t0 21786 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 11u unix 0xffff9c3b90aa8880 0t0 21787 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 12u sock 0,8 0t0 21788 protocol: UNIX-STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 13u unix 0xffff9c3b94449dc0 0t0 16207 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 14u unix 0xffff9c3b9444a200 0t0 19814 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 15u unix 0xffff9c3b90aabb80 0t0 19815 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 16u unix 0xffff9c3b91d58cc0 0t0 23904 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 17u unix 0xffff9c3b90dfdd80 0t0 18783 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 18u unix 0xffff9c3b94445940 0t0 138339 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 19u unix 0xffff9c3b93529100 0t0 17375 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 20u unix 0xffff9c3b8a1772c0 0t0 72115 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 21u unix 0xffff9c3b8a172ec0 0t0 138398 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:dbus-daem 626 messagebus 24u unix 0xffff9c3b8a1750c0 0t0 135766 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root txt REG 8,1 68464 2451 /usr/sbin/irqbalance 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root 1u unix 0xffff9c3b90aad500 0t0 16173 type=STREAM 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root 2u unix 0xffff9c3b90aad500 0t0 16173 type=STREAM 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 root 5u unix 0xffff9c3b90aa8cc0 0t0 16179 /run/irqbalance/irqbalance631.sock type=STREAM 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root txt REG 8,1 68464 2451 /usr/sbin/irqbalance 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root 1u unix 0xffff9c3b90aad500 0t0 16173 type=STREAM 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root 2u unix 0xffff9c3b90aad500 0t0 16173 type=STREAM 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:irqbalanc 631 633 gmain root 5u unix 0xffff9c3b90aa8cc0 0t0 16179 /run/irqbalance/irqbalance631.sock type=STREAM 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 699 HT\x20cle root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 700 lttng-ses root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 701 Health root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 703 Notificat root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 704 Action root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 705 Timer root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 706 Rotation root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 707 Client root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.519 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 708 UST\x20re root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 709 UST\x20ap root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 710 UST\x20ap root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 711 Applicati root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 712 Agent\x20 root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 821379 524297 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 1492437 524292 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 13012 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 26433 524299 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 3wW REG 0,25 0 1383 /run/lttng/lttng-sessiond.lck 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 4u unix 0xffff9c3b90aab740 0t0 16224 type=STREAM 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 5r FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 6w FIFO 0,13 0t0 16226 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 7r FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 8w FIFO 0,13 0t0 16227 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 9r FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 10w FIFO 0,13 0t0 16228 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 11r FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 12w FIFO 0,13 0t0 16229 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 13r FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 14w FIFO 0,13 0t0 16230 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 15r FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 16w FIFO 0,13 0t0 16231 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 17r FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 18w FIFO 0,13 0t0 16232 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 20u unix 0xffff9c3b90aaaa80 0t0 16235 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 21u unix 0xffff9c3b90aaaec0 0t0 16236 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 22u unix 0xffff9c3b90aa8000 0t0 16237 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 23r FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 24w FIFO 0,13 0t0 16238 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 25r FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 26w FIFO 0,13 0t0 16239 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 27r FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 28w FIFO 0,13 0t0 16240 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 29r FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 30w FIFO 0,13 0t0 16243 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 32u unix 0xffff9c3b94440000 0t0 18697 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 33r FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 34w FIFO 0,13 0t0 16246 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 35u unix 0xffff9c3b94444400 0t0 18698 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 37r FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 38w FIFO 0,13 0t0 23883 pipe 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 39r FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 40w FIFO 0,13 0t0 23884 pipe 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 41u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 42u unix 0xffff9c3b9097f2c0 0t0 23885 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 43u unix 0xffff9c3b9352c400 0t0 26229 type=STREAM 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 44u unix 0xffff9c3b93528000 0t0 18699 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 45u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 46r FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 47w FIFO 0,13 0t0 23886 pipe 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 48u unix 0xffff9c3b9097ea40 0t0 23887 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 50r FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 51w FIFO 0,13 0t0 23888 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 52r FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 53w FIFO 0,13 0t0 23889 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 55r FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 56w FIFO 0,13 0t0 23890 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 59u IPv4 21846 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 60r FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 61w FIFO 0,13 0t0 23891 pipe 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-ses 632 713 Kernel root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 1u unix 0xffff9c3b91d5f2c0 0t0 17096 type=STREAM 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 2u unix 0xffff9c3b91d5f2c0 0t0 17096 type=STREAM 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 3u unix 0xffff9c3b91d5aa80 0t0 17154 type=STREAM 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 5u unix 0xffff9c3b91d59980 0t0 17156 type=STREAM 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:networkd- 635 root 6u unix 0xffff9c3b91d5b740 0t0 17157 type=STREAM 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root txt REG 8,1 601248 21354 /usr/sbin/smartd 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:smartd 660 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root txt REG 8,1 264712 19791 /usr/lib/systemd/systemd-logind 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 1u unix 0xffff9c3b91d5ea40 0t0 17102 type=STREAM 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 2u unix 0xffff9c3b91d5ea40 0t0 17102 type=STREAM 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 3u unix 0xffff9c3b9444bb80 0t0 21817 type=DGRAM 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 6u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 7r REG 0,22 4096 26760 /sys/devices/virtual/tty/tty0/active 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 8u netlink 0t0 21824 KOBJECT_UEVENT 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 10r FIFO 0,25 0t0 1470 /run/systemd/inhibit/1.ref 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 11u netlink 0t0 21825 KOBJECT_UEVENT 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 12u netlink 0t0 21826 KOBJECT_UEVENT 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 13u netlink 0t0 21827 KOBJECT_UEVENT 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 14u unix 0xffff9c3b9444e1c0 0t0 21828 type=STREAM 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 15u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 16u CHR 13,65 0t0 150 /dev/input/event1 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 17u CHR 13,64 0t0 149 /dev/input/event0 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 18u CHR 13,66 0t0 413 /dev/input/event2 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 19u CHR 4,6 0t0 26 /dev/tty6 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 20r FIFO 0,25 0t0 2015 /run/systemd/sessions/6.ref 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 22r FIFO 0,25 0t0 3231 /run/systemd/inhibit/8.ref 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-l 665 root 23r FIFO 0,25 0t0 3532 /run/systemd/inhibit/9.ref 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve txt REG 8,1 489904 19802 /usr/lib/systemd/systemd-resolved 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 1u unix 0xffff9c3b91d5ee80 0t0 17118 type=STREAM 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 2u unix 0xffff9c3b91d5ee80 0t0 17118 type=STREAM 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 3u unix 0xffff9c3b91d5d940 0t0 17145 type=DGRAM 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 6u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 7r REG 0,43 0 21853 /proc/sys/kernel/hostname 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 9u netlink 0t0 21854 ROUTE 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 10u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 12u unix 0xffff9c3b9444f2c0 0t0 21855 type=STREAM 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 13u IPv4 21856 0t0 UDP localhost:domain 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 14u IPv4 21857 0t0 TCP localhost:domain (LISTEN) 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 15u unix 0xffff9c3b9444bfc0 0t0 21858 /run/systemd/resolve/io.systemd.Resolve type=STREAM 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 16u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:systemd-r 668 systemd-resolve 17u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root 1u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root 2u unix 0xffff9c3b9444b300 0t0 21771 type=STREAM 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:lttng-run 698 root 5u unix 0xffff9c3b90aafb40 0t0 16225 type=STREAM 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 4u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 6u unix 0xffff9c3b90aac400 0t0 16254 type=STREAM 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 4u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 6u unix 0xffff9c3b90aac400 0t0 16254 type=STREAM 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 719 gmain root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 4u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 6u unix 0xffff9c3b90aac400 0t0 16254 type=STREAM 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:polkitd 718 721 gdbus root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root txt REG 8,1 120640 3891 /usr/sbin/rpc.mountd 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 3u REG 0,23 0 4026532421 /proc/923/net/rpc/auth.unix.ip/channel 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 4u IPv4 26266 0t0 UDP *:34021 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 5u IPv4 26268 0t0 TCP *:48325 (LISTEN) 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 6u IPv6 26270 0t0 UDP *:40305 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 7u IPv6 26272 0t0 TCP *:45457 (LISTEN) 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 8u IPv4 26274 0t0 UDP *:49042 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 9u IPv4 26276 0t0 TCP *:39011 (LISTEN) 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 10u IPv6 26278 0t0 UDP *:50859 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 11u IPv6 26280 0t0 TCP *:35619 (LISTEN) 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 12u IPv4 26282 0t0 UDP *:52948 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 13u IPv4 26284 0t0 TCP *:43029 (LISTEN) 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 14u IPv6 26286 0t0 UDP *:56260 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 15u IPv6 26288 0t0 TCP *:36055 (LISTEN) 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 16u REG 0,23 0 4026532425 /proc/923/net/rpc/auth.unix.gid/channel 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 17u REG 0,23 0 4026532441 /proc/923/net/rpc/nfsd.export/channel 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 18u REG 0,23 0 4026532445 /proc/923/net/rpc/nfsd.fh/channel 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 19r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.mount 923 root 20u unix 0xffff9c3b90dfa200 0t0 19832 type=DGRAM 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root cwd DIR 8,1 4096 1160 /var/spool/cron 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root txt REG 8,1 51792 1461 /usr/sbin/cron 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root 1u unix 0xffff9c3b9097c840 0t0 23907 type=STREAM 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root 2u unix 0xffff9c3b9097c840 0t0 23907 type=STREAM 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root 3uW REG 0,25 4 1436 /run/crond.pid 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:cron 939 root 4u unix 0xffff9c3b9097b300 0t0 23911 type=DGRAM 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios txt REG 8,1 79096 10043 /usr/sbin/nrpe 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios DEL REG 8,1 24692 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios 3u unix 0xffff9c3b91d5bfc0 0t0 17226 type=DGRAM 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios 4u IPv4 17234 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:nrpe 947 nagios 5u IPv6 17235 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd cwd DIR 8,1 4096 5393 /var/lib/nfs 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd txt REG 8,1 80944 2384 /usr/sbin/rpc.statd 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 4u unix 0xffff9c3b91d5aec0 0t0 17190 type=DGRAM 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 5u IPv4 17191 0t0 UDP localhost:706 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 6w REG 0,25 4 1443 /run/rpc.statd.pid 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 8u IPv4 17195 0t0 UDP *:47424 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 9u IPv4 17197 0t0 TCP *:50459 (LISTEN) 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 10u IPv6 17199 0t0 UDP *:34282 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:rpc.statd 954 statd 11u IPv6 17201 0t0 TCP *:58499 (LISTEN) 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root txt REG 8,1 436848 16646 /usr/sbin/tgtd 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 1u unix 0xffff9c3b9372b300 0t0 23331 type=STREAM 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 2u unix 0xffff9c3b9372b300 0t0 23331 type=STREAM 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 4ww REG 0,25 0 1463 /run/tgtd/socket.0.lock 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 5u unix 0xffff9c3b90978880 0t0 23951 /var/run/tgtd/socket.0 type=STREAM 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 6u IPv4 19220 0t0 TCP *:iscsi-target (LISTEN) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 7u IPv6 19221 0t0 TCP *:iscsi-target (LISTEN) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:tgtd 957 root 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 347096 12961 /usr/lib/python3/dist-packages/apt_pkg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 1u unix 0xffff9c3b94449100 0t0 21924 type=STREAM 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 2u unix 0xffff9c3b94449100 0t0 21924 type=STREAM 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 3w REG 8,1 113 655443 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 4u unix 0xffff9c3b90dfe600 0t0 19857 type=STREAM 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 7u unix 0xffff9c3b90dfd940 0t0 19860 type=STREAM 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 8w FIFO 0,25 0t0 1470 /run/systemd/inhibit/1.ref 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 root 9u unix 0xffff9c3b90dfea40 0t0 19861 type=STREAM 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 347096 12961 /usr/lib/python3/dist-packages/apt_pkg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 1u unix 0xffff9c3b94449100 0t0 21924 type=STREAM 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 2u unix 0xffff9c3b94449100 0t0 21924 type=STREAM 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 3w REG 8,1 113 655443 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 4u unix 0xffff9c3b90dfe600 0t0 19857 type=STREAM 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 7u unix 0xffff9c3b90dfd940 0t0 19860 type=STREAM 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 8w FIFO 0,25 0t0 1470 /run/systemd/inhibit/1.ref 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:unattende 959 991 gmain root 9u unix 0xffff9c3b90dfea40 0t0 19861 type=STREAM 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1049 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1050 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1051 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1052 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1053 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1127 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1128 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1129 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1130 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1131 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1133 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1134 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 1u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 2u unix 0xffff9c3b90aa9540 0t0 16331 type=STREAM 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 4r FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 5w FIFO 0,13 0t0 26883 pipe 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 9r FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 10w FIFO 0,13 0t0 23456 pipe 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 11u unix 0xffff9c3b9372aec0 0t0 23457 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 12u unix 0xffff9c3b9372cc80 0t0 23459 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 13u IPv4 23996 0t0 TCP localhost:36077 (LISTEN) 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 14u unix 0xffff9c3b9352b740 0t0 118257 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:container 962 1148 container root 15u unix 0xffff9c3b90dff700 0t0 123351 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 974 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 974 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 974 root txt unknown /proc/974/exe 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:lockd 977 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:lockd 977 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:lockd 977 root txt unknown /proc/977/exe 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 981 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 981 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 981 root txt unknown /proc/981/exe 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 982 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 982 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 982 root txt unknown /proc/982/exe 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 983 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 983 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 983 root txt unknown /proc/983/exe 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 984 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 984 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 984 root txt unknown /proc/984/exe 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 985 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 985 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 985 root txt unknown /proc/985/exe 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 986 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 986 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 986 root txt unknown /proc/986/exe 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 987 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 987 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 987 root txt unknown /proc/987/exe 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 988 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 988 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:nfsd 988 root txt unknown /proc/988/exe 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root 1u unix 0xffff9c3b91d5a640 0t0 17240 type=STREAM 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root 2u unix 0xffff9c3b91d5a640 0t0 17240 type=STREAM 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root 3u IPv4 17249 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 990 root 4u IPv6 17251 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:ib-comp-w 1054 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:ib-comp-w 1054 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:ib-comp-w 1054 root txt unknown /proc/1054/exe 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:ib-comp-u 1055 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:ib-comp-u 1055 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi040.stdout:ib-comp-u 1055 root txt unknown /proc/1055/exe 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:ib_mcast 1056 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:ib_mcast 1056 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:ib_mcast 1056 root txt unknown /proc/1056/exe 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:ib_nl_sa_ 1057 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:ib_nl_sa_ 1057 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:ib_nl_sa_ 1057 root txt unknown /proc/1057/exe 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:rdma_cm 1068 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:rdma_cm 1068 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:rdma_cm 1068 root txt unknown /proc/1068/exe 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root txt REG 8,1 56888 3161 /usr/sbin/agetty 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root 0u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root 1u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root 2u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1141 root 4r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root txt REG 8,1 3798008 15961 /usr/bin/perl 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 35416 47035 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Time/HiRes/HiRes.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 68400 46935 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Compress/Raw/Zlib/Zlib.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 60360 33580 /usr/lib/x86_64-linux-gnu/perl-base/auto/List/Util/Util.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 23064 47032 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Sys/Syslog/Syslog.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 31568 33577 /usr/lib/x86_64-linux-gnu/perl-base/auto/File/Glob/Glob.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 18992 33575 /usr/lib/x86_64-linux-gnu/perl-base/auto/Cwd/Cwd.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 47816 33582 /usr/lib/x86_64-linux-gnu/perl-base/auto/Socket/Socket.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 23152 33579 /usr/lib/x86_64-linux-gnu/perl-base/auto/IO/IO.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 110424 33581 /usr/lib/x86_64-linux-gnu/perl-base/auto/POSIX/POSIX.so 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 22896 33576 /usr/lib/x86_64-linux-gnu/perl-base/auto/Fcntl/Fcntl.so 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root 3r DIR 0,23 0 1 /proc 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:collectl 1146 root 4w REG 8,1 1399214 463 /var/log/collectl/smithi040-20231104-012436.raw.gz 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root txt REG 8,1 56888 3161 /usr/sbin/agetty 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root mem REG 8,1 353616 44555 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root 0u CHR 4,1 0t0 21 /dev/tty1 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root 1u CHR 4,1 0t0 21 /dev/tty1 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root 2u CHR 4,1 0t0 21 /dev/tty1 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:agetty 1150 root 4r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 1u unix 0xffff9c3b9352d0c0 0t0 26472 type=STREAM 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 2u unix 0xffff9c3b9352d0c0 0t0 26472 type=STREAM 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 3u unix 0xffff9c3b93528cc0 0t0 26493 type=DGRAM 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 6r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 7r DIR 0,28 0 4830 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 9u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 10r REG 0,23 0 26496 /proc/1314/mountinfo 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 11r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 12u unix 0xffff9c3b9352e1c0 0t0 26512 /run/user/1000/bus type=STREAM 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 14r REG 0,23 0 4026532081 /proc/swaps 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 15u netlink 0t0 26497 KOBJECT_UEVENT 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 16u unix 0xffff9c3b93529980 0t0 26503 /run/user/1000/systemd/notify type=DGRAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 17u unix 0xffff9c3b9352fb40 0t0 26504 type=DGRAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 18u unix 0xffff9c3b9352c840 0t0 26505 type=DGRAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 19u unix 0xffff9c3b9352b300 0t0 26506 /run/user/1000/systemd/private type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 20u unix 0xffff9c3b9352bb80 0t0 26508 type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 21u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 26u unix 0xffff9c3b94440880 0t0 19320 /run/user/1000/gnupg/S.dirmngr type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 27u unix 0xffff9c3b94447b40 0t0 19322 /run/user/1000/gnupg/S.gpg-agent.browser type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 28u unix 0xffff9c3b94443740 0t0 19324 /run/user/1000/gnupg/S.gpg-agent.extra type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 29u unix 0xffff9c3b94445500 0t0 19326 /run/user/1000/gnupg/S.gpg-agent.ssh type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 30u unix 0xffff9c3b94441980 0t0 19328 /run/user/1000/gnupg/S.gpg-agent type=STREAM 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:systemd 1314 ubuntu 31u unix 0xffff9c3b94444c80 0t0 19330 /run/user/1000/pk-debconf-socket type=STREAM 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 1u unix 0xffff9c3b9352d0c0 0t0 26472 type=STREAM 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 2u unix 0xffff9c3b9352d0c0 0t0 26472 type=STREAM 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 6w FIFO 0,13 0t0 26475 pipe 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:(sd-pam) 1315 ubuntu 7u unix 0xffff9c3b93528880 0t0 26483 type=DGRAM 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 3u unix 0xffff9c3b91d5c400 0t0 16813 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 6u unix 0xffff9c3b8ab450c0 0t0 22291 type=DGRAM 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 7w REG 8,1 537222 115293 /var/log/syslog 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 8w REG 8,1 1122173 658472 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 9w REG 8,1 722937 655441 /var/log/auth.log 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 syslog 11w REG 8,1 5759 658469 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 3u unix 0xffff9c3b91d5c400 0t0 16813 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 6u unix 0xffff9c3b8ab450c0 0t0 22291 type=DGRAM 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 7w REG 8,1 537222 115293 /var/log/syslog 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 8w REG 8,1 1122173 658472 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 9w REG 8,1 722937 655441 /var/log/auth.log 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1368 in:imuxso syslog 11w REG 8,1 5759 658469 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 3u unix 0xffff9c3b91d5c400 0t0 16813 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 6u unix 0xffff9c3b8ab450c0 0t0 22291 type=DGRAM 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 7w REG 8,1 537222 115293 /var/log/syslog 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 8w REG 8,1 1122173 658472 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 9w REG 8,1 722937 655441 /var/log/auth.log 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1369 in:imklog syslog 11w REG 8,1 5759 658469 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 3u unix 0xffff9c3b91d5c400 0t0 16813 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 6u unix 0xffff9c3b8ab450c0 0t0 22291 type=DGRAM 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 7w REG 8,1 537222 115293 /var/log/syslog 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 8w REG 8,1 1122173 658472 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 9w REG 8,1 722937 655441 /var/log/auth.log 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:rsyslogd 1367 1370 rs:main syslog 11w REG 8,1 5759 658469 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 1u unix 0xffff9c3b9352d500 0t0 70475 type=STREAM 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 2u unix 0xffff9c3b9352d500 0t0 70475 type=STREAM 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 3u unix 0xffff9c3b9352a200 0t0 70478 type=DGRAM 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 5u netlink 0t0 70481 ROUTE 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 8u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 9u unix 0xffff9c3b8a175d80 0t0 69263 type=STREAM 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 1u unix 0xffff9c3b9352d500 0t0 70475 type=STREAM 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 2u unix 0xffff9c3b9352d500 0t0 70475 type=STREAM 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 3u unix 0xffff9c3b9352a200 0t0 70478 type=DGRAM 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 5u netlink 0t0 70481 ROUTE 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 8u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 9u unix 0xffff9c3b8a175d80 0t0 69263 type=STREAM 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13495 gmain root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 1u unix 0xffff9c3b9352d500 0t0 70475 type=STREAM 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 2u unix 0xffff9c3b9352d500 0t0 70475 type=STREAM 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 3u unix 0xffff9c3b9352a200 0t0 70478 type=DGRAM 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 5u netlink 0t0 70481 ROUTE 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 8u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 9u unix 0xffff9c3b8a175d80 0t0 69263 type=STREAM 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi040.stdout:packageki 13494 13496 gdbus root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 14197 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 14197 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 14197 root txt unknown /proc/14197/exe 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 16551 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 16551 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 16551 root txt unknown /proc/16551/exe 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 16609 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 16609 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 16609 root txt unknown /proc/16609/exe 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 16983 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 16983 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 16983 root txt unknown /proc/16983/exe 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17016 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17016 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17016 root txt unknown /proc/17016/exe 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17048 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17048 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17048 root txt unknown /proc/17048/exe 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17080 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17080 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17080 root txt unknown /proc/17080/exe 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17112 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17112 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:kdmflush 17112 root txt unknown /proc/17112/exe 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:xfsalloc 17307 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi040.stdout:xfsalloc 17307 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfsalloc 17307 root txt unknown /proc/17307/exe 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs_mru_c 17308 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs_mru_c 17308 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs_mru_c 17308 root txt unknown /proc/17308/exe 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 17310 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 17310 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 17310 root txt unknown /proc/17310/exe 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 17311 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 17311 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 17311 root txt unknown /proc/17311/exe 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 17312 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 17312 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 17312 root txt unknown /proc/17312/exe 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 17313 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 17313 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 17313 root txt unknown /proc/17313/exe 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 17314 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 17314 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 17314 root txt unknown /proc/17314/exe 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 17315 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 17315 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 17315 root txt unknown /proc/17315/exe 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 17316 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 17316 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 17316 root txt unknown /proc/17316/exe 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 17317 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 17317 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 17317 root txt unknown /proc/17317/exe 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27649 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27650 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27651 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27652 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27653 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27654 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27655 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27656 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27657 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27658 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27719 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 1u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 2u unix 0xffff9c3b9352aec0 0t0 122583 type=STREAM 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 3u unix 0xffff9c3b94443b80 0t0 114176 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 4u unix 0xffff9c3b94447700 0t0 18635 /run/docker.sock type=STREAM 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 6r FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 7w FIFO 0,13 0t0 122588 pipe 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 8u unix 0xffff9c3b9352f700 0t0 122589 type=STREAM 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 9u unix 0xffff9c3b90dfe1c0 0t0 120593 type=STREAM 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 12u netlink 0t0 114232 ROUTE 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 13u netlink 0t0 114233 XFRM 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 14u netlink 0t0 114234 NETFILTER 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 15u unix 0xffff9c3b94441100 0t0 114279 /var/run/docker/libnetwork/abc6b2e54c71.sock type=STREAM 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:dockerd 27648 27721 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 18424 14480 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 18424 14482 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 14328 14484 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 3u unix 0xffff9c3b8ab40000 0t0 121424 type=DGRAM 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 4u IPv4 124144 0t0 TCP smithi040.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:60018 (ESTABLISHED) 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 6u unix 0xffff9c3b8ab44c80 0t0 121410 type=STREAM 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 7u unix 0xffff9c3b8ab44840 0t0 121431 type=STREAM 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27904 root 8w FIFO 0,25 0t0 2015 /run/systemd/sessions/6.ref 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 18424 14480 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 18424 14482 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 14328 14484 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 3u unix 0xffff9c3b8ab40000 0t0 121424 type=DGRAM 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 4u IPv4 124144 0t0 TCP smithi040.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:60018 (ESTABLISHED) 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 5u unix 0xffff9c3b8ab40440 0t0 121430 type=STREAM 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 6u unix 0xffff9c3b8ab44c80 0t0 121410 type=STREAM 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 8w FIFO 0,25 0t0 2015 /run/systemd/sessions/6.ref 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 9w FIFO 0,13 0t0 141542 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 10r FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 11w FIFO 0,13 0t0 141545 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 12r FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 13r FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 14w FIFO 0,13 0t0 145657 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 15r FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 16r FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 17w FIFO 0,13 0t0 145660 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 18r FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 19r FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 20w FIFO 0,13 0t0 145663 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 21r FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 22r FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 23w FIFO 0,13 0t0 145666 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 24r FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 25r FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 26w FIFO 0,13 0t0 206087 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 27r FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 28r FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 29w FIFO 0,13 0t0 208718 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 30r FIFO 0,13 0t0 208719 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 32r FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 33r FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 34r FIFO 0,13 0t0 208720 pipe 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 36r FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 37r FIFO 0,13 0t0 214334 pipe 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:sshd 27925 ubuntu 39r FIFO 0,13 0t0 214335 pipe 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp txt REG 8,1 879688 5353 /usr/sbin/ntpd 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 140800 30041 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 1r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 2r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 3u unix 0xffff9c3b90aadd80 0t0 123649 type=DGRAM 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 4w REG 8,1 45862 11598 /var/log/ntpstats/rawstats.20231104 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 6w REG 8,1 5658 655474 /var/log/ntpstats/peerstats.20231104 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 7w REG 8,1 748 494 /var/log/ntpstats/loopstats.20231104 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 16u IPv6 123657 0t0 UDP *:ntp 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 17u IPv4 123660 0t0 UDP *:ntp 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 18u IPv4 123664 0t0 UDP localhost:ntp 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 19u IPv4 123666 0t0 UDP smithi040.front.sepia.ceph.com:ntp 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 20u IPv6 123668 0t0 UDP localhost:ntp 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 21u IPv6 123670 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 22u netlink 0t0 123671 ROUTE 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 23u unix 0xffff9c3b90aaf700 0t0 123672 type=STREAM 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 24u unix 0xffff9c3b90aaa640 0t0 123673 type=STREAM 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 25u IPv4 165554 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 26u IPv6 165558 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 ntp 28u IPv6 165672 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp txt REG 8,1 879688 5353 /usr/sbin/ntpd 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 140800 30041 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 1r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 2r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 3u unix 0xffff9c3b90aadd80 0t0 123649 type=DGRAM 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 4w REG 8,1 45862 11598 /var/log/ntpstats/rawstats.20231104 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 6w REG 8,1 5658 655474 /var/log/ntpstats/peerstats.20231104 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 7w REG 8,1 748 494 /var/log/ntpstats/loopstats.20231104 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 16u IPv6 123657 0t0 UDP *:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 17u IPv4 123660 0t0 UDP *:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 18u IPv4 123664 0t0 UDP localhost:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 19u IPv4 123666 0t0 UDP smithi040.front.sepia.ceph.com:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 20u IPv6 123668 0t0 UDP localhost:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 21u IPv6 123670 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 22u netlink 0t0 123671 ROUTE 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 23u unix 0xffff9c3b90aaf700 0t0 123672 type=STREAM 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 24u unix 0xffff9c3b90aaa640 0t0 123673 type=STREAM 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 25u IPv4 165554 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 26u IPv6 165558 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd 27945 27946 ntpd ntp 28u IPv6 165672 0t0 UDP smithi040:ntp 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph 1u unix 0xffff9c3b8ab42640 0t0 130553 type=STREAM 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-cras 30590 ceph 2u unix 0xffff9c3b8ab42640 0t0 130553 type=STREAM 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root txt REG 8,1 3397048 674127 /usr/sbin/wpa_supplicant 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 43064 16927 /usr/lib/x86_64-linux-gnu/libpcsclite.so.1.0.0 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 32256 26981 /usr/lib/x86_64-linux-gnu/libnl-genl-3.so.200.26.0 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root 1u unix 0xffff9c3b94444840 0t0 133789 type=STREAM 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root 2u unix 0xffff9c3b94444840 0t0 133789 type=STREAM 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root 3u unix 0xffff9c3b94445d80 0t0 133792 type=DGRAM 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:wpa_suppl 32178 root 4u unix 0xffff9c3b944450c0 0t0 133793 type=STREAM 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root txt REG 8,1 3255560 673979 /usr/sbin/NetworkManager 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 43160 789186 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 39168 789180 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 298240 789183 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 27144 673952 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 47400 789182 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 1144904 673905 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 100584 789187 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 194000 673799 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 35120 789184 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 96544 789181 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 27280 673911 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 1u unix 0xffff9c3b8a175940 0t0 132671 type=STREAM 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 2u unix 0xffff9c3b8a175940 0t0 132671 type=STREAM 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 5u unix 0xffff9c3b8a176a40 0t0 132676 type=DGRAM 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 6u unix 0xffff9c3b8a176600 0t0 132677 type=STREAM 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 8r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 9r REG 0,4 0 4026532625 mnt 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 10u netlink 0t0 132681 KOBJECT_UEVENT 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 11u netlink 0t0 132682 GENERIC 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 12u netlink 0t0 132683 ROUTE 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 14r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 15u netlink 0t0 132720 KOBJECT_UEVENT 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 16u netlink 0t0 132721 KOBJECT_UEVENT 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 17u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 root 19w FIFO 0,25 0t0 3231 /run/systemd/inhibit/8.ref 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root txt REG 8,1 3255560 673979 /usr/sbin/NetworkManager 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 43160 789186 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 39168 789180 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 298240 789183 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 27144 673952 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 47400 789182 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 1144904 673905 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 100584 789187 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 194000 673799 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 35120 789184 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 96544 789181 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 27280 673911 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 1u unix 0xffff9c3b8a175940 0t0 132671 type=STREAM 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 2u unix 0xffff9c3b8a175940 0t0 132671 type=STREAM 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 5u unix 0xffff9c3b8a176a40 0t0 132676 type=DGRAM 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 6u unix 0xffff9c3b8a176600 0t0 132677 type=STREAM 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 8r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 9r REG 0,4 0 4026532625 mnt 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 10u netlink 0t0 132681 KOBJECT_UEVENT 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 11u netlink 0t0 132682 GENERIC 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 12u netlink 0t0 132683 ROUTE 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 14r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 15u netlink 0t0 132720 KOBJECT_UEVENT 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 16u netlink 0t0 132721 KOBJECT_UEVENT 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 17u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32363 gmain root 19w FIFO 0,25 0t0 3231 /run/systemd/inhibit/8.ref 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root txt REG 8,1 3255560 673979 /usr/sbin/NetworkManager 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 43160 789186 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 39168 789180 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 298240 789183 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 27144 673952 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 47400 789182 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 1144904 673905 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 100584 789187 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 194000 673799 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 35120 789184 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 96544 789181 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 27280 673911 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 1u unix 0xffff9c3b8a175940 0t0 132671 type=STREAM 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 2u unix 0xffff9c3b8a175940 0t0 132671 type=STREAM 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 5u unix 0xffff9c3b8a176a40 0t0 132676 type=DGRAM 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 6u unix 0xffff9c3b8a176600 0t0 132677 type=STREAM 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 9r REG 0,4 0 4026532625 mnt 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 10u netlink 0t0 132681 KOBJECT_UEVENT 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 11u netlink 0t0 132682 GENERIC 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 12u netlink 0t0 132683 ROUTE 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 14r a_inode 0,14 0 12540 inotify 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 15u netlink 0t0 132720 KOBJECT_UEVENT 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 16u netlink 0t0 132721 KOBJECT_UEVENT 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 17u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:NetworkMa 32362 32364 gdbus root 19w FIFO 0,25 0t0 3231 /run/systemd/inhibit/8.ref 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres DEL REG 0,1 7175 /dev/zero 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.634431242 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres DEL REG 0,1 4 /SYSV000c132e 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 4w FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 5u IPv6 137785 0t0 TCP localhost:postgresql (LISTEN) 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 6u IPv4 137786 0t0 TCP localhost:postgresql (LISTEN) 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 7u unix 0xffff9c3b9097aa80 0t0 137787 /var/run/postgresql/.s.PGSQL.5432 type=STREAM 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32892 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres DEL REG 0,1 7175 /dev/zero 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.634431242 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres DEL REG 0,1 4 /SYSV000c132e 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 4u REG 8,1 16777216 791372 /var/lib/postgresql/14/main/pg_wal/000000010000000000000001 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32894 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres DEL REG 0,1 7175 /dev/zero 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.634431242 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres DEL REG 0,1 4 /SYSV000c132e 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32895 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres DEL REG 0,1 7175 /dev/zero 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.634431242 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres DEL REG 0,1 4 /SYSV000c132e 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 4u REG 8,1 16777216 791372 /var/lib/postgresql/14/main/pg_wal/000000010000000000000001 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32896 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres DEL REG 0,1 7175 /dev/zero 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.634431242 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres DEL REG 0,1 4 /SYSV000c132e 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 4u REG 8,1 8192 791420 /var/lib/postgresql/14/main/global/1262 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32897 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32898 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres cwd DIR 8,1 4096 791342 /var/lib/postgresql/14/main 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres txt REG 8,1 9509856 789736 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres DEL REG 0,1 7175 /dev/zero 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.634431242 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres DEL REG 0,1 4 /SYSV000c132e 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 1w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 2w REG 8,1 651 791370 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 3r FIFO 0,13 0t0 137779 pipe 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 4u REG 8,1 0 791451 /var/lib/postgresql/14/main/global/6100 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 8u IPv6 137791 0t0 UDP localhost:52349->localhost:52349 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi040.stdout:postgres 32899 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 32911 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 32911 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 32911 root txt unknown /proc/32911/exe 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root txt REG 8,1 2194240 673961 /usr/sbin/ModemManager 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14384 789066 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 63776 789095 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14352 789075 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 100632 789099 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18608 789079 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14440 789083 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 47384 789087 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14392 789073 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22736 789065 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 30912 789101 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22872 789084 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14512 789081 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 47392 789064 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22816 789068 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18760 789093 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 43336 789091 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18720 789089 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 30992 789082 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14504 789096 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14464 789086 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 26944 789102 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14416 789094 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14424 789090 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 31008 789103 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14392 789072 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14360 789092 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22784 789100 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18616 789077 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 137544 789067 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14384 789098 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 129376 789076 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22704 789097 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 26944 789078 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14384 789069 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 39352 789085 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 63808 789070 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14416 789074 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 43280 789071 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22800 789080 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 14400 789088 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 43176 789107 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 80120 789106 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 88312 789110 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 30968 789108 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 63736 789109 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22696 789105 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 63736 789111 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18680 789104 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 632904 673561 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 3528776 673929 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 1144904 673905 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 1u unix 0xffff9c3b9097aec0 0t0 137822 type=STREAM 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 5u unix 0xffff9c3b9097cc80 0t0 137827 type=DGRAM 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 6u unix 0xffff9c3b8a1761c0 0t0 132924 type=STREAM 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 8u netlink 0t0 137828 KOBJECT_UEVENT 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 root 9w FIFO 0,25 0t0 3532 /run/systemd/inhibit/9.ref 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root txt REG 8,1 2194240 673961 /usr/sbin/ModemManager 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14384 789066 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 63776 789095 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14352 789075 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 100632 789099 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18608 789079 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14440 789083 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 47384 789087 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14392 789073 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22736 789065 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 30912 789101 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22872 789084 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14512 789081 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 47392 789064 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22816 789068 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18760 789093 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 43336 789091 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18720 789089 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 30992 789082 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14504 789096 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14464 789086 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 26944 789102 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14416 789094 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14424 789090 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 31008 789103 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14392 789072 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14360 789092 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22784 789100 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18616 789077 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 137544 789067 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14384 789098 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 129376 789076 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22704 789097 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 26944 789078 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14384 789069 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 39352 789085 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 63808 789070 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14416 789074 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 43280 789071 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22800 789080 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 14400 789088 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 43176 789107 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 80120 789106 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 88312 789110 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 30968 789108 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 63736 789109 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22696 789105 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 63736 789111 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18680 789104 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 632904 673561 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 3528776 673929 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 1144904 673905 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 1u unix 0xffff9c3b9097aec0 0t0 137822 type=STREAM 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 5u unix 0xffff9c3b9097cc80 0t0 137827 type=DGRAM 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 6u unix 0xffff9c3b8a1761c0 0t0 132924 type=STREAM 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 8u netlink 0t0 137828 KOBJECT_UEVENT 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32974 gmain root 9w FIFO 0,25 0t0 3532 /run/systemd/inhibit/9.ref 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root txt REG 8,1 2194240 673961 /usr/sbin/ModemManager 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14384 789066 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 63776 789095 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14352 789075 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 100632 789099 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18608 789079 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14440 789083 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 47384 789087 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14392 789073 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22736 789065 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 30912 789101 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22872 789084 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14512 789081 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 47392 789064 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22816 789068 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18760 789093 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 43336 789091 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18720 789089 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 30992 789082 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14504 789096 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14464 789086 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 26944 789102 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14416 789094 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14424 789090 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 31008 789103 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14392 789072 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14360 789092 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22784 789100 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18616 789077 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 137544 789067 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14384 789098 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 129376 789076 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22704 789097 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 26944 789078 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14384 789069 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 39352 789085 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 63808 789070 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14416 789074 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 43280 789071 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22800 789080 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 14400 789088 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 43176 789107 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 80120 789106 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 88312 789110 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 30968 789108 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 63736 789109 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22696 789105 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 63736 789111 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18680 789104 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 632904 673561 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 3528776 673929 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 1144904 673905 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 1u unix 0xffff9c3b9097aec0 0t0 137822 type=STREAM 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 5u unix 0xffff9c3b9097cc80 0t0 137827 type=DGRAM 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 6u unix 0xffff9c3b8a1761c0 0t0 132924 type=STREAM 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 8u netlink 0t0 137828 KOBJECT_UEVENT 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:ModemMana 32973 32977 gdbus root 9w FIFO 0,25 0t0 3532 /run/systemd/inhibit/9.ref 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33234 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33234 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33234 root txt unknown /proc/33234/exe 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33235 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33235 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33235 root txt unknown /proc/33235/exe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33236 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33236 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33236 root txt unknown /proc/33236/exe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33237 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33237 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33237 root txt unknown /proc/33237/exe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33238 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33238 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33238 root txt unknown /proc/33238/exe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33239 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33239 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33239 root txt unknown /proc/33239/exe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33240 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33240 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33240 root txt unknown /proc/33240/exe 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33241 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33241 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33241 root txt unknown /proc/33241/exe 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33252 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33252 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33252 root txt unknown /proc/33252/exe 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33253 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33253 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33253 root txt unknown /proc/33253/exe 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33254 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33254 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33254 root txt unknown /proc/33254/exe 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33255 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33255 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33255 root txt unknown /proc/33255/exe 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33256 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33256 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33256 root txt unknown /proc/33256/exe 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33257 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33257 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33257 root txt unknown /proc/33257/exe 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33258 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33258 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33258 root txt unknown /proc/33258/exe 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33259 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33259 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33259 root txt unknown /proc/33259/exe 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33270 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33270 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33270 root txt unknown /proc/33270/exe 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33271 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33271 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33271 root txt unknown /proc/33271/exe 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33272 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33272 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33272 root txt unknown /proc/33272/exe 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33273 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33273 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33273 root txt unknown /proc/33273/exe 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33274 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33274 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33274 root txt unknown /proc/33274/exe 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33275 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33275 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33275 root txt unknown /proc/33275/exe 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33276 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33276 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33276 root txt unknown /proc/33276/exe 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33277 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33277 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33277 root txt unknown /proc/33277/exe 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33288 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33288 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-buf/d 33288 root txt unknown /proc/33288/exe 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33289 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33289 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-conv/ 33289 root txt unknown /proc/33289/exe 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33290 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33290 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-recla 33290 root txt unknown /proc/33290/exe 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33291 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33291 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-block 33291 root txt unknown /proc/33291/exe 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33292 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33292 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-inode 33292 root txt unknown /proc/33292/exe 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33293 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33293 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-log/d 33293 root txt unknown /proc/33293/exe 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33294 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33294 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfs-cil/d 33294 root txt unknown /proc/33294/exe 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33295 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33295 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:xfsaild/d 33295 root txt unknown /proc/33295/exe 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-0 33310 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-0 33310 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-0 33310 root txt unknown /proc/33310/exe 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-1 34451 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-1 34451 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-1 34451 root txt unknown /proc/34451/exe 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-2 35592 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-2 35592 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-2 35592 root txt unknown /proc/35592/exe 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-3 36733 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-3 36733 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:dio/dm-3 36733 root txt unknown /proc/36733/exe 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 0r FIFO 0,13 0t0 141542 pipe 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 3r FIFO 0,13 0t0 144560 pipe 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 4w FIFO 0,13 0t0 144560 pipe 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 6u netlink 0t0 144569 AUDIT 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38004 root 7u unix 0xffff9c3b90979980 0t0 144570 type=DGRAM 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root 0r FIFO 0,13 0t0 141542 pipe 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38005 root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 0r FIFO 0,13 0t0 141545 pipe 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 3r FIFO 0,13 0t0 145625 pipe 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 4w FIFO 0,13 0t0 145625 pipe 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 6u netlink 0t0 145634 AUDIT 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38007 root 7u unix 0xffff9c3b8a171dc0 0t0 145635 type=DGRAM 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38013 log root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38014 service root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38015 admin_soc root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38016 signal_ha root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38017 rocksdb:l root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38018 rocksdb:h root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38034 ceph-mon root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38035 fn_monsto root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38037 msgr-work root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38038 msgr-work root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38039 msgr-work root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38040 OpHistory root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38041 fin root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38042 safe_time root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38043 cpu_tp root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38044 cpu_tp root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38045 cpu_tp root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38046 cpu_tp root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38047 ms_dispat root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38048 ms_local root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38049 safe_time root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38050 ms_dispat root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 38051 ms_local root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 1w FIFO 0,13 0t0 141543 pipe 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 2w FIFO 0,13 0t0 141544 pipe 2023-11-04T01:48:28.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 3r FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 4w FIFO 0,13 0t0 141556 pipe 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 5w REG 8,1 56972589 674497 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 6uW REG 0,25 6 3571 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 7r FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 8w FIFO 0,13 0t0 141557 pipe 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 9u unix 0xffff9c3b9352dd80 0t0 141558 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 10r FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 11w FIFO 0,13 0t0 141559 pipe 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 16u IPv4 204717 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:52608 (ESTABLISHED) 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 17w REG 253,4 72802 33595531 /var/lib/ceph/mon/ceph-a/store.db/000019.log 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 18w REG 253,4 898 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 20r FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 21w FIFO 0,13 0t0 141566 pipe 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 23r FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 24w FIFO 0,13 0t0 141567 pipe 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 26r FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 27w FIFO 0,13 0t0 141568 pipe 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 28u IPv4 144576 0t0 TCP smithi040.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 29u IPv4 144577 0t0 TCP smithi040.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 30w REG 8,1 180182 674500 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 31u IPv4 145778 0t0 TCP smithi040.front.sepia.ceph.com:34554->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 32r FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 33w FIFO 0,13 0t0 141569 pipe 2023-11-04T01:48:28.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 34r FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 35w FIFO 0,13 0t0 141570 pipe 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 36r FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 37w FIFO 0,13 0t0 141571 pipe 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 38u IPv4 144585 0t0 TCP smithi040.front.sepia.ceph.com:57306->smithi091.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 39u IPv4 141574 0t0 TCP smithi040.front.sepia.ceph.com:44112->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 40w REG 8,1 103852 674498 /var/log/ceph/ceph.log 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 41u IPv4 142857 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33404 (ESTABLISHED) 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 42u IPv4 142870 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33420 (ESTABLISHED) 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 43u IPv4 144680 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33422 (ESTABLISHED) 2023-11-04T01:48:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 44u IPv4 144684 0t0 TCP smithi040.front.sepia.ceph.com:3300->smithi040.front.sepia.ceph.com:33424 (ESTABLISHED) 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 45r REG 253,4 4552242 33595540 /var/lib/ceph/mon/ceph-a/store.db/000021.sst 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mon 38008 58189 rstore_co root 47u IPv4 213357 0t0 TCP smithi040.front.sepia.ceph.com:3300->192.168.0.1:42490 (ESTABLISHED) 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root 0r FIFO 0,13 0t0 141545 pipe 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38010 root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 14w REG 8,1 670344 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38052 log root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38054 msgr-work root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38055 msgr-work root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38056 msgr-work root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38090 service root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38091 admin_soc root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38092 ceph_time root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38093 fn_anonym root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38094 signal_ha root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38095 mgrsb-fin root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38096 ms_dispat root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38097 ms_local root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38098 io_contex root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38099 io_contex root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38100 safe_time root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38101 safe_time root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38102 safe_time root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38103 fn_anonym root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38104 flusher root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38105 safe_time root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38204 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 14w REG 8,1 669676 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38205 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 14w REG 8,1 670344 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38206 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 14w REG 8,1 670344 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38207 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 14w REG 8,1 670344 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38208 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 14w REG 8,1 670344 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38209 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 104672 673527 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 49936 670022 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 14848 664260 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 43336 666191 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 1w FIFO 0,13 0t0 141546 pipe 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 2w FIFO 0,13 0t0 141547 pipe 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 3r FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 4w FIFO 0,13 0t0 138853 pipe 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 6r FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 7w FIFO 0,13 0t0 138854 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 9r FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 10w FIFO 0,13 0t0 138855 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 12r FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 13w FIFO 0,13 0t0 138856 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 14w REG 8,1 670344 674499 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 15uW REG 0,25 6 3574 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 16r FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 17w FIFO 0,13 0t0 138923 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 18u unix 0xffff9c3b8ab472c0 0t0 138924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 19r FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 20w FIFO 0,13 0t0 138928 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 21r FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 22w FIFO 0,13 0t0 138929 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 23u IPv4 145790 0t0 TCP smithi040.front.sepia.ceph.com:34576->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mgr 38036 38210 ceph-mgr root 24u IPv4 141585 0t0 TCP smithi040.front.sepia.ceph.com:44160->smithi091.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 0r FIFO 0,13 0t0 145657 pipe 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 3r FIFO 0,13 0t0 138941 pipe 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 4w FIFO 0,13 0t0 138941 pipe 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 6u netlink 0t0 138950 AUDIT 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38106 root 7u unix 0xffff9c3b8ab46e80 0t0 138951 type=DGRAM 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 0r FIFO 0,13 0t0 145660 pipe 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 3r FIFO 0,13 0t0 144601 pipe 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 4w FIFO 0,13 0t0 144601 pipe 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 6u netlink 0t0 144610 AUDIT 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38107 root 7u unix 0xffff9c3b9097ee80 0t0 144611 type=DGRAM 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 0r FIFO 0,13 0t0 145663 pipe 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 3r FIFO 0,13 0t0 143471 pipe 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 4w FIFO 0,13 0t0 143471 pipe 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 6u netlink 0t0 143480 AUDIT 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38108 root 7u unix 0xffff9c3b93729980 0t0 143481 type=DGRAM 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 0r FIFO 0,13 0t0 145666 pipe 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 3r FIFO 0,13 0t0 138961 pipe 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 4w FIFO 0,13 0t0 138961 pipe 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 6u netlink 0t0 138970 AUDIT 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 38109 root 7u unix 0xffff9c3b8ab47b40 0t0 138971 type=DGRAM 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root 0r FIFO 0,13 0t0 145657 pipe 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38110 root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root 0r FIFO 0,13 0t0 145660 pipe 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38112 root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root 0r FIFO 0,13 0t0 145663 pipe 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38114 root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root 0r FIFO 0,13 0t0 145666 pipe 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 38116 root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 14w REG 8,1 55912351 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38126 log root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 14w REG 8,1 55912351 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38130 msgr-work root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 14w REG 8,1 55912351 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38131 msgr-work root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 14w REG 8,1 55912351 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38132 msgr-work root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 14w REG 8,1 55912351 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38143 service root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38145 admin_soc root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38214 signal_ha root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38215 io_contex root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38216 io_contex root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38232 OpHistory root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38233 ceph_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38271 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38283 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38298 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38311 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38323 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38335 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38347 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38562 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38563 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38564 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38565 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38566 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38567 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38568 fn_anonym root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38644 rocksdb:l root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38646 rocksdb:l root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38650 rocksdb:l root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 38652 rocksdb:h root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40240 bstore_ai root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40241 bstore_di root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40834 bstore_ai root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 40835 bstore_di root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41421 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41426 cfin root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41427 bstore_kv root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41428 bstore_kv root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41429 bstore_me root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41469 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41470 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41471 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41472 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41473 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41474 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41475 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41476 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41477 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41478 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41479 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41480 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41481 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41482 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41483 ms_dispat root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41484 ms_local root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41485 fn_anonym root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41486 finisher root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41487 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41488 safe_time root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41489 ceph-osd root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41490 osd_srv_a root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41491 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41492 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41493 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41494 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41495 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41496 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41497 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41498 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41499 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41500 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41501 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41502 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41503 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41504 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41505 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41506 tp_osd_tp root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root DEL REG 0,19 143684 /[aio] 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root DEL REG 0,19 143681 /[aio] 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 1w FIFO 0,13 0t0 145661 pipe 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 2w FIFO 0,13 0t0 145662 pipe 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 3r FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 4w FIFO 0,13 0t0 144644 pipe 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 6r FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 7w FIFO 0,13 0t0 144645 pipe 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 9r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 10w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 12r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 13w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 14w REG 8,1 55912564 674494 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 15uW REG 0,25 6 3576 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 16r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 17w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 18u unix 0xffff9c3b90978cc0 0t0 144651 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 19u IPv4 140890 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 20u IPv4 140895 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 21u IPv4 140902 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 22u IPv4 143509 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 23u IPv4 140283 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 24u IPv4 146440 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 25u IPv4 146455 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 26u IPv4 139053 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 27r FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 28w FIFO 0,13 0t0 144664 pipe 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 29r FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 30w FIFO 0,13 0t0 144665 pipe 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 31u sock 0,8 0t0 140972 protocol: UDPv6 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 59u IPv4 144683 0t0 TCP smithi040.front.sepia.ceph.com:33424->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 60r FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 61w FIFO 0,13 0t0 146611 pipe 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 62r FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 63w FIFO 0,13 0t0 146612 pipe 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 64u IPv4 146616 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33896 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 65u IPv4 146619 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41506 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 66u IPv4 139101 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36704 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 67u IPv4 139104 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54556 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 68u IPv4 143703 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36710 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 69u IPv4 145810 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54558 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 70u IPv4 146628 0t0 TCP smithi040.front.sepia.ceph.com:40038->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 71u IPv4 145813 0t0 TCP smithi040.front.sepia.ceph.com:39478->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 72u IPv4 146629 0t0 TCP smithi040.front.sepia.ceph.com:57720->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 73u IPv4 145814 0t0 TCP smithi040.front.sepia.ceph.com:43688->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 74u IPv4 146630 0t0 TCP smithi040.front.sepia.ceph.com:41574->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 75u IPv4 146631 0t0 TCP smithi040.front.sepia.ceph.com:38078->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 76u IPv4 139107 0t0 TCP smithi040.front.sepia.ceph.com:47724->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 77u IPv4 146632 0t0 TCP smithi040.front.sepia.ceph.com:52176->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 78u IPv4 139108 0t0 TCP smithi040.front.sepia.ceph.com:48946->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 79u IPv4 145815 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 80u IPv4 139109 0t0 TCP smithi040.front.sepia.ceph.com:52428->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 81u IPv4 145816 0t0 TCP smithi040.front.sepia.ceph.com:48382->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 82u IPv4 139110 0t0 TCP smithi040.front.sepia.ceph.com:34654->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 83u IPv4 139111 0t0 TCP smithi040.front.sepia.ceph.com:41902->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 84u IPv4 141647 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33912 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 85u IPv4 141648 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54564 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 86u IPv4 141649 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi040.front.sepia.ceph.com:33924 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 87u IPv4 141652 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41512 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 88u IPv4 141653 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36718 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 89u IPv4 141654 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi040.front.sepia.ceph.com:41520 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 90u IPv4 141657 0t0 TCP smithi040.front.sepia.ceph.com:6810->smithi091.front.sepia.ceph.com:36734 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 91u IPv4 141660 0t0 TCP smithi040.front.sepia.ceph.com:6814->smithi091.front.sepia.ceph.com:54574 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 92u IPv4 144716 0t0 TCP smithi040.front.sepia.ceph.com:52854->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 93u IPv4 145822 0t0 TCP smithi040.front.sepia.ceph.com:52832->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 94u IPv4 141006 0t0 TCP smithi040.front.sepia.ceph.com:34742->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 95u IPv4 142916 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi040.front.sepia.ceph.com:42382 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 96u IPv4 141009 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi091.front.sepia.ceph.com:45998 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 97u IPv4 142919 0t0 TCP smithi040.front.sepia.ceph.com:36226->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 98u IPv4 141668 0t0 TCP smithi040.front.sepia.ceph.com:45640->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 99u IPv4 213092 0t0 TCP smithi040.front.sepia.ceph.com:6802->smithi040.front.sepia.ceph.com:46164 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 100u IPv4 139125 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59174 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38122 41507 osd_srv_h root 101u IPv4 139126 0t0 TCP smithi040.front.sepia.ceph.com:6806->smithi091.front.sepia.ceph.com:59190 (ESTABLISHED) 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38128 log root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38134 msgr-work root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38136 msgr-work root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38137 msgr-work root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38142 service root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38144 admin_soc root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38222 signal_ha root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38223 io_contex root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38224 io_contex root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38240 OpHistory root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38242 ceph_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38274 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38286 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38295 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38308 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38320 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38332 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38344 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38356 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38357 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38358 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38359 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38360 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38361 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38362 fn_anonym root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38367 rocksdb:l root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38368 rocksdb:l root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38369 rocksdb:l root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 38370 rocksdb:h root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39868 bstore_ai root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 39869 bstore_di root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40604 bstore_ai root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40605 bstore_di root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40786 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40787 cfin root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40788 bstore_kv root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40789 bstore_kv root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40790 bstore_me root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40791 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40792 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40793 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40794 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40795 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40796 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40797 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40798 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40799 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40800 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40801 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40802 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40803 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40804 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40805 ms_dispat root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40806 ms_local root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40807 fn_anonym root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40808 finisher root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40809 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40810 safe_time root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40811 ceph-osd root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40812 osd_srv_a root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40813 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40814 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40815 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40816 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40817 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40818 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:30.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:30.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:30.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40819 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:30.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:30.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:30.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40820 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40821 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40822 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40823 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.067 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:31.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40824 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40825 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40826 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40827 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40828 tp_osd_tp root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root DEL REG 0,19 146603 /[aio] 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root DEL REG 0,19 146599 /[aio] 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 1w FIFO 0,13 0t0 145664 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 2w FIFO 0,13 0t0 145665 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 3r FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 4w FIFO 0,13 0t0 143499 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 6r FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 7w FIFO 0,13 0t0 143500 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 9r FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 10w FIFO 0,13 0t0 143501 pipe 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 12r FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 13w FIFO 0,13 0t0 143502 pipe 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 14w REG 8,1 49044445 674495 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 15uW REG 0,25 6 3577 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 16r FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 17w FIFO 0,13 0t0 143503 pipe 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 18u unix 0xffff9c3b9372aa80 0t0 143504 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 19u IPv4 143524 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 20u IPv4 143544 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 21u IPv4 143557 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 22u IPv4 143581 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 23u IPv4 139080 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 24u IPv4 145763 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 25u IPv4 143629 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 26u IPv4 143661 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 27r FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 28w FIFO 0,13 0t0 142777 pipe 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 29r FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 30w FIFO 0,13 0t0 142778 pipe 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 31u sock 0,8 0t0 142841 protocol: UDPv6 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 59r FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 60u IPv4 140984 0t0 TCP smithi040.front.sepia.ceph.com:33404->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 61w FIFO 0,13 0t0 144692 pipe 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 62r FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 63w FIFO 0,13 0t0 144693 pipe 2023-11-04T01:48:31.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 64u IPv4 142881 0t0 TCP smithi040.front.sepia.ceph.com:33896->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 65u IPv4 143692 0t0 TCP smithi040.front.sepia.ceph.com:41506->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 66u IPv4 145806 0t0 TCP smithi040.front.sepia.ceph.com:43682->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 67u IPv4 142882 0t0 TCP smithi040.front.sepia.ceph.com:52412->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 68u IPv4 143693 0t0 TCP smithi040.front.sepia.ceph.com:41894->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 69u IPv4 143694 0t0 TCP smithi040.front.sepia.ceph.com:41560->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 70u IPv4 142883 0t0 TCP smithi040.front.sepia.ceph.com:48380->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 71u IPv4 145807 0t0 TCP smithi040.front.sepia.ceph.com:39462->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 72u IPv4 145808 0t0 TCP smithi040.front.sepia.ceph.com:34652->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 73u IPv4 142884 0t0 TCP smithi040.front.sepia.ceph.com:38064->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 74u IPv4 145809 0t0 TCP smithi040.front.sepia.ceph.com:40036->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 75u IPv4 143695 0t0 TCP smithi040.front.sepia.ceph.com:41408->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 76u IPv4 143696 0t0 TCP smithi040.front.sepia.ceph.com:47722->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 77u IPv4 142885 0t0 TCP smithi040.front.sepia.ceph.com:52170->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 78u IPv4 143697 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42098 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 79u IPv4 143700 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38740 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 80u IPv4 143706 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42102 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 81u IPv4 143727 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38752 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 82u IPv4 143728 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48946 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 83u IPv4 143729 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48958 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 84u IPv4 143730 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38764 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 85u IPv4 143731 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi040.front.sepia.ceph.com:48964 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 86u IPv4 143732 0t0 TCP smithi040.front.sepia.ceph.com:6826->smithi091.front.sepia.ceph.com:38772 (ESTABLISHED) 2023-11-04T01:48:31.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 87u IPv4 143735 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57720 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 88u IPv4 143736 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57730 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 89u IPv4 143737 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi040.front.sepia.ceph.com:57744 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 90u IPv4 143738 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42116 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 91u IPv4 143739 0t0 TCP smithi040.front.sepia.ceph.com:6830->smithi091.front.sepia.ceph.com:42120 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 92u IPv4 141002 0t0 TCP smithi040.front.sepia.ceph.com:52842->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 93u IPv4 143745 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52824 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 94u IPv4 145823 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52832 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 95u IPv4 141669 0t0 TCP smithi040.front.sepia.ceph.com:34716->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 96u IPv4 145824 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi040.front.sepia.ceph.com:52834 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 97u IPv4 145825 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58176 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 98u IPv4 145826 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58192 (ESTABLISHED) 2023-11-04T01:48:31.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 99u IPv4 145827 0t0 TCP smithi040.front.sepia.ceph.com:6821->smithi091.front.sepia.ceph.com:58200 (ESTABLISHED) 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 100u IPv4 142922 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi091.front.sepia.ceph.com:59264 (ESTABLISHED) 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38123 40829 osd_srv_h root 101u IPv4 211269 0t0 TCP smithi040.front.sepia.ceph.com:6816->smithi040.front.sepia.ceph.com:33618 (ESTABLISHED) 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38155 log root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38161 msgr-work root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38162 msgr-work root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38164 msgr-work root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38170 service root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38171 admin_soc root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38219 signal_ha root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38220 io_contex root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38221 io_contex root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38239 OpHistory root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38241 ceph_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38278 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38289 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38301 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38314 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38327 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38338 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38350 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38551 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38552 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38553 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38554 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38555 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38556 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38557 fn_anonym root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38573 rocksdb:l root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38574 rocksdb:l root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38575 rocksdb:l root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 38576 rocksdb:h root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40052 bstore_ai root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40053 bstore_di root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40830 bstore_ai root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 40831 bstore_di root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41376 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41377 cfin root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41378 bstore_kv root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41379 bstore_kv root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41380 bstore_me root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41381 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41382 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41383 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41384 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41385 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41386 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41387 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41388 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41389 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41390 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41391 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41392 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41393 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:31.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41394 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:31.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:31.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:31.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:31.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:31.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:31.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:31.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:31.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:31.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41395 ms_dispat root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41396 ms_local root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41397 fn_anonym root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41398 finisher root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41399 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41400 safe_time root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41401 ceph-osd root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41402 osd_srv_a root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41403 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41404 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41405 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41406 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41407 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41408 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41409 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41410 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41411 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41412 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41413 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41414 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41415 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41416 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.354 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.356 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.357 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.359 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.360 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.363 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41417 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41418 tp_osd_tp root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root DEL REG 0,19 141638 /[aio] 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root DEL REG 0,19 141635 /[aio] 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 1w FIFO 0,13 0t0 145667 pipe 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 2w FIFO 0,13 0t0 145668 pipe 2023-11-04T01:48:32.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 3r FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 4w FIFO 0,13 0t0 142765 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 6r FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 7w FIFO 0,13 0t0 142766 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 9r FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 10w FIFO 0,13 0t0 142767 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 12r FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 13w FIFO 0,13 0t0 142768 pipe 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 14w REG 8,1 58256722 674496 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:32.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 15uW REG 0,25 6 3580 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 16r FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 17w FIFO 0,13 0t0 140268 pipe 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 18u unix 0xffff9c3b90dfc400 0t0 140269 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 19u IPv4 145704 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 20u IPv4 145723 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 21u IPv4 145737 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 22u IPv4 145760 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 23u IPv4 146493 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 24u IPv4 146519 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 25u IPv4 146547 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 26u IPv4 146577 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 27r FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 28w FIFO 0,13 0t0 140934 pipe 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 29r FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 30w FIFO 0,13 0t0 140935 pipe 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 31u sock 0,8 0t0 146586 protocol: UDPv6 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 59u IPv4 144678 0t0 TCP smithi040.front.sepia.ceph.com:33420->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 60r FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 61w FIFO 0,13 0t0 139093 pipe 2023-11-04T01:48:32.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 62r FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 63w FIFO 0,13 0t0 139094 pipe 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 64u IPv4 144701 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52412 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 65u IPv4 144704 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43682 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 66u IPv4 140989 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35744 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 67u IPv4 140992 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50040 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 68u IPv4 142895 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50050 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 69u IPv4 142898 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35758 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 70u IPv4 141644 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43688 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 71u IPv4 139112 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52428 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 72u IPv4 140995 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi040.front.sepia.ceph.com:52444 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 73u IPv4 140998 0t0 TCP smithi040.front.sepia.ceph.com:39484->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 74u IPv4 140999 0t0 TCP smithi040.front.sepia.ceph.com:34674->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 75u IPv4 141000 0t0 TCP smithi040.front.sepia.ceph.com:41920->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 76u IPv4 141001 0t0 TCP smithi040.front.sepia.ceph.com:47736->smithi040.front.sepia.ceph.com:6807 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 77u IPv4 144711 0t0 TCP smithi040.front.sepia.ceph.com:57744->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 78u IPv4 144712 0t0 TCP smithi040.front.sepia.ceph.com:41602->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 79u IPv4 144713 0t0 TCP smithi040.front.sepia.ceph.com:41432->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 80u IPv4 144714 0t0 TCP smithi040.front.sepia.ceph.com:48402->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 81u IPv4 144715 0t0 TCP smithi040.front.sepia.ceph.com:33924->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 82u IPv4 143709 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi040.front.sepia.ceph.com:43704 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 83u IPv4 143710 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35762 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 84u IPv4 143713 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50060 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 85u IPv4 143716 0t0 TCP smithi040.front.sepia.ceph.com:48964->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 86u IPv4 143717 0t0 TCP smithi040.front.sepia.ceph.com:38098->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 87u IPv4 143718 0t0 TCP smithi040.front.sepia.ceph.com:52188->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 88u IPv4 143719 0t0 TCP smithi040.front.sepia.ceph.com:40040->smithi040.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 89u IPv4 143720 0t0 TCP smithi040.front.sepia.ceph.com:41520->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 90u IPv4 143721 0t0 TCP smithi040.front.sepia.ceph.com:6827->smithi091.front.sepia.ceph.com:50066 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 91u IPv4 143724 0t0 TCP smithi040.front.sepia.ceph.com:6824->smithi091.front.sepia.ceph.com:35766 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 92u IPv4 145818 0t0 TCP smithi040.front.sepia.ceph.com:52870->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 93u IPv4 141663 0t0 TCP smithi040.front.sepia.ceph.com:52834->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 94u IPv4 144724 0t0 TCP smithi040.front.sepia.ceph.com:34718->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 95u IPv4 145833 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36220 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 96u IPv4 144727 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi091.front.sepia.ceph.com:46488 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 97u IPv4 146660 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi040.front.sepia.ceph.com:36226 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 98u IPv4 145836 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60724 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 99u IPv4 145837 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60736 (ESTABLISHED) 2023-11-04T01:48:32.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 100u IPv4 145840 0t0 TCP smithi040.front.sepia.ceph.com:6820->smithi091.front.sepia.ceph.com:60752 (ESTABLISHED) 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38124 41419 osd_srv_h root 101u IPv4 211281 0t0 TCP smithi040.front.sepia.ceph.com:6817->smithi040.front.sepia.ceph.com:54258 (ESTABLISHED) 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38154 log root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38158 msgr-work root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.448 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38159 msgr-work root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38160 msgr-work root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38172 service root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38173 admin_soc root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38211 signal_ha root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 14w REG 8,1 57776647 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38212 io_contex root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38213 io_contex root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38231 OpHistory root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.567 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.568 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.569 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.570 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.572 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.574 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38234 ceph_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38277 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38292 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38305 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38317 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38326 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.656 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38341 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38353 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38620 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38632 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38634 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38637 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38639 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.762 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.764 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.766 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38641 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38643 fn_anonym root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38952 rocksdb:l root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38953 rocksdb:l root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38954 rocksdb:l root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 38955 rocksdb:h root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40193 bstore_ai root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40195 bstore_di root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40832 bstore_ai root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 40833 bstore_di root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.924 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.925 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.926 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41420 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.928 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.929 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.933 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.934 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.937 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.941 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.942 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41422 cfin root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.944 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.945 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.947 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.949 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.952 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.953 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.954 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41423 bstore_kv root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.958 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.959 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.960 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.961 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.962 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.963 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.964 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 14w REG 8,1 57781243 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.966 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.967 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.968 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.971 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41424 bstore_kv root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.972 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.975 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.976 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.977 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.978 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.979 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 14w REG 8,1 57781556 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.984 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:32.985 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41425 bstore_me root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:32.987 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:32.988 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:32.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:32.990 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:32.991 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:32.992 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:32.993 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.994 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 14w REG 8,1 57792532 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:32.995 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.997 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.998 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:32.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.000 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.001 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41430 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.002 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.003 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.004 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.006 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.007 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 14w REG 8,1 57797119 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.011 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.012 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.013 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.014 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.015 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41431 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.017 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.018 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.019 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.020 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.022 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.023 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.026 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.027 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.028 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.031 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41432 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.033 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.034 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.035 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.036 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.037 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.039 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.041 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.042 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.043 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.044 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.045 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41433 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.047 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.049 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.050 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.052 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.053 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.054 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.059 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.060 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41434 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.062 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.063 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.064 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.066 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.068 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.072 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.073 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.074 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.076 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41435 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.077 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.078 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.079 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.081 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.082 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.084 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.086 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.087 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.088 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.089 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.090 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.091 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41436 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.093 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.094 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.095 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.096 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.097 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.099 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.100 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.102 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.103 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.104 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41437 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.106 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.107 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.109 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.110 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.112 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.113 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.115 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.117 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.118 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.119 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.120 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41438 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.121 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.122 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.123 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.125 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.126 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.127 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.131 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.132 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.133 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.134 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.135 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41439 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.136 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.137 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.138 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.139 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.140 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.142 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.143 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.144 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.145 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.146 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.147 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.148 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.150 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.151 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41440 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.152 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.153 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.154 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.155 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.156 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.157 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.158 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.159 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.160 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.161 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.162 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.163 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.165 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.166 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41441 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.167 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.168 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.169 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.170 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.171 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.173 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.174 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 14w REG 8,1 57801703 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.175 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.177 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.178 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41442 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.182 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.183 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.184 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.185 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.186 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.187 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.188 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.189 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41443 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.199 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.204 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.207 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.209 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.210 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.211 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41444 ms_dispat root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.212 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.213 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.215 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.217 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.218 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.219 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.220 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.223 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.224 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.225 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41445 ms_local root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.228 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.229 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.230 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.231 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.232 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.233 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.234 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.235 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.237 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.238 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.239 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41446 fn_anonym root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.240 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.241 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.242 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.243 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.244 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.246 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.248 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.250 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.251 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.252 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41447 finisher root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.253 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.254 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.255 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.256 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.257 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.258 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.260 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.262 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.264 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.266 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41448 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.267 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.270 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.271 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.272 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.273 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.274 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.275 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.276 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.277 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.278 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41449 safe_time root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.283 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.284 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.286 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.288 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.290 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.291 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.293 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.294 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41450 ceph-osd root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.295 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.297 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.300 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.301 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.305 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.306 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41451 osd_srv_a root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.310 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.312 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.313 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.315 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.316 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.317 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.319 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41452 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.324 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.327 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.329 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.331 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.332 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.333 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.335 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.336 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41453 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.338 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.339 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.341 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.342 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.343 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.344 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.346 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.350 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41454 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.351 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.352 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.368 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.371 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.372 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.374 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.376 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.377 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.378 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.379 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41455 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.381 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.382 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.383 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.384 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.386 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.387 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.388 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.389 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.391 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41456 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.396 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.399 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.400 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.401 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.402 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.404 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.405 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.406 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41457 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.409 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.410 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.412 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.414 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.415 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.416 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.417 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.418 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.419 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.421 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41458 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.422 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.423 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.424 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.425 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.426 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.428 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.429 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.430 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.432 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.435 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41459 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.436 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.437 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.438 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.439 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.440 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.442 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.443 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.444 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.445 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.447 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.449 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41460 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.450 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.452 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.453 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.455 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.456 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.457 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.460 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.461 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.463 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41461 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.464 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.468 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.471 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.472 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.475 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.476 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.477 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41462 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.484 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.485 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.486 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41463 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.495 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.498 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.500 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.501 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.502 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.503 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.504 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.505 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.506 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41464 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.508 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.509 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.510 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.512 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.514 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.515 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.516 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.517 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.518 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.519 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.520 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.521 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41465 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.522 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.523 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.524 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.525 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.527 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.528 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.529 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.530 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.533 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41466 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.536 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.538 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.539 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.541 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.543 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.545 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.546 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41467 tp_osd_tp root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 113624 663900 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 1285744 663899 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 43800 663903 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 68688 663885 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 216168 663888 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 68400 663904 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 84992 663896 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 35648 663889 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:33.551 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 39688 663886 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 117792 663884 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 806216 663898 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 72688 663891 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 64384 663887 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 47920 663892 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 80872 663890 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 396768 663897 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 27352 663894 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 68520 663895 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 35560 663905 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 1372216 663876 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 335232 663872 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root DEL REG 0,19 146604 /[aio] 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root DEL REG 0,19 146601 /[aio] 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 64464 663882 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 31432 663831 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.553 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.555 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:48:33.556 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 1w FIFO 0,13 0t0 145658 pipe 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 2w FIFO 0,13 0t0 145659 pipe 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 3r FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 4w FIFO 0,13 0t0 145679 pipe 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 6r FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.557 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 7w FIFO 0,13 0t0 145680 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 9r FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 10w FIFO 0,13 0t0 145681 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 12r FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 13w FIFO 0,13 0t0 145682 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 14w REG 8,1 57806347 674493 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 15uW REG 0,25 6 3582 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 16r FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 17w FIFO 0,13 0t0 140882 pipe 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 18u unix 0xffff9c3b94440440 0t0 140883 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 19u IPv4 140886 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:33.558 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 20u IPv4 140888 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 21u IPv4 141612 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 22u IPv4 141618 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 23u IPv4 141626 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 24u IPv4 140279 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 25u IPv4 139029 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 26u IPv4 139043 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 27r FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 28w FIFO 0,13 0t0 141628 pipe 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 29r FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 30w FIFO 0,13 0t0 141629 pipe 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 31u sock 0,8 0t0 143677 protocol: UDPv6 2023-11-04T01:48:33.559 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.560 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:48:33.561 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 59u IPv4 145791 0t0 TCP smithi040.front.sepia.ceph.com:33422->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 60r FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 61w FIFO 0,13 0t0 145793 pipe 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 62r FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 63w FIFO 0,13 0t0 145794 pipe 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 64u IPv4 139098 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40036 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 65u IPv4 146622 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47722 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 66u IPv4 142886 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44742 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 67u IPv4 142889 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40148 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 68u IPv4 142892 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44752 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 69u IPv4 146625 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40152 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 70u IPv4 146633 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40038 (ESTABLISHED) 2023-11-04T01:48:33.562 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 71u IPv4 146636 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47724 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 72u IPv4 146639 0t0 TCP smithi040.front.sepia.ceph.com:38086->smithi091.front.sepia.ceph.com:6819 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 73u IPv4 144707 0t0 TCP smithi040.front.sepia.ceph.com:34670->smithi091.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 74u IPv4 146640 0t0 TCP smithi040.front.sepia.ceph.com:48394->smithi091.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 75u IPv4 146641 0t0 TCP smithi040.front.sepia.ceph.com:52444->smithi040.front.sepia.ceph.com:6827 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 76u IPv4 142901 0t0 TCP smithi040.front.sepia.ceph.com:33912->smithi040.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 77u IPv4 146642 0t0 TCP smithi040.front.sepia.ceph.com:41586->smithi091.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 78u IPv4 144708 0t0 TCP smithi040.front.sepia.ceph.com:57730->smithi040.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 79u IPv4 142902 0t0 TCP smithi040.front.sepia.ceph.com:41512->smithi040.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 80u IPv4 144709 0t0 TCP smithi040.front.sepia.ceph.com:43704->smithi040.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 81u IPv4 142903 0t0 TCP smithi040.front.sepia.ceph.com:41914->smithi091.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 82u IPv4 144710 0t0 TCP smithi040.front.sepia.ceph.com:41426->smithi091.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 83u IPv4 142904 0t0 TCP smithi040.front.sepia.ceph.com:48958->smithi040.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 84u IPv4 142905 0t0 TCP smithi040.front.sepia.ceph.com:39496->smithi091.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 85u IPv4 142906 0t0 TCP smithi040.front.sepia.ceph.com:52178->smithi091.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 86u IPv4 146643 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi040.front.sepia.ceph.com:47736 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 87u IPv4 146646 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40154 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 88u IPv4 146649 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44762 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 89u IPv4 146652 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi040.front.sepia.ceph.com:40040 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 90u IPv4 139115 0t0 TCP smithi040.front.sepia.ceph.com:6807->smithi091.front.sepia.ceph.com:44764 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 91u IPv4 139118 0t0 TCP smithi040.front.sepia.ceph.com:6811->smithi091.front.sepia.ceph.com:40170 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 92u IPv4 145817 0t0 TCP smithi040.front.sepia.ceph.com:52862->smithi091.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 93u IPv4 144720 0t0 TCP smithi040.front.sepia.ceph.com:52824->smithi040.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 94u IPv4 142921 0t0 TCP smithi040.front.sepia.ceph.com:34732->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 95u IPv4 143763 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi091.front.sepia.ceph.com:43798 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 96u IPv4 211272 0t0 TCP smithi040.front.sepia.ceph.com:6800->smithi040.front.sepia.ceph.com:55656 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 99u IPv4 143755 0t0 TCP smithi040.front.sepia.ceph.com:42382->smithi040.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:33.564 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 100u IPv4 143756 0t0 TCP smithi040.front.sepia.ceph.com:36220->smithi040.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 101u IPv4 146659 0t0 TCP smithi040.front.sepia.ceph.com:45830->smithi091.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 102u IPv4 141003 0t0 TCP smithi040.front.sepia.ceph.com:45632->smithi091.front.sepia.ceph.com:6811 (ESTABLISHED) 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-osd 38125 41468 osd_srv_h root 103u IPv4 141004 0t0 TCP smithi040.front.sepia.ceph.com:60646->smithi091.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 41593 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 41593 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 41593 root txt unknown /proc/41593/exe 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 41732 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 41732 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 41732 root txt unknown /proc/41732/exe 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 41743 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 41743 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 41743 root txt unknown /proc/41743/exe 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 41899 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.565 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 41899 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/2 41899 root txt unknown /proc/41899/exe 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 42082 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 42082 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 42082 root txt unknown /proc/42082/exe 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 42218 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 42218 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/0 42218 root txt unknown /proc/42218/exe 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 42236 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 42236 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 42236 root txt unknown /proc/42236/exe 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 42242 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 42242 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.566 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 42242 root txt unknown /proc/42242/exe 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 42497 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 42497 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/5 42497 root txt unknown /proc/42497/exe 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 42574 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 42574 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 42574 root txt unknown /proc/42574/exe 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 42742 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 42742 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 42742 root txt unknown /proc/42742/exe 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 43189 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 43189 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 43189 root txt unknown /proc/43189/exe 2023-11-04T01:48:33.567 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 43191 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 43191 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 43191 root txt unknown /proc/43191/exe 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 43551 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 43551 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 43551 root txt unknown /proc/43551/exe 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 43608 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 43608 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 43608 root txt unknown /proc/43608/exe 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 57413 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 57413 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 57413 root txt unknown /proc/57413/exe 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 57414 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 57414 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.568 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/u 57414 root txt unknown /proc/57414/exe 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58254 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58254 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58254 root txt unknown /proc/58254/exe 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58255 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58255 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58255 root txt unknown /proc/58255/exe 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58256 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58256 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/4 58256 root txt unknown /proc/58256/exe 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 58575 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 58575 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/3 58575 root txt unknown /proc/58575/exe 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 59273 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.569 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 59273 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/7 59273 root txt unknown /proc/59273/exe 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59304 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59304 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59304 root txt unknown /proc/59304/exe 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59305 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59305 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59305 root txt unknown /proc/59305/exe 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59306 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59306 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/1 59306 root txt unknown /proc/59306/exe 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.570 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.571 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:33.572 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 0r FIFO 0,13 0t0 206087 pipe 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.573 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 3r FIFO 0,13 0t0 206866 pipe 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 4w FIFO 0,13 0t0 206866 pipe 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 6u netlink 0t0 206875 AUDIT 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 59477 root 7u unix 0xffff9c3b8ab45500 0t0 206876 type=DGRAM 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:33.574 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root 0r FIFO 0,13 0t0 206087 pipe 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:daemon-he 59479 root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.575 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.576 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.577 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.579 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.580 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.582 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.585 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59485 log root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.590 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.594 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.595 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59487 msgr-work root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.596 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.597 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.598 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.599 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.600 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.601 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.602 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59488 msgr-work root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.603 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.606 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.607 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.608 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59489 msgr-work root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.610 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.612 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.614 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.615 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.616 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59493 service root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.617 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.618 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.619 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59494 admin_soc root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.629 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.630 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59495 signal_ha root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.631 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.635 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59496 io_contex root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.638 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.639 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.640 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.642 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.643 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.644 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59497 io_contex root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.645 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.646 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.647 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.648 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.649 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.650 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.651 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59498 ms_dispat root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.652 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.654 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.655 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.657 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.660 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59499 ms_local root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.661 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.665 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.666 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.667 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59500 safe_time root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.668 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.669 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.670 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.673 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.674 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59501 safe_time root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.675 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.676 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.677 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.680 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.681 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59502 ceph-mds root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.685 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.686 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 59526 safe_time root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.689 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60437 ceph_time root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.696 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.697 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.698 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.699 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.700 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60438 OpHistory root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.704 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60439 ms_dispat root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.709 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.710 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.712 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.714 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.715 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.716 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60440 mds_rank_ root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.720 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.723 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60441 PQ_Finish root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.726 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.727 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.728 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.729 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.730 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60442 safe_time root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.732 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.733 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.734 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.737 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.738 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60443 MR_Finish root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.739 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.740 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.741 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.742 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.743 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.745 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60445 md_submit root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.746 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.747 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.749 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.750 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.752 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60801 ms_dispat root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.754 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.756 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 1w FIFO 0,13 0t0 206088 pipe 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 2w FIFO 0,13 0t0 206089 pipe 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 3r FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 4w FIFO 0,13 0t0 203604 pipe 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 6r FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 7w FIFO 0,13 0t0 203605 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 9r FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 10w FIFO 0,13 0t0 203606 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 12r FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 13w FIFO 0,13 0t0 203607 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 14w REG 8,1 6235865 674505 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 15uW REG 0,25 6 4245 /run/ceph/ceph-mds.c.pid 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 16r FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 17w FIFO 0,13 0t0 199596 pipe 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 18u unix 0xffff9c3b9352e600 0t0 199597 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 19u IPv4 206913 0t0 TCP *:6832 (LISTEN) 2023-11-04T01:48:33.758 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 20u IPv4 206947 0t0 TCP *:6833 (LISTEN) 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 21r FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 22w FIFO 0,13 0t0 199599 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 23r FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 24w FIFO 0,13 0t0 199600 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 25r FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 26w FIFO 0,13 0t0 199601 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 27u IPv4 206948 0t0 TCP smithi040.front.sepia.ceph.com:52608->smithi040.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 28r FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 29w FIFO 0,13 0t0 199602 pipe 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 30u IPv4 203611 0t0 TCP smithi040.front.sepia.ceph.com:38494->smithi091.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 31u IPv4 208167 0t0 TCP smithi040.front.sepia.ceph.com:46164->smithi040.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 32u IPv4 211268 0t0 TCP smithi040.front.sepia.ceph.com:33618->smithi040.front.sepia.ceph.com:6816 (ESTABLISHED) 2023-11-04T01:48:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 33u IPv4 213095 0t0 TCP smithi040.front.sepia.ceph.com:38302->smithi091.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 34u IPv4 207356 0t0 TCP smithi040.front.sepia.ceph.com:41410->smithi091.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 35u IPv4 213096 0t0 TCP smithi040.front.sepia.ceph.com:55656->smithi040.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 36u IPv4 210101 0t0 TCP smithi040.front.sepia.ceph.com:54258->smithi040.front.sepia.ceph.com:6817 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 37u IPv4 206776 0t0 TCP smithi040.front.sepia.ceph.com:50368->smithi091.front.sepia.ceph.com:6808 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 39u IPv4 209298 0t0 TCP smithi040.front.sepia.ceph.com:36514->smithi091.front.sepia.ceph.com:6800 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-mds 59484 60802 ms_dispat root 40u IPv4 207720 0t0 TCP smithi040.front.sepia.ceph.com:6832->192.168.0.1:46164 (ESTABLISHED) 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.760 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu 0r FIFO 0,13 0t0 208394 pipe 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61100 ubuntu 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:33.761 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 0r FIFO 0,13 0t0 208394 pipe 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 3r FIFO 0,13 0t0 213337 pipe 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 4w FIFO 0,13 0t0 213337 pipe 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 6u netlink 0t0 213346 AUDIT 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61102 root 7u unix 0xffff9c3b9372c400 0t0 213347 type=DGRAM 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:33.764 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:33.765 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.766 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 0r FIFO 0,13 0t0 208394 pipe 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 3r FIFO 0,13 0t0 212252 pipe 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 4w FIFO 0,13 0t0 212252 pipe 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:33.767 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 6u sock 0,8 0t0 212262 protocol: NETLINK 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61105 root 7u sock 0,8 0t0 212263 protocol: UNIX 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.768 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root 0r FIFO 0,13 0t0 208394 pipe 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root 3r FIFO 0,13 0t0 209380 pipe 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61106 root 4w FIFO 0,13 0t0 209380 pipe 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.770 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.771 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.773 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.777 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61110 log root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.782 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.783 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.784 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61112 msgr-work root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.788 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.792 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61113 msgr-work root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.794 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.795 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61114 msgr-work root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.800 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.804 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61118 service root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.805 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.806 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.807 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.808 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.809 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.810 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61119 admin_soc root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.811 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.813 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.814 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.815 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61120 signal_ha root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.817 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.818 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.819 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.820 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61121 io_contex root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.822 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.823 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.824 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.825 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.827 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61122 io_contex root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.828 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.829 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.831 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.832 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61123 ceph_time root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.834 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.835 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.836 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.837 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.838 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.839 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61124 fn_anonym root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.841 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.842 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.843 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.844 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61125 fn_anonym root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.845 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.846 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.848 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.849 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61126 fn_anonym root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.851 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.852 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.853 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.854 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61127 fn_anonym root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.857 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.858 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.859 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.860 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.861 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61128 fn_anonym root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.863 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.864 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.865 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.866 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.867 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61129 safe_time root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.868 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.870 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.871 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.872 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.873 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61130 fn_anonym root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.874 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.875 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.877 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.878 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.879 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61131 flusher root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.883 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.884 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61132 ms_dispat root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.886 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.887 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.891 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61133 ms_local root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.893 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.894 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61134 safe_time root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.897 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.898 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.899 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.900 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.901 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.902 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61135 ceph-fuse root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.903 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.907 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.908 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61137 ceph-fuse root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.909 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.911 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.912 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.913 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61139 ceph-fuse root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root cwd DIR 8,1 4096 655473 /home/ubuntu/cephtest 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.915 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:48:33.916 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 667864 673526 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:48:33.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 4451632 673525 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:48:33.918 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 9469840 663665 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 0r FIFO 0,13 0t0 209381 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 1w FIFO 0,13 0t0 208395 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 2w FIFO 0,13 0t0 208396 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 3w REG 8,1 298084 675093 /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 5r FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 6w FIFO 0,13 0t0 208413 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 8r FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 9w FIFO 0,13 0t0 208414 pipe 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:48:33.919 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 11r FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 12w FIFO 0,13 0t0 208415 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 13r FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 14w FIFO 0,13 0t0 208416 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 15u sock 0,8 0t0 208417 protocol: UNIX-STREAM 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 16r FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 17w FIFO 0,13 0t0 208418 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 18r FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 19w FIFO 0,13 0t0 208419 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 20u sock 0,8 0t0 212268 protocol: TCP 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 22u sock 0,8 0t0 211611 protocol: TCP 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 24r FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 25w FIFO 0,13 0t0 208423 pipe 2023-11-04T01:48:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 26r FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 27w FIFO 0,13 0t0 211612 pipe 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 28r FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-fuse 61109 61209 ceph-fuse root 29w FIFO 0,13 0t0 207777 pipe 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu 0r FIFO 0,13 0t0 214333 pipe 2023-11-04T01:48:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu 1w FIFO 0,13 0t0 214334 pipe 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61296 ubuntu 2w FIFO 0,13 0t0 214335 pipe 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu cwd DIR 0,45 0 1 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu txt REG 8,1 68096 8052 /usr/bin/mkdir 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu 0r FIFO 0,13 0t0 214333 pipe 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu 1w FIFO 0,13 0t0 214334 pipe 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir 61297 ubuntu 2w FIFO 0,13 0t0 214335 pipe 2023-11-04T01:48:33.922 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61418 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61418 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61418 root txt unknown /proc/61418/exe 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61419 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61419 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61419 root txt unknown /proc/61419/exe 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61420 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61420 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:kworker/6 61420 root txt unknown /proc/61420/exe 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu 0r FIFO 0,13 0t0 208718 pipe 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu 1w FIFO 0,13 0t0 208719 pipe 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:bash 61842 ubuntu 2w FIFO 0,13 0t0 208720 pipe 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:48:33.924 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:48:33.925 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:33.926 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 0r FIFO 0,13 0t0 208718 pipe 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 1w FIFO 0,13 0t0 208719 pipe 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 2w FIFO 0,13 0t0 208720 pipe 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 3r FIFO 0,13 0t0 209603 pipe 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 4w FIFO 0,13 0t0 209603 pipe 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 5r REG 8,1 1698 9252 /etc/sudoers 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 6u netlink 0t0 209612 AUDIT 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:sudo 61843 root 7u unix 0xffff9c3c6b7a8cc0 0t0 209613 type=DGRAM 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.927 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.928 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root 0r FIFO 0,13 0t0 208718 pipe 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root 1w FIFO 0,13 0t0 208719 pipe 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root 2w FIFO 0,13 0t0 208720 pipe 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root 3r FIFO 0,13 0t0 210416 pipe 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root 4w FIFO 0,13 0t0 210416 pipe 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:stdin-kil 61844 root 6w FIFO 0,13 0t0 210417 pipe 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root txt REG 8,1 167544 14991 /usr/bin/lsof 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.929 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 0r FIFO 0,13 0t0 210417 pipe 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 1w FIFO 0,13 0t0 208719 pipe 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 2w FIFO 0,13 0t0 208720 pipe 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 3r DIR 0,23 0 1 /proc 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 4r DIR 0,23 0 212607 /proc/61845/fd 2023-11-04T01:48:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 5w FIFO 0,13 0t0 212619 pipe 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61845 root 6r FIFO 0,13 0t0 212620 pipe 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root txt REG 8,1 167544 14991 /usr/bin/lsof 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:48:33.932 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:48:33.932 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:48:33.932 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:48:33.932 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root 4r FIFO 0,13 0t0 212619 pipe 2023-11-04T01:48:33.932 INFO:teuthology.orchestra.run.smithi040.stdout:lsof 61846 root 7w FIFO 0,13 0t0 212620 pipe 2023-11-04T01:48:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 2 0.0 0.0 0 0 ? S 01:24 0:00 [kthreadd] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 3 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rcu_gp] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 4 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rcu_par_gp] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 5 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [slub_flushwq] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 6 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [netns] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 8 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 10 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [mm_percpu_wq] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 11 0.0 0.0 0 0 ? S 01:24 0:00 \_ [rcu_tasks_rude_] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 12 0.0 0.0 0 0 ? S 01:24 0:00 \_ [rcu_tasks_trace] 2023-11-04T01:48:33.934 INFO:teuthology.orchestra.run.smithi040.stdout:root 13 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/0] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 14 0.0 0.0 0 0 ? I 01:24 0:01 \_ [rcu_sched] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 15 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/0] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 16 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/0] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 18 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/0] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 19 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/1] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 20 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/1] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 21 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/1] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 22 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/1] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 24 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 25 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/2] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 26 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/2] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 27 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/2] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 28 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/2] 2023-11-04T01:48:33.935 INFO:teuthology.orchestra.run.smithi040.stdout:root 30 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 31 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/3] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 32 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/3] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 33 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/3] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 34 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/3] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 36 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 37 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/4] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 38 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/4] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 39 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/4] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 40 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/4] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 42 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/4:0H-kblockd] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 43 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/5] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 44 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/5] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 45 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/5] 2023-11-04T01:48:33.936 INFO:teuthology.orchestra.run.smithi040.stdout:root 46 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/5] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 48 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/5:0H-kblockd] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 49 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/6] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 50 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/6] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 51 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/6] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 52 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/6] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 54 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 55 0.0 0.0 0 0 ? S 01:24 0:00 \_ [cpuhp/7] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 56 0.0 0.0 0 0 ? S 01:24 0:00 \_ [idle_inject/7] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 57 0.0 0.0 0 0 ? S 01:24 0:00 \_ [migration/7] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 58 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ksoftirqd/7] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 60 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 61 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kdevtmpfs] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 62 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [inet_frag_wq] 2023-11-04T01:48:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:root 63 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kauditd] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 64 0.0 0.0 0 0 ? S 01:24 0:00 \_ [khungtaskd] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 65 0.0 0.0 0 0 ? S 01:24 0:00 \_ [oom_reaper] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 66 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [writeback] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 67 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kcompactd0] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 68 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [ksmd] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 69 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [khugepaged] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 116 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kintegrityd] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 117 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kblockd] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 118 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [blkcg_punt_bio] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 119 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [tpm_dev_wq] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 120 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ata_sff] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 121 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [md] 2023-11-04T01:48:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:root 122 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [edac-poller] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 123 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [devfreq_wq] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 124 0.0 0.0 0 0 ? S 01:24 0:00 \_ [watchdogd] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 127 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/0:1H-xfs-log/dm-4] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 134 0.0 0.0 0 0 ? S 01:24 0:00 \_ [kswapd0] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 135 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ecryptfs-kthrea] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 137 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kthrotld] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 138 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [acpi_thermal_pm] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 141 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [vfio-irqfd-clea] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 142 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [mld] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 143 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ipv6_addrconf] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 152 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kstrp] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 157 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [zswap-shrink] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 158 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/u17:0-xprtiod] 2023-11-04T01:48:33.939 INFO:teuthology.orchestra.run.smithi040.stdout:root 163 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [charger_manager] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 185 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/2:1H-xfs-log/dm-4] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 217 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-wq] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 219 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-reset-wq] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 220 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [nvme-delete-wq] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 221 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_0] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 222 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_0] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 223 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_1] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 224 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_1] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 225 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_2] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 226 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_2] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 227 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_3] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 228 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_3] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 234 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_4] 2023-11-04T01:48:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:root 235 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_4] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 236 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_5] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 237 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_5] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 238 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_6] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 239 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_6] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 240 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_7] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 241 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_7] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 242 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_8] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 243 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_8] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 244 0.0 0.0 0 0 ? S 01:24 0:00 \_ [scsi_eh_9] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 245 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [scsi_tmf_9] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 249 0.0 0.0 0 0 ? I 01:24 0:00 \_ [kworker/u16:11-flush-253:1] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 252 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ixgbe] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 254 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/5:1H-xfs-log/dm-4] 2023-11-04T01:48:33.941 INFO:teuthology.orchestra.run.smithi040.stdout:root 261 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/7:1H-kblockd] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 262 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/6:1H-xfs-log/dm-1] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 273 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/3:1H-kblockd] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 276 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/1:1H-xfs-log/dm-4] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 309 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/4:1H-kblockd] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 311 0.0 0.0 0 0 ? S 01:24 0:00 \_ [jbd2/sda1-8] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 312 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ext4-rsv-conver] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 360 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rpciod] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 361 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [xprtiod] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 387 0.0 0.0 0 0 ? S 01:24 0:00 \_ [ext4lazyinit] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 390 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [iscsi_eh] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 391 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [iscsi_conn_clea] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 491 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ipmi-msghandler] 2023-11-04T01:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:root 539 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [cryptd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 580 0.0 0.0 0 0 ? SN 01:24 0:00 \_ [kipmi0] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 974 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [kworker/u17:1] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 977 0.0 0.0 0 0 ? S 01:24 0:00 \_ [lockd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 981 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 982 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 983 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 984 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 985 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 986 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 987 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 988 0.0 0.0 0 0 ? S 01:24 0:00 \_ [nfsd] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 1054 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ib-comp-wq] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 1055 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ib-comp-unb-wq] 2023-11-04T01:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout:root 1056 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ib_mcast] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 1057 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [ib_nl_sa_wq] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 1068 0.0 0.0 0 0 ? I< 01:24 0:00 \_ [rdma_cm] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 14197 0.0 0.0 0 0 ? I 01:30 0:00 \_ [kworker/u16:0-xfs-cil/dm-1] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 16551 0.0 0.0 0 0 ? I 01:31 0:00 \_ [kworker/u16:1-ext4-rsv-conversion] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 16609 0.0 0.0 0 0 ? I 01:31 0:00 \_ [kworker/u16:3-writeback] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 16983 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17016 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17048 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17080 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17112 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [kdmflush] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17307 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfsalloc] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17308 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs_mru_cache] 2023-11-04T01:48:33.944 INFO:teuthology.orchestra.run.smithi040.stdout:root 17310 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-buf/dm-4] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17311 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-conv/dm-4] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17312 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17313 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17314 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17315 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-log/dm-4] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17316 0.0 0.0 0 0 ? I< 01:32 0:00 \_ [xfs-cil/dm-4] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 17317 0.0 0.0 0 0 ? S 01:32 0:00 \_ [xfsaild/dm-4] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 32911 0.0 0.0 0 0 ? I 01:38 0:00 \_ [kworker/1:1-events] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 33234 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-buf/dm-0] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 33235 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-conv/dm-0] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 33236 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 33237 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 33238 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:33.945 INFO:teuthology.orchestra.run.smithi040.stdout:root 33239 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-log/dm-0] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33240 0.0 0.0 0 0 ? I< 01:38 0:00 \_ [xfs-cil/dm-0] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33241 0.0 0.0 0 0 ? S 01:38 0:00 \_ [xfsaild/dm-0] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33252 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-1] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33253 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-1] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33254 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33255 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33256 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33257 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-1] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33258 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-1] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33259 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-1] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33270 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-2] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33271 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-2] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33272 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:33.946 INFO:teuthology.orchestra.run.smithi040.stdout:root 33273 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33274 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33275 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-2] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33276 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-2] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33277 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-2] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33288 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-3] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33289 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-3] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33290 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33291 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33292 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33293 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-3] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33294 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-3] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33295 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-3] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 33310 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-0] 2023-11-04T01:48:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:root 34451 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-1] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 35592 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-2] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 36733 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-3] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 41593 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/1:15-events] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 41732 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/2:45-rcu_gp] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 41743 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/3:51-mm_percpu_wq] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 41899 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/2:75-mm_percpu_wq] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42082 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/0:89-events] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42218 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/0:225-events] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42236 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/5:50-mm_percpu_wq] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42242 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/6:3-events] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42497 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/5:174-dio/dm-3] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42574 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/6:160-events] 2023-11-04T01:48:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:root 42742 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/3:121-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 43189 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/7:304-mm_percpu_wq] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 43191 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/7:306-xfs-sync/dm-0] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 43551 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/4:189-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 43608 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/4:246-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 57413 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/7:0-mm_percpu_wq] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 57414 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/u16:2-events_power_efficient] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 58254 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/4:0-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 58255 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/4:1] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 58256 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/4:2-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 58575 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/3:0-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 59273 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/7:1-xfs-sync/dm-1] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 59304 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/1:0-events] 2023-11-04T01:48:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:root 59305 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/1:2] 2023-11-04T01:48:33.950 INFO:teuthology.orchestra.run.smithi040.stdout:root 59306 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/1:3] 2023-11-04T01:48:33.950 INFO:teuthology.orchestra.run.smithi040.stdout:root 61418 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/6:0-events] 2023-11-04T01:48:33.950 INFO:teuthology.orchestra.run.smithi040.stdout:root 61419 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/6:1] 2023-11-04T01:48:33.950 INFO:teuthology.orchestra.run.smithi040.stdout:root 61420 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/6:2-mm_percpu_wq] 2023-11-04T01:48:33.950 INFO:teuthology.orchestra.run.smithi040.stdout:root 1 0.7 0.0 167680 13256 ? Ss 01:24 0:11 /sbin/init 2023-11-04T01:48:33.950 INFO:teuthology.orchestra.run.smithi040.stdout:root 359 0.1 0.0 64992 25332 ? S stdin-killer -- python3 -c ' 2023-11-04T01:48:33.956 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-11-04T01:48:33.956 DEBUG:teuthology.orchestra.run.smithi040:> path = "/sys/fs/fuse/connections/45/abort" 2023-11-04T01:48:33.956 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists(path): 2023-11-04T01:48:33.956 DEBUG:teuthology.orchestra.run.smithi040:> open(path, "w").write("1") 2023-11-04T01:48:33.956 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-11-04T01:48:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:48:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:34.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-11-04T01:48:34.038 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:48:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:34.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:mkdir: cannot create directory 'd1/dir/.snap/s33': Software caused connection abort 2023-11-04T01:48:34.100 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:48:40.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~32s 2023-11-04T01:48:47.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~39s 2023-11-04T01:48:53.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2023-11-04T01:49:00.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~52s 2023-11-04T01:49:02.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:02.281 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:07.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~59s 2023-11-04T01:49:13.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-11-04T01:49:20.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~72s 2023-11-04T01:49:26.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~79s 2023-11-04T01:49:32.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:32.332 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:33.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2023-11-04T01:49:40.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~92s 2023-11-04T01:49:46.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~99s 2023-11-04T01:49:53.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~105s 2023-11-04T01:49:59.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~112s 2023-11-04T01:50:02.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:02.453 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:06.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~118s 2023-11-04T01:50:13.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~125s 2023-11-04T01:50:19.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~132s 2023-11-04T01:50:26.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~138s 2023-11-04T01:50:32.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:32.573 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:33.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2023-11-04T01:50:39.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~151s 2023-11-04T01:50:46.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~158s 2023-11-04T01:50:52.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2023-11-04T01:50:59.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~171s 2023-11-04T01:51:02.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:02.660 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:06.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~178s 2023-11-04T01:51:12.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~184s 2023-11-04T01:51:19.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~191s 2023-11-04T01:51:25.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~198s 2023-11-04T01:51:32.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~204s 2023-11-04T01:51:32.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:32.764 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:39.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~211s 2023-11-04T01:51:45.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~218s 2023-11-04T01:51:52.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~224s 2023-11-04T01:51:59.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~231s 2023-11-04T01:52:02.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:02.901 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:05.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~237s 2023-11-04T01:52:12.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~244s 2023-11-04T01:52:18.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~251s 2023-11-04T01:52:25.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~257s 2023-11-04T01:52:32.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~264s 2023-11-04T01:52:32.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:32.945 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:38.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~270s 2023-11-04T01:52:45.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~277s 2023-11-04T01:52:51.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~284s 2023-11-04T01:52:58.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~290s 2023-11-04T01:53:02.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:02.992 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:05.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~297s 2023-11-04T01:53:11.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~303s 2023-11-04T01:53:11.721 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-04T01:53:11.722 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:53:11.722 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:11.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:53:11.729 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi040.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-04T01:53:11.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:53:11.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:11.729 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:53:11.777 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:53:11.777 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:11.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:53:11.825 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi040.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-04T01:53:11.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:53:11.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:11.825 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:53:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:53:11.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:53:11.873 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:53:11.873 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:11.880 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:53:11.880 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi091.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-04T01:53:11.880 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:53:11.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:11.880 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:53:11.926 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:53:11.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:53:11.928 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:53:11.928 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:53:11.975 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:53:11.975 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi091.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-04T01:53:11.975 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:53:11.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:11.975 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:53:12.022 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:53:12.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:53:13.632 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-04T01:53:13.632 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-04T01:53:13.632 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-04T01:53:13.633 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-04T01:53:13.633 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-04T01:53:13.633 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-04T01:53:13.633 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-04T01:53:13.634 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-04T01:53:13.634 INFO:tasks.ceph.mds.c:Sent signal 15 2023-11-04T01:53:13.634 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-04T01:53:13.634 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-04T01:53:13.634 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-04T01:53:13.635 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-04T01:53:13.635 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-04T01:53:13.635 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-04T01:53:13.635 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-04T01:53:13.636 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f5098d8e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 38383) UID: 0 2023-11-04T01:53:13.636 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f5098d8e640 -1 osd.4 117 *** Got signal Terminated *** 2023-11-04T01:53:13.636 INFO:tasks.ceph.osd.4.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f5098d8e640 -1 osd.4 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.636 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fe377a44640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 38386) UID: 0 2023-11-04T01:53:13.636 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fe377a44640 -1 osd.5 117 *** Got signal Terminated *** 2023-11-04T01:53:13.637 INFO:tasks.ceph.osd.5.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fe377a44640 -1 osd.5 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.637 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:53:13.641+0000 7ff1aeeb4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 38388) UID: 0 2023-11-04T01:53:13.637 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:53:13.641+0000 7ff1aeeb4640 -1 osd.6 117 *** Got signal Terminated *** 2023-11-04T01:53:13.637 INFO:tasks.ceph.osd.6.smithi091.stderr:2023-11-04T01:53:13.641+0000 7ff1aeeb4640 -1 osd.6 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.637 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f10e9243640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 38390) UID: 0 2023-11-04T01:53:13.637 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f10e9243640 -1 osd.7 117 *** Got signal Terminated *** 2023-11-04T01:53:13.638 INFO:tasks.ceph.osd.7.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f10e9243640 -1 osd.7 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.638 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fac3fa81640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44650) UID: 0 2023-11-04T01:53:13.638 INFO:tasks.ceph.mds.b.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fac3fa81640 -1 mds.b *** got signal Terminated *** 2023-11-04T01:53:13.638 INFO:tasks.ceph.mds.d.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f25e35d6640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 44382) UID: 0 2023-11-04T01:53:13.638 INFO:tasks.ceph.mds.d.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f25e35d6640 -1 mds.d *** got signal Terminated *** 2023-11-04T01:53:13.639 INFO:tasks.ceph.mon.b.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f0e0c928640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 38071) UID: 0 2023-11-04T01:53:13.639 INFO:tasks.ceph.mon.b.smithi091.stderr:2023-11-04T01:53:13.641+0000 7f0e0c928640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:53:13.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fa4819ed640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 38072) UID: 0 2023-11-04T01:53:13.639 INFO:tasks.ceph.mon.c.smithi091.stderr:2023-11-04T01:53:13.641+0000 7fa4819ed640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f357ce35640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38110) UID: 0 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f357ce35640 -1 osd.0 117 *** Got signal Terminated *** 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f357ce35640 -1 osd.0 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f10fba91640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 38112) UID: 0 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f10fba91640 -1 osd.1 117 *** Got signal Terminated *** 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f10fba91640 -1 osd.1 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.640 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fd302193640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 38114) UID: 0 2023-11-04T01:53:13.641 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fd302193640 -1 osd.2 117 *** Got signal Terminated *** 2023-11-04T01:53:13.641 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fd302193640 -1 osd.2 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.641 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fdd8a0da640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 38116) UID: 0 2023-11-04T01:53:13.641 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fdd8a0da640 -1 osd.3 117 *** Got signal Terminated *** 2023-11-04T01:53:13.641 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fdd8a0da640 -1 osd.3 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:53:13.641 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f5d7b70e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 59479) UID: 0 2023-11-04T01:53:13.642 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-11-04T01:53:13.631+0000 7f5d7b70e640 -1 mds.c *** got signal Terminated *** 2023-11-04T01:53:13.642 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fde35940640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 38005) UID: 0 2023-11-04T01:53:13.642 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-11-04T01:53:13.631+0000 7fde35940640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-04T01:53:13.837 INFO:tasks.ceph.mgr.y.smithi040.stderr:daemon-helper: command crashed with signal 15 2023-11-04T01:53:21.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-11-04T01:53:21 stdin-killer ERROR: timeout expired: sending signal 9 to command and myself 2023-11-04T01:53:21.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:bash: line 1: 61102 Killed ( cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 ) 2023-11-04T01:53:26.966 DEBUG:teuthology.orchestra.run:got remote process result: 137 2023-11-04T01:53:26.967 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:53:26.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:26.967 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:53:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:53:26.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:53:26.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:53:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 Processor -- start 2023-11-04T01:53:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 -- start start 2023-11-04T01:53:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa380cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 0x7faa380ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa380b3e30 2023-11-04T01:53:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa38160680 2023-11-04T01:53:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa3d9dc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa38160a60 2023-11-04T01:53:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa380b3e30 legacy=0x7faa380cf9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa380cdba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 msgr2=0x7faa380ce0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.147+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 0x7faa380ce0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.351+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa380b3e30 legacy=0x7faa380cf9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.351+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.351+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa380cdba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.351+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 msgr2=0x7faa380ce0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:27.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.351+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 0x7faa380ce0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:27.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.755+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa380b3e30 legacy=0x7faa380cf9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:27.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.755+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:27.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.755+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa380cdba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:27.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.755+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 msgr2=0x7faa380ce0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:27.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:27.755+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 0x7faa380ce0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:28.559+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa380b3e30 legacy=0x7faa380cf9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:28.559+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:28.559+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa380cdba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:28.559+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 msgr2=0x7faa380ce0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:28.559+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 0x7faa380ce0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 msgr2=0x7faa380ce0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa38160a60 0x7faa380ce0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa380cdba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa380cdba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa380b3e30 legacy=0x7faa380cf9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa180036a0 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa180072f0 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180036a0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.147+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:30.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.351+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180036a0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:30.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.351+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:30.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.351+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.755+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180036a0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.755+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:30.755+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:31.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:31.559+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180036a0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:31.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:31.559+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:31.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:31.559+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:33.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:33.129 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180072f0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180036a0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa18009ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800a8d0 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa38160680 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800a400 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a8d0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.147+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.351+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a8d0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.351+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.351+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.351+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.351+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.755+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.755+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a8d0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:33.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.755+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:33.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.755+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:33.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:33.755+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:34.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:34.559+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:34.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:34.559+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a8d0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:34.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:34.559+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:34.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:34.559+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:34.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:34.559+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa38160680 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a8d0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:36.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 0x7faa1800d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa1800dd30 2023-11-04T01:53:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800d1f0 2023-11-04T01:53:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 msgr2=0x7faa1800d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa180122a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:36.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.147+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 0x7faa1800d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:36.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.351+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa180122a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:36.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.351+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 msgr2=0x7faa1800d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:36.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.351+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 0x7faa1800d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.755+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 msgr2=0x7faa1800d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.755+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa180122a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:36.755+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 0x7faa1800d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:37.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:37.559+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 msgr2=0x7faa1800d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:37.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:37.559+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa180122a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:37.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:37.559+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 0x7faa1800d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:39.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 msgr2=0x7faa1800d660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800d1f0 0x7faa1800d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa180122a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 0x7faa18013e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800dd30 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18013a60 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800a400 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 msgr2=0x7faa18013e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18012a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 0x7faa18013e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:39.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.147+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:39.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.351+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18012a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:39.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.351+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 msgr2=0x7faa18013e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:39.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.351+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:39.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.351+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 0x7faa18013e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:39.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.351+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.755+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 msgr2=0x7faa18013e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.755+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.755+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18012a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.755+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 0x7faa18013e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:39.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:39.755+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:40.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:40.559+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 msgr2=0x7faa18013e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:40.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:40.559+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18012a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:40.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:40.559+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:40.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:40.559+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 0x7faa18013e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:40.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:40.559+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 msgr2=0x7faa18013e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013a60 0x7faa18013e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18012a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa180145b0 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800d6d0 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180145b0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:42.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.151+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.355+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.355+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180145b0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.355+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:42.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.759+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180145b0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:42.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.759+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:42.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:42.759+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:43.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:43.563+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180145b0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:43.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:43.563+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:43.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:43.563+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180145b0 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800dd30 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800d6d0 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800a400 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.151+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.147+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.151+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.151+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:45.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.355+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:45.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.355+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:45.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.355+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:45.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.355+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:45.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.355+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:45.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.759+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:45.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.759+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:45.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.759+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:45.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.759+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:45.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:45.759+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:46.563+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:46.563+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:46.563+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:46.563+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:46.563+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 0x7faa18012330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa18012870 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18013e60 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012870 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 msgr2=0x7faa18012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.151+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 0x7faa18012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.355+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012870 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.355+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 msgr2=0x7faa18012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.355+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 0x7faa18012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:48.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.759+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 msgr2=0x7faa18012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:48.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.759+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012870 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:48.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:48.759+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 0x7faa18012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:49.563+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 msgr2=0x7faa18012330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:49.563+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012870 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:49.563+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 0x7faa18012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 msgr2=0x7faa18012330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013e60 0x7faa18012330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012870 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800dd30 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800d6d0 2023-11-04T01:53:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800a400 2023-11-04T01:53:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:51.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.151+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.355+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.355+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.355+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.355+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.355+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:51.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.759+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:51.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.759+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:51.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.759+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:51.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.759+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:51.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:51.759+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:52.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:52.563+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:52.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:52.563+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:52.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:52.563+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:52.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:52.563+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:53:52.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:52.563+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800a400 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 0x7faa18013430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:54.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa18013e60 2023-11-04T01:53:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa180123b0 2023-11-04T01:53:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013e60 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 msgr2=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:54.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.151+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 0x7faa18013430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:54.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.355+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013e60 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:54.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.355+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 msgr2=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:54.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.355+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 0x7faa18013430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:54.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.759+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013e60 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:54.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.759+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 msgr2=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:54.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:54.759+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 0x7faa18013430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:55.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:55.563+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013e60 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:55.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:55.563+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 msgr2=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:53:55.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:55.563+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 0x7faa18013430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:57.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 msgr2=0x7faa18013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:57.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa180123b0 0x7faa18013430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:57.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013e60 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:57.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800dd30 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa1800a400 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800d6d0 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.151+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800a400 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.355+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.355+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.355+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.355+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800a400 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:57.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.759+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:57.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.759+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:57.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.759+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:57.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:57.759+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800a400 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:53:58.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:58.563+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:53:58.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:58.563+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:53:58.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:58.563+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:58.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:53:58.563+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800a400 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800a400 legacy=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18013430 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa180123b0 2023-11-04T01:54:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.151+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:00.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.355+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:00.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.355+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:00.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.355+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:00.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.355+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.759+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.759+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.759+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:00.759+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:01.563+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:01.563+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:01.563+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:01.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:01.563+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800dd30 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18013430 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa180123b0 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.151+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:03.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:03.190 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.355+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.355+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.355+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.355+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.355+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:03.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.759+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:03.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.759+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:03.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.759+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:03.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.759+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:03.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:03.759+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:04.563+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18003b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:04.563+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:04.563+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:04.563+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:04.563+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 msgr2=0x7faa180097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180123b0 0x7faa180097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800dd30 legacy=0x7faa18003b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18012c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa18013d50 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800d6d0 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18012c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.151+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013d50 legacy=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.355+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.355+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18012c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.355+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013d50 legacy=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.759+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.759+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18012c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:06.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:06.759+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013d50 legacy=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:07.563+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:07.563+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18012c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:07.563+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013d50 legacy=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 msgr2=0x7faa18012c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800d6d0 0x7faa18012c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013d50 legacy=0x7faa18009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800d6d0 2023-11-04T01:54:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dd30 2023-11-04T01:54:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa18013430 2023-11-04T01:54:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa18012c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.155+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:09.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.359+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:09.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.359+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:09.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.359+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:09.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.359+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa18012c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:09.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.359+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:09.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.763+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:09.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.763+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:09.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.763+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:09.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.763+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa18012c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:09.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:09.763+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:10.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:10.567+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:10.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:10.567+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:10.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:10.567+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:10.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:10.567+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa18012c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:10.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:10.567+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 msgr2=0x7faa18013810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18013430 0x7faa18013810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa18012c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 0x7faa18006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa180123b0 2023-11-04T01:54:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18013d50 2023-11-04T01:54:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180123b0 legacy=0x7faa180087b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 msgr2=0x7faa18006aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.155+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 0x7faa18006aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:12.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.359+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180123b0 legacy=0x7faa180087b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:12.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.359+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 msgr2=0x7faa18006aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:12.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.359+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 0x7faa18006aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:12.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.763+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180123b0 legacy=0x7faa180087b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:12.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.763+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 msgr2=0x7faa18006aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:12.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:12.763+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 0x7faa18006aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:13.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:13.567+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180123b0 legacy=0x7faa180087b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:13.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:13.567+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 msgr2=0x7faa18006aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:13.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:13.567+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 0x7faa18006aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:15.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 msgr2=0x7faa18006aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013d50 0x7faa18006aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180123b0 legacy=0x7faa180087b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800a360 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dd30 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800d6d0 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18008ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:15.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.151+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.355+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.355+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18008ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.355+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.355+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.355+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:15.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.759+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:15.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.759+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18008ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:15.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.759+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:15.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.759+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:15.759+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:16.563+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18008ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:16.563+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:16.563+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:16.563+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:16.563+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:18.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:18.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18008ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa18012bb0 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18006aa0 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012bb0 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.151+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:18.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.355+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012bb0 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:18.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.355+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:18.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.355+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:18.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.759+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012bb0 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:18.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.759+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:18.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:18.759+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:19.563+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012bb0 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:19.563+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:19.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:19.563+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18012bb0 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:21.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18008290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa180077a0 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18006aa0 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800d6d0 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18008290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180077a0 legacy=0x7faa18007b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18008290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:21.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.155+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.359+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18008290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.359+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.359+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180077a0 legacy=0x7faa18007b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.359+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18008290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.359+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.763+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180077a0 legacy=0x7faa18007b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.763+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.763+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18008290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.763+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18008290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:21.763+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:22.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:22.567+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180077a0 legacy=0x7faa18007b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:22.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:22.567+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18008290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:22.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:22.567+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:22.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:22.567+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18008290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:22.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:22.567+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:24.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 msgr2=0x7faa180095d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:24.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1800d6d0 0x7faa180095d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:24.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18008290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:24.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18008290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180077a0 legacy=0x7faa18007b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800a360 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dd30 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:24.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.155+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.359+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.359+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.359+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:24.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.763+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:24.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.763+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:24.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:24.763+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:25.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:25.567+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:25.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:25.567+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:25.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:25.567+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800a360 2023-11-04T01:54:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dd30 2023-11-04T01:54:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa18006aa0 2023-11-04T01:54:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.155+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.359+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.359+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:27.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.359+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.359+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:27.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.359+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.762+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.762+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.762+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.762+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:27.762+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:28.566+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:28.566+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:28.566+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:28.566+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:28.566+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:30.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:30.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:30.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:30.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dd30 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:30.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800d6d0 2023-11-04T01:54:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18008ec0 2023-11-04T01:54:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.154+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:30.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.358+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:30.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.358+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:30.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.358+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:30.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.762+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:30.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.762+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:30.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:30.762+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:31.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:31.566+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:31.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:31.566+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:31.566+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:33.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:33.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800a360 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa1800d6d0 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18008ec0 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:33.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.154+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:33.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:33.319 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.358+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.358+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.358+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.358+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.762+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.762+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.762+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:33.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:33.762+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:34.566+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:34.566+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:34.566+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:34.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:34.566+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 msgr2=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18008ec0 0x7faa180092c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180077a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18006aa0 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800dca0 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:36.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:36.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:36.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.154+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.358+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.358+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.358+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:36.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.358+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.762+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.762+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.762+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:36.762+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:37.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:37.566+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:37.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:37.566+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:37.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:37.566+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:37.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:37.566+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa1800a360 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18006aa0 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800dca0 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:39.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.154+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:39.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.358+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.358+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.358+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.358+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:39.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.358+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.762+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.762+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:39.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.762+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.762+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:39.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:39.762+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:40.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:40.566+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:40.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:40.566+0000 7faa377fe640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:40.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:40.566+0000 7faa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:40.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:40.566+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:40.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:40.566+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:42.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:42.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:42.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18006aa0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800d6d0 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa180087b0 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:42.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.158+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:42.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:42.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.362+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:42.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.362+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:42.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:42.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.766+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:42.766+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:43.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:43.570+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:43.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:43.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:43.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:43.570+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa1800d6d0 legacy=0x7faa180092c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa18016a80 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dca0 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa180087b0 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18018e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:45.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:45.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:45.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:45.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.158+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:45.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.362+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:45.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18018e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.362+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.362+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.362+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:45.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18018e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:45.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.766+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:45.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.766+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:45.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.766+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:45.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:45.766+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:46.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:46.570+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:46.570+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:46.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18018e70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:46.570+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:46.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:46.570+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18018e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa1800a360 2023-11-04T01:54:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa18013410 2023-11-04T01:54:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.158+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:48.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.362+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:48.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:48.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.362+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.766+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:48.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:48.766+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:49.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:49.570+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:49.570+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:51.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa1800a360 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa18012890 con 0x7faa18016a80 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dca0 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:51.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.158+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.362+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:51.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.362+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:51.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.362+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.766+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.766+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:51.766+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:52.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:52.570+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:54:52.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:52.570+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:52.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:52.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:52.570+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa1800a360 legacy=0x7faa180091a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 0x7faa18013410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa180087b0 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa18012f90 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:54.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 msgr2=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:54.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.158+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 0x7faa18013410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.362+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.362+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.362+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 msgr2=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.362+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 0x7faa18013410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:54.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.766+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:54.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.766+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:54.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.766+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 msgr2=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:54.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:54.766+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 0x7faa18013410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:55.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:55.570+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:54:55.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:55.570+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:55.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:55.570+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 msgr2=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:55.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:55.570+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 0x7faa18013410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 msgr2=0x7faa18013410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18012f90 0x7faa18013410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa180087b0 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa18016a80 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dca0 2023-11-04T01:54:57.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa18013410 2023-11-04T01:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.158+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:57.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.362+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:57.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.362+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:57.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.362+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:57.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.362+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:57.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.362+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:57.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.766+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:57.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.766+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:57.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.766+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:57.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.766+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:57.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:57.766+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:58.570+0000 7faa377fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:54:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:58.570+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:54:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:58.570+0000 7faa36ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:54:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:58.570+0000 7faa36ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:54:58.570+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:00.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 msgr2=0x7faa180137f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:00.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa18013410 0x7faa180137f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:00.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:00.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa180091a0 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800a360 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa180061a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:00.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.158+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.362+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa180061a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.362+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.362+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.766+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa180061a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.766+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:00.766+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:01.570+0000 7faa367fc640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa180061a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:01.570+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:01.570+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa180061a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa18016a80 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800a360 2023-11-04T01:55:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800dca0 2023-11-04T01:55:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.158+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.362+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.362+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.362+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.362+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:03.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:03.454 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:03.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.766+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:03.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.766+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:03.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:03.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.766+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:03.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:03.766+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:04.570+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:04.570+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:04.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:04.570+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:04.570+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18016a80 legacy=0x7faa18005a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18013b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa180091a0 2023-11-04T01:55:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa180087b0 2023-11-04T01:55:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.158+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.362+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.362+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.766+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:06.766+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:07.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:07.570+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:07.570+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 msgr2=0x7faa18013b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa180087b0 0x7faa18013b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180091a0 legacy=0x7faa18013410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:55:09.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa1801d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa180061a0 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dca0 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1801ae90 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180061a0 legacy=0x7faa18006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa1801d280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:09.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.158+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa1801d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:09.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.362+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180061a0 legacy=0x7faa18006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:09.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.362+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa1801d280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:09.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.362+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.362+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa1801d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:09.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.362+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:09.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.766+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180061a0 legacy=0x7faa18006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:09.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.766+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa1801d280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:09.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.766+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:09.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.766+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:09.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:09.766+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa1801d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:10.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:10.570+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180061a0 legacy=0x7faa18006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:10.570+0000 7faa377fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:10.570+0000 7faa367fc640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa1801d280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:10.570+0000 7faa377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:10.570+0000 7faa367fc640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa1801d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:12.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa1801d280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa1801d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18009e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18009e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa180061a0 legacy=0x7faa18006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa180133d0 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800a360 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.158+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180133d0 legacy=0x7faa180137b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.362+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.362+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.362+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180133d0 legacy=0x7faa180137b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:12.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.766+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:12.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.766+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:12.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:12.766+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180133d0 legacy=0x7faa180137b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:13.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:13.570+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:13.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:13.570+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:13.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:13.570+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180133d0 legacy=0x7faa180137b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 msgr2=0x7faa18008bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a360 0x7faa18008bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180133d0 legacy=0x7faa180137b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa18009e20 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dca0 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1801ae90 2023-11-04T01:55:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:15.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:15.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:15.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:15.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.162+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.366+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.366+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.366+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:15.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.366+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:15.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.366+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:15.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.770+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:15.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.770+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:15.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.770+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:15.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.770+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:15.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:15.770+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:16.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:16.574+0000 7faa377fe640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:16.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:16.574+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:16.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:16.574+0000 7faa36ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:16.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:16.574+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:16.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:16.574+0000 7faa36ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 0x7faa180051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa18013ae0 2023-11-04T01:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800a220 2023-11-04T01:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 msgr2=0x7faa180051a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 0x7faa180051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.162+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013ae0 legacy=0x7faa18003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:18.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.366+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 msgr2=0x7faa180051a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:18.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.366+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 0x7faa180051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:18.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.366+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013ae0 legacy=0x7faa18003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.770+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 msgr2=0x7faa180051a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.770+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 0x7faa180051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:18.770+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013ae0 legacy=0x7faa18003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:19.574+0000 7faa367fc640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 msgr2=0x7faa180051a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:19.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:19.574+0000 7faa367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 0x7faa180051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:19.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:19.574+0000 7faa36ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013ae0 legacy=0x7faa18003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:21.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 msgr2=0x7faa180051a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800a220 0x7faa180051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa18013ae0 legacy=0x7faa18003a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa377fe640 1 -- reap_dead start 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380cf000 con 0x7faa18009e20 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380d18f0 con 0x7faa180056e0 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa34ff9640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1801ae90 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180056e0 legacy=0x7faa18005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:21.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.162+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.366+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.366+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180056e0 legacy=0x7faa18005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.366+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.366+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.770+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.770+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.770+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180056e0 legacy=0x7faa18005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:21.770+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:22.574+0000 7faa36ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:22.574+0000 7faa367fc640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180056e0 legacy=0x7faa18005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:22.574+0000 7faa377fe640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:22.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:22.574+0000 7faa377fe640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 msgr2=0x7faa18016a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7faa1801ae90 0x7faa18016a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7faa180056e0 legacy=0x7faa18005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7faa18009e20 legacy=0x7faa180133d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 0x7faa18006210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:24.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380b5de0 con 0x7faa1800dca0 2023-11-04T01:55:24.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa34ff9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380d1610 con 0x7faa1800a220 2023-11-04T01:55:24.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:24.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:24.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 msgr2=0x7faa18006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:24.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.162+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 0x7faa18006210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.366+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.366+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.366+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 msgr2=0x7faa18006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.366+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 0x7faa18006210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:24.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.770+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:24.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.770+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:24.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.770+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 msgr2=0x7faa18006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:24.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:24.770+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 0x7faa18006210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:25.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:25.574+0000 7faa36ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 msgr2=0x7faa18008b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:25.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:25.574+0000 7faa36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1800dca0 0x7faa18008b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:25.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:25.574+0000 7faa367fc640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 msgr2=0x7faa18006210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:25.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:25.574+0000 7faa367fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faa1800a220 0x7faa18006210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:27.035 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:55:27.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:55:27.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:55:27.094 DEBUG:teuthology.orchestra.run.smithi091:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:55:27.167 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:55:27.168 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:55:27.168 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:27.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:55:27.174 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:55:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:27.174 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:55:27.220 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:55:27.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:27.222 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:55:27.222 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:27.228 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:55:27.228 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:55:27.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:27.228 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:55:27.274 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:55:27.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:27.275 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:55:27.275 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:27.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:55:27.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:55:27.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:27.282 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:55:27.328 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:55:27.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:27.330 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:55:27.330 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:27.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:55:27.336 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:55:27.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:27.336 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:55:27.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:27.383 INFO:teuthology.orchestra.run.smithi091.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:55:27.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:55:27.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 Processor -- start 2023-11-04T01:55:27.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 -- start start 2023-11-04T01:55:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 0x7fef9c06a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef9c06a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef9c1607e0 2023-11-04T01:55:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef9c071740 2023-11-04T01:55:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa3601640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef9c071bd0 2023-11-04T01:55:27.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 msgr2=0x7fef9c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 0x7fef9c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef9c06d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef9c06a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:27.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.514+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef9c06a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.718+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 msgr2=0x7fef9c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.718+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 0x7fef9c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.718+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef9c06d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.718+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef9c06a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:27.718+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef9c06a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:28.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.122+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 msgr2=0x7fef9c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.122+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef9c06d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.122+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 0x7fef9c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.122+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef9c06a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.122+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef9c06a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:28.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.926+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef9c06d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:28.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.926+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 msgr2=0x7fef9c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:28.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.926+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 0x7fef9c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:28.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.926+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef9c06a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:28.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:28.926+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef9c06a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef9c06a670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef9c06a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 msgr2=0x7fef9c06a130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef9c071740 0x7fef9c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef9c06d670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80006160 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800036d0 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80006160 legacy=0x7fef80008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.514+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:30.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.718+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80006160 legacy=0x7fef80008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:30.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.718+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:30.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:30.718+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:31.122+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:31.122+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80006160 legacy=0x7fef80008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:31.122+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:31.926+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:31.926+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80006160 legacy=0x7fef80008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:31.926+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80006160 legacy=0x7fef80008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef9c1607e0 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef9c071bd0 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef800036d0 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.518+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:33.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:33.658 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:33.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.722+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:33.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.722+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:33.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.722+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:33.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.722+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:33.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:33.722+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.126+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.126+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.126+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.126+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.126+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:34.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.930+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.930+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.930+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.930+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:34.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:34.930+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:36.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 msgr2=0x7fef80005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:36.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef800036d0 0x7fef80005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef9c1607e0 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80008df0 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800091d0 2023-11-04T01:55:36.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:36.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:36.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.518+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80008df0 legacy=0x7fef800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.722+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.722+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:36.722+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80008df0 legacy=0x7fef800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:37.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:37.126+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:37.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:37.126+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:37.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:37.126+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80008df0 legacy=0x7fef800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:37.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:37.930+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:37.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:37.930+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:37.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:37.930+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80008df0 legacy=0x7fef800085c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80008df0 legacy=0x7fef800085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:55:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef80013090 2023-11-04T01:55:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800091d0 2023-11-04T01:55:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef9c071bd0 2023-11-04T01:55:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80015480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.517+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:39.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.721+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:39.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.721+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:39.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.721+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:39.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.721+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80015480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:39.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:39.721+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:40.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.125+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:40.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.125+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:40.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.125+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:40.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.125+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80015480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:40.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.125+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:40.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.929+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:40.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.929+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:40.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.929+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80015480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:40.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.929+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:40.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:40.929+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 msgr2=0x7fef800095e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800091d0 0x7fef800095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80015480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 0x7fef8000b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80008680 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef80005b20 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80008680 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:42.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:42.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.513+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.717+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80008680 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.717+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:42.717+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:43.121+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80008680 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:43.121+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:43.121+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:43.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:43.925+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80008680 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:43.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:43.925+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:43.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:43.925+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80005b20 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80008680 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef8000b580 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80013090 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef9c071bd0 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef80016ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.517+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.721+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef80016ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.721+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.721+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:45.721+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:46.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.125+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef80016ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:46.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.125+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:46.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.125+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:46.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.125+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:46.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.929+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef80016ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:46.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.929+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:46.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.929+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:46.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:46.929+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 msgr2=0x7fef8000a670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef9c071bd0 0x7fef8000a670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef80016ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 0x7fef8000b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 0x7fef80013470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef80009740 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000da40 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.517+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:48.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.721+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:48.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.721+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:48.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.721+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:48.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:48.721+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.125+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.125+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.125+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.125+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:49.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.929+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:49.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.929+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:49.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.929+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:49.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:49.929+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000da40 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 msgr2=0x7fef8000b040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef80009740 0x7fef8000b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000b580 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef80013090 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800139b0 2023-11-04T01:55:51.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:51.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:51.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:51.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.517+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:51.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.721+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:51.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.721+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:51.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.721+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:51.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:51.721+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:52.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.125+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:52.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.125+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:52.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.125+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:52.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.125+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:52.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.929+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:52.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.929+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:55:52.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.929+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:52.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:52.929+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b580 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 0x7fef80013470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 0x7fef80012090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000a670 2023-11-04T01:55:54.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000b000 2023-11-04T01:55:54.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 msgr2=0x7fef80012090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:54.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:54.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 0x7fef80012090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:54.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.517+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:54.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.721+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:54.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.721+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 msgr2=0x7fef80012090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:54.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.721+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:54.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:54.721+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 0x7fef80012090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:55.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.125+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:55.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.125+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 msgr2=0x7fef80012090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:55.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.125+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:55.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.125+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 0x7fef80012090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.929+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:55.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.929+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 msgr2=0x7fef80012090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:55:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.929+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:55.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:55.929+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 0x7fef80012090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:57.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 msgr2=0x7fef80012090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b000 0x7fef80012090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000a670 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef800125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80013090 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800139b0 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000fa50 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:57.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:57.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef800125d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:57.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef800125d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:57.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.521+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.725+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.725+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.725+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef800125d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.725+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:57.725+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef800125d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.129+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.129+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:58.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.129+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef800125d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:58.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.129+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:58.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.129+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef800125d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.933+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:55:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.933+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.933+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:55:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.933+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef800125d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:55:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:55:58.933+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef800125d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef800125d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef800125d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef80013090 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000b000 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef80012090 2023-11-04T01:56:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b000 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.521+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.725+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b000 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.725+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:00.725+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:01.129+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b000 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:01.129+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:01.129+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:01.933+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b000 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:01.933+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:01.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:01.933+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b000 legacy=0x7fef800163b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800139b0 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000fa50 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8000d520 con 0x7fef80012090 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.521+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:03.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:03.720 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.725+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.725+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.725+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.725+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.725+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:03.725+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.129+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.129+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.129+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.129+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:04.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.129+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:04.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.129+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.933+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.933+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.933+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.933+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.933+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:04.933+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:06.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 msgr2=0x7fef80013470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:06.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012090 0x7fef80013470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:06.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80012a50 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000b000 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80012a50 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:06.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.521+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:06.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.725+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80012a50 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:06.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:06.725+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:07.129+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80012a50 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:07.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:07.129+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:07.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:07.933+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80012a50 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:07.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:07.933+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:09.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:09.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80012a50 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:09.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:09.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:09.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:09.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef8000b000 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800139b0 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000fa50 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:09.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.521+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:09.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.725+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:09.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.725+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:09.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.725+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:09.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.725+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:09.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:09.725+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.129+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.129+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.129+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.129+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.129+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.933+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.933+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.933+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.933+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:10.933+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:12.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 msgr2=0x7fef80012510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:12.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000fa50 0x7fef80012510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:12.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 msgr2=0x7fef80015da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:12.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800139b0 0x7fef80015da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 0x7fef80012e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80013370 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef80012a50 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80013370 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 msgr2=0x7fef80012e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.521+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 0x7fef80012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.725+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80013370 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.725+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 msgr2=0x7fef80012e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:12.725+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 0x7fef80012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:13.129+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80013370 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:13.129+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 msgr2=0x7fef80012e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:13.129+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 0x7fef80012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:13.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:13.933+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80013370 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:13.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:13.933+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 msgr2=0x7fef80012e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:13.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:13.933+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 0x7fef80012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:15.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 msgr2=0x7fef80012e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:15.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80012a50 0x7fef80012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80013370 legacy=0x7fef80011080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef8000b000 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000be30 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000b510 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:15.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.521+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:15.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.725+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:15.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.725+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:15.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.725+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:15.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.725+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:15.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:15.725+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.129+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.129+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.129+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.129+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.129+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.933+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.933+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.933+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.933+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:16.933+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:18.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 0x7fef800160b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef8000fa50 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000ce90 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 msgr2=0x7fef800160b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000fa50 legacy=0x7fef8000c780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:18.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.521+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 0x7fef800160b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:18.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.725+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000fa50 legacy=0x7fef8000c780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:18.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.725+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 msgr2=0x7fef800160b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:18.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:18.725+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 0x7fef800160b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:19.129+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000fa50 legacy=0x7fef8000c780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:19.129+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 msgr2=0x7fef800160b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:19.129+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 0x7fef800160b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:19.933+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000fa50 legacy=0x7fef8000c780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:19.933+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 msgr2=0x7fef800160b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:19.933+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 0x7fef800160b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:21.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 msgr2=0x7fef800160b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:21.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000ce90 0x7fef800160b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:21.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000fa50 legacy=0x7fef8000c780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef800165f0 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000be30 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000b510 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800189e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.521+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:21.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.725+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800189e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:21.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.725+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:21.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.725+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.725+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:21.725+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.129+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800189e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.129+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.129+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.129+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:22.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.129+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:22.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.933+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800189e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:22.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.933+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:22.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.933+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:22.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.933+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:22.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:22.933+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:24.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800189e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef8000b000 2023-11-04T01:56:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c780 2023-11-04T01:56:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.521+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.725+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.725+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:24.725+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:25.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:25.129+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:25.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:25.129+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:25.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:25.129+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:25.933+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:25.933+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:25.933+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef800165f0 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c780 2023-11-04T01:56:27.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000be30 2023-11-04T01:56:27.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:27.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:27.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:27.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:27.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.521+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.725+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.725+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.725+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.725+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:27.725+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:28.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.129+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:28.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.129+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:28.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.129+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:28.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.129+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:28.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.129+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:28.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.933+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:28.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.933+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800150a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.933+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.933+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:28.933+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef800165f0 legacy=0x7fef800150a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef8000b000 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000b510 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.525+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.729+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:30.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.729+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:30.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:30.729+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:31.133+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:31.133+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:31.133+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:31.937+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:31.937+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:31.937+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:33.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000b000 legacy=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef800157b0 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c780 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000b510 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:33.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:33.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:33.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.521+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:33.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.725+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:33.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.725+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:33.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.725+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:33.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.725+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:33.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:33.725+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:33.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:33.805 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.129+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.129+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.129+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.129+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.129+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.933+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.933+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.933+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:34.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.933+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:34.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:34.933+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:36.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 msgr2=0x7fef8000b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000b510 0x7fef8000b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80009f40 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000be30 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009f40 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:36.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.525+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:36.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.729+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009f40 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:36.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.729+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:36.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:36.729+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:37.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:37.133+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009f40 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:37.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:37.133+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:37.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:37.133+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:37.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:37.937+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009f40 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:37.937+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:37.937+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009f40 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef800157b0 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c780 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000be30 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:39.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.525+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.729+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.729+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.729+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.729+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:39.729+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:40.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.133+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:40.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.133+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:40.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.133+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:40.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.133+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:40.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.133+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.937+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.937+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.937+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.937+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:40.937+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 msgr2=0x7fef8000c240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000be30 0x7fef8000c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:42.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 msgr2=0x7fef8000cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c780 0x7fef8000cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800157b0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 0x7fef80010070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef8000b510 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef80009f40 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b510 legacy=0x7fef800162a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 msgr2=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:42.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.525+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 0x7fef80010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.729+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b510 legacy=0x7fef800162a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.729+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 msgr2=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:42.729+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 0x7fef80010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:43.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:43.133+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b510 legacy=0x7fef800162a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:43.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:43.133+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 msgr2=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:43.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:43.133+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 0x7fef80010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:43.937+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b510 legacy=0x7fef800162a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:43.937+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 msgr2=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:43.937+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 0x7fef80010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 msgr2=0x7fef80010070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80009f40 0x7fef80010070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000b510 legacy=0x7fef800162a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef8000c240 2023-11-04T01:56:45.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000cba0 2023-11-04T01:56:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000c680 2023-11-04T01:56:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.525+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:45.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.729+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:45.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.729+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:45.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.729+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:45.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.729+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:45.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:45.729+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:46.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.133+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:46.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.133+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:46.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.133+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:46.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.133+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:46.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.133+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.937+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.937+0000 7fefa1b9e640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.937+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.937+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:46.937+0000 7fefa1b9e640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:48.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:48.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:48.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:48.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:48.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:48.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:48.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef800075c0 2023-11-04T01:56:48.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800080b0 2023-11-04T01:56:48.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:48.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:48.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.525+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:48.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.729+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:48.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.729+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:48.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:48.729+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:49.133+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:49.133+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:49.133+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:49.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:49.937+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:49.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:49.937+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:49.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:49.937+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:51.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:51.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:51.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef8000c240 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000cba0 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000c680 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:51.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.525+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:51.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.729+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:51.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.729+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:51.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.729+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:51.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.729+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:51.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:51.729+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:52.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.133+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:52.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.133+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:52.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.133+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:52.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.133+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:52.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.133+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.937+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:56:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.937+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.937+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:52.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.937+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:52.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:52.937+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c240 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef800075c0 2023-11-04T01:56:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800080b0 2023-11-04T01:56:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.525+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.729+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.729+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:54.729+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:55.133+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:55.133+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:55.133+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:55.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:55.937+0000 7fefa0b9c640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:55.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:55.937+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:55.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:55.937+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 msgr2=0x7fef800170b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800080b0 0x7fef800170b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800075c0 legacy=0x7fef800079a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:57.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.524+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c210 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000cba0 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8000d520 con 0x7fef8000c680 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.528+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:57.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.732+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:57.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.732+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:57.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.732+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:57.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.732+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:57.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:57.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:57.732+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:58.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.136+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:58.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.136+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.136+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.136+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.136+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.940+0000 7fefa1b9e640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:56:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.940+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.940+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:56:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.940+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:56:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.940+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:56:58.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c680 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef80009ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000cba0 0x7fef80009ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef80007cd0 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef8000d000 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80007cd0 legacy=0x7fef800160a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.528+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000d000 legacy=0x7fef800065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.732+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80007cd0 legacy=0x7fef800160a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:00.732+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000d000 legacy=0x7fef800065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:01.136+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80007cd0 legacy=0x7fef800160a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:01.136+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000d000 legacy=0x7fef800065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:01.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:01.940+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80007cd0 legacy=0x7fef800160a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:01.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:01.940+0000 7fefa139d640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000d000 legacy=0x7fef800065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000d000 legacy=0x7fef800065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80007cd0 legacy=0x7fef800160a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef80009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000c610 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c210 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000cba0 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.528+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:03.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.732+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:03.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.732+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:03.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:03.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.732+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:03.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:03.732+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:03.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:03.855 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:04.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.136+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:04.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.136+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:04.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:04.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.136+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:04.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.136+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.940+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.940+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.940+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:04.940+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:06.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef8000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef800137a0 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000d000 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:06.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.732+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:06.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.732+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:06.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:06.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:07.136+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:07.136+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:07.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:07.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:07.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:07.940+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:07.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:07.940+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:07.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:07.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000c610 2023-11-04T01:57:09.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cdce0 con 0x7fef800137a0 2023-11-04T01:57:09.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000cba0 2023-11-04T01:57:09.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:09.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:09.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:09.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.528+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:09.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.732+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:09.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.732+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:09.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.732+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:09.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:09.732+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:10.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.136+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:10.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.136+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:10.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.136+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:10.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.136+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.940+0000 7fefa0b9c640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.940+0000 7fefa1b9e640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:10.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.940+0000 7fefa139d640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:10.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:10.940+0000 7fefa139d640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:12.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 msgr2=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:12.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000cba0 0x7fef8000b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:12.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80015b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000c610 legacy=0x7fef80010070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c210 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000d000 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:12.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.528+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.732+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.732+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:12.732+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:13.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.136+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:13.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:13.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.136+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:13.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.136+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.940+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:13.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.940+0000 7fefa0b9c640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:13.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:13.940+0000 7fefa0b9c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 msgr2=0x7fef8000ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000c210 0x7fef8000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 0x7fef800196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef800137a0 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef800172b0 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef8000d000 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 msgr2=0x7fef800196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 0x7fef800196a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80013b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:15.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.528+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:15.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.732+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 msgr2=0x7fef800196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:15.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 0x7fef800196a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.732+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80013b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.732+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:15.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:15.732+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.136+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 msgr2=0x7fef800196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 0x7fef800196a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.136+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80013b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:16.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.136+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:16.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.136+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.940+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 msgr2=0x7fef800196a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 0x7fef800196a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.940+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80013b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.940+0000 7fefa1b9e640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:16.940+0000 7fefa1b9e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:18.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 msgr2=0x7fef80009e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:18.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef8000d000 0x7fef80009e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:18.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 msgr2=0x7fef800196a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:18.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef800172b0 0x7fef800196a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef800137a0 legacy=0x7fef80013b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 0x7fef800075a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000cba0 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000c610 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000cba0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 msgr2=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:18.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.528+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 0x7fef800075a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:18.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.732+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000cba0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:18.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.732+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 msgr2=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:18.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:18.732+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 0x7fef800075a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:19.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:19.136+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000cba0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:19.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:19.136+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 msgr2=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:19.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:19.136+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 0x7fef800075a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:19.940+0000 7fefa139d640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000cba0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:19.940+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 msgr2=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:19.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:19.940+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 0x7fef800075a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:21.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 msgr2=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:21.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef8000c610 0x7fef800075a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef8000cba0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fefa1b9e640 1 -- reap_dead start 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 0x7fef8000cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c071220 con 0x7fef80009e90 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800095b0 con 0x7fef8000c5f0 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef8000cba0 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef8000cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 0x7fef8000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009e90 legacy=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:21.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.528+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000c5f0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:21.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.732+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009e90 legacy=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:21.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.732+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef8000cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:21.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 0x7fef8000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:21.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:21.732+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000c5f0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.136+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009e90 legacy=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.136+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef8000cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 0x7fef8000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:22.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.136+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000c5f0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.940+0000 7fefa1b9e640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009e90 legacy=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.940+0000 7fefa139d640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef8000cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 0x7fef8000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:22.940+0000 7fefa0b9c640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000c5f0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 msgr2=0x7fef8000cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef8000cba0 0x7fef8000cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fef8000c5f0 legacy=0x7fef8000b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7fef80009e90 legacy=0x7fef800075a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 0x7fef800080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 0x7fef80017450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c070c60 con 0x7fef80007cb0 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fef92ffd640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c070f40 con 0x7fef80015060 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 msgr2=0x7fef800080c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 msgr2=0x7fef80017450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 0x7fef800080c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.528+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 0x7fef80017450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.732+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 msgr2=0x7fef800080c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.732+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 msgr2=0x7fef80017450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.732+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 0x7fef800080c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:24.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:24.732+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 0x7fef80017450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.136+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 msgr2=0x7fef800080c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.136+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 msgr2=0x7fef80017450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.136+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 0x7fef800080c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.136+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 0x7fef80017450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:25.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.940+0000 7fefa0b9c640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 msgr2=0x7fef80017450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:25.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.940+0000 7fefa139d640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 msgr2=0x7fef800080c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:25.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.940+0000 7fefa0b9c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7fef80015060 0x7fef80017450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:25.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:25.940+0000 7fefa139d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef80007cb0 0x7fef800080c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:27.403 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:57:27.406 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-04T01:57:27.406 INFO:tasks.cephfs_test_runner:ERROR 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:57:27.407 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:27.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:27.409 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:27.410 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner:Ran 5 tests in 1015.299s 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.411 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:57:27.413 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:27.414 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:27.415 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:27.416 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:27.417 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:27.417 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:27.480 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=65d6873a2bb84cf3aa4f3e0cc5110e38 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:27.482 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-04T01:57:27.491 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T01:57:27.512 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T01:57:27.513 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:57:27.513 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:27.526 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:57:27.526 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-11-04T01:57:27.526 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:27.573 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16796 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:57:27.573 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:57:27.573 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:27.579 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:57:27.580 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-11-04T01:57:27.580 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:27.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:57:27.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.628 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-11-04T01:57:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:57:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:57:27.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:57:27.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:57:27.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-11-04T01:57:27.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.926 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-11-04T01:57:27.932 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-04T01:57:27.932 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:57:27.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.933 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:57:27.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:27.989 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:57:28.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:28.060 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-11-04T01:57:28.229 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T01:57:28.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:57:28.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:57:28.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 Processor -- start 2023-11-04T01:57:28.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 -- start start 2023-11-04T01:57:28.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 0x7ff4940ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:28.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 0x7ff49415b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:28.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff49415b9c0 2023-11-04T01:57:28.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff4940b27d0 2023-11-04T01:57:28.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49c79c640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff4940b5ef0 2023-11-04T01:57:28.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff49415b9c0 legacy=0x7ff49415ef50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:28.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 msgr2=0x7ff49415b480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:28.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 msgr2=0x7ff4940ce130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:28.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 0x7ff49415b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:28.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.372+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 0x7ff4940ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.576+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff49415b9c0 legacy=0x7ff49415ef50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.576+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 msgr2=0x7ff4940ce130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.576+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 msgr2=0x7ff49415b480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.576+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 0x7ff4940ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.576+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 0x7ff49415b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:28.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.980+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff49415b9c0 legacy=0x7ff49415ef50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:28.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.980+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 msgr2=0x7ff49415b480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:28.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.980+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 msgr2=0x7ff4940ce130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:28.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.980+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 0x7ff4940ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:28.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:28.980+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 0x7ff49415b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:29.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:29.784+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff49415b9c0 legacy=0x7ff49415ef50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:29.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:29.784+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 msgr2=0x7ff49415b480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:29.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:29.784+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 msgr2=0x7ff4940ce130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:29.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:29.784+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 0x7ff49415b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:29.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:29.784+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 0x7ff4940ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:31.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 msgr2=0x7ff4940ce130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff4940b5ef0 0x7ff4940ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 msgr2=0x7ff49415b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4940b27d0 0x7ff49415b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff49415b9c0 legacy=0x7ff49415ef50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 0x7ff478005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff4780061a0 2023-11-04T01:57:31.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff4780036d0 2023-11-04T01:57:31.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 msgr2=0x7ff478005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:31.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 0x7ff478005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:31.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.372+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780061a0 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:31.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.576+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 msgr2=0x7ff478005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:31.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.576+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 0x7ff478005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:31.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.576+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780061a0 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:31.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.980+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 msgr2=0x7ff478005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:31.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.980+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 0x7ff478005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:31.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:31.980+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780061a0 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:32.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:32.784+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 msgr2=0x7ff478005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:32.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:32.784+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 0x7ff478005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:32.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:32.784+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780061a0 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:33.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:33.969 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:34.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 msgr2=0x7ff478005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:34.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4780036d0 0x7ff478005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:34.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780061a0 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:34.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:57:34.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:34.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff47800aa90 2023-11-04T01:57:34.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff478009f00 2023-11-04T01:57:34.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478005c10 2023-11-04T01:57:34.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:34.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478009f00 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:34.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:34.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.372+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.576+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.576+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478009f00 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.576+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.576+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:34.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.980+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:34.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.980+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478009f00 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:34.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.980+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:34.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:34.980+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:35.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:35.784+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:35.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:35.784+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:35.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:35.784+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478009f00 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:35.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:35.784+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:37.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:37.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:37.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478009f00 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 0x7ff47800fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478010390 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800f8b0 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 msgr2=0x7ff47800fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.372+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 0x7ff47800fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:37.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.576+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:37.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.576+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:37.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.576+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 msgr2=0x7ff47800fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:37.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.576+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 0x7ff47800fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:37.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.980+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:37.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.980+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:37.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.980+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 msgr2=0x7ff47800fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:37.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:37.980+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 0x7ff47800fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:38.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:38.784+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:38.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:38.784+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:38.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:38.784+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 msgr2=0x7ff47800fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:38.784+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 0x7ff47800fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:40.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 msgr2=0x7ff47800fcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:40.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f8b0 0x7ff47800fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:40.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:40.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:40.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:57:40.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:40.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:40.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff47800aa90 2023-11-04T01:57:40.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478010390 2023-11-04T01:57:40.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff478005c10 2023-11-04T01:57:40.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:40.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:40.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:40.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:40.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.372+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.576+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.576+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.576+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.576+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:40.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.576+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.980+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.980+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:40.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.980+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.980+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:40.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:40.980+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:41.784+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:41.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:41.784+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:41.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:41.784+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:41.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:41.784+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:41.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:41.784+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478010390 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800aa90 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff47800fd40 2023-11-04T01:57:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800ee20 2023-11-04T01:57:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800fd40 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.376+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:43.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.580+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:43.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.580+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800fd40 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:43.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.580+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.984+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.984+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800fd40 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:43.984+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:44.788+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:44.788+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800fd40 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:44.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:44.788+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:46.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800fd40 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478014bf0 2023-11-04T01:57:46.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800ee20 2023-11-04T01:57:46.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff478005c10 2023-11-04T01:57:46.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014bf0 legacy=0x7ff478014ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:46.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:46.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:46.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:46.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.376+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.580+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014bf0 legacy=0x7ff478014ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.580+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.580+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.580+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.580+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.984+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.984+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014bf0 legacy=0x7ff478014ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.984+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.984+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:46.984+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:47.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:47.788+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:47.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:47.788+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014bf0 legacy=0x7ff478014ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:47.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:47.788+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:47.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:47.788+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:47.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:47.788+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478005c10 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800f230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800ee20 0x7ff47800f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014bf0 legacy=0x7ff478014ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:49.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 0x7ff47800e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff478010390 2023-11-04T01:57:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800a9f0 2023-11-04T01:57:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478010390 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:49.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.376+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:49.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.580+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.580+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478010390 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.580+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:49.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.984+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478010390 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:49.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.984+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:49.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:49.984+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:50.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:50.788+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:50.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:50.788+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478010390 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:50.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:50.788+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:52.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 msgr2=0x7ff47800e0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:52.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a9f0 0x7ff47800e0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:52.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478010390 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:52.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:57:52.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:52.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 0x7ff47800f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:52.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478008660 2023-11-04T01:57:52.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800ee20 2023-11-04T01:57:52.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff478014b50 2023-11-04T01:57:52.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:52.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:52.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 msgr2=0x7ff47800f200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.376+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 0x7ff47800f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.580+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.580+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.580+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.580+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 msgr2=0x7ff47800f200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.580+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 0x7ff47800f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:52.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.984+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:52.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.984+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:52.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.984+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:52.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.984+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 msgr2=0x7ff47800f200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:52.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:52.984+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 0x7ff47800f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:53.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:53.788+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:53.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:53.788+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:53.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:53.788+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:53.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:53.788+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 msgr2=0x7ff47800f200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:57:53.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:53.788+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 0x7ff47800f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:55.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 msgr2=0x7ff47800f200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478014b50 0x7ff47800f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 0x7ff478009150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff478014ff0 2023-11-04T01:57:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800a9f0 2023-11-04T01:57:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014ff0 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.376+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.580+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.580+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014ff0 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.580+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:55.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.984+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:55.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.984+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014ff0 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:55.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:55.984+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:56.788+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:57:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:56.788+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014ff0 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:56.788+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:58.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:58.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a9f0 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478014ff0 legacy=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478008660 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff478005b10 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800ee20 2023-11-04T01:57:58.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:58.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:58.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:58.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.376+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:58.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.580+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:58.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.580+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:58.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.580+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:58.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.580+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:58.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.984+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:58.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.984+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:58.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.984+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:58.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:58.984+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:57:59.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:59.788+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:57:59.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:59.788+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:57:59.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:59.788+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:59.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:57:59.788+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:01.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:01.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:01.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:01.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478008660 legacy=0x7ff478008a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 0x7ff478009150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800f200 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff478014b50 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:01.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:01.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.376+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.580+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.580+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:01.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.580+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:01.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.580+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:01.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.984+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:01.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.984+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:01.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.984+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:01.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:01.984+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:02.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:02.788+0000 7ff499d37640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:02.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:02.788+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:02.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:02.788+0000 7ff499d37640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:02.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:02.788+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:04.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:04.023 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:04.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 msgr2=0x7ff478009150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:04.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478014b50 0x7ff478009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff47800d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff478005b10 2023-11-04T01:58:04.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800f200 2023-11-04T01:58:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a820 2023-11-04T01:58:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:04.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.376+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.580+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.580+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.580+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.580+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.580+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.984+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.984+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.984+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.984+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:04.984+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:05.788+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:05.788+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:05.788+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:05.788+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:05.788+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478009150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478009860 2023-11-04T01:58:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800ee20 2023-11-04T01:58:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.376+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:07.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.580+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:07.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.580+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:07.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.580+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:07.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.984+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:07.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.984+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:07.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:07.984+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:08.788+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:08.788+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:08.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:08.788+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:10.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:10.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800ee20 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:10.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:10.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff478009860 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478005b10 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800f200 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478008d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:10.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:10.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.376+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:10.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.580+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:10.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.580+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478008d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:10.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.580+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:10.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.580+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.984+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.984+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478008d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.984+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:10.984+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:11.788+0000 7ff49ad39640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:11.788+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478008d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:11.788+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:11.788+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800f200 0x7ff47800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478005b10 legacy=0x7ff478008d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009860 legacy=0x7ff478008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 0x7ff47800e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 0x7ff47800d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800edf0 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff478009480 2023-11-04T01:58:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.376+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:13.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.580+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:13.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.580+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.580+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:13.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.580+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:13.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.984+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:13.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.984+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:13.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.984+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:13.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:13.984+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:14.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:14.788+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:14.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:14.788+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:14.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:14.788+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:14.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:14.788+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 msgr2=0x7ff47800e780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478009480 0x7ff47800e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 msgr2=0x7ff47800d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800edf0 0x7ff47800d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff47800f200 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800a820 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a2e0 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.380+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.584+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.584+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.584+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.584+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:16.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.584+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:16.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.988+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:16.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.988+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:16.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.988+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.988+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:16.988+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:17.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:17.792+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:17.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:17.792+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:17.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:17.792+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:17.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:17.792+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:17.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:17.792+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:19.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:19.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:19.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:19.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:19.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:19.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:19.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800b600 2023-11-04T01:58:19.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478003b00 2023-11-04T01:58:19.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:19.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:19.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.380+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:19.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.584+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:19.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.584+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:19.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.584+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.987+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.987+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:19.987+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:20.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:20.791+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:20.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:20.791+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:20.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:20.791+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff47800f200 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800b600 2023-11-04T01:58:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800a2e0 2023-11-04T01:58:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.379+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.583+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.583+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.583+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.583+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.987+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.987+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.987+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:22.987+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:23.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:23.791+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:23.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:23.791+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:23.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:23.791+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:23.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:23.791+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:25.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:25.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800a2e0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:25.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800b600 legacy=0x7ff47800d9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:25.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:25.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:25.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:25.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478003b00 2023-11-04T01:58:25.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a820 2023-11-04T01:58:25.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:25.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:25.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:25.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.379+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:25.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.583+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:25.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.583+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:25.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.583+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:25.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.583+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.987+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.987+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.987+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:25.987+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:26.791+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:26.791+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:26.791+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:26.791+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:28.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:28.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:28.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:28.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478003b00 0x7ff47800b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:28.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff47800f200 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478003b00 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a820 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:28.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:28.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:28.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:28.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.379+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.583+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.583+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.583+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.583+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.583+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:28.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.987+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:28.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.987+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:28.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.987+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:28.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.987+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:28.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:28.987+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:29.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:29.791+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:29.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:29.791+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:29.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:29.791+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:29.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:29.791+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:29.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:29.791+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:31.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:31.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478018c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800f200 legacy=0x7ff478019190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 0x7ff478008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff47800a2e0 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800c7e0 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 msgr2=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 0x7ff478008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.379+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800a2e0 legacy=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.583+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 msgr2=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.583+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 0x7ff478008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:31.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.583+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800a2e0 legacy=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:31.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.987+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 msgr2=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:31.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.987+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 0x7ff478008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:31.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:31.987+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800a2e0 legacy=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:32.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:32.791+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 msgr2=0x7ff478008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:32.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:32.791+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 0x7ff478008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:32.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:32.791+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800a2e0 legacy=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:34.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:34.143 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 msgr2=0x7ff478008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800c7e0 0x7ff478008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800a2e0 legacy=0x7ff47800b0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478009690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478008ba0 2023-11-04T01:58:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478003b00 2023-11-04T01:58:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a820 2023-11-04T01:58:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.379+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.583+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.583+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.583+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:34.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.583+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:34.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.583+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:34.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.987+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:34.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.987+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:34.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.987+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:34.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.987+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:34.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:34.987+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:35.791+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:35.791+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:35.791+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:35.791+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:35.791+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a820 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 0x7ff47800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff47800e160 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800f200 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e160 legacy=0x7ff47800b080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.379+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 0x7ff47800dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.583+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e160 legacy=0x7ff47800b080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.583+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.583+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 0x7ff47800dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:37.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.987+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e160 legacy=0x7ff47800b080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:37.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.987+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:37.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:37.987+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 0x7ff47800dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:38.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:38.791+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e160 legacy=0x7ff47800b080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:38.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:38.791+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:38.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:38.791+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 0x7ff47800dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:40.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 msgr2=0x7ff47800dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:40.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47800f200 0x7ff47800dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e160 legacy=0x7ff47800b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff478019360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff47800c7a0 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff478008ba0 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff478019360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:40.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff478017c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff478019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:40.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.379+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.583+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff478019360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.583+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff478017c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.583+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff478019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.583+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.987+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff478019360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.987+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff478017c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.987+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff478019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:40.987+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:41.791+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff478019360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:41.791+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff478017c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:41.791+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff478019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:41.791+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:43.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff478019360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff478019360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478008ba0 legacy=0x7ff478008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff478017c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff478009690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478003b00 2023-11-04T01:58:43.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a780 2023-11-04T01:58:43.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:43.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:43.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:43.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.379+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.583+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.583+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:43.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.583+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:43.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.583+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.987+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.987+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:43.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.987+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:43.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:43.987+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:44.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:44.791+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:44.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:44.791+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:44.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:44.791+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:44.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:44.791+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:46.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff478009690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:46.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff478009690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:46.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:46.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff478003b00 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:46.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:46.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:46.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:46.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800c7a0 2023-11-04T01:58:46.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:58:46.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800dbd0 2023-11-04T01:58:46.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff47800b5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:46.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800b060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:46.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.379+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.583+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:46.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.583+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.583+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff47800b5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.583+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800b060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.583+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.987+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff47800b5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.987+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.987+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.987+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800b060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:46.987+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:47.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:47.791+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff47800b5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:47.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:47.791+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:47.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:47.791+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:47.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:47.791+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800b060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:47.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:47.791+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800b060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:49.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800c7a0 legacy=0x7ff47800b5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff47800bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff47800c1f0 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800a780 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:49.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800c1f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.379+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:49.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.583+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800c1f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:49.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.583+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:49.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.583+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:49.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.987+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800c1f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:49.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.987+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:49.987+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:50.791+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800c1f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:50.791+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:50.791+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a780 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800c1f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 0x7ff478008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:58:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800dbd0 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780155e0 con 0x7ff478019360 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:52.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.383+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.587+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.587+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.587+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.587+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.587+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.587+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:52.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.991+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:52.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.991+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:52.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.991+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:52.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.991+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:52.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.991+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:52.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:52.991+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:53.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:53.795+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:53.795+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:53.795+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:53.795+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:58:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:53.795+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:53.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:53.795+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff478019360 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff47800bcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff47800bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800a760 2023-11-04T01:58:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478010900 con 0x7ff478019740 2023-11-04T01:58:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800a760 legacy=0x7ff47800c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.383+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478019740 legacy=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.587+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800a760 legacy=0x7ff47800c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.587+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478019740 legacy=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:55.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.991+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800a760 legacy=0x7ff47800c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:55.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:55.991+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478019740 legacy=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:56.795+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800a760 legacy=0x7ff47800c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:58:56.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:56.795+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478019740 legacy=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff478019740 legacy=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800a760 legacy=0x7ff47800c1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:58:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:58.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff4780097f0 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800dbd0 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:58.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.383+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:58.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.587+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:58.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.587+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:58.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.587+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:58.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.587+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:58.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.587+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.991+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:58.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.991+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:58.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.991+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:58.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.991+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:58.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:58.991+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:59.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:59.795+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:58:59.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:59.795+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:59.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:59.795+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:58:59.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:59.795+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:58:59.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:58:59.795+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dbd0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff478018c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff478019360 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800a760 2023-11-04T01:59:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478019360 legacy=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.383+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:01.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.587+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478019360 legacy=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:01.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.587+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:01.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.587+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.991+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478019360 legacy=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.991+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:01.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:01.991+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:02.795+0000 7ff49a538640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478019360 legacy=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:02.795+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:02.795+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:04.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:04.196 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478019360 legacy=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:59:04.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff4780097f0 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a760 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:04.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:04.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.383+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.587+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.587+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.587+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.587+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.587+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:04.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.991+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:04.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.991+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:04.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.991+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:04.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.991+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:04.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:04.991+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:05.795+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:05.795+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:05.795+0000 7ff49ad39640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:05.795+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:05.795+0000 7ff49ad39640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 0x7ff47800cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800d9e0 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800e750 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d9e0 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 msgr2=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.383+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 0x7ff47800cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.587+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d9e0 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.587+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 msgr2=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.587+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 0x7ff47800cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.991+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d9e0 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.991+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 msgr2=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:07.991+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 0x7ff47800cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:08.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:08.795+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d9e0 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:08.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:08.795+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 msgr2=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:08.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:08.795+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 0x7ff47800cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:10.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 msgr2=0x7ff47800cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800e750 0x7ff47800cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d9e0 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff4780097f0 2023-11-04T01:59:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:59:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a760 2023-11-04T01:59:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.383+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:10.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.587+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:10.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.587+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:10.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.587+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:10.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.587+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.587+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.991+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.991+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:10.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.991+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:10.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.991+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:10.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:10.991+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:11.795+0000 7ff49ad39640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:11.795+0000 7ff49ad39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:11.795+0000 7ff499d37640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:11.795+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:11.795+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800d100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 0x7ff47800e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:13.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800d810 2023-11-04T01:59:13.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800cbc0 2023-11-04T01:59:13.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d810 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:13.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:13.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.383+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.587+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d810 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.587+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.587+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:13.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.991+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d810 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:13.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.991+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:13.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:13.991+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:14.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:14.795+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d810 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:14.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:14.795+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:14.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:14.795+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 msgr2=0x7ff47800e750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800cbc0 0x7ff47800e750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800d810 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff4780097f0 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800a760 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800cfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.383+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.587+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.587+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.587+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800cfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.587+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.587+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.991+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.991+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.991+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800cfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.991+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:16.991+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:17.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:17.795+0000 7ff49a538640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:17.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:17.795+0000 7ff49a538640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:17.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:17.795+0000 7ff49ad39640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800cfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:17.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:17.795+0000 7ff499d37640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:17.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:17.795+0000 7ff499d37640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff4780097f0 legacy=0x7ff47800cfa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800e750 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff47800dc50 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e750 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:19.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.383+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:19.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.587+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e750 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:19.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.587+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:19.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.587+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.991+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e750 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.991+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:19.991+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:20.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:20.795+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e750 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:20.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:20.795+0000 7ff49a538640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:20.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:20.795+0000 7ff49a538640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff47800e750 legacy=0x7ff478018c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff49ad39640 1 -- reap_dead start 2023-11-04T01:59:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2c90 con 0x7ff478008660 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940b2f70 con 0x7ff47800dc50 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff48bfff640 1 -- --> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780155e0 con 0x7ff47800a760 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:22.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:22.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.383+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:22.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.587+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:22.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.587+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:22.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.587+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:22.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.587+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.587+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.587+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:22.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.991+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:22.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.991+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:22.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.991+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.991+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.991+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:22.991+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:23.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:23.795+0000 7ff499d37640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.40:3300/0 2023-11-04T01:59:23.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:23.795+0000 7ff499d37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:23.795+0000 7ff49ad39640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-11-04T01:59:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:23.795+0000 7ff49a538640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3301/0 2023-11-04T01:59:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:23.795+0000 7ff49ad39640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:23.795+0000 7ff49a538640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:25.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 -- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 msgr2=0x7ff478008ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:25.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 --2- >> [v2:172.21.15.91:3301/0,v1:172.21.15.91:6790/0] conn(0x7ff47800a760 0x7ff478008ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:25.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 msgr2=0x7ff47800d6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:25.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff47800dc50 0x7ff47800d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:25.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 -- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 msgr2=0x7ff4780090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:25.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff478008660 0x7ff4780090e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:25.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49415ea70 con 0x7ff478009620 2023-11-04T01:59:25.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff48bfff640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b3250 con 0x7ff47800e750 2023-11-04T01:59:25.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009620 legacy=0x7ff4780162b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:25.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.387+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800e750 legacy=0x7ff478015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.591+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009620 legacy=0x7ff4780162b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:25.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.591+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800e750 legacy=0x7ff478015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:25.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.995+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009620 legacy=0x7ff4780162b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:25.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:25.995+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800e750 legacy=0x7ff478015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:26.799+0000 7ff499d37640 1 -- >> v1:172.21.15.40:6789/0 conn(0x7ff478009620 legacy=0x7ff4780162b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.40:6789/0 2023-11-04T01:59:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-11-04T01:59:26.799+0000 7ff49a538640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7ff47800e750 legacy=0x7ff478015ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-11-04T01:59:28.262 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:59:28.262 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:28.274 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T01:59:28.274 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:59:28.275 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:28.277 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:59:28.287 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:59:28.287 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:59:28.287 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.287 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:59:28.288 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:59:28.288 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.288 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:59:28.288 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:59:28.288 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.288 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:59:28.289 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T01:59:28.289 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T01:59:28.289 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.289 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T01:59:28.289 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T01:59:28.289 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.290 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T01:59:28.290 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T01:59:28.290 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.290 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T01:59:28.290 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T01:59:28.290 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.291 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T01:59:28.291 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-04T01:59:28.291 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.291 INFO:tasks.ceph.osd.4:Stopped 2023-11-04T01:59:28.291 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-04T01:59:28.291 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.291 INFO:tasks.ceph.osd.5:Stopped 2023-11-04T01:59:28.292 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-04T01:59:28.292 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.292 INFO:tasks.ceph.osd.6:Stopped 2023-11-04T01:59:28.292 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-04T01:59:28.292 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.292 INFO:tasks.ceph.osd.7:Stopped 2023-11-04T01:59:28.293 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T01:59:28.293 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T01:59:28.293 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:28.293 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-11-04T01:59:28.303 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T01:59:28.304 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T01:59:28.304 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.304 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T01:59:28.304 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T01:59:28.304 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T01:59:28.304 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.305 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T01:59:28.305 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T01:59:28.305 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.305 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T01:59:28.305 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T01:59:28.305 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:28.306 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T01:59:28.306 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T01:59:28.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-04T01:59:28.327 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:59:28.327 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T01:59:28.498 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:59:28.498 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T01:59:28.797 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:59:28.798 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T01:59:28.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:59:28.947 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T01:59:29.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:59:29.114 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-04T01:59:29.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:59:29.225 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-04T01:59:29.384 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:59:29.385 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-04T01:59:29.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:59:29.544 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-04T01:59:29.735 INFO:tasks.ceph:Archiving mon data... 2023-11-04T01:59:29.737 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/data/mon.a.tgz 2023-11-04T01:59:29.737 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-11-04T01:59:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.1BLgRObgZ7 2023-11-04T01:59:29.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1BLgRObgZ7 2023-11-04T01:59:29.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.1BLgRObgZ7 2023-11-04T01:59:29.945 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.1BLgRObgZ7 is 384KB 2023-11-04T01:59:30.006 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.1BLgRObgZ7 2023-11-04T01:59:30.011 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/data/mon.b.tgz 2023-11-04T01:59:30.011 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-04T01:59:30.017 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.Q9WWxzs4Yy 2023-11-04T01:59:30.017 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Q9WWxzs4Yy 2023-11-04T01:59:30.152 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.Q9WWxzs4Yy 2023-11-04T01:59:30.216 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.Q9WWxzs4Yy is 385KB 2023-11-04T01:59:30.278 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.Q9WWxzs4Yy 2023-11-04T01:59:30.283 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/data/mon.c.tgz 2023-11-04T01:59:30.283 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-11-04T01:59:30.332 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.ec9PUVHxpr 2023-11-04T01:59:30.332 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ec9PUVHxpr 2023-11-04T01:59:30.471 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.ec9PUVHxpr 2023-11-04T01:59:30.536 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.ec9PUVHxpr is 385KB 2023-11-04T01:59:30.598 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.ec9PUVHxpr 2023-11-04T01:59:30.603 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T01:59:30.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:59:30.605 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:59:30.663 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T01:59:30.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:59:30.666 DEBUG:teuthology.orchestra.run.smithi091:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:59:30.693 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:59:30.735 INFO:teuthology.orchestra.run.smithi091.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:59:30.740 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T01:59:30.741 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/remote/smithi040/crash 2023-11-04T01:59:30.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:59:30.823 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/remote/smithi091/crash 2023-11-04T01:59:30.824 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:59:30.868 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T01:59:30.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:30.871 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:30.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:30.964 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:30.975 INFO:tasks.ceph:Compressing logs... 2023-11-04T01:59:30.976 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:59:31.009 DEBUG:teuthology.orchestra.run.smithi091:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:59:31.021 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50893.log 2023-11-04T01:59:31.022 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44935.log 2023-11-04T01:59:31.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53118.log 2023-11-04T01:59:31.024 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50893.log.gz 2023-11-04T01:59:31.024 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44097.log 2023-11-04T01:59:31.024 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44935.log.gz 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53535.log 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53118.log.gz 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52153.log 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53535.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44097.log.gz 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60674.log 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53535.log.gz 2023-11-04T01:59:31.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51814.log 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60674.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52153.log.gz 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60244.log 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51814.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60674.log.gz 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51814.log.gz 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56611.log 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52655.log 2023-11-04T01:59:31.029 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60244.log.gz 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43901.log 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53066.log 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52655.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56611.log.gz 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38247.log 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53066.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43901.log.gz 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60453.log 2023-11-04T01:59:31.030 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53066.log.gz 2023-11-04T01:59:31.031 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52655.log.gz/var/log/ceph/ceph-client.admin.38247.log: 2023-11-04T01:59:31.031 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51310.log 2023-11-04T01:59:31.031 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38247.log.gz 2023-11-04T01:59:31.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 2023-11-04T01:59:31.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51310.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60453.log.gz 2023-11-04T01:59:31.031 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:59:31.040 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38237.log 2023-11-04T01:59:31.040 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38189.log 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38237.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38237.log.gz 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr:gzip/var/log/ceph/ceph-client.admin.38189.log: -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38189.log.gz 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr:gzip/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38333.log 2023-11-04T01:59:31.041 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38309.log 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38333.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38309.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38333.log.gz 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38309.log.gz 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38213.log 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-04T01:59:31.042 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr: 87.1%/var/log/ceph/ceph-mon.c.log: -- replaced with /var/log/ceph/ceph-client.admin.38213.log.gz 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38357.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.audit.log: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38285.log 2023-11-04T01:59:31.043 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-04T01:59:31.047 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38285.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38285.log.gz 2023-11-04T01:59:31.047 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-04T01:59:31.047 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:59:31.047 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-04T01:59:31.058 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43893.log 2023-11-04T01:59:31.070 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44003.log 2023-11-04T01:59:31.070 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.1.43893.log: 90.6% -- replaced with /var/log/ceph/ceph-client.1.43893.log.gz 2023-11-04T01:59:31.083 INFO:teuthology.orchestra.run.smithi091.stderr: 91.7%/var/log/ceph/ceph-client.3.44003.log: 91.1% -- replaced with /var/log/ceph/ceph-client.3.44003.log.gz 2023-11-04T01:59:31.083 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-04T01:59:31.087 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51310.log.gz 2023-11-04T01:59:31.087 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51710.log 2023-11-04T01:59:31.087 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.y.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2023-11-04T01:59:31.087 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45928.log 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52865.log 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45928.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51710.log.gz 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57880.log 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45928.log.gz 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58869.log 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52839.log 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52865.log.gz 2023-11-04T01:59:31.088 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54292.log 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58869.log.gz 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52839.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57880.log.gzgzip 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52839.log.gz 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54292.log.gz 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60499.log 2023-11-04T01:59:31.089 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50572.log 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60499.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55290.log 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60499.log.gz 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5/var/log/ceph/ceph-client.admin.50572.log: --verbose -- /var/log/ceph/ceph-client.admin.55486.log 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53928.log 2023-11-04T01:59:31.090 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50572.log.gz 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55486.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55290.log.gz 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43927.log 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55486.log.gz 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52046.log 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53928.log: gzip -5/var/log/ceph/ceph-client.admin.43927.log: --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53928.log.gz 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52046.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43927.log.gz 2023-11-04T01:59:31.091 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60525.log 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52046.log.gz 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53483.log 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58765.log 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53483.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60525.log.gz 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53983.log 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53483.log.gz 2023-11-04T01:59:31.092 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.53983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58765.log.gz 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47537.log 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz/var/log/ceph/ceph-client.admin.47271.log: 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59664.log 2023-11-04T01:59:31.093 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54665.log 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48996.log 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59664.log: /var/log/ceph/ceph-client.admin.54665.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47537.log.gz 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47407.log 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59664.log.gz 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54665.log.gz 2023-11-04T01:59:31.094 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57097.log 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48996.log.gz 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57444.log 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47407.log: /var/log/ceph/ceph-client.admin.57097.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.47407.log.gz --verbose 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.56366.log 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57097.log.gz 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57368.log 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57444.log.gz 2023-11-04T01:59:31.095 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52891.log 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56366.log: /var/log/ceph/ceph-client.admin.57368.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.53983.log.gz 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56366.log.gz 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57368.log.gz 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52891.log.gz/var/log/ceph/ceph-client.admin.43847.log: 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2023-11-04T01:59:31.096 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54561.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53851.log 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48177.log 2023-11-04T01:59:31.097 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58077.log 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53851.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.48177.log: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58077.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.48177.log.gz --verbose 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.59636.log 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58077.log.gz 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61022.log 2023-11-04T01:59:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48659.log 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59636.log: /var/log/ceph/ceph-client.admin.61022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59530.log 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59636.log.gz 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61022.log.gz 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48944.log 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60752.log 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48659.log.gz 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2023-11-04T01:59:31.099 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59530.log.gz 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48944.log.gz 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48335.log 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60752.log.gz 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56997.log 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44413.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48335.log.gz 2023-11-04T01:59:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47694.log 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60181.log 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60181.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47694.log.gz 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49648.log 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56997.log.gz 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60181.log.gz 2023-11-04T01:59:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60350.log 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49648.log.gz 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61160.log 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46690.log: /var/log/ceph/ceph-client.admin.60350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54134.log 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60350.log.gz 2023-11-04T01:59:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55694.log 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56251.log 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55694.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61160.log.gz 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54134.log.gz 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47088.log 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55694.log.gz 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56251.log.gz 2023-11-04T01:59:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55238.log 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47088.log.gz 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55238.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz -- 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.46318.log 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55238.log.gz 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53431.log 2023-11-04T01:59:31.104 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49937.log 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44517.log 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46318.log.gz 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53431.log.gz 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55996.log 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49937.log.gz 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59372.log 2023-11-04T01:59:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49343.log 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44517.log.gz 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59372.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55996.log.gz 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54238.log 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59372.log.gz 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48449.log 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49343.log.gz 2023-11-04T01:59:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48449.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54238.log.gz 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48449.log.gz 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54717.log 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53196.log 2023-11-04T01:59:31.107 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58139.log 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54795.log 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54717.log.gz 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53196.log.gz 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59690.log 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58139.log.gz 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60914.log 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54431.log 2023-11-04T01:59:31.108 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54795.log.gz 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60914.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59690.log.gz 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45141.log 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60914.log.gz 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45864.log 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60218.log 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54431.log.gz 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45864.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45141.log.gz 2023-11-04T01:59:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44229.log 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45864.log.gz 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49674.log 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60218.log.gz 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44229.log.gz 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51918.log 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2023-11-04T01:59:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52962.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51918.log.gz 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50676.log 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57680.log 2023-11-04T01:59:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52360.log 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57680.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50676.log.gz 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54899.log 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57680.log.gz 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58579.log 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51173.log 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52360.log.gz 2023-11-04T01:59:31.112 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54899.log.gz/var/log/ceph/ceph-client.admin.58579.log: 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60581.log 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58579.log.gz 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60414.log 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47034.log 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51173.log.gz 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60581.log.gz 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60414.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-04T01:59:31.113 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60414.log.gz 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.47034.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59398.log 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49048.log 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47034.log.gz 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52253.log 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59398.log.gz 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48423.log 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2023-11-04T01:59:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52253.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49048.log.gz 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51596.log 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52253.log.gz 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48423.log.gz 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56971.log 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51596.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51225.log 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51596.log.gz 2023-11-04T01:59:31.115 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52438.log 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58337.log 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51225.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56971.log.gz 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48203.log 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52438.log.gz 88.9% 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51225.log.gz 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61932.log 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58337.log: /var/log/ceph/ceph-client.admin.48203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49265.log 2023-11-04T01:59:31.116 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58337.log.gz 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48203.log.gz 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59909.log/var/log/ceph/ceph-client.admin.61932.log: 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60611.log 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49265.log: /var/log/ceph/ceph-client.admin.59909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57734.log 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49265.log.gz 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59909.log.gz 2023-11-04T01:59:31.117 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51840.log 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60611.log: /var/log/ceph/ceph-client.admin.57734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47062.log 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60611.log.gz 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57734.log.gz 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51462.log 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51840.log: /var/log/ceph/ceph-client.admin.47062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48255.log 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51840.log.gz 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47062.log.gz 2023-11-04T01:59:31.118 INFO:teuthology.orchestra.run.smithi040.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.61932.log.gz 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48255.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51462.log.gz 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47589.log 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48255.log.gz 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59805.log 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47589.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2023-11-04T01:59:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46559.log 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47589.log.gz 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59805.log.gz 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51364.log 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58817.log 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57268.log 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51364.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46559.log.gz 2023-11-04T01:59:31.120 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58817.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51364.log.gz 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58817.log.gz 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54977.log 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- 89.6% /var/log/ceph/ceph-client.admin.56127.log 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57268.log.gz 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.54977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54977.log.gz 2023-11-04T01:59:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46716.log 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49518.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56127.log.gz 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59226.log 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55969.log 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59226.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46716.log.gz 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44516.log 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59226.log.gz 2023-11-04T01:59:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38012.log 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55969.log.gz 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49570.log 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57930.log 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.38012.log: /var/log/ceph/ceph-client.admin.49570.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44516.log.gz 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59424.log 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38012.log.gz 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49570.log.gz 2023-11-04T01:59:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57930.log: /var/log/ceph/ceph-client.admin.59424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49135.log 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59424.log.gz 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46292.log 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51277.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57930.log.gz 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54769.log 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46292.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49135.log.gz 2023-11-04T01:59:31.124 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55564.log 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54769.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46292.log.gz 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54613.log 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.55564.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47979.log 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54769.log.gz 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54613.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55564.log.gz 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60324.log 2023-11-04T01:59:31.125 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54613.log.gz 2023-11-04T01:59:31.127 INFO:teuthology.orchestra.run.smithi091.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-04T01:59:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61331.log 2023-11-04T01:59:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47979.log: /var/log/ceph/ceph-client.admin.60324.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.60324.log.gz -- 2023-11-04T01:59:31.182 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.52787.log 2023-11-04T01:59:31.182 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47979.log.gz 2023-11-04T01:59:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2023-11-04T01:59:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61331.log: /var/log/ceph/ceph-client.admin.52787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56022.log 2023-11-04T01:59:31.182 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61331.log.gz 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52787.log.gz 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58658.log 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44930.log: /var/log/ceph/ceph-client.admin.56022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61738.log 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57047.log 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6%/var/log/ceph/ceph-client.admin.61738.log: -- replaced with /var/log/ceph/ceph-client.admin.56022.log.gz 2023-11-04T01:59:31.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58658.log.gz 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56217.log 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61738.log.gz 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54951.log 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57047.log: /var/log/ceph/ceph-client.admin.56217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56217.log.gz 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.54951.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2023-11-04T01:59:31.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60700.log 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57047.log.gz 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52206.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54951.log.gz 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60700.log.gz 2023-11-04T01:59:31.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45219.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55460.log 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47355.log 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55460.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50867.log 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55460.log.gz 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47355.log: -- /var/log/ceph/ceph-client.admin.55590.log 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2023-11-04T01:59:31.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50867.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47355.log.gz 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52490.log 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50867.log.gz 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51762.log: -- replaced with /var/log/ceph/ceph-client.admin.55590.log.gz 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52490.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.51488.log -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52490.log.gz 2023-11-04T01:59:31.187 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49707.log: /var/log/ceph/ceph-client.admin.51488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49965.log 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51488.log.gz 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47166.log 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49965.log.gz 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47166.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2023-11-04T01:59:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47824.log 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60386.log 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47166.log.gz 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61891.log 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60386.log: /var/log/ceph/ceph-client.admin.61891.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47824.log.gz 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52761.log 2023-11-04T01:59:31.189 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60386.log.gz 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55668.log 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59608.log 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52761.log.gz 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54457.log 2023-11-04T01:59:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55668.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55668.log.gz 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59608.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.61891.log.gz 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59608.log.gz 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60646.log 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55346.log 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49544.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54457.log.gz 2023-11-04T01:59:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48913.log 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55346.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60646.log.gz 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60125.log 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48913.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55346.log.gz 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53405.log 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48913.log.gz 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45349.log 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44203.log 2023-11-04T01:59:31.192 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60125.log.gz 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53405.log.gz 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50815.log 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44203.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45349.log.gz 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46422.log 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44203.log.gz 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53773.log 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2023-11-04T01:59:31.193 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50815.log.gz 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46422.log: /var/log/ceph/ceph-client.admin.53773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50841.log 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46422.log.gz 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48888.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53773.log.gz 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60940.log 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58739.log 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz 2023-11-04T01:59:31.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60940.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50841.log.gz 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54847.log 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60940.log.gz 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46982.log 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51866.log 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58739.log.gz 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54847.log: /var/log/ceph/ceph-client.admin.46982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48043.log 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54847.log.gz 2023-11-04T01:59:31.195 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46982.log.gz 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59831.log 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48043.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51866.log.gz 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3%/var/log/ceph/ceph-client.admin.59831.log: -- replaced with /var/log/ceph/ceph-client.admin.48043.log.gz 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54353.log 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58843.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59831.log.gz 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60551.log 2023-11-04T01:59:31.196 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44907.log 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60551.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54353.log.gz 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60551.log.gz 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44907.log.gz 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2023-11-04T01:59:31.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46344.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55134.log 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gz 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%/var/log/ceph/ceph-client.admin.44515.log: -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2023-11-04T01:59:31.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50133.log 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50624.log 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48866.log: /var/log/ceph/ceph-client.admin.50133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59582.log 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50133.log.gz 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59279.log 2023-11-04T01:59:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56313.log 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59582.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50624.log.gz 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54873.log 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59582.log.gz 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59279.log.gz 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44933.log 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44719.log 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56313.log.gz 2023-11-04T01:59:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58454.log 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54873.log.gz 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44933.log.gz 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47511.log 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59252.log 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44719.log.gz 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58454.log: /var/log/ceph/ceph-client.admin.47511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58113.log 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58454.log.gz 2023-11-04T01:59:31.201 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46240.log 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54483.log 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58113.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59252.log.gz 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58113.log.gz 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5%/var/log/ceph/ceph-client.admin.54483.log: -- replaced with /var/log/ceph/ceph-client.admin.46240.log.gz 2023-11-04T01:59:31.202 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60075.log 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54483.log.gz 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60075.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57760.log 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56877.log 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60075.log.gz 2023-11-04T01:59:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50650.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57760.log.gz 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45560.log 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60888.log 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0%/var/log/ceph/ceph-client.admin.56877.log: -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56877.log.gz 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60888.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45560.log.gz 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2023-11-04T01:59:31.204 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60888.log.gz 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61712.log 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47563.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54691.log 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55186.log 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61712.log.gz 2023-11-04T01:59:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46032.log: /var/log/ceph/ceph-client.admin.54691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50159.log 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55186.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54691.log.gz -5 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59483.log 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55186.log.gz 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50159.log.gz 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45323.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2023-11-04T01:59:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55746.log 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44255.log 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59483.log.gz 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47921.log 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52181.log 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44255.log: /var/log/ceph/ceph-client.admin.47921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53509.log 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.55746.log.gz 2023-11-04T01:59:31.207 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44255.log.gz 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52181.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47921.log.gz 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52181.log.gz 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51656.log 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53509.log.gz 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56661.log 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47798.log: /var/log/ceph/ceph-client.0.48764.log 2023-11-04T01:59:31.208 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51656.log.gz 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55796.log 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56661.log.gz 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45193.log 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.48764.log: /var/log/ceph/ceph-client.admin.55796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46162.log 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61269.log 2023-11-04T01:59:31.209 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55796.log.gz 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46162.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45193.log.gz 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.0.48764.log.gz 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59720.log 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61269.log.gz 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2023-11-04T01:59:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59937.log 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47668.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59720.log.gz 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip 88.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz -- 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.55264.log 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58260.log 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59937.log: /var/log/ceph/ceph-client.admin.55264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46214.log 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%/var/log/ceph/ceph-client.admin.58260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50107.log 2023-11-04T01:59:31.211 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55264.log.gz 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59937.log.gz 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46214.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58260.log.gz 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53092.log 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46214.log.gz 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61477.log 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50107.log: /var/log/ceph/ceph-client.admin.53092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47485.log 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50107.log.gz 2023-11-04T01:59:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55512.log 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53092.log.gz 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52735.log 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47485.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61477.log.gz 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48151.log 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47485.log.gz 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55512.log.gz 2023-11-04T01:59:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55432.log 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52735.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50711.log 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52735.log.gz/var/log/ceph/ceph-client.admin.48151.log: 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61686.log 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48151.log.gz 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48229.log 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55432.log.gz 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50711.log: /var/log/ceph/ceph-client.admin.61686.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50711.log.gz 2023-11-04T01:59:31.214 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61686.log.gz 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51251.log 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48229.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48229.log.gz 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57127.log 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46136.log 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51251.log.gz 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44033.log 2023-11-04T01:59:31.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54587.log 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57127.log.gz 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46136.log.gz 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44033.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44033.log.gz 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46956.log 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50945.log 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46956.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55616.log 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54587.log.gz 2023-11-04T01:59:31.216 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46956.log.gz 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50945.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50945.log.gz 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48069.log 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55616.log.gz 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48069.log.gz 2023-11-04T01:59:31.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44726.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53695.log 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49466.log 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53695.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.58791.log 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53695.log.gz 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49466.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49466.log.gz 2023-11-04T01:59:31.218 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59883.log 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58791.log.gz 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59883.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61109.log 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45427.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59883.log.gz 2023-11-04T01:59:31.219 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54266.log 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56771.log 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.61109.log: /var/log/ceph/ceph-client.admin.54266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56771.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54266.log.gz 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56771.log.gz 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44931.log 2023-11-04T01:59:31.220 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%/var/log/ceph/ceph-client.admin.45115.log: -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55042.log 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53379.log 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5%/var/log/ceph/ceph-client.admin.55042.log: -- replaced with /var/log/ceph/ceph-client.admin.44931.log.gz 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55042.log.gz 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56509.log 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49291.log 2023-11-04T01:59:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56509.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53379.log.gz 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56509.log.gz 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46637.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49291.log.gz 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51068.log 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2023-11-04T01:59:31.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51068.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51068.log.gz 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60778.log 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44063.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr: 95.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57520.log 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.0.61109.log.gz 2023-11-04T01:59:31.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54108.log 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60778.log.gz 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57520.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.57520.log.gz 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54821.log 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54821.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54108.log.gz 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46110.log 2023-11-04T01:59:31.224 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54821.log.gz 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44928.log: /var/log/ceph/ceph-client.admin.43873.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57596.log 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3%/var/log/ceph/ceph-client.admin.57596.log: -- replaced with /var/log/ceph/ceph-client.admin.46110.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59172.log 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.225 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57596.log.gz 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49239.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53222.log 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7%/var/log/ceph/ceph-client.admin.44335.log: -- replaced with /var/log/ceph/ceph-client.admin.59172.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60726.log 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53222.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53222.log.gz 2023-11-04T01:59:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56915.log 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49369.log 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.56915.log: -- replaced with /var/log/ceph/ceph-client.admin.60726.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56915.log.gz 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49369.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49369.log.gz 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45271.log 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59345.log 2023-11-04T01:59:31.227 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8%/var/log/ceph/ceph-client.admin.45271.log: -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58552.log 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45271.log.gz 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59345.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59345.log.gz 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59857.log 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45375.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58552.log.gz 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44307.log 2023-11-04T01:59:31.228 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51996.log 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59857.log: /var/log/ceph/ceph-client.admin.44307.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59857.log.gz 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44307.log.gz 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49109.log 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.51996.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58229.log 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49109.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58229.log: 91.2% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49109.log.gz 2023-11-04T01:59:31.229 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51996.log.gz 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58229.log.gz 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49622.log 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58389.log 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50443.log 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58389.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49622.log.gz 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58389.log.gz 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2023-11-04T01:59:31.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44508.log: 90.6% 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50443.log.gz 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53014.log 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53014.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2023-11-04T01:59:31.231 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59113.log 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53014.log.gz 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51121.log: /var/log/ceph/ceph-client.admin.48397.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56394.log 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56277.log 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56394.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59113.log.gz 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2023-11-04T01:59:31.232 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59037.log 2023-11-04T01:59:31.233 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56394.log.gz 2023-11-04T01:59:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49213.log: /var/log/ceph/ceph-client.admin.56277.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2023-11-04T01:59:31.233 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56277.log.gz 2023-11-04T01:59:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49993.log 2023-11-04T01:59:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49421.log 2023-11-04T01:59:31.233 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54509.log 2023-11-04T01:59:31.234 INFO:teuthology.orchestra.run.smithi091.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-04T01:59:31.275 INFO:teuthology.orchestra.run.smithi040.stderr: 91.4% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59037.log.gz 2023-11-04T01:59:31.275 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49421.log: -- replaced with /var/log/ceph/ceph-client.admin.49993.log.gz 2023-11-04T01:59:31.276 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49421.log.gz 2023-11-04T01:59:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47008.log 2023-11-04T01:59:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61978.log 2023-11-04T01:59:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2023-11-04T01:59:31.276 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54509.log.gz 2023-11-04T01:59:31.276 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61978.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47008.log.gz 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.61978.log.gz 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46611.log 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59200.log 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3%/var/log/ceph/ceph-client.admin.54070.log: -- replaced with /var/log/ceph/ceph-client.admin.46611.log.gz 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58713.log 2023-11-04T01:59:31.277 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58632.log 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59200.log: /var/log/ceph/ceph-client.admin.58713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61451.log 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59200.log.gz 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58632.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58713.log.gz 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58632.log.gz 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56745.log 2023-11-04T01:59:31.278 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51147.log 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58927.log 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61451.log.gz 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56745.log.gz 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51147.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51147.log.gz 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55108.log 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49832.log 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61213.log 2023-11-04T01:59:31.279 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58927.log.gz 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49832.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55108.log.gz 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49832.log.gz 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52709.log 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53144.log 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59454.log 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61213.log.gz 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52709.log.gz 2023-11-04T01:59:31.280 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53144.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53144.log.gz 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52683.log 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54535.log 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54405.log 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59454.log.gz 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52683.log.gz 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54535.log.gz 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48477.log 2023-11-04T01:59:31.281 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48477.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54405.log.gz 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44708.log 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57418.log 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.44724.log: -- replaced with /var/log/ceph/ceph-client.admin.48477.log.gz 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44708.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44708.log.gz 2023-11-04T01:59:31.282 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56851.log 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56430.log 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57418.log: /var/log/ceph/ceph-client.admin.56851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54186.log 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57418.log.gz 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56851.log.gz 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56430.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56430.log.gz 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61357.log 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53457.log 2023-11-04T01:59:31.283 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54186.log.gz 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57470.log 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61357.log.gz/var/log/ceph/ceph-client.admin.53457.log: 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57470.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53457.log.gz 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61607.log 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57470.log.gz 2023-11-04T01:59:31.284 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51039.log 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56461.log 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51039.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61607.log.gz 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51039.log.gz 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58051.log 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58051.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56461.log.gz 2023-11-04T01:59:31.285 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46266.log 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58051.log.gz 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60155.log: /var/log/ceph/ceph-client.admin.48607.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55160.log 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50546.log 2023-11-04T01:59:31.286 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9%/var/log/ceph/ceph-client.admin.55160.log: -- replaced with /var/log/ceph/ceph-client.admin.46266.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56713.log 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55160.log.gz 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50546.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50546.log.gz 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57570.log 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61529.log 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3%/var/log/ceph/ceph-client.admin.57570.log: -- replaced with /var/log/ceph/ceph-client.admin.56713.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47850.log 2023-11-04T01:59:31.287 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57570.log.gz 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61529.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61529.log.gz 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55642.log 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47850.log.gz 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2023-11-04T01:59:31.288 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55642.log: /var/log/ceph/ceph-client.admin.56187.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55642.log.gz 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44005.log 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6%/var/log/ceph/ceph-client.admin.44005.log: -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61790.log 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.289 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44005.log.gz 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50237.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57980.log 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%/var/log/ceph/ceph-client.admin.47219.log: -- replaced with /var/log/ceph/ceph-client.admin.61790.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58193.log 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2023-11-04T01:59:31.290 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57980.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57980.log.gz 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60024.log 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9%/var/log/ceph/ceph-client.admin.44499.log: -- replaced with /var/log/ceph/ceph-client.admin.58193.log.gz 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.60024.log: 92.9% -- replaced with /var/log/ceph/ceph-client.0.60024.log.gz 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53170.log 2023-11-04T01:59:31.291 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58415.log 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0%/var/log/ceph/ceph-client.admin.53170.log: -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50598.log 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53170.log.gz 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58415.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58415.log.gz 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45297.log 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52917.log 2023-11-04T01:59:31.292 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45297.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50598.log.gz 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48581.log 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45297.log.gz/var/log/ceph/ceph-client.admin.52917.log: 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52917.log.gz 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45245.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51682.log 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48581.log.gz 2023-11-04T01:59:31.293 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44725.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55406.log 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53878.log 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%/var/log/ceph/ceph-client.admin.55406.log: -- replaced with /var/log/ceph/ceph-client.admin.51682.log.gzgzip 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53721.log 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53878.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55406.log.gz 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.53878.log.gz 2023-11-04T01:59:31.294 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50789.log 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50339.log 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%/var/log/ceph/ceph-client.admin.50789.log: -- replaced with /var/log/ceph/ceph-client.admin.53721.log.gz 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50789.log.gz 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50339.log: /var/log/ceph/ceph-client.admin.46742.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50339.log.gz 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2023-11-04T01:59:31.295 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50971.log 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50289.log 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50971.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53255.log 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50289.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50971.log.gz 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50289.log.gz 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60862.log 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53255.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33158.log 2023-11-04T01:59:31.296 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8%/var/log/ceph/ceph-client.admin.60862.log: -- replaced with /var/log/ceph/ceph-client.admin.53255.log.gz 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61243.log 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60862.log.gz 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.tmp-client.admin.33158.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33158.log.gz 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60970.log 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52412.log 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3%/var/log/ceph/ceph-client.admin.60970.log: -- replaced with /var/log/ceph/ceph-client.admin.61243.log.gzgzip 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61425.log 2023-11-04T01:59:31.297 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60970.log.gz 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52412.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52412.log.gz 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49492.log 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49492.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61425.log.gz 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48970.log 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49492.log.gz 2023-11-04T01:59:31.298 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54743.log: /var/log/ceph/ceph-client.admin.48970.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48970.log.gz 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61383.log 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58684.log 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61383.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49911.log 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:59:31.299 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4%/var/log/ceph/ceph-client.admin.58684.log: -- replaced with /var/log/ceph/ceph-client.admin.61383.log.gz 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49911.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58684.log.gz 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54925.log 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58526.log 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.58526.log: -- replaced with /var/log/ceph/ceph-client.admin.54925.log.gz 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58526.log.gz 2023-11-04T01:59:31.300 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53591.log 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1%/var/log/ceph/ceph-client.admin.47297.log: -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.c.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53591.log.gz 2023-11-04T01:59:31.301 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60996.log 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44387.log: /var/log/ceph/ceph-client.admin.45890.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57706.log 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.60996.log.gz 2023-11-04T01:59:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43979.log 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57706.log.gz 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56072.log 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43979.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43979.log.gz 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56072.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56072.log.gz 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49858.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 2023-11-04T01:59:31.303 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61660.log 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45401.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53643.log 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61660.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61660.log.gz 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53287.log 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53643.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53643.log.gz 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53287.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53287.log.gz 2023-11-04T01:59:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54160.log 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50079.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46800.log 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54160.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54160.log.gz 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47459.log 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46800.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46800.log.gz 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46370.log 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47459.log.gz 2023-11-04T01:59:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61503.log 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46370.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46370.log.gz 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49187.log 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61503.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61503.log.gz 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59087.log 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49187.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49187.log.gz 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59087.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59087.log.gz 2023-11-04T01:59:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54212.log 2023-11-04T01:59:31.307 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48097.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2023-11-04T01:59:31.307 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54639.log 2023-11-04T01:59:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54212.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54212.log.gz 2023-11-04T01:59:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51199.log 2023-11-04T01:59:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54639.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54639.log.gz 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46474.log 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51199.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51199.log.gz 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46474.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46474.log.gz 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57189.log 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47947.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2023-11-04T01:59:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57189.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57189.log.gz 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51630.log 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53825.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48816.log 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51630.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51630.log.gz 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58500.log 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48816.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48816.log.gz 2023-11-04T01:59:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55909.log 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58500.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58500.log.gz 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61555.log 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55909.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55909.log.gz 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52988.log 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61555.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61555.log.gz 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57215.log 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52988.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52988.log.gz 2023-11-04T01:59:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57153.log 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57215.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58289.log 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57153.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57153.log.gz 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44721.log 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58289.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58289.log.gz 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38121.log 2023-11-04T01:59:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44721.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44721.log.gz 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52101.log 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.38121.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38121.log.gz 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.52101.log: 89.5% -- replaced with /var/log/ceph/ceph-client.0.52101.log.gz 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53669.log 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48841.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2023-11-04T01:59:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53669.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53669.log.gz 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50515.log 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45954.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55538.log 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50515.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50515.log.gz 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59753.log 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55538.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55538.log.gz 2023-11-04T01:59:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49739.log 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59753.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59753.log.gz 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49739.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49739.log.gz 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2023-11-04T01:59:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44504.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58166.log 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44727.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58166.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58166.log.gz 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56687.log 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45980.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz 2023-11-04T01:59:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55720.log 2023-11-04T01:59:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56687.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56687.log.gz 2023-11-04T01:59:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58982.log 2023-11-04T01:59:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55720.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55720.log.gz 2023-11-04T01:59:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61581.log 2023-11-04T01:59:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.58982.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.58982.log.gz 2023-11-04T01:59:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2023-11-04T01:59:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61581.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61581.log.gz 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55212.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49161.log 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49395.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49161.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49161.log.gz 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47329.log 2023-11-04T01:59:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47772.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59779.log 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47329.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47329.log.gz 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50263.log 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59779.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59779.log.gz 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52278.log 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50263.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50263.log.gz 2023-11-04T01:59:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60296.log 2023-11-04T01:59:31.338 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52278.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52278.log.gz 2023-11-04T01:59:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61816.log 2023-11-04T01:59:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60296.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60296.log.gz 2023-11-04T01:59:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2023-11-04T01:59:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61816.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61816.log.gz 2023-11-04T01:59:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52464.log 2023-11-04T01:59:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53040.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2023-11-04T01:59:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61054.log 2023-11-04T01:59:31.341 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52464.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52464.log.gz 2023-11-04T01:59:31.341 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44439.log 2023-11-04T01:59:31.342 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61054.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61054.log.gz 2023-11-04T01:59:31.342 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2023-11-04T01:59:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44439.log.gz 2023-11-04T01:59:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56535.log 2023-11-04T01:59:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz 2023-11-04T01:59:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45819.log 2023-11-04T01:59:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56535.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56535.log.gz 2023-11-04T01:59:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58895.log 2023-11-04T01:59:31.348 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.2.45819.log: 91.4% -- replaced with /var/log/ceph/ceph-client.2.45819.log.gz 2023-11-04T01:59:31.348 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61305.log 2023-11-04T01:59:31.349 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58895.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58895.log.gz 2023-11-04T01:59:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61764.log 2023-11-04T01:59:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61305.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61305.log.gz 2023-11-04T01:59:31.351 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46664.log 2023-11-04T01:59:31.352 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61764.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61764.log.gz 2023-11-04T01:59:31.352 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2023-11-04T01:59:31.353 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46664.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46664.log.gz 2023-11-04T01:59:31.353 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2023-11-04T01:59:31.354 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47381.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2023-11-04T01:59:31.355 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48363.log 2023-11-04T01:59:31.356 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46878.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2023-11-04T01:59:31.356 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46188.log 2023-11-04T01:59:31.357 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48363.log: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 91.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-04T01:59:31.357 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.357 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48363.log.gz 2023-11-04T01:59:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48529.log 2023-11-04T01:59:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2023-11-04T01:59:31.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47876.log 2023-11-04T01:59:31.359 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46188.log.gz 2023-11-04T01:59:31.359 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48529.log.gz 2023-11-04T01:59:31.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43783.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2023-11-04T01:59:31.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2023-11-04T01:59:31.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46448.log 2023-11-04T01:59:31.360 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%/var/log/ceph/ceph-client.admin.51095.log: -- replaced with /var/log/ceph/ceph-client.admin.47876.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44281.log 2023-11-04T01:59:31.360 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.362 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gz 2023-11-04T01:59:31.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46448.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46448.log.gz 2023-11-04T01:59:31.362 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45453.log 2023-11-04T01:59:31.362 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57798.log 2023-11-04T01:59:31.362 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%/var/log/ceph/ceph-client.admin.45453.log: -- replaced with /var/log/ceph/ceph-client.admin.44281.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52577.log 2023-11-04T01:59:31.363 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.363 INFO:teuthology.orchestra.run.smithi040.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45453.log.gz 2023-11-04T01:59:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57798.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57798.log.gz 2023-11-04T01:59:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2023-11-04T01:59:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60270.log 2023-11-04T01:59:31.365 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3%/var/log/ceph/ceph-client.admin.47193.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.52577.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.45683.log 2023-11-04T01:59:31.365 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.365 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60270.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2023-11-04T01:59:31.365 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60270.log.gz 2023-11-04T01:59:31.365 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60836.log 2023-11-04T01:59:31.367 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.45683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.60836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53747.log 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr: 89.7%/var/log/ceph/ceph-client.admin.44465.log: -- replaced with /var/log/ceph/ceph-client.admin.60836.log.gz 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.45683.log.gz 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47720.log 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61634.log 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4%/var/log/ceph/ceph-client.admin.47720.log: -- replaced with /var/log/ceph/ceph-client.admin.53747.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51892.log 2023-11-04T01:59:31.368 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.369 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47720.log.gz 2023-11-04T01:59:31.369 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.61634.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61634.log.gz 2023-11-04T01:59:31.369 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57622.log 2023-11-04T01:59:31.369 INFO:teuthology.orchestra.run.smithi091.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-04T01:59:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2023-11-04T01:59:31.372 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3%/var/log/ceph/ceph-client.admin.57622.log: -- replaced with /var/log/ceph/ceph-client.admin.51892.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57301.log 2023-11-04T01:59:31.372 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.372 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57622.log.gz 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43750.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4%/var/log/ceph/ceph-client.admin.50490.log: -- replaced with /var/log/ceph/ceph-client.admin.57301.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56157.log 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2023-11-04T01:59:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2023-11-04T01:59:31.374 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56797.log 2023-11-04T01:59:31.374 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52629.log 2023-11-04T01:59:31.374 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3%/var/log/ceph/ceph-client.admin.56797.log: -- replaced with /var/log/ceph/ceph-client.admin.56157.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54327.log 2023-11-04T01:59:31.374 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.374 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56797.log.gz 2023-11-04T01:59:31.374 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52629.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52629.log.gz 2023-11-04T01:59:31.377 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56823.log 2023-11-04T01:59:31.377 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50394.log 2023-11-04T01:59:31.377 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%/var/log/ceph/ceph-client.admin.56823.log: -- replaced with /var/log/ceph/ceph-client.admin.54327.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48281.log 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56823.log.gz 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.50394.log: 88.6% -- replaced with /var/log/ceph/ceph-client.0.50394.log.gz 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58363.log 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51410.log 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5%/var/log/ceph/ceph-client.admin.58363.log: -- replaced with /var/log/ceph/ceph-client.admin.48281.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57828.log 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.378 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58363.log.gz 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51410.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51410.log.gz 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59969.log 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51944.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57828.log.gz 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52603.log 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59969.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59969.log.gz 2023-11-04T01:59:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52231.log 2023-11-04T01:59:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2023-11-04T01:59:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52231.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52603.log.gz 2023-11-04T01:59:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52813.log 2023-11-04T01:59:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47114.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52231.log.gz 2023-11-04T01:59:31.383 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53799.log 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49074.log 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52813.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57242.log 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53799.log: 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49074.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53799.log.gz 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49074.log.gz 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60807.log 2023-11-04T01:59:31.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55010.log 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7%/var/log/ceph/ceph-client.admin.60807.log: -- replaced with /var/log/ceph/ceph-client.admin.57242.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60807.log.gz 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55010.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55010.log.gz 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58605.log 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46768.log 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.58605.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2023-11-04T01:59:31.385 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54041.log 2023-11-04T01:59:31.389 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46768.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58605.log.gz 2023-11-04T01:59:31.389 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46768.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46826.log 2023-11-04T01:59:31.389 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54041.log: /var/log/ceph/ceph-client.admin.46826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59556.log 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54041.log.gz 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46826.log.gz 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55935.log 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2023-11-04T01:59:31.390 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8%/var/log/ceph/ceph-client.admin.55935.log: -- replaced with /var/log/ceph/ceph-client.admin.59556.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55318.log 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55935.log.gz 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46396.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57654.log 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57654.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55318.log.gz 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49317.log 2023-11-04T01:59:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59139.log 2023-11-04T01:59:31.392 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57654.log.gz 2023-11-04T01:59:31.392 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44123.log: /var/log/ceph/ceph-client.admin.49317.log: 88.7% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2023-11-04T01:59:31.392 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49317.log.gz 2023-11-04T01:59:31.392 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46930.log 2023-11-04T01:59:31.392 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2023-11-04T01:59:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46930.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59310.log 2023-11-04T01:59:31.394 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59139.log.gz 2023-11-04T01:59:31.394 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46930.log.gz 2023-11-04T01:59:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46585.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2023-11-04T01:59:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56945.log 2023-11-04T01:59:31.395 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.59310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55853.log 2023-11-04T01:59:31.395 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4%/var/log/ceph/ceph-client.admin.56945.log: -- replaced with /var/log/ceph/ceph-client.admin.59310.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53563.log 2023-11-04T01:59:31.395 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.395 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56945.log.gz 2023-11-04T01:59:31.396 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.55853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52334.log 2023-11-04T01:59:31.396 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56561.log 2023-11-04T01:59:31.397 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53563.log: /var/log/ceph/ceph-client.admin.52334.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53563.log.gz 2023-11-04T01:59:31.398 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52334.log.gz 2023-11-04T01:59:31.398 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52516.log 2023-11-04T01:59:31.398 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.56561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2023-11-04T01:59:31.399 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52516.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52516.log.gz 2023-11-04T01:59:31.399 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56561.log.gz 2023-11-04T01:59:31.399 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 2023-11-04T01:59:31.400 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2023-11-04T01:59:31.401 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46904.log: /var/log/ceph/ceph-client.admin.44924.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz 2023-11-04T01:59:31.401 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2023-11-04T01:59:31.401 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58021.log 2023-11-04T01:59:31.402 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52386.log 2023-11-04T01:59:31.402 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44519.log: /var/log/ceph/ceph-client.admin.58021.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2023-11-04T01:59:31.402 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58021.log.gz 2023-11-04T01:59:31.402 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2023-11-04T01:59:31.404 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54379.log 2023-11-04T01:59:31.404 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52386.log: /var/log/ceph/ceph-client.admin.44518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52386.log.gz 2023-11-04T01:59:31.404 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2023-11-04T01:59:31.404 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2023-11-04T01:59:31.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57854.log 2023-11-04T01:59:31.405 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54379.log: /var/log/ceph/ceph-client.admin.45167.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54379.log.gz 2023-11-04T01:59:31.405 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2023-11-04T01:59:31.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56340.log 2023-11-04T01:59:31.405 INFO:teuthology.orchestra.run.smithi040.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.55853.log.gz 2023-11-04T01:59:31.406 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.57854.log: /var/log/ceph/ceph-client.admin.56340.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57854.log.gz 2023-11-04T01:59:31.406 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56340.log.gz 2023-11-04T01:59:31.506 INFO:teuthology.orchestra.run.smithi091.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-04T01:59:31.636 INFO:teuthology.orchestra.run.smithi091.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-04T01:59:31.656 INFO:teuthology.orchestra.run.smithi091.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-04T01:59:31.761 INFO:teuthology.orchestra.run.smithi091.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-04T01:59:31.781 INFO:teuthology.orchestra.run.smithi091.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-04T01:59:31.783 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-11-04T01:59:31.783 INFO:teuthology.orchestra.run.smithi091.stderr:real 0m0.760s 2023-11-04T01:59:31.783 INFO:teuthology.orchestra.run.smithi091.stderr:user 0m3.639s 2023-11-04T01:59:31.784 INFO:teuthology.orchestra.run.smithi091.stderr:sys 0m0.151s 2023-11-04T01:59:31.812 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-04T01:59:31.859 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-04T01:59:31.883 INFO:teuthology.orchestra.run.smithi040.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-04T01:59:31.892 INFO:teuthology.orchestra.run.smithi040.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-04T01:59:31.987 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-04T01:59:31.988 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-11-04T01:59:31.988 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m0.977s 2023-11-04T01:59:31.989 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m4.695s 2023-11-04T01:59:31.989 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.327s 2023-11-04T01:59:31.990 INFO:tasks.ceph:Archiving logs... 2023-11-04T01:59:31.990 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/remote/smithi040/log 2023-11-04T01:59:31.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:59:32.971 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/remote/smithi091/log 2023-11-04T01:59:32.972 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:59:33.381 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:33.391 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T01:59:33.400 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:33.405 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T01:59:33.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:59:33.410 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:59:33.473 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T01:59:33.483 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T01:59:33.483 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:59:33.486 DEBUG:teuthology.orchestra.run.smithi091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:59:33.496 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T01:59:33.496 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2023-11-04T01:59:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:*hv01.front.sepi 44.4.53.2 2 u 31 64 377 0.094 -3.587 0.171 2023-11-04T01:59:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 64 377 0.097 -1.372 0.123 2023-11-04T01:59:33.497 INFO:teuthology.orchestra.run.smithi040.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.091 -0.378 0.173 2023-11-04T01:59:33.497 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-11-04T01:59:33.498 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T01:59:33.499 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2023-11-04T01:59:33.499 INFO:teuthology.orchestra.run.smithi091.stdout:*hv01.front.sepi 44.4.53.2 2 u 20 64 377 0.109 -10.631 1.098 2023-11-04T01:59:33.499 INFO:teuthology.orchestra.run.smithi091.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.104 -7.670 0.771 2023-11-04T01:59:33.499 INFO:teuthology.orchestra.run.smithi091.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.097 -6.226 0.960 2023-11-04T01:59:33.499 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-11-04T01:59:33.499 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T01:59:33.509 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T01:59:33.510 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T01:59:33.520 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T01:59:33.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T01:59:33.539 INFO:teuthology.task.internal:Duration was 2082.293437 seconds 2023-11-04T01:59:33.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T01:59:33.549 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T01:59:33.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:59:33.552 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:59:33.640 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T01:59:33.640 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-11-04T01:59:33.640 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:59:33.650 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi091.front.sepia.ceph.com 2023-11-04T01:59:33.651 DEBUG:teuthology.orchestra.run.smithi091:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:59:33.662 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T01:59:33.662 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:59:33.697 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:59:33.724 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T01:59:33.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:59:33.765 DEBUG:teuthology.orchestra.run.smithi091:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:59:33.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T01:59:33.844 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T01:59:33.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:59:33.857 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:59:33.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T01:59:33.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:33.901 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:33.910 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-11-04T01:59:33.922 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = core 2023-11-04T01:59:33.935 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:33.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:33.968 DEBUG:teuthology.orchestra.run.smithi091:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:33.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:33.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T01:59:33.990 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T01:59:33.990 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/remote/smithi040 2023-11-04T01:59:33.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:59:34.028 DEBUG:teuthology.misc:Transferring archived files from smithi091:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923/remote/smithi091 2023-11-04T01:59:34.028 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:59:34.047 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T01:59:34.047 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:59:34.069 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:59:34.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T01:59:34.107 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T01:59:34.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T01:59:34.117 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T01:59:34.118 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:59:34.120 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:59:34.123 INFO:teuthology.orchestra.run.smithi040.stdout: 655473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:59 /home/ubuntu/cephtest 2023-11-04T01:59:34.147 INFO:teuthology.orchestra.run.smithi091.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:59 /home/ubuntu/cephtest 2023-11-04T01:59:34.148 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T01:59:34.160 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T01:59:34.171 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:34.171 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T01:59:34.199 DEBUG:teuthology.nuke:shortname: smithi040 2023-11-04T01:59:34.199 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:59:34.220 DEBUG:teuthology.nuke:shortname: smithi091 2023-11-04T01:59:34.220 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:59:34.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:37.139718', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObjzkOIRGUA/IGRZGae37U/XDfCXtLtiK/EkhveSRNXY05XcUpf0WEB+mPgaqfQVuR3/mzKeWsP7F092gmawQc='} 2023-11-04T01:59:34.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445923', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:37.138360', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEGp5T0z04DJrPMtyLJse+C9AA/f1IUwrnreXuSXlkCBjRW4LDq6ssOWsdbrX8AQSoEspz75IP7kWmHJtBc1K1Q='} 2023-11-04T01:59:34.272 INFO:teuthology.orchestra.console.smithi040:Power off 2023-11-04T01:59:34.272 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:59:34.288 INFO:teuthology.orchestra.console.smithi091:Power off 2023-11-04T01:59:34.288 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:59:34.297 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-11-04T01:59:34.298 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:34.311 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-11-04T01:59:34.311 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:34.322 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-04T01:59:34.333 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-04T01:59:38.323 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:38.335 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:38.434 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-04T01:59:38.445 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-11-04T01:59:42.438 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:42.447 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:42.549 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-11-04T01:59:42.558 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-11-04T01:59:42.659 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-11-04T01:59:46.552 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:46.662 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-11-04T01:59:46.763 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-11-04T01:59:46.868 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 2082.2934370040894 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=65d6873a2bb84cf3aa4f3e0cc5110e38 status: fail success: false 2023-11-04T01:59:46.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:59:46.951 INFO:teuthology.run:FAIL